1
|
Moradi R, Kashanian M, Yarigholi F, Pazouki A, Sheikhtaheri A. Predicting pregnancy at the first year following metabolic-bariatric surgery: development and validation of machine learning models. Surg Endosc 2025; 39:2656-2667. [PMID: 40064691 DOI: 10.1007/s00464-025-11640-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2024] [Accepted: 02/21/2025] [Indexed: 03/26/2025]
Abstract
BACKGROUND Metabolic-bariatric surgery (MBS) is the last effective way to lose weight whom around half of the patients are women of reproductive age. It is recommended an interval of 12 months between surgery and pregnancy to optimize weight loss and nutritional status. Predicting pregnancy up to 12 months after MBS is important for evaluating reproductive health services in bariatric centers; therefore, this study aimed to present a prediction model for pregnancy at the first year following MBS using machine learning (ML) algorithms. METHODS In a nested case-control study of 473 women with a history of pregnancy after MBS during 2009-2023, predisposing factors in pregnancy within 12 months after MBS were identified and subsequently, several ML models, including the classification algorithms and decision trees, as well as regression analyses, were applied to predict pregnancy up to 12 months after MBS. RESULTS The highest area under the curve (AUC) was 0.920 ± 0.014 (95%CI 0.906, 0.927) for the C5.0 decision tree with sensitivity and specificity of 0.762 ± 0.044 (95%CI 0.739, 0.801) and 0.916 ± 0.028 (95%CI 0.883, 0.922), respectively. This model considered thirteen important factors to predict pregnancy at the first 12 months following MB, including menstrual irregularity, marital status, a history of abnormal fetal development, age, infertility type, parity, gravidity, fertility treatment, presurgery body mass index (BMI), infertility, infertility duration, polycystic ovary syndrome (PCOS), and type 2 diabetes (T2DM). CONCLUSION Developing the ML models, which predict pregnancy within 12 months after MBS, can help bariatric surgeons and obstetricians to prevent and manage suboptimal surgical response and adverse pregnancy outcomes.
Collapse
Affiliation(s)
- Raheleh Moradi
- Minimally Invasive Surgery Research Center, Iran University of Medical Sciences, Tehran, Iran.
| | - Maryam Kashanian
- Department of Obstetrics & Gynecology, Akbarabadi Teaching Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Fahime Yarigholi
- Division of Minimally Invasive and Bariatric Surgery, Minimally Invasive Surgery Research Center, Hazrat-E Fatemeh Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Abdolreza Pazouki
- Division of Minimally Invasive and Bariatric Surgery, Minimally Invasive Surgery Research Center, Hazrat-E Fatemeh Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Abbas Sheikhtaheri
- Department of Health Information Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
2
|
Kermansaravi M, Chiappetta S, Shahabi Shahmiri S, Varas J, Parmar C, Lee Y, Dang JT, Shabbir A, Hashimoto D, Davarpanah Jazi AH, Meireles OR, Aarts E, Almomani H, Alqahtani A, Aminian A, Behrens E, Birk D, Cantu FJ, Cohen RV, De Luca M, Di Lorenzo N, Dillemans B, ElFawal MH, Felsenreich DM, Gagner M, Galvan HG, Galvani C, Gawdat K, Ghanem OM, Haddad A, Himpens J, Kasama K, Kassir R, Khoursheed M, Khwaja H, Kow L, Lainas P, Lakdawala M, Tello RL, Mahawar K, Marchesini C, Masrur MA, Meza C, Musella M, Nimeri A, Noel P, Palermo M, Pazouki A, Ponce J, Prager G, Quiróz-Guadarrama CD, Rheinwalt KP, Rodriguez JG, Saber AA, Salminen P, Shikora SA, Stenberg E, Stier CK, Suter M, Szomstein S, Taskin HE, Vilallonga R, Wafa A, Yang W, Zorron R, Torres A, Kroh M, Zundel N. International expert consensus on the current status and future prospects of artificial intelligence in metabolic and bariatric surgery. Sci Rep 2025; 15:9312. [PMID: 40102585 PMCID: PMC11920084 DOI: 10.1038/s41598-025-94335-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2025] [Accepted: 03/13/2025] [Indexed: 03/20/2025] Open
Abstract
Artificial intelligence (AI) is transforming the landscape of medicine, including surgical science and practice. The evolution of AI from rule-based systems to advanced machine learning and deep learning algorithms has opened new avenues for its application in metabolic and bariatric surgery (MBS). AI has the potential to enhance various aspects of MBS, including education and training, decision-making, procedure planning, cost and time efficiency, optimization of surgical techniques, outcome and complication prediction, patient education, and access to care. However, concerns persist regarding the reliability of AI-generated decisions and associated ethical considerations. This study aims to establish a consensus on the role of AI in MBS using a modified Delphi method. A panel of 68 leading metabolic and bariatric surgeons from 35 countries participated in this consensus-building process, providing expert insights into the integration of AI in MBS. Of the 28 statements evaluated, a consensus of at least 70% was achieved for all, with 25 statements reaching consensus in the first round and the remaining three in the second round. Experts agreed that AI has the potential to enhance the evaluation of surgical skills in MBS by providing objective, detailed assessments, enabling personalized feedback, and accelerating the learning curve. Most experts also recognized AI's role in identifying qualified candidates for MBS referrals, helping patient and procedure selection, and addressing specific clinical questions. However, concerns were raised about the potential overreliance on AI-generated recommendations. The consensus emphasized the need for ethical guidelines governing AI use and the inclusion of AI's role in decision-making within the patient consent process. Furthermore, the results suggest that AI education should become an essential component of future surgical training. Advancements in AI-driven robotics and AI-integrated genomic applications were also identified as promising developments that could significantly shape the future of MBS.
Collapse
Affiliation(s)
- Mohammad Kermansaravi
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, Hazrat-E Fatemeh Hospital, Iran University of Medical Sciences, Tehran, Iran.
| | | | - Shahab Shahabi Shahmiri
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, Hazrat-E Fatemeh Hospital, Iran University of Medical Sciences, Tehran, Iran.
| | - Julian Varas
- Center for Simulation and Experimental Surgery, Faculty of Medicine, Pontificia Universidad Católica de Chile, Uc-Christus Health Network, Santiago, Chile
| | | | - Yung Lee
- Division of General Surgery, McMaster University, Hamilton, ON, Canada
| | - Jerry T Dang
- Digestive Disease Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Asim Shabbir
- National University of Singapore, Singapore, Singapore
| | - Daniel Hashimoto
- Penn Computer Assisted Surgery and Outcomes Laboratory, Department of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Amir Hossein Davarpanah Jazi
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, Hazrat-E Fatemeh Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Ozanan R Meireles
- Surgical Artificial Intelligence and Innovation Laboratory, Department of Surgery, Massachusetts General Hospital, 15 Parkman Street, WAC339, Boston, MA, 02114, USA
| | - Edo Aarts
- Weight Works Clinics and Allurion Clinics, Amersfoort, The Netherlands
| | | | - Aayad Alqahtani
- New You Medical Center, King Saud University, Obesity Chair, Riyadh, Saudi Arabia
| | - Ali Aminian
- Bariatric and Metabolic Institute, Cleveland Clinic, Cleveland, OH, USA
| | | | - Dieter Birk
- Department of General Surgery, Klinikum Bietigheim-Ludwigsburg, Bietigheim-Bissingen, Germany
| | - Felipe J Cantu
- Universidad México Americana del Norte UMAN, Reynosa, Tamps., Mexico
| | - Ricardo V Cohen
- Center for the Treatment of Obesity and Diabetes, Hospital Alemão Oswaldo Cruz, Sao Paolo, Brazil
| | | | | | - Bruno Dillemans
- Department of General Surgery, Sint Jan Brugge-Oostende, Brugge, AZ, Belgium
| | | | | | - Michel Gagner
- Department of Surgery, Westmount Square Surgical Center, Westmount, QC, Canada
| | | | - Carlos Galvani
- Department of Surgery, Louisiana State University Health Sciences Center, New Orleans, USA
| | - Khaled Gawdat
- Bariatric Surgery Unit, Faculty of Medicine, Ain Shams University, Cairo, Egypt
| | - Omar M Ghanem
- Division of Metabolic & Abdominal Wall Reconstructive Surgery, Department of Surgery, Mayo Clinic, Rochester, MN, USA
| | - Ashraf Haddad
- Minimally Invasive and Bariatric Surgery, Gastrointestinal Bariatric and Metabolic Center (GBMC)-Jordan Hospital, Amman, Jordan
| | - Jaques Himpens
- Bariatric Surgery Unit, Delta Chirec Hospital, Brussels, Belgium
| | - Kazunori Kasama
- Weight Loss and Metabolic Surgery Center, Yotsuya Medical Cube, Tokyo, Japan
| | - Radwan Kassir
- Digestive and Bariatric Surgery Department, The View Hospital, Doha, Qatar
| | | | - Haris Khwaja
- Department of Bariatric and Metabolic Surgery, Chelsea and Westminster Hospital, London, UK
| | - Lilian Kow
- Adelaide Bariatric Centre, Flinders University of South Australia, Adelaide, Australia
| | - Panagiotis Lainas
- Department of Metabolic & Bariatric Surgery, Metropolitan Hospital, Athens, Greece
| | - Muffazal Lakdawala
- Department of General Surgery and Minimal Access Surgical Sciences, Sir H.N. Reliance Foundation Hospital, Mumbai, India
| | - Rafael Luengas Tello
- Departamento de Cirugía, Hospital Clínico Universidad de Chile, Santos Dumont 999, Santiago, Chile
| | - Kamal Mahawar
- South Tyneside and Sunderland Foundation NHS Trust, Sunderland, UK
| | | | | | | | - Mario Musella
- Advanced Biomedical Sciences Department, Federico II" University, Naples, Italy
| | - Abdelrahman Nimeri
- Department of Surgery, Center for Metabolic and Bariatric Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Patrick Noel
- Hospital Privé Bouchard, ELSAN, Marseille, 13006, France
| | - Mariano Palermo
- Department of Surgery, Centro CIEN-Diagnomed, University of Buenos Aires, Buenos Aires, Argentina
| | - Abdolreza Pazouki
- Department of Surgery, Minimally Invasive Surgery Research Center, Division of Minimally Invasive and Bariatric Surgery, Hazrat-E Fatemeh Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Jaime Ponce
- Bariatric Surgery Program, CHI Memorial Hospital, Chattanooga, TN, USA
| | - Gerhard Prager
- Department of Surgery, Vienna Medical University, Vienna, Austria
| | | | - Karl P Rheinwalt
- Department of Bariatric, Metabolic and Plastic Surgery, Cellitinnen Hospital St. Franziskus, Cologne, Germany
| | | | - Alan A Saber
- Metabolic and Bariatric Institute, Newark Beth Israel Medical Center, New Jersy, USA
| | | | - Scott A Shikora
- Department of Surgery, Center for Metabolic and Bariatric Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Erik Stenberg
- Department of Surgery, Faculty of Medicine and Health, Örebro University, Örebro, Sweden
| | - Christine K Stier
- Department of Surgery, Medical Faculty Mannheim, Universitätsmedizin Mannheim, University of Heidelberg, Mannheim, Germany
| | - Michel Suter
- Department of Surgery, Hôpital Riviera-Chablais, Rennaz, Switzerland
| | - Samuel Szomstein
- Bariatric and Metabolic Institute, Department of Minimally Invasive Surgery, Cleveland Clinic Florida, Weston, FL, USA
| | - Halit Eren Taskin
- Department of Surgery, Istanbul University Cerrahpasa Medical Faculty, Istanbul, Turkey
| | - Ramon Vilallonga
- Endocrine, Bariatric, and Metabolic Surgery Department, University Hospital Vall Hebron, Barcelona, Spain
| | - Ala Wafa
- Aljazeera International Hospital, Misurata University School of Medicine, Misurata, Libya
| | - Wah Yang
- Department of Metabolic and Bariatric Surgery, The First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Ricardo Zorron
- Center for Bariatric and Metabolic Surgery, Hospital CUF Descobertas, Lisbon, Portugal
| | - Antonio Torres
- General and Digestive Surgery Service, Department of Surgery, Hospital Clínico San Carlos, Complutense University Medical School, Universidad Complutense de Madrid (UCM), Madrid, Spain
| | - Matthew Kroh
- Digestive Disease Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Natan Zundel
- Department of Surgery, University at Buffalo, Buffalo, NY, 14203, USA
| |
Collapse
|
3
|
Lock M, El Ansari W. New world of big data-new challenges for evidence synthesis: impact of data duplication on estimates generated by meta-analyses and the development of a framework for its identification and management. J Clin Epidemiol 2025; 179:111641. [PMID: 39701398 DOI: 10.1016/j.jclinepi.2024.111641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 11/27/2024] [Accepted: 12/10/2024] [Indexed: 12/21/2024]
Abstract
OBJECTIVES The aim of this study was to highlight the effects of entering duplicated or overlapping data from published studies using the same data registries into a meta-analysis, including its identification and management using a novel structured framework. STUDY DESIGN AND SETTING Secondary analysis of data from a proportional meta-analysis of 30-day cumulative incidence of venous thromboembolic events (VTE) after metabolic and bariatric surgery was performed. Sensitivity analysis was conducted a) including all studies regardless of duplication (uncorrected sample) and b) comparing it to a corrected sample of studies. We developed a decision tree framework to identify duplicated data from prospective studies and data registries. RESULTS We demonstrated that biasing from duplicated data, primarily from data registries, underestimated the incidence of VTE in the literature by 0.15% of the patient population (an erroneous difference equivalent to 22.06% of total VTE). This error persisted at 8.16% of total VTE when limiting to studies using a primarily laparoscopic approach. The decision tree framework used a comparison of the data source (country and hospital or registry), sampling time frame (dates/years of included data) and inclusion characteristics (included procedures/diagnoses or inclusion criteria) to identify potentially duplicated data. Inter-rater reliability was excellent (κ = 1.00, P < .001), although only 17.86% of studies coded as containing data duplication were verified by the authors while the remaining studies could not be verified. Lastly, we identified a strong lack of diversity in the geographical origins of the data from the included studies. CONCLUSION We demonstrated that inadvertently including duplicated data in a meta-analysis can result in substantially inaccurate pooled estimates. We outlined a comprehensive decision tree framework that future researchers can apply to assist with decision making when identifying and managing duplicated data, including that from prospective trials and data registries or other publicly accessible datasets. PLAIN LANGUAGE SUMMARY We explored the effects of entering duplicated or overlapping data from published studies using the same data registries into a meta-analysis; and developed a decision tree framework to identify such duplicated data from prospective studies and data registries. We analyzed data of 30-day incidence of venous thromboembolic events after metabolic and bariatric surgery. We demonstrated that including duplicated data, mainly from data registries, in a meta-analysis can result in substantially inaccurate pooled estimates, underestimating the incidence of total venous thromboembolic events by 22.06%. We also found a lack of diversity in the geographical origins of the data. The decision tree compared data source (country and hospital/registry), sampling time frame (dates/years of included data) and inclusion characteristics (inclusion criteria/procedures/diagnoses) to identify potentially duplicated data. Future researchers can apply the framework to make decisions when identifying and managing duplicated data from data registries or other publicly accessible datasets.
Collapse
Affiliation(s)
- Merilyn Lock
- Exercise Science, Health and Epidemiology, College of Health and Life Sciences, Hamad Bin Khalifa University, Doha, Qatar
| | - Walid El Ansari
- College of Medicine, Ajman University, Ajman, United Arab Emirates; Department of Surgery, Hamad Medical Corporation, Doha, Qatar; College of Medicine, Qatar University, Doha, Qatar; Department of Population Health, Weill Cornell Medicine-Qatar, Doha, Qatar.
| |
Collapse
|
4
|
Mann J, Lyons M, O'Rourke J, Davies S. Machine learning or traditional statistical methods for predictive modelling in perioperative medicine: A narrative review. J Clin Anesth 2025; 102:111782. [PMID: 39977974 DOI: 10.1016/j.jclinane.2025.111782] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2024] [Revised: 02/11/2025] [Accepted: 02/12/2025] [Indexed: 02/22/2025]
Abstract
Prediction of outcomes in perioperative medicine is key to decision-making and various prediction models have been created to help quantify and communicate those risks to both patients and clinicians. Increasingly, machine learning (ML) is being favoured over more traditional techniques to improve prediction of outcomes, however, the studies are of varying quality. It is also not known whether any increase in predictive performance using ML algorithms transpires into a clinically meaningful benefit. This coupled with the difficulty in interrogating ML algorithms is a potential cause of concern within the medical community. In this review, we provide a concise appraisal of studies which develop perioperative predictive ML models and compare predictive performance to traditional statistical models. The search strategy, title and abstract screening, and full-text reviews produced 37 studies for data extraction. Initially designed as a systematic review but due to the heterogeneity of the population and outcomes, was written in the narrative. Perioperative ML and traditional predictive models continue to be developed and published across a range of populations. This review highlights several studies which show that ML can enhance perioperative prediction models, although this is not universal, and performance for both methods remain context dependent. By focusing on relevant patient-centred outcomes, model interpretability, external validation, and maintaining high standards of reporting and methodological transparency, researchers can develop ML models alongside traditional methods to enhance clinical decision-making and improve patient care.
Collapse
Affiliation(s)
- Jason Mann
- Sheffield Teaching Hospitals NHS Foundation Trust, Royal Hallamshire Hospital, Anaesthesia and Operating Services, C-floor, Glossop Road, Sheffield, South Yorkshire S11 2JF, UK.
| | - Mathew Lyons
- SCREDS Clinical Lecturer in Anaesthesia, University of Edinburgh, UK
| | - John O'Rourke
- Anaesthetic Academic Clinical Fellow, York and Scarborough Teaching Hospitals, York, UK
| | - Simon Davies
- Reader in Anaesthesia, Centre for Health and Population Sciences, Hull York Medical School, UK
| |
Collapse
|
5
|
Xu L, Da M. Incidence and Risk Factors of Lower Limb Deep Vein Thrombosis in Psychiatric Inpatients by Applying Machine Learning to Electronic Health Records: A Retrospective Cohort Study. Clin Epidemiol 2025; 17:197-209. [PMID: 40027401 PMCID: PMC11871911 DOI: 10.2147/clep.s501062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2024] [Accepted: 01/11/2025] [Indexed: 03/05/2025] Open
Abstract
Background Psychiatric inpatients face an increased risk of deep vein thrombosis (DVT) due to their psychiatric conditions and pharmacological treatments. However, research focusing on this population remains limited. Methods This study analyzed 17,434 psychiatric inpatients at Huzhou Third Municipal Hospital, incorporating data on demographics, psychiatric diagnoses, physical illnesses, laboratory results, and medication use. Predictive models for DVT were developed using logistic regression, random forest, support vector machine (SVM), and XGBoost (Extreme Gradient Boosting). Feature importance was assessed using the random forest model. Results The DVT incidence among psychiatric inpatients was 1.6%. Predictive model performance, measured by the area under the curve (AUC), showed logistic regression (0.900), random forest (0.885), SVM (0.890), and XGBoost (0.889) performed well. Logistic regression and random forest models exhibited optimal overall performance, while XGBoost excelled in recall. Significant predictors of DVT included elevated D-dimer levels, age, Alzheimer's disease, and Madopar use. Conclusion Psychiatric inpatients require vigilance for DVT risk, with factors like D-dimer levels and age serving as critical indicators. Machine learning models effectively predict DVT risk, enabling early detection and personalized prevention strategies in clinical practice.
Collapse
Affiliation(s)
- Liang Xu
- Department of Psychiatry, Huzhou Third Municipal Hospital, the Affiliated Hospital of Huzhou University, Huzhou, Zhejiang, People’s Republic of China
| | - Miao Da
- Department of Psychiatry, Huzhou Third Municipal Hospital, the Affiliated Hospital of Huzhou University, Huzhou, Zhejiang, People’s Republic of China
| |
Collapse
|
6
|
Azmi S, Kunnathodi F, Alotaibi HF, Alhazzani W, Mustafa M, Ahmad I, Anvarbatcha R, Lytras MD, Arafat AA. Harnessing Artificial Intelligence in Obesity Research and Management: A Comprehensive Review. Diagnostics (Basel) 2025; 15:396. [PMID: 39941325 PMCID: PMC11816645 DOI: 10.3390/diagnostics15030396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2024] [Revised: 01/05/2025] [Accepted: 01/31/2025] [Indexed: 02/16/2025] Open
Abstract
Purpose: This review aims to explore the clinical and research applications of artificial intelligence (AI), particularly machine learning (ML) and deep learning (DL), in understanding, predicting, and managing obesity. It assesses the use of AI tools to identify obesity-related risk factors, predict outcomes, personalize treatments, and improve healthcare interventions for obesity. Methods: A comprehensive literature search was conducted using PubMed and Google Scholar, with keywords including "artificial intelligence", "machine learning", "deep learning", "obesity", "obesity management", and related terms. Studies focusing on AI's role in obesity research, management, and therapeutic interventions were reviewed, including observational studies, systematic reviews, and clinical applications. Results: This review identifies numerous AI-driven models, such as ML and DL, used in obesity prediction, patient stratification, and personalized management strategies. Applications of AI in obesity research include risk prediction, early detection, and individualization of treatment plans. AI has facilitated the development of predictive models utilizing various data sources, such as genetic, epigenetic, and clinical data. However, AI models vary in effectiveness, influenced by dataset type, research goals, and model interpretability. Performance metrics such as accuracy, precision, recall, and F1-score were evaluated to optimize model selection. Conclusions: AI offers promising advancements in obesity management, enabling more personalized and efficient care. While technology presents considerable potential, challenges such as data quality, ethical considerations, and technical requirements remain. Addressing these will be essential to fully harness AI's potential in obesity research and treatment, supporting a shift toward precision healthcare.
Collapse
Affiliation(s)
- Sarfuddin Azmi
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
| | - Faisal Kunnathodi
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
| | - Haifa F. Alotaibi
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
- Department of Family Medicine, Prince Sultan Military Medical City, Riyadh 11159, Saudi Arabia
| | - Waleed Alhazzani
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
- Critical Care and Internal Medicine Department, College of Medicine, Imam Abdulrahman Bin Faisal University, Dammam 31441, Saudi Arabia
| | - Mohammad Mustafa
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
| | - Ishtiaque Ahmad
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
| | - Riyasdeen Anvarbatcha
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
| | - Miltiades D. Lytras
- Computer Science Department, College of Engineering, Effat University, Jeddah 21478, Saudi Arabia;
- Department of Management, School of Business and Economics, The American College of Greece, 15342 Athens, Greece
| | - Amr A. Arafat
- Scientific Research Center, Al Hussain bin Ali Street, Ministry of Defense Health Services, Riyadh 12485, Saudi Arabia; (S.A.); (F.K.); (H.F.A.); (W.A.); (M.M.); (I.A.); (R.A.)
- Departments of Adult Cardiac Surgery, Prince Sultan Cardiac Center, Riyadh 31982, Saudi Arabia
| |
Collapse
|
7
|
van Boekel AM, van der Meijden SL, Arbous SM, Nelissen RGHH, Veldkamp KE, Nieswaag EB, Jochems KFT, Holtz J, Veenstra AVIJ, Reijman J, de Jong Y, van Goor H, Wiewel MA, Schoones JW, Geerts BF, de Boer MGJ. Systematic evaluation of machine learning models for postoperative surgical site infection prediction. PLoS One 2024; 19:e0312968. [PMID: 39666725 PMCID: PMC11637340 DOI: 10.1371/journal.pone.0312968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Accepted: 10/15/2024] [Indexed: 12/14/2024] Open
Abstract
BACKGROUND Surgical site infections (SSIs) lead to increased mortality and morbidity, as well as increased healthcare costs. Multiple models for the prediction of this serious surgical complication have been developed, with an increasing use of machine learning (ML) tools. OBJECTIVE The aim of this systematic review was to assess the performance as well as the methodological quality of validated ML models for the prediction of SSIs. METHODS A systematic search in PubMed, Embase and the Cochrane library was performed from inception until July 2023. Exclusion criteria were the absence of reported model validation, SSIs as part of a composite adverse outcome, and pediatric populations. ML performance measures were evaluated, and ML performances were compared to regression-based methods for studies that reported both methods. Risk of bias (ROB) of the studies was assessed using the Prediction model Risk of Bias Assessment Tool. RESULTS Of the 4,377 studies screened, 24 were included in this review, describing 85 ML models. Most models were only internally validated (81%). The C-statistic was the most used performance measure (reported in 96% of the studies) and only two studies reported calibration metrics. A total of 116 different predictors were described, of which age, steroid use, sex, diabetes, and smoking were most frequently (100% to 75%) incorporated. Thirteen studies compared ML models to regression-based models and showed a similar performance of both modelling methods. For all included studies, the overall ROB was high or unclear. CONCLUSIONS A multitude of ML models for the prediction of SSIs are available, with large variability in performance. However, most models lacked external validation, performance was reported limitedly, and the risk of bias was high. In studies describing both ML models and regression-based models, one modelling method did not outperform the other.
Collapse
Affiliation(s)
- Anna M. van Boekel
- Department of Internal Medicine, Leiden University Medical Center, Leiden, The Netherlands
| | - Siri L. van der Meijden
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
- Healthplus.ai R&D B.V., Amsterdam, The Netherlands
| | - Sesmu M. Arbous
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
| | - Rob G. H. H. Nelissen
- Department of Orthopedic surgery, Leiden University Medical Center, Leiden, The Netherlands
| | - Karin E. Veldkamp
- Department of Medical Microbiology and Infection Control, Leiden University Medical Center, Leiden, The Netherlands
| | - Emma B. Nieswaag
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
- Healthplus.ai R&D B.V., Amsterdam, The Netherlands
| | - Kim F. T. Jochems
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
- Healthplus.ai R&D B.V., Amsterdam, The Netherlands
| | - Jeroen Holtz
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
- Healthplus.ai R&D B.V., Amsterdam, The Netherlands
| | - Annekee van IJlzinga Veenstra
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
- Healthplus.ai R&D B.V., Amsterdam, The Netherlands
| | - Jeroen Reijman
- Department of Intensive Care, Leiden University Medical Center, Leiden, The Netherlands
- Healthplus.ai R&D B.V., Amsterdam, The Netherlands
| | - Ype de Jong
- Department of Internal Medicine, Leiden University Medical Center, Leiden, The Netherlands
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Harry van Goor
- Department of Surgery, Radboud UMC, Nijmegen, The Netherlands
| | | | - Jan W. Schoones
- Waleus Medical Library, Leiden University Medical Center, Leiden, The Netherlands
| | | | - Mark G. J. de Boer
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
- Department of Infectious disease, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
8
|
Chrysafi P, Lam B, Carton S, Patell R. From Code to Clots: Applying Machine Learning to Clinical Aspects of Venous Thromboembolism Prevention, Diagnosis, and Management. Hamostaseologie 2024; 44:429-445. [PMID: 39657652 DOI: 10.1055/a-2415-8408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2024] Open
Abstract
The high incidence of venous thromboembolism (VTE) globally and the morbidity and mortality burden associated with the disease make it a pressing issue. Machine learning (ML) can improve VTE prevention, detection, and treatment. The ability of this novel technology to process large amounts of high-dimensional data can help identify new risk factors and better risk stratify patients for thromboprophylaxis. Applications of ML for VTE include systems that interpret medical imaging, assess the severity of the VTE, tailor treatment according to individual patient needs, and identify VTE cases to facilitate surveillance. Generative artificial intelligence may be leveraged to design new molecules such as new anticoagulants, generate synthetic data to expand datasets, and reduce clinical burden by assisting in generating clinical notes. Potential challenges in the applications of these novel technologies include the availability of multidimensional large datasets, prospective studies and clinical trials to ensure safety and efficacy, continuous quality assessment to maintain algorithm accuracy, mitigation of unwanted bias, and regulatory and legal guardrails to protect patients and providers. We propose a practical approach for clinicians to integrate ML into research, from choosing appropriate problems to integrating ML into clinical workflows. ML offers much promise and opportunity for clinicians and researchers in VTE to translate this technology into the clinic and directly benefit the patients.
Collapse
Affiliation(s)
- Pavlina Chrysafi
- Department of Medicine, Mount Auburn Hospital, Harvard Medical School, Cambridge, Massachusetts, United States
| | - Barbara Lam
- Division of Hemostasis and Thrombosis, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States
- Division of Clinical Informatics, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States
| | - Samuel Carton
- Department of Computer Science, College of Engineering and Physical Sciences, University of New Hampshire, Durham, New Hampshire, United States
| | - Rushad Patell
- Division of Hemostasis and Thrombosis, Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States
| |
Collapse
|
9
|
Kang DW, Zhou S, Torres R, Chowdhury A, Niranjan S, Rogers A, Shen C. Predicting serious postoperative complications and evaluating racial fairness in machine learning algorithms for metabolic and bariatric surgery. Surg Obes Relat Dis 2024; 20:1056-1064. [PMID: 39232870 DOI: 10.1016/j.soard.2024.08.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 08/03/2024] [Indexed: 09/06/2024]
Abstract
BACKGROUND Predicting the risk of complications is critical in metabolic and bariatric surgery (MBS). OBJECTIVES To develop machine learning (ML) models to predict serious postoperative complications of MBS and evaluate racial fairness of the models. SETTING Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) national database, United States. METHODS We developed logistic regression, random forest (RF), gradient-boosted tree (GBT), and XGBoost model using the MBSAQIP Participant Use Data File from 2016 to 2020. To address the class imbalance, we randomly undersampled the complication-negative class to match the complication-positive class. Model performance was evaluated using the area under the receiver operating characteristic curve (AUROC), precision, recall, and F1 score. Fairness across White and non-White patient groups was assessed using equal opportunity difference and disparate impact metrics. RESULTS A total of 40,858 patients were included after undersampling the complication-negative class. The XGBoost model was the best-performing model in terms of AUROC; however, the difference was not statistically significant. While the F1 score and precision did not vary significantly across models, the RF exhibited better recall compared to the logistic regression. Surgery type was the most important feature to predict complications, followed by operative time. The logistic regression model had the best fairness metrics for race. CONCLUSIONS The XGBoost model achieved the highest AUROC, albeit without a statistically significant difference. The RF may be useful when recall is the primary concern. Undersampling of the privileged group may improve the fairness of boosted tree models.
Collapse
Affiliation(s)
- Dong-Won Kang
- Department of Surgery, Penn State College of Medicine, Hershey, Pennsylvania
| | - Shouhao Zhou
- Department of Public Health Sciences, Penn State College of Medicine, Hershey, Pennsylvania
| | - Russell Torres
- Department of Information Technology and Decision Sciences, University of North Texas, Denton, Texas
| | | | - Suman Niranjan
- Department of Logistics and Operations Management, G. Brint Ryan College of Business, University of North Texas, Denton, Texas
| | - Ann Rogers
- Department of Surgery, Penn State College of Medicine, Hershey, Pennsylvania
| | - Chan Shen
- Department of Surgery, Penn State College of Medicine, Hershey, Pennsylvania; Department of Public Health Sciences, Penn State College of Medicine, Hershey, Pennsylvania.
| |
Collapse
|
10
|
Danilatou V, Dimopoulos D, Kostoulas T, Douketis J. Machine Learning-Based Predictive Models for Patients with Venous Thromboembolism: A Systematic Review. Thromb Haemost 2024; 124:1040-1052. [PMID: 38574756 DOI: 10.1055/a-2299-4758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/06/2024]
Abstract
BACKGROUND Venous thromboembolism (VTE) is a chronic disorder with a significant health and economic burden. Several VTE-specific clinical prediction models (CPMs) have been used to assist physicians in decision-making but have several limitations. This systematic review explores if machine learning (ML) can enhance CPMs by analyzing extensive patient data derived from electronic health records. We aimed to explore ML-CPMs' applications in VTE for risk stratification, outcome prediction, diagnosis, and treatment. METHODS Three databases were searched: PubMed, Google Scholar, and IEEE electronic library. Inclusion criteria focused on studies using structured data, excluding non-English publications, studies on non-humans, and certain data types such as natural language processing and image processing. Studies involving pregnant women, cancer patients, and children were also excluded. After excluding irrelevant studies, a total of 77 studies were included. RESULTS Most studies report that ML-CPMs outperformed traditional CPMs in terms of receiver operating area under the curve in the four clinical domains that were explored. However, the majority of the studies were retrospective, monocentric, and lacked detailed model architecture description and external validation, which are essential for quality audit. This review identified research gaps and highlighted challenges related to standardized reporting, reproducibility, and model comparison. CONCLUSION ML-CPMs show promise in improving risk assessment and individualized treatment recommendations in VTE. Apparently, there is an urgent need for standardized reporting and methodology for ML models, external validation, prospective and real-world data studies, as well as interventional studies to evaluate the impact of artificial intelligence in VTE.
Collapse
Affiliation(s)
- Vasiliki Danilatou
- School of Medicine, European University of Cyprus, Nicosia, Cyprus
- Healthcare Division, Sphynx Technology Solutions, Nicosia, Cyprus
| | - Dimitrios Dimopoulos
- School of Engineering, Department of Information and Communication Systems Engineering, University of the Aegean, North Aegean, Greece
| | - Theodoros Kostoulas
- School of Engineering, Department of Information and Communication Systems Engineering, University of the Aegean, North Aegean, Greece
| | - James Douketis
- Department of Medicine, McMaster University, Hamilton, Canada
- Department of Medicine, St. Joseph's Healthcare Hamilton, Ontario, Canada
| |
Collapse
|
11
|
Zucchini N, Capozzella E, Giuffrè M, Mastronardi M, Casagranda B, Crocè SL, de Manzini N, Palmisano S. Advanced Non-linear Modeling and Explainable Artificial Intelligence Techniques for Predicting 30-Day Complications in Bariatric Surgery: A Single-Center Study. Obes Surg 2024; 34:3627-3638. [PMID: 39271585 DOI: 10.1007/s11695-024-07501-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2024] [Revised: 08/27/2024] [Accepted: 08/30/2024] [Indexed: 09/15/2024]
Abstract
PURPOSE Metabolic bariatric surgery (MBS) became integral to managing severe obesity. Understanding surgical risks associated with MBS is crucial. Different scores, such as the Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP), aid in patient selection and outcome prediction. This study aims to evaluate machine learning (ML) models performance in predicting 30-day post-operative complications and compare them with the MBSAQIP risk score. MATERIALS AND METHODS We retrospectively evaluated 424 consecutive patients (2006-2020) who underwent MBS, analyzing 30-day surgical complications according to Clavien-Dindo Classification. ML models, including logistic regression, support vector machine, random forest, k-nearest neighbors, multi-layer perceptron, and extreme gradient boosting, were analyzed and compared to MBSAQIP risk score. Performance was measured by area under receiver operating characteristic curve (AUROC) analysis. RESULTS Random forest showed the highest AUROC in the training (AUROC = 0.94) and the validation set (AUROC = 0.88). ML algorithms, particularly random forest, outperformed MBSAQIP in predicting negative 30-day outcomes in both the training and validation sets (AUROC = 0.64, DeLong's Test p < 0.001). The five features that were more relevant for the prediction of the random forest model were serum alkaline phosphatase, platelet count, triglycerides, glycated hemoglobin, and albumin. CONCLUSION We developed several ML model that identifies patients at risk for 30-day complications after MBS. Among these, random forest is the most performing one and outperforms the already established MBSAQIP score. This model could increase the identification of high-risk patients before MBS.
Collapse
Affiliation(s)
- Nicolas Zucchini
- Department of Medical, Surgical and Health Sciences, University of Trieste, Strada Di Fiume, 447, 34149, Trieste, Italy
| | - Eugenia Capozzella
- Department of Medical, Surgical and Health Sciences, University of Trieste, Strada Di Fiume, 447, 34149, Trieste, Italy
| | - Mauro Giuffrè
- Department of Internal Medicine (Digestive Diseases), Yale School of Medicine, Yale University, New Haven, CT, USA
| | - Manuela Mastronardi
- Department of Medical, Surgical and Health Sciences, University of Trieste, Strada Di Fiume, 447, 34149, Trieste, Italy.
| | - Biagio Casagranda
- Surgical Clinic Division, Cattinara Hospital, ASUGI, 34149, Trieste, Italy
| | - Saveria Lory Crocè
- Department of Medical, Surgical and Health Sciences, University of Trieste, Strada Di Fiume, 447, 34149, Trieste, Italy
| | - Nicolò de Manzini
- Department of Medical, Surgical and Health Sciences, University of Trieste, Strada Di Fiume, 447, 34149, Trieste, Italy
- Surgical Clinic Division, Cattinara Hospital, ASUGI, 34149, Trieste, Italy
| | - Silvia Palmisano
- Department of Medical, Surgical and Health Sciences, University of Trieste, Strada Di Fiume, 447, 34149, Trieste, Italy
- Surgical Clinic Division, Cattinara Hospital, ASUGI, 34149, Trieste, Italy
| |
Collapse
|
12
|
Agnes A, Nguyen ST, Konishi T, Peacock O, Bednarski BK, You YN, Messick CA, Tillman MM, Skibber JM, Chang GJ, Uppal A. Early Postoperative Prediction of Complications and Readmission After Colorectal Cancer Surgery Using an Artificial Neural Network. Dis Colon Rectum 2024; 67:1341-1352. [PMID: 38959458 DOI: 10.1097/dcr.0000000000003253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/05/2024]
Abstract
BACKGROUND Early predictors of postoperative complications can risk-stratify patients undergoing colorectal cancer surgery. However, conventional regression models have limited power to identify complex nonlinear relationships among a large set of variables. We developed artificial neural network models to optimize the prediction of major postoperative complications and risk of readmission in patients undergoing colorectal cancer surgery. OBJECTIVE This study aimed to develop an artificial neural network model to predict postoperative complications using postoperative laboratory values and compare the accuracy of models to standard regression methods. DESIGN This retrospective study included patients who underwent elective colorectal cancer resection between January 1, 2016, and July 31, 2021. Clinical data, cancer stage, and laboratory data from postoperative days 1 to 3 were collected. Complications and readmission risk models were created using multivariable logistic regression and single-layer neural networks. SETTING National Cancer Institute-Designated Comprehensive Cancer Center. PATIENTS Adult patients with colorectal cancer. MAIN OUTCOME MEASURES The accuracy of predicting postoperative major complications, readmissions, and anastomotic leaks using the area under the receiver operating characteristic curve. RESULTS Neural networks had larger areas under the curve for predicting major complications compared to regression models (neural network 0.811; regression model 0.724, p < 0.001). Neural networks also showed an advantage in predicting anastomotic leak ( p = 0.036) and readmission using postoperative day 1 to 2 values ( p = 0.014). LIMITATIONS Single-center, retrospective design limited to cancer operations. CONCLUSIONS In this study, we generated a set of models for the early prediction of complications after colorectal surgery. The neural network models provided greater discrimination than the models based on traditional logistic regression. These models may allow for early detection of postoperative complications as early as postoperative day 2. See the Video Abstract . PREDICCIN POST OPERATORIA TEMPRANA DE COMPLICACIONES Y REINGRESO DESPUS DE LA CIRUGA DE CNCER COLORRECTAL MEDIANTE UNA RED NEURONAL ARTIFICIAL ANTECEDENTES:Los predictores tempranos de complicaciones postoperatorias pueden estratificar el riesgo de los pacientes sometidos a cirugía de cáncer colorrectal. Sin embargo, los modelos de regresión convencionales tienen un poder limitado para identificar relaciones no lineales complejas entre un gran conjunto de variables. Desarrollamos modelos de redes neuronales artificiales para optimizar la predicción de complicaciones postoperatorias importantes y riesgo de reingreso en pacientes sometidos a cirugía de cáncer colorrectal.OBJETIVO:El objetivo de este estudio fue desarrollar un modelo de red neuronal artificial para predecir complicaciones postoperatorias utilizando valores de laboratorio postoperatorios y comparar la precisión de estos modelos con los métodos de regresión estándar.DISEÑO:Este estudio retrospectivo incluyó a pacientes que se sometieron a resección electiva de cáncer colorrectal entre el 1 de enero de 2016 y el 31 de julio de 2021. Se recopilaron datos clínicos, estadio del cáncer y datos de laboratorio del día 1 al 3 posoperatorio. Se crearon modelos de complicaciones y riesgo de reingreso mediante regresión logística multivariable y redes neuronales de una sola capa.AJUSTE:Instituto Nacional del Cáncer designado Centro Oncológico Integral.PACIENTES:Pacientes adultos con cáncer colorrectal.PRINCIPALES MEDIDAS DE RESULTADO:Precisión de la predicción de complicaciones mayores postoperatorias, reingreso y fuga anastomótica utilizando el área bajo la curva característica operativa del receptor.RESULTADOS:Las redes neuronales tuvieron áreas bajo la curva más grandes para predecir complicaciones importantes en comparación con los modelos de regresión (red neuronal 0,811; modelo de regresión 0,724, p < 0,001). Las redes neuronales también mostraron una ventaja en la predicción de la fuga anastomótica ( p = 0,036) y el reingreso utilizando los valores del día 1-2 postoperatorio ( p = 0,014).LIMITACIONES:Diseño retrospectivo de un solo centro limitado a operaciones de cáncer.CONCLUSIONES:En este estudio, generamos un conjunto de modelos para la predicción temprana de complicaciones después de la cirugía colorrectal. Los modelos de redes neuronales proporcionaron una mayor discriminación que los modelos basados en regresión logística tradicional. Estos modelos pueden permitir la detección temprana de complicaciones posoperatorias tan pronto como el segundo día posoperatorio. (Traducción-Dr. Mauricio Santamaria ).
Collapse
Affiliation(s)
- Annamaria Agnes
- Department of General Surgery, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
| | - Sa T Nguyen
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Tsuyoshi Konishi
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Oliver Peacock
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Brian K Bednarski
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Y Nancy You
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Craig A Messick
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Matthew M Tillman
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - John M Skibber
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - George J Chang
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Abhineet Uppal
- Department of Colon and Rectal Surgery, University of Texas MD Anderson Cancer Center, Houston, Texas
| |
Collapse
|
13
|
van der Meijden SL, van Boekel AM, van Goor H, Nelissen RG, Schoones JW, Steyerberg EW, Geerts BF, de Boer MG, Arbous MS. Automated Identification of Postoperative Infections to Allow Prediction and Surveillance Based on Electronic Health Record Data: Scoping Review. JMIR Med Inform 2024; 12:e57195. [PMID: 39255011 PMCID: PMC11422734 DOI: 10.2196/57195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 07/12/2024] [Accepted: 07/16/2024] [Indexed: 09/11/2024] Open
Abstract
BACKGROUND Postoperative infections remain a crucial challenge in health care, resulting in high morbidity, mortality, and costs. Accurate identification and labeling of patients with postoperative bacterial infections is crucial for developing prediction models, validating biomarkers, and implementing surveillance systems in clinical practice. OBJECTIVE This scoping review aimed to explore methods for identifying patients with postoperative infections using electronic health record (EHR) data to go beyond the reference standard of manual chart review. METHODS We performed a systematic search strategy across PubMed, Embase, Web of Science (Core Collection), the Cochrane Library, and Emcare (Ovid), targeting studies addressing the prediction and fully automated surveillance (ie, without manual check) of diverse bacterial infections in the postoperative setting. For prediction modeling studies, we assessed the labeling methods used, categorizing them as either manual or automated. We evaluated the different types of EHR data needed for the surveillance and labeling of postoperative infections, as well as the performance of fully automated surveillance systems compared with manual chart review. RESULTS We identified 75 different methods and definitions used to identify patients with postoperative infections in studies published between 2003 and 2023. Manual labeling was the predominant method in prediction modeling research, 65% (49/75) of the identified methods use structured data, and 45% (34/75) use free text and clinical notes as one of their data sources. Fully automated surveillance systems should be used with caution because the reported positive predictive values are between 0.31 and 0.76. CONCLUSIONS There is currently no evidence to support fully automated labeling and identification of patients with infections based solely on structured EHR data. Future research should focus on defining uniform definitions, as well as prioritizing the development of more scalable, automated methods for infection detection using structured EHR data.
Collapse
Affiliation(s)
- Siri Lise van der Meijden
- Intensive Care Unit, Leiden University Medical Center, Leiden, Netherlands
- Healthplus.ai BV, Amsterdam, Netherlands
| | - Anna M van Boekel
- Intensive Care Unit, Leiden University Medical Center, Leiden, Netherlands
| | - Harry van Goor
- General Surgery Department, Radboud University Medical Center, Nijmegen, Netherlands
| | - Rob Ghh Nelissen
- Department of Orthopedics, Leiden University Medical Center, Leiden, Netherlands
| | - Jan W Schoones
- Directorate of Research Policy, Leiden University Medical Center, Leiden, Netherlands
| | - Ewout W Steyerberg
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, Netherlands
| | | | - Mark Gj de Boer
- Department of Infectious Diseases, Leiden University Medical Center, Leiden, Netherlands
| | - M Sesmu Arbous
- Intensive Care Unit, Leiden University Medical Center, Leiden, Netherlands
| |
Collapse
|
14
|
Shukla A, Chaudhary R, Nayyar N. Role of artificial intelligence in gastrointestinal surgery. Artif Intell Cancer 2024; 5. [DOI: 10.35713/aic.v5.i2.97317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Revised: 07/11/2024] [Accepted: 07/17/2024] [Indexed: 09/05/2024] Open
Abstract
Artificial intelligence is rapidly evolving and its application is increasing day-by-day in the medical field. The application of artificial intelligence is also valuable in gastrointestinal diseases, by calculating various scoring systems, evaluating radiological images, preoperative and intraoperative assistance, processing pathological slides, prognosticating, and in treatment responses. This field has a promising future and can have an impact on many management algorithms. In this minireview, we aimed to determine the basics of artificial intelligence, the role that artificial intelligence may play in gastrointestinal surgeries and malignancies, and the limitations thereof.
Collapse
Affiliation(s)
- Ankit Shukla
- Department of Surgery, Dr Rajendra Prasad Government Medical College, Kangra 176001, Himachal Pradesh, India
| | - Rajesh Chaudhary
- Department of Renal Transplantation, Dr Rajendra Prasad Government Medical College, Kangra 176001, India
| | - Nishant Nayyar
- Department of Radiology, Dr Rajendra Prasad Government Medical College, Kangra 176001, Himachal Pradesh, India
| |
Collapse
|
15
|
Zhang M, Chen R, Yang Y, Sun X, Shan X. Machine learning analysis of lab tests to predict bariatric readmissions. Sci Rep 2024; 14:16845. [PMID: 39039130 PMCID: PMC11263698 DOI: 10.1038/s41598-024-67710-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Accepted: 07/15/2024] [Indexed: 07/24/2024] Open
Abstract
The purpose of this study was to develop a machine learning model for predicting 30-day readmission after bariatric surgery based on laboratory tests. Data were collected from patients who underwent bariatric surgery between 2018 and 2023. Laboratory test indicators from the preoperative stage, one day postoperatively, and three days postoperatively were analyzed. Least absolute shrinkage and selection operator regression was used to select the most relevant features. Models constructed included support vector machine (SVM), generalized linear model, multi-layer perceptron, random forest, and extreme gradient boosting. Model performance was evaluated and compared using the area under the receiver operating characteristic curve (AUROC). A total of 1262 patients were included, of which 7.69% of cases were readmitted. The SVM model achieved the highest AUROC (0.784; 95% CI 0.696-0.872), outperforming other models. This suggests that machine learning models based on laboratory test data can effectively identify patients at high risk of readmission after bariatric surgery.
Collapse
Affiliation(s)
- Mingchuang Zhang
- Department of Pancreatic and Metabolic Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing University of Chinese Medicine, Nanjing, 210008, China
| | - Rui Chen
- Department of Pancreatic and Metabolic Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing University of Chinese Medicine, Nanjing, 210008, China
| | - Yidi Yang
- Department of Pancreatic and Metabolic Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing University of Chinese Medicine, Nanjing, 210008, China
| | - Xitai Sun
- Department of Pancreatic and Metabolic Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing University of Chinese Medicine, Nanjing, 210008, China.
| | - Xiaodong Shan
- Department of Pancreatic and Metabolic Surgery, Nanjing Drum Tower Hospital, Affiliated Hospital of Medical School, Nanjing University, Nanjing, 210008, China.
| |
Collapse
|
16
|
Nopour R. Comparison of machine learning models to predict complications of bariatric surgery: A systematic review. Health Informatics J 2024; 30:14604582241285794. [PMID: 39282871 DOI: 10.1177/14604582241285794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
Abstract
Background and aim: Due to changes in lifestyle, bariatric surgery is expanding worldwide. However, this surgery has numerous complications, and early identification of these complications could be essential in assisting patients to have a higher-quality surgery. Machine learning has a significant role in prediction tasks. So far, no systematic review has been carried out on leveraging ML techniques for predicting complications of bariatric surgery. Therefore, this study aims to perform a systematic review for better prediction insight. Materials and methods: This review was conducted in 2023 based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). We searched scientific databases using the inclusion and exclusion criteria to obtain articles. The data extraction form was used to gather data. To analyze the data, we leveraged the narrative synthesis of the quantitative data. Results: Ensemble algorithms outperformed others in large databases, especially at the national registries. Artificial Neural Networks (ANN) performed better than others based on one-single-center database. Also, Deep Belief Networks (DBN) and ANN obtained favorable performance for complications such as diabetes, dyslipidemia, hypertension, thrombosis, leakage, and depression. Conclusion: This review gave us insight into using ensemble and non-ensemble algorithms based on the types of datasets and complications.
Collapse
Affiliation(s)
- Raoof Nopour
- Department of Health Information Management, School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
17
|
Wang J, Tozzi F, Ashraf Ganjouei A, Romero-Hernandez F, Feng J, Calthorpe L, Castro M, Davis G, Withers J, Zhou C, Chaudhary Z, Adam M, Berrevoet F, Alseidi A, Rashidian N. Machine learning improves prediction of postoperative outcomes after gastrointestinal surgery: a systematic review and meta-analysis. J Gastrointest Surg 2024; 28:956-965. [PMID: 38556418 DOI: 10.1016/j.gassur.2024.03.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2024] [Revised: 03/04/2024] [Accepted: 03/08/2024] [Indexed: 04/02/2024]
Abstract
BACKGROUND Machine learning (ML) approaches have become increasingly popular in predicting surgical outcomes. However, it is unknown whether they are superior to traditional statistical methods such as logistic regression (LR). This study aimed to perform a systematic review and meta-analysis to compare the performance of ML vs LR models in predicting postoperative outcomes for patients undergoing gastrointestinal (GI) surgery. METHODS A systematic search of Embase, MEDLINE, Cochrane, Web of Science, and Google Scholar was performed through December 2022. The primary outcome was the discriminatory performance of ML vs LR models as measured by the area under the receiver operating characteristic curve (AUC). A meta-analysis was then performed using a random effects model. RESULTS A total of 62 LR models and 143 ML models were included across 38 studies. On average, the best-performing ML models had a significantly higher AUC than the LR models (ΔAUC, 0.07; 95% CI, 0.04-0.09; P < .001). Similarly, on average, the best-performing ML models had a significantly higher logit (AUC) than the LR models (Δlogit [AUC], 0.41; 95% CI, 0.23-0.58; P < .001). Approximately half of studies (44%) were found to have a low risk of bias. Upon a subset analysis of only low-risk studies, the difference in logit (AUC) remained significant (ML vs LR, Δlogit [AUC], 0.40; 95% CI, 0.14-0.66; P = .009). CONCLUSION We found a significant improvement in discriminatory ability when using ML over LR algorithms in predicting postoperative outcomes for patients undergoing GI surgery. Subsequent efforts should establish standardized protocols for both developing and reporting studies using ML models and explore the practical implementation of these models.
Collapse
Affiliation(s)
- Jane Wang
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Francesca Tozzi
- Department of General, HPB Surgery and Liver Transplantation, Ghent University Hospital, Ghent, Belgium
| | - Amir Ashraf Ganjouei
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Fernanda Romero-Hernandez
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Jean Feng
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, California, United States
| | - Lucia Calthorpe
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Maria Castro
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Greta Davis
- Department of Surgery, Division of Plastic and Reconstructive Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Jacquelyn Withers
- Department of Surgery, Division of Plastic and Reconstructive Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Connie Zhou
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Zaim Chaudhary
- University of California, Berkeley, Berkeley, California, United States
| | - Mohamed Adam
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Frederik Berrevoet
- Department of General, HPB Surgery and Liver Transplantation, Ghent University Hospital, Ghent, Belgium
| | - Adnan Alseidi
- Department of Surgery, University of California, San Francisco, San Francisco, California, United States
| | - Nikdokht Rashidian
- Department of General, HPB Surgery and Liver Transplantation, Ghent University Hospital, Ghent, Belgium.
| |
Collapse
|
18
|
El Ansari W, El-Menyar A, El-Ansari K, Al-Ansari A, Lock M. Cumulative Incidence of Venous Thromboembolic Events In-Hospital, and at 1, 3, 6, and 12 Months After Metabolic and Bariatric Surgery: Systematic Review of 87 Studies and Meta-analysis of 2,731,797 Patients. Obes Surg 2024; 34:2154-2176. [PMID: 38602603 PMCID: PMC11127857 DOI: 10.1007/s11695-024-07184-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 03/15/2024] [Accepted: 03/15/2024] [Indexed: 04/12/2024]
Abstract
Systematic review/meta-analysis of cumulative incidences of venous thromboembolic events (VTE) after metabolic and bariatric surgery (MBS). Electronic databases were searched for original studies. Proportional meta-analysis assessed cumulative VTE incidences. (PROSPERO ID:CRD42020184529). A total of 3066 records, and 87 studies were included (N patients = 4,991,683). Pooled in-hospital VTE of mainly laparoscopic studies = 0.15% (95% CI = 0.13-0.18%); pooled cumulative incidence increased to 0.50% (95% CI = 0.33-0.70%); 0.51% (95% CI = 0.38-0.65%); 0.72% (95% CI = 0.13-1.52%); 0.78% (95% CI = 0-3.49%) at 30 days and 3, 6, and 12 months, respectively. Studies using predominantly open approach exhibited higher incidence than laparoscopic studies. Within the first month, 60% of VTE occurred after discharge. North American and earlier studies had higher incidence than non-North American and more recent studies. This study is the first to generate detailed estimates of the incidence and patterns of VTE after MBS over time. The incidence of VTE after MBS is low. Improved estimates and time variations of VTE require longer-term designs, non-aggregated reporting of characteristics, and must consider many factors and the use of data registries. Extended surveillance of VTE after MBS is required.
Collapse
Affiliation(s)
- Walid El Ansari
- Department of Surgery, Hamad Medical Corporation, 3050, Doha, Qatar.
- College of Medicine, Qatar University, Doha, Qatar.
- Department of Clinical Population Health, Weill Cornell Medicine-Qatar, Doha, Qatar.
| | - Ayman El-Menyar
- Clinical Research, Trauma and Vascular Surgery, Hamad Medical Corporation, Doha, Qatar
- Department of Clinical Medicine, Weill Cornell Medicine-Qatar, Doha, Qatar
| | - Kareem El-Ansari
- Faculty of Medicine, St. George's University, Saint George's, Grenada
| | | | - Merilyn Lock
- Department of Exercise Science, Health and Epidemiology, College of Health and Life Sciences, Hamad Bin Khalifa University, Doha, Qatar
| |
Collapse
|
19
|
Scott AW, Amateau SK, Leslie DB, Ikramuddin S, Wise ES. Prediction of 30-Day Morbidity and Mortality After Conversion of Sleeve Gastrectomy to Roux-en-Y Gastric Bypass: Use of an Artificial Neural Network. Am Surg 2024; 90:1202-1210. [PMID: 38197867 DOI: 10.1177/00031348241227182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2024]
Abstract
BACKGROUND Conversion of sleeve gastrectomy to Roux-en-Y gastric bypass is indicated primarily for unsatisfactory weight loss or gastroesophageal reflux disease (GERD). This study aimed to use a comprehensive database to define predictors of 30-day reoperation, readmission, reintervention, or mortality. An artificial neural network (ANN) was employed to optimize prediction of the composite endpoint (occurrence of 1+ morbid event). METHODS Areview of 8895 patients who underwent conversion for weight-related or GERD-related indications was performed using the 2021 MBSAQIP national dataset. Demographics, comorbidities, laboratory values, and other factors were assessed for bivariate and subsequent multivariable associations with the composite endpoint (P ≤ .05). Factors considered in the multivariable model were imputed into a three-node ANN with 20% randomly withheld for internal validation, to optimize predictive accuracy. Models were compared using receiver operating characteristic (ROC) curve analysis. RESULTS 39% underwent conversion for weight considerations and 61% for GERD. Rates of 30-day reoperation, readmission, reintervention, mortality, and the composite endpoint were 3.0%, 7.1%, 2.1%, .1%, and 9.1%, respectively. Of the nine factors associated with the composite endpoint on bivariate analysis, only non-white race (P < .001; odds ratio 1.4), lower body-mass index (P < .001; odds ratio .22), and therapeutic anticoagulation (P = .001; odds ratio 2.0) remained significant upon multivariable analysis. Areas under ROC curves for the multivariable regression, ANN training, and validation sets were .587, .601, and .604, respectively. DISCUSSION Identification of risk factors for morbidity after conversion offers critical information to improve patient selection and manage postoperative expectations. ANN models, with appropriate clinical integration, may optimize prediction of morbidity.
Collapse
Affiliation(s)
- Adam W Scott
- School of Medicine, University of Minnesota, Minneapolis, MN, USA
| | - Stuart K Amateau
- Division of Gastroenterology, Hepatology and Nutrition, Department of Medicine, University of Minnesota, Minneapolis, MN, USA
| | - Daniel B Leslie
- Department of Surgery, University of Minnesota, Minneapolis, MN, USA
| | - Sayeed Ikramuddin
- Department of Surgery, University of Minnesota, Minneapolis, MN, USA
| | - Eric S Wise
- Department of Surgery, University of Minnesota, Minneapolis, MN, USA
| |
Collapse
|
20
|
Nadal E, Benito E, Ródenas-Navarro AM, Palanca A, Martinez-Hervas S, Civera M, Ortega J, Alabadi B, Piqueras L, Ródenas JJ, Real JT. Machine Learning Model in Obesity to Predict Weight Loss One Year after Bariatric Surgery: A Pilot Study. Biomedicines 2024; 12:1175. [PMID: 38927382 PMCID: PMC11200726 DOI: 10.3390/biomedicines12061175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Revised: 05/13/2024] [Accepted: 05/21/2024] [Indexed: 06/28/2024] Open
Abstract
Roux-en-Y gastric bypass (RYGB) is a treatment for severe obesity. However, many patients have insufficient total weight loss (TWL) after RYGB. Although multiple factors have been involved, their influence is incompletely known. The aim of this exploratory study was to evaluate the feasibility and reliability of the use of machine learning (ML) techniques to estimate the success in weight loss after RYGP, based on clinical, anthropometric and biochemical data, in order to identify morbidly obese patients with poor weight responses. We retrospectively analyzed 118 patients, who underwent RYGB at the Hospital Clínico Universitario of Valencia (Spain) between 2013 and 2017. We applied a ML approach using local linear embedding (LLE) as a tool for the evaluation and classification of the main parameters in conjunction with evolutionary algorithms for the optimization and adjustment of the parameter model. The variables associated with one-year postoperative %TWL were obstructive sleep apnea, osteoarthritis, insulin treatment, preoperative weight, insulin resistance index, apolipoprotein A, uric acid, complement component 3, and vitamin B12. The model correctly classified 71.4% of subjects with TWL < 30% although 36.4% with TWL ≥ 30% were incorrectly classified as "unsuccessful procedures". The ML-model processed moderate discriminatory precision in the validation set. Thus, in severe obesity, ML-models can be useful to assist in the selection of patients before bariatric surgery.
Collapse
Affiliation(s)
- Enrique Nadal
- Instituto Universitario de Ingeniería Mecánica y Biomecánica (I2MB), Universitat Politècnica de València, 46022 Valencia, Spain;
| | - Esther Benito
- CIBER de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), Instituto de Salud Carlos III (ISCIII), 28040 Madrid, Spain; (E.B.); (B.A.); (L.P.); (J.T.R.)
| | - Ana María Ródenas-Navarro
- Endocrinology and Nutrition Service, Clinical University Hospital of Valencia, 46010 Valencia, Spain; (A.M.R.-N.); (A.P.); (M.C.)
| | - Ana Palanca
- Endocrinology and Nutrition Service, Clinical University Hospital of Valencia, 46010 Valencia, Spain; (A.M.R.-N.); (A.P.); (M.C.)
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
| | - Sergio Martinez-Hervas
- CIBER de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), Instituto de Salud Carlos III (ISCIII), 28040 Madrid, Spain; (E.B.); (B.A.); (L.P.); (J.T.R.)
- Endocrinology and Nutrition Service, Clinical University Hospital of Valencia, 46010 Valencia, Spain; (A.M.R.-N.); (A.P.); (M.C.)
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
- Department of Medicine, University of Valencia, 46010 Valencia, Spain
| | - Miguel Civera
- Endocrinology and Nutrition Service, Clinical University Hospital of Valencia, 46010 Valencia, Spain; (A.M.R.-N.); (A.P.); (M.C.)
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
| | - Joaquín Ortega
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
- General Surgery Service, University Hospital of Valencia, 46010 Valencia, Spain
- Department of Surgery, University of Valencia, 46010 Valencia, Spain
| | - Blanca Alabadi
- CIBER de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), Instituto de Salud Carlos III (ISCIII), 28040 Madrid, Spain; (E.B.); (B.A.); (L.P.); (J.T.R.)
- Endocrinology and Nutrition Service, Clinical University Hospital of Valencia, 46010 Valencia, Spain; (A.M.R.-N.); (A.P.); (M.C.)
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
| | - Laura Piqueras
- CIBER de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), Instituto de Salud Carlos III (ISCIII), 28040 Madrid, Spain; (E.B.); (B.A.); (L.P.); (J.T.R.)
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
- Department of Pharmacology, University of Valencia, 46010 Valencia, Spain
| | - Juan José Ródenas
- Instituto Universitario de Ingeniería Mecánica y Biomecánica (I2MB), Universitat Politècnica de València, 46022 Valencia, Spain;
| | - José T. Real
- CIBER de Diabetes y Enfermedades Metabólicas Asociadas (CIBERDEM), Instituto de Salud Carlos III (ISCIII), 28040 Madrid, Spain; (E.B.); (B.A.); (L.P.); (J.T.R.)
- Endocrinology and Nutrition Service, Clinical University Hospital of Valencia, 46010 Valencia, Spain; (A.M.R.-N.); (A.P.); (M.C.)
- INCLIVA Biomedical Research Institute, 46010 Valencia, Spain;
- Department of Medicine, University of Valencia, 46010 Valencia, Spain
| |
Collapse
|
21
|
Şişik A, Dalkılıç MS, Gençtürk M, Yılmaz M, Erdem H. Individualized Bariatric Surgery Utilizing Artificial Intelligence: A Call to Colleagues and New Year's Aspiration. Obes Surg 2024; 34:1380-1381. [PMID: 38206563 DOI: 10.1007/s11695-024-07060-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 01/01/2024] [Accepted: 01/07/2024] [Indexed: 01/12/2024]
Affiliation(s)
| | - Muhammed Said Dalkılıç
- Department of General Surgery, School of Medicine, Marmara University, Fevzi Çakmak Mahallesi Muhsin Yazıcıoğlu Caddesi No:10 Pendik, Istanbul, Turkey.
| | | | | | | |
Collapse
|
22
|
Chen KA, Goffredo P, Butler LR, Joisa CU, Guillem JG, Gomez SM, Kapadia MR. Prediction of Pathologic Complete Response for Rectal Cancer Based on Pretreatment Factors Using Machine Learning. Dis Colon Rectum 2024; 67:387-397. [PMID: 37994445 PMCID: PMC11186794 DOI: 10.1097/dcr.0000000000003038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2023]
Abstract
BACKGROUND Pathologic complete response after neoadjuvant therapy is an important prognostic indicator for locally advanced rectal cancer and may give insights into which patients might be treated nonoperatively in the future. Existing models for predicting pathologic complete response in the pretreatment setting are limited by small data sets and low accuracy. OBJECTIVE We sought to use machine learning to develop a more generalizable predictive model for pathologic complete response for locally advanced rectal cancer. DESIGN Patients with locally advanced rectal cancer who underwent neoadjuvant therapy followed by surgical resection were identified in the National Cancer Database from years 2010 to 2019 and were split into training, validation, and test sets. Machine learning techniques included random forest, gradient boosting, and artificial neural network. A logistic regression model was also created. Model performance was assessed using an area under the receiver operating characteristic curve. SETTINGS This study used a national, multicenter data set. PATIENTS Patients with locally advanced rectal cancer who underwent neoadjuvant therapy and proctectomy. MAIN OUTCOME MEASURES Pathologic complete response defined as T0/xN0/x. RESULTS The data set included 53,684 patients. Pathologic complete response was experienced by 22.9% of patients. Gradient boosting showed the best performance with an area under the receiver operating characteristic curve of 0.777 (95% CI, 0.773-0.781), compared with 0.684 (95% CI, 0.68-0.688) for logistic regression. The strongest predictors of pathologic complete response were no lymphovascular invasion, no perineural invasion, lower CEA, smaller size of tumor, and microsatellite stability. A concise model including the top 5 variables showed preserved performance. LIMITATIONS The models were not externally validated. CONCLUSIONS Machine learning techniques can be used to accurately predict pathologic complete response for locally advanced rectal cancer in the pretreatment setting. After fine-tuning a data set including patients treated nonoperatively, these models could help clinicians identify the appropriate candidates for a watch-and-wait strategy. See Video Abstract . EL CNCER DE RECTO BASADA EN FACTORES PREVIOS AL TRATAMIENTO MEDIANTE EL APRENDIZAJE AUTOMTICO ANTECEDENTES:La respuesta patológica completa después de la terapia neoadyuvante es un indicador pronóstico importante para el cáncer de recto localmente avanzado y puede dar información sobre qué pacientes podrían ser tratados de forma no quirúrgica en el futuro. Los modelos existentes para predecir la respuesta patológica completa en el entorno previo al tratamiento están limitados por conjuntos de datos pequeños y baja precisión.OBJETIVO:Intentamos utilizar el aprendizaje automático para desarrollar un modelo predictivo más generalizable para la respuesta patológica completa para el cáncer de recto localmente avanzado.DISEÑO:Los pacientes con cáncer de recto localmente avanzado que se sometieron a terapia neoadyuvante seguida de resección quirúrgica se identificaron en la Base de Datos Nacional del Cáncer de los años 2010 a 2019 y se dividieron en conjuntos de capacitación, validación y prueba. Las técnicas de aprendizaje automático incluyeron bosque aleatorio, aumento de gradiente y red neuronal artificial. También se creó un modelo de regresión logística. El rendimiento del modelo se evaluó utilizando el área bajo la curva característica operativa del receptor.ÁMBITO:Este estudio utilizó un conjunto de datos nacional multicéntrico.PACIENTES:Pacientes con cáncer de recto localmente avanzado sometidos a terapia neoadyuvante y proctectomía.PRINCIPALES MEDIDAS DE VALORACIÓN:Respuesta patológica completa definida como T0/xN0/x.RESULTADOS:El conjunto de datos incluyó 53.684 pacientes. El 22,9% de los pacientes experimentaron una respuesta patológica completa. El refuerzo de gradiente mostró el mejor rendimiento con un área bajo la curva característica operativa del receptor de 0,777 (IC del 95%: 0,773 - 0,781), en comparación con 0,684 (IC del 95%: 0,68 - 0,688) para la regresión logística. Los predictores más fuertes de respuesta patológica completa fueron la ausencia de invasión linfovascular, la ausencia de invasión perineural, un CEA más bajo, un tamaño más pequeño del tumor y la estabilidad de los microsatélites. Un modelo conciso que incluye las cinco variables principales mostró un rendimiento preservado.LIMITACIONES:Los modelos no fueron validados externamente.CONCLUSIONES:Las técnicas de aprendizaje automático se pueden utilizar para predecir con precisión la respuesta patológica completa para el cáncer de recto localmente avanzado en el entorno previo al tratamiento. Después de realizar ajustes en un conjunto de datos que incluye pacientes tratados de forma no quirúrgica, estos modelos podrían ayudar a los médicos a identificar a los candidatos adecuados para una estrategia de observar y esperar. (Traducción-Dr. Ingrid Melo ).
Collapse
Affiliation(s)
- Kevin A Chen
- Division of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, NC, 4038 Burnett Womack Building, Chapel Hill, NC 27599
| | - Paolo Goffredo
- Division of Colorectal Surgery, Department of Surgery, University of Minnesota, Minneapolis, MN, 420 Delaware St SE, Minneapolis, MN 55455
| | - Logan R Butler
- Division of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, NC, 4038 Burnett Womack Building, Chapel Hill, NC 27599
| | - Chinmaya U Joisa
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599
| | - Jose G Guillem
- Division of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, NC, 4038 Burnett Womack Building, Chapel Hill, NC 27599
| | - Shawn M Gomez
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599
| | - Muneera R Kapadia
- Division of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, NC, 4038 Burnett Womack Building, Chapel Hill, NC 27599
| |
Collapse
|
23
|
Drăgan A, Drăgan AŞ. Novel Insights in Venous Thromboembolism Risk Assessment Methods in Ambulatory Cancer Patients: From the Guidelines to Clinical Practice. Cancers (Basel) 2024; 16:458. [PMID: 38275899 PMCID: PMC10813930 DOI: 10.3390/cancers16020458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 01/07/2024] [Accepted: 01/19/2024] [Indexed: 01/27/2024] Open
Abstract
Many cancer patients will experience venous thromboembolism (VTE) at some stage, with the highest rate in the initial period following diagnosis. Novel cancer therapies may further enhance the risk. VTE in a cancer setting is associated with poor prognostic, a decreased quality of life, and high healthcare costs. If thromboprophylaxis in hospitalized cancer patients and perioperative settings is widely accepted in clinical practice and supported by the guidelines, it is not the same situation in ambulatory cancer patient settings. The guidelines do not recommend primary thromboprophylaxis, except in high-risk cases. However, nowadays, risk stratification is still challenging, although many tools have been developed. The Khrorana score remains the most used method, but it has many limits. This narrative review aims to present the current relevant knowledge of VTE risk assessment in ambulatory cancer patients, starting from the guideline recommendations and continuing with the specific risk assessment methods and machine learning models approaches. Biomarkers, genetic, and clinical features were tested alone or in groups. Old and new models used in VTE risk assessment are exposed, underlining their clinical utility. Imaging and biomolecular approaches to VTE screening of outpatients with cancer are also presented, which could help clinical decisions.
Collapse
Affiliation(s)
- Anca Drăgan
- Department of Cardiovascular Anaesthesiology and Intensive Care, Emergency Institute for Cardiovascular Diseases “Prof. Dr. C C Iliescu”, 258 Fundeni Road, 022328 Bucharest, Romania
| | - Adrian Ştefan Drăgan
- Faculty of General Medicine, Carol Davila University of Medicine and Pharmacy, 8 Eroii Sanitari Blvd, 050474 Bucharest, Romania;
| |
Collapse
|
24
|
Tian Y, Li R, Wang G, Xu K, Li H, He L. Prediction of postoperative infectious complications in elderly patients with colorectal cancer: a study based on improved machine learning. BMC Med Inform Decis Mak 2024; 24:11. [PMID: 38184556 PMCID: PMC10770876 DOI: 10.1186/s12911-023-02411-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 12/18/2023] [Indexed: 01/08/2024] Open
Abstract
BACKGROUND Infectious complications after colorectal cancer (CRC) surgery increase perioperative mortality and are significantly associated with poor prognosis. We aimed to develop a model for predicting infectious complications after colorectal cancer surgery in elderly patients based on improved machine learning (ML) using inflammatory and nutritional indicators. METHODS The data of 512 elderly patients with colorectal cancer in the Third Affiliated Hospital of Anhui Medical University from March 2018 to April 2022 were retrospectively collected and randomly divided into a training set and validation set. The optimal cutoff values of NLR (3.80), PLR (238.50), PNI (48.48), LCR (0.52), and LMR (2.46) were determined by receiver operating characteristic (ROC) curve; Six conventional machine learning models were constructed using patient data in the training set: Linear Regression, Random Forest, Support Vector Machine (SVM), BP Neural Network (BP), Light Gradient Boosting Machine (LGBM), Extreme Gradient Boosting (XGBoost) and an improved moderately greedy XGBoost (MGA-XGBoost) model. The performance of the seven models was evaluated by area under the receiver operator characteristic curve, accuracy (ACC), precision, recall, and F1-score of the validation set. RESULTS Five hundred twelve cases were included in this study; 125 cases (24%) had postoperative infectious complications. Postoperative infectious complications were notably associated with 10 items features: American Society of Anesthesiologists scores (ASA), operation time, diabetes, presence of stomy, tumor location, NLR, PLR, PNI, LCR, and LMR. MGA-XGBoost reached the highest AUC (0.862) on the validation set, which was the best model for predicting postoperative infectious complications in elderly patients with colorectal cancer. Among the importance of the internal characteristics of the model, LCR accounted for the highest proportion. CONCLUSIONS This study demonstrates for the first time that the MGA-XGBoost model with 10 risk factors might predict postoperative infectious complications in elderly CRC patients.
Collapse
Affiliation(s)
- Yuan Tian
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Rui Li
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Guanlong Wang
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Kai Xu
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Hongxia Li
- Department of Oncology, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Lei He
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China.
| |
Collapse
|
25
|
Romero-Velez G, Dang J, Barajas-Gamboa JS, Lee-St John T, Strong AT, Navarrete S, Corcelles R, Rodriguez J, Fares M, Kroh M. Machine learning prediction of major adverse cardiac events after elective bariatric surgery. Surg Endosc 2024; 38:319-326. [PMID: 37749205 DOI: 10.1007/s00464-023-10429-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 08/31/2023] [Indexed: 09/27/2023]
Abstract
BACKGROUND Machine learning (ML) is an emerging technology with the potential to predict and improve clinical outcomes including adverse events, based on complex pattern recognition. Major adverse cardiac events (MACE) after bariatric surgery have an incidence of 0.1% but carry significant morbidity and mortality. Prior studies have investigated these events using traditional statistical methods, however, studies reporting ML for MACE prediction in bariatric surgery remain limited. As such, the objective of this study was to evaluate and compare MACE prediction models in bariatric surgery using traditional statistical methods and ML. METHODS Cross-sectional study of the MBSAQIP database, from 2015 to 2019. A binary-outcome MACE prediction model was generated using three different modeling methods: (1) main-effects-only logistic regression, (2) neural network with a single hidden layer, and (3) XGBoost model with a max depth of 3. The same set of predictor variables and random split of the total data (50/50) were used to train and validate each model. Overall performance was compared based on the area under the receiver operating curve (AUC). RESULTS A total of 755,506 patients were included, of which 0.1% experienced MACE. Of the total sample, 79.6% were female, 47.8% had hypertension, 26.2% had diabetes, 23.7% had hyperlipidemia, 8.4% used tobacco within 1 year, 1.9% had previous percutaneous cardiac intervention, 1.2% had a history of myocardial infarction, 1.1% had previous cardiac surgery, and 0.6% had renal insufficiency. The AUC for the three different MACE prediction models was: 0.790 for logistic regression, 0.798 for neural network and 0.787 for XGBoost. While the AUC implies similar discriminant function, the risk prediction histogram for the neural network shifted in a smoother fashion. CONCLUSION The ML models developed achieved good discriminant function in predicting MACE. ML can help clinicians with patient selection and identify individuals who may be at elevated risk for MACE after bariatric surgery.
Collapse
Affiliation(s)
| | - Jerry Dang
- Digestive Disease and Surgery Institute, Cleveland Clinic, 9500 Euclid Avenue, Desk A100, Cleveland, OH, 44195, USA
| | | | | | - Andrew T Strong
- Digestive Disease and Surgery Institute, Cleveland Clinic, 9500 Euclid Avenue, Desk A100, Cleveland, OH, 44195, USA
| | - Salvador Navarrete
- Digestive Disease and Surgery Institute, Cleveland Clinic, 9500 Euclid Avenue, Desk A100, Cleveland, OH, 44195, USA
| | - Ricard Corcelles
- Digestive Disease and Surgery Institute, Cleveland Clinic, 9500 Euclid Avenue, Desk A100, Cleveland, OH, 44195, USA
| | - John Rodriguez
- Digestive Disease Institute, Cleveland Clinic, Abu Dhabi, United Arab Emirates
| | - Maan Fares
- Heart, Vascular and Thoracic Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Matthew Kroh
- Digestive Disease and Surgery Institute, Cleveland Clinic, 9500 Euclid Avenue, Desk A100, Cleveland, OH, 44195, USA.
| |
Collapse
|
26
|
Arina P, Kaczorek MR, Hofmaenner DA, Pisciotta W, Refinetti P, Singer M, Mazomenos EB, Whittle J. Prediction of Complications and Prognostication in Perioperative Medicine: A Systematic Review and PROBAST Assessment of Machine Learning Tools. Anesthesiology 2024; 140:85-101. [PMID: 37944114 PMCID: PMC11146190 DOI: 10.1097/aln.0000000000004764] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Indexed: 11/12/2023]
Abstract
BACKGROUND The utilization of artificial intelligence and machine learning as diagnostic and predictive tools in perioperative medicine holds great promise. Indeed, many studies have been performed in recent years to explore the potential. The purpose of this systematic review is to assess the current state of machine learning in perioperative medicine, its utility in prediction of complications and prognostication, and limitations related to bias and validation. METHODS A multidisciplinary team of clinicians and engineers conducted a systematic review using the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) protocol. Multiple databases were searched, including Scopus, Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Cochrane Library, PubMed, Medline, Embase, and Web of Science. The systematic review focused on study design, type of machine learning model used, validation techniques applied, and reported model performance on prediction of complications and prognostication. This review further classified outcomes and machine learning applications using an ad hoc classification system. The Prediction model Risk Of Bias Assessment Tool (PROBAST) was used to assess risk of bias and applicability of the studies. RESULTS A total of 103 studies were identified. The models reported in the literature were primarily based on single-center validations (75%), with only 13% being externally validated across multiple centers. Most of the mortality models demonstrated a limited ability to discriminate and classify effectively. The PROBAST assessment indicated a high risk of systematic errors in predicted outcomes and artificial intelligence or machine learning applications. CONCLUSIONS The findings indicate that the development of this field is still in its early stages. This systematic review indicates that application of machine learning in perioperative medicine is still at an early stage. While many studies suggest potential utility, several key challenges must be first overcome before their introduction into clinical practice. EDITOR’S PERSPECTIVE
Collapse
Affiliation(s)
- Pietro Arina
- Bloomsbury Institute of Intensive Care Medicine and Human Physiology and Performance Laboratory, Centre for Perioperative Medicine, Department of Targeted Intervention, University College London, London, United Kingdom
| | - Maciej R. Kaczorek
- Wellcome/EPSRC Centre of Interventional and Surgical Sciences and Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Daniel A. Hofmaenner
- Bloomsbury Institute of Intensive Care Medicine, University College London, London, United Kingdom; and Institute of Intensive Care Medicine, University Hospital Zurich, Zurich, Switzerland
| | - Walter Pisciotta
- Bloomsbury Institute of Intensive Care Medicine, University College London, London, United Kingdom
| | - Patricia Refinetti
- Human Physiology and Performance Laboratory, Centre for Perioperative Medicine, Department of Targeted Intervention, University College London, London, United Kingdom
| | - Mervyn Singer
- Bloomsbury Institute of Intensive Care Medicine, University College London, London, United Kingdom
| | - Evangelos B. Mazomenos
- Wellcome/EPSRC Centre of Interventional and Surgical Sciences and Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - John Whittle
- Human Physiology and Performance Laboratory, Centre for Perioperative Medicine, Department of Targeted Intervention, University College London, London, United Kingdom
| |
Collapse
|
27
|
Ravenel M, Joliat GR, Demartines N, Uldry E, Melloul E, Labgaa I. Machine learning to predict postoperative complications after digestive surgery: a scoping review. Br J Surg 2023; 110:1646-1649. [PMID: 37478369 PMCID: PMC10638531 DOI: 10.1093/bjs/znad229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Revised: 07/05/2023] [Accepted: 07/06/2023] [Indexed: 07/23/2023]
Affiliation(s)
- Maximilien Ravenel
- Department of Visceral Surgery, Lausanne University Hospital (CHUV), University of Lausanne (UNIL), Lausanne, Switzerland
- Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL), Lausanne, Switzerland
| | - Gaëtan-Romain Joliat
- Department of Visceral Surgery, Lausanne University Hospital (CHUV), University of Lausanne (UNIL), Lausanne, Switzerland
- Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL), Lausanne, Switzerland
- Graduate School of Health Sciences, University of Bern, Bern, Switzerland
| | - Nicolas Demartines
- Department of Visceral Surgery, Lausanne University Hospital (CHUV), University of Lausanne (UNIL), Lausanne, Switzerland
- Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL), Lausanne, Switzerland
| | - Emilie Uldry
- Department of Visceral Surgery, Lausanne University Hospital (CHUV), University of Lausanne (UNIL), Lausanne, Switzerland
- Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL), Lausanne, Switzerland
| | - Emmanuel Melloul
- Department of Visceral Surgery, Lausanne University Hospital (CHUV), University of Lausanne (UNIL), Lausanne, Switzerland
- Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL), Lausanne, Switzerland
| | - Ismail Labgaa
- Department of Visceral Surgery, Lausanne University Hospital (CHUV), University of Lausanne (UNIL), Lausanne, Switzerland
- Faculty of Biology and Medicine (FBM), University of Lausanne (UNIL), Lausanne, Switzerland
| |
Collapse
|
28
|
Butler LR, Chen KA, Hsu J, Kapadia MR, Gomez SM, Farrell TM. Predicting readmission after bariatric surgery using machine learning. Surg Obes Relat Dis 2023; 19:1236-1244. [PMID: 37455158 PMCID: PMC12057647 DOI: 10.1016/j.soard.2023.05.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Accepted: 05/27/2023] [Indexed: 07/18/2023]
Abstract
BACKGROUND While bariatric surgery is an effective method for achieving long-term weight loss, postoperative readmissions are associated with negative clinical outcomes and significant costs. OBJECTIVES We aimed to use machine learning (ML) algorithms to predict readmissions and compare results to logistic regression. SETTING Hospitals participating in the Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program, United States. METHODS Patients who underwent sleeve gastrectomy (SG), Roux-en-Y gastric bypass (RYGB), and biliopancreatic diversion with duodenal switch between 2016 and 2020 were selected from the Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) database. Patient variables reported by the MBSAQIP database were analyzed by ML algorithms random forest (RF), gradient boosting (XGB), and deep neural networks (NN), and the results of the predictive models were compared to logistic regression using area under the receiver operating characteristic curve (AUROC). RESULTS Our study included 863,348 patients, of which 39,068 (4.52%) were readmitted. AUROC scores were XGB .785 (95% CI .784-.786), RF .785 (95% CI .784-.785), and NN .754 (95% CI .753-.754), compared with .62 (95% CI .62-.621) for logistic regression (LR) (P < .001). The sensitivity and specificity for XGB, the best performing model, were 73.81% and 70%, compared with 52.94% and 70% for logistic regression. The most important variables were intervention or reoperation prior to discharge, unplanned ICU admission, initial procedure, and the intraoperative transfusion. CONCLUSIONS ML demonstrates significant advantages over logistic regression when predicting 30-day readmission following bariatric surgery. With external validation, models could identify the best candidates for early discharge or targeted postdischarge resources.
Collapse
Affiliation(s)
- Logan R Butler
- Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina.
| | - Kevin A Chen
- Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Justin Hsu
- Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Muneera R Kapadia
- Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Shawn M Gomez
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Timothy M Farrell
- Department of Surgery, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| |
Collapse
|
29
|
Stam WT, Ingwersen EW, Ali M, Spijkerman JT, Kazemier G, Bruns ERJ, Daams F. Machine learning models in clinical practice for the prediction of postoperative complications after major abdominal surgery. Surg Today 2023; 53:1209-1215. [PMID: 36840764 PMCID: PMC10520164 DOI: 10.1007/s00595-023-02662-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 02/07/2023] [Indexed: 02/26/2023]
Abstract
Complications after surgery have a major impact on short- and long-term outcomes, and decades of technological advancement have not yet led to the eradication of their risk. The accurate prediction of complications, recently enhanced by the development of machine learning algorithms, has the potential to completely reshape surgical patient management. In this paper, we reflect on multiple issues facing the implementation of machine learning, from the development to the actual implementation of machine learning models in daily clinical practice, providing suggestions on the use of machine learning models for predicting postoperative complications after major abdominal surgery.
Collapse
Affiliation(s)
- Wessel T Stam
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands
- AGEM Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam, The Netherlands
| | - Erik W Ingwersen
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands
- AGEM Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam, The Netherlands
| | - Mahsoem Ali
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands
| | - Jorik T Spijkerman
- Independent Consultant in Computational Intelligence, Amsterdam, The Netherlands
| | - Geert Kazemier
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands
| | - Emma R J Bruns
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands
| | - Freek Daams
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands.
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands.
| |
Collapse
|
30
|
Hsu JL, Chen KA, Butler LR, Bahraini A, Kapadia MR, Gomez SM, Farrell TM. Application of machine learning to predict postoperative gastrointestinal bleed in bariatric surgery. Surg Endosc 2023; 37:7121-7127. [PMID: 37311893 PMCID: PMC12046526 DOI: 10.1007/s00464-023-10156-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 05/20/2023] [Indexed: 06/15/2023]
Abstract
BACKGROUND Postoperative gastrointestinal bleeding (GIB) is a rare but serious complication of bariatric surgery. The recent rise in extended venous thromboembolism regimens as well as outpatient bariatric surgery may increase the risk of postoperative GIB or lead to delay in diagnosis. This study seeks to use machine learning (ML) to create a model that predicts postoperative GIB to aid surgeon decision-making and improve patient counseling for postoperative bleeds. METHODS The Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) database was used to train and validate three types of ML methods: random forest (RF), gradient boosting (XGB), and deep neural networks (NN), and compare them with logistic regression (LR) regarding postoperative GIB. The dataset was split using fivefold cross-validation into training and validation sets, in an 80/20 ratio. The performance of the models was assessed using area under the receiver operating characteristic curve (AUROC) and compared with the DeLong test. Variables with the strongest effect were identified using Shapley additive explanations (SHAP). RESULTS The study included 159,959 patients. Postoperative GIB was identified in 632 (0.4%) patients. The three ML methods, RF (AUROC 0.764), XGB (AUROC 0.746), and NN (AUROC 0.741) all outperformed LR (AUROC 0.709). The best ML method, RF, was able to predict postoperative GIB with a specificity and sensitivity of 70.0% and 75.4%, respectively. Using DeLong testing, the difference between RF and LR was determined to be significant with p < 0.01. Type of bariatric surgery, pre-op hematocrit, age, duration of procedure, and pre-op creatinine were the 5 most important features identified by ML retrospectively. CONCLUSIONS We have developed a ML model that outperformed LR in predicting postoperative GIB. Using ML models for risk prediction can be a helpful tool for both surgeons and patients undergoing bariatric procedures but more interpretable models are needed.
Collapse
Affiliation(s)
- Justin L Hsu
- Department of Surgery, University of North Carolina School of Medicine, 4001 Burnett-Womack CB#7050, Chapel Hill, NC, 27599, USA.
| | - Kevin A Chen
- Department of Surgery, University of North Carolina School of Medicine, 4001 Burnett-Womack CB#7050, Chapel Hill, NC, 27599, USA
| | - Logan R Butler
- University of North Carolina School of Medicine, Chapel Hill, NC, USA
| | - Anoosh Bahraini
- Department of Surgery, University of North Carolina School of Medicine, 4001 Burnett-Womack CB#7050, Chapel Hill, NC, 27599, USA
| | - Muneera R Kapadia
- Department of Surgery, University of North Carolina School of Medicine, 4001 Burnett-Womack CB#7050, Chapel Hill, NC, 27599, USA
| | - Shawn M Gomez
- Department of Biomedical Engineering, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Timothy M Farrell
- Department of Surgery, University of North Carolina School of Medicine, 4001 Burnett-Womack CB#7050, Chapel Hill, NC, 27599, USA
| |
Collapse
|
31
|
Chen KA, Goffredo P, Hu D, Joisa CU, Guillem JG, Gomez SM, Kapadia MR. Estimating Risk of Locoregional Failure and Overall Survival in Anal Cancer Following Chemoradiation: A Machine Learning Approach. J Gastrointest Surg 2023; 27:1925-1935. [PMID: 37407899 PMCID: PMC10528925 DOI: 10.1007/s11605-023-05755-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 06/03/2023] [Indexed: 07/07/2023]
Abstract
BACKGROUND Optimal treatment of anal squamous cell carcinoma (ASCC) is definitive chemoradiation. Patients with persistent or recurrent disease require abdominoperineal resection (APR). Current models for predicting need for APR and overall survival are limited by low accuracy or small datasets. This study sought to use machine learning (ML) to develop more accurate models for locoregional failure and overall survival for ASCC. METHODS This study used the National Cancer Database from 2004-2018, divided into training, validation, and test sets. We included patients with stage I-III ASCC who underwent chemoradiation. Our primary outcomes were need for APR and 3-year overall survival. Random forest (RF), gradient boosting (XGB), and neural network (NN) ML-based models were developed and compared with logistic regression (LR). Accuracy was assessed using area under the receiver operating characteristic curve (AUROC). RESULTS APR was required in 5.3% (1,015/18,978) of patients. XGB performed best with AUROC of 0.813, compared with 0.691 for LR. Tumor size, lymphovascular invasion, and tumor grade showed the strongest influence on model predictions. Mortality was 23.6% (7,988/33,834). AUROC for XGB and LR were similar at 0.766 and 0.748, respectively. For this model, age, radiation dose, sex, and insurance status were the most influential variables. CONCLUSIONS We developed and internally validated machine learning-based models for predicting outcomes in ASCC and showed higher accuracy versus LR for locoregional failure, but not overall survival. After external validation, these models may assist clinicians with identifying patients with ASCC at high risk of treatment failure.
Collapse
Affiliation(s)
- Kevin A Chen
- Divison of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, 100 Manning Drive, 4038 Burnett Womack Building, CB #7050, Chapel Hill, NC, 27599, USA
| | - Paolo Goffredo
- Division of Colon & Rectal Surgery, Department of Surgery, University of Minnesota, 420 Delaware St SE, MN, 55455, Minneapolis, USA
| | - David Hu
- Department of Biostatistics, UNC Gillings School of Global Public Health, University of North Carolina at Chapel Hill, 3101 McGavran-Greenberg Hall, CB #7420, Chapel Hill, NC, 27599-7420, USA
| | - Chinmaya U Joisa
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599, USA
| | - Jose G Guillem
- Divison of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, 100 Manning Drive, 4038 Burnett Womack Building, CB #7050, Chapel Hill, NC, 27599, USA
| | - Shawn M Gomez
- Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599, USA
| | - Muneera R Kapadia
- Divison of Gastrointestinal Surgery, Department of Surgery, University of North Carolina at Chapel Hill, 100 Manning Drive, 4038 Burnett Womack Building, CB #7050, Chapel Hill, NC, 27599, USA.
| |
Collapse
|
32
|
Yu YC, Zhang W, O'Gara D, Li JS, Chang SH. A moment kernel machine for clinical data mining to inform medical decision making. Sci Rep 2023; 13:10459. [PMID: 37380721 DOI: 10.1038/s41598-023-36752-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Accepted: 06/09/2023] [Indexed: 06/30/2023] Open
Abstract
Machine learning-aided medical decision making presents three major challenges: achieving model parsimony, ensuring credible predictions, and providing real-time recommendations with high computational efficiency. In this paper, we formulate medical decision making as a classification problem and develop a moment kernel machine (MKM) to tackle these challenges. The main idea of our approach is to treat the clinical data of each patient as a probability distribution and leverage moment representations of these distributions to build the MKM, which transforms the high-dimensional clinical data to low-dimensional representations while retaining essential information. We then apply this machine to various pre-surgical clinical datasets to predict surgical outcomes and inform medical decision making, which requires significantly less computational power and time for classification while yielding favorable performance compared to existing methods. Moreover, we utilize synthetic datasets to demonstrate that the developed moment-based data mining framework is robust to noise and missing data, and achieves model parsimony giving an efficient way to generate satisfactory predictions to aid personalized medical decision making.
Collapse
Affiliation(s)
- Yao-Chi Yu
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA
| | - Wei Zhang
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA
| | - David O'Gara
- Division of Computational and Data Sciences, Washington University in St. Louis, St. Louis, MO, 63130, USA
| | - Jr-Shin Li
- Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, 63130, USA.
- Division of Computational and Data Sciences, Washington University in St. Louis, St. Louis, MO, 63130, USA.
- Division of Biology and Biomedical Sciences, Washington University in St. Louis, St. Louis, MO, 63130, USA.
| | - Su-Hsin Chang
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine, St. Louis, MO, 63110, USA.
| |
Collapse
|
33
|
Hany M, Zidan A, Sabry K, Ibrahim M, Agayby ASS, Aboelsoud MR, Torensma B. How Good is Stratification and Prediction Model Analysis Between Primary and Revisional Roux-en-Y Gastric Bypass Surgery? A Multi-center Study and Narrative Review. Obes Surg 2023; 33:1431-1448. [PMID: 36905504 PMCID: PMC10156787 DOI: 10.1007/s11695-023-06532-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Revised: 02/24/2023] [Accepted: 02/24/2023] [Indexed: 03/12/2023]
Abstract
INTRODUCTIONS Revision surgery because of weight recurrence is performed in 2.5-33% of primary vertical banded gastroplasty (VBG), laparoscopic sleeve gastrectomy (LSG), and gastric band (GB) cases. These cases qualify for revisional Roux-en-Y gastric bypass (RRYGB). METHODS This retrospective cohort study analyzed data from 2008 to 2019. A stratification analysis and multivariate logistic regression for prediction modeling compared the possibility of sufficient % excess weight loss (%EWL) ≥ 50 or insufficient %EWL < 50 between three different RRYGB procedures, with primary Roux-en-Y gastric bypass (PRYGB) as the control during 2 years of follow-up. A narrative review was conducted to test the presence of prediction models in the literature and their internal and external validity. RESULTS A total of 558 patients underwent PRYGB, and 338 underwent RRYGB after VBG, LSG, and GB, and completed 2 years of follow-up. Overall, 32.2% of patients after RRYGB had a sufficient %EWL ≥ 50 after 2 years, compared to 71.3% after PRYGB (p ≤ 0.001). The total %EWL after the revision surgeries for VBG, LSG, and GB was 68.5%, 74.2%, and 64.1%, respectively (p ≤ 0.001). After correcting for confounding factors, the baseline odds ratio (OR) or sufficient %EWL ≥ 50 after PRYGB, LSG, VBG, and GB was 2.4, 1.45, 0.29, and 0.32, respectively (p ≤ 0.001). Age was the only significant variable in the prediction model (p = 0.0016). It was impossible to develop a validated model after revision surgery because of the differences between stratification and the prediction model. The narrative review showed only 10.2% presence of validation in the prediction models, and 52.5% had external validation. CONCLUSION Overall, 32.2% of all patients after revisional surgery had a sufficient %EWL ≥ 50 after 2 years, compared to PRYGB. LSG had the best outcome in the revisional surgery group in the sufficient %EWL group and the best outcome in the insufficient %EWL group. The skewness between the prediction model and stratification resulted in a partially non-functional prediction model.
Collapse
Affiliation(s)
- Mohamed Hany
- Department of Surgery, Medical Research Institute, Alexandria University, 165 Horreya Avenue, Hadara, Alexandria, 21561, Egypt.
- Bariatric Surgery at Madina Women's Hospital (IFSO-Certified Bariatric Center), Alexandria, Egypt.
| | - Ahmed Zidan
- Department of Surgery, Medical Research Institute, Alexandria University, 165 Horreya Avenue, Hadara, Alexandria, 21561, Egypt
| | - Karim Sabry
- Department of Surgery, Ain Shams University, Cairo, Egypt
| | - Mohamed Ibrahim
- Department of Surgery, Medical Research Institute, Alexandria University, 165 Horreya Avenue, Hadara, Alexandria, 21561, Egypt
| | - Ann Samy Shafiq Agayby
- Department of Surgery, Medical Research Institute, Alexandria University, 165 Horreya Avenue, Hadara, Alexandria, 21561, Egypt
| | - Moustafa R Aboelsoud
- Department of Surgery, Medical Research Institute, Alexandria University, 165 Horreya Avenue, Hadara, Alexandria, 21561, Egypt
| | - Bart Torensma
- Leiden University Medical Center (LUMC), Leiden, The Netherlands
| |
Collapse
|
34
|
Liu Y, Ko CY, Hall BL, Cohen ME. American College of Surgeons NSQIP Risk Calculator Accuracy Using a Machine Learning Algorithm Compared with Regression. J Am Coll Surg 2023; 236:1024-1030. [PMID: 36728295 DOI: 10.1097/xcs.0000000000000556] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
BACKGROUND The American College of Surgeons NSQIP risk calculator (RC) uses regression to make predictions for fourteen 30-day surgical outcomes. While this approach provides accurate (discrimination and calibration) risk estimates, they might be improved by machine learning (ML). To investigate this possibility, accuracy for regression-based risk estimates were compared to estimates from an extreme gradient boosting (XGB)-ML algorithm. STUDY DESIGN A cohort of 5,020,713 million NSQIP patient records was randomly divided into 80% for model construction and 20% for validation. Risk predictions using regression and XGB-ML were made for 13 RC binary 30-day surgical complications and one continuous outcome (length of stay [LOS]). For the binary outcomes, discrimination was evaluated using the area under the receiver operating characteristic curve (AUROC) and area under the precision recall curve (AUPRC), and calibration was evaluated using Hosmer-Lemeshow statistics. Mean squared error and a calibration curve analog were evaluated for the continuous LOS outcome. RESULTS For every binary outcome, discrimination (AUROC and AUPRC) was slightly greater for XGB-ML than for regression (mean [across the outcomes] AUROC was 0.8299 vs 0.8251, and mean AUPRC was 0.1558 vs 0.1476, for XGB-ML and regression, respectively). For each outcome, miscalibration was greater (larger Hosmer-Lemeshow values) with regression; there was statistically significant miscalibration for all regression-based estimates, but only for 4 of 13 when XGB-ML was used. For LOS, mean squared error was lower for XGB-ML. CONCLUSIONS XGB-ML provided more accurate risk estimates than regression in terms of discrimination and calibration. Differences in calibration between regression and XGB-ML were of substantial magnitude and support transitioning the RC to XGB-ML.
Collapse
Affiliation(s)
- Yaoming Liu
- From the Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL (Liu, Ko, Hall, Cohen)
| | - Clifford Y Ko
- From the Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL (Liu, Ko, Hall, Cohen)
- the Department of Surgery, University of California Los Angeles David Geffen School of Medicine and the VA Greater Los Angeles Healthcare System, Los Angeles, CA (Ko)
| | - Bruce L Hall
- From the Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL (Liu, Ko, Hall, Cohen)
- the Department of Surgery, Washington University in St. Louis; Center for Health Policy and the Olin Business School at Washington University in St Louis; John Cochran Veterans Affairs Medical Center; and BJC Healthcare, St Louis, MO (Hall)
| | - Mark E Cohen
- From the Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL (Liu, Ko, Hall, Cohen)
| |
Collapse
|
35
|
Chen KA, Joisa CU, Stem J, Guillem JG, Eng SMG, Kapadia MR. Improved Prediction of Surgical-Site Infection After Colorectal Surgery Using Machine Learning. Dis Colon Rectum 2023; 66:458-466. [PMID: 36538699 PMCID: PMC10069984 DOI: 10.1097/dcr.0000000000002559] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
BACKGROUND Surgical-site infection is a source of significant morbidity after colorectal surgery. Previous efforts to develop models that predict surgical-site infection have had limited accuracy. Machine learning has shown promise in predicting postoperative outcomes by identifying nonlinear patterns within large data sets. OBJECTIVE This study aimed to seek usage of machine learning to develop a more accurate predictive model for colorectal surgical-site infections. DESIGN Patients who underwent colorectal surgery were identified in the American College of Surgeons National Quality Improvement Program database from years 2012 to 2019 and were split into training, validation, and test sets. Machine-learning techniques included random forest, gradient boosting, and artificial neural network. A logistic regression model was also created. Model performance was assessed using area under the receiver operating characteristic curve. SETTINGS A national, multicenter data set. PATIENTS Patients who underwent colorectal surgery. MAIN OUTCOME MEASURES The primary outcome (surgical-site infection) included patients who experienced superficial, deep, or organ-space surgical-site infections. RESULTS The data set included 275,152 patients after the application of exclusion criteria. Of all patients, 10.7% experienced a surgical-site infection. Artificial neural network showed the best performance with area under the receiver operating characteristic curve of 0.769 (95% CI, 0.762-0.777), compared with 0.766 (95% CI, 0.759-0.774) for gradient boosting, 0.764 (95% CI, 0.756-0.772) for random forest, and 0.677 (95% CI, 0.669-0.685) for logistic regression. For the artificial neural network model, the strongest predictors of surgical-site infection were organ-space surgical-site infection present at time of surgery, operative time, oral antibiotic bowel preparation, and surgical approach. LIMITATIONS Local institutional validation was not performed. CONCLUSIONS Machine-learning techniques predict colorectal surgical-site infections with higher accuracy than logistic regression. These techniques may be used to identify patients at increased risk and to target preventive interventions for surgical-site infection. See Video Abstract at http://links.lww.com/DCR/C88 . PREDICCIN MEJORADA DE LA INFECCIN DEL SITIO QUIRRGICO DESPUS DE LA CIRUGA COLORRECTAL MEDIANTE EL APRENDIZAJE AUTOMTICO ANTECEDENTES:La infección del sitio quirúrgico es una fuente de morbilidad significativa después de la cirugía colorrectal. Los esfuerzos anteriores para desarrollar modelos que predijeran la infección del sitio quirúrgico han tenido una precisión limitada. El aprendizaje automático se ha mostrado prometedor en la predicción de los resultados posoperatorios mediante la identificación de patrones no lineales dentro de grandes conjuntos de datos.OBJETIVO:Intentamos utilizar el aprendizaje automático para desarrollar un modelo predictivo más preciso para las infecciones del sitio quirúrgico colorrectal.DISEÑO:Los pacientes que se sometieron a cirugía colorrectal se identificaron en la base de datos del Programa Nacional de Mejoramiento de la Calidad del Colegio Estadounidense de Cirujanos de los años 2012 a 2019 y se dividieron en conjuntos de capacitación, validación y prueba. Las técnicas de aprendizaje automático incluyeron conjunto aleatorio, aumento de gradiente y red neuronal artificial. También se creó un modelo de regresión logística. El rendimiento del modelo se evaluó utilizando el área bajo la curva característica operativa del receptor.CONFIGURACIÓN:Un conjunto de datos multicéntrico nacional.PACIENTES:Pacientes intervenidos de cirugía colorrectal.PRINCIPALES MEDIDAS DE RESULTADO:El resultado primario (infección del sitio quirúrgico) incluyó pacientes que experimentaron infecciones superficiales, profundas o del espacio de órganos del sitio quirúrgico.RESULTADOS:El conjunto de datos incluyó 275.152 pacientes después de la aplicación de los criterios de exclusión. El 10,7% de los pacientes presentó infección del sitio quirúrgico. La red neuronal artificial mostró el mejor rendimiento con el área bajo la curva característica operativa del receptor de 0,769 (IC del 95 %: 0,762 - 0,777), en comparación con 0,766 (IC del 95 %: 0,759 - 0,774) para el aumento de gradiente, 0,764 (IC del 95 %: 0,756 - 0,772) para conjunto aleatorio y 0,677 (IC 95% 0,669 - 0,685) para regresión logística. Para el modelo de red neuronal artificial, los predictores más fuertes de infección del sitio quirúrgico fueron la infección del sitio quirúrgico del espacio del órgano presente en el momento de la cirugía, el tiempo operatorio, la preparación intestinal con antibióticos orales y el abordaje quirúrgico.LIMITACIONES:No se realizó validación institucional local.CONCLUSIONES:Las técnicas de aprendizaje automático predicen infecciones del sitio quirúrgico colorrectal con mayor precisión que la regresión logística. Estas técnicas se pueden usar para identificar a los pacientes con mayor riesgo y para orientar las intervenciones preventivas para la infección del sitio quirúrgico. Consulte Video Resumen en http://links.lww.com/DCR/C88 . (Traducción-Dr Yolanda Colorado ).
Collapse
Affiliation(s)
- Kevin A Chen
- Department of Surgery, University of North Carolina, Chapel Hill, NC 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Chinmaya U Joisa
- Joint Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599
| | - Jonathan Stem
- Department of Surgery, University of North Carolina, Chapel Hill, NC 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Jose G Guillem
- Department of Surgery, University of North Carolina, Chapel Hill, NC 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Shawn M Gomez Eng
- Joint Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599
| | - Muneera R Kapadia
- Department of Surgery, University of North Carolina, Chapel Hill, NC 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| |
Collapse
|
36
|
Zheng J, Lv X, Jiang L, Liu H, Zhao X. Development of a Pancreatic Fistula Prediction Model After Pancreaticoduodenectomy Based on a Decision Tree and Random Forest Algorithm. Am Surg 2023:31348231158692. [PMID: 36803027 DOI: 10.1177/00031348231158692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
Abstract
BACKGROUND The incidence of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy (PD) is high. We sought to develop a POPF prediction model based on a decision tree (DT) and random forest (RF) algorithm after PD and to explore its clinical value. METHODS The case data of 257 patients who underwent PD in a tertiary general hospital from 2013 to 2021 were retrospectively collected in China. The RF model was used to select features by ranking the importance of variables, and both algorithms were used to build the prediction model after automatic adjustment of parameters by setting the respective hyperparameter intervals and resampling as a 10-fold cross-validation method, etc. The prediction model's performance was assessed by the receiver operating characteristic curve (ROC) and the area under curve (AUC). RESULTS Postoperative pancreatic fistula occurred in 56 cases (56/257, 21.8%). The DT model had an AUC of .743 and an accuracy of .840, while the RF model had an AUC of .977 and an accuracy of .883. The DT plot visualized the process of inferring the risk of pancreatic fistula from the DT model on independent individuals. The top 10 important variables were selected for ranking in the RF variable importance ranking. CONCLUSION This study successfully developed a DT and RF algorithm for the POPF prediction model, which can be used as a reference for clinical health care professionals to optimize treatment strategies to reduce the incidence of POPF.
Collapse
Affiliation(s)
- Jisheng Zheng
- School of Nursing, Binzhou Medical University, Yantai, China
| | - Xiaoqin Lv
- Department of Hepatobiliary Surgery, Binzhou Medical University Hospital, Binzhou, China
| | - Lihui Jiang
- Hepatobiliary, Pancreatic and Splenic Surgery, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, China
| | - Haiwei Liu
- Department of Hepatobiliary Surgery, Binzhou Medical University Hospital, Binzhou, China
| | - Xiaomin Zhao
- School of Nursing, Binzhou Medical University, Yantai, China
| |
Collapse
|
37
|
Enodien B, Taha-Mehlitz S, Saad B, Nasser M, Frey DM, Taha A. The development of machine learning in bariatric surgery. Front Surg 2023; 10:1102711. [PMID: 36911599 PMCID: PMC9998495 DOI: 10.3389/fsurg.2023.1102711] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Accepted: 02/08/2023] [Indexed: 03/14/2023] Open
Abstract
Background Machine learning (ML), is an approach to data analysis that makes the process of analytical model building automatic. The significance of ML stems from its potential to evaluate big data and achieve quicker and more accurate outcomes. ML has recently witnessed increased adoption in the medical domain. Bariatric surgery, otherwise referred to as weight loss surgery, reflects the series of procedures performed on people demonstrating obesity. This systematic scoping review aims to explore the development of ML in bariatric surgery. Methods The study used the Preferred Reporting Items for Systematic and Meta-analyses for Scoping Review (PRISMA-ScR). A comprehensive literature search was performed of several databases including PubMed, Cochrane, and IEEE, and search engines namely Google Scholar. Eligible studies included journals published from 2016 to the current date. The PRESS checklist was used to evaluate the consistency demonstrated during the process. Results A total of seventeen articles qualified for inclusion in the study. Out of the included studies, sixteen concentrated on the role of ML algorithms in prediction, while one addressed ML's diagnostic capacity. Most articles (n = 15) were journal publications, whereas the rest (n = 2) were papers from conference proceedings. Most included reports were from the United States (n = 6). Most studies addressed neural networks, with convolutional neural networks as the most prevalent. Also, the data type used in most articles (n = 13) was derived from hospital databases, with very few articles (n = 4) collecting original data via observation. Conclusions This study indicates that ML has numerous benefits in bariatric surgery, however its current application is limited. The evidence suggests that bariatric surgeons can benefit from ML algorithms since they will facilitate the prediction and evaluation of patient outcomes. Also, ML approaches to enhance work processes by making data categorization and analysis easier. However, further large multicenter studies are required to validate results internally and externally as well as explore and address limitations of ML application in bariatric surgery.
Collapse
Affiliation(s)
- Bassey Enodien
- Department of Surgery, GZO-Hospital, Wetzikon, Switzerland
| | - Stephanie Taha-Mehlitz
- Clarunis, University Centre for Gastrointestinal and Liver Diseases, St. Clara Hospital and University Hospital, Basel, Switzerland
| | - Baraa Saad
- School of Medicine, St George's University of London, London, United Kingdom
| | - Maya Nasser
- School of Medicine, St George's University of London, London, United Kingdom
| | - Daniel M Frey
- Department of Biomedical Engineering, Faculty of Medicine, University of Basel, Allschwil, Switzerland
| | - Anas Taha
- Clarunis, University Centre for Gastrointestinal and Liver Diseases, St. Clara Hospital and University Hospital, Basel, Switzerland.,Department of Biomedical Engineering, Faculty of Medicine, University of Basel, Allschwil, Switzerland
| |
Collapse
|
38
|
Xu Q, Lei H, Li X, Li F, Shi H, Wang G, Sun A, Wang Y, Peng B. Machine learning predicts cancer-associated venous thromboembolism using clinically available variables in gastric cancer patients. Heliyon 2023; 9:e12681. [PMID: 36632097 PMCID: PMC9826862 DOI: 10.1016/j.heliyon.2022.e12681] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 12/20/2022] [Accepted: 12/21/2022] [Indexed: 01/07/2023] Open
Abstract
Stomach cancer (GC) has one of the highest rates of thrombosis among cancers and can lead to considerable morbidity, mortality, and additional costs. However, to date, there is no suitable venous thromboembolism (VTE) prediction model for gastric cancer patients to predict risk. Therefore, there is an urgent need to establish a clinical prediction model for VTE in gastric cancer patients. We collected data on 3092 patients between January 1, 2018 and December 31, 2021. And after feature selection, 11 variables are reserved as predictors to build the model. Five machine learning (ML) algorithms are used to build different VTE predictive models. The accuracy, sensitivity, specificity, and AUC of these five models were compared with traditional logistic regression (LR) to recommend the best VTE prediction model. RF and XGB models have selected the essential characters in the model: Clinical stage, Blood Transfusion History, D-Dimer, AGE, and FDP. The model has an AUC of 0.825, an accuracy of 0.799, a sensitivity of 0.710, and a specificity of 0.802 in the validation set. The model has good performance and high application value in clinical practice, and can identify high-risk groups of gastric cancer patients and prevent venous thromboembolism.
Collapse
Affiliation(s)
- Qianjie Xu
- Department of Health Statistics, School of Public Health, Chongqing Medical University, Chongqing, 400016, China
| | - Haike Lei
- Chongqing Cancer Multi-omics Big Data Application Engineering Research Center, Chongqing University Cancer Hospital, Chongqing, 400030, China
| | - Xiaosheng Li
- Chongqing Cancer Multi-omics Big Data Application Engineering Research Center, Chongqing University Cancer Hospital, Chongqing, 400030, China
| | - Fang Li
- Chongqing Cancer Multi-omics Big Data Application Engineering Research Center, Chongqing University Cancer Hospital, Chongqing, 400030, China
| | - Hao Shi
- Chongqing Cancer Multi-omics Big Data Application Engineering Research Center, Chongqing University Cancer Hospital, Chongqing, 400030, China
| | - Guixue Wang
- MOE Key Lab for Biorheological Science and Technology, State and Local Joint Engineering Laboratory for Vascular Implants, College of Bioengineering Chongqing University, Chongqing, 400030, China
| | - Anlong Sun
- Chongqing Cancer Multi-omics Big Data Application Engineering Research Center, Chongqing University Cancer Hospital, Chongqing, 400030, China
| | - Ying Wang
- Chongqing Cancer Multi-omics Big Data Application Engineering Research Center, Chongqing University Cancer Hospital, Chongqing, 400030, China
| | - Bin Peng
- Department of Health Statistics, School of Public Health, Chongqing Medical University, Chongqing, 400016, China
| |
Collapse
|
39
|
Chen KA, Joisa CU, Stitzenberg KB, Stem J, Guillem JG, Gomez SM, Kapadia MR. Development and Validation of Machine Learning Models to Predict Readmission After Colorectal Surgery. J Gastrointest Surg 2022; 26:2342-2350. [PMID: 36070116 PMCID: PMC10081888 DOI: 10.1007/s11605-022-05443-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 08/18/2022] [Indexed: 01/31/2023]
Abstract
BACKGROUND Readmission after colorectal surgery is common and often implies complications for patients and costs for hospitals. Previous works have created predictive models using logistic regression for this outcome but have shown limited accuracy. Machine learning has shown promise in improving predictions by identifying non-linear patterns in data. We sought to create a more accurate predictive model for readmission after colorectal surgery using machine learning. METHODS Patients who underwent colorectal surgery were identified in the National Quality Improvement Program (NSQIP) database including years 2012-2019 and split into training, validation, and test sets. The primary outcome was readmission within 30 days of surgery. Three types of machine learning models were created, including random forest (RF), gradient boosting (XGB), and neural network (NN). A logistic regression (LR) model was also created for comparison. Model performance was evaluated using area under the receiver operating characteristic curve (AUROC). RESULTS The dataset included 213,827 patients after application of exclusion criteria. A total of 23,083 (10.8%) of patients experienced readmission. NN obtained an AUROC of 0.751 (95% CI 0.743-0.759), compared with 0.684 (95% CI 0.676-0.693) for LR. RF and XGB performed similarly with AUROCs of 0.749 (95% CI 0.741-0.757) and 0.745 (95% CI 0.737-0.753) respectively. Ileus, index admission length of stay, organ-space surgical site infection present at time of surgery, and ostomy placement were identified as the most contributory variables. CONCLUSIONS Machine learning approaches outperformed traditional statistical methods in the prediction of readmission after colorectal surgery. After external validation, this improved prediction model could be used to target interventions to reduce readmission rate.
Collapse
Affiliation(s)
- Kevin A Chen
- Department of Surgery, University of North Carolina, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC, 27599, USA
| | - Chinmaya U Joisa
- Joint Department of Biomedical Engineering, University of North Carolina, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599, USA
| | - Karyn B Stitzenberg
- Department of Surgery, University of North Carolina, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC, 27599, USA
| | - Jonathan Stem
- Department of Surgery, University of North Carolina, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC, 27599, USA
| | - Jose G Guillem
- Department of Surgery, University of North Carolina, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC, 27599, USA
| | - Shawn M Gomez
- Joint Department of Biomedical Engineering, University of North Carolina, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599, USA
| | - Muneera R Kapadia
- Department of Surgery, University of North Carolina, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC, 27599, USA.
| |
Collapse
|
40
|
Wilson S, Chen X, Cronin M, Dengler N, Enker P, Krauss ES, Laberko L, Lobastov K, Obi AT, Powell CA, Schastlivtsev I, Segal A, Simonson B, Siracuse J, Wakefield TW, McAneny D, Caprini JA, Caprini JA. Thrombosis prophylaxis in surgical patients using the Caprini Risk Score. Curr Probl Surg 2022; 59:101221. [PMID: 36372452 DOI: 10.1016/j.cpsurg.2022.101221] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Affiliation(s)
| | - Xialan Chen
- Beijing Shijitan Hospital, Capital Medical University, Beijing, P.R. China
| | - MaryAnne Cronin
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Nancy Dengler
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Paul Enker
- Zucker School of Medicine, Hofstra University, Uniondale, NY
| | - Eugene S Krauss
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Leonid Laberko
- Pirogov Russian National Research Medical University, Moscow, Russia
| | - Kirill Lobastov
- Pirogov Russian National Research Medical University, Moscow, Russia
| | - Andrea T Obi
- Section of Vascular Surgery, Department of Surgery, University of Michigan, Ann Arbor, MI
| | - Chloé A Powell
- Department of Surgery, University of Michigan, Ann Arbor, MI
| | | | - Ayal Segal
- Department of Orthopedic Surgery, Syosset Hospital, Syosset, NY
| | - Barry Simonson
- Zucker School of Medicine, Hofstra University, Uniondale, NY
| | | | | | - David McAneny
- Boston University School of Medicine, Boston Medical Center, Boston, MA
| | - Joseph A Caprini
- Emeritus, NorthShore University Health System, University of Chicago Pritzker School of Medicine, Chicago, IL
| | | |
Collapse
|
41
|
Chen KA, Berginski ME, Desai CS, Guillem JG, Stem J, Gomez Eng SM, Kapadia MR. Differential Performance of Machine Learning Models in Prediction of Procedure-Specific Outcomes. J Gastrointest Surg 2022; 26:1732-1742. [PMID: 35508684 PMCID: PMC9444966 DOI: 10.1007/s11605-022-05332-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Accepted: 04/02/2022] [Indexed: 01/31/2023]
Abstract
BACKGROUND Procedure-specific complications can have devastating consequences. Machine learning-based tools have the potential to outperform traditional statistical modeling in predicting their risk and guiding decision-making. We sought to develop and compare deep neural network (NN) models, a type of machine learning, to logistic regression (LR) for predicting anastomotic leak after colectomy, bile leak after hepatectomy, and pancreatic fistula after pancreaticoduodenectomy (PD). METHODS The colectomy, hepatectomy, and PD National Surgical Quality Improvement Program (NSQIP) databases were analyzed. Each dataset was split into training, validation, and testing sets in a 60/20/20 ratio, with fivefold cross-validation. Models were created using NN and LR for each outcome. Models were evaluated primarily with area under the receiver operating characteristic curve (AUROC). RESULTS A total of 197,488 patients were included for colectomy, 25,403 for hepatectomy, and 23,333 for PD. For anastomotic leak, AUROC for NN was 0.676 (95% 0.666-0.687), compared with 0.633 (95% CI 0.620-0.647) for LR. For bile leak, AUROC for NN was 0.750 (95% CI 0.739-0.761), compared with 0.722 (95% CI 0.698-0.746) for LR. For pancreatic fistula, AUROC for NN was 0.746 (95% CI 0.733-0.760), compared with 0.713 (95% CI 0.703-0.723) for LR. Variables related to intra-operative information, such as surgical approach, biliary reconstruction, and pancreatic gland texture were highly important for model predictions. DISCUSSION Machine learning showed a marginal advantage over traditional statistical techniques in predicting procedure-specific outcomes. However, models that included intra-operative information performed better than those that did not, suggesting that NSQIP procedure-targeted datasets may be strengthened by including relevant intra-operative information.
Collapse
Affiliation(s)
- Kevin A Chen
- Department of Surgery, University of North Carolina, Chapel Hill, NC, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Matthew E Berginski
- Department of Pharmacology, University of North Carolina, Chapel Hill, NC, 120 Mason Farm Rd, Genetic Medicine Building, Chapel Hill, NC 27599
| | - Chirag S Desai
- Department of Surgery, University of North Carolina, Chapel Hill, NC, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Jose G Guillem
- Department of Surgery, University of North Carolina, Chapel Hill, NC, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Jonathan Stem
- Department of Surgery, University of North Carolina, Chapel Hill, NC, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| | - Shawn M Gomez Eng
- Department of Pharmacology, University of North Carolina, Chapel Hill, NC, 120 Mason Farm Rd, Genetic Medicine Building, Chapel Hill, NC 27599,Joint Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC, 10202C Mary Ellen Jones Building, Chapel Hill, NC, 27599
| | - Muneera R Kapadia
- Department of Surgery, University of North Carolina, Chapel Hill, NC, 100 Manning Drive, Burnett Womack Building, Suite 4038, Chapel Hill, NC 27599
| |
Collapse
|
42
|
Bektaş M, Reiber BMM, Pereira JC, Burchell GL, van der Peet DL. Artificial Intelligence in Bariatric Surgery: Current Status and Future Perspectives. Obes Surg 2022; 32:2772-2783. [PMID: 35713855 PMCID: PMC9273535 DOI: 10.1007/s11695-022-06146-1] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 06/03/2022] [Accepted: 06/03/2022] [Indexed: 11/25/2022]
Abstract
Background Machine learning (ML) has been successful in several fields of healthcare, however the use of ML within bariatric surgery seems to be limited. In this systematic review, an overview of ML applications within bariatric surgery is provided. Methods The databases PubMed, EMBASE, Cochrane, and Web of Science were searched for articles describing ML in bariatric surgery. The Cochrane risk of bias tool and the PROBAST tool were used to evaluate the methodological quality of included studies. Results The majority of applied ML algorithms predicted postoperative complications and weight loss with accuracies up to 98%. Conclusions In conclusion, ML algorithms have shown promising capabilities in the prediction of surgical outcomes after bariatric surgery. Nevertheless, the clinical introduction of ML is dependent upon the external validation of ML.
Collapse
Affiliation(s)
- Mustafa Bektaş
- Department of Gastrointestinal Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, the Netherlands.
| | - Beata M M Reiber
- Department of Gastrointestinal Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, the Netherlands
| | - Jaime Costa Pereira
- Department of Computer Science, Vrije Universiteit Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, the Netherlands
| | - George L Burchell
- Medical Library Department, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, the Netherlands
| | - Donald L van der Peet
- Department of Gastrointestinal Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV, Amsterdam, the Netherlands
| |
Collapse
|
43
|
Fati SM, Senan EM, Azar AT. Hybrid and Deep Learning Approach for Early Diagnosis of Lower Gastrointestinal Diseases. SENSORS (BASEL, SWITZERLAND) 2022; 22:4079. [PMID: 35684696 PMCID: PMC9185306 DOI: 10.3390/s22114079] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Revised: 05/21/2022] [Accepted: 05/24/2022] [Indexed: 05/27/2023]
Abstract
Every year, nearly two million people die as a result of gastrointestinal (GI) disorders. Lower gastrointestinal tract tumors are one of the leading causes of death worldwide. Thus, early detection of the type of tumor is of great importance in the survival of patients. Additionally, removing benign tumors in their early stages has more risks than benefits. Video endoscopy technology is essential for imaging the GI tract and identifying disorders such as bleeding, ulcers, polyps, and malignant tumors. Videography generates 5000 frames, which require extensive analysis and take a long time to follow all frames. Thus, artificial intelligence techniques, which have a higher ability to diagnose and assist physicians in making accurate diagnostic decisions, solve these challenges. In this study, many multi-methodologies were developed, where the work was divided into four proposed systems; each system has more than one diagnostic method. The first proposed system utilizes artificial neural networks (ANN) and feed-forward neural networks (FFNN) algorithms based on extracting hybrid features by three algorithms: local binary pattern (LBP), gray level co-occurrence matrix (GLCM), and fuzzy color histogram (FCH) algorithms. The second proposed system uses pre-trained CNN models which are the GoogLeNet and AlexNet based on the extraction of deep feature maps and their classification with high accuracy. The third proposed method uses hybrid techniques consisting of two blocks: the first block of CNN models (GoogLeNet and AlexNet) to extract feature maps; the second block is the support vector machine (SVM) algorithm for classifying deep feature maps. The fourth proposed system uses ANN and FFNN based on the hybrid features between CNN models (GoogLeNet and AlexNet) and LBP, GLCM and FCH algorithms. All the proposed systems achieved superior results in diagnosing endoscopic images for the early detection of lower gastrointestinal diseases. All systems produced promising results; the FFNN classifier based on the hybrid features extracted by GoogLeNet, LBP, GLCM and FCH achieved an accuracy of 99.3%, precision of 99.2%, sensitivity of 99%, specificity of 100%, and AUC of 99.87%.
Collapse
Affiliation(s)
- Suliman Mohamed Fati
- College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia;
| | - Ebrahim Mohammed Senan
- Department of Computer Science & Information Technology, Dr. Babasaheb Ambedkar Marathwada University, Aurangabad 431004, India;
| | - Ahmad Taher Azar
- College of Computer and Information Sciences, Prince Sultan University, Riyadh 11586, Saudi Arabia;
- Faculty of Computers and Artificial Intelligence, Benha University, Benha 13518, Egypt
| |
Collapse
|
44
|
Bellini V, Valente M, Turetti M, Del Rio P, Saturno F, Maffezzoni M, Bignami E. Current Applications of Artificial Intelligence in Bariatric Surgery. Obes Surg 2022; 32:2717-2733. [PMID: 35616768 PMCID: PMC9273529 DOI: 10.1007/s11695-022-06100-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2021] [Revised: 05/02/2022] [Accepted: 05/04/2022] [Indexed: 11/27/2022]
Abstract
The application of artificial intelligence technologies is growing in several fields of healthcare settings. The aim of this article is to review the current applications of artificial intelligence in bariatric surgery. We performed a review of the literature on Scopus, PubMed and Cochrane databases, screening all relevant studies published until September 2021, and finally including 36 articles. The use of machine learning algorithms in bariatric surgery is explored in all steps of the clinical pathway, from presurgical risk-assessment and intraoperative management to complications and outcomes prediction. The models showed remarkable results helping physicians in the decision-making process, thus improving the quality of care, and contributing to precision medicine. Several legal and ethical hurdles should be overcome before these methods can be used in common practice.
Collapse
Affiliation(s)
- Valentina Bellini
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| | - Marina Valente
- General Surgery Unit, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| | - Melania Turetti
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| | - Paolo Del Rio
- General Surgery Unit, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| | - Francesco Saturno
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| | - Massimo Maffezzoni
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| | - Elena Bignami
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126, Parma, Italy
| |
Collapse
|
45
|
van Kooten RT, Bahadoer RR, Ter Buurkes de Vries B, Wouters MWJM, Tollenaar RAEM, Hartgrink HH, Putter H, Dikken JL. Conventional regression analysis and machine learning in prediction of anastomotic leakage and pulmonary complications after esophagogastric cancer surgery. J Surg Oncol 2022; 126:490-501. [PMID: 35503455 PMCID: PMC9544929 DOI: 10.1002/jso.26910] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 04/11/2022] [Accepted: 04/21/2022] [Indexed: 12/24/2022]
Abstract
Background and Objectives With the current advanced data‐driven approach to health care, machine learning is gaining more interest. The current study investigates the added value of machine learning to linear regression in predicting anastomotic leakage and pulmonary complications after upper gastrointestinal cancer surgery. Methods All patients in the Dutch Upper Gastrointestinal Cancer Audit undergoing curatively intended esophageal or gastric cancer surgeries from 2011 to 2017 were included. Anastomotic leakage was defined as any clinically or radiologically proven anastomotic leakage. Pulmonary complications entailed: pneumonia, pleural effusion, respiratory failure, pneumothorax, and/or acute respiratory distress syndrome. Different machine learning models were tested. Nomograms were constructed using Least Absolute Shrinkage and Selection Operator. Results Between 2011 and 2017, 4228 patients underwent surgical resection for esophageal cancer, of which 18% developed anastomotic leakage and 30% a pulmonary complication. Of the 2199 patients with surgical resection for gastric cancer, 7% developed anastomotic leakage and 15% a pulmonary complication. In all cases, linear regression had the highest predictive value with the area under the curves varying between 61.9 and 68.0, but the difference with machine learning models did not reach statistical significance. Conclusion Machine learning models can predict postoperative complications in upper gastrointestinal cancer surgery, but they do not outperform the current gold standard, linear regression
Collapse
Affiliation(s)
- Robert T van Kooten
- Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands
| | - Renu R Bahadoer
- Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands
| | | | - Michel W J M Wouters
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands.,Department of Surgery, Netherlands Cancer Institute-Antoni van Leeuwenhoek, Amsterdam, The Netherlands
| | - Rob A E M Tollenaar
- Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands
| | - Henk H Hartgrink
- Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands
| | - Hein Putter
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
| | - Johan L Dikken
- Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
46
|
Mora D, Nieto JA, Mateo J, Bikdeli B, Barco S, Trujillo-Santos J, Soler S, Font L, Bosevski M, Monreal M. Machine Learning to Predict Outcomes in Patients with Acute Pulmonary Embolism Who Prematurely Discontinued Anticoagulant Therapy. Thromb Haemost 2022; 122:570-577. [PMID: 34107539 DOI: 10.1055/a-1525-7220] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
BACKGROUND Patients with pulmonary embolism (PE) who prematurely discontinue anticoagulant therapy (<90 days) are at an increased risk for death or recurrences. METHODS We used the data from the RIETE (Registro Informatizado de Pacientes con Enfermedad TromboEmbólica) registry to compare the prognostic ability of five machine-learning (ML) models and logistic regression to identify patients at increased risk for the composite of fatal PE or recurrent venous thromboembolism (VTE) 30 days after discontinuation. ML models included decision tree, k-nearest neighbors algorithm, support vector machine, Ensemble, and neural network [NN]. A "full" model with 70 variables and a "reduced" model with 23 were analyzed. Model performance was assessed by confusion matrix metrics on the testing data for each model and a calibration plot. RESULTS Among 34,447 patients with PE, 1,348 (3.9%) discontinued therapy prematurely. Fifty-one (3.8%) developed fatal PE or sudden death and 24 (1.8%) had nonfatal VTE recurrences within 30 days after discontinuation. ML-NN was the best method for identification of patients experiencing the composite endpoint, predicting the composite outcome with an area under receiver operating characteristic (ROC) curve of 0.96 (95% confidence interval [CI]: 0.95-0.98), using either 70 or 23 variables captured before discontinuation. Similar numbers were obtained for sensitivity, specificity, positive predictive value, negative predictive value, and accuracy. The discrimination of logistic regression was inferior (area under ROC curve, 0.76 [95% CI: 0.70-0.81]). Calibration plots showed similar deviations from the perfect line for ML-NN and logistic regression. CONCLUSION The ML-NN method very well predicted the composite outcome after premature discontinuation of anticoagulation and outperformed traditional logistic regression.
Collapse
Affiliation(s)
- Damián Mora
- Department of Internal Medicine, Hospital Virgen de la Luz, Cuenca, Spain
| | - José A Nieto
- Department of Internal Medicine, Hospital Virgen de la Luz, Cuenca, Spain
| | - Jorge Mateo
- Neurobiological Research Group, Institute of Technology, Universidad de Castilla-La Mancha, Cuenca, Spain
| | - Behnood Bikdeli
- Cardiovascular Medicine Division, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States.,Yale/YNHH Center for Outcomes Research and Evaluation, New Haven, Connecticut, United States.,Cardiovascular Research Foundation (CRF), New York, New York, United States
| | - Stefano Barco
- Clinic of Angiology, University Hospital Zurich, Zurich, Switzerland.,Center for Thrombosis and Hemostasis, University Hospital Mainz, Mainz, Germany
| | - Javier Trujillo-Santos
- Department of Internal Medicine, Hospital General Universitario Santa Lucía, Universidad Católica de Murcia, Murcia, Spain
| | - Silvia Soler
- Department of Internal Medicine, Hospital Olot i Comarcal de la Garrotxa, Gerona, Spain
| | - Llorenç Font
- Department of Haematology, Hospital de Tortosa Verge de la Cinta, Tarragona, Spain
| | - Marijan Bosevski
- Faculty of Medicine, University Cardiology Clinic, Skopje, Republic of Macedonia
| | - Manuel Monreal
- Department of Internal Medicine, Hospital Germans Trias i Pujol, Badalona, Barcelona, Spain.,Department of Medicine, Universidad Católica de Murcia, Murcia, Spain
| | | |
Collapse
|
47
|
Jin S, Qin D, Liang BS, Zhang LC, Wei XX, Wang YJ, Zhuang B, Zhang T, Yang ZP, Cao YW, Jin SL, Yang P, Jiang B, Rao BQ, Shi HP, Lu Q. Machine learning predicts cancer-associated deep vein thrombosis using clinically available variables. Int J Med Inform 2022; 161:104733. [DOI: 10.1016/j.ijmedinf.2022.104733] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Revised: 02/23/2022] [Accepted: 03/02/2022] [Indexed: 12/17/2022]
|
48
|
Bellini V, Valente M, Bertorelli G, Pifferi B, Craca M, Mordonini M, Lombardo G, Bottani E, Del Rio P, Bignami E. Machine learning in perioperative medicine: a systematic review. JOURNAL OF ANESTHESIA, ANALGESIA AND CRITICAL CARE 2022; 2:2. [PMCID: PMC8761048 DOI: 10.1186/s44158-022-00033-y] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/18/2023]
Abstract
Background Risk stratification plays a central role in anesthetic evaluation. The use of Big Data and machine learning (ML) offers considerable advantages for collection and evaluation of large amounts of complex health-care data. We conducted a systematic review to understand the role of ML in the development of predictive post-surgical outcome models and risk stratification. Methods Following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines, we selected the period of the research for studies from 1 January 2015 up to 30 March 2021. A systematic search in Scopus, CINAHL, the Cochrane Library, PubMed, and MeSH databases was performed; the strings of research included different combinations of keywords: “risk prediction,” “surgery,” “machine learning,” “intensive care unit (ICU),” and “anesthesia” “perioperative.” We identified 36 eligible studies. This study evaluates the quality of reporting of prediction models using the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) checklist. Results The most considered outcomes were mortality risk, systemic complications (pulmonary, cardiovascular, acute kidney injury (AKI), etc.), ICU admission, anesthesiologic risk and prolonged length of hospital stay. Not all the study completely followed the TRIPOD checklist, but the quality was overall acceptable with 75% of studies (Rev #2, comm #minor issue) showing an adherence rate to TRIPOD more than 60%. The most frequently used algorithms were gradient boosting (n = 13), random forest (n = 10), logistic regression (LR; n = 7), artificial neural networks (ANNs; n = 6), and support vector machines (SVM; n = 6). Models with best performance were random forest and gradient boosting, with AUC > 0.90. Conclusions The application of ML in medicine appears to have a great potential. From our analysis, depending on the input features considered and on the specific prediction task, ML algorithms seem effective in outcomes prediction more accurately than validated prognostic scores and traditional statistics. Thus, our review encourages the healthcare domain and artificial intelligence (AI) developers to adopt an interdisciplinary and systemic approach to evaluate the overall impact of AI on perioperative risk assessment and on further health care settings as well.
Collapse
Affiliation(s)
- Valentina Bellini
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| | - Marina Valente
- General Surgery Unit, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| | - Giorgia Bertorelli
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| | - Barbara Pifferi
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| | - Michelangelo Craca
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| | - Monica Mordonini
- Department of Engineering and Architecture, University of Parma, Viale G.P.Usberti 181/A, 43124 Parma, Italy
| | - Gianfranco Lombardo
- Department of Engineering and Architecture, University of Parma, Viale G.P.Usberti 181/A, 43124 Parma, Italy
| | - Eleonora Bottani
- Department of Engineering and Architecture, University of Parma, Viale G.P.Usberti 181/A, 43124 Parma, Italy
| | - Paolo Del Rio
- General Surgery Unit, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| | - Elena Bignami
- Anesthesiology, Critical Care and Pain Medicine Division, Department of Medicine and Surgery, University of Parma, Viale Gramsci 14, 43126 Parma, Italy
| |
Collapse
|
49
|
The prediction of surgical complications using artificial intelligence in patients undergoing major abdominal surgery: A systematic review. Surgery 2021; 171:1014-1021. [PMID: 34801265 DOI: 10.1016/j.surg.2021.10.002] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Revised: 09/23/2021] [Accepted: 10/01/2021] [Indexed: 02/08/2023]
Abstract
BACKGROUND Conventional statistics are based on a simple cause-and-effect principle. Postoperative complications, however, have a multifactorial and interrelated etiology. The application of artificial intelligence might be more accurate to predict postoperative outcomes. The objective of this study was to determine the current quality of studies describing the use of artificial intelligence in predicting complications in patients undergoing major abdominal surgery. METHODS A literature search was performed in PubMed, Embase, and Web of Science. Inclusion criteria were (1) empirical studies including patients undergoing (2) any type of gastrointestinal surgery, including hepatopancreaticobiliary surgery, whose (3) complications or mortality were predicted with the use of (4) any artificial intelligence system. Studies were screened for description of method of validation and testing in methodology. Outcome measurements were sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve. RESULTS From a total of 1,537 identified articles, 15 were included for the review. Among a large variety of algorithms used by the included studies, sensitivity was between 0.06 and 0.96, specificity was between 0.61 and 0.98, accuracy was between 0.78 and 0.95, and area under the receiver operating characteristic curve varied between 0.50 and 0.96. CONCLUSION Artificial intelligence algorithms have the ability to accurately predict postoperative complications. Nevertheless, algorithms should be properly tested and validated, both internally and externally. Furthermore, a complete database and the absence of unsampled imbalanced data are absolute prerequisites for algorithms to predict accurately.
Collapse
|
50
|
Pantelis AG, Stravodimos GK, Lapatsanis DP. A Scoping Review of Artificial Intelligence and Machine Learning in Bariatric and Metabolic Surgery: Current Status and Future Perspectives. Obes Surg 2021; 31:4555-4563. [PMID: 34264433 DOI: 10.1007/s11695-021-05548-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Revised: 06/12/2021] [Accepted: 06/17/2021] [Indexed: 01/01/2023]
Abstract
Artificial intelligence (AI) is a revolution in data analysis with emerging roles in various specialties and with various applications. The objective of this scoping review was to retrieve current literature on the fields of AI that have been applied to metabolic bariatric surgery (MBS) and to investigate potential applications of AI as a decision-making tool of the bariatric surgeon. Initial search yielded 3260 studies published from January 2000 until March 2021. After screening, 49 unique articles were included in the final analysis. Studies were grouped into categories, and the frequency of appearing algorithms, dataset types, and metrics were documented. The heterogeneity of current studies showed that meticulous validation, strict reporting systems, and reliable benchmarking are mandatory for ensuring the clinical validity of future research.
Collapse
Affiliation(s)
- Athanasios G Pantelis
- 4th Department of Surgery, Bariatric and Metabolic Surgery Unit, Evaggelismos General Hospital of Athens, Ipsilantou 45-47, 10676, Athens, Greece.
| | - Georgios K Stravodimos
- 4th Department of Surgery, Bariatric and Metabolic Surgery Unit, Evaggelismos General Hospital of Athens, Ipsilantou 45-47, 10676, Athens, Greece
| | - Dimitris P Lapatsanis
- 4th Department of Surgery, Bariatric and Metabolic Surgery Unit, Evaggelismos General Hospital of Athens, Ipsilantou 45-47, 10676, Athens, Greece
| |
Collapse
|