1
|
Axford D, Sohel F, Abedi V, Zhu Y, Zand R, Barkoudah E, Krupica T, Iheasirim K, Sharma UM, Dugani SB, Takahashi PY, Bhagra S, Murad MH, Saposnik G, Yousufuddin M. Development and internal validation of machine learning-based models and external validation of existing risk scores for outcome prediction in patients with ischaemic stroke. Eur Heart J Digit Health 2024; 5:109-122. [PMID: 38505491 PMCID: PMC10944684 DOI: 10.1093/ehjdh/ztad073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 10/14/2023] [Accepted: 10/30/2023] [Indexed: 03/21/2024]
Abstract
Aims We developed new machine learning (ML) models and externally validated existing statistical models [ischaemic stroke predictive risk score (iScore) and totalled health risks in vascular events (THRIVE) scores] for predicting the composite of recurrent stroke or all-cause mortality at 90 days and at 3 years after hospitalization for first acute ischaemic stroke (AIS). Methods and results In adults hospitalized with AIS from January 2005 to November 2016, with follow-up until November 2019, we developed three ML models [random forest (RF), support vector machine (SVM), and extreme gradient boosting (XGBOOST)] and externally validated the iScore and THRIVE scores for predicting the composite outcomes after AIS hospitalization, using data from 721 patients and 90 potential predictor variables. At 90 days and 3 years, 11 and 34% of patients, respectively, reached the composite outcome. For the 90-day prediction, the area under the receiver operating characteristic curve (AUC) was 0.779 for RF, 0.771 for SVM, 0.772 for XGBOOST, 0.720 for iScore, and 0.664 for THRIVE. For 3-year prediction, the AUC was 0.743 for RF, 0.777 for SVM, 0.773 for XGBOOST, 0.710 for iScore, and 0.675 for THRIVE. Conclusion The study provided three ML-based predictive models that achieved good discrimination and clinical usefulness in outcome prediction after AIS and broadened the application of the iScore and THRIVE scoring system for long-term outcome prediction. Our findings warrant comparative analyses of ML and existing statistical method-based risk prediction tools for outcome prediction after AIS in new data sets.
Collapse
Affiliation(s)
- Daniel Axford
- Department of Information Technology, Mathematics and Statistics, College of Science, Health, Engineering and Education, Murdoch University, Murdoch, Australia
| | - Ferdous Sohel
- Department of Information Technology, Mathematics and Statistics, College of Science, Health, Engineering and Education, Murdoch University, Murdoch, Australia
| | - Vida Abedi
- Department of Public Health Science, Penn State College of Medicine, Hershey, PA, USA
| | - Ye Zhu
- Robert D. and Patricia E. Kern Centre for the Science of Healthcare Delivery, Mayo Clinic, Rochester, MN, USA
| | - Ramin Zand
- Neuroscience Institute, Geisinger Health System, 100 North Academy Ave, Danville, PA 17822, USA
- Neuroscience Institute, The Pennsylvania State University, Hershey, PA 17033, USA
| | - Ebrahim Barkoudah
- Internal Medicine/Hospital Medicine, Brigham and Women’s Hospital, Harvard University, Boston, MA, USA
| | - Troy Krupica
- Internal Medicine/Hospital Medicine, West Virginial University, Morgantown, WV, USA
| | - Kingsley Iheasirim
- Internal Medicine/Hospital Internal Medicine, Mayo Clinic Health System, Mankato, MN, USA
| | - Umesh M Sharma
- Hospital Internal Medicine, Mayo Clinic, Phoenix, AZ, USA
| | - Sagar B Dugani
- Hospital Internal Medicine, Mayo Clinic, Rochester, MN, USA
| | | | - Sumit Bhagra
- Endocrinology, Diabetes and Metabolism, Mayo Clinic Health System, Austin, MN, USA
| | - Mohammad H Murad
- Division of Public Health, Infectious Diseases, and Occupational Medicine, Mayo Clinic, Rochester, MN, USA
| | - Gustavo Saposnik
- Stroke Outcomes and Decision Neuroscience Research Unit, Division of Neurology, Department of Medicine and Li Ka Shing Knowledge Institute, St.Michael’s Hospital, University of Toronto, Toronto, Ontario, Canada
| | - Mohammed Yousufuddin
- Hospital Internal Medicine, Mayo Clinic Health System, 1000 1st Drive NW, Austin, MN 55912, USA
| |
Collapse
|