1
|
Kirpalani A, Viel T, Hu Z, Lin HM, Hermans S, Gomez D, Moreland R, Mathur S, Jhaveri A, Wu M, Vlachou PA, Tafur M, Sejdić E, Colak E. External validation of an RSNA 2023 Abdominal Trauma AI Challenge high performing machine learning model in the detection and grading of splenic injuries on CT. Abdom Radiol (NY) 2025:10.1007/s00261-025-04910-2. [PMID: 40312490 DOI: 10.1007/s00261-025-04910-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Revised: 01/27/2025] [Accepted: 03/21/2025] [Indexed: 05/03/2025]
Abstract
PURPOSE This study aims to validate the performance of an award-winning machine learning (ML) model from the Radiological Society of North America (RSNA) 2023 Abdominal Trauma AI Challenge in detecting splenic injuries on CT scans using a large, geographically and temporally distinct external dataset. METHOD A single-center retrospective study was conducted using an external dataset comprising 1216 CT scans (608 positive and 608 negative for splenic injuries). The ML model, trained on the RSNA Abdominal Traumatic Injury CT (RATIC) dataset, employs a multi-component pipeline including 2D MaxVit, 2.5D CoatNet with LSTM for study-level predictions. Model performance was evaluated using sensitivity, specificity, PPV, NPV, accuracy, F1 score, and AUC. RESULTS The ML model achieved an AUC of 0.931 (95% CI: 0.917, 0.945) for binary classification of splenic injuries, with an accuracy of 0.849 (95% CI: 0.827, 0.868), sensitivity of 0.747 (95% CI: 0.711, 0.780), and specificity of 0.951 (95% CI: 0.930, 0.965). For high-grade splenic injuries, the model achieved an AUC of 0.950 (95% CI: 0.932, 0.968), accuracy of 0.928 (95% CI: 0.912, 0.941), sensitivity of 0.719 (95% CI: 0.643, 0.784), and specificity of 0.958 (95% CI: 0.944, 0.968). CONCLUSION The ML model shows strong, reliable performance and generalizability in detecting and grading splenic injuries on CT scans. This supports its potential clinical application, particularly for quick and accurate diagnosis in splenic trauma patients, and highlights the value of RSNA AI challenges in advancing clinical research and applications in medical imaging.
Collapse
Affiliation(s)
- Anish Kirpalani
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
- Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, Canada
| | | | - Zixuan Hu
- The Edward S. Rogers Department of Electrical and Computer Engineering, University of Toronto, Toronto, Canada
| | - Hui Ming Lin
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
| | - Sebastiaan Hermans
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
| | - David Gomez
- Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, Canada
- Division of General Surgery, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Surgery, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
- Institute for Medical Science, University of Toronto, Toronto, Canada
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
| | - Robert Moreland
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Shobhit Mathur
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
- Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, Canada
| | - Aaditeya Jhaveri
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Matthew Wu
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Paraskevi A Vlachou
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Monica Tafur
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Ervin Sejdić
- The Edward S. Rogers Department of Electrical and Computer Engineering, University of Toronto, Toronto, Canada
- North York General Hospital, Toronto, Canada
| | - Errol Colak
- Department of Medical Imaging, St. Michael's Hospital, Unity Health Toronto, Toronto, Canada.
- Department of Medical Imaging, Temetry Faculty of Medicine, University of Toronto, Toronto, Canada.
- Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, Canada.
| |
Collapse
|
2
|
Houston R, Mahato B, Odell T, Khan YR, Mahato D. The Financial and Radiation Burden of Early Reimaging in Neurosurgical Patients: An Original Study and Review of the Literature. Cureus 2021; 13:e17383. [PMID: 34584793 PMCID: PMC8457306 DOI: 10.7759/cureus.17383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2021] [Accepted: 08/23/2021] [Indexed: 11/05/2022] Open
Abstract
The computed tomographic (CT) scanner has become ubiquitous in healthcare. When trauma patients are imaged at facilities not equipped to care for them, imaging is often repeated at the receiving institution. CTs have clinical, financial, and resource costs, and eliminating unnecessary imaging will benefit patients, providers, and institutions. This paper reviews patterns of repetition of CT scans for transferred trauma patients and motivations underlying such behaviors via analysis of our Trauma Registry database and literature published in this area. Neurosurgeons are fundamentally impactful in this decision-making process. The most commonly repeated scan is a CT head (CTH). More than ¼ of our patients receiving a clinically indicated repeat CTH also had a repeat scan of their cervical spine with no reason given for the cervical scan. Herein, we discuss our findings that both non-trauma center practitioners and non-neurosurgical staff at trauma centers cite a lower level of comfort with neuroradiology and fear of litigation as motivators in overzealous neuroimaging. As a result, inappropriate neurosurgical imaging is routinely ordered prior to transfer and again upon arrival at trauma centers. Education of non-neurosurgical staff is essential to prevent inappropriate neuroaxis imaging.
Collapse
Affiliation(s)
- Rebecca Houston
- Neurosurgery, Desert Regional Medical Center, Palm Springs, USA
| | - Bandana Mahato
- Neurosurgery, Desert Regional Medical Center, Palm Springs, USA
| | - Tiffany Odell
- Neurosurgery, Desert Regional Medical Center, Palm Springs, USA
| | - Yasir R Khan
- Neurosurgery, Desert Regional Medical Center, Palm Springs, USA
| | | |
Collapse
|