1
|
Mastrokostas PG, Mastrokostas LE, Razi A, Houten JK, Bou Monsef J, Razi AE, Ng MK. Prediction of Primary Admission Total Charges Following Single-Level Lumbar Arthrodesis Utilizing Machine Learning. Global Spine J 2025:21925682251336714. [PMID: 40243119 PMCID: PMC12006119 DOI: 10.1177/21925682251336714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/18/2025] Open
Abstract
Study DesignRetrospective analysis utilizing machine learning.ObjectivesThis study aims to identify the key factors influencing total charges during the primary admission period following single-level lumbar arthrodesis, using machine learning models to enhance predictive accuracy.MethodsData were extracted from the National Inpatient Sample (NIS) database and analyzed using various machine learning models, including random forest, gradient boosting trees, and logistic regression. A total of 78,022 unweighted cases of patients who underwent single-level lumbar arthrodesis were identified using the NIS database from 2016 to 2020. Variables included hospital size, region, patient-specific factors, and procedural details. Multivariate linear regression was also used to identify charge-related variables.ResultsThe average total charge for single-level lumbar arthrodesis was $145,600 ± $102,500. Significant predictors of charge included length of stay, hospital size, hospital ownership, and region. Private investor-owned hospitals and procedures performed in the Western U.S. were associated with higher charges. Random forest models demonstrated superior predictive accuracy with an AUC of .866, outperforming other models.ConclusionsHospital characteristics, regional factors, and patient-specific variables significantly influence the charges of single-level lumbar arthrodesis. Machine learning models, particularly random forest, provide robust tools for predicting healthcare costs, enabling better resource allocation and decision-making. Future research should explore these dynamics further to optimize cost management and improve care quality.
Collapse
Affiliation(s)
- Paul G. Mastrokostas
- Department of Orthopaedic Surgery, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Leonidas E. Mastrokostas
- Department of Orthopaedic Surgery, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Abigail Razi
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - John K. Houten
- Department of Neurosurgery, Mount Sinai School of Medicine, New York, NY, USA
| | - Jad Bou Monsef
- Department of Orthopaedic Surgery, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Afshin E. Razi
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| | - Mitchell K. Ng
- Department of Orthopaedic Surgery, Maimonides Medical Center, Brooklyn, NY, USA
| |
Collapse
|
2
|
Yahanda AT, Joseph K, Bui T, Greenberg JK, Ray WZ, Ogunlade JI, Hafez D, Pallotta NA, Neuman BJ, Molina CA. Current Applications and Future Implications of Artificial Intelligence in Spine Surgery and Research: A Narrative Review and Commentary. Global Spine J 2025; 15:1445-1454. [PMID: 39359113 PMCID: PMC11559723 DOI: 10.1177/21925682241290752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/04/2024] Open
Abstract
STUDY DESIGN Narrative review. OBJECTIVES Artificial intelligence (AI) is being increasingly applied to the domain of spine surgery. We present a review of AI in spine surgery, including its use across all stages of the perioperative process and applications for research. We also provide commentary regarding future ethical considerations of AI use and how it may affect surgeon-industry relations. METHODS We conducted a comprehensive literature review of peer-reviewed articles that examined applications of AI during the pre-, intra-, or postoperative spine surgery process. We also discussed the relationship among AI, spine industry partners, and surgeons. RESULTS Preoperatively, AI has been mainly applied to image analysis, patient diagnosis and stratification, decision-making. Intraoperatively, AI has been used to aid image guidance and navigation. Postoperatively, AI has been used for outcomes prediction and analysis. AI can enable curation and analysis of huge datasets that can enhance research efforts. Large amounts of data are being accrued by industry sources for use by their AI platforms, though the inner workings of these datasets or algorithms are not well known. CONCLUSIONS AI has found numerous uses in the pre-, intra-, or postoperative spine surgery process, and the applications of AI continue to grow. The clinical applications and benefits of AI will continue to be more fully realized, but so will certain ethical considerations. Making industry-sponsored databases open source, or at least somehow available to the public, will help alleviate potential biases and obscurities between surgeons and industry and will benefit patient care.
Collapse
Affiliation(s)
- Alexander T. Yahanda
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Karan Joseph
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Tim Bui
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Jacob K. Greenberg
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Wilson Z. Ray
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - John I. Ogunlade
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Daniel Hafez
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Nicholas A. Pallotta
- Department of Orthopedic Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Brian J. Neuman
- Department of Orthopedic Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| | - Camilo A. Molina
- Department of Neurological Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA
| |
Collapse
|
3
|
Windermere SA, Shah S, Hey G, McGrath K, Rahman M. Applications of Artificial Intelligence in Neurosurgery for Improving Outcomes Through Diagnostics, Predictive Tools, and Resident Education. World Neurosurg 2025; 197:123809. [PMID: 40015674 DOI: 10.1016/j.wneu.2025.123809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2025] [Accepted: 02/11/2025] [Indexed: 03/01/2025]
Abstract
BACKGROUND Artificial intelligence (AI) has become an increasingly prominent tool in the field of neurosurgery, revolutionizing various aspects of patient care and surgical practices. AI-powered systems can provide real-time feedback to surgeons, enhancing precision and reducing the risk of complications during surgical procedures. The objective of this study is to review the role of AI in training neurosurgical residents, improving accuracy during surgery, and reducing complications. METHODS The literature search method involved searching PubMed using relevant keywords to identify English literature publications, including full texts, and concerning human subject matter from its inception until May 2024, initially generating 247,747 results. Articles were then screened for topic relevancy by abstract contents. Further articles were retrieved from the sources cited by the initially reviewed articles. A comprehensive review was then performed on various studies, including observational studies, case-control studies, cohort studies, clinical trials, meta-analyses, and reviews by 4 reviewers individually and then collectively. RESULTS Studies on AI in neurosurgery reach more than 4000 produced over a decade alone. The majority of studies regarding clinical diagnosis, risk prediction, and intraoperative guidance remain retrospective in nature. In its current form, AI-based paradigm performed inferiorly to neurosurgery residents in test taking. CONCLUSIONS AI has potential for broad applications in neurosurgery from use as a diagnostic, predictive, intraoperative, or educational tool. Further research is warranted for prospective use of AI-based technology for delivery of neurosurgical care.
Collapse
Affiliation(s)
| | - Siddharth Shah
- Department of Neurosurgery, RCSM Government Medical College, Kolhapur, Maharashtra, India
| | - Grace Hey
- University of Florida College of Medicine, Gainesville, Florida, USA
| | - Kyle McGrath
- University of Florida College of Medicine, Gainesville, Florida, USA
| | - Maryam Rahman
- Lillian S. Wells Department of Neurosurgery, University of Florida, Gainesville, Florida, USA
| |
Collapse
|
4
|
Ryvlin J, Seneviratne N, Bangash AH, Goodwin CR, Weber MH, Charest-Morin R, Shin JH, Versteeg AL, Fourman MS, Murthy SG, Gelfand Y, Yassari R, De la Garza Ramos R. The utilization of hypoalbuminemia as a prognostic metric in patients with spinal metastases: A scoping review. BRAIN & SPINE 2025; 5:104223. [PMID: 40103850 PMCID: PMC11914803 DOI: 10.1016/j.bas.2025.104223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Revised: 02/18/2025] [Accepted: 02/24/2025] [Indexed: 03/20/2025]
Abstract
Introduction Hypoalbuminemia is associated with poor outcomes in cancer patients, but its role in spinal metastases remains unclear. Research question This study aimed to identify albumin cutoff values defining hypoalbuminemia and describe the association between serum albumin and outcomes in patients with spinal metastases. Material and methods A narrative review of articles up to December 2022 was conducted using PubMed/Medline, EMBASE, and Web of Science databases. Variables extracted included study design, patient characteristics, serum albumin levels, treatments, and levels of evidence. Outcomes included survival/mortality, complications, ambulatory status, readmission, length of stay, discharge disposition, and blood loss. Results Thirty-eight studies comprising 21,401 patients were analyzed. Most studies (92%) were Level of Evidence III. Albumin was evaluated as a continuous variable in 18% of studies and as a dichotomous variable in 76%, with 3.5 g/dL being the most common threshold for hypoalbuminemia. Primary outcomes evaluated were survival/mortality (71% of studies), complications (34%), and reoperation/readmission (11%). Of studies examining the association between hypoalbuminemia and survival/mortality, 74% found a significant association. An association between albumin levels and complications was found in 54% of relevant studies. Discussion and conclusion The findings of this study suggest that a threshold of 3.5 g/dL seems most appropriate to define hypoalbuminemia in patients with spinal metastases. However, evidence also supports a level-dependent effect. The most consistent significant association was between low albumin and survival at both fixed and continuous time points. There is less evidence to support an association between hypoalbuminemia and other endpoints such as perioperative complications.
Collapse
Affiliation(s)
- Jessica Ryvlin
- Spine Tumor Mechanics and Outcomes Research (TUMOR) Lab, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Namal Seneviratne
- Department of Neurology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Ali Haider Bangash
- Spine Tumor Mechanics and Outcomes Research (TUMOR) Lab, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Neurosurgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - C Rory Goodwin
- Department of Neurosurgery, Duke University School of Medicine, Durham, NC, USA
| | - Michael H Weber
- Department of Orthopedic Surgery, University of Connecticut, Farmington, CT, USA
| | | | - John H Shin
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Anne L Versteeg
- Division of Surgery, Department of Orthopaedics, University of Toronto, Toronto, Canada
| | - Mitchell S Fourman
- Department of Orthopedic Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Saikiran G Murthy
- Spine Tumor Mechanics and Outcomes Research (TUMOR) Lab, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Neurosurgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Yaroslav Gelfand
- Spine Tumor Mechanics and Outcomes Research (TUMOR) Lab, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Neurosurgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Reza Yassari
- Spine Tumor Mechanics and Outcomes Research (TUMOR) Lab, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Neurosurgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Rafael De la Garza Ramos
- Spine Tumor Mechanics and Outcomes Research (TUMOR) Lab, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Neurosurgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, USA
| |
Collapse
|
5
|
Lai CY, Yen HK, Lin HC, Groot OQ, Lin WH, Hsu HP. Systematic review of 99 extremity bone malignancy survival prediction models. J Orthop Traumatol 2025; 26:5. [PMID: 39873938 PMCID: PMC11775353 DOI: 10.1186/s10195-025-00821-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/24/2024] [Accepted: 01/12/2025] [Indexed: 01/30/2025] Open
Abstract
BACKGROUND Various prediction models have been developed for extremity metastasis and sarcoma. This systematic review aims to evaluate extremity metastasis and sarcoma models using the utility prediction model (UPM) evaluation framework. METHODS We followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and systematically searched PubMed, Embase, and Cochrane to identify articles presenting original prediction models with 1-year survival outcome for extremity metastasis and 5-year survival outcome for sarcoma. Identified models were assessed using the UPM score (0-16), categorized as excellent (12-16), good (7-11), fair (3-6), or poor (0-2). A total of 5 extremity metastasis and 94 sarcoma models met inclusion criteria and were analyzed for design, validation, and performance. RESULTS We assessed 5 models for extremity metastasis and 94 models for sarcoma. Only 4 out of 99 (4%) models achieved excellence, 1 from extremity metastasis and 3 from sarcoma. The majority were rated good (62%; 61/99), followed by fair (31%, 31/99) and poor (3%, 3/99). CONCLUSIONS Most predictive models for extremity metastasis and sarcoma fall short of UPM excellence. Suboptimal study design, limited external validation, and the infrequent availability of web-based calculators are main drawbacks. LEVEL OF EVIDENCE This study is classified as Level 2a evidence according to the Oxford 2011 Levels of Evidence. Trial registration This study was registered in PROSEPRO (CRD42022373391, https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=373391 ).
Collapse
Affiliation(s)
- Cheng-Yo Lai
- Department of Orthopedic Surgery, National Taiwan University Hospital Hsinchu Branch, Hsinchu, Taiwan
| | - Hung-Kuan Yen
- Department of Orthopedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Hao-Chen Lin
- Department of Medical Education, National Taiwan University Hospital, Taipei, Taiwan
| | - Olivier Quinten Groot
- Department of Orthopaedics, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Wei-Hsin Lin
- Department of Orthopedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Hao-Ping Hsu
- Department of Medical Imaging, Chi Mei Medical Center, Tainan, Taiwan.
| |
Collapse
|
6
|
Wilson SB, Ward J, Munjal V, Lam CSA, Patel M, Zhang P, Xu DS, Chakravarthy VB. Machine Learning in Spine Oncology: A Narrative Review. Global Spine J 2025; 15:210-227. [PMID: 38860699 PMCID: PMC11571526 DOI: 10.1177/21925682241261342] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/12/2024] Open
Abstract
STUDY DESIGN Narrative Review. OBJECTIVE Machine learning (ML) is one of the latest advancements in artificial intelligence used in medicine and surgery with the potential to significantly impact the way physicians diagnose, prognose, and treat spine tumors. In the realm of spine oncology, ML is utilized to analyze and interpret medical imaging and classify tumors with incredible accuracy. The authors present a narrative review that specifically addresses the use of machine learning in spine oncology. METHODS This study was conducted in accordance with the Preferred Reporting Items of Systematic Reviews and Meta-Analysis (PRISMA) methodology. A systematic review of the literature in the PubMed, EMBASE, Web of Science, Scopus, and Cochrane Library databases since inception was performed to present all clinical studies with the search terms '[[Machine Learning] OR [Artificial Intelligence]] AND [[Spine Oncology] OR [Spine Cancer]]'. Data included studies that were extracted and included algorithms, training and test size, outcomes reported. Studies were separated based on the type of tumor investigated using the machine learning algorithms into primary, metastatic, both, and intradural. A minimum of 2 independent reviewers conducted the study appraisal, data abstraction, and quality assessments of the studies. RESULTS Forty-five studies met inclusion criteria out of 480 references screened from the initial search results. Studies were grouped by metastatic, primary, and intradural tumors. The majority of ML studies relevant to spine oncology focused on utilizing a mixture of clinical and imaging features to risk stratify mortality and frailty. Overall, these studies showed that ML is a helpful tool in tumor detection, differentiation, segmentation, predicting survival, predicting readmission rates of patients with either primary, metastatic, or intradural spine tumors. CONCLUSION Specialized neural networks and deep learning algorithms have shown to be highly effective at predicting malignant probability and aid in diagnosis. ML algorithms can predict the risk of tumor recurrence or progression based on imaging and clinical features. Additionally, ML can optimize treatment planning, such as predicting radiotherapy dose distribution to the tumor and surrounding normal tissue or in surgical resection planning. It has the potential to significantly enhance the accuracy and efficiency of health care delivery, leading to improved patient outcomes.
Collapse
Affiliation(s)
- Seth B. Wilson
- Department of Neurosurgery, The Ohio State University, Columbus, OH, USA
| | - Jacob Ward
- Department of Neurosurgery, The Ohio State University, Columbus, OH, USA
| | - Vikas Munjal
- Department of Neurosurgery, The Ohio State University, Columbus, OH, USA
| | | | - Mayur Patel
- Department of Neurosurgery, The Ohio State University, Columbus, OH, USA
| | - Ping Zhang
- Department of Computer Science and Engineering, The Ohio State University College of Engineering, Columbus, OH, USA
- Department of Biomedical Informatics, The Ohio State University College of Medicine, Columbus, OH, USA
| | - David S. Xu
- Department of Neurosurgery, The Ohio State University, Columbus, OH, USA
| | | |
Collapse
|
7
|
De la Garza Ramos R, Charest-Morin R, Goodwin CR, Zuckerman SL, Laufer I, Dea N, Sahgal A, Rhines LD, Gokaslan ZL, Bettegowda C, Versteeg AL, Chen H, Cordula N, Sciubba DM, O'Toole JE, Fehlings MG, Kumar N, Disch AC, Stephens B, Goldschlager T, Weber MH, Shin JH. Malnutrition in Spine Oncology: Where Are We and What Are We Measuring? Global Spine J 2025; 15:29S-46S. [PMID: 39815762 PMCID: PMC11988249 DOI: 10.1177/21925682231213799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/18/2025] Open
Abstract
STUDY DESIGN Scoping review. OBJECTIVE To identify which markers are used as surrogates for malnutrition in metastatic spine disease and which are the most studied outcomes associated with it. METHODS A scoping review was performed by searching the PubMed/Medline, EMBASE, and Web of Science databases up to July 2022. We searched for articles exploring markers of malnutrition in spine oncology patients including but not limited to albumin, body weight, weight loss, and nutrition indices. A narrative synthesis was performed. RESULTS A total of 61 articles reporting on 31,385 patients met inclusion criteria. There were 13 different surrogate markers of nutrition, with the most common being albumin in 67% of studies (n = 41), body weight/BMI in 34% (n = 21), and muscle mass in 28% (n = 17). The most common studied outcomes were survival in 82% (n = 50), complications in 28% (n = 17), and length of stay in 10% (n = 6) of studies. Quality of life and functional outcomes were assessed in 2% (n = 1) and 3% (n = 2) of studies, respectively. Out of 61 studies, 18% (n = 11) found no association between the examined markers and outcome. CONCLUSION Assessment of nutritional status in patients with spinal metastases is fundamental. However, there is lack of a comprehensive and consistent way of assessing malnutrition in oncologic spine patients and therefore inconsistency in its relationship with outcomes. A consensus agreement on the assessment and definition of malnutrition in spine tumor patients is needed.
Collapse
Affiliation(s)
- Rafael De la Garza Ramos
- Department of Neurological Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, New York, NY, USA
| | - Raphaële Charest-Morin
- Combined Neurosurgical and Orthopedic Spine Program, Department of Orthopedics Surgery, University of British Columbia, Vancouver, BC, Canada
| | - C Rory Goodwin
- Department of Neurosurgery, Spine Division, Duke University, Durham, NC, USA
| | - Scott L Zuckerman
- Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Ilya Laufer
- Department of Neurological Surgery, New York University Grossman School of Medicine, New York, NY, USA
| | - Nicolas Dea
- Combined Neurosurgical and Orthopedic Spine Program, Department of Orthopedics Surgery, University of British Columbia, Vancouver, BC, Canada
| | - Arjun Sahgal
- Department of Radiation Oncology, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Laurence D Rhines
- Department of Neurosurgery, Division of Surgery, The University of Texas MD Anderson Cancer Center, University of Texas, Houston, TX, USA
| | - Ziya L Gokaslan
- Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
| | - Chetan Bettegowda
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Anne L Versteeg
- Division of Surgery, Department of Orthopaedics, University of Toronto, Toronto, ON, Canada
| | - Hanbo Chen
- Department of Radiation Oncology, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Netzer Cordula
- Department of Spine Surgery, University Hospital of Basel, Basel, Switzerland
| | - Daniel M Sciubba
- Department of Neurosurgery, Zucker School of Medicine at Hofstra, Long Island Jewish Medical Center and North Shore University Hospital, Northwell Health, Manhasset, NY, New York, USA
| | - John E O'Toole
- Department of Neurological Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Michael G Fehlings
- Department of Surgery, Division of Neurosurgery and Spine Program, University Health Network, University of Toronto, Toronto, ON, Canada
| | - Naresh Kumar
- Department of Orthopaedic Surgery, National University Health System, Singapore, Singapore
| | - Alexander C Disch
- University Comprehensive Spine Center, University Center for Orthopedics, Traumatology and Plastic Surgery, University Hospital Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Byron Stephens
- Deparment of Orthopedic Surgery, Vanderbilt University Medical Center, Nashville, TN, United States
| | - Tony Goldschlager
- Department of Neurosurgery, Monash Health, Melbourne, VIC, Australia
| | - Michael H Weber
- Spine Surgery Program, Department of Surgery, Montreal General Hospital, McGill University Health Center, Montreal, QC, Canada
| | - John H Shin
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
8
|
Dichter A, Bhatt K, Liu M, Park T, Djalilian HR, Abouzari M. Post-Operative Outcome Predictions in Vestibular Schwannoma Using Machine Learning Algorithms. J Pers Med 2024; 14:1170. [PMID: 39728082 PMCID: PMC11678011 DOI: 10.3390/jpm14121170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2024] [Revised: 12/16/2024] [Accepted: 12/20/2024] [Indexed: 12/28/2024] Open
Abstract
Background/Objectives: This study aimed to develop a machine learning (ML) algorithm that can predict unplanned reoperations and surgical/medical complications after vestibular schwannoma (VS) surgery. Methods: All pre- and peri-operative variables available in the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) database (n = 110), except those directly related to our outcome variables, were used as input variables. A deep neural network model consisting of seven layers was developed using the Keras open-source library, with a 70:30 breakdown for training and testing. The feature importance of input variables was measured to elucidate their relative permutation effect in the ML model. Results: Of the 1783 patients with VS undergoing surgery, unplanned reoperation, surgical complications, and medical complications were seen in 8.5%, 5.2%, and 6.2% of patients, respectively. The deep neural network model had area under the curve of receiver operating characteristics (ROC-AUC) of 0.6315 (reoperation), 0.7939 (medical complications), and 0.719 (surgical complications). Accuracy, specificity, and negative predictive values of the model for all outcome variables ranged from 82.1 to 96.6%, while positive predictive values and sensitivity ranged from 16.7 to 51.5%. Variables such as the length of stay post-operation until discharge, days from operation to discharge, and the total hospital length of stay had the highest permutation importance. Conclusions: We developed an effective ML algorithm predicting unplanned reoperation and surgical/medical complications post-VS surgery. This may offer physicians guidance into potential post-surgical outcomes to allow for personalized medical care plans for VS patients.
Collapse
Affiliation(s)
| | | | | | | | | | - Mehdi Abouzari
- Division of Neurotology and Skull Base Surgery, Department of Otolaryngology-Head and Neck Surgery, University of California, Irvine, CA 92697, USA
| |
Collapse
|
9
|
Han H, Li R, Fu D, Zhou H, Zhan Z, Wu Y, Meng B. Revolutionizing spinal interventions: a systematic review of artificial intelligence technology applications in contemporary surgery. BMC Surg 2024; 24:345. [PMID: 39501233 PMCID: PMC11536876 DOI: 10.1186/s12893-024-02646-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 10/28/2024] [Indexed: 11/09/2024] Open
Abstract
Leveraging its ability to handle large and complex datasets, artificial intelligence can uncover subtle patterns and correlations that human observation may overlook. This is particularly valuable for understanding the intricate dynamics of spinal surgery and its multifaceted impacts on patient prognosis. This review aims to delineate the role of artificial intelligence in spinal surgery. A search of the PubMed database from 1992 to 2023 was conducted using relevant English publications related to the application of artificial intelligence in spinal surgery. The search strategy involved a combination of the following keywords: "Artificial neural network," "deep learning," "artificial intelligence," "spinal," "musculoskeletal," "lumbar," "vertebra," "disc," "cervical," "cord," "stenosis," "procedure," "operation," "surgery," "preoperative," "postoperative," and "operative." A total of 1,182 articles were retrieved. After a careful evaluation of abstracts, 90 articles were found to meet the inclusion criteria for this review. Our review highlights various applications of artificial neural networks in spinal disease management, including (1) assessing surgical indications, (2) assisting in surgical procedures, (3) preoperatively predicting surgical outcomes, and (4) estimating the occurrence of various surgical complications and adverse events. By utilizing these technologies, surgical outcomes can be improved, ultimately enhancing the quality of life for patients.
Collapse
Affiliation(s)
- Hao Han
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Ran Li
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Dongming Fu
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Hongyou Zhou
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Zihao Zhan
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Yi'ang Wu
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Bin Meng
- Department of Orthopedics, The First Affiliated Hospital of Soochow University, Suzhou, China.
| |
Collapse
|
10
|
Shahzad H, Veliky C, Le H, Qureshi S, Phillips FM, Javidan Y, Khan SN. Preserving privacy in big data research: the role of federated learning in spine surgery. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2024; 33:4076-4081. [PMID: 38403832 DOI: 10.1007/s00586-024-08172-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 11/27/2023] [Accepted: 01/27/2024] [Indexed: 02/27/2024]
Abstract
PURPOSE Integrating machine learning models into electronic medical record systems can greatly enhance decision-making, patient outcomes, and value-based care in healthcare systems. Challenges related to data accessibility, privacy, and sharing can impede the development and deployment of effective predictive models in spine surgery. Federated learning (FL) offers a decentralized approach to machine learning that allows local model training while preserving data privacy, making it well-suited for healthcare settings. Our objective was to describe federated learning solutions for enhanced predictive modeling in spine surgery. METHODS The authors reviewed the literature. RESULTS FL has promising applications in spine surgery, including telesurgery, AI-based prediction models, and medical image segmentation. Implementing FL requires careful consideration of infrastructure, data quality, and standardization, but it holds the potential to revolutionize orthopedic surgery while ensuring patient privacy and data control. CONCLUSIONS Federated learning shows great promise in revolutionizing predictive modeling in spine surgery by addressing the challenges of data privacy, accessibility, and sharing. The applications of FL in telesurgery, AI-based predictive models, and medical image segmentation have demonstrated their potential to enhance patient outcomes and value-based care.
Collapse
Affiliation(s)
- Hania Shahzad
- Department of Orthopaedics, UC Davis Medical Center, Sacramento, CA, USA
| | - Cole Veliky
- Ohio State College of Medicine, The Ohio State University, Columbus, OH, USA
| | - Hai Le
- UC Davis Medical Center, Sacramento, CA, USA
| | | | | | | | - Safdar N Khan
- Department of Orthopaedics, UC Davis Medical Center, Sacramento, CA, USA.
| |
Collapse
|
11
|
Li Z, Yao W, Wang J, Wang X, Luo S, Zhang P. Impact of perioperative hemoglobin-related parameters on clinical outcomes in patients with spinal metastases: identifying key markers for blood management. BMC Musculoskelet Disord 2024; 25:632. [PMID: 39118064 PMCID: PMC11311924 DOI: 10.1186/s12891-024-07748-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Accepted: 07/30/2024] [Indexed: 08/10/2024] Open
Abstract
PURPOSE Patients with spinal metastases undergoing surgical treatment face challenges related to preoperative anemia, intraoperative blood loss, and frailty, emphasizing the significance of perioperative blood management. This retrospective analysis aimed to assess the correlation between hemoglobin-related parameters and outcomes, identifying key markers to aid in blood management. METHODS A retrospective review was performed to identify patients who underwent surgical treatment for spinal metastases. Hb-related parameters, including baseline Hb, postoperative nadir Hb, predischarge Hb, postoperative nadir Hb drift, and predischarge Hb drift (both in absolute values and percentages) were subjected to univariate and multivariate analyses. These analyses were conducted in conjunction with other established variables to identify independent markers predicting patient outcomes. The outcomes of interest were postoperative short-term (6-week) mortality, long-term (1-year) mortality, and postoperative 30-day morbidity. RESULTS A total of 289 patients were included. Our study demonstrated that predischarge Hb (OR 0.62, 95% CI 0.44-0.88, P = 0.007) was an independent prognostic factor of short-term mortality, while baseline Hb (OR 0.76, 95% CI 0.66-0.88, P < 0.001) was identified as an independent prognostic factor of long-term mortality. Additionally, nadir Hb drift (OR 0.82, 95% CI 0.70-0.97, P = 0.023) was found to be an independent prognostic factor for postoperative 30-day morbidity. CONCLUSIONS This study demonstrated that predischarge Hb, baseline Hb, and nadir Hb drift are prognostic factors for outcomes. These findings provide a foundation for precise blood management strategies. It is crucial to consider Hb-related parameters appropriately, and prospective intervention studies addressing these markers should be conducted in the future.
Collapse
Affiliation(s)
- Zhehuang Li
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China.
| | - Weitao Yao
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Jiaqiang Wang
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Xin Wang
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Suxia Luo
- Department of Medical Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Peng Zhang
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| |
Collapse
|
12
|
Houston R, Desai S, Takayanagi A, Quynh Thu Tran C, Mortezaei A, Oladaskari A, Sourani A, Siddiqi I, Khodayari B, Ho A, Hariri O. A Multidisciplinary Update on Treatment Modalities for Metastatic Spinal Tumors with a Surgical Emphasis: A Literature Review and Evaluation of the Role of Artificial Intelligence. Cancers (Basel) 2024; 16:2800. [PMID: 39199573 PMCID: PMC11352440 DOI: 10.3390/cancers16162800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Revised: 07/16/2024] [Accepted: 07/29/2024] [Indexed: 09/01/2024] Open
Abstract
Spinal metastases occur in up to 40% of patients with cancer. Of these cases, 10% become symptomatic. The reported incidence of spinal metastases has increased in recent years due to innovations in imaging modalities and oncological treatments. As the incidence of spinal metastases rises, so does the demand for improved treatments and treatment algorithms, which now emphasize greater multidisciplinary collaboration and are increasingly customized per patient. Uniquely, we discuss the potential clinical applications of AI and NGS in the treatment of spinal metastases. Material and Methods: A PubMed search for articles published from 2000 to 2023 regarding spinal metastases and artificial intelligence in healthcare was completed. After screening for relevance, the key findings from each study were summarized in this update. Results: This review summarizes the evidence from studies reporting on treatment modalities for spinal metastases, including minimally invasive surgery (MIS), external beam radiation therapy (EBRT), stereotactic radiosurgery (SRS), CFR-PEEK instrumentation, radiofrequency ablation (RFA), next-generation sequencing (NGS), artificial intelligence, and predictive models.
Collapse
Affiliation(s)
- Rebecca Houston
- Department of Neurosurgery, Arrowhead Regional Medical Center, 400 N Pepper Ave, Colton, CA 92324, USA;
| | - Shivum Desai
- Department of Neurosurgery, Ascension Providence Hospital, 16001 W Nine Mile Rd, Southfield, MI 48075, USA;
| | - Ariel Takayanagi
- Department of Neurosurgery, Riverside University Health System, 26520 Cactus Ave, Moreno Valley, CA 92555, USA; (A.T.); (I.S.)
| | - Christina Quynh Thu Tran
- Kaiser Permanente Bernard J. Tyson School of Medicine, 98 S Los Robles Ave, Pasadena, CA 91101, USA;
| | - Ali Mortezaei
- Student Research Committee, Gonabad University of Medical Sciences, Gonabad 9P67+R29, Razavi Khorasan, Iran;
| | - Alireza Oladaskari
- School of Biological Sciences, University of California Irvine, 402 Physical Sciences Quad, Irvine, CA 92697, USA;
| | - Arman Sourani
- Department of Neurosurgery, Isfahan University of Medical Sciences, Hezar Jerib Avenue, Isfahan JM76+5M3, Isfahan, Iran;
- Environment Research Center, Research Institute for Primordial Prevention of Non-Communicable Disease, Isfahan University of Medical Sciences, Hezar Jerib Avenue, Isfahan JM76+5M3, Isfahan, Iran
| | - Imran Siddiqi
- Department of Neurosurgery, Riverside University Health System, 26520 Cactus Ave, Moreno Valley, CA 92555, USA; (A.T.); (I.S.)
| | - Behnood Khodayari
- Department of Radiation Oncology, Kaiser Permanente Los Angeles Medical Center, 4867 W Sunset Blvd, Los Angeles, CA 90027, USA;
| | - Allen Ho
- Department of Neurological Surgery, Kaiser Permanente Orange County, 3440 E La Palma Ave, Anaheim, CA 92806, USA;
| | - Omid Hariri
- Department of Neurosurgery, Arrowhead Regional Medical Center, 400 N Pepper Ave, Colton, CA 92324, USA;
- Kaiser Permanente Bernard J. Tyson School of Medicine, 98 S Los Robles Ave, Pasadena, CA 91101, USA;
- Department of Neurological Surgery, Kaiser Permanente Orange County, 3440 E La Palma Ave, Anaheim, CA 92806, USA;
- Department of Surgery, Western University of Health Sciences, 309 E 2nd St, Pomona, CA 91766, USA
- Department of Orthopedic Surgery, University of California Irvine School of Medicine, 1001 Health Sciences Rd, Irvine, CA 92617, USA
| |
Collapse
|
13
|
Ton A, Wishart D, Ball JR, Shah I, Murakami K, Ordon MP, Alluri RK, Hah R, Safaee MM. The Evolution of Risk Assessment in Spine Surgery: A Narrative Review. World Neurosurg 2024; 188:1-14. [PMID: 38677646 DOI: 10.1016/j.wneu.2024.04.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 04/17/2024] [Accepted: 04/18/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND Risk assessment is critically important in elective and high-risk interventions, particularly spine surgery. This narrative review describes the evolution of risk assessment from the earliest instruments focused on general surgical risk stratification, to more accurate and spine-specific risk calculators that quantified risk, to the current era of big data. METHODS The PubMed and SCOPUS databases were queried on October 11, 2023 using search terms to identify risk assessment tools (RATs) in spine surgery. A total of 108 manuscripts were included after screening with full-text review using the following inclusion criteria: 1) study population of adult spine surgical patients, 2) studies describing validation and subsequent performance of preoperative RATs, and 3) studies published in English. RESULTS Early RATs provided stratified patients into broad categories and allowed for improved communication between physicians. Subsequent risk calculators attempted to quantify risk by estimating general outcomes such as mortality, but then evolved to estimate spine-specific surgical complications. The integration of novel concepts such as invasiveness, frailty, genetic biomarkers, and sarcopenia led to the development of more sophisticated predictive models that estimate the risk of spine-specific complications and long-term outcomes. CONCLUSIONS RATs have undergone a transformative shift from generalized risk stratification to quantitative predictive models. The next generation of tools will likely involve integration of radiographic and genetic biomarkers, machine learning, and artificial intelligence to improve the accuracy of these models and better inform patients, surgeons, and payers.
Collapse
Affiliation(s)
- Andy Ton
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Danielle Wishart
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Jacob R Ball
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Ishan Shah
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Kiley Murakami
- Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Matthew P Ordon
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - R Kiran Alluri
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Raymond Hah
- Department of Orthopedic Surgery, Keck School of Medicine, University of Southern California, Los Angeles, California, USA
| | - Michael M Safaee
- Department of Neurological Surgery, Keck School of MedicineUniversity of Southern California, Los Angeles, California, USA.
| |
Collapse
|
14
|
De la Garza Ramos R, Ryvlin J, Bangash AH, Hamad MK, Fourman MS, Shin JH, Gelfand Y, Murthy S, Yassari R. Predictors of Clavien-Dindo Grade III-IV or Grade V Complications after Metastatic Spinal Tumor Surgery: An Analysis of Sociodemographic, Socioeconomic, Clinical, Oncologic, and Operative Parameters. Cancers (Basel) 2024; 16:2741. [PMID: 39123469 PMCID: PMC11311255 DOI: 10.3390/cancers16152741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2024] [Revised: 07/28/2024] [Accepted: 07/30/2024] [Indexed: 08/12/2024] Open
Abstract
The rate of major complications and 30-day mortality after surgery for metastatic spinal tumors is relatively high. While most studies have focused on baseline comorbid conditions and operative parameters as risk factors, there is limited data on the influence of other parameters such as sociodemographic or socioeconomic data on outcomes. We retrospectively analyzed data from 165 patients who underwent surgery for spinal metastases between 2012-2023. The primary outcome was development of major complications (i.e., Clavien-Dindo Grade III-IV complications), and the secondary outcome was 30-day mortality (i.e., Clavien-Dindo Grade V complications). An exploratory data analysis that included sociodemographic, socioeconomic, clinical, oncologic, and operative parameters was performed. Following multivariable analysis, independent predictors of Clavien-Dindo Grade III-IV complications were Frankel Grade A-C, lower modified Bauer score, and lower Prognostic Nutritional Index. Independent predictors of Clavien-Dindo Grade V complications) were lung primary cancer, lower modified Bauer score, lower Prognostic Nutritional Index, and use of internal fixation. No sociodemographic or socioeconomic factor was associated with either outcome. Sociodemographic and socioeconomic factors did not impact short-term surgical outcomes for metastatic spinal tumor patients in this study. Optimization of modifiable factors like nutritional status may be more important in improving outcomes in this complex patient population.
Collapse
Affiliation(s)
- Rafael De la Garza Ramos
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
- Department of Neurological Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| | - Jessica Ryvlin
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
| | - Ali Haider Bangash
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
| | - Mousa K. Hamad
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
- Department of Neurological Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| | - Mitchell S. Fourman
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
- Department of Orthopedic Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| | - John H. Shin
- Department of Neurological Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02115, USA;
| | - Yaroslav Gelfand
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
- Department of Neurological Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| | - Saikiran Murthy
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
- Department of Neurological Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| | - Reza Yassari
- Spine Research Group, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA; (J.R.); (A.H.B.); (M.K.H.); (M.S.F.); (Y.G.); (S.M.); (R.Y.)
- Department of Neurological Surgery, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY 10467, USA
| |
Collapse
|
15
|
De Barros A, Abel F, Kolisnyk S, Geraci GC, Hill F, Engrav M, Samavedi S, Suldina O, Kim J, Rusakov A, Lebl DR, Mourad R. Determining Prior Authorization Approval for Lumbar Stenosis Surgery With Machine Learning. Global Spine J 2024; 14:1753-1759. [PMID: 36752058 PMCID: PMC11268295 DOI: 10.1177/21925682231155844] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2023] Open
Abstract
STUDY DESIGN Medical vignettes. OBJECTIVES Lumbar spinal stenosis (LSS) is a degenerative condition with a high prevalence in the elderly population, that is associated with a significant economic burden and often requires spinal surgery. Prior authorization of surgical candidates is required before patients can be covered by a health plan and must be approved by medical directors (MDs), which is often subjective and clinician specific. In this study, we hypothesized that the prediction accuracy of machine learning (ML) methods regarding surgical candidates is comparable to that of a panel of MDs. METHODS Based on patient demographic factors, previous therapeutic history, symptoms and physical examinations and imaging findings, we propose an ML which computes the probability of spinal surgical recommendations for LSS. The model implements a random forest model trained from medical vignette data reviewed by MDs. Sets of 400 and 100 medical vignettes reviewed by MDs were used for training and testing. RESULTS The predictive accuracy of the machine learning model was with a root mean square error (RMSE) between model predictions and ground truth of .1123, while the average RMSE between individual MD's recommendations and ground truth was .2661. For binary classification, the AUROC and Cohen's kappa were .959 and .801, while the corresponding average metrics based on individual MD's recommendations were .844 and .564, respectively. CONCLUSIONS Our results suggest that ML can be used to automate prior authorization approval of surgery for LSS with performance comparable to a panel of MDs.
Collapse
Affiliation(s)
- Amaury De Barros
- Toulouse NeuroImaging Center (ToNIC), University of Toulouse Paul Sabatier-INSERM, Toulouse, France
- Neuroscience (Neurosurgery) Center, Toulouse University Hospital, Toulouse, France
| | | | | | | | | | | | | | | | | | | | | | - Raphael Mourad
- Remedy Logic, New York, NY, USA
- University of Toulouse, Toulouse, France
| |
Collapse
|
16
|
Kalanjiyam GP, Chandramohan T, Raman M, Kalyanasundaram H. Artificial intelligence: a new cutting-edge tool in spine surgery. Asian Spine J 2024; 18:458-471. [PMID: 38917854 PMCID: PMC11222879 DOI: 10.31616/asj.2023.0382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 01/07/2024] [Accepted: 01/11/2024] [Indexed: 06/27/2024] Open
Abstract
The purpose of this narrative review was to comprehensively elaborate the various components of artificial intelligence (AI), their applications in spine surgery, practical concerns, and future directions. Over the years, spine surgery has been continuously transformed in various aspects, including diagnostic strategies, surgical approaches, procedures, and instrumentation, to provide better-quality patient care. Surgeons have also augmented their surgical expertise with rapidly growing technological advancements. AI is an advancing field that has the potential to revolutionize many aspects of spine surgery. We performed a comprehensive narrative review of the various aspects of AI and machine learning in spine surgery. To elaborate on the current role of AI in spine surgery, a review of the literature was performed using PubMed and Google Scholar databases for articles published in English in the last 20 years. The initial search using the keywords "artificial intelligence" AND "spine," "machine learning" AND "spine," and "deep learning" AND "spine" extracted a total of 78, 60, and 37 articles and 11,500, 4,610, and 2,270 articles on PubMed and Google Scholar. After the initial screening and exclusion of unrelated articles, duplicates, and non-English articles, 405 articles were identified. After the second stage of screening, 93 articles were included in the review. Studies have shown that AI can be used to analyze patient data and provide personalized treatment recommendations in spine care. It also provides valuable insights for planning surgeries and assisting with precise surgical maneuvers and decisionmaking during the procedures. As more data become available and with further advancements, AI is likely to improve patient outcomes.
Collapse
Affiliation(s)
- Guna Pratheep Kalanjiyam
- Spine Surgery Unit, Department of Orthopaedics, Meenakshi Mission Hospital and Research Centre, Madurai,
India
| | - Thiyagarajan Chandramohan
- Department of Orthopaedics, Government Stanley Medical College, Chennai,
India
- Department of Emergency Medicine, Government Stanley Medical College, Chennai,
India
| | - Muthu Raman
- Department of Orthopaedics, Tenkasi Government Hospital, Tenkasi,
India
| | | |
Collapse
|
17
|
Shah AA, Schwab JH. Predictive Modeling for Spinal Metastatic Disease. Diagnostics (Basel) 2024; 14:962. [PMID: 38732376 PMCID: PMC11083521 DOI: 10.3390/diagnostics14090962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Revised: 04/27/2024] [Accepted: 04/29/2024] [Indexed: 05/13/2024] Open
Abstract
Spinal metastasis is exceedingly common in patients with cancer and its prevalence is expected to increase. Surgical management of symptomatic spinal metastasis is indicated for pain relief, preservation or restoration of neurologic function, and mechanical stability. The overall prognosis is a major driver of treatment decisions; however, clinicians' ability to accurately predict survival is limited. In this narrative review, we first discuss the NOMS decision framework used to guide decision making in the treatment of patients with spinal metastasis. Given that decision making hinges on prognosis, multiple scoring systems have been developed over the last three decades to predict survival in patients with spinal metastasis; these systems have largely been developed using expert opinions or regression modeling. Although these tools have provided significant advances in our ability to predict prognosis, their utility is limited by the relative lack of patient-specific survival probability. Machine learning models have been developed in recent years to close this gap. Employing a greater number of features compared to models developed with conventional statistics, machine learning algorithms have been reported to predict 30-day, 6-week, 90-day, and 1-year mortality in spinal metastatic disease with excellent discrimination. These models are well calibrated and have been externally validated with domestic and international independent cohorts. Despite hypothesized and realized limitations, the role of machine learning methodology in predicting outcomes in spinal metastatic disease is likely to grow.
Collapse
Affiliation(s)
- Akash A. Shah
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA 90095, USA
| | - Joseph H. Schwab
- Department of Orthopaedic Surgery, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA;
| |
Collapse
|
18
|
Cui Y, Shi X, Qin Y, Wang Q, Cao X, Che X, Pan Y, Wang B, Lei M, Liu Y. Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis. Int J Surg 2024; 110:2738-2756. [PMID: 38376838 PMCID: PMC11093492 DOI: 10.1097/js9.0000000000001169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Accepted: 01/28/2024] [Indexed: 02/21/2024]
Abstract
BACKGROUND Identification of patients with high-risk of experiencing inability to walk after surgery is important for surgeons to make therapeutic strategies for patients with metastatic spinal disease. However, there is a lack of clinical tool to assess postoperative ambulatory status for those patients. The emergence of artificial intelligence (AI) brings a promising opportunity to develop accurate prediction models. METHODS This study collected 455 patients with metastatic spinal disease who underwent posterior decompressive surgery at three tertiary medical institutions. Of these, 220 patients were collected from one medical institution to form the model derivation cohort, while 89 and 146 patients were collected from two other medical institutions to form the external validation cohorts 1 and 2, respectively. Patients in the model derivation cohort were used to develop and internally validate models. To establish the interactive AI platform, machine learning techniques were used to develop prediction models, including logistic regression (LR), decision tree (DT), random forest (RF), extreme gradient boosting machine (eXGBM), support vector machine (SVM), and neural network (NN). Furthermore, to enhance the resilience of the study's model, an ensemble machine learning approach was employed using a soft-voting method by combining the results of the above six algorithms. A scoring system incorporating 10 evaluation metrics was used to comprehensively assess the prediction performance of the developed models. The scoring system had a total score of 0 to 60, with higher scores denoting better prediction performance. An interactive AI platform was further deployed via Streamlit. The prediction performance was compared between medical experts and the AI platform in assessing the risk of experiencing postoperative inability to walk among patients with metastatic spinal disease. RESULTS Among all developed models, the ensemble model outperformed the six other models with the highest score of 57, followed by the eXGBM model (54), SVM model (50), and NN model (50). The ensemble model had the best performance in accuracy and calibration slope, and the second-best performance in precise, recall, specificity, area under the curve (AUC), Brier score, and log loss. The scores of the LR model, RF model, and DT model were 39, 46, and 26, respectively. External validation demonstrated that the ensemble model had an AUC value of 0.873 (95% CI: 0.809-0.936) in the external validation cohort 1 and 0.924 (95% CI: 0.890-0.959) in the external validation cohort 2. In the new ensemble machine learning model excluding the feature of the number of comorbidities, the AUC value was still as high as 0.916 (95% CI: 0.863-0.969). In addition, the AUC values of the new model were 0.880 (95% CI: 0.819-0.940) in the external validation cohort 1 and 0.922 (95% CI: 0.887-0.958) in the external validation cohort 2, indicating favorable generalization of the model. The interactive AI platform was further deployed online based on the final machine learning model, and it was available at https://postoperativeambulatory-izpdr6gsxxwhitr8fubutd.streamlit.app/ . By using the AI platform, researchers were able to obtain the individual predicted risk of postoperative inability to walk, gain insights into the key factors influencing the outcome, and find the stratified therapeutic recommendations. The AUC value obtained from the AI platform was significantly higher than the average AUC value achieved by the medical experts ( P <0.001), denoting that the AI platform obviously outperformed the individual medical experts. CONCLUSIONS The study successfully develops and validates an interactive AI platform for evaluating the risk of postoperative loss of ambulatory ability in patients with metastatic spinal disease. This AI platform has the potential to serve as a valuable model for guiding healthcare professionals in implementing surgical plans and ultimately enhancing patient outcomes.
Collapse
Affiliation(s)
- Yunpeng Cui
- Department of Orthopedic Surgery, Peking University First Hospital
| | - Xuedong Shi
- Department of Orthopedic Surgery, Peking University First Hospital
| | - Yong Qin
- Department of Joint and Sports Medicine Surgery, The Second Affiliated Hospital of Harbin Medical University, Harbin, People’s Republic of China
| | - Qiwei Wang
- Department of Orthopedic Surgery, Peking University First Hospital
| | - Xuyong Cao
- Department of Orthopedic Surgery, The Fifth Medical Center of PLA General Hospital
| | - Xiaotong Che
- Department of Evaluation Office, Hainan Cancer Hospital, Haikou
| | - Yuanxing Pan
- Department of Orthopedic Surgery, Peking University First Hospital
| | - Bing Wang
- Department of Orthopedic Surgery, Peking University First Hospital
| | - Mingxing Lei
- National Clinical Research Center for Orthopedics, Sports Medicine and Rehabilitation
- Department of Orthopedic Surgery, Chinese PLA General Hospital, Beijing
- Department of Orthopedic Surgery, Hainan Hospital of Chinese PLA General Hospital, Sanya
| | - Yaosheng Liu
- National Clinical Research Center for Orthopedics, Sports Medicine and Rehabilitation
- Senior Department of Orthopedics, The Fourth Medical Center of PLA General Hospital
| |
Collapse
|
19
|
Shah AA, Devana SK, Lee C, SooHoo NF. A predictive algorithm for perioperative complications and readmission after ankle arthrodesis. EUROPEAN JOURNAL OF ORTHOPAEDIC SURGERY & TRAUMATOLOGY : ORTHOPEDIE TRAUMATOLOGIE 2024; 34:1373-1379. [PMID: 38175277 DOI: 10.1007/s00590-023-03805-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Accepted: 12/02/2023] [Indexed: 01/05/2024]
Abstract
PURPOSE Ankle arthrodesis is a mainstay of surgical management for ankle arthritis. Accurately risk-stratifying patients who undergo ankle arthrodesis would be of great utility. There is a paucity of accurate prediction models that can be used to pre-operatively risk-stratify patients for ankle arthrodesis. We aim to develop a predictive model for major perioperative complication or readmission after ankle arthrodesis. METHODS This is a retrospective cohort study of adult patients who underwent ankle arthrodesis at any non-federal California hospital between 2015 and 2017. The primary outcome is readmission within 30 days or major perioperative complication. We build logistic regression and ML models spanning different classes of modeling approaches, assessing discrimination and calibration. We also rank the contribution of the included variables to model performance for prediction of adverse outcomes. RESULTS A total of 1084 patients met inclusion criteria for this study. There were 131 patients with major complication or readmission (12.1%). The XGBoost algorithm demonstrates the highest discrimination with an area under the receiver operating characteristic curve of 0.707 and is well-calibrated. The features most important for prediction of adverse outcomes for the XGBoost model include: diabetes, peripheral vascular disease, teaching hospital status, morbid obesity, history of musculoskeletal infection, history of hip fracture, renal failure, implant complication, history of major fracture. CONCLUSION We report a well-calibrated algorithm for prediction of major perioperative complications and 30-day readmission after ankle arthrodesis. This tool may help accurately risk-stratify patients and decrease likelihood of major complications.
Collapse
Affiliation(s)
- Akash A Shah
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, 76-116 CHS, Los Angeles, CA, 90095, USA.
| | - Sai K Devana
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, 76-116 CHS, Los Angeles, CA, 90095, USA
| | - Changhee Lee
- Department of Artificial Intelligence, Chung-Ang University School of Software and Computer Engineering, Seoul, South Korea
| | - Nelson F SooHoo
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, 76-116 CHS, Los Angeles, CA, 90095, USA
| |
Collapse
|
20
|
Lin PC, Chang WS, Hsiao KY, Liu HM, Shia BC, Chen MC, Hsieh PY, Lai TW, Lin FH, Chang CC. Development of a Machine Learning Algorithm to Correlate Lumbar Disc Height on X-rays with Disc Bulging or Herniation. Diagnostics (Basel) 2024; 14:134. [PMID: 38248010 PMCID: PMC10814412 DOI: 10.3390/diagnostics14020134] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Revised: 12/28/2023] [Accepted: 01/02/2024] [Indexed: 01/23/2024] Open
Abstract
Lumbar disc bulging or herniation (LDBH) is one of the major causes of spinal stenosis and related nerve compression, and its severity is the major determinant for spine surgery. MRI of the spine is the most important diagnostic tool for evaluating the need for surgical intervention in patients with LDBH. However, MRI utilization is limited by its low accessibility. Spinal X-rays can rapidly provide information on the bony structure of the patient. Our study aimed to identify the factors associated with LDBH, including disc height, and establish a clinical diagnostic tool to support its diagnosis based on lumbar X-ray findings. In this study, a total of 458 patients were used for analysis and 13 clinical and imaging variables were collected. Five machine-learning (ML) methods, including LASSO regression, MARS, decision tree, random forest, and extreme gradient boosting, were applied and integrated to identify important variables for predicting LDBH from lumbar spine X-rays. The results showed L4-5 posterior disc height, age, and L1-2 anterior disc height to be the top predictors, and a decision tree algorithm was constructed to support clinical decision-making. Our study highlights the potential of ML-based decision tools for surgeons and emphasizes the importance of L1-2 disc height in relation to LDBH. Future research will expand on these findings to develop a more comprehensive decision-supporting model.
Collapse
Affiliation(s)
- Pao-Chun Lin
- Department of Biomedical Engineering, National Taiwan University, Taipei City 10617, Taiwan; (P.-C.L.); (F.-H.L.)
- Department of Neurosurgery, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Wei-Shan Chang
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Kai-Yuan Hsiao
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Hon-Man Liu
- Department of Radiology, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City 24352, Taiwan;
| | - Ben-Chang Shia
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Ming-Chih Chen
- Graduate Institute of Business Administration, College of Management, Fu Jen Catholic University, New Taipei City 24352, Taiwan; (W.-S.C.); (K.-Y.H.); (B.-C.S.); (M.-C.C.)
- Artificial Intelligence Development Center, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| | - Po-Yu Hsieh
- Industrial Technology Research Institute (ITRI), Hsinchu City 310401, Taiwan; (P.-Y.H.); (T.-W.L.)
| | - Tseng-Wei Lai
- Industrial Technology Research Institute (ITRI), Hsinchu City 310401, Taiwan; (P.-Y.H.); (T.-W.L.)
| | - Feng-Huei Lin
- Department of Biomedical Engineering, National Taiwan University, Taipei City 10617, Taiwan; (P.-C.L.); (F.-H.L.)
| | - Che-Cheng Chang
- Department of Neurology, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City 24352, Taiwan
- PhD Program in Nutrition and Food Science, Fu Jen Catholic University, New Taipei City 24352, Taiwan
| |
Collapse
|
21
|
Adida S, Legarreta AD, Hudson JS, McCarthy D, Andrews E, Shanahan R, Taori S, Lavadi RS, Buell TJ, Hamilton DK, Agarwal N, Gerszten PC. Machine Learning in Spine Surgery: A Narrative Review. Neurosurgery 2024; 94:53-64. [PMID: 37930259 DOI: 10.1227/neu.0000000000002660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 07/06/2023] [Indexed: 11/07/2023] Open
Abstract
Artificial intelligence and machine learning (ML) can offer revolutionary advances in their application to the field of spine surgery. Within the past 5 years, novel applications of ML have assisted in surgical decision-making, intraoperative imaging and navigation, and optimization of clinical outcomes. ML has the capacity to address many different clinical needs and improve diagnostic and surgical techniques. This review will discuss current applications of ML in the context of spine surgery by breaking down its implementation preoperatively, intraoperatively, and postoperatively. Ethical considerations to ML and challenges in ML implementation must be addressed to maximally benefit patients, spine surgeons, and the healthcare system. Areas for future research in augmented reality and mixed reality, along with limitations in generalizability and bias, will also be highlighted.
Collapse
Affiliation(s)
- Samuel Adida
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Andrew D Legarreta
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Joseph S Hudson
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - David McCarthy
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Edward Andrews
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Regan Shanahan
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Suchet Taori
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Raj Swaroop Lavadi
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Thomas J Buell
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - D Kojo Hamilton
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| | - Nitin Agarwal
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
- Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh , Pennsylvania , USA
| | - Peter C Gerszten
- Department of Neurosurgery, University of Pittsburgh School of Medicine, Pittsburgh , Pennsylvania , USA
| |
Collapse
|
22
|
Bhimreddy M, Jiang K, Weber-Levine C, Theodore N. Computational Modeling, Augmented Reality, and Artificial Intelligence in Spine Surgery. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1462:453-464. [PMID: 39523282 DOI: 10.1007/978-3-031-64892-2_27] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
Over the past decade, advancements in computational modeling, augmented reality, and artificial intelligence (AI) have been driving innovations in spine surgery. Much of the research conducted in these fields is from the past 5 years. In 2021, the market value for augmented reality and virtual reality reached around $22.6 billion, highlighting the rise in demand for these technologies in the medical industry and beyond. Currently, these modalities have a wide variety of potential uses, from preoperative planning of pedicle screw placement and assessment of surgical instrumentation to predictions for postoperative outcomes and development of educational tools. In this chapter, we provide an overview of the applications of these technologies in spine surgery. Furthermore, we discuss several avenues for further development, including integrations between these modalities and areas of improvement for more immersive, informative surgical experiences.
Collapse
Affiliation(s)
- Meghana Bhimreddy
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kelly Jiang
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Carly Weber-Levine
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Nicholas Theodore
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
23
|
Chaliparambil RK, Krushelnytskyy M, Shlobin NA, Thirunavu V, Roumeliotis AG, Larkin C, Kemeny H, El Tecle N, Koski T, Dahdaleh NS. Surgical management of spinal metastases from primary thyroid carcinoma: Demographics, clinical characteristics, and treatment outcomes - A retrospective analysis. JOURNAL OF CRANIOVERTEBRAL JUNCTION AND SPINE 2024; 15:92-98. [PMID: 38644915 PMCID: PMC11029107 DOI: 10.4103/jcvjs.jcvjs_7_24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Accepted: 01/29/2024] [Indexed: 04/23/2024] Open
Abstract
Objective Metastatic spinal tumors represent a rare but concerning complication of primary thyroid carcinoma. We identified demographics, metastatic features, outcomes, and treatment strategies for these tumors in our institutional cohort. Materials and Methods We retrospectively reviewed patients surgically treated for spinal metastases of primary thyroid carcinoma. Demographics, tumor characteristics, and treatment modalities were collected. The functional outcomes were quantified using Nurik, Modified Rankin, and Karnofsky Scores. Results Twelve patients were identified who underwent 17 surgeries for resection of spinal metastases. The primary thyroid tumor pathologies included papillary (4/12), follicular (6/12), and Hurthle cell (2/12) subtypes. The average number of spinal metastases was 2.5. Of the primary tumor subtypes, follicular tumors averaged 2.8 metastases at the highest and Hurthle cell tumors averaged 2.0 spinal metastases at the lowest. Five patients (41.7%) underwent preoperative embolization for their spinal metastases. Seven patients (58.3%) received postoperative radiation. There was no significant difference in progression-free survival between patients receiving surgery with adjuvant radiation and surgery alone (P = 0.0773). Five patients (41.7%) experienced postoperative complications. Two patients (16.7%) succumbed to disease progression and two patients (16.7%) experienced tumor recurrence following resection. Postsurgical mean Nurik scores decreased 0.54 points, mean Modified Rankin scores decreased 0.48 points, and mean Karnofsky scores increased 4.8 points. Conclusion Surgery presents as an important treatment modality in the management of spinal metastases from thyroid cancer. Further work is needed to understand the predictive factors for survival and outcomes following treatment.
Collapse
Affiliation(s)
| | - Mykhaylo Krushelnytskyy
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Nathan A. Shlobin
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Vineeth Thirunavu
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Anastasios G. Roumeliotis
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Collin Larkin
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Hanna Kemeny
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Najib El Tecle
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Tyler Koski
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Nader S. Dahdaleh
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
24
|
Ghanem M, Ghaith AK, El-Hajj VG, Bhandarkar A, de Giorgio A, Elmi-Terander A, Bydon M. Limitations in Evaluating Machine Learning Models for Imbalanced Binary Outcome Classification in Spine Surgery: A Systematic Review. Brain Sci 2023; 13:1723. [PMID: 38137171 PMCID: PMC10741524 DOI: 10.3390/brainsci13121723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 12/12/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023] Open
Abstract
Clinical prediction models for spine surgery applications are on the rise, with an increasing reliance on machine learning (ML) and deep learning (DL). Many of the predicted outcomes are uncommon; therefore, to ensure the models' effectiveness in clinical practice it is crucial to properly evaluate them. This systematic review aims to identify and evaluate current research-based ML and DL models applied for spine surgery, specifically those predicting binary outcomes with a focus on their evaluation metrics. Overall, 60 papers were included, and the findings were reported according to the PRISMA guidelines. A total of 13 papers focused on lengths of stay (LOS), 12 on readmissions, 12 on non-home discharge, 6 on mortality, and 5 on reoperations. The target outcomes exhibited data imbalances ranging from 0.44% to 42.4%. A total of 59 papers reported the model's area under the receiver operating characteristic (AUROC), 28 mentioned accuracies, 33 provided sensitivity, 29 discussed specificity, 28 addressed positive predictive value (PPV), 24 included the negative predictive value (NPV), 25 indicated the Brier score with 10 providing a null model Brier, and 8 detailed the F1 score. Additionally, data visualization varied among the included papers. This review discusses the use of appropriate evaluation schemes in ML and identifies several common errors and potential bias sources in the literature. Embracing these recommendations as the field advances may facilitate the integration of reliable and effective ML models in clinical settings.
Collapse
Affiliation(s)
- Marc Ghanem
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
- School of Medicine, Lebanese American University, Byblos 4504, Lebanon
| | - Abdul Karim Ghaith
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| | - Victor Gabriel El-Hajj
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
- Department of Clinical Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
| | - Archis Bhandarkar
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| | - Andrea de Giorgio
- Artificial Engineering, Via del Rione Sirignano, 80121 Naples, Italy;
| | - Adrian Elmi-Terander
- Department of Clinical Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
- Department of Surgical Sciences, Uppsala University, 75236 Uppsala, Sweden
| | - Mohamad Bydon
- Mayo Clinic Neuro-Informatics Laboratory, Mayo Clinic, Rochester, MN 55902, USA; (M.G.); (A.K.G.); (V.G.E.-H.); (A.B.); (M.B.)
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN 55902, USA
| |
Collapse
|
25
|
Cho ST, Shin DE, Kim JW, Yoon S, Ii Lee H, Lee S. Prediction of Progressive Collapse in Osteoporotic Vertebral Fractures Using Conventional Statistics and Machine Learning. Spine (Phila Pa 1976) 2023; 48:1535-1543. [PMID: 37235792 DOI: 10.1097/brs.0000000000004598] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 12/29/2022] [Indexed: 05/28/2023]
Abstract
STUDY DESIGN Retrospective cohort study. OBJECTIVE The objective of this study was to determine prognostic factors for the progression of osteoporotic vertebral fracture (OVF) following conservative treatment. SUMMARY OF BACKGROUND DATA Few studies have evaluated factors associated with progressive collapse (PC) of OVFs. Furthermore, machine learning has not been applied in this context. MATERIALS AND METHODS The study involved the PC and non-PC groups based on a compression rate of 15%. Clinical data, fracture site, OVF shape, Cobb angle, and anterior wedge angle of the fractured vertebra were evaluated. The presence of intravertebral cleft and the type of bone marrow signal change were analyzed using magnetic resonance imaging. Multivariate logistic regression analysis was performed to identify prognostic factors. In machine learning methods, decision tree and random forest models were used. RESULTS There were no significant differences in clinical data between the groups. The proportion of fracture shape ( P <0.001) and bone marrow signal change ( P =0.01) were significantly different between the groups. Moderate wedge shape was frequently observed in the non-PC group (31.7%), whereas the normative shape was most common in the PC group (54.7%). The Cobb angle and anterior wedge angle at diagnosis of OVFs were higher in the non-PC group (13.2±10.9, P =0.001; 14.3±6.6, P <0.001) than in the PC group (10.3±11.8, 10.4±5.5). The bone marrow signal change at the superior aspect of the vertebra was more frequently found in the PC group (42.5%) than in the non-PC group (34.9%). Machine learning revealed that vertebral shape at initial diagnosis was a main predictor of progressive vertebral collapse. CONCLUSION The initial shape of the vertebra and bone edema pattern on magnetic resonance imaging appear to be useful prognostic factors for progressive collapse in osteoporotic vertebral fractures.
Collapse
Affiliation(s)
- Sung Tan Cho
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Dong-Eun Shin
- Department of Orthopaedic Surgery, CHA University School of Medicine, Seongnam-si, Gyeonggi-do Province, Republic of Korea
| | - Jin-Woo Kim
- Department of Orthopaedic Surgery, Nowon Eulji Medical Center, Eulji University, Seoul, Korea
| | - Siyeoung Yoon
- Department of Orthopaedic Surgery, CHA University School of Medicine, Seongnam-si, Gyeonggi-do Province, Republic of Korea
| | - Hyun Ii Lee
- Department of Orthopedic Surgery, Ilsan Paik Hospital, Inje University, Goyang-si, Gyeonggi-do Province, Republic of Korea
| | - Soonchul Lee
- Department of Orthopaedic Surgery, CHA University School of Medicine, Seongnam-si, Gyeonggi-do Province, Republic of Korea
| |
Collapse
|
26
|
Agadi K, Dominari A, Tebha SS, Mohammadi A, Zahid S. Neurosurgical Management of Cerebrospinal Tumors in the Era of Artificial Intelligence : A Scoping Review. J Korean Neurosurg Soc 2023; 66:632-641. [PMID: 35831137 PMCID: PMC10641423 DOI: 10.3340/jkns.2021.0213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Revised: 10/06/2021] [Accepted: 03/14/2022] [Indexed: 11/27/2022] Open
Abstract
Central nervous system tumors are identified as tumors of the brain and spinal cord. The associated morbidity and mortality of cerebrospinal tumors are disproportionately high compared to other malignancies. While minimally invasive techniques have initiated a revolution in neurosurgery, artificial intelligence (AI) is expediting it. Our study aims to analyze AI's role in the neurosurgical management of cerebrospinal tumors. We conducted a scoping review using the Arksey and O'Malley framework. Upon screening, data extraction and analysis were focused on exploring all potential implications of AI, classification of these implications in the management of cerebrospinal tumors. AI has enhanced the precision of diagnosis of these tumors, enables surgeons to excise the tumor margins completely, thereby reducing the risk of recurrence, and helps to make a more accurate prediction of the patient's prognosis than the conventional methods. AI also offers real-time training to neurosurgeons using virtual and 3D simulation, thereby increasing their confidence and skills during procedures. In addition, robotics is integrated into neurosurgery and identified to increase patient outcomes by making surgery less invasive. AI, including machine learning, is rigorously considered for its applications in the neurosurgical management of cerebrospinal tumors. This field requires further research focused on areas clinically essential in improving the outcome that is also economically feasible for clinical use. The authors suggest that data analysts and neurosurgeons collaborate to explore the full potential of AI.
Collapse
Affiliation(s)
- Kuchalambal Agadi
- Division of Research and Academic Affairs, Larkin Health System, South Miami, FL, USA
| | - Asimina Dominari
- Division of Research and Academic Affairs, Larkin Health System, South Miami, FL, USA
- Aristotle University of Thessaloniki School of Medicine, Thessaloniki, Greece
| | - Sameer Saleem Tebha
- Division of Research and Academic Affairs, Larkin Health System, South Miami, FL, USA
- Department of Neurosurgery and Neurology, Jinnah Medical and Dental College, Karachi, Pakistan
| | - Asma Mohammadi
- Division of Research and Academic Affairs, Larkin Health System, South Miami, FL, USA
| | - Samina Zahid
- Division of Research and Academic Affairs, Larkin Health System, South Miami, FL, USA
| |
Collapse
|
27
|
Fuentes Caparrós S, Rodríguez de Tembleque Aguilar F, Marín Luján MÁ, Gutiérrez Castro JA. Preoperative assessment and surgical indications: Separation surgery. Rev Esp Cir Ortop Traumatol (Engl Ed) 2023; 67:463-479. [PMID: 37085000 DOI: 10.1016/j.recot.2023.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 04/05/2023] [Accepted: 04/16/2023] [Indexed: 04/23/2023] Open
Abstract
Neurological compression occurs in 10%-20% of patients who develop spinal metastases. In the last decade, the evolution of oncological diagnostic and medical techniques, the change from conventional external radiation to radiosurgery and the new surgical instruments have meant that the treatment of these patients must be indicated in a personalized manner and by consensus, multidisciplinary way, in specific commissions. Today, the biological state of the patient, the presence of mechanical instability, the neurological assessment and degree of epidural compression, as well as the best prognostic categorization of the tumor, are established as decision factors prior to the indication of surgical treatment, treatment that has passed from a cytoreductive concept to that of a spinal cord release from tumor in order to ensure safe radiosurgery.
Collapse
Affiliation(s)
- S Fuentes Caparrós
- Unidad de Columna, Servicio de Cirugía Ortopédica y Traumatología, Hospital Universitario Reina Sofía, Córdoba, España.
| | | | - M Á Marín Luján
- Unidad de Columna, Servicio de Cirugía Ortopédica y Traumatología, Hospital Universitario Reina Sofía, Córdoba, España
| | - J A Gutiérrez Castro
- Unidad de Columna, Servicio de Cirugía Ortopédica y Traumatología, Hospital Universitario Reina Sofía, Córdoba, España
| |
Collapse
|
28
|
Fuentes Caparrós S, Rodríguez de Tembleque Aguilar F, Marín Luján MÁ, Gutiérrez Castro JA. [Translated article] Preoperative assessment and surgical indications: Separation surgery. Rev Esp Cir Ortop Traumatol (Engl Ed) 2023; 67:S463-S479. [PMID: 37541344 DOI: 10.1016/j.recot.2023.08.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 04/16/2023] [Indexed: 08/06/2023] Open
Abstract
Neurological compression occurs in 10%-20% of patients who develop spinal metastases. In the last decade, the evolution of oncological diagnostic and medical techniques, the change from conventional external radiation to radiosurgery and the new surgical instruments have meant that the treatment of these patients must be indicated in a personalized manner and by consensus, multidisciplinary way, in specific commissions. Today, the biological state of the patient, the presence of mechanical instability, the neurological assessment and degree of epidural compression, as well as the best prognostic categorization of the tumor, are established as decision factors prior to the indication of surgical treatment, treatment that has passed from a cytoreductive concept to that of a spinal cord release from tumor in order to ensure safe radiosurgery.
Collapse
Affiliation(s)
- S Fuentes Caparrós
- Unidad de Columna, Servicio de Cirugía Ortopédica y Traumatología, Hospital Universitario Reina Sofía, Córdoba, Spain.
| | | | - M Á Marín Luján
- Unidad de Columna, Servicio de Cirugía Ortopédica y Traumatología, Hospital Universitario Reina Sofía, Córdoba, Spain
| | - J A Gutiérrez Castro
- Unidad de Columna, Servicio de Cirugía Ortopédica y Traumatología, Hospital Universitario Reina Sofía, Córdoba, Spain
| |
Collapse
|
29
|
Tragaris T, Benetos IS, Vlamis J, Pneumaticos S. Machine Learning Applications in Spine Surgery. Cureus 2023; 15:e48078. [PMID: 38046496 PMCID: PMC10689893 DOI: 10.7759/cureus.48078] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/31/2023] [Indexed: 12/05/2023] Open
Abstract
This literature review sought to identify and evaluate the current applications of artificial intelligence (AI)/machine learning (ML) in spine surgery that can effectively guide clinical decision-making and surgical planning. By using specific keywords to maximize search sensitivity, a thorough literature research was conducted in several online databases: Scopus, PubMed, and Google Scholar, and the findings were filtered according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 46 studies met the requirements and were included in this review. According to this study, AI/ML models were sufficiently accurate with a mean overall value of 74.9%, and performed best at preoperative patient selection, cost prediction, and length of stay. Performance was also good at predicting functional outcomes and postoperative mortality. Regression analysis was the most frequently utilized application whereas deep learning/artificial neural networks had the highest sensitivity score (81.5%). Despite the relatively brief history of engagement with AI/ML, as evidenced by the fact that 77.5% of studies were published after 2018, the outcomes have been promising. In light of the Big Data era, the increasing prevalence of National Registries, and the wide-ranging applications of AI, such as exemplified by ChatGPT (OpenAI, San Francisco, California), it is highly likely that the field of spine surgery will gradually adopt and integrate AI/ML into its clinical practices. Consequently, it is of great significance for spine surgeons to acquaint themselves with the fundamental principles of AI/ML, as these technologies hold the potential for substantial improvements in overall patient care.
Collapse
Affiliation(s)
- Themistoklis Tragaris
- 1st Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Ioannis S Benetos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - John Vlamis
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| | - Spyridon Pneumaticos
- 3rd Department of Orthopaedic Surgery, National and Kapodistrian University of Athens School of Medicine, KAT Hospital, Athens, GRC
| |
Collapse
|
30
|
Yi M, Feng Z, He H, Dinulescu D, Xu B. Evaluating Alkaline Phosphatase-Instructed Self-Assembly of d-Peptides for Selectively Inhibiting Ovarian Cancer Cells. J Med Chem 2023; 66:10027-10035. [PMID: 37459116 PMCID: PMC10614160 DOI: 10.1021/acs.jmedchem.3c00949] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/28/2023]
Abstract
Cancer is a major public health concern requiring novel treatment approaches. Enzyme-instructed self-assembly (EISA) provides a unique approach for selectively inhibiting cancer cells. However, the structure and activity correlation of EISA remains to be explored. This study investigates new EISA substrates of alkaline phosphatase (ALP) to hinder ovarian cancer cells. Analogues 2-8 were synthesized by modifying the amino acid residues of a potent EISA substrate 1 that effectively inhibits the growth of OVSAHO, a high-grade serous ovarian cancer (HGSOC) cell line. The efficacy of 2-8 against OVSAHO was assessed, along with the combination of substrate 1 with clinically used drugs. The results reveal that substrate 1 displays the highest cytotoxicity against OVSAHO cells, with an IC50 of around 8 μM. However, there was limited synergism observed between substrate 1 and the tested clinically used drugs. These findings indicate that EISA likely operates through a distinct mechanism that necessitates further elucidation.
Collapse
Affiliation(s)
- Meihui Yi
- Department of Chemistry, Brandeis University, 415 South Street, Waltham, MA 02453, USA
| | - Zhaoqianqi Feng
- Department of Chemistry, Brandeis University, 415 South Street, Waltham, MA 02453, USA
| | - Hongjian He
- Department of Chemistry, Brandeis University, 415 South Street, Waltham, MA 02453, USA
| | - Daniela Dinulescu
- Department of Pathology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115, USA
| | - Bing Xu
- Department of Chemistry, Brandeis University, 415 South Street, Waltham, MA 02453, USA
| |
Collapse
|
31
|
Tangsrivimol JA, Schonfeld E, Zhang M, Veeravagu A, Smith TR, Härtl R, Lawton MT, El-Sherbini AH, Prevedello DM, Glicksberg BS, Krittanawong C. Artificial Intelligence in Neurosurgery: A State-of-the-Art Review from Past to Future. Diagnostics (Basel) 2023; 13:2429. [PMID: 37510174 PMCID: PMC10378231 DOI: 10.3390/diagnostics13142429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 07/06/2023] [Accepted: 07/10/2023] [Indexed: 07/30/2023] Open
Abstract
In recent years, there has been a significant surge in discussions surrounding artificial intelligence (AI), along with a corresponding increase in its practical applications in various facets of everyday life, including the medical industry. Notably, even in the highly specialized realm of neurosurgery, AI has been utilized for differential diagnosis, pre-operative evaluation, and improving surgical precision. Many of these applications have begun to mitigate risks of intraoperative and postoperative complications and post-operative care. This article aims to present an overview of the principal published papers on the significant themes of tumor, spine, epilepsy, and vascular issues, wherein AI has been applied to assess its potential applications within neurosurgery. The method involved identifying high-cited seminal papers using PubMed and Google Scholar, conducting a comprehensive review of various study types, and summarizing machine learning applications to enhance understanding among clinicians for future utilization. Recent studies demonstrate that machine learning (ML) holds significant potential in neuro-oncological care, spine surgery, epilepsy management, and other neurosurgical applications. ML techniques have proven effective in tumor identification, surgical outcomes prediction, seizure outcome prediction, aneurysm prediction, and more, highlighting its broad impact and potential in improving patient management and outcomes in neurosurgery. This review will encompass the current state of research, as well as predictions for the future of AI within neurosurgery.
Collapse
Affiliation(s)
- Jonathan A Tangsrivimol
- Division of Neurosurgery, Department of Surgery, Chulabhorn Hospital, Chulabhorn Royal Academy, Bangkok 10210, Thailand
- Department of Neurological Surgery, The Ohio State University Wexner Medical Center and Jame Cancer Institute, Columbus, OH 43210, USA
| | - Ethan Schonfeld
- Department Biomedical Informatics, Stanford University School of Medicine, Palo Alto, CA 94305, USA
| | - Michael Zhang
- Department of Neurosurgery, Stanford University School of Medicine, Palo Alto, CA 94305, USA
| | - Anand Veeravagu
- Stanford Neurosurgical Artificial Intelligence and Machine Learning Laboratory, Department of Neurosurgery, Stanford University School of Medicine, Stanford, CA 94305, USA
| | - Timothy R Smith
- Department of Neurosurgery, Computational Neuroscience Outcomes Center (CNOC), Mass General Brigham, Harvard Medical School, Boston, MA 02115, USA
| | - Roger Härtl
- Weill Cornell Medicine Brain and Spine Center, New York, NY 10022, USA
| | - Michael T Lawton
- Department of Neurosurgery, Barrow Neurological Institute (BNI), Phoenix, AZ 85013, USA
| | - Adham H El-Sherbini
- Faculty of Health Sciences, Queen's University, Kingston, ON K7L 3N6, Canada
| | - Daniel M Prevedello
- Department of Neurological Surgery, The Ohio State University Wexner Medical Center and Jame Cancer Institute, Columbus, OH 43210, USA
| | - Benjamin S Glicksberg
- Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
| | - Chayakrit Krittanawong
- Cardiology Division, New York University Langone Health, New York University School of Medicine, New York, NY 10016, USA
| |
Collapse
|
32
|
Tsutsumi K, Goshtasbi K, Ahmed KH, Khosravi P, Tawk K, Haidar YM, Tjoa T, Armstrong WB, Abouzari M. Artificial neural network prediction of post-thyroidectomy outcome. Clin Otolaryngol 2023; 48:665-671. [PMID: 37096572 PMCID: PMC10330281 DOI: 10.1111/coa.14066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Revised: 02/13/2023] [Accepted: 04/09/2023] [Indexed: 04/26/2023]
Abstract
OBJECTIVES The goal of this study was to develop a deep neural network (DNN) for predicting surgical/medical complications and unplanned reoperations following thyroidectomy. DESIGN, SETTING, AND PARTICIPANTS The 2005-2017 American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) database was queried to extract patients who underwent thyroidectomy. A DNN consisting of 10 layers was developed with an 80:20 breakdown for training and testing. MAIN OUTCOME MEASURES Three primary outcomes of interest, including occurrence of surgical complications, medical complications, and unplanned reoperation were predicted. RESULTS Of the 21 550 patients who underwent thyroidectomy, medical complications, surgical complications and reoperation occurred in 1723 (8.0%), 943 (4.38%) and 2448 (11.36%) patients, respectively. The DNN performed with an area under the curve of receiver operating characteristics of .783 (medical complications), .709 (surgical complications) and .703 (reoperations). Accuracy, specificity and negative predictive values of the model for all outcome variables ranged 78.2%-97.2%, while sensitivity and positive predictive values ranged 11.6%-62.5%. Variables with high permutation importance included sex, inpatient versus outpatient and American Society of Anesthesiologists class. CONCLUSIONS We predicted surgical/medical complications and unplanned reoperation following thyroidectomy via development of a well-performing ML algorithm. We have also developed a web-based application available on mobile devices to demonstrate the predictive capacity of our models in real time.
Collapse
Affiliation(s)
- Kotaro Tsutsumi
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Khodayar Goshtasbi
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Khwaja H. Ahmed
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Pooya Khosravi
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Karen Tawk
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Yarah M. Haidar
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Tjoson Tjoa
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - William B. Armstrong
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| | - Mehdi Abouzari
- Department of Otolaryngology–Head and Neck Surgery, University of California, Irvine, USA
| |
Collapse
|
33
|
Dhiman P, Ma J, Andaur Navarro CL, Speich B, Bullock G, Damen JAA, Hooft L, Kirtley S, Riley RD, Van Calster B, Moons KGM, Collins GS. Overinterpretation of findings in machine learning prediction model studies in oncology: a systematic review. J Clin Epidemiol 2023; 157:120-133. [PMID: 36935090 PMCID: PMC11913775 DOI: 10.1016/j.jclinepi.2023.03.012] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 03/03/2023] [Accepted: 03/14/2023] [Indexed: 03/19/2023]
Abstract
OBJECTIVES In biomedical research, spin is the overinterpretation of findings, and it is a growing concern. To date, the presence of spin has not been evaluated in prognostic model research in oncology, including studies developing and validating models for individualized risk prediction. STUDY DESIGN AND SETTING We conducted a systematic review, searching MEDLINE and EMBASE for oncology-related studies that developed and validated a prognostic model using machine learning published between 1st January, 2019, and 5th September, 2019. We used existing spin frameworks and described areas of highly suggestive spin practices. RESULTS We included 62 publications (including 152 developed models; 37 validated models). Reporting was inconsistent between methods and the results in 27% of studies due to additional analysis and selective reporting. Thirty-two studies (out of 36 applicable studies) reported comparisons between developed models in their discussion and predominantly used discrimination measures to support their claims (78%). Thirty-five studies (56%) used an overly strong or leading word in their title, abstract, results, discussion, or conclusion. CONCLUSION The potential for spin needs to be considered when reading, interpreting, and using studies that developed and validated prognostic models in oncology. Researchers should carefully report their prognostic model research using words that reflect their actual results and strength of evidence.
Collapse
Affiliation(s)
- Paula Dhiman
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK; NIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK.
| | - Jie Ma
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK
| | - Constanza L Andaur Navarro
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Benjamin Speich
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK; Meta-Research Centre, Department of Clinical Research, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Garrett Bullock
- Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Johanna A A Damen
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Lotty Hooft
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Shona Kirtley
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK
| | - Richard D Riley
- Centre for Prognosis Research, School of Medicine, Keele University, Staffordshire, UK, ST5 5BG
| | - Ben Van Calster
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium; Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, the Netherlands; EPI-centre, KU Leuven, Leuven, Belgium
| | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Gary S Collins
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK; NIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| |
Collapse
|
34
|
Wick JB, Kalistratova VS, Jr DP, Fine JR, Boozé ZL, Holland J, Vander Voort W, Hisatomi LA, Villegas A, Conry K, Ortega B, Javidan Y, Roberto RF, Klineberg EO, Le HV. A Comparison of Prognostic Models to Facilitate Surgical Decision-Making for Patients With Spinal Metastatic Disease. Spine (Phila Pa 1976) 2023; 48:567-576. [PMID: 36799724 DOI: 10.1097/brs.0000000000004600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Accepted: 11/30/2022] [Indexed: 02/18/2023]
Abstract
STUDY DESIGN Retrospective cohort. OBJECTIVE Compare the performance of and provide cutoff values for commonly used prognostic models for spinal metastases, including Revised Tokuhashi, Tomita, Modified Bauer, New England Spinal Metastases Score (NESMS), and Skeletal Oncology Research Group model, at three- and six-month postoperative time points. SUMMARY OF BACKGROUND DATA Surgery may be recommended for patients with spinal metastases causing fracture, instability, pain, and/or neurological compromise. However, patients with less than three to six months of projected survival are less likely to benefit from surgery. Prognostic models have been developed to help determine prognosis and surgical candidacy. Yet, there is a lack of data directly comparing the performance of these models at clinically relevant time points or providing clinically applicable cutoff values for the models. MATERIALS AND METHODS Sixty-four patients undergoing surgery from 2015 to 2022 for spinal metastatic disease were identified. Revised Tokuhashi, Tomita, Modified Bauer, NESMS, and Skeletal Oncology Research Group were calculated for each patient. Model calibration and discrimination for predicting survival at three months, six months, and final follow-up were evaluated using the Brier score and Uno's C, respectively. Hazard ratios for survival were calculated for the models. The Contral and O'Quigley method was utilized to identify cutoff values for the models discriminating between survival and nonsurvival at three months, six months, and final follow-up. RESULTS Each of the models demonstrated similar performance in predicting survival at three months, six months, and final follow-up. Cutoff scores that best differentiated patients likely to survive beyond three months included the Revised Tokuhashi score=10, Tomita score=four, Modified Bauer score=three, and NESMS=one. CONCLUSION We found comparable efficacy among the models in predicting survival at clinically relevant time points. Cutoff values provided herein may assist surgeons and patients when deciding whether to pursue surgery for spinal metastatic disease. LEVEL OF EVIDENCE 4.
Collapse
Affiliation(s)
- Joseph B Wick
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | | | | | - Jeffrey R Fine
- University of California, Davis, Department Biostatistics, Sacramento, CA
| | - Zachary L Boozé
- University of California, Davis, School of Medicine, Sacramento, CA
| | - Joseph Holland
- University of Louisville School of Medicine, Louisville, KY
| | - Wyatt Vander Voort
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | | | - Alex Villegas
- University of California, Davis, School of Medicine, Sacramento, CA
| | - Keegan Conry
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | - Brandon Ortega
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | - Yashar Javidan
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | - Rolando F Roberto
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | - Eric O Klineberg
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| | - Hai V Le
- Department of Orthopedic Surgery, University of California, Davis, Sacramento, CA
| |
Collapse
|
35
|
Shah AA, Devana SK, Lee C, Olson TE, Upfill-Brown A, Sheppard WL, Lord EL, Shamie AN, van der Schaar M, SooHoo NF, Park DY. Development and External Validation of a Risk Calculator for Prediction of Major Complications and Readmission After Anterior Cervical Discectomy and Fusion. Spine (Phila Pa 1976) 2023; 48:460-467. [PMID: 36730869 PMCID: PMC10023283 DOI: 10.1097/brs.0000000000004531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 10/22/2022] [Indexed: 02/04/2023]
Abstract
STUDY DESIGN A retrospective, case-control study. OBJECTIVE We aim to build a risk calculator predicting major perioperative complications after anterior cervical fusion. In addition, we aim to externally validate this calculator with an institutional cohort of patients who underwent anterior cervical discectomy and fusion (ACDF). SUMMARY OF BACKGROUND DATA The average age and proportion of patients with at least one comorbidity undergoing ACDF have increased in recent years. Given the increased morbidity and cost associated with perioperative complications and unplanned readmission, accurate risk stratification of patients undergoing ACDF is of great clinical utility. METHODS This is a retrospective cohort study of adults who underwent anterior cervical fusion at any nonfederal California hospital between 2015 and 2017. The primary outcome was major perioperative complication or 30-day readmission. We built standard and ensemble machine learning models for risk prediction, assessing discrimination, and calibration. The best-performing model was validated on an external cohort comprised of consecutive adult patients who underwent ACDF at our institution between 2013 and 2020. RESULTS A total of 23,184 patients were included in this study; there were 1886 cases of major complication or readmissions. The ensemble model was well calibrated and demonstrated an area under the receiver operating characteristic curve of 0.728. The variables most important for the ensemble model include male sex, medical comorbidities, history of complications, and teaching hospital status. The ensemble model was evaluated on the validation cohort (n=260) with an area under the receiver operating characteristic curve of 0.802. The ensemble algorithm was used to build a web-based risk calculator. CONCLUSION We report derivation and external validation of an ensemble algorithm for prediction of major perioperative complications and 30-day readmission after anterior cervical fusion. This model has excellent discrimination and is well calibrated when tested on a contemporaneous external cohort of ACDF cases.
Collapse
Affiliation(s)
- Akash A. Shah
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Sai K. Devana
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Changhee Lee
- Department of Artificial Intelligence, Chung-Ang University, Seoul, South Korea
| | - Thomas E. Olson
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Alexander Upfill-Brown
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - William L. Sheppard
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Elizabeth L. Lord
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Arya N. Shamie
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Mihaela van der Schaar
- Department of Electrical and Computer Engineering, University of California, Los Angeles, CA
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, United Kingdom
| | - Nelson F. SooHoo
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| | - Don Y. Park
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, CA
| |
Collapse
|
36
|
Oosterhoff JHF, Karhade AV, Groot OQ, Schwab JH, Heng M, Klang E, Prat D. Intercontinental validation of a clinical prediction model for predicting 90-day and 2-year mortality in an Israeli cohort of 2033 patients with a femoral neck fracture aged 65 or above. Eur J Trauma Emerg Surg 2023; 49:1545-1553. [PMID: 36757419 DOI: 10.1007/s00068-023-02237-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 01/27/2023] [Indexed: 02/10/2023]
Abstract
PURPOSE Mortality prediction in elderly femoral neck fracture patients is valuable in treatment decision-making. A previously developed and internally validated clinical prediction model shows promise in identifying patients at risk of 90-day and 2-year mortality. Validation in an independent cohort is required to assess the generalizability; especially in geographically distinct regions. Therefore we questioned, is the SORG Orthopaedic Research Group (SORG) femoral neck fracture mortality algorithm externally valid in an Israeli cohort to predict 90-day and 2-year mortality? METHODS We previously developed a prediction model in 2022 for estimating the risk of mortality in femoral neck fracture patients using a multicenter institutional cohort of 2,478 patients from the USA. The model included the following input variables that are available on clinical admission: age, male gender, creatinine level, absolute neutrophil, hemoglobin level, international normalized ratio (INR), congestive heart failure (CHF), displaced fracture, hemiplegia, chronic obstructive pulmonary disease (COPD), history of cerebrovascular accident (CVA) and beta-blocker use. To assess the generalizability, we used an intercontinental institutional cohort from the Sheba Medical Center in Israel (level I trauma center), queried between June 2008 and February 2022. Generalizability of the model was assessed using discrimination, calibration, Brier score, and decision curve analysis. RESULTS The validation cohort included 2,033 patients, aged 65 years or above, that underwent femoral neck fracture surgery. Most patients were female 64.8% (n = 1317), the median age was 81 years (interquartile range = 75-86), and 80.4% (n = 1635) patients sustained a displaced fracture (Garden III/IV). The 90-day mortality was 9.4% (n = 190) and 2-year mortality was 30.0% (n = 610). Despite numerous baseline differences, the model performed acceptably to the validation cohort on discrimination (c-statistic 0.67 for 90-day, 0.67 for 2-year), calibration, Brier score, and decision curve analysis. CONCLUSIONS The previously developed SORG femoral neck fracture mortality algorithm demonstrated good performance in an independent intercontinental population. Current iteration should not be relied on for patient care, though suggesting potential utility in assessing patients at low risk for 90-day or 2-year mortality. Further studies should evaluate this tool in a prospective setting and evaluate its feasibility and efficacy in clinical practice. The algorithm can be freely accessed: https://sorg-apps.shinyapps.io/hipfracturemortality/ . LEVEL OF EVIDENCE Level III, Prognostic study.
Collapse
Affiliation(s)
- Jacobien H F Oosterhoff
- Department of Orthopaedic Surgery, Amsterdam Movement Sciences, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105AZ, Amsterdam, the Netherlands. .,Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA. .,Department Engineering Systems and Services, Faculty Technology Policy and Management, Delft University of Technology, Delft, The Netherlands.
| | - Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Olivier Q Groot
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Marilyn Heng
- Department of Orthopaedic Surgery, University of Miami Miller School of Medicine, Miami, FL, USA.,Orthopaedic Trauma Service, Jackson Memorial Ryder Trauma Center, Miami, FL, USA
| | - Eyal Klang
- Sami Sagol AI Hub, ARC, Sheba Medical Center, Ramat Gan, Israel
| | - Dan Prat
- Department of Orthopaedic Surgery, Sheba Medical Center, Ramat Gan, Israel
| |
Collapse
|
37
|
Li Z, Guo L, Guo B, Zhang P, Wang J, Wang X, Yao W. Evaluation of different scoring systems for spinal metastases based on a Chinese cohort. Cancer Med 2023; 12:4125-4136. [PMID: 36128836 PMCID: PMC9972034 DOI: 10.1002/cam4.5272] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Revised: 08/03/2022] [Accepted: 09/02/2022] [Indexed: 11/12/2022] Open
Abstract
INTRODUCTIONS The spine is one of the most common sites of metastasis for malignancies. This study aimed to compare the predictive performance of seven commonly used prognostic scoring systems for surgically treated spine metastases. It is expected to assist surgeons in selecting appropriate scoring systems to support clinical decision-making and better inform patients. METHODS We performed a retrospective study involving 268 surgically treated patients with spine metastases between 2017 and 2020 at a single regional oncology center in China. The revised Tokuhashi, Tomita, modified Bauer, revised Katagiri, van der Linden, Skeletal Oncology Research Group (SORG) nomogram, and SORG machine-learning (ML) scoring systems were externally validated. The area under the curve (AUC) of the receiver operating characteristic curve was used to evaluate sensitivity and specificity at different postoperative time points. The actual survival time was compared with the reference survival time provided in the original publication. RESULTS In the present study, the median survival was 16.6 months. The SORG ML scoring system demonstrated the highest accuracy in predicting 90-day (AUC: 0.743) and 1-year survival (AUC: 0.787). The revised Katagiri demonstrated the highest accuracy (AUC: 0.761) in predicting 180-day survival. The revised Katagiri demonstrated the highest accuracy (AUC: 0.779) in predicting 2-year survival. Based on this series, the actual life expectancy was underestimated compared with the original reference survival time. CONCLUSIONS None of the scoring systems can perform optimally at all time points and for all pathology types, and the reference survival times provided in the original study need to be updated. A cautious awareness of the underestimation by these models is of paramount importance in relation to current patients.
Collapse
Affiliation(s)
- Zhehuang Li
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Liangyu Guo
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Bairu Guo
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Peng Zhang
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Jiaqiang Wang
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Xin Wang
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| | - Weitao Yao
- Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, China
| |
Collapse
|
38
|
Shah AA, Karhade AV, Groot OQ, Olson TE, Schoenfeld AJ, Bono CM, Harris MB, Ferrone ML, Nelson SB, Park DY, Schwab JH. External validation of a predictive algorithm for in-hospital and ninety-day mortality after spinal epidural abscess. Spine J 2023; 23:760-765. [PMID: 36736740 DOI: 10.1016/j.spinee.2023.01.013] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 01/05/2023] [Accepted: 01/21/2023] [Indexed: 02/05/2023]
Abstract
BACKGROUND CONTEXT Mortality in patients with spinal epidural abscess (SEA) remains high. Accurate prediction of patient-specific prognosis in SEA can improve patient counseling as well as guide management decisions. There are no externally validated studies predicting short-term mortality in patients with SEA. PURPOSE The purpose of this study was to externally validate the Skeletal Oncology Research Group (SORG) stochastic gradient boosting algorithm for prediction of in-hospital and 90-day postdischarge mortality in SEA. STUDY DESIGN/SETTING Retrospective, case-control study at a tertiary care academic medical center from 2003 to 2021. PATIENT SAMPLE Adult patients admitted for radiologically confirmed diagnosis of SEA who did not initiate treatment at an outside institution. OUTCOME MEASURES In-hospital and 90-day postdischarge mortality. METHODS We tested the SORG stochastic gradient boosting algorithm on an independent validation cohort. We assessed its performance with discrimination, calibration, decision curve analysis, and overall performance. RESULTS A total of 212 patients met inclusion criteria, with a short-term mortality rate of 10.4%. The area under the receiver operating characteristic curve (AUROC) of the SORG algorithm when tested on the full validation cohort was 0.82, the calibration intercept was -0.08, the calibration slope was 0.96, and the Brier score was 0.09. CONCLUSIONS With a contemporaneous and geographically distinct independent cohort, we report successful external validation of a machine learning algorithm for prediction of in-hospital and 90-day postdischarge mortality in SEA.
Collapse
Affiliation(s)
- Akash A Shah
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, Los Angeles, CA 90095, USA.
| | - Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Olivier Q Groot
- Department of Orthopaedic Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Thomas E Olson
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, Los Angeles, CA 90095, USA
| | - Andrew J Schoenfeld
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115, USA
| | - Christopher M Bono
- Department of Orthopaedic Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Mitchel B Harris
- Department of Orthopaedic Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Marco L Ferrone
- Department of Orthopaedic Surgery, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115, USA
| | - Sandra B Nelson
- Division of Infectious Diseases, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| | - Don Y Park
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, 10833 Le Conte Avenue, Los Angeles, CA 90095, USA
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, 55 Fruit Street, Boston, MA 02114, USA
| |
Collapse
|
39
|
Karabacak M, Margetis K. A Machine Learning-Based Online Prediction Tool for Predicting Short-Term Postoperative Outcomes Following Spinal Tumor Resections. Cancers (Basel) 2023; 15:cancers15030812. [PMID: 36765771 PMCID: PMC9913622 DOI: 10.3390/cancers15030812] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 01/24/2023] [Accepted: 01/26/2023] [Indexed: 01/31/2023] Open
Abstract
Background: Preoperative prediction of short-term postoperative outcomes in spinal tumor patients can lead to more precise patient care plans that reduce the likelihood of negative outcomes. With this study, we aimed to develop machine learning algorithms for predicting short-term postoperative outcomes and implement these models in an open-source web application. Methods: Patients who underwent surgical resection of spinal tumors were identified using the American College of Surgeons, National Surgical Quality Improvement Program. Three outcomes were predicted: prolonged length of stay (LOS), nonhome discharges, and major complications. Four machine learning algorithms were developed and integrated into an open access web application to predict these outcomes. Results: A total of 3073 patients that underwent spinal tumor resection were included in the analysis. The most accurately predicted outcomes in terms of the area under the receiver operating characteristic curve (AUROC) was the prolonged LOS with a mean AUROC of 0.745 The most accurately predicting algorithm in terms of AUROC was random forest, with a mean AUROC of 0.743. An open access web application was developed for getting predictions for individual patients based on their characteristics and this web application can be accessed here: huggingface.co/spaces/MSHS-Neurosurgery-Research/NSQIP-ST. Conclusion: Machine learning approaches carry significant potential for the purpose of predicting postoperative outcomes following spinal tumor resections. Development of predictive models as clinically useful decision-making tools may considerably enhance risk assessment and prognosis as the amount of data in spinal tumor surgery continues to rise.
Collapse
|
40
|
Chandrashekar K, Setlur AS, Sabhapathi C A, Raiker SS, Singh S, Niranjan V. Decision Support System and Web-Application Using Supervised Machine Learning Algorithms for Easy Cancer Classifications. Cancer Inform 2023; 22:11769351221147244. [PMID: 36714384 PMCID: PMC9880585 DOI: 10.1177/11769351221147244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Accepted: 12/06/2022] [Indexed: 01/24/2023] Open
Abstract
Using a decision support system (DSS) that classifies various cancers provides support to the clinicians/researchers to make better decisions that can aid in early cancer diagnosis, thereby reducing chances of incorrect disease diagnosis. Thus, this work aimed at designing a classification model that can predict accurately for 5 different cancer types comprising of 20 cancer exomes, using the mutations identified from whole exome cancer analysis. Initially, a basic model was designed using supervised machine learning classification algorithms such as K-nearest neighbor (KNN), support vector machine (SVM), decision tree, naïve bayes and random forest (RF), among which decision tree and random forest performed better in terms of preliminary model accuracy. However, output predictions were incorrect due to less training scores. Thus, 16 essential features were then selected for model improvement using 2 approaches. All imbalanced datasets were balanced using SMOTE. In the first approach, all features from 20 cancer exome datasets were trained and models were designed using decision tree and random forest. Balanced datasets for decision tree model showed an accuracy of 77%, while with the RF model, the accuracy improved to 82% where all 5 cancer types were predicted correctly. Area under the curve for RF model was closer to 1, than decision tree model. In the second approach, all 15 datasets were trained, while 5 were tested. However, only 2 cancer types were predicted correctly. To cross validate RF model, Matthew's correlation co-efficient (MCC) test was performed. For method 1, the MCC test and MCC cross validation was found to be 0.7796 and 0.9356 respectively. Likewise, for second approach, MCC was observed to be 0.9365, corroborating the accuracy of the designed model. The model was successfully deployed using Streamlit as a web application for easy use. This study presents insights for allowing easy cancer classifications.
Collapse
Affiliation(s)
| | | | | | | | | | - Vidya Niranjan
- Vidya Niranjan, Department of
Biotechnology, R V College of Engineering, Bengaluru, Karnataka 560059, India.
| |
Collapse
|
41
|
Predictors of 30-day mortality using machine learning approach following carotid endarterectomy. Neurol Sci 2023; 44:253-261. [PMID: 36104471 DOI: 10.1007/s10072-022-06392-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Accepted: 08/11/2022] [Indexed: 01/10/2023]
Abstract
BACKGROUND Preoperative prognostication of 30-day mortality in patients with carotid endarterectomy (CEA) can optimize surgical risk stratification and guide the decision-making process to improve survival. This study aims to develop and validate a set of predictive variables of 30-day mortality following CEA. METHODS The patient cohort was identified from the American College of Surgeons National Surgical Quality Improvement Program (2005-2016). We performed logistic regression (enter, stepwise, and forward) and least absolute shrinkage and selection operator (LASSO) method for the selection of variables, which resulted in 28-candidate models. The final model was selected based upon clinical knowledge and numerical results. RESULTS Statistical analysis included 65,807 patients with 30-day mortality in 0.7% (n = 466) patients. The median age of our cohort was 71.0 years (range, 16-89 years). The model with 9 predictive factors which included age, body mass index, functional health status, American Society of Anesthesiologist grade, chronic obstructive pulmonary disorder, preoperative serum albumin, preoperative hematocrit, preoperative serum creatinine, and preoperative platelet count-performed best on discrimination, calibration, Brier score, and decision analysis to develop a machine learning algorithm. Logistic regression showed higher AUCs than LASSO across these different models. The predictive probability derived from the best model was converted into an open-accessible scoring system. CONCLUSION Machine learning algorithms show promising results for predicting 30-day mortality following CEA. These algorithms can be useful aids for counseling patients, assessing preoperative medical risks, and predicting survival after surgery.
Collapse
|
42
|
Chanplakorn P, Budsayavilaimas C, Jaipanya P, Kraiwattanapong C, Keorochana G, Leelapattana P, Lertudomphonwanit T. Validation of Traditional Prognosis Scoring Systems and Skeletal Oncology Research Group Nomogram for Predicting Survival of Spinal Metastasis Patients Undergoing Surgery. Clin Orthop Surg 2022; 14:548-556. [PMID: 36518924 PMCID: PMC9715924 DOI: 10.4055/cios22014] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 04/13/2022] [Accepted: 04/16/2022] [Indexed: 07/30/2023] Open
Abstract
BACKGROUND Many scoring systems that predict overall patient survival are based on clinical parameters and primary tumor type. To date, no consensus exists regarding which scoring system has the greatest predictive survival accuracy, especially when applied to specific primary tumors. Additionally, such scores usually fail to include modern treatment modalities, which influence patient survival. This study aimed to evaluate both the overall predictive accuracy of such scoring systems and the predictive accuracy based on the primary tumor. METHODS A retrospective review on spinal metastasis patients who were aged more than 18 years and underwent surgical treatment was conducted between October 2008 and August 2018. Patients were scored based on data before the time of surgery. A survival probability was calculated for each patient using the given scoring systems. The predictive ability of each scoring system was assessed using receiver operating characteristic analysis at postoperative time points; area under the curve was then calculated to quantify predictive accuracy. RESULTS A total of 186 patients were included in this analysis: 101 (54.3%) were men and the mean age was 57.1 years. Primary tumors were lung in 37 (20%), breast in 26 (14%), prostate in 20 (10.8%), hematologic malignancy in 18 (9.7%), thyroid in 10 (5.4%), gastrointestinal tumor in 25 (13.4%), and others in 40 (21.5%). The primary tumor was unidentified in 10 patients (5.3%). The overall survival was 201 days. For survival prediction, the Skeletal Oncology Research Group (SORG) nomogram showed the highest performance when compared to other prognosis scores in all tumor metastasis but a lower performance to predict survival with lung cancer. The revised Katagiri score demonstrated acceptable performance to predict death for breast cancer metastasis. The Tomita and revised Tokuhashi scores revealed acceptable performance in lung cancer metastasis. The New England Spinal Metastasis Score showed acceptable performance for predicting death in prostate cancer metastasis. SORG nomogram demonstrated acceptable performance for predicting death in hematologic malignancy metastasis at all time points. CONCLUSIONS The results of this study demonstrated inconsistent predictive performance among the prediction models for the specific primary tumor types. The SORG nomogram revealed the highest predictive performance when compared to previous survival prediction models.
Collapse
Affiliation(s)
- Pongsthorn Chanplakorn
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| | - Chanthong Budsayavilaimas
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
- Orthopedic Unit, Banphaeo General Hospital, Samutsakhon, Thailand
| | - Pilan Jaipanya
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
- Orthopedic Unit, Chakri Naruebodindra Medical Institute, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Samut Prakan, Thailand
| | - Chaiwat Kraiwattanapong
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| | - Gun Keorochana
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| | - Pittavat Leelapattana
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| | - Thamrong Lertudomphonwanit
- Department of Orthopedic, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
| |
Collapse
|
43
|
van de Kuit A, Oosterhoff JHF, Dijkstra H, Sprague S, Bzovsky S, Bhandari M, Swiontkowski M, Schemitsch EH, IJpma FFA, Poolman RW, Doornberg JN, Hendrickx LAM. Patients With Femoral Neck Fractures Are at Risk for Conversion to Arthroplasty After Internal Fixation: A Machine-learning Algorithm. Clin Orthop Relat Res 2022; 480:2350-2360. [PMID: 35767811 PMCID: PMC9653184 DOI: 10.1097/corr.0000000000002283] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/01/2022] [Accepted: 05/31/2022] [Indexed: 01/31/2023]
Abstract
BACKGROUND Femoral neck fractures are common and are frequently treated with internal fixation. A major disadvantage of internal fixation is the substantially high number of conversions to arthroplasty because of nonunion, malunion, avascular necrosis, or implant failure. A clinical prediction model identifying patients at high risk of conversion to arthroplasty may help clinicians in selecting patients who could have benefited from arthroplasty initially. QUESTION/PURPOSE What is the predictive performance of a machine-learning (ML) algorithm to predict conversion to arthroplasty within 24 months after internal fixation in patients with femoral neck fractures? METHODS We included 875 patients from the Fixation using Alternative Implants for the Treatment of Hip fractures (FAITH) trial. The FAITH trial consisted of patients with low-energy femoral neck fractures who were randomly assigned to receive a sliding hip screw or cancellous screws for internal fixation. Of these patients, 18% (155 of 875) underwent conversion to THA or hemiarthroplasty within the first 24 months. All patients were randomly divided into a training set (80%) and test set (20%). First, we identified 27 potential patient and fracture characteristics that may have been associated with our primary outcome, based on biomechanical rationale and previous studies. Then, random forest algorithms (an ML learning, decision tree-based algorithm that selects variables) identified 10 predictors of conversion: BMI, cardiac disease, Garden classification, use of cardiac medication, use of pulmonary medication, age, lung disease, osteoarthritis, sex, and the level of the fracture line. Based on these variables, five different ML algorithms were trained to identify patterns related to conversion. The predictive performance of these trained ML algorithms was assessed on the training and test sets based on the following performance measures: (1) discrimination (the model's ability to distinguish patients who had conversion from those who did not; expressed with the area under the receiver operating characteristic curve [AUC]), (2) calibration (the plotted estimated versus the observed probabilities; expressed with the calibration curve intercept and slope), and (3) the overall model performance (Brier score: a composite of discrimination and calibration). RESULTS None of the five ML algorithms performed well in predicting conversion to arthroplasty in the training set and the test set; AUCs of the algorithms in the training set ranged from 0.57 to 0.64, slopes of calibration plots ranged from 0.53 to 0.82, calibration intercepts ranged from -0.04 to 0.05, and Brier scores ranged from 0.14 to 0.15. The algorithms were further evaluated in the test set; AUCs ranged from 0.49 to 0.73, calibration slopes ranged from 0.17 to 1.29, calibration intercepts ranged from -1.28 to 0.34, and Brier scores ranged from 0.13 to 0.15. CONCLUSION The predictive performance of the trained algorithms was poor, despite the use of one of the best datasets available worldwide on this subject. If the current dataset consisted of different variables or more patients, the performance may have been better. Also, various reasons for conversion to arthroplasty were pooled in this study, but the separate prediction of underlying pathology (such as, avascular necrosis or nonunion) may be more precise. Finally, it may be possible that it is inherently difficult to predict conversion to arthroplasty based on preoperative variables alone. Therefore, future studies should aim to include more variables and to differentiate between the various reasons for arthroplasty. LEVEL OF EVIDENCE Level III, prognostic study.
Collapse
Affiliation(s)
- Anouk van de Kuit
- Department of Orthopaedic Surgery, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Jacobien H. F. Oosterhoff
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Department of Orthopaedic Surgery, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Hidde Dijkstra
- Department of Trauma Surgery, University Medical Centre Groningen, University of Groningen, Groningen, the Netherlands
| | - Sheila Sprague
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
- Division of Orthopaedic Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Sofia Bzovsky
- Division of Orthopaedic Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Mohit Bhandari
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada
- Division of Orthopaedic Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Marc Swiontkowski
- Department of Orthopaedic Surgery, University of Minnesota, Minneapolis, MN, USA
| | | | - Frank F. A. IJpma
- Department of Trauma Surgery, University Medical Centre Groningen, University of Groningen, Groningen, the Netherlands
| | - Rudolf W. Poolman
- Department of Orthopaedic Surgery, University Medical Center Leiden, Leiden University, Leiden, the Netherlands
| | - Job N. Doornberg
- Department of Orthopaedic Surgery, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Department of Trauma Surgery, University Medical Centre Groningen, University of Groningen, Groningen, the Netherlands
- Department of Orthopaedic and Trauma Surgery, Flinders Medical Centre, Flinders University, Adelaide, Australia
| | | |
Collapse
|
44
|
Karhade AV, Fenn B, Groot OQ, Shah AA, Yen HK, Bilsky MH, Hu MH, Laufer I, Park DY, Sciubba DM, Steyerberg EW, Tobert DG, Bono CM, Harris MB, Schwab JH. Development and external validation of predictive algorithms for six-week mortality in spinal metastasis using 4,304 patients from five institutions. Spine J 2022; 22:2033-2041. [PMID: 35843533 DOI: 10.1016/j.spinee.2022.07.089] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 06/06/2022] [Accepted: 07/11/2022] [Indexed: 02/03/2023]
Abstract
BACKGROUND CONTEXT Historically, spine surgeons used expected postoperative survival of 3-months to help select candidates for operative intervention in spinal metastasis. However, this cutoff has been challenged by the development of minimally invasive techniques, novel biologics, and advanced radiotherapy. Recent studies have suggested that a life expectancy of 6 weeks may be enough to achieve significant improvements in postoperative health-related quality of life. PURPOSE The purpose of this study was to develop a model capable of predicting 6-week mortality in patients with spinal metastases treated with radiation or surgery. STUDY DESIGN/SETTING A retrospective review was conducted at five large tertiary centers in the United States and Taiwan. PATIENT SAMPLE The development cohort consisted of 3,001 patients undergoing radiotherapy and/or surgery for spinal metastases from one institution. The validation institutional cohort consisted of 1,303 patients from four independent, external institutions. OUTCOME MEASURES The primary outcome was 6-week mortality. METHODS Five models were considered to predict 6-week mortality, and the model with the best performance across discrimination, calibration, decision-curve analysis, and overall performance was integrated into an open access web-based application. RESULTS The most important variables for prediction of 6-week mortality were albumin, primary tumor histology, absolute lymphocyte, three or more spine metastasis, and ECOG score. The elastic-net penalized logistic model was chosen as the best performing model with AUC 0.84 on evaluation in the independent testing set. On external validation in the 1,303 patients from the four independent institutions, the model retained good discriminative ability with an area under the curve of 0.81. The model is available here: https://sorg-apps.shinyapps.io/spinemetssurvival/. CONCLUSIONS While this study does not advocate for the use of a 6-week life expectancy as criteria for considering operative management, the algorithm developed and externally validated in this study may be helpful for preoperative planning, multidisciplinary management, and shared decision-making in spinal metastasis patients with shorter life expectancy.
Collapse
Affiliation(s)
- Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA.
| | - Brian Fenn
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA; Tufts University School of Medicine, Boston, MA, USA
| | - Olivier Q Groot
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA
| | - Akash A Shah
- Department of Orthopaedic Surgery, University of California Los Angeles, Los Angeles, CA, USA
| | - Hung-Kuan Yen
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taiwan
| | - Mark H Bilsky
- Department of Neurosurgery, Memorial Sloan Kettering Cancer Center, New York City, NY, USA
| | - Ming-Hsiao Hu
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taiwan
| | - Ilya Laufer
- Department of Neurosurgery, Memorial Sloan Kettering Cancer Center, New York City, NY, USA
| | - Don Y Park
- Department of Orthopaedic Surgery, University of California Los Angeles, Los Angeles, CA, USA
| | - Daniel M Sciubba
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Ewout W Steyerberg
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, Netherlands
| | - Daniel G Tobert
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA
| | - Christopher M Bono
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA
| | - Mitchel B Harris
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St, Boston, MA, USA
| |
Collapse
|
45
|
Li Z, Huang L, Guo B, Zhang P, Wang J, Wang X, Yao W. The predictive ability of routinely collected laboratory markers for surgically treated spinal metastases: a retrospective single institution study. BMC Cancer 2022; 22:1231. [PMID: 36447178 PMCID: PMC9706860 DOI: 10.1186/s12885-022-10334-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 11/18/2022] [Indexed: 11/30/2022] Open
Abstract
PURPOSE We aimed to identify effective routinely collected laboratory biomarkers for predicting postoperative outcomes in surgically treated spinal metastases and attempted to establish an effective prediction model. METHODS This study included 268 patients with spinal metastases surgically treated at a single institution. We evaluated patient laboratory biomarkers to determine trends to predict survival. The markers included white blood cell (WBC) count, platelet count, neutrophil count, lymphocyte count, hemoglobin, albumin, alkaline phosphatase, creatinine, total bilirubin, calcium, international normalized ratio (INR), platelet-to-lymphocyte ratio (PLR), and neutrophil-to-lymphocyte ratio (NLR). A nomogram based on laboratory markers was established to predict postoperative 90-day and 1-year survival. The discrimination and calibration were validated using concordance index (C-index), area under curves (AUC) from receiver operating characteristic curves, and calibration curves. Another 47 patients were used as a validation group to test the accuracy of the nomogram. The prediction accuracy of the nomogram was compared to Tomita, revised Tokuhashi, modified Bauer, and Skeletal Oncology Research Group machine-learning (SORG ML). RESULTS WBC, lymphocyte count, albumin, and creatinine were shown to be the independent prognostic factors. The four predictive laboratory markers and primary tumor, were incorporated into the nomogram to predict the 90-day and 1-year survival probability. The nomogram performed good with a C-index of 0.706 (0.702-0.710). For predicting 90-day survival, the AUC in the training group and the validation group was 0.740 (0.660-0.819) and 0.795 (0.568-1.000), respectively. For predicting 1-year survival, the AUC in the training group and the validation group was 0.765 (0.709-0.822) and 0.712 (0.547-0.877), respectively. Our nomogram seems to have better predictive accuracy than Tomita, revised Tokuhashi, and modified Bauer, alongside comparable prediction ability to SORG ML. CONCLUSIONS Our study confirmed that routinely collected laboratory markers are closely associated with the prognosis of spinal metastases. A nomogram based on primary tumor, WBC, lymphocyte count, albumin, and creatinine, could accurately predict postoperative survival for patients with spinal metastases.
Collapse
Affiliation(s)
- Zhehuang Li
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| | - Lingling Huang
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| | - Bairu Guo
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| | - Peng Zhang
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| | - Jiaqiang Wang
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| | - Xin Wang
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| | - Weitao Yao
- grid.414008.90000 0004 1799 4638Department of Musculoskeletal Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou, 45000 Henan China
| |
Collapse
|
46
|
Oosterhoff JHF, Oberai T, Karhade AV, Doornberg JN, Kerkhoffs GM, Jaarsma RL, Schwab JH, Heng M. Does the SORG Orthopaedic Research Group Hip Fracture Delirium Algorithm Perform Well on an Independent Intercontinental Cohort of Patients With Hip Fractures Who Are 60 Years or Older? Clin Orthop Relat Res 2022; 480:2205-2213. [PMID: 35561268 PMCID: PMC10476833 DOI: 10.1097/corr.0000000000002246] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 04/22/2022] [Indexed: 01/31/2023]
Abstract
BACKGROUND Postoperative delirium in patients aged 60 years or older with hip fractures adversely affects clinical and functional outcomes. The economic cost of delirium is estimated to be as high as USD 25,000 per patient, with a total budgetary impact between USD 6.6 to USD 82.4 billion annually in the United States alone. Forty percent of delirium episodes are preventable, and accurate risk stratification can decrease the incidence and improve clinical outcomes in patients. A previously developed clinical prediction model (the SORG Orthopaedic Research Group hip fracture delirium machine-learning algorithm) is highly accurate on internal validation (in 28,207 patients with hip fractures aged 60 years or older in a US cohort) in identifying at-risk patients, and it can facilitate the best use of preventive interventions; however, it has not been tested in an independent population. For an algorithm to be useful in real life, it must be valid externally, meaning that it must perform well in a patient cohort different from the cohort used to "train" it. With many promising machine-learning prediction models and many promising delirium models, only few have also been externally validated, and even fewer are international validation studies. QUESTION/PURPOSE Does the SORG hip fracture delirium algorithm, initially trained on a database from the United States, perform well on external validation in patients aged 60 years or older in Australia and New Zealand? METHODS We previously developed a model in 2021 for assessing risk of delirium in hip fracture patients using records of 28,207 patients obtained from the American College of Surgeons National Surgical Quality Improvement Program. Variables included in the original model included age, American Society of Anesthesiologists (ASA) class, functional status (independent or partially or totally dependent for any activities of daily living), preoperative dementia, preoperative delirium, and preoperative need for a mobility aid. To assess whether this model could be applied elsewhere, we used records from an international hip fracture registry. Between June 2017 and December 2018, 6672 patients older than 60 years of age in Australia and New Zealand were treated surgically for a femoral neck, intertrochanteric hip, or subtrochanteric hip fracture and entered into the Australian & New Zealand Hip Fracture Registry. Patients were excluded if they had a pathological hip fracture or septic shock. Of all patients, 6% (402 of 6672) did not meet the inclusion criteria, leaving 94% (6270 of 6672) of patients available for inclusion in this retrospective analysis. Seventy-one percent (4249 of 5986) of patients were aged 80 years or older, after accounting for 5% (284 of 6270) of missing values; 68% (4292 of 6266) were female, after accounting for 0.06% (4 of 6270) of missing values, and 83% (4690 of 5661) of patients were classified as ASA III/IV, after accounting for 10% (609 of 6270) of missing values. Missing data were imputed using the missForest methodology. In total, 39% (2467 of 6270) of patients developed postoperative delirium. The performance of the SORG hip fracture delirium algorithm on the validation cohort was assessed by discrimination, calibration, Brier score, and a decision curve analysis. Discrimination, known as the area under the receiver operating characteristic curves (c-statistic), measures the model's ability to distinguish patients who achieved the outcomes from those who did not and ranges from 0.5 to 1.0, with 1.0 indicating the highest discrimination score and 0.50 the lowest. Calibration plots the predicted versus the observed probabilities, a perfect plot has an intercept of 0 and a slope of 1. The Brier score calculates a composite of discrimination and calibration, with 0 indicating perfect prediction and 1 the poorest. RESULTS The SORG hip fracture algorithm, when applied to an external patient cohort, distinguished between patients at low risk and patients at moderate to high risk of developing postoperative delirium. The SORG hip fracture algorithm performed with a c-statistic of 0.74 (95% confidence interval 0.73 to 0.76). The calibration plot showed high accuracy in the lower predicted probabilities (intercept -0.28, slope 0.52) and a Brier score of 0.22 (the null model Brier score was 0.24). The decision curve analysis showed that the model can be beneficial compared with no model or compared with characterizing all patients as at risk for developing delirium. CONCLUSION Algorithms developed with machine learning are a potential tool for refining treatment of at-risk patients. If high-risk patients can be reliably identified, resources can be appropriately directed toward their care. Although the current iteration of SORG should not be relied on for patient care, it suggests potential utility in assessing risk. Further assessment in different populations, made easier by international collaborations and standardization of registries, would be useful in the development of universally valid prediction models. The model can be freely accessed at: https://sorg-apps.shinyapps.io/hipfxdelirium/ . LEVEL OF EVIDENCE Level III, therapeutic study.
Collapse
Affiliation(s)
- Jacobien H. F. Oosterhoff
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Amsterdam University Medical Centers, University of Amsterdam, Department of Orthopaedic Surgery, Amsterdam Movement Sciences, the Netherlands
- Department of Orthopaedic and Trauma Surgery, Flinders Medical Centre, Flinders University, Adelaide, SA, Australia
| | - Tarandeep Oberai
- Department of Orthopaedic and Trauma Surgery, Flinders Medical Centre, Flinders University, Adelaide, SA, Australia
| | - Aditya V. Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Job N. Doornberg
- Department of Orthopaedic Surgery, University Medical Centre Groningen, University of Groningen, the Netherlands
| | - Gino M.M.J. Kerkhoffs
- Amsterdam University Medical Centers, University of Amsterdam, Department of Orthopaedic Surgery, Amsterdam Movement Sciences, the Netherlands
| | - Ruurd L. Jaarsma
- Department of Orthopaedic and Trauma Surgery, Flinders Medical Centre, Flinders University, Adelaide, SA, Australia
| | - Joseph H. Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Marilyn Heng
- Harvard Medical School Orthopedic Trauma Initiative, Massachusetts General Hospital, Boston, MA, USA
| |
Collapse
|
47
|
Shah AA, Devana SK, Lee C, Bugarin A, Hong MK, Upfill-Brown A, Blumstein G, Lord EL, Shamie AN, van der Schaar M, SooHoo NF, Park DY. A Risk Calculator for the Prediction of C5 Nerve Root Palsy After Instrumented Cervical Fusion. World Neurosurg 2022; 166:e703-e710. [PMID: 35872129 PMCID: PMC10410645 DOI: 10.1016/j.wneu.2022.07.082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 07/17/2022] [Indexed: 12/15/2022]
Abstract
BACKGROUND C5 palsy is a common postoperative complication after cervical fusion and is associated with increased health care costs and diminished quality of life. Accurate prediction of C5 palsy may allow for appropriate preoperative counseling and risk stratification. We primarily aim to develop an algorithm for the prediction of C5 palsy after instrumented cervical fusion and identify novel features for risk prediction. Additionally, we aim to build a risk calculator to provide the risk of C5 palsy. METHODS We identified adult patients who underwent instrumented cervical fusion at a tertiary care medical center between 2013 and 2020. The primary outcome was postoperative C5 palsy. We developed ensemble machine learning, standard machine learning, and logistic regression models predicting the risk of C5 palsy-assessing discrimination and calibration. Additionally, a web-based risk calculator was built with the best-performing model. RESULTS A total of 1024 patients were included, with 52 cases of C5 palsy. The ensemble model was well-calibrated and demonstrated excellent discrimination with an area under the receiver-operating characteristic curve of 0.773. The following features were the most important for ensemble model performance: diabetes mellitus, bipolar disorder, C5 or C4 level, surgical approach, preoperative non-motor neurologic symptoms, degenerative disease, number of fused levels, and age. CONCLUSIONS We report a risk calculator that generates patient-specific C5 palsy risk after instrumented cervical fusion. Individualized risk prediction for patients may facilitate improved preoperative patient counseling and risk stratification as well as potential intraoperative mitigating measures. This tool may also aid in addressing potentially modifiable risk factors such as diabetes and obesity.
Collapse
Affiliation(s)
- Akash A Shah
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA.
| | - Sai K Devana
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Changhee Lee
- Department of Artificial Intelligence, Chung-Ang University, Seoul, South Korea
| | - Amador Bugarin
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Michelle K Hong
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Alexander Upfill-Brown
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Gideon Blumstein
- Department of Orthopaedic Surgery, Rush University Medical Center, Chicago, Illinois, USA
| | - Elizabeth L Lord
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Arya N Shamie
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Mihaela van der Schaar
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, United Kingdom; Department of Electrical & Computer Engineering, UCLA, Los Angeles, California, USA
| | - Nelson F SooHoo
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Don Y Park
- Department of Orthopaedic Surgery, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| |
Collapse
|
48
|
Cui Y, Zhu J, Duan Z, Liao Z, Wang S, Liu W. Artificial Intelligence in Spinal Imaging: Current Status and Future Directions. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:11708. [PMID: 36141981 PMCID: PMC9517575 DOI: 10.3390/ijerph191811708] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 09/14/2022] [Accepted: 09/15/2022] [Indexed: 06/16/2023]
Abstract
Spinal maladies are among the most common causes of pain and disability worldwide. Imaging represents an important diagnostic procedure in spinal care. Imaging investigations can provide information and insights that are not visible through ordinary visual inspection. Multiscale in vivo interrogation has the potential to improve the assessment and monitoring of pathologies thanks to the convergence of imaging, artificial intelligence (AI), and radiomic techniques. AI is revolutionizing computer vision, autonomous driving, natural language processing, and speech recognition. These revolutionary technologies are already impacting radiology, diagnostics, and other fields, where automated solutions can increase precision and reproducibility. In the first section of this narrative review, we provide a brief explanation of the many approaches currently being developed, with a particular emphasis on those employed in spinal imaging studies. The previously documented uses of AI for challenges involving spinal imaging, including imaging appropriateness and protocoling, image acquisition and reconstruction, image presentation, image interpretation, and quantitative image analysis, are then detailed. Finally, the future applications of AI to imaging of the spine are discussed. AI has the potential to significantly affect every step in spinal imaging. AI can make images of the spine more useful to patients and doctors by improving image quality, imaging efficiency, and diagnostic accuracy.
Collapse
Affiliation(s)
- Yangyang Cui
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Jia Zhu
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Zhili Duan
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Zhenhua Liao
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Song Wang
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| | - Weiqiang Liu
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
- Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
- Biomechanics and Biotechnology Lab, Research Institute of Tsinghua University in Shenzhen, Shenzhen 518057, China
| |
Collapse
|
49
|
van Spanning SH, Verweij LPE, Allaart LJH, Hendrickx LAM, Doornberg JN, Athwal GS, Lafosse T, Lafosse L, van den Bekerom MPJ, Buijze GA. Development and training of a machine learning algorithm to identify patients at risk for recurrence following an arthroscopic Bankart repair (CLEARER): protocol for a retrospective, multicentre, cohort study. BMJ Open 2022; 12:e055346. [PMID: 36508223 PMCID: PMC9462090 DOI: 10.1136/bmjopen-2021-055346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
INTRODUCTION Shoulder instability is a common injury, with a reported incidence of 23.9 per 100 000 person-years. There is still an ongoing debate on the most effective treatment strategy. Non-operative treatment has recurrence rates of up to 60%, whereas operative treatments such as the Bankart repair and bone block procedures show lower recurrence rates (16% and 2%, respectively) but higher complication rates (<2% and up to 30%, respectively). Methods to determine risk of recurrence have been developed; however, patient-specific decision-making tools are still lacking. Artificial intelligence and machine learning algorithms use self-learning complex models that can be used to make patient-specific decision-making tools. The aim of the current study is to develop and train a machine learning algorithm to create a prediction model to be used in clinical practice-as an online prediction tool-to estimate recurrence rates following a Bankart repair. METHODS AND ANALYSIS This is a multicentre retrospective cohort study. Patients with traumatic anterior shoulder dislocations that were treated with an arthroscopic Bankart repair without remplissage will be included. This study includes two parts. Part 1, collecting all potential factors influencing the recurrence rate following an arthroscopic Bankart repair in patients using multicentre data, aiming to include data from >1000 patients worldwide. Part 2, the multicentre data will be re-evaluated (and where applicable complemented) using machine learning algorithms to predict outcomes. Recurrence will be the primary outcome measure. ETHICS AND DISSEMINATION For safe multicentre data exchange and analysis, our Machine Learning Consortium adhered to the WHO regulation 'Policy on Use and Sharing of Data Collected by WHO in Member States Outside the Context of Public Health Emergencies'. The study results will be disseminated through publication in a peer-reviewed journal. No Institutional Review Board is required for this study.
Collapse
Affiliation(s)
- Sanne H van Spanning
- Orthopaedic Surgery, OLVG, Amsterdam, Noord-Holland, The Netherlands
- Hand, Upper Limb, Peripheral Nerve, Brachial Plexus and Microsurgery Unit, Alps Surgery Institute, Annecy, France
- Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Lukas P E Verweij
- Orthopedic Surgery, Amsterdam Movement Sciences, Amsterdam UMC Locatie AMC, Amsterdam, North Holland, The Netherlands
- Academic Center for Evidence-based Sports Medicine (ACES), Amsterdam UMC Locatie AMC, Amsterdam, North Holland, The Netherlands
- Amsterdam Collaboration for Health and Safety in Sports (ACHSS), International Olympic Committee (IOC) Research Centre, Amsterdam UMC, Amsterdam, Netherlands
| | - Laurens J H Allaart
- Hand, Upper Limb, Peripheral Nerve, Brachial Plexus and Microsurgery Unit, Alps Surgery Institute, Annecy, France
- Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Laurent A M Hendrickx
- Orthopedic Surgery, Amsterdam Movement Sciences, Amsterdam UMC Locatie AMC, Amsterdam, North Holland, The Netherlands
- Academic Center for Evidence-based Sports Medicine (ACES), Amsterdam UMC Locatie AMC, Amsterdam, North Holland, The Netherlands
- Department of Orthopaedic & Trauma Surgery, Flinders Medical Centre, Flinders University, Adelaide, South Australia, Australia
| | - Job N Doornberg
- Department of Orthopaedic & Trauma Surgery, Flinders Medical Centre, Flinders University, Adelaide, South Australia, Australia
| | - George S Athwal
- Roth McFarlane Hand and Upper Limb Center, Schulich School of Medicine and Dentistry, London, Ontario, Canada
| | - Thibault Lafosse
- Hand, Upper Limb, Peripheral Nerve, Brachial Plexus and Microsurgery Unit, Alps Surgery Institute, Annecy, France
| | - Laurent Lafosse
- Hand, Upper Limb, Peripheral Nerve, Brachial Plexus and Microsurgery Unit, Alps Surgery Institute, Annecy, France
| | - Michel P J van den Bekerom
- Orthopaedic Surgery, OLVG, Amsterdam, Noord-Holland, The Netherlands
- Department of Human Movement Sciences, Faculty of Behavioural and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Geert Alexander Buijze
- Hand, Upper Limb, Peripheral Nerve, Brachial Plexus and Microsurgery Unit, Alps Surgery Institute, Annecy, France
- Orthopedic Surgery, Amsterdam Movement Sciences, Amsterdam UMC Locatie AMC, Amsterdam, North Holland, The Netherlands
- Department of Orthopaedic Surgery, Montpellier University Medical Center, Montpellier, Languedoc-Roussillon, France
| |
Collapse
|
50
|
Yen HK, Hu MH, Zijlstra H, Groot OQ, Hsieh HC, Yang JJ, Karhade AV, Chen PC, Chen YH, Huang PH, Chen YH, Xiao FR, Verlaan JJ, Schwab JH, Yang RS, Yang SH, Lin WH, Hsu FM. Prognostic significance of lab data and performance comparison by validating survival prediction models for patients with spinal metastases after radiotherapy. Radiother Oncol 2022; 175:159-166. [PMID: 36067909 DOI: 10.1016/j.radonc.2022.08.029] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Revised: 07/14/2022] [Accepted: 08/28/2022] [Indexed: 12/17/2022]
Abstract
BACKGROUND AND PURPOSE Well-performing survival prediction models (SPMs) help patients and healthcare professionals to choose treatment aligning with prognosis. This retrospective study aims to investigate the prognostic impacts of laboratory data and to compare the performances of Metastases location, Elderly, Tumor primary, Sex, Sickness/comorbidity, and Site of radiotherapy (METSSS) model, New England Spinal Metastasis Score (NESMS), and Skeletal Oncology Research Group machine learning algorithm (SORG-MLA) for spinal metastases (SM). MATERIALS AND METHODS From 2010 to 2018, patients who received radiotherapy (RT) for SM at a tertiary center were enrolled and the data were retrospectively collected. Multivariate logistic and Cox-proportional-hazard regression analyses were used to assess the association between laboratory values and survival. The area under receiver-operating characteristics curve (AUROC), calibration analysis, Brier score, and decision curve analysis were used to evaluate the performance of SPMs. RESULTS A total of 2786 patients were included for analysis. The 90-day and 1-year survival rates after RT were 70.4% and 35.7%, respectively. Higher albumin, hemoglobin, or lymphocyte count were associated with better survival, while higher alkaline phosphatase, white blood cell count, neutrophil count, neutrophil-to-lymphocyte ratio, platelet-to-lymphocyte ratio, or international normalized ratio were associated with poor prognosis. SORG-MLA has the best discrimination (AUROC 90-day, 0.78; 1-year 0.76), best calibrations, and the lowest Brier score (90-day 0.16; 1-year 0.18). The decision curve of SORG-MLA is above the other two competing models with threshold probabilities from 0.1 to 0.8. CONCLUSION Laboratory data are of prognostic significance in survival prediction after RT for SM. Machine learning-based model SORG-MLA outperforms statistical regression-based model METSSS model and NESMS in survival predictions.
Collapse
Affiliation(s)
- Hung-Kuan Yen
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan; Department of Orthopaedic Surgery, National Taiwan University Hospital, Hsin-Chu Branch, Hsinchu, Taiwan; Department of Medical Education, National Taiwan University Hospital, Hsin-Chu Branch, Hsinchu, Taiwan
| | - Ming-Hsiao Hu
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Hester Zijlstra
- Department of Orthopaedics, University Medical Center Utrecht, Utrecht, Netherlands; Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, United States
| | - Olivier Q Groot
- Department of Orthopaedics, University Medical Center Utrecht, Utrecht, Netherlands; Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, United States
| | - Hsiang-Chieh Hsieh
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Hsin-Chu Branch, Hsinchu, Taiwan
| | - Jiun-Jen Yang
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Aditya V Karhade
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, United States
| | - Po-Chao Chen
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Yu-Han Chen
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Po-Hao Huang
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Yu-Hung Chen
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Fu-Ren Xiao
- Division of Neurosurgery, Department of Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Jorrit-Jan Verlaan
- Department of Orthopaedics, University Medical Center Utrecht, Utrecht, Netherlands
| | - Joseph H Schwab
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, MA, United States
| | - Rong-Sen Yang
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Shu-Hua Yang
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan
| | - Wei-Hsin Lin
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei, Taiwan.
| | - Feng-Ming Hsu
- Division of Radiation Oncology, Department of Oncology, National Taiwan University Hospital, Taipei, Taiwan; Graduate Institute of Oncology, National Taiwan University College of Medicine, Taipei, Taiwan; Department of Radiation Oncology, National Taiwan University Cancer Center, Taipei, Taiwan.
| |
Collapse
|