Artificial intelligence and spine: rise of the machines

Development and External Validation of a Risk Calculator for Prediction of Major Complications and Readmission After Anterior Cervical Discectomy and Fusion

STUDY DESIGN

A retrospective, case-control study.

OBJECTIVE

We aim to build a risk calculator predicting major perioperative complications after anterior cervical fusion. In addition, we aim to externally validate this calculator with an institutional cohort of patients who underwent anterior cervical discectomy and fusion (ACDF).

SUMMARY OF BACKGROUND DATA

The average age and proportion of patients with at least one comorbidity undergoing ACDF have increased in recent years. Given the increased morbidity and cost associated with perioperative complications and unplanned readmission, accurate risk stratification of patients undergoing ACDF is of great clinical utility.

METHODS

This is a retrospective cohort study of adults who underwent anterior cervical fusion at any nonfederal California hospital between 2015 and 2017. The primary outcome was major perioperative complication or 30-day readmission. We built standard and ensemble machine learning models for risk prediction, assessing discrimination, and calibration. The best-performing model was validated on an external cohort comprised of consecutive adult patients who underwent ACDF at our institution between 2013 and 2020.

RESULTS

A total of 23,184 patients were included in this study; there were 1886 cases of major complication or readmissions. The ensemble model was well calibrated and demonstrated an area under the receiver operating characteristic curve of 0.728. The variables most important for the ensemble model include male sex, medical comorbidities, history of complications, and teaching hospital status. The ensemble model was evaluated on the validation cohort (n=260) with an area under the receiver operating characteristic curve of 0.802. The ensemble algorithm was used to build a web-based risk calculator.

CONCLUSION

We report derivation and external validation of an ensemble algorithm for prediction of major perioperative complications and 30-day readmission after anterior cervical fusion. This model has excellent discrimination and is well calibrated when tested on a contemporaneous external cohort of ACDF cases.

External validation of a predictive algorithm for in-hospital and ninety-day mortality after spinal epidural abscess

BACKGROUND CONTEXT

Mortality in patients with spinal epidural abscess (SEA) remains high. Accurate prediction of patient-specific prognosis in SEA can improve patient counseling as well as guide management decisions. There are no externally validated studies predicting short-term mortality in patients with SEA.

PURPOSE

The purpose of this study was to externally validate the Skeletal Oncology Research Group (SORG) stochastic gradient boosting algorithm for prediction of in-hospital and 90-day postdischarge mortality in SEA.

STUDY DESIGN/SETTING

Retrospective, case-control study at a tertiary care academic medical center from 2003 to 2021.

PATIENT SAMPLE

Adult patients admitted for radiologically confirmed diagnosis of SEA who did not initiate treatment at an outside institution.

OUTCOME MEASURES

In-hospital and 90-day postdischarge mortality.

METHODS

We tested the SORG stochastic gradient boosting algorithm on an independent validation cohort. We assessed its performance with discrimination, calibration, decision curve analysis, and overall performance.

RESULTS

A total of 212 patients met inclusion criteria, with a short-term mortality rate of 10.4%. The area under the receiver operating characteristic curve (AUROC) of the SORG algorithm when tested on the full validation cohort was 0.82, the calibration intercept was -0.08, the calibration slope was 0.96, and the Brier score was 0.09.

CONCLUSIONS

With a contemporaneous and geographically distinct independent cohort, we report successful external validation of a machine learning algorithm for prediction of in-hospital and 90-day postdischarge mortality in SEA.