Big Data Defined: A Practical Review for Neurosurgeons

Computer-vision based analysis of the neurosurgical scene - A systematic review

Introduction

With increasing use of robotic surgical adjuncts, artificial intelligence and augmented reality in neurosurgery, the automated analysis of digital images and videos acquired over various procedures becomes a subject of increased interest. While several computer vision (CV) methods have been developed and implemented for analyzing surgical scenes, few studies have been dedicated to neurosurgery.

Research question

In this work, we present a systematic literature review focusing on CV methodologies specifically applied to the analysis of neurosurgical procedures based on intra-operative images and videos. Additionally, we provide recommendations for the future developments of CV models in neurosurgery.

Material and methods

We conducted a systematic literature search in multiple databases until January 17, 2023, including Web of Science, PubMed, IEEE Xplore, Embase, and SpringerLink.

Results

We identified 17 studies employing CV algorithms on neurosurgical videos/images. The most common applications of CV were tool and neuroanatomical structure detection or characterization, and to a lesser extent, surgical workflow analysis. Convolutional neural networks (CNN) were the most frequently utilized architecture for CV models (65%), demonstrating superior performances in tool detection and segmentation. In particular, mask recurrent-CNN manifested most robust performance outcomes across different modalities.

Discussion and conclusion

Our systematic review demonstrates that CV models have been reported that can effectively detect and differentiate tools, surgical phases, neuroanatomical structures, as well as critical events in complex neurosurgical scenes with accuracies above 95%. Automated tool recognition contributes to objective characterization and assessment of surgical performance, with potential applications in neurosurgical training and intra-operative safety management.

Leveraging Artificial Intelligence and Synthetic Data Derivatives for Spine Surgery Research

STUDY DESIGN

Retrospective cohort study.

OBJECTIVES

Leveraging electronic health records (EHRs) for spine surgery research is impeded by concerns regarding patient privacy and data ownership. Synthetic data derivatives may help overcome these limitations. This study's objective was to validate the use of synthetic data for spine surgery research.

METHODS

Data came from the EHR from 15 hospitals. Patients that underwent anterior cervical or posterior lumbar fusion (2010-2020) were included. Real data were obtained from the EHR. Synthetic data was generated to simulate the properties of the real data, without maintaining a one-to-one correspondence with real patients. Within each cohort, ability to predict 30-day readmissions and 30-day complications was evaluated using logistic regression and extreme gradient boosting machines (XGBoost).

RESULTS

We identified 9,072 real and 9,088 synthetic cervical fusion patients. Descriptive characteristics were nearly identical between the 2 datasets. When predicting readmission, models built using real and synthetic data both had c-statistics of .69-.71 using logistic regression and XGBoost. Among 12,111 real and 12,126 synthetic lumbar fusion patients, descriptive characteristics were nearly the same for most variables. Using logistic regression and XGBoost to predict readmission, discrimination was similar with models built using real and synthetic data (c-statistics .66-.69). When predicting complications, models derived using real and synthetic data showed similar discrimination in both cohorts. Despite some differences, the most influential predictors were similar in the real and synthetic datasets.

CONCLUSION

Synthetic data replicate most descriptive and predictive properties of real data, and therefore may expand EHR research in spine surgery.

Methods and Impact for Using Federated Learning to Collaborate on Clinical Research

BACKGROUND

The development of accurate machine learning algorithms requires sufficient quantities of diverse data. This poses a challenge in health care because of the sensitive and siloed nature of biomedical information. Decentralized algorithms through federated learning (FL) avoid data aggregation by instead distributing algorithms to the data before centrally updating one global model.

OBJECTIVE

To establish a multicenter collaboration and assess the feasibility of using FL to train machine learning models for intracranial hemorrhage (ICH) detection without sharing data between sites.

METHODS

Five neurosurgery departments across the United States collaborated to establish a federated network and train a convolutional neural network to detect ICH on computed tomography scans. The global FL model was benchmarked against a standard, centrally trained model using a held-out data set and was compared against locally trained models using site data.

RESULTS

A federated network of practicing neurosurgeon scientists was successfully initiated to train a model for predicting ICH. The FL model achieved an area under the ROC curve of 0.9487 (95% CI 0.9471-0.9503) when predicting all subtypes of ICH compared with a benchmark (non-FL) area under the ROC curve of 0.9753 (95% CI 0.9742-0.9764), although performance varied by subtype. The FL model consistently achieved top three performance when validated on any site's data, suggesting improved generalizability. A qualitative survey described the experience of participants in the federated network.

CONCLUSION

This study demonstrates the feasibility of implementing a federated network for multi-institutional collaboration among clinicians and using FL to conduct machine learning research, thereby opening a new paradigm for neurosurgical collaboration.

Foundations of Machine Learning-Based Clinical Prediction Modeling: Part I-Introduction and General Principles

We provide explanations on the general principles of machine learning, as well as analytical steps required for successful machine learning-based predictive modeling, which is the focus of this series. In particular, we define the terms machine learning, artificial intelligence, as well as supervised and unsupervised learning, continuing by introducing optimization, thus, the minimization of an objective error function as the central dogma of machine learning. In addition, we discuss why it is important to separate predictive and explanatory modeling, and most importantly state that a prediction model should not be used to make inferences. Lastly, we broadly describe a classical workflow for training a machine learning model, starting with data pre-processing and feature engineering and selection, continuing on with a training structure consisting of a resampling method, hyperparameter tuning, and model selection, and ending with evaluation of model discrimination and calibration as well as robust internal or external validation of the fully developed model. Methodological rigor and clarity as well as understanding of the underlying reasoning of the internal workings of a machine learning approach are required, otherwise predictive applications despite being strong analytical tools are not well accepted into the clinical routine.

Machine learning predicts risk of cerebrospinal fluid shunt failure in children: a study from the hydrocephalus clinical research network

PURPOSE

While conventional statistical approaches have been used to identify risk factors for cerebrospinal fluid (CSF) shunt failure, these methods may not fully capture the complex contribution of clinical, radiologic, surgical, and shunt-specific variables influencing this outcome. Using prospectively collected data from the Hydrocephalus Clinical Research Network (HCRN) patient registry, we applied machine learning (ML) approaches to create a predictive model of CSF shunt failure.

METHODS

Pediatric patients (age < 19 years) undergoing first-time CSF shunt placement at six HCRN centers were included. CSF shunt failure was defined as a composite outcome including requirement for shunt revision, endoscopic third ventriculostomy, or shunt infection within 5 years of initial surgery. Performance of conventional statistical and 4 ML models were compared.

RESULTS

Our cohort consisted of 1036 children undergoing CSF shunt placement, of whom 344 (33.2%) experienced shunt failure. Thirty-eight clinical, radiologic, surgical, and shunt-design variables were included in the ML analyses. Of all ML algorithms tested, the artificial neural network (ANN) had the strongest performance with an area under the receiver operator curve (AUC) of 0.71. The ANN had a specificity of 90% and a sensitivity of 68%, meaning that the ANN can effectively rule-in patients most likely to experience CSF shunt failure (i.e., high specificity) and moderately effective as a tool to rule-out patients at high risk of CSF shunt failure (i.e., moderately sensitive). The ANN was independently validated in 155 patients (prospectively collected, retrospectively analyzed).

CONCLUSION

These data suggest that the ANN, or future iterations thereof, can provide an evidence-based tool to assist in prognostication and patient-counseling immediately after CSF shunt placement.

Discrepancies in Stroke Distribution and Dataset Origin in Machine Learning for Stroke

BACKGROUND

Machine learning algorithms depend on accurate and representative datasets for training in order to become valuable clinical tools that are widely generalizable to a varied population. We aim to conduct a review of machine learning uses in stroke literature to assess the geographic distribution of datasets and patient cohorts used to train these models and compare them to stroke distribution to evaluate for disparities.

AIMS

582 studies were identified on initial searching of the PubMed database. Of these studies, 106 full texts were assessed after title and abstract screening which resulted in 489 papers excluded. Of these 106 studies, 79 were excluded due to using cohorts from outside the United States or being review articles or editorials. 27 studies were thus included in this analysis.

SUMMARY OF REVIEW

Of the 27 studies included, 7 (25.9%) used patient data from California, 6 (22.2%) were multicenter, 3 (11.1%) were in Massachusetts, 2 (7.4%) each in Illinois, Missouri, and New York, and 1 (3.7%) each from South Carolina, Washington, West Virginia, and Wisconsin. 1 (3.7%) study used data from Utah and Texas. These were qualitatively compared to a CDC study showing the highest distribution of stroke in Mississippi (4.3%) followed by Oklahoma (3.4%), Washington D.C. (3.4%), Louisiana (3.3%), and Alabama (3.2%) while the prevalence in California was 2.6%.

CONCLUSIONS

It is clear that a strong disconnect exists between the datasets and patient cohorts used in training machine learning algorithms in clinical research and the stroke distribution in which clinical tools using these algorithms will be implemented. In order to ensure a lack of bias and increase generalizability and accuracy in future machine learning studies, datasets using a varied patient population that reflects the unequal distribution of stroke risk factors would greatly benefit the usability of these tools and ensure accuracy on a nationwide scale.

Big data, machine learning, and artificial intelligence: a field guide for neurosurgeons

Big data has transformed into a trend phrase in healthcare and neurosurgery, becoming a pervasive and inescapable phrase in everyday life. The upsurge in big data applications is a direct consequence of the drastic boom in information technology as well as the growing number of internet-connected devices called the Internet of Things in healthcare. Compared with business, marketing, and other sectors, healthcare applications are lagging due to a lack of technical knowledge among healthcare workers, technological limitations in acquiring and analyzing the data, and improper governance of healthcare big data. Despite these limitations, the medical literature is flooded with big data-related articles, and most of these are filled with abstruse terminologies such as machine learning, artificial intelligence, artificial neural network, and algorithm. Many of the recent articles are restricted to neurosurgical registries, creating a false impression that big data is synonymous with registries. Others advocate that the utilization of big data will be the panacea to all healthcare problems and research in the future. Without a proper understanding of these principles, it becomes easy to get lost without the ability to differentiate hype from reality. To that end, the authors give a brief narrative of big data analysis in neurosurgery and review its applications, limitations, and the challenges it presents for neurosurgeons and healthcare professionals naive to this field. Awareness of these basic concepts will allow neurosurgeons to understand the literature regarding big data, enabling them to make better decisions and deliver personalized care.