Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Patients With Chiari Malformation: Diagnosis

Enhancing Diagnostic Support for Chiari Malformation and Syringomyelia: A Comparative Study of Contextualized ChatGPT Models

OBJECTIVES

The rapidly increasing adoption of large language models in medicine has drawn attention to potential applications within the field of neurosurgery. This study evaluates the effects of various contextualization methods on ChatGPT's ability to provide expert-consensus aligned recommendations on the diagnosis and management of Chiari Malformation and Syringomyelia.

METHODS

Native GPT4 and GPT4 models contextualized using various strategies were asked questions revised from the 2022 Chiari and Syringomyelia Consortium International Consensus Document. ChatGPT-provided responses were then compared to consensus statements using reviewer assessments of 1) responding to the prompt, 2) agreement of ChatGPT response with consensus statements, 3) recommendation to consult with a medical professional, and 4) presence of supplementary information. Flesch-Kincaid, SMOG, word count, and Gunning-Fog readability scores were calculated for each model using the quanteda package in R.

RESULTS

Relative to GPT4, all contextualized GPTs demonstrated increased agreement with consensus statements. PDF+Prompting and Prompting models provided the most elevated agreement scores of 19 of 24 and 23 of 24, respectively, versus 9 of 24 for GPT4 (p=.021, p=.001). A trend toward improved readability was observed when comparing contextualized models at large to ChatGPT4, with significant decreases in average word count (180.7 vs 382.3, p<.001) and Flesch-Kincaid Reading Ease score (11.7 vs 17.2, p=.033).

CONCLUSIONS

The enhanced performance observed in response to ChatGPT4 contextualization suggests broader applications of large language models in neurosurgery than what the current literature indicates. This study provides proof of concept for the use of contextualized GPT models in neurosurgical contexts and showcases the easy accessibility of improved model performance.

Craniocervical instability in patients with Ehlers-Danlos syndromes: outcomes analysis following occipito-cervical fusion

Craniocervical instability (CCI) is increasingly recognized in hereditary disorders of connective tissue and in some patients following suboccipital decompression for Chiari malformation (CMI) or low-lying cerebellar tonsils (LLCT). CCI is characterized by severe headache and neck pain, cervical medullary syndrome, lower cranial nerve deficits, myelopathy, and radiological metrics, for which occipital cervical fusion (OCF) has been advocated. We conducted a retrospective analysis of patients with CCI and Ehlers-Danlos syndrome (EDS) to determine whether the surgical outcomes supported the criteria by which patients were selected for OCF. Fifty-three consecutive subjects diagnosed with EDS, who presented with severe head and neck pain, lower cranial nerve deficits, cervical medullary syndrome, myelopathy, and radiologic findings of CCI, underwent open reduction, stabilization, and OCF. Thirty-two of these patients underwent suboccipital decompression for obstruction of cerebral spinal fluid flow. Questionnaire data and clinical findings were abstracted by a research nurse. Follow-up questionnaires were administered at 5-28 months (mean 15.1). The study group demonstrated significant improvement in headache and neck pain (p < 0.001), decreased use of pain medication (p < 0.0001), and improved Karnofsky Performance Status score (p < 0.001). Statistically significant improvement was also demonstrated for nausea, syncope (p < 0.001), speech difficulties, concentration, vertigo, dizziness, numbness, arm weakness, and fatigue (p = 0.001). The mental fatigue score and orthostatic grading score were improved (p < 0.01). There was no difference in pain improvement between patients with CMI/LLCT and those without. This outcomes analysis of patients with disabling CCI in the setting of EDS demonstrated significant benefits of OCF. The results support the reasonableness of the selection criteria for OCF. We advocate for a multi-center, prospective clinical trial of OCF in this population.