Cost-Effectiveness for Surgical Treatment of Degenerative Spondylolisthesis

ChatGPT versus NASS clinical guidelines for degenerative spondylolisthesis: a comparative analysis

BACKGROUND CONTEXT

Clinical guidelines, developed in concordance with the literature, are often used to guide surgeons' clinical decision making. Recent advancements of large language models and artificial intelligence (AI) in the medical field come with exciting potential. OpenAI's generative AI model, known as ChatGPT, can quickly synthesize information and generate responses grounded in medical literature, which may prove to be a useful tool in clinical decision-making for spine care. The current literature has yet to investigate the ability of ChatGPT to assist clinical decision making with regard to degenerative spondylolisthesis.

PURPOSE

The study aimed to compare ChatGPT's concordance with the recommendations set forth by The North American Spine Society (NASS) Clinical Guideline for the Diagnosis and Treatment of Degenerative Spondylolisthesis and assess ChatGPT's accuracy within the context of the most recent literature.

METHODS

ChatGPT-3.5 and 4.0 was prompted with questions from the NASS Clinical Guideline for the Diagnosis and Treatment of Degenerative Spondylolisthesis and graded its recommendations as "concordant" or "nonconcordant" relative to those put forth by NASS. A response was considered "concordant" when ChatGPT generated a recommendation that accurately reproduced all major points made in the NASS recommendation. Any responses with a grading of "nonconcordant" were further stratified into two subcategories: "Insufficient" or "Over-conclusive," to provide further insight into grading rationale. Responses between GPT-3.5 and 4.0 were compared using Chi-squared tests.

RESULTS

ChatGPT-3.5 answered 13 of NASS's 28 total clinical questions in concordance with NASS's guidelines (46.4%). Categorical breakdown is as follows: Definitions and Natural History (1/1, 100%), Diagnosis and Imaging (1/4, 25%), Outcome Measures for Medical Intervention and Surgical Treatment (0/1, 0%), Medical and Interventional Treatment (4/6, 66.7%), Surgical Treatment (7/14, 50%), and Value of Spine Care (0/2, 0%). When NASS indicated there was sufficient evidence to offer a clear recommendation, ChatGPT-3.5 generated a concordant response 66.7% of the time (6/9). However, ChatGPT-3.5's concordance dropped to 36.8% when asked clinical questions that NASS did not provide a clear recommendation on (7/19). A further breakdown of ChatGPT-3.5's nonconcordance with the guidelines revealed that a vast majority of its inaccurate recommendations were due to them being "over-conclusive" (12/15, 80%), rather than "insufficient" (3/15, 20%). ChatGPT-4.0 answered 19 (67.9%) of the 28 total questions in concordance with NASS guidelines (P = 0.177). When NASS indicated there was sufficient evidence to offer a clear recommendation, ChatGPT-4.0 generated a concordant response 66.7% of the time (6/9). ChatGPT-4.0's concordance held up at 68.4% when asked clinical questions that NASS did not provide a clear recommendation on (13/19, P = 0.104).

CONCLUSIONS

This study sheds light on the duality of LLM applications within clinical settings: one of accuracy and utility in some contexts versus inaccuracy and risk in others. ChatGPT was concordant for most clinical questions NASS offered recommendations for. However, for questions NASS did not offer best practices, ChatGPT generated answers that were either too general or inconsistent with the literature, and even fabricated data/citations. Thus, clinicians should exercise extreme caution when attempting to consult ChatGPT for clinical recommendations, taking care to ensure its reliability within the context of recent literature.

Isthmic spondylolisthesis in adults… A review of the current literature

Isthmic spondylolisthesis can be defined as the anterior translation of a vertebral body relative to the one subjacent to it and secondary to an abnormality of the pars interarticularis. Isthmic spondylolisthesis is usually asymptomatic and discovered as an incidental radiographic finding. However, it can be symptomatic due to its biomechanical effects on the adjacent neural structures and patients may present with low back and/or radicular leg pain. Standing plain radiographs can be obtained to confirm the presence or assess the degree of isthmic spondylolisthesis. Computed tomography (CT) clearly shows the pars defect and provides a better assessment of the pathology. Magnetic resonance imaging (MRI) is indicated in patients with neurologic manifestations and can be used to assess the degree of foraminal or central stenosis. Conservative management including oral anti-inflammatory medication, physical therapy, and/or transforaminal epidural corticosteroid injections can be utilized initially. Surgery can be considered in the setting of persistent symptoms unrelieved with conservative management or significant neurologic compromise. Several surgical methods and techniques are available in the management of isthmic spondylolisthesis. There has been a significant national increase in the use of interbody fusion posteriorly for the management of isthmic spondylolisthesis. Reports have suggested that interbody fusion can be a cost-effective technique in selected patients with isthmic spondylolisthesis. Future studies are encouraged to further characterize the specific indications of various surgical modalities in patients with isthmic spondylolisthesis.

Is radiographic lumbar spinal stenosis associated with the quality of life?: The Wakayama Spine Study

Objectives

This prospective study aimed to determine the association between radiographic lumbar spinal stenosis (LSS) and the quality of life (QOL) in the general Japanese population.

Methods

The severity of radiographic LSS was qualitatively graded on axial magnetic resonance images as follows: no stenosis, mild stenosis with ≤1/3 narrowing, moderate stenosis with a narrowing between 1/3 and 2/3, and severe stenosis with > 2/3 narrowing. Patients less than 40 years of age and those who had undergone previous lumbar spine surgery were excluded from the study. The Oswestry Disability Index (ODI), which includes 10 sections, was used to assess the QOL. One-way analysis of variance was performed to determine the statistical relationship between radiographic LSS and ODI. Further, logistic regression analysis adjusted for gender, age, and body mass index was performed to detect the relationship.

Results

Complete data were available for 907 patients (300 men and 607 women; mean age, 67.3±12.4 years). The prevalence of severe, moderate, and non-mild/non-radiographic were 30%, 48%, and 22%, respectively. In addition, the mean values of ODI in each group were 12.9%, 13.1%, and 11.7%, respectively, and there was no statistically significant difference between the three groups in logistic analysis (P = 0.55). In addition, no significant differences in any section of the ODI were observed among the groups. However, severe radiographic LSS was associated with low back pain in the "severe" group as determined by logistic analysis adjusted for gender, age, and body mass index (odds ratio: 1.53, confidence interval: 1.13–2.07) compared with the non-severe group.

Conclusion

In this general population study, severe radiographic LSS was associated with low back pain (LBP), but did not affect ODI.