Reporting trends of p values in the neurosurgical literature

OBJECTIVE

The objective of this study was to evaluate the trends in reporting of p values in the neurosurgical literature from 1990 through 2017.

METHODS

All abstracts from the Journal of Neurology, Neurosurgery, and Psychiatry (JNNP), Journal of Neurosurgery (JNS) collection (including Journal of Neurosurgery: Spine and Journal of Neurosurgery: Pediatrics), Neurosurgery (NS), and Journal of Neurotrauma (JNT) available on PubMed from 1990 through 2017 were retrieved. Automated text mining was performed to extract p values from relevant abstracts. Extracted p values were analyzed for temporal trends and characteristics.

RESULTS

The search yielded 47,889 relevant abstracts. A total of 34,324 p values were detected in 11,171 abstracts. Since 1990 there has been a steady, proportionate increase in the number of abstracts containing p values. There were average absolute year-on-year increases of 1.2% (95% CI 1.1%-1.3%; p < 0.001), 0.93% (95% CI 0.75%-1.1%; p < 0.001), 0.70% (95% CI 0.57%-0.83%; p < 0.001), and 0.35% (95% CI 0.095%-0.60%; p = 0.0091) of abstracts reporting p values in JNNP, JNS, NS, and JNT, respectively. There have also been average year-on-year increases of 0.045 (95% CI 0.031-0.059; p < 0.001), 0.052 (95% CI 0.037-0.066; p < 0.001), 0.042 (95% CI 0.030-0.054; p < 0.001), and 0.041 (95% CI 0.026-0.056; p < 0.001) p values reported per abstract for these respective journals. The distribution of p values showed a positive skew and strong clustering of values at rounded decimals (i.e., 0.01, 0.02, etc.). Between 83.2% and 89.8% of all reported p values were at or below the "significance" threshold of 0.05 (i.e., p ≤ 0.05).

CONCLUSIONS

Trends in reporting of p values and the distribution of p values suggest publication bias remains in the neurosurgical literature.

Long-term outcome in traumatic brain injury patients with midline shift: a secondary analysis of the Phase 3 COBRIT clinical trial

OBJECTIVE

Following traumatic brain injury (TBI), midline shift of the brain at the level of the septum pellucidum is often caused by unilateral space-occupying lesions and is associated with increased intracranial pressure and worsened morbidity and mortality. While outcome has been studied in this population, the recovery trajectory has not been reported in a large cohort of patients with TBI. The authors sought to utilize the Citicoline Brain Injury Treatment (COBRIT) trial to analyze patient recovery over time depending on degree of midline shift at presentation.

METHODS

Patient data from the COBRIT trial were stratified into 4 groups of midline shift, and outcome measures were analyzed at 30, 90, and 180 days postinjury. A recovery trajectory analysis was performed identifying patients with outcome measures at all 3 time points to analyze the degree of recovery based on midline shift at presentation.

RESULTS

There were 892, 1169, and 895 patients with adequate outcome data at 30, 90, and 180 days, respectively. Rates of favorable outcome (Glasgow Outcome Scale-Extended [GOS-E] scores 4-8) at 6 months postinjury were 87% for patients with no midline shift, 79% for patients with 1-5 mm of shift, 64% for patients with 6-10 mm of shift, and 47% for patients with > 10 mm of shift. The mean improvement from unfavorable outcome (GOS-E scores 2 and 3) to favorable outcome (GOS-E scores 4-8) from 1 month to 6 months in all groups was 20% (range 4%-29%). The mean GOS-E score for patients in the 6- to 10-mm group crossed from unfavorable outcome (GOS-E scores 2 and 3) into favorable outcome (GOS-E scores 4-8) at 90 days, and the mean GOS-E of patients in the > 10-mm group nearly reached the threshold of favorable outcome by 180 days postinjury.

CONCLUSIONS

In this secondary analysis of the Phase 3 COBRIT trial, TBI patients with less than 10 mm of midline shift on admission head CT had significantly improved functional outcomes through 180 days after injury compared with those with greater than 10 mm of midline shift. Of note, nearly 50% of patients with > 10 mm of midline shift achieved a favorable outcome (GOS-E score 4-8) by 6 months postinjury.