Surgical prioritization based on decision model outcomes is not sensitive to differences between the health-related quality of life values estimates of physicians and citizens

PURPOSE

Decision models can be used to support allocation of scarce surgical resources. These models incorporate health-related quality of life (HRQoL) values that can be determined using physician panels. The predominant opinion is that one should use values obtained from citizens. We investigated whether physicians give different HRQoL values to citizens and evaluate whether such differences impact decision model outcomes.

METHODS

A two-round Delphi study was conducted. Citizens estimated HRQoL of pre- and post-operative health states for ten surgeries using a visual analogue scale. These values were compared using Bland-Altman analysis with HRQoL values previously obtained from physicians. Impact on decision model outcomes was evaluated by calculating the correlation between the rankings of surgeries established using the physicians' and the citizens' values.

RESULTS

A total of 71 citizens estimated HRQoL. Citizens' values on the VAS scale were - 0.07 points (95% CI - 0.12 to - 0.01) lower than the physicians' values. The correlation between the rankings of surgeries based on citizens' and physicians' values was 0.96 (p < 0.001).

CONCLUSION

Physicians put higher values on health states than citizens. However, these differences only result in switches between adjacent entries in the ranking. It would seem that HRQoL values obtained from physicians are adequate to inform decision models during crises.

Minimizing population health loss due to scarcity in OR capacity: validation of quality of life input

OBJECTIVES

A previously developed decision model to prioritize surgical procedures in times of scarce surgical capacity used quality of life (QoL) primarily derived from experts in one center. These estimates are key input of the model, and might be more context-dependent than the other input parameters (age, survival). The aim of this study was to validate our model by replicating these QoL estimates.

METHODS

The original study estimated QoL of patients in need of commonly performed procedures in live expert-panel meetings. This study replicated this procedure using a web-based Delphi approach in a different hospital. The new QoL scores were compared with the original scores using mixed effects linear regression. The ranking of surgical procedures based on combined QoL values from the validation and original study was compared to the ranking based solely on the original QoL values.

RESULTS

The overall mean difference in QoL estimates between the validation study and the original study was - 0.11 (95% CI:  -0.12 - -0.10). The model output (DALY/month delay) based on QoL data from both studies was similar to the model output based on the original data only: The Spearman's correlation coefficient between the ranking of all procedures before and after including the new QoL estimates was 0.988.

DISCUSSION

Even though the new QoL estimates were systematically lower than the values from the original study, the ranking for urgency based on health loss per unit of time delay of procedures was consistent. This underscores the robustness and generalizability of the decision model for prioritization of surgical procedures.

Minimising population health loss in times of scarce surgical capacity: a modelling study for surgical procedures performed in nonacademic hospitals

BACKGROUND

The burden of the COVID-19 pandemic resulted in a reduction of available health care capacity for regular care. To guide prioritisation of semielective surgery in times of scarcity, we previously developed a decision model to quantify the expected health loss due to delay of surgery, in an academic hospital setting. The aim of this study is to validate our decision model in a nonacademic setting and include additional elective surgical procedures.

METHODS

In this study, we used the previously published three-state cohort state-transition model, to evaluate the health effects of surgery postponement for 28 surgical procedures commonly performed in nonacademic hospitals. Scientific literature and national registries yielded nearly all input parameters, except for the quality of life (QoL) estimates which were obtained from experts using the Delphi method. Two expert panels, one from a single nonacademic hospital and one from different nonacademic hospitals in the Netherlands, were invited to estimate QoL weights. We compared estimated model results (disability adjusted life years (DALY)/month of surgical delay) based on the QoL estimates from the two panels by calculating the mean difference and the correlation between the ranks of the different surgical procedures. The eventual model was based on the combined QoL estimates from both panels.

RESULTS

Pacemaker implantation was associated with the most DALY/month of surgical delay (0.054 DALY/month, 95% CI: 0.025-0.103) and hemithyreoidectomy with the least DALY/month (0.006 DALY/month, 95% CI: 0.002-0.009). The overall mean difference of QoL estimates between the two panels was 0.005 (95% CI -0.014-0.004). The correlation between ranks was 0.983 (p < 0.001).

CONCLUSIONS

Our study provides an overview of incurred health loss due to surgical delay for surgeries frequently performed in nonacademic hospitals. The quality of life estimates currently used in our model are robust and validate towards a different group of experts. These results enrich our earlier published results on academic surgeries and contribute to prioritising a more complete set of surgeries.

Comparative effectiveness of intracranial hypertension management guided by ventricular versus intraparenchymal pressure monitoring: a CENTER-TBI study

OBJECTIVE

To compare outcomes between patients with primary external ventricular device (EVD)-driven treatment of intracranial hypertension and those with primary intraparenchymal monitor (IP)-driven treatment.

METHODS

The CENTER-TBI study is a prospective, multicenter, longitudinal observational cohort study that enrolled patients of all TBI severities from 62 participating centers (mainly level I trauma centers) across Europe between 2015 and 2017. Functional outcome was assessed at 6 months and a year. We used multivariable adjusted instrumental variable (IV) analysis with "center" as instrument and logistic regression with covariate adjustment to determine the effect estimate of EVD on 6-month functional outcome.

RESULTS

A total of 878 patients of all TBI severities with an indication for intracranial pressure (ICP) monitoring were included in the present study, of whom 739 (84%) patients had an IP monitor and 139 (16%) an EVD. Patients included were predominantly male (74% in the IP monitor and 76% in the EVD group), with a median age of 46 years in the IP group and 48 in the EVD group. Six-month GOS-E was similar between IP and EVD patients (adjusted odds ratio (aOR) and 95% confidence interval [CI] OR 0.74 and 95% CI [0.36-1.52], adjusted IV analysis). The length of intensive care unit stay was greater in the EVD group than in the IP group (adjusted rate ratio [95% CI] 1.70 [1.34-2.12], IV analysis). One hundred eighty-seven of the 739 patients in the IP group (25%) required an EVD due to refractory ICPs.

CONCLUSION

We found no major differences in outcomes of patients with TBI when comparing EVD-guided and IP monitor-guided ICP management. In our cohort, a quarter of patients that initially received an IP monitor required an EVD later for ICP control. The prevalence of complications was higher in the EVD group.

PROTOCOL

The core study is registered with ClinicalTrials.gov , number NCT02210221, and the Resource Identification Portal (RRID: SCR_015582).

How to Study the Brain While Anesthetizing It?! A Scoping Review on Running Neuroanesthesiologic Studies and Trials That Include Neurosurgical Patients

This scoping review addresses the challenges of neuroanesthesiologic research: the population, the methods/treatment/exposure, and the outcome/results. These challenges are put into the context of a future research agenda for peri-/intraoperative anesthetic management, neurocritical care, and applied neurosciences. Finally, the opportunities of adaptive trial design in neuroanesthesiologic research are discussed.

Feasibility of Machine Learning and Logistic Regression Algorithms to Predict Outcome in Orthopaedic Trauma Surgery

BACKGROUND

Statistical models using machine learning (ML) have the potential for more accurate estimates of the probability of binary events than logistic regression. The present study used existing data sets from large musculoskeletal trauma trials to address the following study questions: (1) Do ML models produce better probability estimates than logistic regression models? (2) Are ML models influenced by different variables than logistic regression models?

METHODS

We created ML and logistic regression models that estimated the probability of a specific fracture (posterior malleolar involvement in distal spiral tibial shaft and ankle fractures, scaphoid fracture, and distal radial fracture) or adverse event (subsequent surgery [after distal biceps repair or tibial shaft fracture], surgical site infection, and postoperative delirium) using 9 data sets from published musculoskeletal trauma studies. Each data set was split into training (80%) and test (20%) subsets. Fivefold cross-validation of the training set was used to develop the ML models. The best-performing model was then assessed in the independent testing data. Performance was assessed by (1) discrimination (c-statistic), (2) calibration (slope and intercept), and (3) overall performance (Brier score).

RESULTS

The mean c-statistic was 0.01 higher for the logistic regression models compared with the best ML models for each data set (range, -0.01 to 0.06). There were fewer variables strongly associated with variation in the ML models, and many were dissimilar from those in the logistic regression models.

CONCLUSIONS

The observation that ML models produce probability estimates comparable with logistic regression models for binary events in musculoskeletal trauma suggests that their benefit may be limited in this context.

In-depth assessment of health-related quality of life after in-hospital cardiac arrest

INTRODUCTION

Evidence on physical and psychological well-being of in-hospital cardiac arrest (IHCA) survivors is scarce. The aim of this study is to describe long-term health-related quality of life (HRQoL), functional independence and psychological distress 3 and 12 months post-IHCA.

METHODS

A multicenter prospective cohort study in 25 hospitals between January 2017 - May 2018. Adult IHCA survivors were included. HRQoL (EQ-5D-5L, SF-12), psychological distress (HADS, CSI) and functional independence (mRS) were assessed at 3 and 12 months post-IHCA.

RESULTS

At 3-month follow-up 136 of 212 survivors responded to the questionnaire and at 12 months 110 of 198 responded. The median (IQR) EQ-utility Index score was 0.77 (0.65-0.87) at 3 months and 0.81 (0.70-0.91) at 12 months. At 3 months, patients reported a median SF-12 (IQR) physical component scale (PCS) of 38.9 (32.8-46.5) and mental component scale (MCS) of 43.5 (34.0-39.7) and at 12 months a PCS of 43.1 (34.6-52.3) and MCS 46.9 (38.5-54.5).

DISCUSSION

Using various tools most IHCA survivors report an acceptable HRQoL and a substantial part experiences lower HRQoL compared to population norms. Our data suggest that younger (male) patients and those with poor functional status prior to admission are at highest risk of impaired HRQoL.

Between-centre differences in care for in-hospital cardiac arrest: a prospective cohort study

BACKGROUND

Survival after in-hospital cardiac arrest is poor, but current literature shows substantial heterogeneity in reported survival rates. This study aims to evaluate care for patients suffering in-hospital cardiac arrest (IHCA) in the Netherlands by assessing between-hospital heterogeneity in outcomes and to explain this heterogeneity stemming from differences in case-mix or differences in quality of care.

METHODS

A prospective multicentre study was conducted comprising 14 centres. All IHCA patients were included. The adjusted variation in structure and process indicators of quality of care and outcomes (in-hospital mortality and cerebral performance category [CPC] scale) was assessed with mixed effects regression with centre as random intercept. Variation was quantified using the median odds ratio (MOR), representing the expected odds ratio for poor outcome between two randomly picked centres.

RESULTS

After excluding centres with less than 10 inclusions (2 centres), 701 patients were included of whom, 218 (32%) survived to hospital discharge. The unadjusted and case-mix adjusted MOR for mortality was 1.19 and 1.05, respectively. The unadjusted and adjusted MOR for CPC score was 1.24 and 1.19, respectively. In hospitals where personnel received cardiopulmonary resuscitation (CPR) training twice per year, 183 (64.7%) versus 290 (71.4%) patients died or were in a vegetative state, and 59 (20.8%) versus 68 (16.7%) patients showed full recovery (p < 0.001).

CONCLUSION

In the Netherlands, survival after IHCA is relatively high and between-centre differences in outcomes are small. The existing differences in survival are mainly attributable to differences in case-mix. Variation in neurological outcome is less attributable to case-mix.

Identifying trauma patients with benefit from direct transportation to Level-1 trauma centers

Background

Prehospital triage protocols typically try to select patients with Injury Severity Score (ISS) above 15 for direct transportation to a Level-1 trauma center. However, ISS does not necessarily discriminate between patients who benefit from immediate care at Level-1 trauma centers. The aim of this study was to assess which patients benefit from direct transportation to Level-1 trauma centers.

Methods

We used the American National Trauma Data Bank (NTDB), a retrospective observational cohort. All adult patients (ISS > 3) between 2015 and 2016 were included. Patients who were self-presenting or had isolated limb injury were excluded. We used logistic regression to assess the association of direct transportation to Level-1 trauma centers with in-hospital mortality adjusted for clinically relevant confounders. We used this model to define benefit as predicted probability of mortality associated with transportation to a non-Level-1 trauma center minus predicted probability associated with transportation to a Level-1 trauma center. We used a threshold of 1% as absolute benefit. Potential interaction terms with transportation to Level-1 trauma centers were included in a penalized logistic regression model to study which patients benefit.

Results

We included 388,845 trauma patients from 232 Level-1 centers and 429 Level-2/3 centers. A small beneficial effect was found for direct transportation to Level-1 trauma centers (adjusted Odds Ratio: 0.96, 95% Confidence Interval: 0.92–0.99) which disappeared when comparing Level-1 and 2 versus Level-3 trauma centers. In the risk approach, predicted benefit ranged between 0 and 1%. When allowing for interactions, 7% of the patients (n = 27,753) had more than 1% absolute benefit from direct transportation to Level-1 trauma centers. These patients had higher AIS Head and Thorax scores, lower GCS and lower SBP. A quarter of the patients with ISS > 15 were predicted to benefit from transportation to Level-1 centers (n = 26,522, 22%).

Conclusions

Benefit of transportation to a Level-1 trauma centers is quite heterogeneous across patients and the difference between Level-1 and Level-2 trauma centers is small. In particular, patients with head injury and signs of shock may benefit from care in a Level-1 trauma center. Future prehospital triage models should incorporate more complete risk profiles.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12873-021-00487-3.

Blood biomarkers on admission in acute traumatic brain injury: Relations to severity, CT findings and care path in the CENTER-TBI study

Background

Serum biomarkers may inform and improve care in traumatic brain injury (TBI). We aimed to correlate serum biomarkers with clinical severity, care path and imaging abnormalities in TBI, and explore their incremental value over clinical characteristics in predicting computed tomographic (CT) abnormalities.

Methods

We analyzed six serum biomarkers (S100B, NSE, GFAP, UCH-L1, NFL and t-tau) obtained <24 h post-injury from 2867 patients with any severity of TBI in the Collaborative European NeuroTrauma Effectiveness Research (CENTER-TBI) Core Study, a prospective, multicenter, cohort study. Univariable and multivariable logistic regression analyses were performed. Discrimination was assessed by the area under the receiver operating characteristic curve (AUC) with 95% confidence intervals.

Findings

All biomarkers scaled with clinical severity and care path (ER only, ward admission, or ICU), and with presence of CT abnormalities. GFAP achieved the highest discrimination for predicting CT abnormalities (AUC 0•89 [95%CI: 0•87–0•90]), with a 99% likelihood of better discriminating CT-positive patients than clinical characteristics used in contemporary decision rules. In patients with mild TBI, GFAP also showed incremental diagnostic value: discrimination increased from 0•84 [95%CI: 0•83–0•86] to 0•89 [95%CI: 0•87–0•90] when GFAP was included. Results were consistent across strata, and injury severity. Combinations of biomarkers did not improve discrimination compared to GFAP alone.

Interpretation

Currently available biomarkers reflect injury severity, and serum GFAP, measured within 24 h after injury, outperforms clinical characteristics in predicting CT abnormalities. Our results support the further development of serum GFAP assays towards implementation in clinical practice, for which robust clinical assay platforms are required.

Funding

CENTER-TBI study was supported by the European Union 7th Framework program (EC grant 602150).

Machine learning algorithms performed no better than regression models for prognostication in traumatic brain injury

OBJECTIVE

We aimed to explore the added value of common machine learning (ML) algorithms for prediction of outcome for moderate and severe traumatic brain injury.

STUDY DESIGN AND SETTING

We performed logistic regression (LR), lasso regression, and ridge regression with key baseline predictors in the IMPACT-II database (15 studies, n = 11,022). ML algorithms included support vector machines, random forests, gradient boosting machines, and artificial neural networks and were trained using the same predictors. To assess generalizability of predictions, we performed internal, internal-external, and external validation on the recent CENTER-TBI study (patients with Glasgow Coma Scale <13, n = 1,554). Both calibration (calibration slope/intercept) and discrimination (area under the curve) was quantified.

RESULTS

In the IMPACT-II database, 3,332/11,022 (30%) died and 5,233(48%) had unfavorable outcome (Glasgow Outcome Scale less than 4). In the CENTER-TBI study, 348/1,554(29%) died and 651(54%) had unfavorable outcome. Discrimination and calibration varied widely between the studies and less so between the studied algorithms. The mean area under the curve was 0.82 for mortality and 0.77 for unfavorable outcomes in the CENTER-TBI study.

CONCLUSION

ML algorithms may not outperform traditional regression approaches in a low-dimensional setting for outcome prediction after moderate or severe traumatic brain injury. Similar to regression-based prediction models, ML algorithms should be rigorously validated to ensure applicability to new populations.

Toward a New Multi-Dimensional Classification of Traumatic Brain Injury: A Collaborative European NeuroTrauma Effectiveness Research for Traumatic Brain Injury Study

Traumatic brain injury (TBI) is currently classified as mild, moderate, or severe TBI by trichotomizing the Glasgow Coma Scale (GCS). We aimed to explore directions for a more refined multidimensional classification system. For that purpose, we performed a hypothesis-free cluster analysis in the Collaborative European NeuroTrauma Effectiveness Research for TBI (CENTER-TBI) database: a European all-severity TBI cohort (n = 4509). The first building block consisted of key imaging characteristics, summarized using principal component analysis from 12 imaging characteristics. The other building blocks were demographics, clinical severity, secondary insults, and cause of injury. With these building blocks, the patients were clustered into four groups. We applied bootstrap resampling with replacement to study the stability of cluster allocation. The characteristics that predominantly defined the clusters were injury cause, major extracranial injury, and GCS. The clusters consisted of 1451, 1534, 1006, and 518 patients, respectively. The clustering method was quite stable: the proportion of patients staying in one cluster after resampling and reclustering was 97.4% (95% confidence interval [CI]: 85.6-99.9%). These clusters characterized groups of patients with different functional outcomes: from mild to severe, 12%, 19%, 36%, and 58% of patients had unfavorable 6 month outcome. Compared with the mild and the upper intermediate cluster, the lower intermediate and the severe cluster received more key interventions. To conclude, four types of TBI patients may be defined by injury mechanism, presence of major extracranial injury and GCS. Describing patients according to these three characteristics could potentially capture differences in etiology and care pathways better than with GCS only.

Post-Concussion Symptoms in Complicated vs. Uncomplicated Mild Traumatic Brain Injury Patients at Three and Six Months Post-Injury: Results from the CENTER-TBI Study

The aim of this study was to assess the occurrence of post-concussion symptoms and post-concussion syndrome (PCS) in a large cohort of patients after complicated and uncomplicated mild traumatic brain injury (mTBI) at three and six months post-injury. Patients were included through the prospective cohort study: Collaborative European NeuroTrauma Effectiveness Research (CENTER-TBI). Patients enrolled with mTBI (Glasgow Coma Scale 13-15) were further differentiated into complicated and uncomplicated mTBI based on the presence or absence of computed tomography abnormalities, respectively. The Rivermead Post-Concussion Symptoms Questionnaire (RPQ) assessed post-concussion symptoms and PCS according to the mapped ICD-10 classification method. The occurrence of post-concussion symptoms and syndrome at both time points was calculated. Chi square tests were used to test for differences between and within groups. Logistic regression was performed to analyse the association between complicated versus uncomplicated mTBI and the prevalence of PCS. Patients after complicated mTBI reported slightly more post-concussion symptoms compared to those after uncomplicated mTBI. A higher percentage of patients after complicated mTBI were classified as having PCS at three (complicated: 46% vs. uncomplicated: 35%) and six months (complicated: 43% vs. uncomplicated 34%). After adjusting for baseline covariates, the effect of complicated versus uncomplicated mTBI at three months appeared minimal: odds ratio 1.25 (95% confidence interval: 0.95-1.66). Although patients after complicated mTBI report slightly more post-concussion symptoms and show higher PCS rates compared to those after uncomplicated mTBI at three and six months, complicated mTBI was only found a weak indicator for these problems.

Variation in the practice of tracheal intubation in Europe after traumatic brain injury: a prospective cohort study

Traumatic brain injury patients frequently undergo tracheal intubation. We aimed to assess current intubation practice in Europe and identify variation in practice. We analysed data from patients with traumatic brain injury included in the prospective cohort study collaborative European neurotrauma effectiveness research in traumatic brain injury (CENTER‐TBI) in 45 centres in 16 European countries. We included patients who were transported to hospital by emergency medical services. We used mixed‐effects multinomial regression to quantify the effects on pre‐hospital or in‐hospital tracheal intubation of the following: patient characteristics; injury characteristics; centre; and trauma system characteristics. A total of 3843 patients were included. Of these, 1322 (34%) had their tracheas intubated; 839 (22%) pre‐hospital and 483 (13%) in‐hospital. The fit of the model with only patient characteristics predicting intubation was good (Nagelkerke R2 64%). The probability of tracheal intubation increased with the following: younger age; lower pre‐hospital or emergency department GCS; higher abbreviated injury scale scores (head and neck, thorax and chest, face or abdomen abbreviated injury score); and one or more unreactive pupils. The adjusted median odds ratio for intubation between two randomly chosen centres was 3.1 (95%CI 2.1–4.3) for pre‐hospital intubation, and 2.7 (95%CI 1.9–3.5) for in‐hospital intubation. Furthermore, the presence of an anaesthetist was independently associated with more pre‐hospital intubation (OR 2.9, 95%CI 1.3–6.6), in contrast to the presence of ambulance personnel who are allowed to intubate (OR 0.5, 95%CI 0.3–0.8). In conclusion, patient and injury characteristics are key drivers of tracheal intubation. Between‐centre differences were also substantial. Further studies are needed to improve the evidence base supporting recommendations for tracheal intubation.

Prevalence of post-concussion-like symptoms in the general population in Italy, The Netherlands and the United Kingdom

Objectives: To evaluate the frequency of post-concussion symptoms and prevalence and risk factors of post-concussion syndrome (PCS) in the general population, investigate the association between the Rivermead Post-Concussion Symptoms Questionnaire (RPQ) and self-perceived health, and evaluate differences between three European countries. Methods: A web-based survey including the RPQ and EQ-5D was conducted among representative samples in three European countries. Results: A total of 11,759 respondents completed the questionnaire. The most frequently reported symptom was fatigue (49.9%). Almost half (45.1%) of the respondents were classified as having PCS considering rating score 2 (three RPQ items with score ≥ 2) as a cut-off. Chronic health complaints were found as a significant risk factor for PCS. All items of the RPQ were positively correlated with the EQ-5D and the strongest positive correlation (0.633, p<0.001) was between RPQ item 'feeling depressed or tearful' and EQ-5D domain 'anxiety/depression'. Conclusions: We found a high frequency of post-concussion-like symptoms and PCS in the general population, indicating that these symptoms are not specific for patients with traumatic brain injury (TBI), and PCS is not a unique syndrome after TBI. Therefore, the use of post-concussion symptoms and PCS as outcome following mild TBI should be interpreted with caution.