Construct validity, reliability and responsiveness of the 10-item Well-being instrument (WiX) for use in economic evaluation studies

OBJECTIVES

Economic evaluations of interventions in health and social care require outcome measures that capture their full benefits, including those beyond health. The aim of this study was to assess construct validity, test-retest reliability, and responsiveness of the newly developed 10-item Well-being instrument (WiX).

METHODS

Data was gathered via an online survey in a representative sample of the adult general population in the Netherlands (N=1,045). Construct validity was assessed by inspecting convergent, structural and discriminant validity, following the COSMIN methodology. Regression analyses of the WiX and its items on other validated measures of well-being were performed to assess the convergent validity of the instrument and the relevance of its items. Dimensionality of the WiX was assessed using exploratory factor analysis. To assess discriminant validity, several hypotheses in terms of well-being differences were assessed. Finally, a second survey was sent out two weeks after the initial survey (N=563; 53.9% response rate) to assess the test-retest reliability and responsiveness of the WiX.

RESULTS

The WiX showed to be correlated with alternative well-being measures as expected and able to sufficiently differentiate between relevant subgroups in the population. Moreover, the dimensionality analysis indicated that the WiX captures a broad array of elements relevant to well-being, including physical and mental health. The test-retest reliability was good, with an intraclass correlation coefficient of 0.82.

CONCLUSIONS

The results regarding the WiX are favourable and indicate that this new instrument may be a promising alternative for existing measures of well-being for evaluating interventions in health and social care.

Reference Values and Psychometric Properties of the Quality of Life After Traumatic Brain Injury-Overall Scale in Italy, The Netherlands, and the United Kingdom

OBJECTIVES

The Quality of Life after Brain Injury-Overall Scale (QOLIBRI-OS) is a short screening instrument for assessing disease-specific health-related quality of life (HRQoL) after traumatic brain injury. To date, no reference values are available for the QOLIBRI-OS in general populations. Thus, this study aimed to establish reference values for the QOLIBRI-OS in general population samples from Italy, The Netherlands, and the United Kingdom.

METHODS

Data were collected using an online survey. The total sample comprised 11759 participants, consisting of 3549 Italian, 3564 Dutch, and 4646 British subjects. In this sample, 49% of the total sample did not report any health complaints, whereas 51% had at least 1 chronic health condition. Reference values were deduced for the QOLIBRI-OS for health-condition-related samples and total general population samples per country. To ensure the comparability of these values, measurement invariance was assessed using a multigroup confirmatory factor analysis. Covariates characterizing the reference values were selected with the help of regression analyses.

RESULTS

The confirmatory factor analysis confirmed that the QOLIBRI-OS scores measured the same traumatic brain injury-specific HRQoL construct across the 3 countries. Healthy individuals reported significantly higher HRQoL than individuals with at least 1 chronic health condition. Older age and higher education levels were significantly associated with higher HRQoL.

CONCLUSIONS

Because the reference values displayed differences in terms of age and education level across the 3 countries, we recommend using country-specific reference values stratified by sociodemographic and health status in research and clinical practice.

Persistent postconcussive symptoms in children and adolescents with mild traumatic brain injury receiving initial head computed tomography

OBJECTIVE

The aim of this paper was to evaluate the prevalence of postconcussive symptoms and their relation to health-related quality of life (HRQOL) in pediatric and adolescent patients with mild traumatic brain injury (mTBI) who received head CT imaging during initial assessment.

METHODS

Patients aged between 5 and 21 years with mTBI (Glasgow Coma Scale scores 13-15) and available Rivermead Post Concussion Questionnaire (RPQ) at 6 months of follow-up in the multicenter, prospectively collected CENTER-TBI (Collaborative European NeuroTrauma Effectiveness Research in TBI) study were included. The prevalence of postconcussive symptoms was assessed, and the occurrence of postconcussive syndrome (PSC) based on the ICD-10 criteria, was analyzed. HRQOL was compared in patients with and without PCS using the Quality of Life after Brain Injury (QOLIBRI) questionnaire.

RESULTS

A total of 196 adolescent or pediatric mTBI patients requiring head CT imaging were included. High-energy trauma was prevalent in more than half of cases (54%), abnormalities on head CT scans were detected in 41%, and admission to the regular ward or intensive care unit was necessary in 78%. Six months postinjury, 36% of included patients had experienced at least one moderate or severe symptom on the RPQ. PCS was present in 13% of adolescents and children when considering symptoms of at least moderate severity, and those patients had significantly lower QOLIBRI total scores, indicating lower HRQOL, compared with young patients without PCS (57 vs 83 points, p < 0.001).

CONCLUSIONS

Adolescent and pediatric mTBI patients requiring head CT imaging show signs of increased trauma severity. Postconcussive symptoms are present in up to one-third of those patients, and PCS can be diagnosed in 13% 6 months after injury. Moreover, PCS is significantly associated with decreased HRQOL.

Prediction of Global Functional Outcome and Post-Concussive Symptoms after Mild Traumatic Brain Injury: External Validation of Prognostic Models in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) Study

The majority of traumatic brain injuries (TBIs) are categorized as mild, according to a baseline Glasgow Coma Scale (GCS) score of 13-15. Prognostic models that were developed to predict functional outcome and persistent post-concussive symptoms (PPCS) after mild TBI have rarely been externally validated. We aimed to externally validate models predicting 3-12-month Glasgow Outcome Scale Extended (GOSE) or PPCS in adults with mild TBI. We analyzed data from the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) project, which included 2862 adults with mild TBI, with 6-month GOSE available for 2374 and Rivermead Post-Concussion Symptoms Questionnaire (RPQ) results available for 1605 participants. Model performance was evaluated based on calibration (graphically and characterized by slope and intercept) and discrimination (C-index). We validated five published models for 6-month GOSE and three for 6-month PPCS scores. The models used different cutoffs for outcome and some included symptoms measured 2 weeks post-injury. Discriminative ability varied substantially (C-index between 0.58 and 0.79). The models developed in the Corticosteroid Randomisation After Significant Head Injury (CRASH) trial for prediction of GOSE <5 discriminated best (C-index 0.78 and 0.79), but were poorly calibrated. The best performing models for PPCS included 2-week symptoms (C-index 0.75 and 0.76). In conclusion, none of the prognostic models for early prediction of GOSE and PPCS has both good calibration and discrimination in persons with mild TBI. In future studies, prognostic models should be tailored to the population with mild TBI, predicting relevant end-points based on readily available predictors.

Frequency of fatigue and its changes in the first 6 months after traumatic brain injury: results from the CENTER-TBI study

Background

Fatigue is one of the most commonly reported subjective symptoms following traumatic brain injury (TBI). The aims were to assess frequency of fatigue over the first 6 months after TBI, and examine whether fatigue changes could be predicted by demographic characteristics, injury severity and comorbidities.

Methods

Patients with acute TBI admitted to 65 trauma centers were enrolled in the study Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI). Subjective fatigue was measured by single item on the Rivermead Post-Concussion Symptoms Questionnaire (RPQ), administered at baseline, three and 6 months postinjury. Patients were categorized by clinical care pathway: admitted to an emergency room (ER), a ward (ADM) or an intensive care unit (ICU). Injury severity, preinjury somatic- and psychiatric conditions, depressive and sleep problems were registered at baseline. For prediction of fatigue changes, descriptive statistics and mixed effect logistic regression analysis are reported.

Results

Fatigue was experienced by 47% of patients at baseline, 48% at 3 months and 46% at 6 months. Patients admitted to ICU had a higher probability of experiencing fatigue than those in ER and ADM strata. Females and individuals with lower age, higher education, more severe intracranial injury, preinjury somatic and psychiatric conditions, sleep disturbance and feeling depressed postinjury had a higher probability of fatigue.

Conclusion

A high and stable frequency of fatigue was found during the first 6 months after TBI. Specific socio-demographic factors, comorbidities and injury severity characteristics were predictors of fatigue in this study.

Electronic supplementary material

The online version of this article (10.1007/s00415-020-10022-2) contains supplementary material, which is available to authorized users.

Health-related quality of life after traumatic brain injury: deriving value sets for the QOLIBRI-OS for Italy, The Netherlands and The United Kingdom

Purpose

The Quality of Life after Brain Injury overall scale (QOLIBRI-OS) measures health-related quality of life (HRQoL) after traumatic brain injury (TBI). The aim of this study was to derive value sets for the QOLIBRI-OS in three European countries, which will allow calculation of utility scores for TBI health states.

Methods

A QOLIBRI-OS value set was derived by using discrete choice experiments (DCEs) and visual analogue scales (VAS) in general population samples from the Netherlands, United Kingdom and Italy. A three-stage procedure was used: (1) A selection of health states, covering the entire spectrum of severity, was defined; (2) General population samples performed the health state valuation task using a web-based survey with three VAS questions and an at random selection of sixteen DCEs; (3) DCEs were analysed using a conditional logistic regression and were then anchored on the VAS data. Utility scores for QOLIBRI-OS health states were generated resulting in estimates for all potential health states.

Results

The questionnaire was completed by 13,623 respondents. The biggest weight increase for all attributes is seen from “slightly” to “not at all satisfied”, resulting in the largest impact on HRQoL. “Not at all satisfied with how brain is working” should receive the greatest weight in utility calculations in all three countries.

Conclusion

By transforming the QOLIBRI-OS into utility scores, we enabled the application in economic evaluations and in summary measures of population health, which may be used to inform decision-makers on the best interventions and strategies for TBI patients.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02583-6) contains supplementary material, which is available to authorized users.

Rating of pre-injury symptoms over time in patients with mild traumatic brain injury: the good-old-days bias revisited

OBJECTIVE

Post-concussion syndrome (PCS) occurs following mild traumatic brain injury (mTBI). Patients with mTBI are often assessed using self-report instruments that rely on perception of current symptoms compared to how they felt and functioned pre-injury. The objective was to examine reliability of patients' post-injury reporting of their pre-injury symptoms.

METHODS

We included two control groups (trauma patients without brain injury history and healthy controls) who were recruited at an outpatient surgical clinic and among the working and social environment of the researchers, respectively. The Head Injury Symptom Checklist (HISC) was used to assess pre-injury and current symptoms at four time points post injury. We included 836 patients with mTBIs, 191 trauma patients without brain injury history, and 100 healthy controls.

RESULTS

Patients with mTBI reported significantly more pre-injury symptoms than both control groups (p < .001). Forty-five percent of patients with mTBI were inconsistent in their pre-injury ratings across four assessments. Patients with post-injury PCS reported much greater pre-injury symptoms and were more often inconsistent.

CONCLUSION

Accurately assessing PCS by comparing pre with post-injury complaints is difficult, and may have implications for diagnosis when using self-report instruments. Therefore, post-injury PCS diagnosis should be interpreted with caution and PCS should ideally be examined using clinical examination.

Influence of Sociodemographic, Premorbid, and Injury-Related Factors on Post-Concussion Symptoms after Traumatic Brain Injury

BACKGROUND

Post-concussion symptoms (PCS) are often reported as consequences of mild and moderate traumatic brain injury (TBI), but these symptoms are not well documented in severe TBI. There is a lack of agreement as to which factors and covariates affect the occurrence, frequency, and intensity of PCS among TBI severity groups. The present study therefore aims to examine the association between sociodemographic, premorbid, and injury-related factors and PCS.

METHODS

A total of 1391 individuals (65% male) from the CENTER-TBI study were included in the analyses. The occurrence, frequency (number of PCS), and intensity (severity) of PCS were assessed using the Rivermead Post-concussion Symptoms Questionnaire (RPQ) at six months after TBI. To examine the association between selected factors (age, sex, living situation, employment status, educational background, injury and TBI severity, and premorbid problems) and PCS, a zero-inflated negative binomial model (ZINB) for occurrence and frequency of PCS and a standard negative binomial regression (NB) for intensity were applied.

RESULTS

Of the total sample, 72% of individuals after TBI reported suffering from some form of PCS, with fatigue being the most frequent among all TBI severity groups, followed by forgetfulness, and poor concentration. Different factors contributed to the probability of occurrence, frequency, and intensity of PCS. While the occurrence of PCS seemed to be independent of the age and sex of the individuals, both the frequency and intensity of PCS are associated with them. Both injury and TBI severity influence the occurrence and frequency of PCS, but are associated less with its intensity (except "acute" symptoms such as nausea, vomiting, and headaches). Analyses focusing on the mTBI subgroup only yielded results comparable to those of the total sample.

DISCUSSION

In line with previous studies, the results support a multifactorial etiology of PCS and show the importance of differentiating between their occurrence, frequency, and intensity to better provide appropriate treatment for individual subgroups with different symptoms (e.g., multiple PCS or more intense PCS). Although PCS often occur in mild to moderate TBI, individuals after severe TBI also suffer from PCS or post-concussion-like symptoms that require appropriate treatment. The chosen statistical approaches (i.e., ZINB and NB models) permit an ameliorated differentiation between outcomes (occurrence, frequency, and intensity of PCS) and should be used more widely in TBI research.

Outcomes after Complicated and Uncomplicated Mild Traumatic Brain Injury at Three-and Six-Months Post-Injury: Results from the CENTER-TBI Study

The objective of this study was to provide a comprehensive examination of the relation of complicated and uncomplicated mild traumatic brain injury (mTBI) with multidimensional outcomes at three- and six-months after TBI. We analyzed data from the Collaborative European NeuroTrauma Effectiveness Research (CENTER-TBI) research project. Patients after mTBI (Glasgow Coma scale (GCS) score of 13-15) enrolled in the study were differentiated into two groups based on computed tomography (CT) findings: complicated mTBI (presence of any traumatic intracranial injury on first CT) and uncomplicated mTBI (absence of any traumatic intracranial injury on first CT). Multidimensional outcomes were assessed using seven instruments measuring generic and disease-specific health-related quality of life (HRQoL) (SF-36 and QOLIBRI), functional outcome (GOSE), and psycho-social domains including symptoms of post-traumatic stress disorder (PTSD) (PCL-5), depression (PHQ-9), and anxiety (GAD-7). Data were analyzed using a multivariate repeated measures approach (MANOVA-RM), which inspected mTBI groups at three- and six-months post injury. Patients after complicated mTBI had significantly lower GOSE scores, reported lower physical and mental component summary scores based on the SF-36 version 2, and showed significantly lower HRQoL measured by QOLIBRI compared to those after uncomplicated mTBI. There was no difference between mTBI groups when looking at psychological outcomes, however, a slight improvement in PTSD symptoms and depression was observed for the entire sample from three to six months. Patients after complicated mTBI reported lower generic and disease specific HRQoL and worse functional outcome compared to individuals after uncomplicated mTBI at three and six months. Both groups showed a tendency to improve from three to six months after TBI. The complicated mTBI group included more patients with an impaired long-term outcome than the uncomplicated group. Nevertheless, patients, clinicians, researchers, and decisions-makers in health care should take account of the short and long-term impact on outcome for patients after both uncomplicated and complicated mTBI.

Post-Concussion Symptoms in Complicated vs. Uncomplicated Mild Traumatic Brain Injury Patients at Three and Six Months Post-Injury: Results from the CENTER-TBI Study

The aim of this study was to assess the occurrence of post-concussion symptoms and post-concussion syndrome (PCS) in a large cohort of patients after complicated and uncomplicated mild traumatic brain injury (mTBI) at three and six months post-injury. Patients were included through the prospective cohort study: Collaborative European NeuroTrauma Effectiveness Research (CENTER-TBI). Patients enrolled with mTBI (Glasgow Coma Scale 13-15) were further differentiated into complicated and uncomplicated mTBI based on the presence or absence of computed tomography abnormalities, respectively. The Rivermead Post-Concussion Symptoms Questionnaire (RPQ) assessed post-concussion symptoms and PCS according to the mapped ICD-10 classification method. The occurrence of post-concussion symptoms and syndrome at both time points was calculated. Chi square tests were used to test for differences between and within groups. Logistic regression was performed to analyse the association between complicated versus uncomplicated mTBI and the prevalence of PCS. Patients after complicated mTBI reported slightly more post-concussion symptoms compared to those after uncomplicated mTBI. A higher percentage of patients after complicated mTBI were classified as having PCS at three (complicated: 46% vs. uncomplicated: 35%) and six months (complicated: 43% vs. uncomplicated 34%). After adjusting for baseline covariates, the effect of complicated versus uncomplicated mTBI at three months appeared minimal: odds ratio 1.25 (95% confidence interval: 0.95-1.66). Although patients after complicated mTBI report slightly more post-concussion symptoms and show higher PCS rates compared to those after uncomplicated mTBI at three and six months, complicated mTBI was only found a weak indicator for these problems.

The association between post-concussion symptoms and health-related quality of life in patients with mild traumatic brain injury

A subset of mild traumatic brain injury (mTBI) patients experience post-concussion symptoms. When a cluster of post-concussion symptoms persists for over three months, it is referred to as post-concussion syndrome (PCS). Little is known about the association between PCS and Health-Related Quality of Life (HRQoL) after mTBI. The aims of this study were to assess the implications of PCS on HRQoL six months after mTBI and the relationship between PCS and HRQoL domains. A prospective observational cohort study was conducted among a sample of mTBI patients. Follow-up postal questionnaires at six months after emergency department (ED) admission included socio-demographic information, the Rivermead Post-Concussion Symptoms Questionnaire (RPQ), and HRQoL measured with the 36-item Short-Form Health Survey (SF-36) and the Perceived Quality of Life Scale (PQoL). In total, 731 mTBI patients were included, of whom 38.7% were classified as suffering from PCS. Patients with PCS had significantly lower scores on all SF-36 domains, lower physical and mental component summary scores and lower mean PQoL scores compared to patients without PCS. All items of the RPQ were negatively correlated to all SF-36 domains and PQoL subscale scores, indicating that reporting problems on any of the RPQ symptoms was associated with a decrease on different aspects of an individuals' HRQoL. To conclude, PCS is common following mTBI and patients with PCS have a considerably lower HRQoL. A better understanding of the relationship between PCS and HRQoL and possible mediating factors in this relationship could improve intervention strategies, the recovery process for mTBI patients and benchmarking.

Prevalence of post-concussion-like symptoms in the general population in Italy, The Netherlands and the United Kingdom

Objectives: To evaluate the frequency of post-concussion symptoms and prevalence and risk factors of post-concussion syndrome (PCS) in the general population, investigate the association between the Rivermead Post-Concussion Symptoms Questionnaire (RPQ) and self-perceived health, and evaluate differences between three European countries. Methods: A web-based survey including the RPQ and EQ-5D was conducted among representative samples in three European countries. Results: A total of 11,759 respondents completed the questionnaire. The most frequently reported symptom was fatigue (49.9%). Almost half (45.1%) of the respondents were classified as having PCS considering rating score 2 (three RPQ items with score ≥ 2) as a cut-off. Chronic health complaints were found as a significant risk factor for PCS. All items of the RPQ were positively correlated with the EQ-5D and the strongest positive correlation (0.633, p<0.001) was between RPQ item 'feeling depressed or tearful' and EQ-5D domain 'anxiety/depression'. Conclusions: We found a high frequency of post-concussion-like symptoms and PCS in the general population, indicating that these symptoms are not specific for patients with traumatic brain injury (TBI), and PCS is not a unique syndrome after TBI. Therefore, the use of post-concussion symptoms and PCS as outcome following mild TBI should be interpreted with caution.

A Multidimensional Approach to Post-concussion Symptoms in Mild Traumatic Brain Injury

Mild traumatic brain injury (mTBI) presents a substantial burden to patients, families, and health care systems. Whereas, recovery can be expected in the majority of patients, a subset continues to report persisting somatic, cognitive, emotional, and/or behavioral problems, generally referred to as post-concussion syndrome (PCS). However, this term has been the subject of debate since the mechanisms underlying post-concussion symptoms and the role of pre- and post-injury-related factors are still poorly understood. We review current evidence and controversies concerning the use of the terms post-concussion symptoms vs. syndrome, its diagnosis, etiology, prevalence, assessment, and treatment in both adults and children. Prevalence rates of post-concussion symptoms vary between 11 and 82%, depending on diagnostic criteria, population and timing of assessment. Post-concussion symptoms are dependent on complex interactions between somatic, psychological, and social factors. Progress in understanding has been hampered by inconsistent classification and variable assessment procedures. There are substantial limitations in research to date, resulting in gaps in our understanding, leading to uncertainty regarding epidemiology, etiology, prognosis, and treatment. Future directions including the identification of potential mechanisms, new imaging techniques, comprehensive, multidisciplinary assessment and treatment options are discussed. Treatment of post-concussion symptoms is highly variable, and primarily directed at symptom relief, rather than at modifying the underlying pathology. Longitudinal studies applying standardized assessment strategies, diagnoses, and evidence-based interventions are required in adult and pediatric mTBI populations to optimize recovery and reduce the substantial socio-economic burden of post-concussion symptoms.

Divergent Classification Methods of Post-Concussion Syndrome after Mild Traumatic Brain Injury: Prevalence Rates, Risk Factors, and Functional Outcome

Mild traumatic brain injury (mTBI) is a common diagnosis and approximately one third of mTBI patients experience a variety of cognitive, emotional, psychosocial, and behavioral post-concussion symptoms. When a cluster of these symptoms persists for more than 3 months they are often classified as post-concussion syndrome (PCS). The objective of this study was to determine prevalence rates, risk factors, and functional outcome associated with PCS 6 months after mTBI, applying divergent classification methods. Follow-up questionnaires at 6 months after mTBI included the Rivermead Post-Concussion Symptoms Questionnaire (RPQ) and the Glasgow Outcome Scale Extended (GOSE). The RPQ was analyzed according to different classification methods: the mapped International Classification of Diseases, 10th revision (ICD-10)/Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV), the RPQ total score, the RPQ3 and the three-factor model using two different cutoff points (mild or worse and moderate or worse). Our results from a sample of 731 mTBI patients showed that prevalence rates of PCS ranged from 11.4% to 38.7% using divergent classification methods. According to all eight methods, 6.3% (n = 46) of mTBI patients experienced PCS. Applying the divergent classification methods resulted in a different set of predictors being statistically significantly associated with PCS, and a different percentage of overlap with functional impairment, measured with the GOSE. In conclusion, depending on the classification method and rating score used, prevalence rates of PCS deviated considerably. For future research, consensus regarding the diagnostic criteria for PCS and the analysis of the RPQ should be reached, to enhance comparability of studies regarding PCS after mTBI.

Utility-Weighted Modified Rankin Scale as Primary Outcome in Stroke Trials: A Simulation Study

Supplemental Digital Content is available in the text.

Background and Purpose—

The utility-weighted modified Rankin Scale (UW-mRS) has been proposed as a new patient-centered primary outcome in stroke trials. We aimed to describe utility weights for the mRS health states and to evaluate the statistical efficiency of the UW-mRS to detect treatment effects in stroke intervention trials.

Methods—

We used data of the 500 patients enrolled in the MR CLEAN (Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands). Utility values were elicited from the EuroQol Group 5-Dimension Self-Report Questionnaire assessed at 90 days after inclusion, simultaneously with the mRS. Utility weights were determined by averaging the utilities of all patients within each mRS category. We performed simulations to evaluate statistical efficiency. The simulated treatment effect was an odds ratio of 1.65 in favor of the treatment arm, similar for all mRS cutoffs. This treatment effect was analyzed using 3 approaches: linear regression with the UW-mRS as outcome, binary logistic regression with a dichotomized mRS (0–1/2–6, 0–2/3–6, and 0–4/5–6), and proportional odds logistic regression with the ordinal mRS. The statistical power of the 3 approaches was expressed as the proportion of 10 000 simulations that resulted in a statistically significant treatment effect (P≤0.05).

Results—

The mean utility values (SD) for mRS categories 0 to 6 were: 0.95 (0.08), 0.93 (0.13), 0.83 (0.21), 0.62 (0.27), 0.42 (0.28), 0.11 (0.28), and 0 (0), respectively, but varied substantially between individual patients within each category. The UW-mRS approach was more efficient than the dichotomous approach (power 85% versus 71%) but less efficient than the ordinal approach (power 85% versus 87%).

Conclusions—

The UW-mRS as primary outcome does not capture individual variation in utility values and may reduce the statistical power of a randomized trial.