Psychometric Evaluation of a Patient-Reported Symptom Index for Nonmuscle Invasive Bladder Cancer: Field Testing Protocol

Development and psychometric evaluation of a patient-reported symptom index for patients with non-muscle invasive bladder cancer: the NMIBC-SI

BACKGROUND AND OBJECTIVE

Non-muscle invasive bladder cancer (NMIBC) is a chronic condition requiring frequent follow-up with endoscopic examinations, tumour resections and intravesical treatments. In this clinical context, patient-reported outcomes (PROs) have enormous potential to inform treatment assessment and recommendations for NMIBC. We aimed to develop and evaluate a patient-reported NMIBC Symptom Index (NMIBC-SI) to facilitate clinical research and enhance care.

METHODS

NMIBC-SI items were developed based on existing literature and qualitative interviews with patients and clinicians, and evaluated in two field tests: item reduction, using NMIBC-SI data from 220 patients on active treatment from nine Australian centres; reliability and validity evaluation of item-reduced version using NMIBC-SI data from 232 patients from five countries.

RESULTS

NMIBC-SI assesses disease and treatment-related symptom burden and two treatment-specific side-effects (cystoscopy, intravesical BCG/Chemotherapy). Composite analysis supported a single composite model including core symptom and cystoscopy index items (Intravesical index items were not tested due to small sample). Test-retest reliability was strong (range 0.894-0.91). As expected, the NMIBC-SI was able to discriminate between no treatment and any treatment groups, and no treatment and chemo/BCG groups, providing evidence towards validity.

CONCLUSIONS AND CLINICAL IMPLICATIONS

NMIBC-SI assesses patients' self-reported symptom burden and can be used to evaluate NMIBC treatments from the perspective of patients. The NMIBC-SI is acceptable to patients and has evidence for reliability and validity. Future validation work with patients with greater symptom burden is warranted.

The critical role of mixed methods research in developing valid and reliable patient-reported outcome measures

Randomised controlled clinical trials provide the gold standard for evidence underpinning clinical guidelines and patient centred care. However, this is only true when they are robustly designed, conducted and reported and then only if they include outcomes that are important to patients and clinicians. Important outcomes include those that measure impact on patient experience, quality of life, overall well-being, and physical, social, cognitive and emotional functioning, all of which require patient reported outcome measures (PROMs). Patient centred care must be underpinned by objective evidence of the effect of interventions on outcomes that are important to patients. Evidence for patient reported outcomes must be supported by valid and reliable PROMs. Importantly the PROM must reflect patient experience of the impact of the intervention on the outcome and enable quantitative evaluation of that impact. The purpose of this paper is to highlight the critical role of mixed methods research in developing PROMs that are valid (measure what they purport to measure), acceptable to those reporting the outcome and able to reliably detect meaningful differences between individuals with different conditions or severity and with time. This can only be achieved through a structured mixed methods program combining qualitative and quantitative research techniques.

Comparing alternating pressure mattresses and high-specification foam mattresses to prevent pressure ulcers in high-risk patients: the PRESSURE 2 RCT

BACKGROUND

Pressure ulcers (PUs) are a burden to patients, carers and health-care providers. Specialist mattresses minimise the intensity and duration of pressure on vulnerable skin sites in at-risk patients.

PRIMARY OBJECTIVE

Time to developing a new PU of category ≥ 2 in patients using an alternating pressure mattress (APM) compared with a high-specification foam mattress (HSFM).

DESIGN

A multicentre, Phase III, open, prospective, planned as an adaptive double-triangular group sequential, parallel-group, randomised controlled trial with an a priori sample size of 2954 participants. Randomisation used minimisation (incorporating a random element).

SETTING

The trial was set in 42 secondary and community inpatient facilities in the UK.

PARTICIPANTS

Adult inpatients with evidence of acute illness and at a high risk of PU development.

INTERVENTIONS AND FOLLOW-UP

APM or HSFM - the treatment phase lasted a maximum of 60 days; the final 30 days were post-treatment follow-up.

MAIN OUTCOME MEASURES

Time to event.

RESULTS

From August 2013 to November 2016, 2029 participants were randomised to receive either APM (n = 1016) or HSFM (n = 1013). Primary end point - 30-day final follow-up: of the 2029 participants in the intention-to-treat population, 160 (7.9%) developed a new PU of category ≥ 2. There was insufficient evidence of a difference between groups for time to new PU of category ≥ 2 [Fine and Gray model HR 0.76, 95% confidence interval (CI) 0.56 to 1.04; exact p-value of 0.0890 and 2% absolute difference]. Treatment phase sensitivity analysis: 132 (6.5%) participants developed a new PU of category ≥ 2 between randomisation and end of treatment phase. There was a statistically significant difference in the treatment phase time-to-event sensitivity analysis (Fine and Gray model HR 0.66, 95% CI 0.46 to 0.93; p = 0.0176 and 2.6% absolute difference). Secondary end points - 30-day final follow-up: new PUs of category ≥ 1 developed in 350 (17.2%) participants, with no evidence of a difference between mattress groups in time to PU development, (Fine and Gray model HR 0.83, 95% CI 0.67 to 1.02; p-value = 0.0733 and absolute difference 3.1%). New PUs of category ≥ 3 developed in 32 (1.6%) participants with insufficient evidence of a difference between mattress groups in time to PU development (Fine and Gray model HR 0.81, 95% CI 0.40 to 1.62; p = 0.5530 and absolute difference 0.4%). Of the 145 pre-existing PUs of category 2, 89 (61.4%) healed - there was insufficient evidence of a difference in time to healing (Fine and Gray model HR 1.12, 95% CI 0.74 to 1.68; p = 0.6122 and absolute difference 2.9%). Health economics - the within-trial and long-term analysis showed APM to be cost-effective compared with HSFM; however, the difference in costs models are small and the quality-adjusted life-year gains are very small. There were no safety concerns. Blinded photography substudy - the reliability of central blinded review compared with clinical assessment for PUs of category ≥ 2 was 'very good' (kappa statistic 0.82, prevalence- and bias-adjusted kappa 0.82). Quality-of-life substudy - the Pressure Ulcer Quality of Life - Prevention (PU-QoL-P) instrument meets the established criteria for reliability, construct validity and responsiveness.

LIMITATIONS

A lower than anticipated event rate.

CONCLUSIONS

In acutely ill inpatients who are bedfast/chairfast and/or have a category 1 PU and/or localised skin pain, APMs confer a small treatment phase benefit that is diminished over time. Overall, the APM patient compliance, very low PU incidence rate observed and small differences between mattresses indicate the need for improved indicators for targeting of APMs and individualised decision-making. Decisions should take into account skin status, patient preferences (movement ability and rehabilitation needs) and the presence of factors that may be potentially modifiable through APM allocation, including being completely immobile, having nutritional deficits, lacking capacity and/or having altered skin/category 1 PU.

FUTURE WORK

Explore the relationship between mental capacity, levels of independent movement, repositioning and PU development. Explore 'what works for whom and in what circumstances'.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN01151335.

FUNDING

This project was funded by the National Institute for Health Research Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 23, No. 52. See the NIHR Journals Library website for further project information.