Test-retest properties of the Patient Reported Outcomes, Burdens and Experiences (PROBE) questionnaire and its constituent domains

Outcome measures in hemophilia: current and future perspectives

INTRODUCTION

Hemophilia can detrimentally affect patients' quality of life and likelihood of survival. In the evolving landscape of therapies, the therapeutic gain of each treatment must be understood to accurately position it in the therapeutic armamentarium. Accordingly, appropriate outcomes must be measured with appropriate tools.

AREAS COVERED

Our narrative review (PubMed search for 'hemophilia AND outcome' until June 2023), provides a compendium of outcome measures used in hemophilia clinical research. To define each outcome measure's relative value and applicability, several characteristics are critically discussed.

EXPERT OPINION

Bleeding assessment, first annual/annualized bleeding rate, remains central in evaluating the efficacy and safety of hemophilia treatments. As modern therapies improve clinical outcomes toward zero bleeding events, this endpoint may become less sensitive to detect differences between therapeutic approaches. Technological advancements necessitate the adaptation of outcome measures to address infrequent bleeding events, age-related comorbidities, and laboratory parameters with limited comparability after different treatments. Considerable effort has been dedicated to the development of tools that comprehensively assess coagulation, such as thrombin generation assays. Patient-reported outcome measures are gaining importance although limited by their subjectivity. A definitive set of research outcome measures remains elusive. Outcomes may need to be tailored to different therapeutic interventions.

Health utilities in adults with hemophilia A: A retrospective cohort study

INTRODUCTION

Haemophilia A negatively affects a patient's quality of life. There is a limited amount of health utility data (a measure of health-related quality of life) available for patients with haemophilia A. This information is crucial for cost-effectiveness analysis for haemophilia A treatment.

OBJECTIVES

The goal of this project is to elicit the health utilities and factors impacting utility values for haemophilia A patients in Canada.

METHODS

This is a population-based, cross-sectional, retrospective study of health utilities in patients with haemophilia A using Patient Report Outcomes Burdens and Experiences (PROBE) components from the Canadian Bleeding Disorders Registry (CBDR). A review of the mean utilities for three severity states, defined by clotting factor VIII level, was completed. A multiple linear regression analysis was completed to examine the determinants of health utilities including age, treatment type, chronic pain status, number of limited joints, and bleed rate.

RESULTS

The average utility values (and standard deviations) for patients with haemophilia A in Canada are .79(.17), .76(.20), and .77(.19) for patients with severe, moderate, and mild haemophilia. The regression showed chronic pain status and the number of additional comorbidities as major significant factors (p-value < .001) in haemophilia A utility. Haemophilia severity was shown to be a major factor with smaller p-value (p-value < .05).

CONCLUSIONS

Haemophilia A patients have lower utility than the general population. Chronic pain was shown to be a significant, major factor in health-related quality of life. Our study is essential for valuing health outcomes in haemophilia A-related cost-effectiveness analysis.

Test-retest reliability of a mobile application of the patient reported outcomes burdens and experiences (PROBE) study

INTRODUCTION

The Patient Reported Outcomes, Burdens, and Experiences (PROBE) questionnaire is a patient-reported outcome tool that assesses quality of life and disease burden in people with haemophilia (PWH).

AIM

To assesses the test-retest reliability of PROBE when completed using the mobile phone application.

METHODS

We recruited PWH, including carriers, and individuals with no bleeding disorders who attended haemophilia-related workshops or via social media. Participants completed PROBE three times (twice on the app: T1 and T2, and once on the web, T3). Test-retest reliability was analysed for T1 versus T2 (app to app, time period one) and T2 versus T3 (app to web, time period two).

RESULTS

We enrolled 48 participants (median age = 56 [range 27-78] years). Eighteen participants (37.5%) were PWH and seven (14.6%) were carriers. On general health domain questions, we found almost perfect agreement, except for a question on the frequency of use of pain medication in the last 12 months [Kappa coefficient (κ) .72 and .37 for time period one and two, respectively] and any use of pain medications (κ .75) for time period two. For haemophilia-related questions, we found substantial to perfect agreement, except for the questions on the number of joint bleeds in the previous 6 months for time period one (κ .49) and the number of bleeds in the previous two weeks for time period two (κ .34).

CONCLUSIONS

The results demonstrate the reliability of the PROBE app. The app can be used interchangeably with the paper and web platforms for PROBE administration.

Canadian clinical experience on switching from standard half-life recombinant factor VIII (rFVIII), octocog alfa, to extended half-life rFVIII, damoctocog alfa pegol, in persons with haemophilia A ≥ 12 years followed in a Comprehensive Hemophilia Care Program in Canada

INTRODUCTION

Damoctocog alfa pegol (BAY 94-9027, Jivi®) is an extended half-life recombinant factor (F)VIII replacement, indicated for the treatment of haemophilia A in patients aged ≥12 years. Following introduction of damoctocog alfa pegol in Canada in 2020, there have been no reports on routine clinical effectiveness and satisfaction, when switching from a previous FVIII product in Canada.

AIM

To report changes in pharmacokinetics, effectiveness, utilization and patient satisfaction when switching to damoctocog alfa pegol prophylaxis from previous standard half-life octocog alfa (BAY 81-8973, Kovaltry®) treatment.

METHODS

A single-centre, intra-patient comparison of pharmacokinetics and clinical outcomes was performed. Blood samples drawn once pre-dose and ≥2 times post-dose were measured by a one-stage assay to assess pharmacokinetic parameters including area under the curve (AUC, primary endpoint). Patient-reported outcomes data were collected using the Patient-Reported Outcomes, Burdens and Experiences questionnaire (PROBE). Clinical outcomes included annualized bleeding rate (ABR) and factor utilization.

RESULTS

Dose-normalized AUC was significantly increased after switch to damoctocog alfa pegol from octocog alfa. Median (quartile [Q]1; Q3) annualized bleeding rates were 0.67 (0.00; 1.33) with damoctocog alfa pegol and 1.33 (0.00; 2.67) with octocog alfa. Half of the patients receiving damoctocog alfa pegol prophylaxis experienced zero bleeds (n = 9, 50.0%) versus 38.9% (n = 7) of patients treated with octocog alfa. Patients' good quality of life was maintained.

CONCLUSION

This study provides routine clinical evidence supporting the benefits of switching from octocog alfa to damoctocog alfa pegol for patients with severe haemophilia A.

Building the foundation for a community-generated national research blueprint for inherited bleeding disorders: research priorities in health services; diversity, equity, and inclusion; and implementation science

BACKGROUND

The National Hemophilia Foundation (NHF) conducted extensive all-stakeholder inherited bleeding disorder (BD) community consultations to inform a blueprint for future research. Sustaining and expanding the specialized and comprehensive Hemophilia Treatment Center care model, to better serve all people with inherited BDs (PWIBD), and increasing equitable access to optimal health emerged as top priorities.

RESEARCH DESIGN AND METHODS

NHF, with the American Thrombosis and Hemostasis Network (ATHN), convened multidisciplinary expert working groups (WG) to distill priority research initiatives from consultation findings. WG5 was charged with prioritizing health services research (HSR); diversity, equity, and inclusion (DEI); and implementation science (IS) research initiatives to advance community-identified priorities.

RESULTS

WG5 identified multiple priority research themes and initiatives essential to capitalizing on this potential. Formative studies using qualitative and mixed methods approaches should be conducted to characterize issues and meaningfully investigate interventions. Investment in HSR, DEI and IS education, training, and workforce development are vital.

CONCLUSIONS

An enormous amount of work is required in the areas of HSR, DEI, and IS, which have received inadequate attention in inherited BDs. This research has great potential to evolve the experiences of PWIBD, deliver transformational community-based care, and advance health equity.

Pain and functional disability amongst adults with moderate and severe haemophilia from the Irish personalised approach to the treatment of haemophilia (iPATH) study

Objectives

To establish the prevalence of pain and functional disability in Irish adults with moderate and severe haemophilia, and to examine demographic and lifestyle influences.

Methods

Males ≥18 years with moderate or severe haemophilia participated. Pain and function were examined using the PROBE questionnaire.

Results

Of 49 participants [median age 44 (IQR 32, 52) years], most had severe haemophilia (Factor VIII = 30; Factor IX = 13) and were on regular prophylaxis (88%). Those with moderate haemophilia (Factor VIII = 5; Factor IX = 1) treated on demand (12%). Acute (72%) and chronic pain (71%), functional difficulties (58%), and analgesic requirements (92%) were prevalent. Age was significantly associated with more advanced haemophilic arthropathy (p = .002), chronic pain (p = .029) and functional difficulties (p = .036). Adults who reported chronic pain commenced prophylaxis significantly later in life [32 (20, 51) vs. 8 (1, 23) years; p = .004]. Physical activity was significantly lower in those with functional difficulties (p < .05). A disparity between self‐perceived ‘target joints’ and clinically defined target joints was also identified (76% vs. 23%).

Conclusion

Haemophilic arthropathy, pain and functional disability were prevalent amongst Irish adults with moderate and severe haemophilia. Age‐dependent lifestyle, analgesic and treatment influences on pain and function warrant further investigation.

User-Centered Development and Testing of the Online Patient-Reported Outcomes, Burdens, and Experiences (PROBE) Survey and the myPROBE App and Integration With the Canadian Bleeding Disorder Registry: Mixed Methods Study

Background

The Patient-Reported Outcomes, Burdens, and Experiences (PROBE) questionnaire is a tool for assessing the quality of life and disease burden in people living with hemophilia.

Objective

The objectives of our study were (1) to assess the needs of relevant stakeholders involved in the use of PROBE, (2) to develop the software infrastructure needed to meet these needs, and (3) to test the usability of the final product.

Methods

We conducted a series of semistructured interviews of relevant stakeholders, including PROBE investigators, people with hemophilia, and representatives of the sponsor. Based on these, we developed an online survey and a mobile app for iOS and Android. A user group evaluated the final product using the System Usability Scale (SUS) and an open feedback framework.

Results

The online survey was updated, and the myPROBE app for mobile devices and a new application programming interface were developed. The app was tested and modified according to user feedback over multiple cycles. The final version of the app was released in July 2019. Seventeen users aged 23 to 67 years evaluated the final version of the app using the SUS. The median (first, third quartile) SUS score for the app was 85 (68, 88) out of 100. The newly introduced functionalities were as follows: (1) capability to longitudinally track repeated fillings of the questionnaire at different time points by the same participant (as opposed to anonymous completion); (2) linking of the questionnaire with hemophilia registries, starting with the Canadian Bleeding Disorders Registry as a proof of concept; (3) removing or adding questions as needed; and (4) sending notifications to the users (eg, reminders). A new secure database was built for securely storing personal information separately from the questionnaire data. The PROBE online survey is currently available in 96 countries and 34 languages.

Conclusions

The online survey was updated successfully, and the myPROBE app was developed, with a SUS score of 85 (out of 100). The app has been released in 81 countries and 34 languages. This will facilitate data collection for research and advocacy purposes, and the use of this tool in everyday clinical practice.

Recombinant factor IX-Fc fusion protein in severe hemophilia B: Patient-reported outcomes and health-related quality of life

INTRODUCTION

In 2017, all people with severe hemophilia B in Ireland switched to recombinant factor IX Fc fusion protein concentrate (rFIXFc) prophylaxis. Patient-reported outcomes (PROs) and health-related quality of life (HRQoL) are important to evaluate with new treatments.

AIMS

To assess HRQoL in people with severe hemophilia B and their experience after switching to rFIXFc prophylaxis.

METHODS

Participants completed a Patient Reported Outcomes Burden and Experience (PROBE) questionnaire on initiation and following two years of rFIXFc prophylaxis. The PROBE questionnaire has four domains: demographics, general health, haemophilia-specific, and European Quality of Life 5-Dimensions (EQ-5D-5L) questionnaire.

RESULTS

Twenty-three participants completed the questionnaire at both time points. The number of activities where chronic pain occurred and interfered with the activity was reduced by 25% and 33%, respectively (P < .001), following two years of rFIXFc prophylaxis. There was a 9% decrease in chronic pain during the second year of rFIXFc prophylaxis compared to baseline, but the rate remained high, at 74%. A 25% reduction in the number of affected activities of daily living (ADLs) was reported following 2 years of rFIXFc prophylaxis (P = .007). The most common health problems were arthritis, hypertension, anxiety/depression, and gingivitis. The median EQ-5D-5L score was similar following two years of rFIXFc prophylaxis, 0.76 (range, -0.01 to 0.95), compared to 0.77 (range, 0.36-1) at baseline.

CONCLUSION

This study of real-world patient experience using PROs demonstrates a reduction in chronic pain and improvement in ADLs in participants after switching to rFIXFc prophylaxis. It provides important insights into patient-identified health care needs and living with severe hemophilia B.

Evaluation of the sexual health in people living with hemophilia

BACKGROUND

Knowledge about sexual health, difficulty with sexual activity and intimacy (sexual difficulty), in people with hemophilia is little understood.

OBJECTIVES

The objectives were to determine the prevalence of sexual difficulty in people living with hemophilia (PWH) compared to people with no bleeding disorders (PWNoBD), and to determine factors associated with it.

METHODS

This was an analysis of the PROBE study. We recruited individuals who had hemophilia A or B (PWH) and PWNoBD who were 18 years old or older. We calculated proportions of participants with sexual difficulty and odds ratios (ORs) adjusted for sex and age with 95% confidence intervals.

RESULTS

There were 2007 PWH and 1972 PWNoBD. Mean (standard deviation) age was 41 (15) years in PWH and 42 (13) years in PWNoBD. Sexual difficulty was reported in 302 (15.1%) PWH and 79 (4.0%) PWNoBD. The odds of sexual difficulty were significantly higher in PWH (OR 3.82, 95% CI 2.85, 5.11). Among PWH, older age, experiencing acute or chronic pain in the past 12 months, bleeds within the past two weeks, ≥3 spontaneous joint bleeds (past six months), limitation of range of motion of any joints, and any life- or limb-threatening bleeds in the past 12 months were associated with sexual difficulty.

CONCLUSIONS

Sexual difficulty is more prevalent in people living with hemophilia and associated with markers of disease severity. Sexual health issues should be incorporated in comprehensive hemophilia care, future research, and hemophilia related health policy.

Patient-relevant health outcomes for hemophilia care: Development of an international standard outcomes set

BACKGROUND

Patient-relevant health outcomes for persons with hemophilia should be identified and prioritized to optimize and individualize care for persons with hemophilia. Therefore, an international group of persons with hemophilia and multidisciplinary health care providers set out to identify a globally applicable standard set of health outcomes relevant to all individuals with hemophilia.

METHODS

A systematic literature search was performed to identify possible health outcomes and risk adjustment variables. Persons with hemophilia and multidisciplinary health care providers were involved in an iterative nominal consensus process to select the most important health outcomes and risk adjustment variables for persons with hemophilia. Recommendations were made for outcome measurement instruments.

RESULTS

Persons with hemophilia were defined as all men and women with an X-linked inherited bleeding disorder caused by a deficiency of coagulation factor VIII or IX with plasma activity levels <40 IU/dL. We recommend collecting the following 10 health outcomes at least annually, if applicable: (i) cure, (ii) impact of disease on life expectancy, (iii) ability to engage in normal daily activities, (iv) severe bleeding episodes, (v) number of days lost from school or work, (vi) chronic pain, (vii) disease and treatment complications, (viii) sustainability of physical functioning, (ix) social functioning, and (x) mental health. Validated clinical as well as patient-reported outcome measurement instruments were endorsed. Demographic factors, baseline clinical factors, and treatment factors were identified as risk-adjustment variables.

CONCLUSION

A consensus-based international set of health outcomes relevant to all persons with hemophilia, and corresponding measurement instruments, was identified for use in clinical care to facilitate harmonized longitudinal monitoring and comparison of outcomes.

Challenges and key lessons from the design and implementation of an international haemophilia registry supported by a pharmaceutical company

INTRODUCTION

Real-world data are lacking regarding the relationship between prospectively collected patient-reported outcomes (PROs), clinical outcomes and treatment in people with haemophilia (PWH). The Expanding Communications on Hemophilia A Outcomes (ECHO) registry was designed to address this data gap, but a range of difficulties led to early study closure.

AIM

To describe the challenges faced and lessons learned from implementing a multinational haemophilia registry.

METHODS

The Expanding Communications on Hemophilia A Outcomes was planned as a five-year observational cohort study to collect data from 2000 patients in nine countries. Based on direct observations, feedback from patients enrolled in ECHO, challenges of the study design and input from study-sponsor representatives, the ECHO Steering Committee systematically identified the challenges faced and developed recommendations for overcoming or avoiding them in future studies.

RESULTS

The study closed after two years because few countries were activated and patient recruitment was low. This was related to multiple challenges including delayed implementation, stringent pharmacovigilance requirements, objections of investigators and patients to the burden of multiple PROs, data collection issues, lack of resources at study sites, little engagement of patients and competing clinical trials, which further limited recruitment. At study closure, 269 patients had been enrolled in four of nine participating countries.

CONCLUSIONS

Researchers planning studies similar to ECHO may want to consider the barriers identified in this global registry of PWH and suggestions to mitigate these limitations, such as greater patient involvement in design and analysis, clearer assessment and understanding of local infrastructure and potential changes to the administration of the study.

Non-severe haemophilia: Is it benign? - Insights from the PROBE study

INTRODUCTION

There are limited data on the impact of haemophilia on health status and health-related quality of life (HRQL) in people with non-severe (mild and moderate) haemophilia.

AIM

To evaluate the health status of people living with mild or moderate haemophilia.

METHODS

Data on respondents with no bleeding disorder (NoBD), mild and moderate haemophilia patients were drawn from the PROBE study. Respondents were enrolled using network patient organizations. This analysis was performed as a cross-sectional study. Primary outcomes were reported bleeding, acute and chronic pain, activities of daily living and HRQL.

RESULTS

A total of 862 respondents with NoBD (n = 173), mild (n = 102) and moderate (n = 134) haemophilia were eligible, with a median age of 33, 42 and 43, respectively. In relation to haemophilia-related sequalae, 53% of male and 29% of female patients with mild and 83% of males with moderate haemophilia had more than 2-3 bleeds in the last 12 months. Reporting of acute and chronic pain is less in those with NoBD compared to the mild and moderate cohorts for both genders. Multivariate analysis demonstrates significant reductions in quality of life using VAS, EQ-5D-5L and PROBE for males with mild and moderate haemophilia (P ≤ .001) with only PROBE indicating a significant reduction for females with mild (P = .002).

CONCLUSION

People affected by mild or moderate haemophilia report a significant HRQL impact due to haemophilia-related bleeding. Future research is needed to identify the optimal care management of patients with mild and moderate haemophilia.

The national blueprint for 21st century data and specimen collection and observational cohort studies: NHLBI State of the Science Workshop on factor VIII inhibitors

INTRODUCTION

A devastating complication of hemophilia A, the congenital deficiency of coagulation factor VIII (FVIII), therapy is the development of inhibitory antibodies (inhibitors) to infused FVIII concentrate affecting up to 30% of people with the most severe form of the disease. Although the number of patients affected by hemophilia A with inhibitors is small, the physical, emotional, financial, and public health impact is overwhelming to the patient, family, and medical system. To best serve this patient population, as well as enhance knowledge around this complication, a robust data and specimen collection strategy must be designed.

AIM

Working Group 2 (WG2) of the National Heart, Lung, and Blood Institute (NHLBI)- sponsored State of the Science (SOS) workshop on factor VIII inhibitors in 2018 was tasked with developing recommendations around the conduct of research, modeling efficient data and specimen collection, developing infrastructure support, establishing partnerships with all stakeholders, including international collaborators, addressing ethical issues, maximizing patient/family engagement and promoting training opportunities.

METHODS

A group with diverse expertise was assembled who reviewed the current state of data and specimen collection in patients with hemophilia and developed recommendations for the future.

RESULTS

Our results were presented at the SOS Workshop where additional feedback was gained.

CONCLUSION

Our charge and recommendations are summarized in this manuscript.

Hemophilia trials in the twenty-first century: Defining patient important outcomes

Treatment for hemophilia has advanced dramatically over the past 5 decades. Success of prophylactic therapy in preventing bleeding and decreasing associated complications has established a new standard of care. However, with the advent of gene therapy and treatments that effectively mimic sustained coagulation factor replacement, outcome measures that worked well for assessing factor replacement therapies in past clinical trials need to be reassessed. In addition, while therapies have advanced, so has the science of outcome assessment, including recognition of the importance of patient important and patient reported outcomes. This manuscript reviews strengths and limitations of outcome measures used in hemophilia from both a provider and patient perspective.