The Missing Reality of Real Life in Real-World Evidence

Patient-Focused Drug Development and Real World Study

Background

Patient-focused drug development (PFDD) is an important direction in the field of medical research and is of great significance to the development of medicine. In recent years, PFDD and real-world study (RWS) have gained much interest, of which both have their advantages. This study aims to promote research methods innovation and optimize clinical research design and implementation.

Methods

After a brief introduction of PFDD and RWS, this review focused on the comparison of clinical trials of PFDD and RWS in terms of objectives, Population, Intervention, Comparator, Outcome (PICO) elements, research team members, data acquisition, and research key points, and clarified the feasibility and significance of "patient-focused RWS" research model.

Results

PFDD emphasized that patients' needs as well as the willingness and satisfaction of patients should be considered throughout the whole research process and the patient experience data should be collected during the study development and drug use. RWS emphasized the facticity of research implementation environment and the breadth of patient sources, which concerned the problem of the extrapolation of study results, the clinical localization, and patient applicability of the target drug. However, there is a connection between both of the above. Both clinical trials of PFDD and RWS bring benefits to patients.

Conclusions

Combining PFDD idea and RWS research method to carry out new research will maximize the benefits for patients. The study model combining the PFDD concept with RWS can facilitate drug development and dissemination, which can be popularized and applied in various research areas. This study can innovate research methods and provide new ideas for future research.

Co-creating tools for embedding meaningful patient and public involvement and engagement in real-world data and evidence research in the pharmaceutical industry setting: a multistakeholder participatory co-design study

OBJECTIVES

This study aimed to (1) gauge patients understanding and expectations of real-world data and evidence (RWDE) research and (2) use this understanding and patients lived experience to co-create resources and a framework for embedding meaningful patient and public involvement and engagement (PPIE) in RWDE research within the pharmaceutical industry setting.

SETTING AND PARTICIPANTS

An academic organisation, a pharmaceutical company and a PPIE panel of 12 patients or carers partnered to form the project team. The PPIE panel was purposively selected to maximise diversity.

DESIGN

Participatory and co-design methods were used to engender an understanding of the PPIE perspective on RWDE research and the PPIE role within that. Interactive workshops explored understanding and expectations of RWDE research as well as perceived barriers and facilitators of PPIE within each stage of the RWDE research cycle. Workshops were audio and video recorded, with notes captured. Summaries were analysed thematically and shared back with the PPIE panel for validation and further reflection.

RESULTS

We identified a lack of trust and understanding of real-world data, its collection and use and the need to educate the public and researchers. Four themes were identified for meaningful PPIE in RWDE research; equality, diversity and inclusion; feeling valued; ownership and understanding and evaluating impact. We co-created learning resources (video, infographic) and a novel PPIE framework, incorporating potential PPIE activities, resources and support needs for use by researchers conducting RWDE research.

CONCLUSIONS

To our knowledge, this is the first project to explore the practicalities of PPIE in RWDE research from the perspective of patients and carers. Some findings confirm PPIE experience and guidance derived from other areas, with some specific insights into the pharmaceutical industry. These underpin the PPIE framework to enable robust and meaningful PPIE in RWDE research. This article includes a plain language summary in the supplement.

Wearable activity tracker study exploring rheumatoid arthritis patients' disease activity using patient-reported outcome measures, clinical measures, and biometric sensor data (the wear study)

Background

Digital health studies using electronic patient reported outcomes (ePROs), wearables, and clinical data to provide a more comprehensive picture of patient health.

Methods

Newly initiated patients on upadacitinib or adalimumab for RA will be recruited from community settings in the Excellence NEtwork in RheumatoloGY (ENRGY) practice-based research network. Over the period of three to six months, three streams of data will be collected (1) linkable physician-derived data; (2) self-reported daily and weekly ePROs through the ArthritisPower registry app; and (3) biometric sensor data passively collected via wearable. These data will be analyzed to evaluate correlations among the three types of data and patient improvement on the newly initiated medication.

Conclusions

Results from this study will provide valuable information regarding the relationships between physician data, wearable data, and ePROs in patients newly initiating an RA treatment, and demonstrate the feasibility of digital data capture for Remote Patient Monitoring of patients with rheumatic disease.

Designing daily-life research combining experience sampling method with parallel data

BACKGROUND

Ambulatory monitoring is gaining popularity in mental and somatic health care to capture an individual's wellbeing or treatment course in daily-life. Experience sampling method collects subjective time-series data of patients' experiences, behavior, and context. At the same time, digital devices allow for less intrusive collection of more objective time-series data with higher sampling frequencies and for prolonged sampling periods. We refer to these data as parallel data. Combining these two data types holds the promise to revolutionize health care. However, existing ambulatory monitoring guidelines are too specific to each data type, and lack overall directions on how to effectively combine them.

METHODS

Literature and expert opinions were integrated to formulate relevant guiding principles.

RESULTS

Experience sampling and parallel data must be approached as one holistic time series right from the start, at the study design stage. The fluctuation pattern and volatility of the different variables of interest must be well understood to ensure that these data are compatible. Data have to be collected and operationalized in a manner that the minimal common denominator is able to answer the research question with regard to temporal and disease severity resolution. Furthermore, recommendations are provided for device selection, data management, and analysis. Open science practices are also highlighted throughout. Finally, we provide a practical checklist with the delineated considerations and an open-source example demonstrating how to apply it.

CONCLUSIONS

The provided considerations aim to structure and support researchers as they undertake the new challenges presented by this exciting multidisciplinary research field.

Data Governance for Real-World Data Management: A Proposal for a Checklist to Support Decision Making

OBJECTIVES

Real-world data (RWD) and real-world evidence (RWE) can provide extensive information on healthcare for use in health technology assessment and decision making. Nevertheless, there is a lack of consensus surrounding the appropriate data governance (DG) practices for RWD/RWE. Data sharing is also a large concern, especially considering evolving data protection regulations. Our objective is to propose recommendations for international standards of evaluating the acceptability of RWD governance practices.

METHODS

After reviewing the literature, we created a checklist targeting DG practices for RWD/RWE. We then carried out a 3-round Delphi panel, including European policy makers, health technology assessment experts, and hospital managers. The consensus for each statement was measured and the checklist adjusted accordingly.

RESULTS

The literature review identified the main topics regarding RWD/RWE DG practices: data privacy and security, data management and linkage, data access management, and the generation and use of RWE. Members of the Delphi panel (21 experts/25 invited) were presented a total of 24 statements related to each of the topics. Experts demonstrated a progressive level of consensus and importance ratings in all topics and to most statements. We suggest a refined checklist in which the statements rated less important or with less consensus have been removed.

CONCLUSIONS

This study suggests how the DG of RWD/RWE could be qualitatively evaluated. We propose checklists that could be used by all RWD/RWE users to help ensure the quality and integrity of RWD/RWE governance and complement data protection law.

Enhancing Patient Centricity of Real-World Data Research: An Exploratory Analysis Using the Patient Experience Mapping Toolbox

OBJECTIVES

There is an increasing expectation that medical product development and assessment be guided by patient input captured through patient engagement. Recently published consensus guidelines describe how qualitative patient experience data (PED) can guide the design, conduct, and translation of real-world research that reflects patients' lived experience. The objective of this exploratory analysis is to examine how researchers could leverage PED captured through the Patient Experience Mapping Toolbox (PEMT) to guide real-world data (RWD) research designs.

METHODS

This exploratory analysis included a thematic analysis of interview transcripts collected while pilot testing the PEMT followed by a qualitative analysis of the emerging themes aligned with stages listed in the patient-centered real-world evidence, Real-World Research Design Framework.

RESULTS

PED collected using the PEMT include information about symptomology, interactions with the healthcare system, information-seeking behavior, misdiagnoses, lifestyle changes, treatments, side effects, and comorbidities. This information can be leveraged at key study design decisions, including (1) identifying study cohorts and subgroups, (2) identifying exposures, (3) informing covariates and potential confounders; and (4) refining study periods. Additionally, participants described where they seek information about treatments and diseases, which should inform dissemination strategies.

CONCLUSIONS

We identified opportunities for PED collected using the PEMT to inform RWD study designs. The PED described in this exploratory analysis stem from pilot testing of the PEMT across a variety of conditions. In the next phase of development in this area, researchers should evaluate how data collected using the PEMT can be applied to RWD research for a specific disease.

Real-world experience of OnabotulinumtoxinA treatment in female patients with chronic migraine: a qualitative study using in-depth interviews

BACKGROUND

Chronic migraine (CM) causes great disability and affects an individual's quality of life. OnabotulinumtoxinA (OBT-A, Botox®) was the first prophylactic treatment specifically indicated for CM. The aim of this study was to describe the experiences of women with CM treated with OBT-A.

MATERIALS AND METHODS

The study design is a qualitative descriptive study. A purposeful sampling of 30 women (mean age, 42.7; standard deviation, 10.6) who had received at least two administrations of OBT-A for CM (PREEMPT protocol) was performed. Data collection included in-depth interviews and researchers' field notes. A thematic analysis was carried out according to qualitative research guidelines.

RESULTS

Five themes were identified: (a) A long way to go before Botox®, (b) First time hearing about the treatment and its expectations, (c) The administration of Botox®, (d) Treatment effects, and (e) Follow-up. Patients described a long history of treatment failures prior to the start of OBT-A treatment. Information about this migraine treatment came from the neurologist; following the information, patients had high expectations, including unrealistic expectations regarding the onset and duration of effect. They acknowledged fear of the injections and some discomfort due to the procedure. With treatment, participants reported better migraine control and an improvement in their quality of life. Follow-up had some barriers, such as delayed appointments for subsequent doses, but also strengths, such as effectiveness and few side effects.

CONCLUSIONS

Qualitative research offers insight into how patients with CM experience treatment with OBT-A. Our results highlight some relevant aspects that should be considered when providing OBT-A treatment.

Developing Patient-Centered Real-World Evidence: Emerging Methods Recommendations From a Consensus Process

OBJECTIVES

The Joint ISPOR-ISPE Special Task Force on Real-World Evidence included patient/stakeholder engagement as a recommended good procedural practice when designing, conducting, and disseminating real-world evidence (RWE). However, there are no guidelines describing how patient experience data (PED) can be applied when designing real-world data (RWD) studies. This article describes development of consensus recommendations to guide researchers in applying PED to develop patient-centered RWE.

METHODS

A multidisciplinary advisory board, identified through recommendations of collaborators, was established to guide development of recommendations. Semistructured interviews were conducted to identify how experienced RWD researchers (n = 15) would apply PED when designing a hypothetical RWD study. Transcripts were analyzed and emerging themes developed into preliminary methods recommendations. An eDelphi survey (n = 26) was conducted to refine/develop consensus on the draft recommendations.

RESULTS

We identified 13 recommendations for incorporating PED throughout the design, conduct, and translation of RWE. The recommendations encompass themes related to the development of a patient-centered research question, designing a study, disseminating RWE, and general considerations. For example, consider how patient input can inform population/subgroups, comparators, and study period. Researchers can leverage existing information describing PED and may be able to apply those insights to studies relying on traditional RWD sources and/or patient registries.

CONCLUSIONS

Applying these emerging recommendations may improve the patient centricity of RWE through improved relevance of RWE to patient communities of interest and foster greater multidisciplinary participation and transparency in RWD research. As researchers gather experience by applying the methods recommendations, further refinement of these consensus recommendations may lead to "best practices."

Mobile-phone-based e-diary derived patient reported outcomes: Association with clinical disease activity, psychological status and quality of life of patients with multiple sclerosis

BACKGROUND

The applicability of mobile digital technology to promote clinical care of people with multiple sclerosis (pwMS) is gaining increased interest as part of the implementation of patient-centered approaches. We aimed at assessing adherence to a smartphone-based e-diary, which was designed to collect patient-reported outcomes (PROs). Secondary objectives were to evaluate the construct and predictive validity of e-diary derived PROs and to explore the various factors that were associated with changes in PROs over time.

MATERIALS AND METHODS

In this observational cohort study patients downloaded an MS tailored e-diary into their personal smartphones. Report of PROs was enquired once monthly for a period of one year through a smartphone-based application, using previously validated tools. An e-diary derived bodily function summary score (eBF) was defined as the sum of scores depicting vision, limbs function, pain, bowl/ bladder dysfunction, pseudobulbar affect and spasticity. Multiple linear regression and analysis of covariance were used to determine the association between PROs, clinician-reported outcomes (ClinROs) of disease activity and quality of life (QoL). Regression coefficient analysis was used to compare the slope of change in eBF before and after a relapse.

RESULTS

97 pwMS downloaded the e-diary [Female: 64 (66%), EDSS 3.4±2.1]. 76 patients (78%) completed the 12-month study period. 53 patients (55%) submitted ≥75% of requested surveys. Anxiety was negatively associated with adherence to periodic PROs assessments by the e-diary. E-diary derived PROs were significantly correlated with corresponding functional system scores (0.38< r <0.8, P<0.001). eBF score significantly predicted QoL (β = -0.36, P = 0.001) while EDSS did not. Change in eBF score over time was independently associated with the occurrence of an MS relapse (F = 4.4, P = 0.04), anxiety (F = 6.4, P = 0.01) and depression (F = 5.1, P = 0.03). Individual regression slopes of eBF scores were significantly higher pre-relapse than post-relapse (3.0±3.3 vs. -0.8±2.0, P = 0.007).

CONCLUSION

Adherence of pwMS to recording in an e-diary collecting PROs was high. Changes in e-diary derived PROs over time predict clinical MS relapses on the group level and thus carry the potential of usage in clinical research as well as for improved MS care in real world setting.

Adverse Drug Reaction Reporting Using a Mobile Device Application by Persons with Multiple Sclerosis: A Cluster Randomized Controlled Trial

INTRODUCTION

Patient reporting adds value to pharmacovigilance. Encouraging it to be done through a mobile device application (App) is a method that should be evaluated.

OBJECTIVE

This study aimed to determine whether the use of an App, compared to traditional use through e-mail, telephone, or the national website, increased suspected adverse drug reaction (ADR) reporting by persons with multiple sclerosis receiving a first-line disease-modifying drug.

METHODS

An open multi-centric, cluster-randomized controlled trial was conducted (VigipSEP study). Clusters were centers allocated (1:1) to the use of the My eReport France^® App (experimental arm), and traditional reporting (control arm). Persons with multiple sclerosis initiating or switching to a first-line disease-modifying drug between April 2017 and April 2019 were included. The primary outcome was the mean number of ADR reports per patient for the center-level analysis, and the number of ADR reports per patient for the individual-level analysis using the hierarchical Poisson regression model.

RESULTS

Twenty-four centers (12 per arm: six public neurologists from the multiple sclerosis academic expert centers, three public neurologists from general hospitals, and three private practice neurologists) were randomized, including 159 patients. The mean number of ADR reports per patient was significantly higher in centers that used the App: 0.47 vs 0.03 in control centers (p = 0.002). At an individual-level analysis, the experimental arm was significantly associated with a relative risk of ADR reports at 18.6 (95% confidence interval 4.1-84.2; p < 0.001), compared to the control arm, adjusted for sex and type of disease-modifying drug.

CONCLUSIONS

The use of a mobile App increased the ADR reporting by persons with multiple sclerosis receiving a first-line disease-modifying drug. CLINICALTRIALS.

GOV IDENTIFIER

NCT03029897, registered in 2017.