Patient, caregiver and clinician views on engagement in comparative effectiveness research

Lessons Learned with a Triad of Stakeholder Advisory Boards: Working with Adolescents, Mothers, and Clinicians to Design the TRUST Study

Optimal care for pediatric and adolescent patients is carried out under a triadic engagement model, whereby the patient, caregiver, and clinician work in collaboration. Seeking input from all triad members in the development and implementation of clinical trials and interventions may improve health outcomes for children and adolescents. Sufficient evidence demonstrating how to effectively engage stakeholders from all branches of this triadic model is lacking. We address this gap by describing the successes and challenges our team has encountered while convening advisory groups with adolescent patients, parent stakeholders, and their clinicians to assist in the development and deployment of a technology-based intervention to promote the utilization of sexual and reproductive health services by increasing adolescent-clinician alone-time. Each stakeholder group contributed in unique and complementary ways. Working with advisors, our team aligned the priorities of each group with the goals of the research team. The results were improvements made in the content, design, and delivery of the TRUST intervention. While we were largely successful in the recruitment and engagement of adolescent patients and clinicians, we had less success with parents. Future research will need to explore additional strategies for recruitment and engagement of parents, particularly in rural, minority, and underserved communities.

Benefits and barriers to engagement of mental health caregivers in advisory roles: Results from a cross-sectional survey

Background and Aims

Mental health institutions and community organizations have had difficulty recruiting patients and caregivers onto their Patient, Family, and Community Advisory Committees (PFACs). Previous research has focused on barriers and enablers of engaging patients and caregivers who have advisory experience. This study acknowledges the experiential difference between patients and caregivers by focusing only on caregivers; further, we compare the barriers and enablers between advising versus non-advising caregivers of loved ones with mental illness.

Methods

Data from a cross-sectional survey codesigned by researchers, staff, clients, and caregiver affiliated with a tertiary mental health center were completed by n = 84 caregivers (n = 40 past/current PFAC advising caregivers; n = 44 non-advising caregivers).

Results

Caregivers were disproportionately female and late middle-aged. Advising and non-advising caregivers differed on employment status. There were no differences of the demographics of their care-recipients. More non-advising caregivers reported being hindered from PFAC engagement by family-related duties and interpersonal demands. Finally, more advising caregivers considered being publicly acknowledged as important.

Conclusions

Advising and non-advising caregivers of loved ones with mental illness were similar in demographics and in reporting the enablers and hindrances that impact PFAC engagement. Nevertheless, our data highlights specific considerations that institutions/organizations should consider when recruiting and retaining caregivers on PFACs.

Patient or Public Contribution

This project was led by a caregiver advisor to address a need she saw in the community. The surveys were codesigned by a team of two caregivers, one patient, and one researcher. The surveys were reviewed by a group of five caregivers external to the project. The results of the surveys were discussed with two caregivers involved directly with the project.

Consumer involvement in research - parent perceptions of partnership in cerebral palsy research: a qualitative study

PURPOSE

Identify perceptions of parents and caregivers of children with cerebral palsy about being consumer research partners and identify strategies to inform involvement of parents in cerebral palsy research.

MATERIALS AND METHODS

Twenty-two parents in New South Wales and Victoria (Australia) participated in this qualitative study. Seven interviews and three focus groups were completed. Interpretive description guided data analysis. Methodological rigor was enhanced through involving two consumer investigators in the research team, member checking, and multiple researchers completing data analysis and theme generation.

RESULTS

Participants identified a range of factors that may influence their involvement in research partner roles. Main topics emerging from the data included "Research Is Better with Parents" and "Parents Benefit from Being Research Partners." A third, "Parents as Research Partners," contained the themes "Flexible Involvement," "Starting Partnerships," and "Building and Sustaining Partnerships."

CONCLUSION

This study has provided a rich insight into how parents perceive and describe engaging as research partners. Parent-identified guidance will inform future partnerships aiming to enhance the quality of cerebral palsy research and outcomes for people with cerebral palsy and their families. The involvement of consumer investigators in this study was considered valuable for enhancing the quality and applicability of the research.IMPLICATIONS FOR REHABILITATIONParents believed that parent partnership in research has benefits for the research and for the consumers involved.Parents provided guidance about the importance of starting, building and sustaining relationships in involving parents as research partners.Understanding the parent context, investing in relationships and acknowledgement of, and recognition for, contributions were considered important for building and sustaining effective partnerships.Flexible approaches to supporting parents as research partners was considered necessary for effective partnership.

Technological and Rehabilitative Concerns: Perspectives of Cochlear Implant Recipients Who Are Musicians

In these perspectives, we share the experiences of eight cochlear implant (CI) recipients who are musicians, and their efforts within and outside of audiological appointments to achieve satisfying music experiences. Their experiences were previously shared in a panel discussion as part of the 3^rd Music and Cochlear Implant Symposium hosted at The University of Cambridge, United Kingdom. Following the symposium, the panel members and moderator developed and completed a follow-up questionnaire to facilitate a formal analysis of the following questions: (a) What forms of support for optimizing music exist within clinical CI appointments, including counseling, mapping, assessment, and rehabilitation? (b) What forms of support do CI users who are interested in music desire? (c) What self-initiated approaches can be used to improve music perception, enjoyment, and participation? Using qualitative methodology, the questionnaire data were coded, aggregated into themes, and then into core categories. The primary themes that emerged from the data were (a) limited levels of support for optimizing music outcomes within normal clinical appointments, (b) difficulties in current mapping and assessment in relation to music perception, and (c) limited availability of clinically sponsored training/rehabilitation for music. These CI recipients then recommended clinical protocol changes and described self-initiated rehabilitation. These findings were examined in relation to literature on clinical practices for CI users, auditory rehabilitation, and patient-centered care, emphasizing best practices and barriers to audiological care. The data as related to healthcare trends were conceptualized and developed into a proposed Reciprocal Model for Music Rehabilitation (RMMR).

Promoting community stakeholder engagement in research on treatment for pregnant women with opioid use disorder

Aim: Community stakeholder engagement in research (CSER) can improve research relevance and efficiency as well as prevent harmful practices, particularly for vulnerable populations. Despite potential benefits, researchers lack familiarity with CSER methods. Methods: We describe CSER strategies used across the research continuum, including proposal development, study planning and the first years of a comparative effectiveness study of care for pregnant women with opioid use disorder. Results: We highlight successful strategies, grounded in principles of engagement, to establish and maintain stakeholder relationships, foster bidirectional communication and trust and support active participation of women with opioid use disorder in the research process. Conclusion: CSER methods support research with a disenfranchised population. Future work will evaluate the impact of CSER strategies on study outcomes and dissemination.

Patient Interaction Involving Older Adults: Provider vs. Caregiver Expectations

This paper presents a study of the interaction between healthcare providers (HCPs) and older patients and their caregivers. The paper first presents results from a rapid review and narrative synthesis using PubMed and Google Scholar of HCP/patient/caregiver interactions involving older patients; these results then informed the design of a survey administered to HCPs and caregivers using a range of scenarios and their ratings of appropriateness of different responses, to explore where expectations align or differ between HCPs and caregivers. In analyzing ratings, the research found HCPs and caregivers generally approach the older adult encounter with similar expectations, but differences for specific situations are informative. HCPs appear to better recognize when there is a need to show empathy, as when a patient is frustrated or anxious. HCPs, overall, offer more calming responses, especially in embarrassing, upsetting, or worrying situations. For older patients of advanced age, HCPs value engagement with patients more than caregivers, but HCPs are more aligned with caregivers in their ratings of how to engage caregivers. Compared to caregivers, HCPs focus more on simplifying the description of treatment rather than using thorough explanations when a patient expresses hesitancy or avoidance. The results from this work suggest that having a fuller understanding of the different participants’ expectations may improve communication and identify potential pitfalls. A better understanding may also lead to changes in how students in the healthcare fields are trained; having better insight into this relationship will prepare them for interacting with older patients while addressing the needs of caregivers.

Enhancing community engagement in Patient-Centered Outcomes Research: Equipping learners to thrive in translational efforts

Community engagement is a critical component of translational research. Innovative educational approaches to support meaningful involvement of stakeholders in clinical research allows for bidirectional learning and greater engagement in translational efforts. Our Penn State Community-Engaged Research Core (CeRC) team has developed an innovative research curriculum for a variety of stakeholders, including patient partners, organizational representatives, and Community Health Workers (CHWs). This brief report will outline unique curricular approaches, guided by adult learning principles, to enhance stakeholder education and engagement in activities. Initial evidence of impact on learning is also reported.

What works when: mapping patient and stakeholder engagement methods along the ten-step continuum framework

Aim: This study provides a recommended 'patient engagement translation table' that identifies evidence-based methods for meaningful patient engagement along a ten-step framework for continuous engagement. Materials & methods: We used a mixed methods research design to collect data on preferred engagement methods, including an environmental scan of available literature, interviews and focus groups with patient-centered outcomes research stakeholders to match methods with research steps and a modified Delphi process with subject matter experts to create the final translation table. Results: Evidence-based engagement methods included community partnerships, focus groups, interviews, meetings, sharing print materials, social media, storytelling, surveys and including patients as research team members. Conclusion: Our recommended patient engagement translation table is designed to assist investigators in determining appropriate engagement methods for meaningful interactions with stakeholders.

Engaging patients and caregivers to establish priorities for the management of diabetic foot ulcers

OBJECTIVE

Effective diabetic foot ulcer (DFU) care has been stymied by a lack of input from patients and caregivers, reducing treatment adherence and overall quality of care. Our objectives were to capture the patient and caregiver perspectives on experiencing a DFU and to improve prioritization of patient-centered outcomes.

METHODS

A DFU-related stakeholder group was formed at an urban tertiary care center. Seven group meetings were held across 4 months, each lasting ∼1 hour. The meeting facilitator used semistructured questions to guide each discussion. The topics assessed the challenges of the current DFU care system and identified the outcomes most important to stakeholders. The meetings were audio recorded and transcribed. Directed and conventional content analyses were used to identify key themes.

RESULTS

Six patients with diabetes (five with an active DFU), 3 family caregivers, and 1 Wound Clinic staff member participated in the stakeholder group meetings. The mean patient age was 61 years, four (67%) were women, five (83%) were either African American or Hispanic, and the mean hemoglobin A1c was 8.3%. Of the five patients with a DFU, three had previously required lower extremity endovascular treatment and four had undergone at least one minor foot amputation. Overall, stakeholders described how poor communication between medical personnel and patients made the DFU experience difficult. They felt overwhelmed by the complexity of DFU care and were persistently frustrated by inconsistent medical recommendations. Limited resources further exacerbated their frustrations and barriers to care. To improve DFU management, the stakeholders suggested a centralized healthcare delivery pathway with timely access to a coordinated, multidisciplinary DFU team. The clinical outcomes most valued by stakeholders were (1) avoiding amputation and (2) maintaining or improving health-related quality of life, which included independent mobility, pain control, and mental health. From these themes, we developed a conceptual model to inform DFU care pathways.

CONCLUSIONS

Current DFU management lacks adequate care coordination. Multidisciplinary approaches tailored to the self-identified needs of patients and caregivers could improve adherence. Future DFU-related comparative effectiveness studies will benefit from direct stakeholder engagement and are required to evaluate the efficacy of incorporating patient-centered goals into the design of a multidisciplinary DFU care delivery system.

Defining Patient Engagement in Research: Results of a Systematic Review and Analysis: Report of the ISPOR Patient-Centered Special Interest Group

OBJECTIVES

Lack of clarity on the definition of "patient engagement" has been highlighted as a barrier to fully implementing patient engagement in research. This study identified themes within existing definitions related to patient engagement and proposes a consensus definition of "patient engagement in research."

METHODS

A systematic review was conducted to identify definitions of patient engagement and related terms in published literature (2006-2018). Definitions were extracted and qualitatively analyzed to identify themes and characteristics. A multistakeholder approach, including academia, industry, and patient representation, was taken at all stages. A proposed definition is offered based on a synthesis of the findings.

RESULTS

Of 1821 abstracts identified and screened for eligibility, 317 were selected for full-text review. Of these, 169 articles met inclusion criteria, from which 244 distinct definitions were extracted for analysis. The most frequently defined terms were: "patient-centered" (30.5%), "patient engagement" (15.5%), and "patient participation" (13.4%). The majority of definitions were specific to the healthcare delivery setting (70.5%); 11.9% were specific to research. Among the definitions of "patient engagement," the most common themes were "active process," "patient involvement," and "patient as participant." In the research setting, the top themes were "patient as partner," "patient involvement," and "active process"; these did not appear in the top 3 themes of nonresearch definitions.

CONCLUSION

Distinct themes are associated with the term "patient engagement" and with engagement in the "research" setting. Based on an analysis of existing literature and review by patient, industry, and academic stakeholders, we propose a scalable consensus definition of "patient engagement in research."

Clinician engagement in research as a path toward the learning health system: A regional survey across the northwestern United States

Introduction:

Increased research engagement of frontline, community-based clinicians could result in greater research relevancy, increased likelihood of implementation into practice, and improved health care for patients. Establishment of learning health systems within health-care organizations may facilitate this process.

Methods:

In 2016, the U.S. Northwest Participant and Clinical Interactions Network conducted a region-wide survey in four community-based health systems to identify barriers to clinician involvement in research and understand clinician interest and levels of engagement.

Results:

Survey responses indicated broad interest in research’s value to patients (77% of respondents), contribution to clinical evidence (79%), and fulfillment of intellectual curiosity (77%). Engagement was not always correlated with interest. Top barriers included time (65%), support (34%), and getting started (32%).

Conclusion:

In community health systems in the northwestern United States, clinician interest in research exists but with several significant barriers. Leveraging the learning health system movement may be one way to increase focus on research and address identified barriers.

Adult Cochlear Implant Recipients' Perspectives on Experiences With Music in Everyday Life: A Multifaceted and Dynamic Phenomenon

BACKGROUND

Cochlear implants (CIs), which have been designed primarily to support spoken communication of persons with severe to profound hearing loss, are highly effective in supporting speech perception in quiet listening conditions. CI users as a group achieve significantly poorer perception and appraisal of music, and speech perception is compromised when background music is present, though outcomes vary considerably across recipients. A number of factors have been identified that contribute to variable music listening experiences, but many questions remain, particularly regarding experiences in everyday life from the perspective of CI users.

PURPOSE

The purpose of this study was twofold: The first aim was to explore the perspectives of adult CI recipients regarding two experiences with music in everyday life: purposeful music listening and background music that competes with spoken conversation. The second aim was to develop a framework of everyday music experiences based upon CI perspectives that could inform future rehabilitative practices and research initiatives.

METHODS

Qualitative and patient-engaged research methodologies were used to emphasize the perspectives of the CI users. Participants included 40 experienced adult CI users ranging in age from 19 to 81 enrolled in 13 CI centers. Participants completed on-line semi-structured open-ended questionnaires regarding purposeful music listening and background music in conjunction with spoken communication. Responses were analyzed using an iterative inductive coding process consistent with grounded theory methodology. The interrelated themes that emerged from the data were then organized into a model synthesizing components from models on music response and self-management for persons with chronic health conditions.

OUTCOMES

Data analyses informed the development of a Dynamic Problem Solving Model for Management of Music Listening Environments adapted from Hill-Briggs (2003) Problem Solving Model of Chronic Illness Self-Management. Key findings were: (1) Music listening is a dynamic, multifaceted experience; satisfactory listening depended upon optimal combinations of factors; (2) Music listening is effortful, but the extent of satisfaction is influenced by expectations and self-management of the situation; (3) CI users have limited access to resources for optimizing music experiences. Many CI users would consider rehabilitation, but level of commitment and priorities differ across CI users.

Stakeholder engagement in research: a scoping review of current evaluation methods

Aim: Evaluating stakeholder engagement can capture what meaningful engagement in research entails, how it develops, and how it is experienced by all collaborators. We conducted a scoping review of recent approaches for evaluating engagement in research and present a descriptive overview of our findings. Methods: We searched peer-reviewed journal articles published worldwide in English between January 2013 and June 2018. Results: Our final sample consisted of 17 articles. Various approaches for evaluating stakeholder engagement were identified including qualitative approaches, surveys and engagement logs. Discussion & conclusion: We identified evaluation approaches that varied in quality, detail and methods. Valid, systematic and inclusive approaches that are developed with research partners and are inclusive of diverse perspectives are an important area for future research.

A Culture-Centered Community-Grounded Approach to Disseminating Health Information among African Americans

This study highlights the role of local communities in creating culturally rooted health information resources based on comparative effectiveness research (CER), depicting the role of culture in creating entry points for building community-grounded communication structures for evidence-based health knowledge. We report the results from running a year-long culture-centered campaign that was carried out among African American communities in two counties, Lake and Marion County, in Indiana addressing basic evidence-based knowledge on four areas of cardiovascular disease (CVD). Campaign effectiveness was tested through an experimental design with post-test knowledge of CER among African Americans in these counties compared to CER knowledge among African Americans in a comparable control county (Allen). Our campaign, based on the principles of the culture-centered approach (CCA), increased community CER knowledge in the experimental communities relative to a community that did not receive the culturally centered health information campaign. The CCA-based campaign developed by community members and distributed through the mass media, community wide channels such as health fairs and church meetings, postcards, and face-to-face interventions explaining the postcards improved CER knowledge in specific areas (ACE-I/ARBs, atrial fibrillation, and renal artery stenosis) in the CCA communities as compared to the control community.

Patient-Community Perspectives on Real-World Evidence: Enhancing Engagement, Understanding, and Trust

BACKGROUND

Healthcare stakeholders have pronounced both enthusiasm and apprehension over the expanding use of real-world evidence (RWE). The patient community-those who benefit from new treatments but are vulnerable to potential safety risks and whose routine medical encounters are used to generate RWE-has been less vocal. Understanding patient perspectives on the use of RWE to guide clinical decision making and inform regulatory decisions and value assessments is imperative.

METHODS

We convened a day-long, multi-stakeholder roundtable in Washington D.C., USA, on 31 July 2017 to gather patient-community views on RWE and related concerns and the communications, information and tools needed by patients to understand, trust, and use RWE. Participants included a convenience sample of National Health Council (NHC) members primarily representing patient groups as well as non-patient members with an interest in RWE. Participants were organized into small, pre-assigned groups, ensuring representativeness across stakeholders and patient leadership. Discussions, including storyboards, notes, and illustrative examples were captured and later analyzed thematically by NHC staff.

RESULTS

Ten RWE themes emerged: (1) most patients were unaware of RWE and its actual or potential uses, (2) common definitions for real-world data and RWE are needed, (3) patient organizations need RWE skills and tools, (4) patient-scientist partnerships can help differentiate high-quality RWE, (5) RWE should inform decision making, (6) clinician support is needed for RWE uptake in patient decision making, (7) communications to patients should be balanced and empowering, (8) context of use impacts RWE acceptability/trust, (9) privacy/data ownership require clarity, and (10) patient-generated data are also real-world data (RWD).

CONCLUSION

Patients see great possibility in using RWE to understand how a treatment works-to find someone that "looks like me" as assurance of how a treatment might benefit them personally. Patient groups will play a critical role in helping to educate constituents on understanding, contributing to, and using RWE. To maximize patient uptake and the co-development and application of RWE, patient groups require education and tools.

Factors associated with evidence-based decision-making among patients and providers

Aim: For comparative effectiveness research to achieve its purpose, providers and patients must use research evidence to make medical decisions. Therefore, this study examined factors associated with evidence-based decision-making by patients and providers. Methods: Data were collected via cross-sectional online surveys of patients (n = 603) and providers (n = 628) between November 2011 and January 2012. Results: For both patients and providers, evidence-based medical decision-making is associated with perceptions, that is, some combination of self efficacy, attitudes and opinions. However, whereas knowledge is the most consistent factor associated with decision-making for providers, it is not associated at all for patients. Conclusion: Efforts to promote evidence-based medical decision-making among patients and providers should focus on skills training to improve self efficacy, and messages that highlight the benefits of patient engagement in medical decisions.

PaTH to partnership in stakeholder-engaged research: A framework for stakeholder engagement in the PaTH to Health Diabetes study

Engaging a diverse stakeholder group, including patients, clinicians, policy makers, and leadership from national professional organizations as partners in research supports the pursuit of patient-centered outcomes. Utilizing the Patient-Centered Outcomes Research (PCOR) Engagement Principles and applying adult learning theories to training opportunities can enhance stakeholder-investigator collaborations. Regularly scheduled study meetings with stakeholders can help streamline communication, offer a platform for stakeholder voices to be shared, and increase study productivity. Ongoing engagement evaluations provide an important opportunity to assess engagement activities and improve processes moving forward. Benefits of a robust patient partner and stakeholder body extend beyond the study's objectives and translate into the creation of larger networks where resources are shared and patient-centeredness is enhanced.

Leveraging Patient/Community Partnerships to Disseminate Patient Centered Outcomes Research in Geriatrics

Background: With the growth of patient-centered outcomes research (PCOR), partnerships between researchers and patients have presented novel opportunities for disseminating results. A large gap exists in disseminating patient-centered research results to older adult patient end-users. We sought to examine the experiences of patient/community partners in disseminating PCOR results and characterize lessons learned that may facilitate future researcher-patient/community dissemination partnerships. Methods: Patient/community partners who participated in geriatrics-focused PCORI-funded research and were active in disseminating results, as part of their planned activities, were recruited for one-to-one qualitative interviews. Constant comparative and thematic analysis were used to identify and describe common themes that emerged in a survey of open-ended questions. Results: Ten individuals (four community partners, six patients) aged 55–87 years were interviewed. Analysis revealed that for successful dissemination, subjects felt it was vital to reach out to people affected by the results, leverage personal stories, and tap into pre-developed programming. Patient/Community partners identified potential audiences through word-of-mouth, community requests, and mapping a list of audiences—targeting those directly affected as well as those who worked with the audience (e.g., not specifically medical). Patient/community partners recommended that researchers engage patient/community partners for suggestions on audiences, show empathy, include diverse populations, and maintain a community-focus. One community partner stated, “Why wouldn’t we help disseminate results? It’s a no-brainer. We know people!” Conclusion: Patient/community partners provide effective ways to communicate results, new audiences to reach, improved communication with different audiences, and improved credibility of the findings. The lessons learned have implications for assisting future research-patient/community partnerships in the dissemination of their patient-centered research.

Practical Guidance for Involving Stakeholders in Health Research

Stakeholder engagement is increasingly common in health research, with protocols for engaging multiple stakeholder groups becoming normative in patient-centered outcomes research. Previous work has focused on identifying relevant stakeholder groups with whom to work and on working with stakeholders in evidence implementation. This paper draws on the expertise of a team from four countries-Canada, Australia, the UK, and the USA-to provide researchers with practical guidance for carrying out multi-stakeholder-engaged projects: we present a list of questions to assist in selecting appropriate roles and modes of engagement; we introduce a matrix to help summarize engagement activities; and we provide a list of online resources. This guidance, matrix, and list of resources can assist researchers to consider more systematically which stakeholder groups to involve, in what study roles, and by what modes of engagement. By documenting how stakeholders are paired up with specific roles, the matrix also provides a potential structure for evaluating the impact of stakeholder engagement.

Partnering with insiders: A review of peer models across community-engaged research, education and social care

Within community-engaged research, education and social care, peer models that partner with local "insiders" are increasingly common. Peer models are composed of insider "lay" community members who often share similarities or background with a project's target population. Peers are not academically trained, but work alongside researchers and professionals to carry out specific tasks within a project, or in the truest sense of partnership, peers collaborate throughout the project from start to finish as an equal member of the team. Although peer models are used widely, the literature lacks consistency and clarity. This systematic review of literature used a qualitative thematic synthesis to examine and report how, where and why peer models have been used in research, education and social care. We examined the language and titles used to describe the peers, details of their involvement in community-engaged projects, the setting, content/topic of study, level of engagement and related benefits/outcomes of such models. Focusing on the last 10 years, we conducted a comprehensive literature search twice between September 2016 and June 2017. The search resulted in 814 articles which were assessed for eligibility. Overall, 251 articles met our inclusion criteria and were categorised into three categories: empirical (n = 115); process/descriptive (n = 93); and "about" peers (n = 43). Findings suggest that there is a wide variety of peers, titles and terminology associated with peer models. There is inconsistency in how these models are used and implemented in research studies and projects. The majority of articles used an employment peer model, while only a handful involved peers in all phases of the project. The results of this literature review contribute to understanding the use, development and evolution of peer models. We highlight potential benefits of peer models for peers, their communities and community-engaged work, and we offer recommendations for future implementation of peer models.

Introducing Volume 7 of the Journal of Comparative Effectiveness Research

Welcome to the seventh volume of the Journal of Comparative Effectiveness Research. It is great to start the year with a look back at some of our successes from 2017, as well as a look forward to the content of this issue and beyond.

Good practices for real-world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR-ISPE Special Task Force on real-world evidence in health care decision making

PURPOSE

Real-world evidence (RWE) includes data from retrospective or prospective observational studies and observational registries and provides insights beyond those addressed by randomized controlled trials. RWE studies aim to improve health care decision making.

METHODS

The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) created a task force to make recommendations regarding good procedural practices that would enhance decision makers' confidence in evidence derived from RWD studies. Peer review by ISPOR/ISPE members and task force participants provided a consensus-building iterative process for the topics and framing of recommendations.

RESULTS

The ISPOR/ISPE Task Force recommendations cover seven topics such as study registration, replicability, and stakeholder involvement in RWE studies. These recommendations, in concert with earlier recommendations about study methodology, provide a trustworthy foundation for the expanded use of RWE in health care decision making.

CONCLUSION

The focus of these recommendations is good procedural practices for studies that test a specific hypothesis in a specific population. We recognize that some of the recommendations in this report may not be widely adopted without appropriate incentives from decision makers, journal editors, and other key stakeholders.