Patient and Stakeholder Engagement in the PCORI Pilot Projects: Description and Lessons Learned

Patient, caregiver and other knowledge user engagement in consensus-building healthcare initiatives: a scoping review protocol

INTRODUCTION

Patient engagement and integrated knowledge translation (iKT) processes improve health outcomes and care experiences through meaningful partnerships in consensus-building initiatives and research. Consensus-building is essential for engaging a diverse group of experienced knowledge users in co-developing and supporting a solution where none readily exists or is less optimal. Patients and caregivers provide invaluable insights for building consensus in decision-making around healthcare, policy and research. However, despite emerging evidence, patient engagement remains sparse within consensus-building initiatives. Specifically, our research has identified a lack of opportunity for youth living with chronic health conditions and their caregivers to participate in developing consensus on indicators/benchmarks for transition into adult care. To bridge this gap and inform our consensus-building approach with youth/caregivers, this scoping review will synthesise the extent of the literature on patient and other knowledge user engagement in consensus-building healthcare initiatives.

METHODS AND ANALYSIS

Following the scoping review methodology from Joanna Briggs Institute, published literature will be searched in MEDLINE, EMBASE, CINAHL and PsycINFO databases from inception to July 2023. Grey literature will be hand-searched. Two independent reviewers will determine the eligibility of articles in a two-stage process, with disagreements resolved by a third reviewer. Included studies must be consensus-building studies within the healthcare context that involve patient engagement strategies. Data from eligible studies will be extracted and charted on a standardised form. Abstracted data will be analysed quantitatively and descriptively, according to specific consensus methodologies, and patient engagement models and/or strategies.

ETHICS AND DISSEMINATION

Ethics approval is not required for this scoping review protocol. The review process and findings will be shared with and informed by relevant knowledge users. Dissemination of findings will also include peer-reviewed publications and conference presentations. The results will offer new insights for supporting patient engagement in consensus-building healthcare initiatives.

PROTOCOL REGISTRATION

https://osf.io/beqjr.

Patient engagement in designing, conducting, and disseminating clinical pain research: IMMPACT recommended considerations

ABSTRACT

In the traditional clinical research model, patients are typically involved only as participants. However, there has been a shift in recent years highlighting the value and contributions that patients bring as members of the research team, across the clinical research lifecycle. It is becoming increasingly evident that to develop research that is both meaningful to people who have the targeted condition and is feasible, there are important benefits of involving patients in the planning, conduct, and dissemination of research from its earliest stages. In fact, research funders and regulatory agencies are now explicitly encouraging, and sometimes requiring, that patients are engaged as partners in research. Although this approach has become commonplace in some fields of clinical research, it remains the exception in clinical pain research. As such, the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials convened a meeting with patient partners and international representatives from academia, patient advocacy groups, government regulatory agencies, research funding organizations, academic journals, and the biopharmaceutical industry to develop consensus recommendations for advancing patient engagement in all stages of clinical pain research in an effective and purposeful manner. This article summarizes the results of this meeting and offers considerations for meaningful and authentic engagement of patient partners in clinical pain research, including recommendations for representation, timing, continuous engagement, measurement, reporting, and research dissemination.

Does engagement matter? The impact of patient and community engagement on implementation of cardiovascular health materials in primary care settings

BACKGROUND

Engaging patients and community members in healthcare implementation, research and evaluation has become more popular over the past two decades. Despite the growing interest in patient engagement, there is scant evidence of its impact and importance. Boot Camp Translation (BCT) is one evidence-based method of engaging communities in research. The purpose of this report is to describe the uptake by primary care practices of cardiovascular disease prevention materials produced through four different local community engagement efforts using BCT.

METHODS

EvidenceNOW Southwest (ENSW) was a randomized trial to increase cardiovascular disease (CVD) prevention in primary care practices. Because of its study design, Four BCTs were conducted, and the materials created were made available to participating practices in the "enhanced" study arm. As a result, ENSW offered one of the first opportunities to explore the impact of the BCT method by describing the uptake by primary care practices of health messages and materials created locally using the BCT process. Analysis compared uptake of locally translated BCT products vs. all other products among practices based on geography, type of practice, and local BCT.

RESULTS

Within the enhanced arm of the study that included BCT, 69 urban and 13 rural practices participated with 9 being federally qualified community health centers, 14 hospital owned and 59 clinician owned. Sixty-three practices had 5 or fewer clinicians. Two hundred and ten separate orders for materials were placed by 43 of the 82 practices. While practices ordered a wide variety of BCT products, they were more likely to order materials developed by their local BCT.

CONCLUSIONS

In this study, patients and community members generated common and unique messages and materials for cardiovascular disease prevention relevant to their regional and community culture. Primary care practices preferred the materials created in their region. The greater uptake of locally created materials over non-local materials supports the use of patient engagement methods such as BCT to increase the implementation and delivery of guideline-based care. Yes, patient and community engagement matters.

TRIAL REGISTRATION AND IRB

Trial registration was prospectively registered on July 31, 2015 at ClinicalTrials.gov (NCT02515578, protocol identifier 15-0403). The project was approved by the Colorado Multiple Institutional Review Board and the University of New Mexico Human Research Protections Office.

Evaluating Readability, Understandability, and Actionability of Online Printable Patient Education Materials for Cholesterol Management: A Systematic Review

BACKGROUND

Dyslipidemia management is a cornerstone in cardiovascular disease prevention and relies heavily on patient adherence to lifestyle modifications and medications. Numerous cholesterol patient education materials are available online, but it remains unclear whether these resources are suitable for the majority of North American adults given the prevalence of low health literacy. This review aimed to (1) identify printable cholesterol patient education materials through an online search, and (2) evaluate the readability, understandability, and actionability of each resource to determine its utility in practice.

METHODS AND RESULTS

We searched the MEDLINE database for peer-reviewed educational materials and the websites of Canadian and American national health organizations for gray literature. Readability was measured using the Flesch-Kincaid Grade Level, and scores between fifth- and sixth-grade reading levels were considered adequate. Understandability and actionability were scored using the Patient Education Materials Assessment Tool and categorized as superior (>80%), adequate (50%-70%), or inadequate (<50%). Our search yielded 91 results that were screened for eligibility. Among the 22 educational materials included in the study, 15 were identified through MEDLINE, and 7 were from websites. The readability across all materials averaged an 11th-grade reading level (Flesch-Kincaid Grade Level=11.9±2.59). The mean±SD understandability and actionability scores were 82.8±6.58% and 40.9±28.60%, respectively.

CONCLUSIONS

The readability of online cholesterol patient education materials consistently exceeds the health literacy level of the average North American adult. Many resources also inadequately describe action items for individuals to self-manage their cholesterol, representing an implementation gap in cardiovascular disease prevention.

Stakeholder Engagement in Type 1 Diabetes Research, Quality Improvement, and Clinical Care

The integration of stakeholder engagement (SE) in research, quality improvement (QI), and clinical care has gained significant traction. Type 1 diabetes is a chronic disease that requires complex daily management and care from a multidisciplinary team across the lifespan. Inclusion of key stakeholder voices, including patients, caregivers, health care providers and community advocates, in the research process and implementation of clinical care is critical to ensure representation of perspectives that match the values and goals of the patient population. This review describes the current framework for SE and its application to research, QI, and clinical care across the lifespan.

What's in This For You? What's in This For Me?: A Win-Win Perspective of Involving Study Advisory Committee Members in Palliative Care Research

Study advisory committees (SACs) provide critical value to clinical trials by providing unique perspectives that pull from personal and professional experiences related to the trial's healthcare topic. The Emergency Medicine Palliative Care Access (EMPallA) study had the privilege of convening a 16-person SAC from the project's inception to completion. The study team wanted to understand the impact this project had on the SAC members. In this narrative, we use reflective dialogue to share SAC members' lived experiences and the impact the EMPallA study has had on members both personally and professionally. We detail the (1) benefits SAC members, specifically patients, and caregivers, have had through working on this project. (2) The importance of recruiting diverse SAC members with different lived experiences and leveraging their feedback in clinical research. (3) Value of community capacity building to ensure the common vision of the clinical trial is promoted.

A Model of Stakeholder Engagement with American Indians and Alaska Natives from the Native-CHART Study

American Indian (AI) and Alaska Native (AN) community stakeholder engagement has the power to transform health research. However, the engagement and dissemination process is challenging in AIAN communities due to the historical and current negative experiences of AIAN populations in health research (Dillard et al., 2018). Whereas there is a paucity of recommendations about how to engage stakeholders in health research, from agenda-setting to proposal development, study design, recruitment, data collection, analysis, results, and dissemination (Concannon et al., 2014), there is limited information about how these recommendations are operationalized within the context of AIAN health research and practice (Concannon et al., 2014; Forsythe et al., 2016). For the purposes of this article, stakeholders are individuals, organizations, or communities who have a direct interest in the process and outcomes of a project, research, or policy effort (Boaz et al., 2018). Stakeholder engagement is a systematic process involving stakeholders, which provides opportunities for consultation, input, reviews, reactions, support, and assistance with dissemination. Dissemination focuses on how, when, by whom, and under what circumstances evidence spreads throughout agencies, organizations, states, counties, communities, tribes, researchers, policy makers, and service organizations.

Patient involvement in research within the Gynecological Cancer InterGroup: A call to action for a systematic approach: Results from a survey

Background and Aims

Involving patients in research, not only as trial subjects, is not a newly established practice. Over the last two decades, patient roles have gradually expanded to become active research contributors, creating a more patient-centered research landscape. Our survey has explored the scope of patient involvement within the Gynecologic Cancer InterGroup (GCIG), an International Gynecologic Cancer Research Consortium, and identified challenges in developing a systematic, meaningful and sustainable level of patient involvement.

Methods

In late 2019, the GCIG Harmonisation Operations Committee conducted an online survey across 26 national and/or international research cooperative groups, aiming to identify current patient involvement practices implemented by each group. Twelve questions were asked. The results have been generated to support a systematic strategic planning process to increase patient involvement into clinical research projects.

Results

More than half of the 26 participating groups have either already involved (15, [58%]) or are planning (6, [23%]) to involve patients in their research activities. Gaining patient support in raising public awareness around clinical trials appears to be one of the most desired benefits (21, [81%]). Ten respondents managed to integrate patient involvement into their standard practice. When involving patients in research the groups mostly consider that patients bring added value to the study (19, [73%]), although only eight groups (40%) have a well-organized process in doing so.

Conclusion

Even though patient involvement is considered a significant added value to clinical research, its application within GCIG groups is not considered on a regular basis and is predominantly limited to operational aspects of research activities. The lack of resources and expertize, as well as the missing well-organized and structured process of some groups, combined with their ability to ensure process sustainability, are among the main factors affecting implementation and adoption of patient involvement within GCIG research activities.

Patient and Public Involvement in Research: Lessons for Inflammatory Bowel Disease

Participatory research, also referred to as patient and public involvement, is an approach that involves collaborating with patients affected by the focus of the research, on the design, development and delivery of research to improve outcomes. There are two broad justifications for this: first, that it enhances the quality and relevance of research, and second, that it satisfies the ethical argument for patient inclusion in decisions about them. This synergistic and collaborative effort, which bridges the divide between researchers and participants with the lived condition, is now a mainstream activity and widely accepted as best practice. Although there has been a substantial increase in the literature over the past two decades, little has been published on how participatory research has been used in inflammatory bowel disease [IBD] research and little guidance as to how researchers should go about this. With an increasing incidence and prevalence worldwide, combined with declining study enrolment in an era of perennial unmet need, there are a multitude of benefits of participatory research to IBD patients and investigators, including research output that is informed and relevant to the real world. A key example of participatory research in IBD is the I-CARE study, a large-scale, pan-European observational study assessing the safety of advanced therapies, which had significant patient involvement throughout the study. In this review, we provide a comprehensive overview of the benefits and challenges of participatory research and discuss opportunities of building strategic alliances between IBD patients, healthcare providers and academics to strengthen research outcomes.

Storytelling workshop to encourage stakeholder engagement with the Global Initiative for Childhood Cancer

Storytelling can enhance stakeholder engagement and support the implementation of the World Health Organization and Pan American Health Organization's (PAHO) Global Initiative for Childhood Cancer, which aims to improve care globally for children with cancer. The Initiative aligns with the United Nations Sustainable Development Goals, addressing health, education, inequalities and international collaboration. This report describes the design and implementation of a workshop that used storytelling through film to encourage stakeholders in national cancer control plans to engage with the Initiative in its focal countries in Central America, the Dominican Republic and Haiti. A six-step process was used to develop the virtual workshop hosted by PAHO: (i) define the audience; (ii) define the goals of storytelling; (iii) build an appropriate storyline, including choosing a platform and content, and addressing group dynamics and the length of the film; (iv) guide the workshop's design and implementation with current theoretical frameworks, including the Socioecological Model of Health and the Theory of Change; (v) design interactive group exercises; and (vi) disseminate workshop results. The skills-building component of the day-long workshop included 80 representatives from eight countries in the Region of the Americas, with participants representing pediatric oncology, hospital administration, ministries of health, nonprofit foundations, the scientific community and public health organizations. Outputs from the workshop included (i) a summary report, (ii) an empathy word cloud with live reactions from participants, (iii) qualitative responses (i.e. quotes from participants), (iv) stakeholders' analyses and (v) a prioritization matrix for country-level strategic activities that could be undertaken to strengthen health systems when caring for children with cancer. The workshop used storytelling through film to try to reduce health inequalities and have a regional impact. Combining art, public health and medicine, the workshop created positive change by sharing real-life experiences. Commitment was fostered among stakeholders through their engagement with the workshop, which aimed to increase their awareness of the need and advocacy to improve health systems and enhance access to health care for this vulnerable population.

Patient engagement in health implementation research: A logic model

INTRODUCTION

Growing evidence supports patient engagement (PE) in health implementation research to improve the quality, relevance and uptake of research. However, more guidance is needed to plan and operationalize PE before and throughout the research process. The aim of the study was to develop a logic model illustrating the causal links between context, resources, activities, outcomes and impact of PE in an implementation research programme.

METHODS

The Patient Engagement in Health Implementation Research Logic Model (hereafter the Logic Model) was developed using a descriptive qualitative design with a participatory approach, in the context of the PriCARE programme. This programme aims to implement and evaluate case management for individuals who frequently use healthcare services in primary care clinics across five Canadian provinces. Participant observation of team meetings was performed by all team members involved in the programme and in-depth interviews were conducted by two external research assistants with team members (n = 22). A deductive thematic analysis using components of logic models as coding categories was conducted. Data were pooled in the first version of the Logic Model, which was refined in research team meetings with patient partners. The final version was validated by all team members.

RESULTS

The Logic Model highlights the importance of integrating PE into the project before its commencement, with appropriate support in terms of funding and time allocation. The governance structure and leadership of both principal investigators and patient partners have significant effects on PE activities and outcomes. As an empirical and standardized illustration that facilitates a shared understanding, the Logic Model provides guidance for maximizing the impact of patient partnership in various contexts for research, patients, providers and health care.

CONCLUSION

The Logic Model will help academic researchers, decision makers and patient partners plan, operationalize, and assess PE in implementation research for optimal outcomes.

PATIENT OR PUBLIC CONTRIBUTION

Patient partners from the PriCARE research programme contributed to developing the research objectives and designing, developing and validating data collection tools, producing data, developing and validating the Logic Model and reviewing the manuscript.

Development of a Culturally Adapted Dietary Intervention to Reduce Alzheimer's Disease Risk among Older Black Adults

The objective of this study is to identify and understand knowledge and attitudes that influence dietary practices among older Black adults using a community-engaged approach. This is a non-interventional mixed methods study designed to inform the development of an adapted brain-healthy soul food diet intervention. A purposive sampling approach was used to conduct seven semi-structured focus group discussions and an online quantitative survey. In total, 39 participants who self-identified as Black, aged 55 years and older, English speaking, and who were cognitively normal with an AD8 < 2; (25.6% men; 74.4% women) participated in the online survey and one of the seven 60 min virtual focus group discussions (5-7 per focus group). Quantitative frequency data from the online surveys were analyzed using descriptive statistics. Qualitative focus group data were analyzed using a 6-step thematic analysis process. Five themes emerged: dementia awareness; practices shaping food choices and consumption; barriers to eating healthy; instrumental support; and elements of a culturally adapted brain-healthy dietary intervention. Older Black adults perceived an adapted MIND dietary model as the most acceptable with the incorporation of salient cultural characteristics and strategies within both the design and delivery phases.

Perceptions of Artificial Intelligence-Assisted Care for Children With a Respiratory Complaint

OBJECTIVES

To evaluate caregiver opinions on the use of artificial intelligence (AI)-assisted medical decision-making for children with a respiratory complaint in the emergency department (ED).

METHODS

We surveyed a sample of caregivers of children presenting to a pediatric ED with a respiratory complaint. We assessed caregiver opinions with respect to AI, defined as "specialized computer programs" that "help make decisions about the best way to care for children." We performed multivariable logistic regression to identify factors associated with discomfort with AI-assisted decision-making.

RESULTS

Of 279 caregivers who were approached, 254 (91.0%) participated. Most indicated they would want to know if AI was being used for their child's health care (93.5%) and were extremely or somewhat comfortable with the use of AI in deciding the need for blood (87.9%) and viral testing (87.6%), interpreting chest radiography (84.6%), and determining need for hospitalization (78.9%). In multivariable analysis, caregiver age of 30 to 37 years (adjusted odds ratio [aOR] 3.67, 95% confidence interval [CI] 1.43-9.38; relative to 18-29 years) and a diagnosis of bronchospasm (aOR 5.77, 95% CI 1.24-30.28 relative to asthma) were associated with greater discomfort with AI. Caregivers with children being admitted to the hospital (aOR 0.23, 95% CI 0.09-0.50) had less discomfort with AI.

CONCLUSIONS

Caregivers were receptive toward the use of AI-assisted decision-making. Some subgroups (caregivers aged 30-37 years with children discharged from the ED) demonstrated greater discomfort with AI. Engaging with these subgroups should be considered when developing AI applications for acute care.

Community members' experiences training as medical journal reviewers

PURPOSE

Although medical research dissemination is intended to benefit members of society, few members of society actually participate in the process of publishing findings. This study shares findings from community members' (including patients and the public) experiences being trained as medical journal reviewers.

METHODS

We analyzed findings from two focus group interviews of community reviewers (N = 29) to identify themes in their experiences with the training program.

RESULTS

Community members trained as journal reviewers appreciated learning the context under which manuscript development and review occur from authors and funders, the value of the community member perspectives to science, and strengthened their critical thinking skills. A range of training tools and strategies included glossaries of research terms, creating review guides, practicing reviews, being trained by a supportive team, and working with and learning collaboratively.

CONCLUSIONS

Training as a journal reviewer has a positive impact on participating community members. Programs training community members as journal reviewers should incorporate guest speakers well-versed in community engaged research, group activities, a variety of training tools and materials, and highly supportive training teams.

Reflections on patient engagement by patient partners: how it can go wrong

As six patient partners in Canada, we aim to contribute to learning and to provide an opportunity to reflect on patient engagement (PE) in research and healthcare environments. Patient engagement refers to "meaningful and active collaboration in governance, priority setting, conducting research and knowledge translation" with patient partners as members of teams, rather than participants in research or clinical care. While much has been written about the benefits of patient engagement, it is important to accurately document and share what we term 'patient engagement gone wrong.' These examples have been anonymized and presented as four statements: patient partners as a check mark, unconscious bias towards patient partners, lack of support to fully include patient partners, and lack of recognizing the vulnerability of patient partners. The examples provided are intended to demonstrate that patient engagement gone wrong is more common than discussed openly, and to simply bring this to light. This article is not intending to lay blame, rather to evolve and improve patient engagement initiatives. We ask those who interact with patient partners to reflect so we can all work towards improving patient engagement. Lean into the discomfort with these conversations as that is the only way to change these all too recognizable examples, and which will lead to better project outcomes and experiences for all team members.

Community Members as Reviewers of Medical Journal Manuscripts: a Randomized Controlled Trial

BACKGROUND

Community members may provide useful perspectives on manuscripts submitted to medical journals.

OBJECTIVE

To determine the impact of community members reviewing medical journal manuscripts.

DESIGN

Randomized controlled trial involving 578 original research manuscripts submitted to two medical journals from June 2018 to November 2021.

PARTICIPANTS

Twenty-eight community members who were trained, supervised, and compensated.

INTERVENTIONS

A total of 289 randomly selected control manuscripts were reviewed by scientific reviewers only. And 289 randomly selected intervention manuscripts were reviewed by scientific reviewers and one community member. Journal editorial teams used all reviews to make decisions about acceptance, revision, or rejection of manuscripts.

MAIN MEASURES

Usefulness of reviews to editors, content of community reviews, and changes made to published articles in response to community reviewer comments.

KEY RESULTS

Editor ratings of community and scientific reviews averaged 3.1 and 3.3, respectively (difference 0.2, 95% confidence interval [CI] 0.1 to 0.3), on a 5-point scale where a higher score indicates a more useful review. Qualitative analysis of the content of community reviews identified two taxonomies of themes: study attributes and viewpoints. Study attributes are the sections, topics, and components of manuscripts commented on by reviewers. Viewpoints are reviewer perceptions and perspectives on the research described in manuscripts and consisted of four major themes: (1) diversity of study participants, (2) relevance to patients and communities, (3) cultural considerations and social context, and (4) implementation of research by patients and communities. A total of 186 community reviewer comments were integrated into 64 published intervention group articles. Viewpoint themes were present more often in 66 published intervention articles compared to 54 published control articles (2.8 vs. 1.7 themes/article, difference 1.1, 95% CI 0.4 to 1.8).

CONCLUSIONS

With training, supervision, and compensation, community members are able to review manuscripts submitted to medical journals. Their comments are useful to editors, address topics relevant to patients and communities, and are reflected in published articles.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03432143.

Evaluating cancer genetic services in a safety net system: overcoming barriers for a lasting impact beyond the CHARM research project

Underserved patients face substantial barriers to receiving cancer genetic services. The Cancer Health Assessments Reaching Many (CHARM) study evaluated ways to increase access to genetic testing for individuals in underserved populations at risk for hereditary cancer syndromes (HCS). Here, we report the successful implementation of CHARM in a low-resource environment and the development of sustainable processes to continue genetic risk assessment in this setting. The research team involved key clinical personnel and patient advisors at Denver Health to provide input on study methods and materials. Through iterative and collaborative stakeholder engagement, the team identified barriers and developed solutions that would both facilitate participation in CHARM and be feasible to implement and sustain long term in clinical care. With a focus on infrastructure building, educational modules were developed to increase awareness among referring providers, and standard methods of identifying and managing HCS patients were implemented in the electronic medical record. Three hundred sixty-four DH patients successfully completed the risk assessment tool within the study, and we observed a sustained increase in referrals to genetics for HCS (from 179 in 2017 to 427 in 2021 post-intervention). Implementation of the CHARM study at a low-resourced safety net health system resulted in sustainable improvements in access to cancer genetic risk assessment and services that continue even after the study ended.Trial registration NCT03426878.

Then there were seven: a commentary on creating a public involvement strategy group for a policy research unit in behavioural science

The National Institute for Health and Care Research (NIHR) Policy Research Unit in Behavioural Science (PRU-BS) was funded to inform government on the application of behavioural science in health and social care policy. What makes this unit different to other topic specific ones, was the wide range of its brief. Because of this, the PPI group would need to include a wide range of experience and expertise and be prepared to learn. We were a different type of public group for a different type of task. This paper deals with how we approached this. In this paper we outline how the PPI plan in the funding proposal for the PRU-BS was adapted to real world challenges. We describe the stages in the formation of the PPI Strategy Group and how a virtual platform was created to ensure good communication. We discuss our pragmatic approach of developing Terms of Reference and a PPI strategy document. Given the restrictions imposed by the Covid-19 pandemic we explain how we tackled PPI SG member induction sessions, meetings and training sessions. To illustrate how the group operates we provide an example of our involvement in a PRU-BS project. Central to our paper is the lessons we learned. We hope the challenges we met in forming the unique PPI SG, how these were overcome, and our recommendations will help others faced with a similar task.

Enhancing Patient Centricity of Real-World Data Research: An Exploratory Analysis Using the Patient Experience Mapping Toolbox

OBJECTIVES

There is an increasing expectation that medical product development and assessment be guided by patient input captured through patient engagement. Recently published consensus guidelines describe how qualitative patient experience data (PED) can guide the design, conduct, and translation of real-world research that reflects patients' lived experience. The objective of this exploratory analysis is to examine how researchers could leverage PED captured through the Patient Experience Mapping Toolbox (PEMT) to guide real-world data (RWD) research designs.

METHODS

This exploratory analysis included a thematic analysis of interview transcripts collected while pilot testing the PEMT followed by a qualitative analysis of the emerging themes aligned with stages listed in the patient-centered real-world evidence, Real-World Research Design Framework.

RESULTS

PED collected using the PEMT include information about symptomology, interactions with the healthcare system, information-seeking behavior, misdiagnoses, lifestyle changes, treatments, side effects, and comorbidities. This information can be leveraged at key study design decisions, including (1) identifying study cohorts and subgroups, (2) identifying exposures, (3) informing covariates and potential confounders; and (4) refining study periods. Additionally, participants described where they seek information about treatments and diseases, which should inform dissemination strategies.

CONCLUSIONS

We identified opportunities for PED collected using the PEMT to inform RWD study designs. The PED described in this exploratory analysis stem from pilot testing of the PEMT across a variety of conditions. In the next phase of development in this area, researchers should evaluate how data collected using the PEMT can be applied to RWD research for a specific disease.

Parental Perceptions on Use of Artificial Intelligence in Pediatric Acute Care

BACKGROUND

Family engagement is critical in the implementation of artificial intelligence (AI)-based clinical decision support tools, which will play an increasing role in health care in the future. We sought to understand parental perceptions of computer-assisted health care of children in the emergency department (ED).

METHODS

We conducted a population-weighted household panel survey of parents with minor children in their home in a large US city to evaluate perceptions of the use of computer programs for the care of children with respiratory illness. We identified demographics associated with discomfort with AI using survey-weighted logistic regression.

RESULTS

Surveys were completed by 1620 parents (panel response rate = 49.7%). Most respondents were comfortable with the use of computer programs to determine the need for antibiotics (77.6%) or bloodwork (76.5%), and to interpret radiographs (77.5%). In multivariable analysis, Black non-Hispanic parents reported greater discomfort with AI relative to White non-Hispanic parents (odds ratio [OR] 1.67, 95% confidence interval [CI] 1.03-2.70) as did younger parents (18-25 years) relative to parents ≥46 years (OR 2.48, 95% CI 1.31-4.67). The greatest perceived benefits of computer programs were finding something a human would miss (64.2%, 95% CI 60.9%-67.4%) and obtaining a more rapid diagnosis (59.6%; 56.2%-62.9%). Areas of greatest concern were diagnostic errors (63.0%, 95% CI 59.6%-66.4%), and recommending incorrect treatment (58.9%, 95% CI 55.5%-62.3%).

CONCLUSIONS

Parents were generally receptive to computer-assisted management of children with respiratory illnesses in the ED, though reservations emerged. Black non-Hispanic and younger parents were more likely to express discomfort about AI.

Using human-centered design to develop a nurse-to-family telehealth intervention for pediatric transfers

Objective

To develop a nurse-to-family telehealth intervention for pediatric inter-facility transfers using the human-centered design approach.

Methods

We conducted the inspiration and ideation phases of a human-centered design process from July 2022 to December 2022. For the inspiration phase, we conducted a qualitative cross-sectional case study design over 3 months. We used thematic analysis with the framework approach of parent and provider interviews. Five team members individually coded transcripts and then met to discuss memos, update a construct summary sheet, and identify emerging themes. The team adapted themes into "How Might We" statements. For the ideation phase, multidisciplinary stakeholders brainstormed solutions to the "How Might We" statements in a design workshop. Workshop findings informed the design of a nurse-to-family telehealth intervention, which was iteratively revised over 2 months based on stakeholder feedback sessions.

Results

We conducted interviews with nine parents, 11 nurses, and 13 physicians. Four themes emerged supporting the promise of a nurse-to-family telehealth intervention, the need to effectively communicate the intervention purpose, the value of a user-friendly workflow, and the essentiality of ensuring that diverse populations equitably benefit from the intervention. "How Might We" statements were discussed among 22 total workshop participants. Iterative adaptations were made to the intervention until feedback from workshop participants and 67 other stakeholders supported no further improvements were needed.

Conclusion

Human-centered design phases facilitated stakeholder engagement in developing a nurse-to-family telehealth intervention. This intervention will be tested in an implementation phase as a feasibility and pilot trial.

Diabetes-related research priorities of people with type 1 and type 2 diabetes: a cross-sectional study in Germany

To investigate (i) the importance and priorities of research objectives for people with type 1 (T1DM) and type 2 diabetes (T2DM); (ii) subgroups with specific research priorities; (iii) associated factors (e.g., sociodemographic characteristics) of the subgroups. The cross-sectional survey was conducted in 2018 using data from 869 respondents (29.0% response, 31.2% female, mean age 61.3 years, 62.7% T2DM) from a German statutory health insurance population. Diabetes-related research priorities were assessed with a questionnaire. Subgroups and associated factors were identified using latent class analysis. Three subgroups were found in T1DM: (1) high priority for the research topic 'healing diabetes' and moderate priority for the research topic 'prevention of long-term complications', (2) priorities for simplifying handling (high) and stress reduction (moderate), (3) priorities for healing diabetes (high) and simplifying handling (high). Three subgroups were found in T2DM: (1) priorities for simplifying handling (moderate), diabetes prevention (moderate) and prevention of long-term complications (moderate), (2) priorities for stress reduction (high) and diabetes prevention (moderate), (3) priorities for simplifying handling (high) and stress reduction (high). Classes differed in age and HbA_1c. Knowledge about research priorities enables researchers to align their work with the needs of people with diabetes.

Dual Protection Messaging for Adolescents and Young Adults in the Setting of Over-the-Counter Hormonal Contraception: A Human-Centered Design Approach

STUDY OBJECTIVE

To use human-centered design approaches to engage adolescents and young adults in the creation of messages focused on dual method use in the setting of over-the-counter hormonal contraception access DESIGN: Baseline survey and self-directed workbooks with human-centered design activities were completed. The workbooks were transcribed and analyzed using qualitative methods to determine elements of the communication model, including sender, receiver, message, media, and environment.

SETTING

Indiana and Georgia PARTICIPANTS: People aged 14-21 years in Indiana and Georgia INTERVENTIONS: Self-directed workbooks MAIN OUTCOME MEASURES: Elements of the communication model, including sender, receiver, message, media, and environment RESULTS: We analyzed 54 workbooks, with approximately half from each state. Stakeholders self-identified as female (60.5%), white (50.9%), Hispanic (10.0%), sexually active (69.8%), and heterosexual (79.2%), with a mean age of 18 years. Most strongly agreed (75.5%) that they knew how to get condoms, but only 30.2% expressed the same sentiment about hormonal contraception. Exploration of the elements of the communication model indicated the importance of crafting tailored messages to intended receivers. Alternative terminology for dual protection, such as "Condom+____," was created.

CONCLUSION

There is a need for multiple and diverse messaging strategies about dual method use in the context of over-the-counter hormonal contraception to address the various pertinent audiences as this discussion transitions outside of traditional clinical encounters. Human-centered design approaches can be used for novel message development.

Factors to Consider During Identification and Invitation of Individuals in a Multi-stakeholder Research Partnership

BACKGROUND

Health research teams increasingly partner with stakeholders to produce research that is relevant, accessible, and widely used. Previous work has covered stakeholder group identification.

OBJECTIVE

We aimed to develop factors for health research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership, with the aim of forming equitable and informed teams.

DESIGN

Consensus development.

PARTICIPANTS

We involved 16 stakeholders from the international Multi-Stakeholder Engagement (MuSE) Consortium, including patients and the public, providers, payers of health services/purchasers, policy makers, programme managers, peer review editors, and principal investigators.

APPROACH

We engaged stakeholders in factor development and as co-authors of this manuscript. Using a modified Delphi approach, we gathered stakeholder views concerning a preliminary list of 18 factors. Over two feedback rounds, using qualitative and quantitative analysis, we concentrated these into ten factors.

KEY RESULTS

We present seven highly desirable factors: 'expertise or experience', 'ability and willingness to represent the stakeholder group', 'inclusivity (equity, diversity and intersectionality)', 'communication skills', 'commitment and time capacity', 'financial and non-financial relationships and activities, and conflict of interest', 'training support and funding needs'. Additionally, three factors are desirable: 'influence', 'research relevant values', 'previous stakeholder engagement'.

CONCLUSIONS

We present factors for research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership. Policy makers and guideline developers may benefit from considering the factors in stakeholder identification and invitation. Research funders may consider stipulating consideration of the factors in funding applications. We outline how these factors can be implemented and exemplify how their use has the potential to improve the quality and relevancy of health research.

Stakeholder engagement in eight comparative effectiveness trials in African Americans and Latinos with asthma

BACKGROUND

The effects of stakeholder engagement, particularly in comparative effectiveness trials, have not been widely reported. In 2014, eight comparative effectiveness studies targeting African Americans and Hispanics/Latinos with uncontrolled asthma were funded by the Patient-Centered Outcomes Research Institute (PCORI) as part of its Addressing Disparities Program. Awardees were required to meaningfully involve patients and other stakeholders. Using specific examples, we describe how these stakeholders substantially changed the research protocols and in other ways participated meaningfully as full partners in the development and conduct of the eight studies.

METHODS

Using the method content analysis of cases, we identified themes regarding the types of stakeholders, methods of engagement, input from the stakeholders, changes made to the research protocols and processes, and perceived benefits and challenges of the engagement process. We used summaries from meetings of the eight teams, results from an engagement survey, and the final research reports as our data source to obtain detailed information. The descriptive data were assessed by multiple reviewers using inductive and deductive qualitative methods and discussed in the context of engagement literature.

RESULTS

Stakeholders participated in the planning, conduct, and dissemination phases of all eight asthma studies. All the studies included clinicians and community representatives as stakeholders. Other stakeholders included patients with asthma, their caregivers, advocacy organizations, and health-system representatives. Engagement was primarily by participation in advisory boards, although six of the eight studies (75%) also utilized focus groups and one-on-one interviews. Difficulty finding a time and location to meet was the most reported challenge to engagement, noted by four of the eight teams (50%). Other reported challenges and barriers to engagement included recruitment of stakeholders, varying levels of enthusiasm among stakeholders, controlling power dynamics, and ensuring that stakeholder involvement was reflected and had true influence on the project.

CONCLUSION

Engagement-driven modifications led to specific changes in study design and conduct that were felt to have increased enrollment and the general level of trust and support of the targeted communities. The level of interaction described, between investigators and stakeholders in each study and between investigator-stakeholder groups, is-we believe-unprecedented and may provide useful guidance for other studies seeking to improve the effectiveness of community-driven research.

Use of co-design methodology in the development of cardiovascular disease secondary prevention interventions: A scoping review

INTRODUCTION

There is growing evidence to support the use of co-design in developing interventions across many disciplines. This scoping review aims to examine how co-design methodology has been used in the development of cardiovascular disease (CVD) secondary prevention interventions within health and community settings.

METHODS

We searched four academic databases for studies that used the co-design approach to develop their intervention. Studies were included if consumers (adults with CVD) and key stakeholders (e.g. clinicians, service providers) were involved in the co-design process. The review focused on methodology rather than traditional study outcomes; therefore, co-design processes and activities were extracted and evaluated against a selected co-design framework.

RESULTS

Twenty-two studies were included in this review. Studies were implemented across various settings with consumers and stakeholder groups most frequently consisting of patients and healthcare professionals, respectively. Most studies specifically stated that they used a 'co-design' approach (n = 10); others used terms such as participatory action research (n = 3), user-centred design (n = 3) and community-based participatory research (n = 2). Although there was variability in terminology, co-design processes, and participants, all studies adhered to the key principles of consumer engagement. Predominant co-design activities included semistructured interviews, focus groups, co-design/development workshops and advisory group meetings. Intervention effectiveness was assessed in eight studies showing mixed results.

CONCLUSIONS

This review provides an overview of how the co-design approach has previously been used in the development of CVD secondary prevention interventions. These findings provide methodological considerations that can guide researchers and healthcare services when implementing co-design to develop feasible and acceptable interventions that can improve outcomes for CVD populations.

PATIENT OR PUBLIC CONTRIBUTION

No patients, service users, caregivers, people with lived experience or members of the public were involved in this scoping review. This review article was written by academics who have undertaken a significant amount of co-design work with consumers and stakeholders.

Advancing brain network models to reconcile functional neuroimaging and clinical research

Functional magnetic resonance imaging (fMRI) captures information on brain function beyond the anatomical alterations that are traditionally visually examined by neuroradiologists. However, the fMRI signals are complex in addition to being noisy, so fMRI still faces limitations for clinical applications. Here we review methods that have been proposed as potential solutions so far, namely statistical, biophysical and decoding models, with their strengths and weaknesses. We especially evaluate the ability of these models to directly predict clinical variables from their parameters (predictability) and to extract clinically relevant information regarding biological mechanisms and relevant features for classification and prediction (interpretability). We then provide guidelines for useful applications and pitfalls of such fMRI-based models in a clinical research context, looking beyond the current state of the art. In particular, we argue that the clinical relevance of fMRI calls for a new generation of models for fMRI data, which combine the strengths of both biophysical and decoding models. This leads to reliable and biologically meaningful model parameters, which thus fulfills the need for simultaneous interpretability and predictability. In our view, this synergy is fundamental for the discovery of new pharmacological and interventional targets, as well as the use of models as biomarkers in neurology and psychiatry.

Stakeholder engagement in a hypertension and diabetes prevention research program: Description and lessons learned

Background

Stakeholder engagement is important from the management point of view to capture knowledge, increase ownership, reduce conflict, encourage partnership, as well as to develop an ethical perspective that facilitates inclusive decision making and promotes equity. However, there is dearth of literature in the process of stakeholder engagement. The purpose of this paper is to describe the process of increasing stakeholder engagement and highlight the lessons learnt on stakeholder engagement while designing, implementing, and monitoring a study on diabetes and hypertension prevention in workplace settings in Nepal.

Methodology

We identified the stakeholders based on the 7P framework: Patients and public (clients), providers, payers, policy makers, product makers, principal investigators, and purchasers. The identified stakeholders were engaged in prioritization of the research questions, planning data collection, designing, implementing, and monitoring the intervention. Stakeholders were engaged through focus group discussions, in-depth interviews, participatory workshops, individual consultation, information sessions and representation in study team and implementation committees.

Results

The views of the stakeholders were synthesized in each step of the research process, from designing to interpreting the results. Stakeholder engagement helped to shape the methods and plan, and process for participant’s recruitment and data collection. In addition, it enhanced adherence to intervention, mutual learning, and smooth intervention adoption. The major challenges were the time-consuming nature of the process, language barriers, and the differences in health and food beliefs between researchers and stakeholders.

Conclusion

It was possible to engage and benefit from stakeholder’s engagement on the design, implementation and monitoring of a workplace-based hypertension and diabetes management research program in Nepal.

Behavioral Parent Training for Families With Young Deaf or Hard of Hearing Children Followed in Hearing Health Care

PURPOSE

It is well established that individuals with a communication disability, including being deaf or hard of hearing (DHH), experience inequities in health services and outcomes. These inequities extend to DHH children's access to psychosocial evidence-based interventions (EBIs). Behavioral parent training is an EBI that can be used to improve caregiver and child outcomes. Despite being supported by decades of effectiveness research, this EBI is rarely accessed by, or studied with, caregivers of DHH children. The purpose of this article is to describe a program of stakeholder-engaged research adapting and assessing behavioral parent training with caregivers of young DHH children followed in hearing health care, aimed at reducing inequities in access to this EBI.

METHOD

The first section briefly summarizes the literature on disruptive behavior problems in young children, with a focus on preschool-age DHH children. The evidence base for behavioral parent training is described. Next, the gaps in knowledge and practice regarding disruptive behaviors among DHH children are highlighted, and the potential integration of behavioral parent training into the standard of care for this population is proposed.

CONCLUSIONS

Young DHH children who use hearing aids and/or cochlear implants experience disruptive behavior problems at rates at least as high as typically hearing children, but their access to EBIs is limited, and behavioral parent training programs tailored to this population have not been rigorously tested. Caregivers and hearing health care service providers affirm the potential benefits of behavioral parent training and were partners in adapting this EBI. This research highlights several principles and approaches essential for reducing inequities and improving the quality of life not only for DHH children and their families but also for individuals with communication disabilities more broadly: engagement of key stakeholders in research, collaboration across disciplines, and using implementation science methods and models to design for implementation, dissemination, and sustainment. Presentation Video: https://doi.org/10.23641/asha.21215900.

Experience of Inpatient Mental Health Care Assessed With Service User-Developed and Conventional Patient-Reported Outcome Measures

OBJECTIVE

The goal of this study was to examine and compare the psychometric properties of a patient-reported outcome measure (PROM) generated with patients’ input (Views on Inpatient Care [VOICE]) and a PROM conventionally generated without patients’ input (Service Satisfaction Scale: Residential Services Evaluation [SSS-Res]) for assessing a patient’s perception of psychiatric ward care.

METHODS

In a stepped-wedge cluster-randomized trial conducted in the United Kingdom, 1,058 participants admitted to 16 wards reported on their perceptions of care via VOICE and SSS-Res before or up to 2 years after the staff training. Exploratory and confirmatory factor analyses were used to investigate the structure of the PROMs and to assess reliability and convergent validity as well as sensitivity to change; the analyses also considered whether study participants had been admitted voluntarily to the ward.

RESULTS

Two factors emerged from VOICE, labeled “trust” and “involvement,” and from SSS-Res, labeled “environment” and “care,” at baseline. All subscales had high internal consistency and good convergent validity. An ability to detect change in care due to the staff training was observed on the trust subscale of VOICE (N=1,058, mean difference=−0.25, 95% CI=−0.48 to −0.02), but no change was detected on any of the SSS-Res subscales. Patients admitted involuntarily benefited the most from the staff training.

CONCLUSIONS

VOICE captured patients’ perceptions of ward care better than SSS-Res and was sensitive to changes in aspects of trust, suggesting that participatory approaches for developing PROMs improve patients’ self-reports on the care they received.

Stakeholder Engagement in Adoption, Implementation, and Sustainment of an Evidence-Based Intervention to Increase Mammography Adherence Among Low-Income Women

Multi-level organizational stakeholder engagement plays an important role across the research process in a clinical setting. Stakeholders provide organizational specific adaptions in evidence-based interventions to ensure effective adoption, implementation, and sustainability. Stakeholder engagement strategies involve building mutual trust, providing clear communication, and seeking feedback. Using constructs from the Consolidated Framework for Implementation Research and The International Association for Public Participation spectrum, a conceptual framework was created to guide stakeholder engagement in an evidence-based intervention to increase mammography appointment adherence in underserved and low-income women. A document review was used to explore the alignment of the conceptual framework with intervention activities and stakeholder engagement strategies. The results indicate an alignment with the conceptual framework constructs and a real-world application of stakeholder engagement in a mammography evidence-based intervention. The conceptual framework and stakeholder engagement strategies can be applied across a range of community-based cancer programs and interventions, organizations, and clinical settings.

Promoting community stakeholder engagement in research on treatment for pregnant women with opioid use disorder

Aim: Community stakeholder engagement in research (CSER) can improve research relevance and efficiency as well as prevent harmful practices, particularly for vulnerable populations. Despite potential benefits, researchers lack familiarity with CSER methods. Methods: We describe CSER strategies used across the research continuum, including proposal development, study planning and the first years of a comparative effectiveness study of care for pregnant women with opioid use disorder. Results: We highlight successful strategies, grounded in principles of engagement, to establish and maintain stakeholder relationships, foster bidirectional communication and trust and support active participation of women with opioid use disorder in the research process. Conclusion: CSER methods support research with a disenfranchised population. Future work will evaluate the impact of CSER strategies on study outcomes and dissemination.

A stakeholder engagement strategy for an ongoing research program in rural dementia care: Stakeholder and researcher perspectives

Participatory research approaches have developed in response to the growing emphasis on translation of research evidence into practice. However, there are few published examples of stakeholder engagement strategies, and little guidance specific to larger ongoing research programs or those with a rural focus. This paper describes the evolution, structure, and processes of an annual Rural Dementia Summit launched in 2008 as an engagement strategy for the Rural Dementia Action Research (RaDAR) program and ongoing for more than 10 years; and reports findings from a parallel mixed-methods study that includes stakeholder and researcher perspectives on the Summit’s value and impact. Twelve years of stakeholder evaluations were analyzed. Rating scale data were summarized with descriptive statistics; open-ended questions were analyzed using an inductive thematic analysis. A thematic analysis was also used to analyze interviews with RaDAR researchers. Rating scale data showed high stakeholder satisfaction with all aspects of the Summit. Five themes were identified in the qualitative data: hearing diverse perspectives, building connections, collaborating for change, developing research and practice capacity, and leaving recharged. Five themes were identified in the researcher data: impact on development as a researcher, understanding stakeholder needs, informing research design, deepening commitment to rural dementia research, and building a culture of engagement. These findings reflect the key principles and impacts of stakeholder engagement reported in the literature. Additional findings include the value stakeholders place on connecting with stakeholders from diverse backgrounds, how the Summit was revitalizing, and how it developed stakeholder capacity to support change in their communities. Findings indicate that the Summit has developed into a community of practice where people with a common interest come together to learn and collaborate to improve rural dementia care. The Summit’s success and sustainability are linked to RaDAR’s responsiveness to stakeholder needs, the trust that has been established, and the value that stakeholders and researchers find in their participation.

Public Interest Group on Cancer Research: a successful patient-researcher partnership in Newfoundland and Labrador

BACKGROUND

Partnering with patients and family members affected by cancer is essential for meaningful research, public engagement and outreach, and advocacy activities.

OBJECTIVE

Our objective was to create a public interest group through an academic-community partnership focused on cancer research and public engagement.

METHODS

A purposeful recruitment process was implemented to ensure a diverse and inclusive group. The group meets virtually and communicates by email. The group's activities focus on identifying the needs, priorities, and interests of cancer-affected individuals in the province; consultations; and designing research projects and public outreach activities together. Comprehensive meeting minutes are kept and used to distill discussion points. The work of the group is disseminated through a variety of channels.

RESULTS

The public interest group includes 12 cancer patient and family member representatives, in addition to researchers. Discussions by the interest group identified key themes related to: (1) equity issues and regional disparity in provincial oncocare; (2) information needs; (3) need for patient empowerment and public understanding; and (4) family member and partner needs and experiences. To date, the group has co-designed a cancer research proposal and a public engagement/outreach activity. The group also provides consultations on cancer-related projects/public engagement activities and members act as patient partners in specific research and public engagement proposals. The group evolves over time, and increasingly advocates on behalf of cancer patients and families. Retention and satisfaction of the public partners with group activities have been high. The group's work and findings are disseminated to the Provincial Cancer Care Program, as well as to public and scientific stakeholders through local media, academic conferences and presentations, and a dedicated website.

CONCLUSION

Public Interest Group on Cancer Research represents a highly successful patient-researcher partnership in oncology. It designs meaningful and patient-oriented studies and outreach activities in cancer. It also elevates and widely supports cancer patient and family voice.

Implementation Science: Increasing the Public Health Impact of Audiology Research

PURPOSE

Implementation science aims to facilitate the use of evidence-based programs, practices, and policies in routine care settings. In audiology, as in other health disciplines, there is a persistent research-to-practice gap. Improving the adoption, reach, implementation, and sustainment of effective interventions in audiology would increase their public health impact, ensuring that all individuals needing hearing health care services could benefit from innovations and evidence-based best practices. This tutorial provides an introductory overview of implementation science relevant to the field of audiology, including Internet-based practices and interventions.

METHOD

Major concepts and themes of implementation science are presented, including implementation outcomes, implementation science frameworks, implementation strategies, current topics in implementation science, and study design considerations. Recent publications in audiology are highlighted to illustrate implementation science concepts and themes. The relevance of each topic to the use of evidence-based programs, practices, and policies in audiology is highlighted with reference to recent research in the field.

CONCLUSIONS

Challenges in the widespread delivery of evidence-based audiological practices and interventions limit their public health impact. The application of implementation science principles and methods in audiology research, as demonstrated in other areas of health research, can increase our focus on ensuring that effective practices are widely available, accessible, equitable, and sustainable to improve the lives of those who need them.

Best-Worst Scaling and the Prioritization of Objects in Health: A Systematic Review

BACKGROUND AND OBJECTIVE

Best-worst scaling is a theory-driven method that can be used to prioritize objects in health. We sought to characterize all studies of best-worst scaling to prioritize objects in health, to assess trends of using best-worst scaling in prioritization over time, and to assess the relationship between a legacy measure of quality (PREFS) and a novel assessment of subjective quality and policy relevance.

METHODS

A systematic review identified studies published through to the end of 2021 that applied best-worst scaling to study priorities in health (PROSPERO CRD42020209745), updating a prior review published in 2016. The PubMed, EBSCOhost, Embase, Scopus, APA PsychInfo, Web of Science, and Google Scholar databases were used and were supplemented by a hand search. Data describing the application, development, design, administration/analysis, quality, and policy relevance were summarized and we tested for trends by comparing articles before and after 1 January, 2017. Multivariate statistics were then used to assess the relationships between PREFS, subjective quality, policy relevance, and other possible indicators.

RESULTS

From a total of 2826 unique papers identified, 165 best-worst scaling studies were included in this review. Applications of best-worst scaling to study priorities in health have continued to grow (p < 0.01) and are now used in all regions of the world, most often to study the priorities of patients/consumers (67%). Several key trends can be observed over time: increased use of pretesting (p < 0.05); increased use of online administration (p < 0.01), and decreased use of paper self-administered surveys (p = 0.02); increased use of heterogeneity analysis (p = 0.02); an increase in having a clearly stated purpose (p < 0.01); and a decrease in comparing respondents to non-respondents (p = 0.01). The average sample size has more than doubled, from 228 to 472 respondents, but formal sample size justifications remain low (5.3%) and unchanged over time (p = 0.68). While the average PREFS score remained unchanged at 3.1/5, both subjective quality and policy relevance trended up, but changes were not statistically significant (p = 0.06 and p = 0.13). Most of the variation in subjective quality was driven by PREFS (R2 = 0.42), but it was also positively assosciated with policy relevance, heterogeneity analysis, and using a balanced incomplete block design, and was negatively associated with not using developmental methods and an increasing sample size.

CONCLUSIONS

Using best-worst scaling to prioritize objects is now commonly used around the world to assess the priorities of patients and other stakeholders in health. Best practices are clearly emerging for best-worst scaling. Although legacy measures (PREFS) to measure study quality are reasonable, there may need to be new tools to assess both study quality and policy relevance.

Multi-sector stakeholder's perceptions of determinants of successful implementation of a pediatric weight management intervention

Background

Multi-sector stakeholder engagement is essential in the successful implementation, dissemination, and sustainability of pediatric weight management interventions (PWMI), particularly in low-income settings where sustainability relies on external policies and reimbursement. The objective of this study was to engage stakeholders (1) to inform the creation of the intervention with adaptations needed for a successful PWMI in a primary care and community setting and (2) to identify barriers and facilitators to implementation and dissemination.

Methods

We sought to examine the perspectives of local, state, and national clinic and community stakeholders during the pre-implementation period of a two-arm, randomized trial of a Health Weight Clinic PWMI conducted in two health centers and a modified-Healthy Weight and Your Child PWMI at two local YMCAs that serve a predominantly lower income, Hispanic community. The Consolidated Framework for Implementation Research interview guide served as a template for the study but was modified to fit the PWMIs and the various professional roles. Interviews were transcribed and analyzed using the framework analysis approach and themes were linked to the CFIR domains and constructs.

Results

Twenty-six stakeholders perceived the following as needed components of a PWMI: a formal curriculum with illustrative examples, a patient- and family-centered program, group visits, and high-quality multidisciplinary personnel. These findings led to the creation of a group visit curriculum, implementation trainings and cross-site collaborative technical assistance. Additionally, creating partnerships between community and clinical organizations, and addressing patient barriers and unmet social needs (i.e., transportation, food) were identified as facilitators to successful implementation. These results led to the creation of community resource guides, connections to community organizations, and screening and referring for unmet social needs. Perceived facilitators of dissemination included proving cost-effectiveness of the PWMI to inform insurance reimbursement for long-term sustainability. Therefore, we collected cost data and engaged with Medicaid officials to discuss reimbursement.

Conclusion

Findings highlight the importance of engaging multi-sector stakeholders pre-implementation to ensure the components valued are included, ensuring the program minimizes barriers to participation, considering how staff training can improve implementation and how collected outcomes can inform sustainability and dissemination of PWMIs in clinic and community settings.

Engagement of people with lived experience of dementia advisory group and cross-cutting program: reflections on the first year

BACKGROUND

The objective of this paper is to describe the activities, challenges and mitigation strategies, lessons learned and reflections on the importance of engagement from the first year of the Canadian Consortium on Neurodegeneration in Aging (CCNA) Engagement of People with Lived Experience of Dementia (EPLED) Advisory Group and cross-cutting program. EPLED was created to support persons with dementia and care partners to be actively involved in the CCNA research process.

MAIN BODY

The Advisory Group was formed to work with CCNA researchers and programs to develop new ways to further collaborate and advance the methods of patient engagement in research on dementia. A role profile and recruitment poster were developed and, after interviews, 17 people were invited to join the Advisory Group. We planned three online EPLED meetings to take place between July-August of 2020, with one in-person meeting to be held in Canada. Due to COVID-19, we moved all of these meetings online. In the first year, EPLED and the Advisory Group met seven times formally, four times informally, developed a website, engaged with CCNA research projects, participated in CCNA "Central" activities and formulated an evaluation plan. For researchers and people with lived experience of dementia, motivations for patient engagement included challenging stigma, making meaning from their experience (such as building relationships and having their voices heard) and contributing to research. Common challenges to engagement were related to navigating the impact of COVID-19, such as difficulty in getting to know each other and technical issues with video-conference software. We learned that developing trusting relationships, providing education, offering support, being flexible and acknowledging tensions between research, practice and lived experience, were vital to the success of the Advisory Group.

CONCLUSION

The first year of the EPLED Advisory Group demonstrated the potential contributions of people with lived experience of dementia as partners in research. Building these collaborations with individuals and communities-people living with dementia, care partners, researchers and research institutions-has the potential for positive impact across these groups and, ultimately, improve the lives of people living with dementia and their care partners.

Patient and researcher experiences of patient engagement in primary care health care research: a participatory qualitative study

Background

Studies have highlighted common challenges and barriers to patient engagement in research, but most were based on patient partners' or academic researchers' experiences. A better understanding of how both groups differentially experience their partnership could help identify strategies to improve collaboration in patient engagement research.

Aim

This study aimed to describe and compare patient partners' and academic researchers' experiences in patient engagement research.

Methods

Based on a participatory approach, a descriptive qualitative study was conducted with patient partners and academic researchers who are involved in the PriCARE research programme in primary health care to examine their experience of patient engagement. Individual semi‐structured interviews with patient partners (n = 7) and academic researchers (n = 15) were conducted. Academic researchers' interview verbatims, deidentified patient partners' summaries of their interviews and summaries of meetings with patient partners were analysed using inductive thematic analysis in collaboration with patient partners.

Results

Patient partners and academic researchers' experiences with patient engagement are captured within four themes: (1) evolving relationships; (2) creating an environment that fosters patient engagement; (3) striking a balance; and (4) impact and value of patient engagement. Evolving relationships refers to how partnerships grew and improved over time with an acceptance of tensions and willingness to move beyond them, two‐way communication and leadership of key team members. Creating an environment that fosters patient engagement requires appropriate structural support, such as clear descriptions of patient partner roles; adequate training for all team members; institutional guidance on patient engagement; regular and appropriate translation services; and financial assistance. For patient partners and academic researchers, striking a balance referred to the challenge of reconciling patient partners' interests and established research practices. Finally, both groups recognized the value and positive impact of patient engagement in the programme in terms of improving the relevance of research and the applicability of results. While patient partners and academic researchers identified similar challenges and strategies, their experiences of patient engagement differed according to their own backgrounds, motives and expectations.

Conclusion

Both patient partners and academic researchers highlighted the importance of finding a balance between providing structure or guidelines for patient engagement, while allowing for flexibility along the way.

Patient or Public Contribution

Patient partners from the PriCARE research programme were involved in the following aspects of the current study: (1) development of the research objectives; (2) planning of the research design; (3) development and validation of data collection tools (i.e., interview guides); (4) production of data (i.e., acted as interviewees); (5) validation of data analysis tools (code book); (6) analysis of qualitative data; and (7) drafting of the manuscript and contributing to other knowledge translation activities, such as conference presentations and the creation of a short animated video.

Refugee Women's Receptiveness for Virtual Engagement on Reproductive Health During the COVID-19 Pandemic

Background

Refugee women who leave their country due to persecution and violence have multiple barriers to sexual and reproductive health (SRH) services. The COVID-19 pandemic added an additional barrier to in-person reproductive health education, dialogue, and clinical care. This study aimed to assess the potential of using virtual group meetings as a forum for refugee women to learn about and discuss reproductive health concerns such as cervical cancer screening, family planning, childbirth, and postpartum care.

Method

We conducted semi-structured interviews with 36 refugee women and stakeholders to assess factors that impact refugee women’s receptiveness for virtual platforms to obtain information and engage in discussions on reproductive health. Thematic analysis was conducted using the software Dedoose.

Results

Openness to engage in virtual platforms varied by refugee community, women’s demographic, and life experience. The women’s involvement with local refugee groups facilitated their engagement with virtual platforms. Furthermore, individuals’ family structure and marital relationship, along with literacy and English proficiency, and access to and familiarity with technology impacted engagement. Virtual groups needed to mirror confidentiality and women expressed a strong preference that groups were all-women.

Conclusion

Refugee women are receptive to virtual groups on SRH when they are offered in a culturally appropriate manner that considers the living situations and access to technology after arrival to the USA. Findings from this study provide a framework to develop and tailor effective virtual or hybrid virtual-in-person programs for women in refugee communities.

Engaging Families in Life Course Intervention Research: An Essential Step in Advancing Equity

Life course intervention research requires a thorough understanding of complex factors that interact to affect health over time. Partnerships with families and communities are critical to understanding these interconnections and identifying effective interventions. Here, family and community engagement are presented, aligned with the 5 phases of the life course intervention research framework: planning, design, implementation, evaluation, and translation. During planning, the researcher considers their own starting position and what they need to learn from families and the community. The design phase produces a plan for family engagement that is layered, iterative, and includes qualitative methods that will inform life course modeling and the research process. The implementation phase includes administrative actions such as creating opportunities for contributions and providing compensation to family and community partners. The evaluation phase requires measurement of the quality of partnerships with families and community and includes making adjustments as indicated to improve these partnerships. This phase also calls for reflection on the impact these partnerships had on the intervention, including if they made a difference for those being served. During translation, the researcher works with all partners, including families and communities, about follow up steps toward project continuation, replication, or completion. The researcher also works collaboratively in determining how the study results are shared. A holistic approach to health over the life course that is designed and executed in partnership with families and their community can generate research findings with broad practical applicability and strong translational potential.

Factors Associated With Participation in Clinical Trials Among Patients With Lupus

BACKGROUND/OBJECTIVE

Participation rates for clinical trials, including lupus trials, in the United States are low, but are even lower for underrepresented minorities. The impact of underrepresentation in trials can be far-reaching and is problematic because female subjects of color with lupus experience greater morbidity and mortality. As such, the overarching goal of this study was to characterize the factors that influence participation in lupus clinical trials.

METHODS

The Lupus and Allied Diseases Association, the Lupus Foundation of America, and the Lupus Research Alliance collected data for their externally led Patient-Focused Drug Development Initiative-for the purpose of understanding and improving the rates of participation in lupus-related clinical trials. Participants completed a 46-question survey (in English or Spanish) electronically or on paper, which was distributed online or at lupus events. Logistic regression was used to test whether demographic and disease characteristics were associated with participation in past lupus trials.

RESULTS

Data were available for 2220 respondents. Black respondents with lupus were more likely, than their White and Hispanic counterparts, to have participated in past clinical trials (p < 0.05). Although not statistically significant, Hispanic respondents were also more likely to have participated than their White counterparts (odds ratio, 1.40; 95% confidence interval, 0.96-2.11). Both demographic (ie, race/ethnicity) and medical (ie, disease severity defined as more organ involvement) factors seem to be important determinants of participation in clinical trials (p < 0.05).

CONCLUSIONS

Combining the results from this study and prior research provides insight into recruitment strategies to increase participation rates of historically underrepresented minorities.

A Communication Perspective on What Patient Advisory Boards Do: Action-Implicative Discourse Analysis and Negotiating Advice

Stakeholder advisory boards are recognized as an essential and useful part of patient-centered research. However, such engagement can involve exchanges of diverse individual experiences, multiple opinions, and strong feelings in the face of researchers' limitations, deadlines, and agendas. Yet, little work examines how these potential tensions occur and are resolved in actual advisory board meetings. This perspective article describes and employs a communication framework for analyzing a patient advisory council (PAC) for a comparative effectiveness study on acupuncture and pain counseling for inpatients with cancer. The framework, Action-Implicative Discourse Analysis (AIDA), is an observational method that examines challenges through recorded and transcribed, naturally occurring interaction. Our analysis focused on two short excerpts from the first PAC meeting to demonstrate members' navigation of advice-giving and advice-receiving-one in which advice was ultimately implemented by the study team and another in which it was deemed unfeasible. Although advice is inherent to the work of all PACs, it often emerges unannounced as negotiated moments, made up of seemingly minor conversation moves. As a recurring event, advice can and should be analyzed and discussed within PACs to improve communication and team dynamics.

Understanding the Influence and Impact of Stakeholder Engagement in Patient-centered Outcomes Research: a Qualitative Study

BACKGROUND

Engaging patients and other stakeholders as partners in research offers promise in improving the relevance and usefulness of research findings.

OBJECTIVE

To explore the influence and impact of patient and other stakeholder engagement on the planning and conduct of comparative effectiveness research studies.

DESIGN

Qualitative study with virtual, hour-long semi-structured interviews.

PARTICIPANTS

Fifty-eight researchers and fifty-one partners from a diverse purposeful sample of fifty-eight studies funded by the Patient-Centered Outcomes Research Institute (PCORI).

APPROACH

Content and thematic analysis of interview data.

KEY RESULTS

Described as an integral, long-term part of the research process, engagement influenced all aspects of the design and execution of studies. Partner influence was also dynamic and iterative, taking different forms over the course of the study. Across studies, we identified 387 discrete examples of influence and classified each as one of five types of influence, derived inductively from the interview data: co-producing, redirecting, refining, confirming, and limited. Most projects exhibited multiple types of influence, with 50 researchers and 41 partners reporting two or more types of influence within a project. Of the 387 examples of stakeholder influence, 306 had at least one reported impact on the study. Such impacts included changes to reflect the needs and preferences of patients or clinicians, as well as impacts on study feasibility, study quality, engagement scope or quality, and study relevance. Both researchers and partners identified multiple types of impact within projects, with 42 researchers and 38 partners reporting two or more types within a project. Because of these observable impacts, researchers and partners described engagement as worthwhile.

CONCLUSIONS

Findings provide insights for funders and institutions supporting engagement, measurement efforts, and clinical researchers aiming to conduct engaged research and observe similar influences and impacts in their own studies.

Engaging Patient Advisory Boards of African American Community Members with Type 2 Diabetes in Implementing and Refining a Peer-Led Medication Adherence Intervention

African Americans are more likely than non-Hispanic whites to be diagnosed with and die from diabetes. A contributing factor to these health disparities is African Americans’ poor diabetes medication adherence that is due in part to sociocultural barriers (e.g., medicine and illness misperceptions), which negatively affect diabetes management. In our prior work, we engaged with community stakeholders to develop and test a brief version of a culturally adapted intervention to address these barriers to medication adherence. The objective of this study was to elicit feedback to inform the refinement of the full 8-week intervention. We utilized a community-engaged study design to conduct a series of meetings with two cohorts of patient advisory boards of African Americans with type 2 diabetes who were adherent to their diabetes medicines (i.e., peer ambassadors). In total, 15 peer ambassadors were paired with 21 African American participants (i.e., peer buddies) to provide specific intervention support as peers and serve in an advisory role as a board member. Data were collected during nine board meetings with the patient stakeholders. A qualitative thematic analysis of the data was conducted to synthesize the findings. Feedback from the patient advisory board contributed to refining the intervention in the immediate-term, short-term, and long-term. The inclusion of African American community members living with type 2 diabetes on the advisory board contributed to further tailoring the intervention to the specific needs of African Americans with type 2 diabetes in the community.

Peer Support Needs and Preferences for Digital Peer Navigation among Adolescent and Young Adults with Cancer: A Canadian Cross-Sectional Survey

Adolescents and young adults (AYA) with cancer desire peer support and require support programs that address their unique needs. This study investigated the need for, and barriers to, peer support and preferences for digital peer navigation among AYA. A cross-sectional survey was administered to AYA, diagnosed with cancer between the ages of 15–39, at a cancer center and through social media. Descriptive summary statistics were calculated. Participants (n = 436) were on average 31.2 years (SD = 6.3), 3.3 years since-diagnosis (SD = 3.8), and 65% (n = 218) were women. Over three-quaters (n = 291, 76.6%) desired peer support from cancer peers, but 41.4% (n = 157) had not accessed peer support. Main access barriers were: Inconvenience of in-person support groups (n = 284, 76.1%), finding AYA with whom they could relate (n = 268, 72.4%), and finding AYA-specific support programs (n = 261, 70.4%). Eighty-two percent (n = 310) desired support from a peer navigator through a digital app, and 63% (n = 231) were interested in being a peer navigator. Participants indicated a greater need for emotional (n = 329, 90.1%) and informational support (n = 326, 89.1%) than companionship (n = 284, 78.0%) or practical support (n = 269, 73.6%) from a peer navigator. Foremost peer matching characteristics were cancer-type (n = 329, 88.4%), specific concerns (n = 317, 86.1%), and age-at-diagnosis (n = 316, 86.1%). A digital peer navigation program was desired by over 80% of a large Canadian sample of AYA and could potentially overcome the barriers AYA experience in accessing peer support. The design of a peer navigation program for AYA should consider the matching characteristics and multidimensional support needs of AYA.

Navigating ethical challenges of conducting randomized clinical trials on COVID-19

BACKGROUND

The contemporary frameworks for clinical research require informed consent for research participation that includes disclosure of material information, comprehension of disclosed information and voluntary consent to research participation. There is thus an urgent need to test, and an ethical imperative, to test, modify or refine medications or healthcare plans that could reduce patient morbidity, lower healthcare costs or strengthen healthcare systems.

METHODS

Conceptual review.

DISCUSSION

Although some allocation principles seem better than others, no single moral principle allocates interventions justly, necessitating combining the moral principles into multiprinciple allocation systems. The urgency notwithstanding, navigating ethical challenges related to conducting corona virus disease (COVID-19) clinical trials is mandatory, in order to safeguard the safety and welfare of research participants, ensure autonomy of participants, reduce possibilities for exploitation and ensure opportunities for research participation. The ethical challenges to can be categorized as challenges in allocation of resources for research; challenges of clinical equipoise in relation to the research questions; challenges of understanding disclosed information in potential participants; and challenges in obtaining informed consent.

CONCLUSION

To navigate these challenges, stakeholders need a delicate balance of moral principles during allocation of resources for research. Investigators need to apply information processing theories to aid decision-making about research participation or employ acceptable modifications to improve the informed consent process. Research and ethics committees should strengthen research review and oversight to ensure rigor, responsiveness and transparency.