Developing a Canadian evaluation framework for patient and public engagement in research: study protocol

Studying How Patient Engagement Influences Research: A Mixed Methods Study

BACKGROUND

There is evidence supporting the value of patient engagement (PE) in research to patients and researchers. However, there is little research evidence on the influence of PE throughout the entire research process as well as the outcomes of research engagement. The purpose of our study is to add to this evidence.

METHODS

We used a convergent mixed method design to guide the integration of our survey data and observation data to assess the influence of PE in two groups, comprising patient research partners (PRPs), clinicians, and researchers. A PRP led one group (PLG) and an academic researcher led the other (RLG). Both groups were given the same research question and tasked to design and conduct an inflammatory bowel disease (IBD)-related patient preference study. We administered validated evaluation tools at three points and observed PE in the two groups conducting the IBD study.

RESULTS

PRPs in both groups took on many operational roles and influenced all stages of the IBD-related qualitative study: launch, design, implementation, and knowledge translation. PRPs provided more clarity on the study design, target population, inclusion-exclusion criteria, data collection approach, and the results. PRPs helped operationalize the project question, develop study material and data collection instruments, collect data, and present the data in a relevant and understandable manner to the patient community. The synergy of collaborative partnership resulted in two projects that were patient-centered, meaningful, understandable, legitimate, rigorous, adaptable, feasible, ethical and transparent, timely, and sustainable.

CONCLUSION

Collaborative and meaningful engagement of patients and researchers can influence all stages of qualitative research including design and approach, and outputs.

Future directions for patient engagement in research: a participatory workshop with Canadian patient partners and academic researchers

BACKGROUND

Patient engagement in research (also commonly referred to as patient or patient and public involvement in research) strives to transform health research wherein patients (including caregivers and the public) are regularly and actively engaged as multidisciplinary research team members (i.e. patient partners) working jointly towards improved health outcomes and an enhanced healthcare system. To support its mindful evolution into a staple of health research, this participatory study aimed to identify future directions for Canadian patient engagement in research and discusses its findings in the context of the international literature.

METHODS

The study met its aim through a multi-meeting pan-Canadian virtual workshop. Participants (n = 30) included Strategy for Patient-Oriented Research-funded academic researchers and patient partners identified through a publicly available database, personal and professional networks and social media. All spoke English, could access the workshop virtually, and provided written informed consent. The workshop was composed of four, 1.5-3-h virtual meetings wherein participants discussed the current and preferred future states of Canadian patient engagement in research. Workshop discussions (i.e. data) were video and audio recorded. Themes were generated through an iterative process of inductive thematic analysis that occurred concurrently with the multi-week workshop.

RESULTS

Our participatory and iterative process identified 10 targetable areas of focus for the future of Canadian patient engagement in research. Five were categorized as system-level (systemic integration; academic culture; engagement networks; funding models; compensation models), one as researcher-level (engagement processes), and four crossed both levels (awareness; diversity and recruitment; training, tools and education; evaluation and impact). System level targetable areas called for reshaping the patient engagement ecosystem to create a legitimized and supportive space for patient engagement to be a staple component of a learning health system. Researcher level targetable areas called for academic researchers and patient partners to collaboratively generate evidence and apply knowledge to inform values and behaviours necessary to foster and sustain supportive health research spaces that are accessible to all.

CONCLUSIONS

Future directions for Canadian patient engagement in research span 10 interconnected targetable areas that require strong leadership and joint action between patient partners, academic researchers, and health and research institutions if patient engagement is to become a ubiquitous component of a learning health system.

Four year evaluation of a parent advisory group to support a research program for knowledge translation in child health

BACKGROUND

In 2016, we developed a pediatric parent advisory group to inform our research program which creates innovative knowledge translation (KT) tools for parents on priority topics related to acute childhood illness. We implemented a mixed methods strategy to evaluate the experiences of group members. The purpose of this paper is to present the findings from parent evaluations over four years and to discuss our experiences collaborating with the group over a multi-year period.

METHODS

We conducted year-end surveys and interviews of group members to understand parents' perceptions of their experiences, group management, researcher interaction, and other outcomes of advisory group participation from 2018 to 2021. We applied a mixed methods approach, collecting and analyzing both quantitative (survey) and qualitative (survey/interview) data. Survey data were analyzed by term using descriptive statistics (i.e., frequencies, percentages). Open-ended survey responses were analyzed by conventional content analysis. Interview data were analysed thematically.

RESULTS

Year-end survey response rates and interview participation varied over the years. Responses to evaluation questions were generally positive and most improved over time. Results prompted changes to improve P-PAG operations, such as changes to location of meetings, communications about the group's purpose, offering sufficient context for discussion items, and providing feedback about how members' input was used. Themes identified from the qualitative data related to the importance of certain aspects of group functioning, positive views of the group's current management, and potential areas for improvement. Parents regularly expressed a desire for more diversity in the group's membership and an interest in hearing more about how the research program's activities fit into the broader healthcare system and their impacts on health outcomes.

CONCLUSIONS

Our experience in establishing, managing, and evaluating a parent advisory group over many years has resulted in valuable insights regarding patient engagement in health research and sustaining an advisory group over time. We have learned that an intentional and iterative approach with regular evaluations and responsive changes has been essential for fostering meaningful engagement. Significant resources are required to maintain the group; in turn, the group has made substantial and diverse contributions to the research program and its outputs.

Factors influencing French community pharmacists' willingness to participate in research projects: a mixed method study

BACKGROUND

French community pharmacists are facing an increasing demand to provide a wider range of services to meet the needs of the population. These new missions must be evaluated by primary care research studies. This study aims to explore the factors that influence French community pharmacists' willingness to participate in research projects.

METHODS

A mixed-method design was adopted for this study, comprising an initial quantitative online survey followed by semi-directed interviews. The investigation was conducted at two French faculties of pharmacy, Angers and Nantes, involving students in their 6th and final year of pharmacy education, and their community pharmacist tutors. The survey items were based on a study by Saini et al. and participants responded using five-point Likert scales. The semi-directed interviews were conducted after the quantitative analysis, only with volunteer and already graduated community pharmacists.

RESULTS

A total of 131 people participated in the quantitative analysis, comprising 75 students and 56 pharmacists. Pharmacists and students agreed on the significance of two key aspects: the research must possess a clear and meaningful purpose, and researchers must keep the pharmacists informed about the study's results. Among the 27 proposed items, only three showed significantly different results between students and pharmacists. Moreover, 11 semi-structured interviews were conducted. Research in the community pharmacy domain is relatively new for many pharmacists. Despite limited training, their willingness to participate is contingent on being actively involved from the outset, receiving appropriate support and training. However, the research should be seamlessly integrated into their daily practice, without being too time-consuming and administratively burdensome. Time constraints emerged as the main obstacle, along with concerns about the availability of human resources. Pharmacists expressed strong motivation driven by the research topic's relevance, and its potential impact on patients or the profession. While financial compensation is desirable, it did not appear to be the main criterion for participation in a study.

CONCLUSIONS

French pharmacists are willing to participate in research projects to improve patient care and develop the profession. Research teams must guide and involve from the project's inception.

A holistic approach to integrating patient, family, and lived experience voices in the development of the BrainHealth Databank: a digital learning health system to enable artificial intelligence in the clinic

Artificial intelligence, machine learning, and digital health innovations have tremendous potential to advance patient-centred, data-driven mental healthcare. To enable the clinical application of such innovations, the Krembil Centre for Neuroinformatics at the Centre for Addiction and Mental Health, Canada's largest mental health hospital, embarked on a journey to co-create a digital learning health system called the BrainHealth Databank (BHDB). Working with clinicians, scientists, and administrators alongside patients, families, and persons with lived experience (PFLE), this hospital-wide team has adopted a systems approach that integrates clinical and research data and practices to improve care and accelerate research. PFLE engagement was intentional and initiated at the conception stage of the BHDB to help ensure the initiative would achieve its goal of understanding the community's needs while improving patient care and experience. The BHDB team implemented an evolving, dynamic strategy to support continuous and active PFLE engagement in all aspects of the BHDB that has and will continue to impact patients and families directly. We describe PFLE consultation, co-design, and partnership in various BHDB activities and projects. In all three examples, we discuss the factors contributing to successful PFLE engagement, share lessons learned, and highlight areas for growth and improvement. By sharing how the BHDB navigated and fostered PFLE engagement, we hope to motivate and inspire the health informatics community to collectively chart their paths in PFLE engagement to support advancements in digital health and artificial intelligence.

"I think there has to be a mutual respect for there to be value": Evaluating patient engagement in a national clinical trial on de-implementation of low value care

BACKGROUND

The evaluation of patient engagement in research is understudied and under-reported, making it difficult to know what engagement strategies work best and when. We provide the results of an evaluation of patient engagement in a large Canadian research program focused on the de-implementation of low-value care. We aimed to evaluate the experience and impact of patient engagement in the study.

METHODS

An online cross-sectional survey was administered using Microsoft Forms to (1) researchers and study staff and (2) patient partners. The survey was developed following iterative reviews by the project's patient partnership council and evaluation committee. Survey content areas included opinions on patient engagement to date, including challenges to engagement and suggestions for improvement. Patient partners also evaluated the partnership council. Descriptive statistics including counts and percentages described Likert scale survey items, while open comments were analyzed using descriptive content analysis.

RESULTS

The survey response rate was 46% (17/37). There were positive attitudes about the value of patient engagement in this project. There was also a high degree of willingness to be involved with patient engagement in future projects, whether as a patient partner or as a researcher including patients on the research team. Most patient partners felt their contributions to the project were valued by researchers and study research staff. Open comments revealed that a co-design approach and full inclusion on the research team were integral to demonstrating the value of patient partner input. Areas for improvement included more frequent and ongoing communication among all team members, as well as earlier training about patient engagement, particularly addressing role expectations and role clarity.

CONCLUSIONS

Our data revealed that despite some challenges, team members recognized the value of patient engagement in research and agreed project decisions had been impacted by patient partner input. Ongoing communication was highlighted as an area for improvement, as well as earlier training and ongoing support for all team members, but particularly researchers and study staff. In response to evaluation data, the team has reinstated a quarterly newsletter and plans to use specific patient engagement planning templates across study sites for all project activities. These tools should help make expectations clear for all team members and contribute to a positive patient engagement experience. Findings can inform patient engagement planning and evaluation for other health research projects.

Resilience at Work among Healthcare Professionals in Oncology during and beyond the Pandemic: Report from A Deliberative Multi-Stakeholder Reflexive Symposium

The chronic distress faced by healthcare professionals (HCPs) in oncology was exacerbated by the COVID-19 pandemic, heightening the need to improve their resilience. The Entretiens Jacques Cartier symposium provided an opportunity for participants from France and Quebec to share perspectives on resilience at work and discuss interventions at individual and organizational levels to support HCP health and well-being. Fifty-eight stakeholders were invited to the symposium, including HCPs, government decision-makers, researchers, and patient representatives. The symposium began with presentations on the nature of professional resilience at work in oncology and promising interventions developed in France and Quebec. Participants were then engaged in deliberation on how evidence and experiential knowledge could contribute to workplace strategies to strengthen resilience. Small-group reflexive sessions using the photovoice method, and an intersectoral roundtable, elicited the expression and deliberation of multiple perspectives on the nature and building blocks of resilience. Four main themes emerged from the discussions: (1) that resilience remains a muddy concept and can be associated pejoratively with "happycracy"; (2) that resilience must contend with bounded autonomy and captors; (3) that it relies on a sense of coherence at work; and (4) that patients play a role in improving HCP resilience. Stakeholders from healthcare systems in different countries view resilience at work as a means of equipping teams to handle chronic and punctual stresses in cancer care. The symposium emphasized the importance of better defining what resilience at work means and pursuing explorations of multicomponent interventions to support oncology HCPs and the patients they care for. The themes raised by participants at the symposium suggest pathways for furthering this exploration.

Using telepresence robots as a tool to engage patient and family partners in dementia research during COVID-19 pandemic: a qualitative participatory study

BACKGROUND

Long-term care (LTC) settings have been disproportionately affected by the COVID-19 pandemic; it is important to address unmet needs and explore practical strategies for supporting LTC residents and staff. The involvement of patient partners and family community members in research planning, implementation and evaluation is the basis of Patient and Public Involvement approach and has been challenging during the COVID-19 pandemic, as visitation restrictions have created barriers to conducting research in healthcare settings. Innovative methods and tools are needed for conducting participatory research. This study investigated the use of telepresence as innovative tools for participatory research based on three projects conducted with patient and family partners during the COVID-19 pandemic.

METHODS

The data source includes (a) team reflective discussions, (b) weekly meeting notes, (c) field notes, and (d) interviews with ten researchers. We applied purposive sampling to select ten researchers who used a telepresence robot to conduct research in British Columbia, Canada. Semi-structured one-to-one interviews were conducted via Zoom virtual meetings. Patient and family partners contributed to team analysis to identify themes.

RESULTS

Analysis of the data produced five themes: (1) Research Enabler, (2) User-Friendly Technology, (3) Increased Engagement, (4) Lack of Infrastructure and Resources, and (5) Training and Technical Obstacles. Based on the results, we propose "ROBOT"-an acronym for five actionable recommendations to support the use of telepresence robots for research. The ROBOT recommendations represent: Realign to adapt, Organize with champions, Blend strategies, Offer timely technical assistance, and Tailor training to individual needs.

CONCLUSIONS

This study offers practical insights into the use of telepresence robots as a safe and innovative tool for conducting remote research with people with dementia, even in times of restricted access, as with COVID-19. Future research should apply more creativity and flexibility in adopting technology to expand possibilities for involving people with dementia in research.

Embedding research codesign knowledge and practice: Learnings from researchers in a new research institute in Australia

BACKGROUND

Research codesign is generally defined as end-users' involvement in planning, implementation, and evaluation of projects. Recently, there has been a growing interest in codesign to maximise research acceptability, applicability, and impact and to address longstanding issues around power and depth of involvement. Frameworks have been developed to assist in understanding research codesign processes at a project level. However, little is known about how university based researchers construct or adopt a coherent approach to sustain research codesign in governance, methodological approaches, and practice. This study investigated the perspectives of researchers within a newly formed research institute about principles and practices of research codesign in the context of their previous and current projects. We also investigated their perceptions of institution-level enablers and barriers to codesign. University based researchers are our primary focus here and we intend to consult other stakeholders in future work.

METHODS

Using an interview guide informed by exploratory work and a scoping review of the literature, we conducted 15 individual interviews with Caring Futures Institute (CFI) leaders and researchers at different career stages working across multiple areas of health, care, and social research. Qualitative thematic analysis was conducted.

RESULTS

The researchers we interviewed were involved in projects ranging from large nationally funded projects to small studies funded by the university or PhD projects. Research codesign activities were generally part of larger researcher-led projects but there were a few examples of community-led projects. There was agreement amongst participants on the principles and perceived benefits of research codesign such as partnership, co-learning, and power sharing. Less agreement was found regarding the definition of research codesign and best terminology to be used. Themes reflecting the success of research codesign included pre-existing community relationships, communication skills, knowledge, and training on codesign, balancing power relationships, use of external facilitators, and adequacy of funding, time, and resources.

CONCLUSIONS

The study reaffirmed the complexity of research codesign from researchers' perspectives and identified areas of potential action that may be beneficial for university based research institutions in building codesign skills, capacity and culture for example training, peer learning and funding support. Implications for practice improvement centre on a dual strategy of building practical capacity in researchers and integrating institutional dimensions (such as governance and leadership) into codesign frameworks. This can help to ensure research codesign is integrated into organisational culture and through the work of individual researchers.

Facilitating and supporting the engagement of patients, families and caregivers in research: the "Ottawa model" for patient engagement in research

BACKGROUND

Patient engagement is increasingly being recognized as a critical component of health research; however, institutional models for building infrastructure and capacity for patient engagement in research are limited. There is an opportunity to create reproducible and scalable models of patient engagement in research and share best and promising practices.

MAIN BODY

In this article, we describe the development and features of the framework for the Ottawa Patient Engagement in Research Model at The Ottawa Hospital (TOH) and the Ottawa Hospital Research Institute (OHRI). Key components of the model include: a Patient and Family Engagement Program at TOH, which recruits, educates, and supports patients, families and caregivers to engage in clinical care, governance, and research; the Ottawa Methods Centre within the OHRI, which leads methodological research and provides support to investigators for patient engagement and patient-oriented research at TOH; and the Office of Patient Engagement in Research Activities, also within the OHRI, which facilitates collaborations between patients, researchers, clinicians and other stakeholders. Early success of this model can be attributed to aligned institutional priorities between TOH, OHRI and patients, the establishment of a patient engagement policy, ongoing education and support provided to patient partners and researchers, and innovative recruitment, tracking and evaluation procedures. Ongoing challenges and next steps include promoting diversity among patient partners, implementing an equitable compensation policy, engaging patients across a variety of roles and research areas, and developing resources to expand and sustain this program.

CONCLUSION

This model represents a unique effort of patients, clinicians, researchers, and policymakers across disciplines and institutions to produce a harmonized strategy and infrastructure for meaningful collaboration with patients and families in health research, and capacity building in patient-oriented research.

Shared decision-making in Canada: Update on integration of evidence in health decisions and patient-centred care government mandates

In Canada, government mandates for patient-centred care (PCC) vary across the 10 provinces and three territories. Although basic medical and hospital services are provided for all, health care options for patients also depend on having private insurance. Thus, the current design of the Canadian healthcare system has several implications for PCC and shared decision-making (SDM). Since 2007, this is our fourth update on SDM in Canada. The aim of this paper is to provide an update on the current state of SDM and patient and public involvement in Canada. Overall, we still observed the difficulty of implementing any sort of national strategy partly because of the decentralized nature of the healthcare system. Second, national professional education programs are complicated by licensure and scope of practice variations across jurisdictions. Third, there are variations in the availability of different options covered by universal healthcare. Canada has experienced some favorable development as PCC is now explicitly articulated in the policies of most provinces and territories and there are increased efforts to give patients more access to their electronic health records. However, patient and public engagement (PPE) reform in health programs and governance remains an exception, and continuing centralization of governance structures may reduce their responsiveness to patient priorities. In a 2018 survey, 47.2% of respondents reported that they were not told by their health professional that they had a choice about treatment. Nonetheless, decision aids and decision coaching are increasingly available for health-related decisions and the Ottawa Hospital Research Institute's decision aid inventory has ensured continued leadership in this area. Diverse jurisdictions are starting to embed decision aids into care pathways, with some decision aids being included in clinical practice guidelines. The COVID-19 pandemic may have had a negative impact on SDM by removing decision choices due to emergency public health mandates, but stimulated new research and decision aids. Canada continues to assign health research funding to SDM and PCC, and a program dedicated to patient-oriented research is central to this effort. Guides and frameworks are increasingly available for planning and evaluating PPE. Finally, various initiatives are attempting to involve and empower Indigenous peoples through PPE and SDM.