Evaluating communities of practice and knowledge networks: a systematic scoping review of evaluation frameworks

Utilising a 'Community of Practice' to support pharmacists to work in residential aged care: protocol for a longitudinal evaluation

INTRODUCTION

A Community of Practice is briefly defined as a group of people with a shared interest in a given area of practice who work collaboratively to grow collective knowledge. Communities of Practice have been used to facilitate knowledge exchange and improve evidence-based practice. Knowledge translation within the residential aged care sector is lacking, with barriers such as inadequate staffing and knowledge gaps commonly cited. In Australia, a Federal inquiry into residential aged care practices led to a recommendation to embed pharmacists within residential aged care facilities. Onsite practice in aged care is a new role for pharmacists in Australia. Thus, support is needed to enable pharmacists to practice in this role.The primary aim is to evaluate the processes and outcomes of a Community of Practice designed to support pharmacists to work in aged care.

METHODS AND ANALYSIS

A longitudinal, single-group, pretest-post-test design in which the intervention is a Community of Practice. The Community of Practice will be established and made available for 3 years to all Australian pharmacists interested in, new to or established in aged care roles. The Community of Practice will be hosted on online discussion platforms, with additional virtual meetings and annual symposia. The following data will be collected from all members of the Community of Practice: self-evaluation of the processes and outcomes of the Community of Practice (via the CoPeval scale) and confidence in evidence-based practice (EPIC scale), collected via online questionnaires annually; and discussion platform usage statistics and discussion transcripts. A subset of members will be invited to participate in annual semi-structured individual interviews.Data from the online questionnaire will be analysed descriptively. Discussion transcripts will be analysed using topic modelling and content analysis to identify the common topics discussed and their frequencies. Qualitative data from individual interviews will be thematically analysed to explore perceptions and experiences with the intervention for information/knowledge exchange, impact on practice, and sharing/promoting/implementing evidence-based practice.

ETHICS AND DISSEMINATION

Human ethics approval has been granted by the University of Western Australia's Human Ethics Committee (2023/ET000000). No personal information will be included in any publications and reports to funding bodies.Findings will be disseminated to all members of the Community of Practice, professional organisations, social and mass media, peer-review journals, research and professional conferences and annual reports to the funding body.

Communities of practice to facilitate change in health professions education: A realist synthesis

BACKGROUND

Communities of practice could contribute to transformations in health professions education to meet complex and emerging challenges. However, little is known about the underlying mechanisms of communities of practice in this setting, and how context influences outcomes.

OBJECTIVE

To understand when, why and how communities of practice with health professions education faculty work to facilitate higher education change.

DESIGN

A realist synthesis according to the RAMESES standards and steps described by Pawson and colleagues.

REVIEW METHODS

Early scoping of the literature informed the development of an initial program theory to describe underlying assumptions about how communities of practice in higher education, implemented with health professions education faculty, were likely to work. The theory was tested and further refined through a realist synthesis. A systematic search for evidence using search terms 'faculty', 'communities of practice' and 'higher education' and related terms was supplemented with citation tracking and hand searching of significant authors and journals. Following study appraisal, data were extracted and synthesised from 21 manuscripts describing 16 communities of practice. The realist synthesis focused on identifying patterns in context-mechanism-outcome interactions, and the alignment with substantive theory.

RESULTS

From the included manuscripts, ten context-mechanism-outcome configurations were identified that describe a range of individual, interpersonal and institutional outcomes of communities of practice with health professions education faculty and context-mechanism interactions that contribute to achieving these outcomes.

CONCLUSIONS

This study expands theoretical understandings of how and why communities of practice work. There is value in communities of practice in the higher education sector, primarily in the field of health professions education. Communities of practice implemented in the context of complex change with participants who have a desire to participate can facilitate change in health professions education, including institutional level changes, through reflection, experiential learning and creating a shared agenda for change. Findings from this study can be used by policy and decision-makers within health education to best apply communities of practice to achieve meaningful outcomes.

Exploring value creation in a virtual community of practice: a framework analysis for knowledge and skills development among primary care professionals

BACKGROUND

Healthcare professionals traditional education reflects constraints to face the complex needs of people with chronic diseases in primary care settings. Since more innovative and practical solutions are required, Virtual Community of Practices (vCoP) seem to better respond to learning updates, improving professional and organizational knowledge. However, little is known about the value created in vCoPs as social learning environments. The objective of this project was to explore the value creation process of a gamified vCoP ("e-mpodera vCoP") aimed at improving the knowledge and attitudes of primary healthcare professionals (PCPs) (nurses and general practitioners) to the empowerment of people with chronic conditions.

METHODS

A framework analysis assessed the value creation process using a mixed methods approach. The framework provided awareness about knowledge and usefulness in a learning community through five cycles: (1) immediate value, (2) potential value, (3) applied value, (4) realized value, and (5) reframing value. Quantitative data included vCoP analytics such as logins, contributions, points, badges, and performance metrics. Qualitative data consisted of PCPs' forum contributions from Madrid, Catalonia, and Canary Islands over 14 months.

RESULTS

A total of 185 PCPs had access to the e-mpodera vCoPs. The vCoP showed the dynamic participation of 146 PCPs, along 63 content activities posted, including a total of 3,571 contributions (including text, images, links to webpages, and other files). Regarding the value creation process, the e-mpodera vCoP seems to encompass a broad spectrum of value cycles, with indicators mostly related to cycle 1 (immediate value - activities and interactions) and cycle 2 (potential value - knowledge capital); and to a lesser extent for cycle 3 (applied value - changes in practice) and for cycle 4 (realized value - performance improvement). The presence of indicators related to cycle 5 (reframing value), was minimal, due to few individual redefinitions of success.

CONCLUSION

To reach a wider range of value possibilities, a combination of learning objectives, competence framework, challenged-based gamified platform, and pathway model of skill development seems crucial. However, additional research is required to gain clearer insights into organizational values, professionals' lifelong educational needs in healthcare, and the long-term sustainability of performance improvement.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02757781. Registered on 02/05/2016.

The Impact of Community Learning During a Participatory Nursing Research Project

BACKGROUND

Community learning is one approach to promote research competencies and to involve nurses and nursing students in research. This study examines the impact of community learning according to participants-both those inside and outside the community-in a joint nursing research project at a hospital.

METHOD

A qualitative design was selected using a participatory approach. Data were collected through semistructured interviews, reflections, conversations, and patient input during 2 academic years.

RESULTS

Thematic analysis showed 11 themes, which were organized into three clusters: realization, transformation, and influencing factors. Participants perceived changes in practice and described how their perspectives have changed on care, education, and research. Reconsiderations led to some new or revised strategies, and influencing factors were associated with the contemporary context, degree of involvement, and design/facilitation.

CONCLUSION

The impact of community learning emerged and extended beyond community boundaries, and the indicated influencing factors must be taken into account. [J Contin Educ Nurs. 2023;54(3):131-144.].

Small Towns Talk: Clinical Competency Described Among Rural School Psychologists in Saskatchewan

School psychologists serve the learning needs of students through assessment, intervention, and consultation. The school psychologist can often be the only mental health professional who travels into rural communities. In an effort to adapt to this context of clinical isolation, rural school psychologists develop specialty competencies to serve their clients. This study explores the competencies required among school psychologists practicing in rural regions of Saskatchewan. Eight rural school psychologists participated in a thematic Delphi process to describe the competencies needed in rural school psychology. The participants engaged in three rounds of data collection and collective data analysis and arrived at a strong level of agreement on the final outcomes. The findings describe rural school psychology knowledge (i.e., community knowledge, generalist knowledge, and system knowledge), skills (i.e., relationship skills, core psychologist skills, efficiency skills, and communication skills), attitudes (i.e., flexibility, openness, and compassion), and behaviors (i.e., being responsive, being empowering, being available, and being procedural). The present study results contribute to better defining and understanding the multiple roles and practices of rural school psychologists. Recommendations of the study invite psychologists, clinical supervisors, and psychology training programs to incorporate an emphasis on interpersonal relationships, a generalist approach to psychological services, and consider creative practices of rural practitioners to the initial training and ongoing professional development of school psychologists.

Applications of social theories of learning in health professions education programs: A scoping review

Introduction

In health professions education (HPE), acknowledging and understanding the theories behind the learning process is important in optimizing learning environments, enhancing efficiency, and harmonizing the education system. Hence, it is argued that learning theories should influence educational curricula, interventions planning, implementation, and evaluation in health professions education programs (HPEPs). However, learning theories are not regularly and consistently implemented in educational practices, partly due to a paucity of specific in-context examples to help educators consider the relevance of the theories to their teaching setting. This scoping review attempts to provide an overview of the use of social theories of learning (SToLs) in HPEPs.

Method

A scoping search strategy was designed to identify the relevant articles using two key concepts: SToLs, and HPEPs. Four databases (PubMed, ERIC, ProQuest, and Cochrane) were searched for primary research studies published in English from 2011 to 2020. No study design restrictions were applied. Data analysis involved a descriptive qualitative and quantitative summary according to the SToL identified, context of use, and included discipline.

Results

Nine studies met the inclusion criteria and were included in the analysis. Only two SToLs were identified in this review: Bandura's social learning theory (n = 5) and Lave and Wenger's communities of practice (CoP) theory (n = 4). A total of five studies used SToLs in nursing programs, one in medicine, one in pharmacy, and two used SToLs in multi-disciplinary programs. SToLs were predominantly used in teaching and learning (n = 7), with the remaining focusing on assessment (n = 1) and curriculum design (n = 1).

Conclusions

This review illustrated the successful and effective use of SToLs in different HPEPs, which can be used as a guide for educators and researchers on the application of SToLs in other HPEPs. However, the limited number of HPEPs that apply and report the use of SToLs suggests a potential disconnect between SToLs and educational practices. Therefore, this review supports earlier calls for collaborative reform initiatives to enhance the optimal use of SToLs in HPEPs. Future research should focus on the applicability and usefulness of other theories of learning in HPEPs and on measuring implementation outcomes.

Systematic Review Registration:https://www.researchregistry.com/browse-the-registry#registryofsystematicreviewsmetaanalyses/registryofsystematicreviewsmeta-analysesdetails/60070249970590001bd06f38/, identifier review registry1069.

How successful was the use of a community of practice for the implementation of evidence-based practices for heart failure within the United States Department of Veterans Affairs: Insights from a formative evaluation

Background

Communities of Practice (CoPs) are a promising approach to facilitate the implementation of evidence-based practices (EBPs) to improve care for chronic conditions like heart failure (HF). CoPs involve a complex process of acquiring and converting both explicit and tacit knowledge into clinical activities. This study describes the conceptualization, creation, capacity-building and dissemination of a CoP sustained over 9 years, and evaluates its value and impact on EBP.

Methods

In July 2006, a CoP called the Heart Failure Provider Network (HF Network) was established within the United States Department of Veterans Affairs (VA) with the overarching goal of improving the quality of care for HF patients. We assessed (formative) the HF Network in terms of its various activities (inputs) and proximal impacts (mediators) at the individual level, and its distal impacts (outcomes) at the site level including implementation of new/improved EBPs at the systemwide level.

Results

The HF Network membership grew steadily over the 9 years. The CoP has involved a total of 1341 multidisciplinary and multilevel members at all 144 VA Health Care Systems (sites). Most members were practising clinicians (n = 891, 66.4%), followed by administrators (n = 342, 25.5%), researchers (n = 70, 5.2%) and others (n = 38, 2.8%). Participation was assessed to be “active” for 70.6% versus “passive” for 29.4% of members. The distribution of active members (clinicians 64.7%, administrators 21.6%) was similar to the distribution of overall membership.

Conclusions

Survey respondents perceived the HF Network as useful in terms of its varied activities and resources relevant for patient care. Strong evidence shows that these members, particularly those who considered themselves influential in improving quality of care, noted multiple benefits of membership, which included confirmation of their own clinical practices, evidence-based changes to their practice and help in understanding facilitators and barriers in setting up or running HF clinics and other programmes. Such CoPs have strong impacts on the quality of care being delivered for both mandated and non-mandated initiatives.

The Community of Practice: A Method for Cooperative Learning of Occupational Health and Safety Inspectors

Background: Workplace injuries in Italy still occur despite laws and safety norms. We need to understand the causes rooted in the context and social conditions, and need to improve the practice of Occupational Safety and Health (OSH) inspectors of the Workplace Safety and Prevention Services (WSPS) of the Italian regional health boards. The aims of this study were to describe the setting up of a Community of Practice (CoP) for the production of best practices for injury prevention and to evaluate the motivation of OSH inspectors for participating in the CoP and the effects of CoP participation on their professional practice. Methods: Two workplace injury stories underwent peer review during each CoP meeting. We evaluated the CoP using a focus group and a questionnaire. Result: Between 2014 and 2021, the CoP met in 18 workshops. Over the 8-year period, the CoP grew from 20 to 150 participants. Overall, 30 stories underwent peer review and were published on the institutional website. The focus group participants stated that the reasons why they participated in the CoP were the need to share experience and to tackle new challenges. Conclusion: The CoP was found to be useful for improving professional practice by strengthening professional identity and contributing to the production of new knowledge.

Designing a National Veterinary Prescribing Champion Programme for Welsh Veterinary Practices: The Arwain Vet Cymru Project

Antimicrobial use in agriculture has been identified as an area of focus for reducing overall antimicrobial use and improving stewardship. In this paper, we outline the design of a complex antimicrobial stewardship (AMS) intervention aimed at developing a national Veterinary Prescribing Champion programme for Welsh farm animal veterinary practices. We describe the process by which participants were encouraged to design and deliver bespoke individualised AMS activities at practice level by forging participant “champion” identities and communities of practice through participatory and educational online activities. We describe the key phases identified as important when designing this complex intervention, namely (i) involving key collaborators in government and industry to stimulate project engagement; (ii) grounding the design in the literature, the results of stakeholder engagement, expert panel input, and veterinary clinician feedback to promote contextual relevance and appropriateness; and (iii) taking a theoretical approach to implementing intervention design to foster critical psychological needs for participant motivation and scheme involvement. With recruitment of over 80% of all farm animal practices in Wales to the programme, we also describe demographic data of the participating Welsh Veterinary Prescribing Champions in order to inform recruitment and design of future AMS programmes.

A Qualitative Study of Community-Based HIV/AIDS Prevention Interventions, Programs, and Projects for Rural and Remote Regions in Canada: Implementation Challenges and Lessons Learned

CONTEXT

Fifteen percent to 20% of the Canadian and American populations live outside urban areas, and despite growing regional HIV/AIDS-related health disparities, there is little published research specific to rural or remote (rural/remote) HIV/AIDS prevention programming.

OBJECTIVE

To document implementation challenges, lessons learned, and evaluation approaches of promising and proven HIV/AIDS prevention programs and interventions developed and delivered by organizations with rural/remote catchment areas in Canada to provide a foundation for information sharing among agencies.

DESIGN

Qualitative study design, using a community-based participatory research approach. We screened Canadian community-based organizations with an HIV/AIDS prevention mandate to determine whether they offered services for rural/remote populations and invited organizational representatives to participate in semistructured telephone interviews. Interviews were audio-recorded and transcribed. Content analysis was used to identify categories in the interview data.

SETTING

Canada, provinces (all except Prince Edward Island), and territories (all except Nunavut).

PARTICIPANTS

Twenty-four community-based organizations.

RESULTS

Screening calls were completed with 74 organizations, of which 39 met study criteria. Twenty-four (62%) interviews were conducted. Populations most frequently served were Indigenous peoples (n = 13 organizations) and people who use drugs (n = 8 organizations) (categories not mutually exclusive). Key lessons learned included the importance of involving potential communities served in program development; prioritizing community allies/partnerships; building relationships; local relevancy and appropriateness; assessing community awareness or readiness; program flexibility/adaptability; and addressing stigma. Evaluation activities were varied and used for funder reporting and organizational learning.

CONCLUSIONS

Rural/remote HIV/AIDS programs across Canada expressed similar challenges and lessons learned, suggesting that there is potential for knowledge exchange, and development of a community of practice. Top-down planning and evaluation models may fail to capture program achievements in rural/remote contexts. The long-term engagement practices that render rural/remote programs promising do not always conform to planning and implementation requirements of limited funding.

Key characteristics and critical junctures for successful Interprofessional networks in healthcare - a case study

Background

The use of networks in healthcare has been steadily increasing over the past decade. Healthcare networks reduce fragmented care, support coordination amongst providers and patients, improve health system efficiencies, support better patient care and improve overall satisfaction of both patients and healthcare professionals. There has been little research to date on the implementation, development and use of small localized networks. This paper describes lessons learned from a successful small localized primary care network in Southwestern Ontario that developed and implemented a regional respiratory care program (The ARGI Respiratory Health Program - ARGI is a not-for-profit corporation leading the implementation and evaluation of a respiratory health program. Respiratory therapists (who have a certified respiratory educators designation), care for patients from all seven of the network’s FHTs. Patients rostered within the network of FHTs that have been diagnosed with a chronic respiratory disease are referred by their family physicians to the program. The RTs are integrated into the FHTs, and work in a triad along with patients and providers to educate and empower patients in self-management techniques, create exacerbation action plans, and act as a liaison between the patient’s care providers. ARGI uses an eTool designed specifically for use by the network to assist care delivery, choosing education topics, and outcome tracking. RTs are hired by ARGI and are contracted to the participating FHTs in the network.).

Methods

This study used an exploratory case study approach. Data from four participant groups was collected using focus groups, observations, interviews and document analysis to develop a rich understanding of the multiple perspectives associated with the network.

Results

This network’s success can be described by four characteristics (growth mindset and quality improvement focus; clear team roles that are strengths-based; shared leadership, shared success; and transparent communication); and five critical junctures (acknowledge a shared need; create a common vision that is flexible and adaptable depending on the context; facilitate empowerment; receive external validation; and demonstrate the impacts and success of their work).

Conclusions

Networks are used in healthcare to act as integrative, interdisciplinary tools to connect individuals with the aim of improving processes and outcomes. We have identified four general lessons to be learned from a successful small and localized network: importance of clear, flexible, and strengths-based roles; need for shared goals and vision; value of team support and empowerment; and commitment to feedback and evaluations. Insight from this study can be used to support the development and successful implementation of other similar locally developed networks.

Participant reported outcomes of a community of practice about social participation for speech-language pathologists in aphasia rehabilitation

Purpose: Because of their communication difficulties, persons with aphasia are at risk of not fully participating in significant activities after rehabilitation. Speech-language pathologists can contribute to support optimal social participation in rehabilitation. A community of practice (CoP) was designed to provide motivated clinicians with opportunities to acquire knowledge and reflect on social participation within aphasia rehabilitation. The aim of this study was to describe the outcomes of this CoP according to the perspectives of speech-language pathologist participants.Methods: Semi-structured individual interviews were conducted 4 to 10 weeks after the end of the CoP with 13 speech-language pathologist participants. Analyses were guided by grounded theory.Results: Participants perceived that the CoP experience contributed to a better alignment of their practice with the ideal end purpose of optimizing social participation. A sense of community emerged among CoP members, who collectively reflected on their practice. Participants stated feeling equipped to adopt new practices, adopting new practices for optimizing social participation, and/or advocating for better services for persons with aphasia. They felt increased confidence, motivation, well-being, and/or energy towards their practice.Conclusions: CoPs can help speech-language pathologists to more confidently practice with the goal of optimizing the social participation of persons with aphasia.Implications for rehabilitationSpeech-language pathologists in aphasia rehabilitation, as a result of being involved in a community of practice (CoP) about social participation, may offer more evidence-based services aiming at optimizing the social participation of persons with aphasia.Markers of a successful CoP may include participants' increased feelings of confidence, motivation, well-being, and/or energy towards their practice.CoPs can be used for continuing education purposes and support the development of clinical expertise among professionals, such as speech-language pathologists in aphasia rehabilitation.

Improving public sector knowledge sharing through communities of practice

Purpose

This paper aims to study the impact of intentionally developed communities of practice (CoPs) on knowledge sharing and practice improvement in an administrative public sector organisation (PSO).

Design/methodology/approach

A case study approach was used to analyse the impact of the CoPs intentionally developed by four different teams at a Danish PSO. The study applied a CoP development framework suggested by the literature to develop the CoPs.

Findings

Three out of the four CoPs were successfully developed, and they positively affected knowledge sharing and practice improvement. CoP participants engaged in conversations to explore individual ways of working, share knowledge and ultimately improve practice. Standardisation and boundary spanning were identified as contextual factors influencing the CoP activities.

Research limitations/implications

The findings verify the framework and contribute to a better understanding of the factors affecting the development of CoPs that positively impact knowledge sharing and practice improvements in a PSO context.

Practical implications

The study provides operations managers in PSOs with a framework for developing CoPs to improve work performance through better knowledge sharing among employees.

Originality/value

The paper provides case study evidence for the relevance of CoPs in PSO settings and highlights the necessity of investing resources in employee knowledge-sharing interactions.

Evaluation of a community of practice for speech-language pathologists in aphasia rehabilitation: a logic analysis

BACKGROUND

Aphasia is a communication disorder affecting participation. Although there are evidence-based practice recommendations about participation and aphasia rehabilitation, it may be challenging for speech-language pathologists to ensure that rehabilitation activities have an impact on the person's participation, in part due to time limitations. Participation remains limited after rehabilitation for persons who have aphasia. Communities of practice (CoPs) are a collaborative knowledge transfer strategy that can be used for evidence-based practice implementation. The aim of this study was to describe the components and evaluate a CoP for speech-language pathologists about participation and aphasia rehabilitation.

METHODS

Logic analysis was used to determine the adequacy between resources, implemented activities, outputs and short-term outcomes of the CoP. Qualitative and quantitative descriptive data were collected through observation and participants' logbooks. Outputs and outcomes of the CoP were revealed through thematic analysis and interpretation of descriptive statistics.

RESULTS

Resources including CoP design and educational aims, human and material resources were combined to create various web-based, online and offline activities. Participants invested more time per week than expected in the CoP, shared and created clinical tools and appreciated the array of suggested activities. Participant engagement allowed them to reflect, interact and collaborate with each other. All 13 participants reported they acquired knowledge about clinical tools and 12 mentioned they reflected on their practice. While the CoP was ongoing, six participants noticed evidence-practice gaps, seven prepared to change their practice, and three changed their practice towards including more participation-based considerations.

CONCLUSIONS

This study showed that speech-language pathologists can include more participation-based approaches in aphasia rehabilitation as a result of participating in a time-bound, web-based CoP.

Addressing fidelity within complex health behaviour change interventions: A protocol of a scoping review of intervention fidelity frameworks and models

Intervention fidelity is crucial to facilitate accurate interpretation of research outcomes, but has been inadequately addressed within complex health behaviour change interventions. Recent research has highlighted a need for practical guidance to improve understanding and use of existing fidelity frameworks and models within complex health behaviour change intervention research. The aim of this paper is to present a protocol for a scoping review of existing intervention fidelity frameworks and models.  In accordance with scoping review guidelines, the following stages will be conducted: (1) identifying the research question, (2) identifying potentially relevant studies of fidelity frameworks and models, (3) study screening and selection, (4) charting and extracting data from identified frameworks and models, (5) collating, summarising and reporting the results and (6) consultation with stakeholders. Two reviewers will independently conduct the screening and extraction stages. Identified frameworks will be collated, summarized and categorized iteratively by one reviewer in consultation with the review team. The findings of this review will provide a useful resource by identifying and comparing existing fidelity frameworks and models. It is intended that increased clarity and understanding in this area will facilitate the appropriate selection and application of fidelity frameworks for complex health behaviour change interventions, inform areas for future research, and ultimately contribute towards improving how intervention fidelity is addressed in this area.

Improving Quality of Radiation Therapy Care Across Ontario using a Community-of-Practice Approach

PURPOSE

In 2003 and 2004, Cancer Care Ontario (CCO) divested its assets and staff to regional hospitals, leading to decreased contact between radiation therapy departments across Ontario's Regional Cancer Centres (RCCs). The Radiation Treatment Program (RTP) at CCO developed a communities-of-practice (CoPs) program to rebuild the provincial radiation therapy community to facilitate collaboration among centers, with the goals of decreasing variation in practice and improving the quality of patient care. RTP's CoPs are led and driven by volunteer frontline health care practitioners who identify and prioritize key quality issues and select corresponding projects to pursue.

METHODS AND MATERIALS

An evaluation of RTP's CoPs was conducted to assess whether they were successful in knowledge creation, knowledge transfer and exchange, and community building. The framework was developed based on the Centers for Disease Control and Prevention CoP evaluation framework and tools. Data were collected using prospectively administered member surveys (257 surveys), publications, and semistructured interviews (18 participants).

RESULTS

A total of 95% of participants reported that CoP projects were very relevant to their practice, and 50% reported changes in their practice stemming from CoP involvement. In addition, 90% of participants reported growth of their professional network as a result of CoPs. Overall, 93% of participants and 100% of interviewees reported that CoPs are a worthwhile initiative. The largest challenge of CoPs was the time commitment required to participate.

CONCLUSIONS

This approach of member-driven CoPs should be explored and modeled in other health care settings as a means to develop and share knowledge to reduce variation in care and improve the quality of radiation therapy care.

Communities of practice to improve public health outcomes: a systematic review

Purpose

Communities of practice (CoPs) exist to enable people to share knowledge, innovate and progress a common field of practice. This paper aims to identify whether CoPs have a measured impact on public health practice and the tools used to measure the impact and potential barriers and facilitators that may have been identified during the implementation of these CoPs.

Design/methodology/approach

A systematic review of the literature was conducted using PRISMA guidelines. Searches of six databases, Google Scholar and a citation search were completed. Included studies were from 1986 to 2016, involved the public health workforce and an evaluation of a CoP -like intervention. A narrative synthesis of the findings was conducted.

Findings

From 3,021 publications, 12 studies met inclusion criteria and described the impact of ten CoPs amongst public health practitioners from America, Canada, Australasia and the United Kingdom. CoPs support the prevention workforce to change their practice when they provide structured problem-solving, reflective practice and networking opportunities. None of the studies described the impact of CoPs on public health outcomes.

Practical implications

CoPs that provide structured problem-solving, reflective practice and diverse networking may effectively support the public health workforce. Existing methods used to evaluate CoPs lack rigour; thus, the true impact of CoPs on population health remains unknown.

Originality/value

This is the first known systematic review that has measured the impact of CoPs on the preventative health workforce and the conditions in which they have an impact.

Building a Global, Online Community of Practice: The OPENPediatrics World Shared Practices Video Series

PROBLEM

Health care professionals are familiar with engaging in local communities of practice (CoPs) within their hospital, region, and/or country, but despite the availability of online technologies that facilitate online global collaboration, the health care sector has yet to fully embrace these tools.

APPROACH

In 2013, OPENPediatrics (an online social learning platform) launched the World Shared Practices video (WSP) series to engage and coalesce the global community of critical care clinicians. Each month, a 30- to 45-minute video featuring a pediatric critical care medicine expert, interspersed with questions for the audience, is released. Viewers contribute to the community discussion by leaving comments that display alongside the video. Clinicians are encouraged to asynchronously host an educational conference so they can watch the videos and participate in the discussion together.

OUTCOMES

From March 2013-November 2015, 28 WSPs were launched on a variety of topics. They were viewed over 18,414 times by 1,864 viewers in 132 countries and 760 hospitals; 1,155 comments were submitted. Attending physicians/consultants were the largest audience (36% [671/1,864]), and 37% (30/81) of responding viewers that commented in WSPs watched in small groups. The WSP series was reported to add value to respondents' learning or teaching and to have had a positive impact on their knowledge or practice.

NEXT STEPS

Future research will focus on further describing the context and structure of the CoP and on more deeply investigating its higher-level outcomes and impact. More work is needed to identify barriers and strategies that improve online community engagement.

Integrated knowledge translation: digging deeper, moving forward

BACKGROUND

Integrated knowledge translation has risen in popularity as a solution to the underuse of research in policy and practice settings. It engages knowledge users-policymakers, practitioners, patients/consumers or their advocates, and members of the wider public-in mutually beneficial research that can involve the joint development of research questions, data collection, analysis and dissemination of findings. Knowledge that is co-produced has a better chance of being implemented.

DISCUSSION

The purpose of this paper is to update developments in the field of integrated knowledge translation through a deeper analysis of the approach in practice-oriented and policy-oriented health research. We present collaborative models that fall outside the scope of integrated knowledge translation, but then explore consensus-based approaches and networks as alternate sites of knowledge co-production. We discuss the need to advance the field through the development, or use, of data collection and interpretation tools that creatively engage knowledge users in the research process. Most importantly, conceptually relevant outcomes need to be identified, including ones that focus on team transformation through the co-production of knowledge.

CONCLUSIONS

We explore some of these challenges and benefits in detail to help researchers understand what integrated knowledge translation means, and whether the approach's potential added value is worth the investment of time, energy and other resources.

Using developmental evaluation methods with communities of practice

Purpose

This paper aims to explore the use of developmental evaluation methods with community of practice programmes experiencing change or transition to better understand how to target support resources.

Design/methodology/approach

The practical use of a number of developmental evaluation methods was explored in three organizations over a nine-month period using an action research design. The research was a collaborative process involving all the company participants and the academic (the author) with the intention of developing the practices of the participants as well as contributing to scholarship.

Findings

The developmental evaluation activities achieved the objectives of the knowledge managers concerned: they developed a better understanding of the contribution and performance of their communities of practice, allowing support resources to be better targeted. Three methods (fundamental evaluative thinking, actual-ideal comparative method and focus on strengths and assets) were found to be useful. Cross-case analysis led to the proposition that developmental evaluation methods act as a structural mechanism that develops the discourse of the organization in ways that enhance the climate for learning, potentially helping develop a learning organization.

Practical implications

Developmental evaluation methods add to the options available to evaluate community of practice programmes. These supplement the commonly used activity indicators and impact story methods.

Originality/value

Developmental evaluation methods are often used in social change initiatives, informing public policy and funding decisions. The contribution here is to extend their use to organizational community of practice programmes.

Communities of practice for supporting health systems change: a missed opportunity

BACKGROUND

Communities of practice (CoPs) have been used in the health sector to support professional practice change. However, little is known about how CoPs might be used to influence a system that requires change at and across various levels (i.e. front line care, organizational, governmental). In this paper we examine the experience of a CoP in the Canadian province of Ontario as it engages in improving the care of seniors. Our aim is to shed light on using CoPs to facilitate systems change.

METHODS

This paper draws on year one findings of a larger multiple case study that is aiming to increase understanding of knowledge translation processes mobilized through CoPs. In this paper we strategically report on one case to illustrate a critical example of a CoP trying to effect systems change. Primary data included semi-structured interviews with CoP members (n = 8), field notes from five planning meetings, and relevant background documents. Data analysis included deductive coding (i.e. pre-determined codes aligned with the larger project) and inductive coding which allowed codes and themes to emerge. A thorough description of the case was prepared using all the coded data.

RESULTS

The CoP recognized a need to support health professionals (nurses, dentists) and related paraprofessionals with knowledge, experience, and resources to appropriately address their clients' oral health care needs. Accordingly, the CoP led a knowledge-to-action initiative that involved a seven-part webinar series meant to transfer step-by-step, skill-based knowledge through live and archived webinars. Although the core planning team functioned effectively to develop the webinars, the CoP was challenged by organizational and long-term care sector cultures, as well as governmental structures within the broader health context.

CONCLUSION

The provincial CoP functioned as an incubator that brought together best practices, research, experiences, a reflective learning cycle, and passionate champions. Nevertheless, the CoP's efforts to stimulate practice changes were met with broader resistance. Research about how to use CoPs to influence health systems change is needed given that CoPs are being tasked with this goal.

Rehabilitation living lab in the mall community of practice: learning together to improve rehabilitation, participation and social inclusion for people living with disabilities

Communities of practice (CoP) can facilitate collaboration between people who share a common interest, but do not usually work together. A CoP was initiated and developed including stakeholders from clinical, research, community and governmental backgrounds involved in a large multidisciplinary and multi-sectorial project: the Rehabilitation Living Lab in a Mall (RehabMaLL). This study aimed to evaluate the structure, process and outcomes of this CoP. A single case-study, using mixed-methods, evaluated the RehabMaLL CoP initiative after one year, based on Donabedian's conceptual evaluation model. Forty-three participants took part in the RehabMaLL CoP with 60.5% (n = 26) participating at least once on the online platform where 234 comments were posted. Four in-person meetings were held. Members expressed satisfaction regarding the opportunity to share knowledge with people from diverse backgrounds and the usefulness of the CoP for the RehabMaLL project. Collaboration led to concrete outcomes, such as a sensitization activity and a research project. Common challenges included lack of time and difficulty finding common objectives. A CoP can be a useful strategy to facilitate knowledge sharing on disability issues. Future research is necessary to determine strategies of increasing knowledge creation between members.