A scoping review of the use of ethnographic approaches in implementation research and recommendations for reporting

Science for behavioral health systems change: evolving research-policy-public partnerships

Potent partnerships among researchers, policymakers, and community members have potential to produce positive changes in communities on a range of topics, including behavioral health. The paper provides a brief illustrative review of such partnerships and then describes the development and evolution of one partnership in particular in Virginia. The origin of the partnership is traced, along with its founding vision, mission, and values. Some of its several projects are described, including (a) needs assessment for implementation of evidence-based programs (EBPs) pursuant to the Family First Prevention Services Act; (b) statewide fidelity monitoring of key EBPs; and (c) projects to synergize state investments in specific EBPs, like multisystemic therapy, functional family therapy, and high fidelity wraparound. The paper concludes with some themes around which the center has evolved to serve the state and its citizens more effectively.

Implementing a new living concept for persons with dementia in long-term care: evaluation of a quality improvement process

BACKGROUND

Improving quality of nursing home care for residents is a constant focus of stakeholders involved within quality improvement projects. Though, achieving change in long-term care is challenging. Process evaluations provide insight into the nature, exposure and experiences of stakeholders and influencing mechanisms for implementation. The aim of this study is to gain insight into the process and facilitating and hindering mechanisms of implementing a quality improvement project that seeks to create a dementia-friendly community with a nursing home at its core.

METHODS

For the process evaluation we planned a case study design with an ethnographic approach. Various research methods were used: qualitative observations, focus groups, interviews and questionnaires for various stakeholders and document review. Data collection and analyses in this study is based on the Consolidated Framework for Implementation Research.

RESULTS

Four main lessons were learned. Firstly, nursing staff are crucial to achieve more freedom for residents. Secondly, high-impact changes in daily care need strong and sustainable focus from the care organisation. Thirdly, dementia-friendly societies should be deployed from multiple actors, which entails long-term collaborations with external stakeholders. Fourthly, the transition to a dementia-friendly society requires meeting spaces for and a focus on both residents and people from the community. Consequently, local residents are shifting from external to internal stakeholders, extending beyond the regular involvement of informal carers and volunteers within the nursing home.

CONCLUSIONS

Nursing homes are part of the local community and provide opportunities to collaborate on a dementia-friendly society. However, the change that is required (promoting freedom, residents' autonomy and the redesign of care processes) is complex and influenced by various mechanisms. Understanding these mechanisms can benefit other care organisations that strive to implement a similar initiative.

Learning to teach with patients and caregivers: a focused ethnography

BACKGROUND

Little is known about what happens when patients and caregivers are involved in an academic setting as co-teachers and how healthcare professionals approach a new model of partnership-based teaching. This study aimed to explore the learning and behavioural patterns of a group of healthcare professionals who were learning to teach with patients and caregivers as co-teachers in a post-graduate course.

METHODS

A focused ethnographic study involving 11 health professionals was conducted. Data were collected through participatory observation during the course, individual semi-structured interviews, and a follow-up focus group. Taxonomic analysis was performed.

RESULTS

Three categories were identified: 'group', 'role of narration' and 'applying co-teaching with patients and caregivers '. Specifically, heterogeneity, absence of hierarchies, and balanced relationships characterised the group dynamic and promoted partnership. Narration played a key role both in learning and in healthcare professionals' relationship with patients and caregivers and promoted emotional skills and self-awareness. Project planning and lessons simulations were essential aspects of the implementation process.

CONCLUSIONS

This focused ethnography helped further understanding of the context of a specific project involving patients and caregivers as co-teachers in healthcare professional education. The development of emotional skills and self-awareness are the main learning patterns of co-teaching, and interprofessionalism and balanced relationships are the basis of the behavioural patterns. These patterns facilitated the involvement of patients and caregivers in health education.

Implicit and explicit: a scoping review exploring the contribution of anthropological practice in implementation science

BACKGROUND

This study's goal is to identify the existing variation in how, why, and by whom anthropological practice is conducted as part of implementation science projects. As doctorally trained anthropologists, we sought to characterize how and why the term "ethnography" was variously applied in the implementation science literature and characterize the practice of anthropology within and across the field.

METHODS

While we follow the PRISMA-ScR checklist, we present the work with a narrative approach to accurately reflect our review process. A health services librarian developed a search strategy using subject headings and keywords for the following databases: PubMed, Embase (Elsevier), Cochrane CENTRAL (Wiley), CIHAHL (EBSCO), PsycINFO (EBSCO), Web of Science Core Collection, and Anthropology Plus (EBSCO). We focused on the practice of anthropology in implementation research conducted in a healthcare setting, in English, with no date restrictions. Studies were included if they applied one or several elements of anthropological methods in terms of study design, data collection, and/or analysis.

RESULTS

The database searches produced 3450 results combined after duplicates were removed, which were added to Rayyan for two rounds of screening by title and abstract. A total of 487 articles were included in the full-text screening. Of these, 227 were included and received data extraction that we recorded and analyzed with descriptive statistics in three main domains: (1) anthropological methods; (2) implementation science methods; and (3) study context. We found the use of characteristic tools of anthropology like ethnography and field notes are usually not systematically described but often mentioned. Further, we found that research design decisions and compromises (e.g., length of time in the field, logistics of stakeholder involvement, reconciling diverse firsthand experiences) that often impact anthropological approaches are not systematically described.

CONCLUSIONS

Anthropological work often supports larger, mixed-methods implementation projects without being thoroughly reported. Context is essential to anthropological practice and implicitly fundamental to implementation research, yet the goals of anthropology and how its practice informs larger research projects are often not explicitly stated.

How Clinicians Decide? Exploring Complexity of Antibiotic Prescribing in Emergency Departments Using Video-Reflexive Ethnography

Antibiotic overprescribing is a global issue that significantly contributes to increased antimicrobial resistance. Strengthening antimicrobial prescribing practices should be considered a priority. The emergency department (ED) represents a setting where antibiotics are frequently prescribed, but the determinants that influence prescribing choices are complex and multifaceted. We conducted an exploratory qualitative study to investigate the contextual factors that influence antibiotic prescribing choices among clinicians in the ED. The study employed video-reflexive ethnography (VRE) to capture prospective clinical decision-making in situated practice. Data collection involved fieldwork observations, video observations, and delivery of facilitated group reflexive sessions, where clinicians viewed a selection of recorded video snippets relating to antibiotic prescribing. Study was conducted across two EDs within the same health service in Australia. A total of 29 clinical conversations focusing on antibiotic prescribing were recorded. Additionally, 34 clinicians participated in group reflexive sessions. Thematic analysis from the transcribed data yielded four themes: 'importance of clinical judgment', 'usability of prescribing guidelines', 'managing patient expectations', and 'context-dependent disruptions'. Our findings provide insights into the challenges faced by clinicians in navigating complex ED environment, utilising electronic decision-support tools and engaging in discussions about patient treatments with senior clinicians. The findings also indicate that VRE is useful in visualising full complexity of the ED setting, and in initiating meaningful discussions among clinical teams. Integrating the use of VRE in everyday clinical settings can potentially facilitate the implementation of pragmatic solutions for delivering effective antibiotic stewardship practices.

Connecting the science and practice of implementation - applying the lens of context to inform study design in implementation research

The saying "horses for courses" refers to the idea that different people and things possess different skills or qualities that are appropriate in different situations. In this paper, we apply the analogy of "horses for courses" to stimulate a debate about how and why we need to get better at selecting appropriate implementation research methods that take account of the context in which implementation occurs. To ensure that implementation research achieves its intended purpose of enhancing the uptake of research-informed evidence in policy and practice, we start from a position that implementation research should be explicitly connected to implementation practice. Building on our collective experience as implementation researchers, implementation practitioners (users of implementation research), implementation facilitators and implementation educators and subsequent deliberations with an international, inter-disciplinary group involved in practising and studying implementation, we present a discussion paper with practical suggestions that aim to inform more practice-relevant implementation research.

Study protocol: Type III hybrid effectiveness-implementation study implementing Age-Friendly evidence-based practices in the VA to improve outcomes in older adults

BACKGROUND

Unmet care needs among older adults accelerate cognitive and functional decline and increase medical harms, leading to poorer quality of life, more frequent hospitalizations, and premature nursing home admission. The Department of Veterans Affairs (VA) is invested in becoming an "Age-Friendly Health System" to better address four tenets associated with reduced harm and improved outcomes among the 4 million Veterans aged 65 and over receiving VA care. These four tenets focus on "4Ms" that are fundamental to the care of older adults, including (1) what Matters (ensuring that care is consistent with each person's goals and preferences); (2) Medications (only using necessary medications and ensuring that they do not interfere with what matters, mobility, or mentation); (3) Mentation (preventing, identifying, treating, and managing dementia, depression, and delirium); and (4) Mobility (promoting safe movement to maintain function and independence). The Safer Aging through Geriatrics-Informed Evidence-Based Practices (SAGE) Quality Enhancement Research Initiative (QUERI) seeks to implement four evidence-based practices (EBPs) that have shown efficacy in addressing these core tenets of an "Age-Friendly Health System," leading to reduced harm and improved outcomes in older adults.

METHODS

We will implement four EBPs in 9 VA medical centers and associated outpatient clinics using a type III hybrid effectiveness-implementation stepped-wedge trial design. We selected four EBPs that align with Age-Friendly Health System principles: Surgical Pause, EMPOWER (Eliminating Medications Through Patient Ownership of End Results), TAP (Tailored Activities Program), and CAPABLE (Community Aging in Place - Advancing Better Living for Elders). Guided by the Pragmatic Robust Implementation and Sustainability Model (PRISM), we are comparing implementation as usual vs. active facilitation. Reach is our primary implementation outcome, while "facility-free days" is our primary effectiveness outcome across evidence-based practice interventions.

DISCUSSION

To our knowledge, this is the first large-scale randomized effort to implement "Age-Friendly" aligned evidence-based practices. Understanding the barriers and facilitators to implementing these evidence-based practices is essential to successfully help shift current healthcare systems to become Age-Friendly. Effective implementation of this project will improve the care and outcomes of older Veterans and help them age safely within their communities.

TRIAL REGISTRATION

Registered 05 May 2021, at ISRCTN #60,657,985.

REPORTING GUIDELINES

Standards for Reporting Implementation Studies (see attached).

Rapid ethnography and participatory techniques increase onchocerciasis mass drug administration treatment coverage in Benin: a difference-in-differences analysis

BACKGROUND

Onchocerciasis, a neglected tropical disease (NTD) that causes blindness, is controlled via mass drug administration (MDA) where entire endemic communities are targeted with preventative chemotherapeutic treatment. However, in many settings, MDA coverage remains low. The purpose of this project was to determine if engaging communities in the development of implementation strategies improves MDA coverage.

METHODS

This study took place in an intervention and a control commune in Benin, West Africa. We conducted rapid ethnography in each commune to learn about community member perceptions of onchocerciasis, MDA, and opportunities to increase MDA coverage. Findings were shared with key stakeholders and a structured nominal group technique was used to derive implementation strategies most likely to increase treatment coverage. The implementation strategies were delivered prior to and during onchocerciasis MDA. We conducted a coverage survey within 2 weeks of MDA to determine treatment coverage in each commune. A difference-in-differences design was used to determine if the implementation package effectively increased coverage. A dissemination meeting was held with the NTD program and partners to share findings and determine the perceived acceptability, appropriateness, and feasibility of implementing rapid ethnography as part of routine program improvement.

RESULTS

During rapid ethnography, key barriers to MDA participation included trust in community drug distributors, poor penetration of MDA programs in rural or geographically isolated areas, and low demand for MDA among specific sub-populations driven by religious or socio-cultural beliefs. Stakeholders developed a five-component implementation strategy package, including making drug distributor trainings dynamic, redesigning distributor job aids, tailoring community sensitization messages, formalizing supervision, and preparing local champions. After implementing the strategy package, MDA coverage increased by 13% (95% CI: 11.0-15.9%) in the intervention commune relative to the control commune. Ministry of Health and implementing partners found the approach to be largely acceptable and appropriate; however, there was mixed feedback regarding the feasibility of future implementation of rapid ethnography.

CONCLUSIONS

Implementation research conducted in Benin, and indeed throughout sub-Saharan Africa, is often implemented in a top-down manner, with both implementation determinants and strategies derived in the global North. This project demonstrates the importance of participatory action research involving community members and implementers to optimize program delivery.

Using ethnographic approaches to document, evaluate, and facilitate virtual community-engaged implementation research

BACKGROUND

Community Advisory Boards (CABs) have been frequently used to engage diverse partners to inform research projects. Yet, evaluating the quality of engagement has not been routine. We describe a multi-method ethnographic approach documenting and assessing partner engagement in two "virtual" CABs, for which we conducted all meetings remotely.

METHODS

Two research projects for increasing equitable COVID-19 testing, vaccination, and clinical trial participation for underserved communities involved remote CAB meetings. Thirty-three partners representing 17 community groups participated in 15 sessions across the two CABs facilitated by a social change organization. We developed ethnographic documentation forms to assess multiple aspects of CAB member engagement (e.g., time spent speaking, modality used, types of interactions). Documenters were trained to observe CAB sub-groups via virtual sessions. Debriefing with the documentation team after CAB meetings supported quality assurance and process refinement. CAB members completed a brief validated survey after each meeting to assess the quality and frequency of engagement. Content and rapid thematic analysis were used to analyze documentation data. Quantitative data were summarized as frequencies and means. Qualitative and quantitative findings were triangulated.

RESULTS

A total of 4,540 interactions were identified across 15 meetings. The most frequent interaction was providing information (44%), followed by responding (37-38%). The quality and frequency of stakeholder engagement were rated favorably (average 4.7 of 5). Most CAB members (96%) reported good/excellent engagement. Specific comments included appreciation for the diversity of perspectives represented by the CAB members and suggestions for improved live interpretation. Debriefing sessions led to several methodological refinements for the documentation process and forms.

CONCLUSION

We highlight key strategies for documenting and assessing community engagement. Our methods allowed for rich ethnographic data collection that refined our work with community partners. We recommend ongoing trainings, including debriefing sessions and routinely reviewed assessment of data to strengthen meaningful community engagement.

Using a stakeholder-engaged, iterative, and systematic approach to adapting collaborative decision skills training for implementation in VA psychosocial rehabilitation and recovery centers

BACKGROUND

Adaptation of interventions is inevitable during translation to new populations or settings. Systematic approach to adaptation can ensure that fidelity to core functions of the intervention are preserved while optimizing implementation feasibility and effectiveness for the local context. In this study, we used an iterative, mixed methods, and stakeholder-engaged process to systematically adapt Collaborative Decision Skills Training for Veterans with psychosis currently participating in VA Psychosocial Rehabilitation and Recovery Centers.

METHODS

A modified approach to Intervention Mapping (IM-Adapt) guided the adaptation process. An Adaptation Resource Team of five Veterans, two VA clinicians, and four researchers was formed. The Adaptation Resource Team engaged in an iterative process of identifying and completing adaptations including individual qualitative interviews, group meetings, and post-meeting surveys. Qualitative interviews were analyzed using rapid matrix analysis. We used the modified, RE-AIM enriched expanded Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME) to document adaptations. Additional constructs included adaptation size and scope; implementation of planned adaptation (yes-no); rationale for non-implementation; and tailoring of adaptation for a specific population (e.g., Veterans).

RESULTS

Rapid matrix analysis of individual qualitative interviews resulted in 510 qualitative codes. Veterans and clinicians reported that the intervention was a generally good fit for VA Psychosocial Rehabilitation and Recovery Centers and for Veterans. Following group meetings to reach adaptation consensus, 158 adaptations were completed. Most commonly, adaptations added or extended a component; were small in size and scope; intended to improve the effectiveness of the intervention, and based on experience as a patient or working with patients. Few adaptations were targeted towards a specific group, including Veterans. Veteran and clinician stakeholders reported that these adaptations were important and would benefit Veterans, and that they felt heard and understood during the adaptation process.

CONCLUSIONS

A stakeholder-engaged, iterative, and mixed methods approach was successful for adapting Collaborative Decision Skills Training for immediate clinical application to Veterans in a psychosocial rehabilitation center. The ongoing interactions among multiple stakeholders resulted in high quality, tailored adaptations which are likely to be generalizable to other populations or settings. We recommend the use of this stakeholder-engaged, iterative approach to guide adaptations.

Methodological approaches to study context in intervention implementation studies: an evidence gap map

BACKGROUND

Within implementation science studies, contextual analysis is increasingly recognized as foundational to interventions' successful and sustainable implementation. However, inconsistencies between methodological approaches currently limit progress in studying context and guidance to standardize the use of those approaches is scant. Therefore, this study's objective was to systematically review and map current methodological approaches to contextual analysis in intervention implementation studies. The results would help us both to systematize the process of contextual analysis and identify gaps in the current evidence.

METHODS

We conducted an evidence gap map (EGM) based on literature data via a stepwise approach. First, using an empirically developed search string, we randomly sampled 20% of all intervention implementation studies available from PubMed per year (2015-2020). Second, we assessed included studies that conducted a contextual analysis. Data extraction and evaluation followed the Basel Approach for CoNtextual ANAlysis (BANANA), using a color-coded rating scheme. Also based on BANANA and on the Context and Implementation of Complex Interventions (CICI) framework-an implementation framework that pays ample attention to context- we created visual maps of various approaches to contextual analysis.

RESULTS

Of 15, 286 identified intervention implementation studies and study protocols, 3017 were screened for inclusion. Of those, 110 warranted close examination, revealing 22% that reported on contextual analysis. Only one study explicitly applied a framework for contextual analysis. Data were most commonly collected via surveys (n = 15) and individual interviews (n = 13). Ten studies reported mixed-methods analyses. Twenty-two assessed meso-level contextual and setting factors, with socio-cultural aspects most commonly studied. Eighteen described the use of contextual information for subsequent project phases (e.g., intervention development/adaption, selecting implementation strategies). Nine reported contextual factors' influences on implementation and/or effectiveness outcomes.

CONCLUSIONS

This study describes current approaches to contextual analysis in implementation science and provides a novel framework for evaluating and mapping it. By synthesizing our findings graphically in figures, we provide an initial evidence base framework that can incorporate new findings as necessary. We strongly recommend further development of methodological approaches both to conduct contextual analysis and to systematize the reporting of it. These actions will increase the quality and consistency of implementation science research.

Research and Scholarly Methods: Implementation Science Studies

Traditional research focuses on efficacy or effectiveness of interventions but lacks evaluation of strategies needed for equitable uptake, scalable implementation, and sustainable evidence-based practice transformation. The purpose of this introductory review is to describe key implementation science (IS) concepts as they apply to medication management and pharmacy practice, and to provide guidance on literature review with an IS lens. There are five key ingredients of IS, including: (1) evidence-based intervention; (2) implementation strategies; (3) IS theory, model, or framework; (4) IS outcomes and measures; and (5) stakeholder engagement, which is key to a successful implementation. These key ingredients apply across the three stages of IS research: (1) pre-implementation; (2) implementation; and (3) sustainment. A case example using a combination of IS models, PRISM (Practical, Robust Implementation and Sustainability model) and RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance), is included to describe how an IS study is designed and conducted. This case is a cluster randomized trial comparing two clinical decision support tools to improve guideline-concordant prescribing for patients with heart failure and reduced ejection fraction. The review also includes information on the Standards for Reporting Implementation Studies (StaRI), which is used for literature review and reporting of IS studies,as well as IS-related learning resources.

Conceptualizing Context and Intervention as a System in Implementation Science: Learning From Complexity Theory Comment on "Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-country Analysis"

In implementation science, implementation has been widely theorized and assessed. Context, on the other hand, usually played a minor role in the field and was usually conceptualized in a rather positivist way. Despite some promising efforts, there is a strong need to continue building theory on context and operationalizing the concept in implementation practice. I argue for the benefit of integrating complexity theory into our understanding of context in order to further our thinking about context and intervention as a system. This should be reflected by the way in which we build theory as well as apply this theory by employing methods that adequately account for complexity in systems.

Oilcloth sessions as an implementation strategy: a qualitative study in Denmark

BACKGROUND

The aim of this study was to explore healthcare professionals, managers, and other key employees' experiences of oilcloth sessions as a strategy when implementing new emergency departments in Denmark, based on their participations in these sessions. The study addresses the importance of securing alignment in implementation strategies. Too often, this does not get enough attention in the literature and in practice. In this study, alignment among components was achieved in an educational implementation strategy called oilcloth sessions.

METHODS

The study is based on participants' observations of 13 oilcloth sessions and follow-up via 53 semi-structured interviews with the board of directors, managers, and key employees from the present emergency department and different specialty departments. Data were analysed deductively using Biggs and Tang's model of didactic alignment.

RESULTS

The analysis showed the complexity of challenges when using oilcloth sessions as a strategy when implementing a new emergency department described in terms of three phases and nine main themes (a-i): the preparation phase: (a) preparing individually and collectively, (b) objectives, (c) involving participants, (d) selecting cases; the execution phase: (e) using materials, (f) facilitating the sessions, (g) temporal structures; evaluation: (h) following up on the sessions, (i) adapting to the context.

CONCLUSIONS

This study shows that it is important to ensure alignment among elements in implementation strategies. Thus, oilcloth sessions with high alignment are useful if the challenges experienced are to be overcome and the strategy will be experienced as a useful way to support the implementation of a new emergency department from the participants' point of view. Bigg and Tang's didactic model is useful as an analytical framework to ensure alignment in implementation strategies in general.

Understanding dynamic complexity in context-Enriching contextual analysis in implementation science from a constructivist perspective

Context in implementation science includes not only characteristics of a setting in which an intervention will be delivered, but also social systems (e.g., interrelationships). Context is dynamic and interacts with both, the intervention and its implementation. Therefore, contextual analysis is recognized as an indispensable part of implementation science methodology: it provides the foundation for successful and sustainable implementation projects. Yet, driven by the prevailing post-positivist understanding of context, contextual analysis typically focuses on individual characteristics of context i.e., contextual dynamics and interactions go unnoticed. Conducting contextual analysis from a constructivist perspective promotes a multilayered approach, building a more comprehensive understanding of context, and thus facilitating successful implementation. In this article, we highlight the limitations of prevailing perspectives on context and approaches to contextual analysis. We then describe how contextual analysis can be enriched by working from a constructivist perspective. We finish with a discussion of the methodological and practical implications the proposed changes would entail. Emerging literature attempts to address both the concept of context and methods for contextual analysis. Various theories, models and frameworks consider context, however, many of these are reductionistic and do not acknowledge the dynamic nature of context or interactions within it. To complement recent conceptualizations of context, we suggest consider the following five constructivist concepts: 1) social space; 2) social place; 3) agency; 4) sensation; and 5) embodiment. We demonstrate the value of these concepts using COVID-19 vaccination uptake as an example and integrate the concepts in the Context and Implementation of Complex Interventions (CICI) framework-an implementation science framework that pays ample attention to context. To study context from a constructivist perspective, we also suggest additional considerations in view of methodologies for data collection and analysis, e.g., rapid ethnographic methods. A constructivist perspective contributes to a stronger conceptualization of contextual analysis. Considering the five constructivist concepts helps to overcome contextual analysis' current shortcomings, while revealing complex dynamics that usually go unnoticed. Thus, more comprehensive understanding of context can be developed to inform subsequent phases of an implementation project, thereby maximizing an intervention's uptake and sustainability.

Qualitative Research Methods in Chronic Disease: Introduction and Opportunities to Promote Health Equity

Public health research that addresses chronic disease has historically underutilized and undervalued qualitative methods. This has limited the field's ability to advance (a) a more in-depth understanding of the factors and processes that shape health behaviors, (b) contextualized explanations of interventions' impacts (e.g., why and how something did or did not work for recipients and systems), and (c) opportunities for building and testing theories. We introduce frameworks and methodological approaches common to qualitative research, discuss how and when to apply them in order to advance health equity, and highlight relevant strengths and challenges. We provide an overview of data collection, sampling, and analysis for qualitative research, and we describe research questions that can be addressed by applying qualitative methods across the continuum of chronic disease research. Finally, we offer recommendations to promote the strategic application of rigorous qualitative methods, with an emphasis on priority areas to enhance health equity across the evidence generation continuum.