Addressing social needs in oncology care: another research-to-practice gap

Social determinants of health and unmet social needs are directly related to cancer outcomes, from diagnosis to survivorship. If identified, unmet social needs can be addressed in oncology care by changing care plans in collaboration with patients' preferences and accounting for clinical practice guidelines (eg, reducing the frequency of appointments, switching treatment modalities) and connecting patients to resources within healthcare organizations (eg, social work support, patient navigation), and with community organizations (eg, food banks, housing assistance programs). Screening for social needs is the first step to identifying those who need additional support and is increasingly recognized as a necessary component of high-quality cancer care delivery. Despite evidence about the relationship between social needs and cancer outcomes and the abundance of screening tools, the implementation of social needs screening remains a challenge and little is known regarding the adoption, reach, and sustainability of social needs screening in routine clinical practice. We present data on the adoption and implementation of social needs screening at two large academic cancer centers and discuss three challenges associated with implementing evidence-based social needs screening in clinical practice: (1) identifying an optimal approach for administering social needs screening in oncology care, (2) adequately addressing identified unmet needs with resources and support, and (3) coordinating social needs screening between oncology and primary care.

How can a behavioral economics lens contribute to implementation science?

BACKGROUND

Implementation science in health is an interdisciplinary field with an emphasis on supporting behavior change required when clinicians and other actors implement evidence-based practices within organizational constraints. Behavioral economics has emerged in parallel and works towards developing realistic models of how humans behave and categorizes a wide range of features of choices that can influence behavior. We argue that implementation science can be enhanced by the incorporation of approaches from behavioral economics. Main body First, we provide a general overview of implementation science and ways in which implementation science has been limited to date. Second, we review principles of behavioral economics and describe how concepts from BE have been successfully applied to healthcare including nudges deployed in the electronic health record. For example, de-implementation of low-value prescribing has been supported by changing the default in the electronic health record. We then describe what a behavioral economics lens offers to existing implementation science theories, models and frameworks, including rich and realistic models of human behavior, additional research methods such as pre-mortems and behavioral design, and low-cost and scalable implementation strategies. We argue that insights from behavioral economics can guide the design of implementation strategies and the interpretation of implementation studies. Key objections to incorporating behavioral economics are addressed, including concerns about sustainment and at what level the strategies work.

CONCLUSION

Scholars should consider augmenting implementation science theories, models, and frameworks with relevant insights from behavioral economics. By drawing on these additional insights, implementation scientists have the potential to boost efforts to expand the provision and availability of high quality care.

Family cascade screening for equitable identification of familial hypercholesterolemia: study protocol for a hybrid effectiveness-implementation type III randomized controlled trial

BACKGROUND

Familial hypercholesterolemia (FH) is a heritable disorder affecting 1.3 million individuals in the USA. Eighty percent of people with FH are undiagnosed, particularly minoritized populations including Black or African American people, Asian or Asian American people, and women across racial groups. Family cascade screening is an evidence-based practice that can increase diagnosis and improve health outcomes but is rarely implemented in routine practice, representing an important care gap. In pilot work, we leveraged best practices from behavioral economics and implementation science-including mixed-methods contextual inquiry with clinicians, patients, and health system constituents-to co-design two patient-facing implementation strategies to address this care gap: (a) an automated health system-mediated strategy and (b) a nonprofit foundation-mediated strategy with contact from a foundation-employed care navigator. This trial will test the comparative effectiveness of these strategies on completion of cascade screening for relatives of individuals with FH, centering equitable reach.

METHODS

We will conduct a hybrid effectiveness-implementation type III randomized controlled trial testing the comparative effectiveness of two strategies for implementing cascade screening with 220 individuals with FH (i.e., probands) per arm identified from a large northeastern health system. The primary implementation outcome is reach, or the proportion of probands with at least one first-degree biological relative (parent, sibling, child) in the USA who is screened for FH through the study. Our secondary implementation outcomes include the number of relatives screened and the number of relatives meeting the American Heart Association criteria for FH. Our secondary clinical effectiveness outcome is post-trial proband cholesterol level. We will also use mixed methods to identify implementation strategy mechanisms for implementation strategy effectiveness while centering equity.

DISCUSSION

We will test two patient-facing implementation strategies harnessing insights from behavioral economics that were developed collaboratively with constituents. This trial will improve our understanding of how to implement evidence-based cascade screening for FH, which implementation strategies work, for whom, and why. Learnings from this trial can be used to equitably scale cascade screening programs for FH nationally and inform cascade screening implementation efforts for other genetic disorders.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT05750667. Registered 15 February 2023-retrospectively registered, https://clinicaltrials.gov/study/NCT05750667 .

Suicide Screening, Risk Assessment, and Lethal Means Counseling During Zero Suicide Implementation

OBJECTIVE

The authors measured implementation of Zero Suicide (ZS) clinical practices that support identification of suicide risk and risk mitigation, including screening, risk assessment, and lethal means counseling, across mental health specialty and primary care settings.

METHODS

Six health care systems in California, Colorado, Michigan, Oregon, and Washington participated. The sample included members ages ≥13 years from 2010 to 2019 (N=7,820,524 patients). The proportions of patients with suicidal ideation screening, suicide risk assessment, and lethal means counseling were estimated.

RESULTS

In 2019, patients were screened for suicidal ideation in 27.1% (range 5.0%-85.0%) of mental health visits and 2.5% (range 0.1%-35.0%) of primary care visits among a racially and ethnically diverse sample (44.9% White, 27.2% Hispanic, 13.4% Asian, and 7.7% Black). More patients screened positive for suicidal ideation in the mental health setting (10.2%) than in the primary care setting (3.8%). Of the patients screening positive for suicidal ideation in the mental health setting, 76.8% received a risk assessment, and 82.4% of those identified as being at high risk received lethal means counseling, compared with 43.2% and 82.4%, respectively, in primary care.

CONCLUSIONS

Six health systems that implemented ZS showed a high level of variation in the proportions of patients receiving suicide screening and risk assessment and lethal means counseling. Two opportunities emerged for further study to increase frequency of these practices: expanding screening beyond patients with regular health care visits and implementing risk assessment with lethal means counseling in the primary care setting directly after a positive suicidal ideation screening.

Co-designing strategies to implement long-acting injectable PrEP for sexual minority men in Chicago: a study protocol for an innovation tournament and implementation mapping

BACKGROUND

Participatory design approaches can improve successful selection and tailoring of implementation strategies by centering the voices of key constituents. To reduce incidence of the human immunodeficiency virus (HIV) in the USA, co-design of implementation strategies is needed for long-acting injectable cabotegravir (CAB-LA), a new form of HIV pre-exposure prophylaxis, among the disproportionately impacted population of sexual minority men (SMM). This manuscript describes the protocol for participatory design approaches (i.e., innovation tournament and implementation mapping) to inform implementation of CAB-LA among SMM (≥ 12 years), particularly Black and Latino populations, in Chicago.

METHODS

This research incorporates innovative methods to accomplish two objectives: (1) to crowdsource ideas for the design of implementation strategies for CAB-LA through a virtual innovation tournament and (2) to leverage the ideas from the innovation tournament to operationalize implementation strategies for CAB-LA thorough the systematic process of implementation mapping. A committee of constituents with diverse expertise and perspectives (e.g., SMM, implementation scientists, HIV clinicians, public health leadership, and community partners) will provide input throughout the design process.

DISCUSSION

This research will produce a menu of co-designed implementation strategies, which can guide plans for CAB-LA integration in Chicago and provide insights for other EHE regions. Further, as the first innovation tournament focused on HIV prevention, this research can provide a framework for participatory approaches across the care continuum. Given that the co-design of implementation strategies often does not involve the participation of individuals with lived experiences, this work will center the voices of those who will benefit most.

Adolescent Preferences for a Pediatric Primary Care-based Sexually Transmitted Infection and HIV Prevention Intervention

PURPOSE

We sought to elicit perspectives on HIV and sexually transmitted infection (STI) prevention among adolescents with recent STIs in primary care to optimize acceptability and effectiveness in designing a novel HIV/STI prevention intervention.

METHODS

We enrolled 13-19 year-olds with recent gonorrhea, chlamydia, trichomonas, and/or syphilis in a multimethods cross-sectional study at two primary care clinics. Participants completed surveys and interviews. We used an integrated analytic approach deductively coding data using the Integrated Behavioral Model, then inductively coding to identify themes not represented in the Integrated Behavioral Model.

RESULTS

Participants (n = 35) were 85% cisgender female, 14% cisgender male, 1% transgender female; 25% identified as lesbian, bisexual, or queer. Most (97%) identified as non-Latinx Black. None used condoms consistently, 26% were aware of pre-exposure prophylaxis (PrEP), and 31% were never HIV tested. Five key themes emerged. 1) Mental health was central to HIV prevention behavior uptake and coping with STI diagnosis. 2) Youth desired prevention counseling that allowed decisional autonomy and individualized goal setting. 3) Negative social norms around condoms and absent norms around HIV testing and PrEP limited method uptake. 4) Both confidence and concrete skills were needed to initiate prevention methods. 5) Youth desired education at the time of STI diagnosis to improve subsequent prevention decision making.

DISCUSSION

Key intervention design considerations included 1) integrating mental health assessment and referral to services, 2) promoting individualized goal setting, 4) building communication skills, 4) providing navigation and material support for PrEP uptake and HIV testing, and 5) augmenting comprehensive STI and HIV prevention education.

Possible unintended consequences of pediatric clinician strategies for communicating about social-emotional and developmental concerns in diverse young children

INTRODUCTION

Screening to promote social-emotional well-being in toddlers has positive effects on long-term health and functioning. Communication about social-emotional well-being can be challenging for primary care clinicians for various reasons including lack of time, training and expertise, resource constraints, and cognitive burden. Therefore, we explored clinicians' perspectives on identifying and communicating with caregivers about social-emotional risk in toddlers.

METHOD

In 2021, semistructured interviews were conducted with pediatric clinicians (N = 20) practicing in Federally Qualified Health Centers in a single metropolitan area. Most participants identified as female (n = 15; 75%), white non-Hispanic/Latino (n = 14; 70%), and were Doctors of Medicine or Osteopathic Medicine (n = 14; 70%). Thematic analysis was conducted on audio-recorded interview transcripts.

RESULTS

Clinicians used various approaches to identify social-emotional concerns which were sometimes difficult to distinguish from other developmental concerns. The clinician-caregiver relationship guided identification and communication practices and cut-across themes. Themes include: starting with caregivers' concerns, communicating concerns with data and sensitivity, navigating labels, culture, and stigma, and limiting communication based on family capacity and interest.

DISCUSSION

Prioritizing the clinician-caregiver relationship is consistent with best practice and family-centered care. Yet, the dearth of standardized decision support may undermine clinician confidence and impede timely conversations about social-emotional concerns. An evidence-based approach with developmentally based culturally informed quantitative tools and standardized decision supports could help ensure equitable management and decision making about young children's social and emotional well-being and development. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Barriers and Facilitators to Implementing an Evidence-Based Community Health Worker Model

Importance

Community health worker (CHW) programs may improve health outcomes, increase quality of life, and reduce hospitalizations and cost of care. However, knowledge is limited on the barriers and facilitators associated with scaling evidence-based CHW programs to maximize their public health outcomes.

Objective

To identify barriers and facilitators to implementing an evidence-based CHW model.

Design, Setting, and Participants

This qualitative study examined perspectives of Individualized Management of Person-Centered Targets (IMPaCT) program staff (health system leaders, program managers, and community health workers) and patients receiving the intervention between March 9, 2020, and July 22, 2021, at 5 institutionally and geographically diverse health systems across the US. The collected data were analyzed between December 1, 2021, and April 27, 2022. Program staff were recruited via purposive sampling, and patients were recruited via convenience sampling.

Intervention

The disease-agnostic IMPaCT CHW model includes a standardized implementation approach and a structured set of theory-informed intervention components to create and achieve individualized action plans.

Main Outcomes and Measures

Interview guides were informed by the Consolidated Framework for Implementation Research. A rapid qualitative analytic technique was used to identify key themes, which were categorized into barriers and facilitators associated with framework ecological domains.

Results

Of a total 41 individuals invited, 39 agreed to participate (95% response rate; mean [SD] age, 45.0 [12.6] years; 30 women). General barriers included economic and policy constraints, including insufficient funding for CHW programs, clinical integration challenges, and CHW difficulty with maintaining boundaries. Program-specific barriers included insufficiently tailored materials for certain populations and upfront and ongoing program costs. General facilitators included CHWs' interpersonal skills and life experiences. Program-specific facilitators included the model's strong evidence base, supportive implementation team, and program design that enabled relationship building and engagement. Additional themes were cited as both barriers and facilitators, including the COVID-19 pandemic, organizational leadership, IMPaCT training, and program fidelity.

Conclusions and Relevance

These findings suggest growing recognition of the importance of CHWs to improving health equity and population health. Barriers identified point to important policy and practice implications for CHW programs more broadly, including the need for continued attention to improving clinical integration and the need for sustainable program financing to preserve the longevity of this workforce.

Getting Started With Multi-site Research: Lessons From the Eliminating Monitor Overuse (EMO) Study

Research in Pediatric Hospital Medicine is growing and expanding rapidly, and with this comes the need to expand single-site research projects into multisite research studies within practice-based research networks. This expansion is crucial to ensure generalizable findings in diverse populations; however, expanding Pediatric Hospital Medicine research projects from single to multisite can be daunting. We provide an overview of major logistical steps and challenges in project management, regulatory approvals, data use agreements, training, communication, and financial management that are germane to hospitalist researchers launching their first multisite project by sharing processes and lessons learned from running multisite research projects in the Pediatric Research in Inpatient Settings Network within the Eliminating Monitor Overuse study portfolio. This description is relevant to hospitalist researchers transitioning from single-site to multisite research or those considering serving as site lead for a multisite project.

A mixed-methods evaluation of organization and individual factors influencing provider intentions to use caregiver coaching in community-based early intervention

BACKGROUND

Most psycho-social interventions contain multiple components. Practitioners often vary in their implementation of different intervention components. Caregiver coaching is a multicomponent intervention for young autistic children that is highly effective but poorly implemented in community-based early intervention (EI). Previous research has shown that EI providers' intentions, and the determinants of their intentions, to implement caregiver coaching vary across components. Organizational culture and climate likely influence these psychological determinants of intention by affecting beliefs that underlie attitudes, norms, and self-efficacy to implement an intervention. Research in this area is limited, which limits the development of theoretically driven, multilevel implementation strategies to support multi-component interventions. This mixed methods study evaluated the relationships among organizational leadership, culture and climate, attitudes, norms, self-efficacy, and EI providers' intentions to implement the components of caregiver coaching.

METHODS

We surveyed 264 EI providers from 37 agencies regarding their intentions and determinants of intentions to use caregiver coaching. We also asked questions about the organizational culture, climate, and leadership in their agencies related to caregiver coaching. We used multilevel structural equation models to estimate associations among intentions, psychological determinants of intentions (attitudes, descriptive norms, injunctive norms, and self-efficacy), and organizational factors (implementation climate and leadership). We conducted qualitative interviews with 36 providers, stratified by strength of intentions to use coaching. We used mixed-methods analysis to gain an in-depth understanding of the organization and individual-level factors.

RESULTS

The associations among intentions, psychological determinants of intentions, and organizational factors varied across core components of caregiver coaching. Qualitative interviews elucidated how providers describe the importance of each component. For example, providers' attitudes toward coaching caregivers and their perceptions of caregivers' expectations for service were particularly salient themes related to their use of caregiver coaching.

CONCLUSION

Results highlight the importance of multi-level strategies that strategically target individual intervention components as well as organization-level and individual-level constructs. This approach holds promise for improving the implementation of complex, multicomponent, psychosocial interventions in community-based service systems.

Evaluating the implementation of a community health worker-delivered intervention integrating asthma care in West Philadelphia public schools

OBJECTIVE

Schools are an important setting because students spend much of their time in school and engage in physical activity during the school day that could exacerbate asthma symptoms. Our objective is to understand the barriers and facilitators to implementing an experimental community health worker-delivered care coordination program for students with asthma within the context of the West Philadelphia Controls Asthma study.

METHODS

Surveys (n = 256) and semi-structured interviews (n = 41) were completed with principals, teachers, nurses, and community health workers from 21 public and charter schools in West Philadelphia between January 2019 and September 2021. Survey participants completed the Evidence Based Practice Attitudes Scale, the Implementation Leadership Scale, and Organizational Climate Index. Semi-structured qualitative interview guides were developed, informed by the Consolidated Framework for Implementation Research.

RESULTS

Participant responses indicate that they perceived benefits for schools and students related to the community health worker-based care coordination program. Several barriers and facilitators to implementing the program were noted, including challenges associated with incorporating the program into school nurse workflow, environmental triggers in the school environment, and challenges communicating with family members. An important facilitator that was identified was having supportive school administrators and staff who were engaged and saw the benefits of the program.

CONCLUSIONS

This work can inform implementation planning for other locales interested in implementing community-based pediatric asthma control programs delivered by community health workers in schools.

Acceptability of Dyad Care Management After Preterm Birth: A Qualitative Study

OBJECTIVES

Care management programs for medically complex infants interact with parents after complicated pregnancies, when gaps in maternal health care are well documented. These care managers may have the relationships and skills to promote postpartum and interconception health and health care access. It is unknown whether expanding these care management models to address maternal needs would be acceptable.

METHODS

We conducted qualitative interviews with women with a history of preterm birth and clinicians. For women with a history of preterm birth, additional inclusion criteria were Medicaid-insured infant in one health system and English proficiency. We purposively oversampled women whose infants received care management. Clinicians worked in two geographically adjacent health systems. Interviews explored priorities after preterm birth and perceived acceptability of mother-infant dyad care management. Interviews were audio recorded, transcribed, and coded following an integrated approach in which we applied a priori codes and captured emergent themes.

RESULTS

We interviewed 33 women (10/2018-7/2021) and 24 clinicians (3/2021-8/2021). Women were predominantly non-Hispanic Black, and 15 had infants receiving care management. Clinicians included physicians, nurses, and social workers from Pediatrics, Obstetrics, and Family Medicine. Subgroups converged thematically, finding care management acceptable. Tailoring programs to address stress and sleep, emphasizing care managers with strong interpersonal skills and shared experiences with care management users, and program flexibility would contribute to acceptability.

CONCLUSIONS FOR PRACTICE

Dyad care management after preterm birth is acceptable to potential program end-users and clinicians. Dyad health promotion may contribute to improved birth outcomes, infant, and parent health.

Integrating Care for Mother-Infant Dyads After Preterm Birth: A Qualitative Study of Clinician Perspectives on Feasibility

Objective

There are gaps in receipt of maternal preventive services in the interconception period. Yet mother-infant dyads have frequent health care visits. Health systems have opportunities to better capitalize on existing visits to address dyad needs, but this possibility has not been fully explored.

Methods

In this qualitative study we conducted semistructured interviews with clinical team members involved with birthing parents or infants after preterm birth. We conducted snowball sampling from teams in pediatrics, obstetrics, and family medicine at two geographically adjacent health systems. Interviews explored perspectives on existing barriers and facilitators to integrating dyad care across adult and infant teams. Interviews were audio-recorded, professionally transcribed, and coded using an integrated approach.

Results

We interviewed 24 physicians, nurses, midwives, and social workers (March-November 2021). Participants identified barriers to integrated care including infrequent communication between clinical teams, which was generalizable to care of the birthing parent or infant as individuals, and additional barriers related to privacy, credentialing, and visit design that were specific to dyad care. To improve integration of dyad care, clinicians proposed adapting a variety tools and procedures currently used in their practices, including electronic health record tools for communication, dedicated roles to support communication or navigation, centralized information on resources for dyad care, referral protocols, identifying dyads for proactive outreach, and opportunities for clinicians to connect face-to-face about shared patients or families.

Conclusions

Clinicians believe existing health care structures and processes can be adapted to address current substantial barriers to integrated dyad care.

An evaluation of implementation climate in inpatient maternity care: a cross-sectional survey study

OBJECTIVE

Researchers in obstetrics and gynecology are continuously generating new evidence to inform clinical care delivery. Yet, much of this newly emerging evidence fails to be rapidly and effectively integrated into routine clinical practice. Implementation climate refers to clinicians' perceptions of to what degree organizations support and reward use of an evidence-based practice (EBP) and is an important construct in the science of implementation in healthcare. Little is known about implementation climate for EBPs in maternity care. Thus, we aimed to (a) determine the reliability of the Implementation Climate Scale (ICS) for use in inpatient maternity care, (b) describe implementation climate in inpatient maternity care overall, and (c) compare individual perceptions of implementation climate between physician and nursing clinicians on these units.

STUDY DESIGN

We performed a cross-sectional survey of clinicians in inpatient maternity units across 2 urban, academic hospitals in the northeastern United States in 2020. Clinicians completed the 18-question validated ICS [scored 0-4]. Scale reliability by role was evaluated using Cronbach's α. Subscale and total scores were described overall and compared by physician versus nursing role using independent t-tests, as well as linear regression to control for confounders.

RESULTS

111 clinicians completed the survey (physicians = 65; nursing = 46). Physicians were less likely to identify as female (75.4% vs. 100.0%, p < .001), but were of similar age and years of experience as nursing clinicians. Reliability of the ICS was excellent, with Cronbach's α of 0.91 and 0.86 among physicians and nursing clinicians, respectively. Scores were notably low for implementation climate in maternity care overall and for all subscales. ICS total scores were also higher among physicians as compared to nurses (2.18(±0.56) vs. 1.92(±0.50), p = .02), which remained significant in multivariable modeling (p = .02). Unadjusted subscale scores were higher among physicians in Recognition for EBP (2.68(±0.89) vs. 2.30(±0.86), p = .03) and Selection for EBP (2.24(±0.93) vs. 1.62(±1.04), p = .002). After adjustment for potential confounders, subscale scores for Focus on EBP (p = .04) and Selection for EBP (p = .002) were all higher among physicians.

CONCLUSIONS

This study supports the ICS as a reliable scale for measuring implementation climate in the inpatient maternity care setting. Notably lower implementation climate scores across subscales and roles compared to other settings may underlie the vast evidence to practice gap in obstetrics. In order to successfully implement practices that reduce maternal morbidity, we may need to focus on building educational support and rewarding EBP utilization on labor and delivery units, with an emphasis on nursing clinicians.

Eliminating Monitor Overuse (EMO) type III effectiveness-deimplementation cluster-randomized trial: Statistical analysis plan

Background

Deimplementing overused health interventions is essential to maximizing quality and value while minimizing harm, waste, and inefficiencies. Three national guidelines discourage continuous pulse oximetry (SpO2) monitoring in children who are not receiving supplemental oxygen, but the guideline-discordant practice remains prevalent, making it a prime target for deimplementation. This paper details the statistical analysis plan for the Eliminating Monitor Overuse (EMO) SpO2 trial, which compares the effect of two competing deimplementation strategies (unlearning only vs. unlearning plus substitution) on the sustainment of deimplementation of SpO2 monitoring in children with bronchiolitis who are in room air.

Methods

The EMO Trial is a hybrid type 3 effectiveness-deimplementation trial with a longitudinal cluster-randomized design, conducted in Pediatric Research in Inpatient Settings Network hospitals. The primary outcome is deimplementation sustainment, analyzed as a longitudinal difference-in-differences comparison between study arms. This analysis will use generalized hierarchical mixed-effects models for longitudinal clustering outcomes. Secondary outcomes include the length of hospital stay and oxygen supplementation duration, modeled using linear mixed-effects regressions. Using the well-established counterfactual approach, we will also perform a mediation analysis of hospital-level mechanistic measures on the association between the deimplementation strategy and the sustainment outcome.

Discussion

We anticipate that the EMO Trial will advance the science of deimplementation by providing new insights into the processes, mechanisms, and likelihood of sustained practice change using rigorously designed deimplementation strategies. This pre-specified statistical analysis plan will mitigate reporting bias and support data-driven approaches.

Trial registration

ClinicalTrials.gov NCT05132322. Registered on 24 November 2021.

Protocol for a pragmatic stepped wedge cluster randomized clinical trial testing behavioral economic implementation strategies to increase supplemental breast MRI screening among patients with extremely dense breasts

BACKGROUND

Increased breast density augments breast cancer risk and reduces mammography sensitivity. Supplemental breast MRI screening can significantly increase cancer detection among women with dense breasts. However, few women undergo this exam, and screening is consistently lower among racially minoritized populations. Implementation strategies informed by behavioral economics ("nudges") can promote evidence-based practices by improving clinician decision-making under conditions of uncertainty. Nudges directed toward clinicians and patients may facilitate the implementation of supplemental breast MRI.

METHODS

Approximately 1600 patients identified as having extremely dense breasts after non-actionable mammograms, along with about 1100 clinicians involved with their care at 32 primary care or OB/GYN clinics across a racially diverse academically based health system, will be enrolled. A 2 × 2 randomized pragmatic trial will test nudges to patients, clinicians, both, or neither to promote supplemental breast MRI screening. Before implementation, rapid cycle approaches informed by clinician and patient experiences and behavioral economics and health equity frameworks guided nudge design. Clinicians will be clustered into clinic groups based on existing administrative departments and care patterns, and these clinic groups will be randomized to have the nudge activated at different times per a stepped wedge design. Clinicians will receive nudges integrated into the routine mammographic report or sent through electronic health record (EHR) in-basket messaging once their clinic group (i.e., wedge) is randomized to receive the intervention. Independently, patients will be randomized to receive text message nudges or not. The primary outcome will be defined as ordering or scheduling supplemental breast MRI. Secondary outcomes include MRI completion, cancer detection rates, and false-positive rates. Patient sociodemographic information and clinic-level variables will be examined as moderators of nudge effectiveness. Qualitative interviews conducted at the trial's conclusion will examine barriers and facilitators to implementation.

DISCUSSION

This study will add to the growing literature on the effectiveness of behavioral economics-informed implementation strategies to promote evidence-based interventions. The design will facilitate testing the relative effects of nudges to patients and clinicians and the effects of moderators of nudge effectiveness, including key indicators of health disparities. The results may inform the introduction of low-cost, scalable implementation strategies to promote early breast cancer detection.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05787249. Registered on March 28, 2023.

Protocol to evaluate sequential electronic health record-based strategies to increase genetic testing for breast and ovarian cancer risk across diverse patient populations in gynecology practices

BACKGROUND

Germline genetic testing is recommended by the National Comprehensive Cancer Network (NCCN) for individuals including, but not limited to, those with a personal history of ovarian cancer, young-onset (< 50 years) breast cancer, and a family history of ovarian cancer or male breast cancer. Genetic testing is underused overall, and rates are consistently lower among Black and Hispanic populations. Behavioral economics-informed implementation strategies, or nudges, directed towards patients and clinicians may increase the use of this evidence-based clinical practice.

METHODS

Patients meeting eligibility for germline genetic testing for breast and ovarian cancer will be identified using electronic phenotyping algorithms. A pragmatic cohort study will test three sequential strategies to promote genetic testing, two directed at patients and one directed at clinicians, deployed in the electronic health record (EHR) for patients in OB-GYN clinics across a diverse academic medical center. We will use rapid cycle approaches informed by relevant clinician and patient experiences, health equity, and behavioral economics to optimize and de-risk our strategies and methods before trial initiation. Step 1 will send patients messages through the health system patient portal. For non-responders, step 2 will reach out to patients via text message. For non-responders, Step 3 will contact patients' clinicians using a novel "pend and send" tool in the EHR. The primary implementation outcome is engagement with germline genetic testing for breast and ovarian cancer predisposition, defined as a scheduled genetic counseling appointment. Patient data collected through the EHR (e.g., race/ethnicity, geocoded address) will be examined as moderators of the impact of the strategies.

DISCUSSION

This study will be one of the first to sequentially examine the effects of patient- and clinician-directed strategies informed by behavioral economics on engagement with breast and ovarian cancer genetic testing. The pragmatic and sequential design will facilitate a large and diverse patient sample, allow for the assessment of incremental gains from different implementation strategies, and permit the assessment of moderators of strategy effectiveness. The findings may help determine the impact of low-cost, highly transportable implementation strategies that can be integrated into healthcare systems to improve the use of genomic medicine.

TRIAL REGISTRATION

ClinicalTrials.gov. NCT05721326. Registered February 10, 2023. https://www.

CLINICALTRIALS

gov/study/NCT05721326.

Evaluation of a brief virtual implementation science training program: the Penn Implementation Science Institute

BACKGROUND

To meet the growing demand for implementation science expertise, building capacity is a priority. Various training opportunities have emerged to meet this need. To ensure rigor and achievement of specific implementation science competencies, it is critical to systematically evaluate training programs.

METHODS

The Penn Implementation Science Institute (PennISI) offers 4 days (20 h) of virtual synchronous training on foundational and advanced topics in implementation science. Through a pre-post design, this study evaluated the sixth PennISI, delivered in 2022. Surveys measures included 43 implementation science training evaluation competencies grouped into four thematic domains (e.g., items related to implementation science study design grouped into the "design, background, and rationale" competency category), course-specific evaluation criteria, and open-ended questions to evaluate change in knowledge and suggestions for improving future institutes. Mean composite scores were created for each of the competency themes. Descriptive statistics and thematic analysis were completed.

RESULTS

One hundred four (95.41% response rate) and 55 (50.46% response rate) participants completed the pre-survey and post-survey, respectively. Participants included a diverse cohort of individuals primarily affiliated with US-based academic institutions and self-reported as having novice or beginner-level knowledge of implementation science at baseline (81.73%). In the pre-survey, all mean composite scores for implementation science competencies were below one (i.e., beginner-level). Participants reported high value from the PennISI across standard course evaluation criteria (e.g., mean score of 3.77/4.00 for overall quality of course). Scores for all competency domains increased to a score between beginner-level and intermediate-level following training. In both the pre-survey and post-survey, competencies related to "definition, background, and rationale" had the highest mean composite score, whereas competencies related to "design and analysis" received the lowest score. Qualitative themes offered impressions of the PennISI, didactic content, PennISI structure, and suggestions for improvement. Prior experience with or knowledge of implementation science influenced many themes.

CONCLUSIONS

This evaluation highlights the strengths of an established implementation science institute, which can serve as a model for brief, virtual training programs. Findings provide insight for improving future program efforts to meet the needs of the heterogenous implementation science community (e.g., different disciplines and levels of implementation science knowledge). This study contributes to ensuring rigorous implementation science capacity building through the evaluation of programs.

Eight characteristics of rigorous multilevel implementation research: a step-by-step guide

BACKGROUND

Although healthcare is delivered in inherently multilevel contexts, implementation science has no widely endorsed methodological standards defining the characteristics of rigorous, multilevel implementation research. We identify and describe eight characteristics of high-quality, multilevel implementation research to encourage discussion, spur debate, and guide decision-making around study design and methodological issues.

RECOMMENDATIONS

Implementation researchers who conduct rigorous multilevel implementation research demonstrate the following eight characteristics. First, they map and operationalize the specific multilevel context for defined populations and settings. Second, they define and state the level of each construct under study. Third, they describe how constructs relate to each other within and across levels. Fourth, they specify the temporal scope of each phenomenon at each relevant level. Fifth, they align measurement choices and construction of analytic variables with the levels of theories selected (and hypotheses generated, if applicable). Sixth, they use a sampling strategy consistent with the selected theories or research objectives and sufficiently large and variable to examine relationships at requisite levels. Seventh, they align analytic approaches with the chosen theories (and hypotheses, if applicable), ensuring that they account for measurement dependencies and nested data structures. Eighth, they ensure inferences are made at the appropriate level. To guide implementation researchers and encourage debate, we present the rationale for each characteristic, actionable recommendations for operationalizing the characteristics in implementation research, a range of examples, and references to make the characteristics more usable. Our recommendations apply to all types of multilevel implementation study designs and approaches, including randomized trials, quantitative and qualitative observational studies, and mixed methods.

CONCLUSION

These eight characteristics provide benchmarks for evaluating the quality and replicability of multilevel implementation research and promote a common language and reference points. This, in turn, facilitates knowledge generation across diverse multilevel settings and ensures that implementation research is consistent with (and appropriately leverages) what has already been learned in allied multilevel sciences. When a shared and integrated description of what constitutes rigor is defined and broadly communicated, implementation science is better positioned to innovate both methodologically and theoretically.

Increasing antiretroviral therapy adherence and retention in care among adults living with HIV in Philadelphia: a study protocol for a stepped-wedge cluster-randomised type 2 hybrid effectiveness-implementation trial of managed problem-solving plus (MAPS+) delivered by community health workers

INTRODUCTION

To end the HIV epidemic in Philadelphia, implementation of evidence-based practices (EBP) to increase viral suppression and retention in HIV care is critical. Managed problem solving (MAPS), an EBP for antiretroviral therapy adherence, follows a problem-solving approach to empower people living with HIV (PWH) to manage their health. To overcome barriers to care experienced by PWH in Philadelphia, the EBP was adapted to include a focus on care retention and delivery by community health workers (CHWs). The adapted intervention is MAPS+. To maximise the clinical impact and reach of the intervention, evaluation of the effectiveness and implementation of MAPS+ is necessary.

METHODS AND ANALYSIS

This manuscript describes the protocol for a stepped-wedge cluster-randomised type 2 hybrid effectiveness-implementation trial in 10 clinics in Philadelphia. This research incorporates innovative approaches to accomplish three objectives: (1) to evaluate the effectiveness of the CHW-led MAPS+ intervention to improve viral suppression and retention in care 1 year after the individual implementation period (N=390 participants), (2) to examine the effect of the menu of implementation strategies on reach and implementation cost and (3) to examine processes, mechanisms, and sustainment of the implementation strategies for MAPS+ (N=56 participants). Due to various factors (eg, COVID-19), protocol modifications have occurred.

ETHICS AND DISSEMINATION

The institutional review board (IRB) at the city of Philadelphia serves as the primary IRB; initial approval was granted on 21 December 2020. The University of Pennsylvania and Northwestern University executed reliance agreements. A safety monitoring committee comprised experts in implementation science, biostatistics and infectious diseases oversee this study. This research will offer insights into achieving the goals to end the HIV epidemic in Philadelphia as well as implementation efforts of MAPS+ and other behavioural interventions aimed at increasing medication adherence and retention in care. Dissemination will include deliverables (eg, peer-reviewed manuscripts and lay publications) to reach multiple constituents.

TRIAL REGISTRATION NUMBER

NCT04560621.

Cluster Randomized Pragmatic Clinical Trial Testing Behavioral Economic Implementation Strategies to Improve Tobacco Treatment for Patients With Cancer Who Smoke

PURPOSE

Few cancer centers systematically engage patients with evidence-based tobacco treatment despite its positive effect on quality of life and survival. Implementation strategies directed at patients, clinicians, or both may increase tobacco use treatment (TUT) within oncology.

METHODS

We conducted a four-arm cluster-randomized pragmatic trial across 11 clinical sites comparing the effect of strategies informed by behavioral economics on TUT engagement during oncology encounters with cancer patients. We delivered electronic health record (EHR)-based nudges promoting TUT across four nudge conditions: patient only, clinician only, patient and clinician, or usual care. Nudges were designed to counteract cognitive biases that reduce TUT engagement. The primary outcome was TUT penetration, defined as the proportion of patients with documented TUT referral or a medication prescription in the EHR. Generalized estimating equations were used to estimate the parameters of a linear model.

RESULTS

From June 2021 to July 2022, we randomly assigned 246 clinicians in 95 clusters, and collected TUT penetration data from their encounters with 2,146 eligible patients who smoke receiving oncologic care. Intent-to-treat (ITT) analysis showed that the clinician nudge led to a significant increase in TUT penetration versus usual care (35.6% v 13.5%; OR = 3.64; 95% CI, 2.52 to 5.24; P < .0001). Completer-only analysis (N = 1,795) showed similar impact (37.7% clinician nudge v 13.5% usual care; OR = 3.77; 95% CI, 2.73 to 5.19; P < .0001). Clinician type affected TUT penetration, with physicians less likely to provide TUT than advanced practice providers (ITT OR = 0.67; 95% CI, 0.51 to 0.88; P = .004).

CONCLUSION

EHR nudges, informed by behavioral economics and aimed at oncology clinicians, appear to substantially increase TUT penetration. Adding patient nudges to the implementation strategy did not affect TUT penetration rates.

Integrating a focus on health equity in implementation science: Case examples from the national cancer institute's implementation science in cancer control centers (ISC3) network

Background

A Health Equity Task Force (HETF) of members from seven Centers funded by the National Cancer Institute's (NCI) Implementation Science in Cancer Control Centers (ISC3) network sought to identify case examples of how Centers were applying a focus on health equity in implementation science to inform future research and capacity-building efforts.

Methods

HETF members at each ISC3 collected information on how health equity was conceptualized, operationalized, and addressed in initial research and capacity-building efforts across the seven ISC3 Centers funded in 2019-2020. Each Center completed a questionnaire assessing five health equity domains central to implementation science (e.g., community engagement; implementation science theories, models, and frameworks (TMFs); and engaging underrepresented scholars). Data generated illustrative examples from these five domains.

Results

Centers reported a range of approaches focusing on health equity in implementation research and capacity-building efforts, including (1) engaging diverse community partners/settings in making decisions about research priorities and projects; (2) applying health equity within a single TMF applied across projects or various TMFs used in specific projects; (3) evaluating health equity in operationalizing and measuring health and implementation outcomes; (4) building capacity for health equity-focused implementation science among trainees, early career scholars, and partnering organizations; and (5) leveraging varying levels of institutional resources and efforts to engage, include, and support underrepresented scholars.

Conclusions

Examples of approaches to integrating health equity across the ISC3 network can inform other investigators and centers' efforts to build capacity and infrastructure to support growth and expansion of health equity-focused implementation science.

Power Redistribution and Upending White Supremacy in Implementation Research and Practice in Community Mental Health

This Open Forum explores how implementation research and practice may sustain White supremacist ideas, perpetuate unequal power dynamics, and maintain mental health care inequities. The following questions were considered: What information is valued and considered evidence? and How do power differentials within implementation research and practice manifest? The implementation of evidence-based interventions within community mental health clinics is used as an example to explore these questions. Recommendations are provided to envision a future that centers collaboratively developed and community-led approaches to foster equity in mental health care.

An innovative sequential mixed-methods approach to evaluating clinician acceptability during implementation of a standardized labor induction protocol

BACKGROUND

Implementation outcomes, including acceptability, are of critical importance in both implementation research and practice. The gold standard measure of acceptability, Acceptability of Intervention Measure (AIM), skews positively with a limited range. In an ongoing hybrid effectiveness-implementation trial, we aimed to evaluate clinician acceptability of induction standardization. Here, we describe an innovative mixed-methods approach to maximize the interpretability of the AIM using a case study in maternal health.

METHODS

In this explanatory sequential mixed methods study, we distributed the validated, 4-question AIM (total 4-20) to labor and delivery clinicians 6 months post-implementation at 2 sites (Site 1: 3/2021; Site 2: 6/2021). Respondents were grouped by total score into tertiles. The top ("High" Acceptability) and bottom ("Low" Acceptability) tertiles were invited to participate in a 30-minute semi-structured qualitative interview from 6/2021 to 10/2021 until thematic saturation was reached in each acceptability group. Participants were purposively sampled by role and site. Interviews were coded using an integrated approach, incorporating a priori attributes (Consolidated Framework for Implementation Research constructs) into a modified content analysis approach.

RESULTS

104 clinicians completed the initial survey; 24 were interviewed (12 "High" and 12 "Low" Acceptability). Median total AIM scores were 20/20 IQR[20-20] in the High and 12.5/20 IQR[11-14] in the Low Acceptability groups. In both groups, clinicians were enthusiastic about efforts to standardize labor induction, believing it reduces inter-clinician variability and improves equitable, evidence-based care. In the Low Acceptability group, clinicians stated the need for flexibility and consideration for patient uniqueness. Rarely, clinicians felt labor induction could not or should not be standardized, citing discomfort with medicalization of labor, and concerns with "bulldozing" the patient with interventions. Suggested strategies for overcoming negative sentiment included comprehensive clinician education, as well as involving patients as active participants in the protocol prenatally.

CONCLUSIONS

This study utilized AIM in an innovative sequential mixed-methods approach to characterize clinician acceptability, which may be generalizable across implementation endeavors. By performing this work during a hybrid trial, implementation strategies to improve acceptability emerged (clinician education focusing on respect for flexibility; involving patients as active participants prenatally) for year 2, which will inform future multi-site work.

Sustainment of continuous pulse oximetry deimplementation: Analysis of Eliminating Monitor Overuse study data from six hospitals

Using continuous pulse oximetry (cSpO2 ) to monitor children with bronchiolitis who are not receiving supplemental oxygen is a form of medical overuse. In this longitudinal analysis from the Eliminating Monitor Overuse (EMO) study, we aimed to assess changes in cSpO2 overuse before, during, and after intensive cSpO2 -deimplementation efforts in six hospitals. Monitoring data were collected during three phases: "P1" baseline, "P2" active deimplementation (all sites engaged in education and audit and feedback strategies), and "P3" sustainment (a new baseline measured after strategies were withdrawn). Two thousand and fifty-three observations were analyzed. We found that each hospital experienced reductions during active deimplementation (P2), with overall adjusted cSpO2 overuse decreasing from 53%, 95% confidence interval (CI): (49-57) to 22%, 95% CI: (19-25) between P1 and P2. However, following the withdrawal of deimplementation strategies, overuse rebounded in all six sites, with overall adjusted cSpO2 overuse increasing to 37%, 95% CI: (33-41) in P3.

Effect of Integrating Patient-Generated Digital Data Into Mental Health Therapy: A Randomized Controlled Trial

OBJECTIVE

The authors sought to determine whether providing summaries of patients' social media and other digital data to patients and their clinicians improves patients' health-related quality of life (HRQoL) measured by the RAND 36-Item Short Form Health Survey (SF-36).

METHODS

The authors randomly assigned 115 adults receiving outpatient mental health therapy to usual care or to periodic sharing of summaries of their digital data with their clinician providing psychosocial therapy. The study was conducted October 2020-December 2021.

RESULTS

Patients' mean±SD age was 31.3±10.5 years, and 82% were women. At 60 days after enrollment, no statistically significant change was detected in SF-36 scores for patients randomly allocated to the intervention (mean difference=-0.39, 95% CI=-4.17, 3.39) or to usual care (mean difference=-1.98, 95% CI=-5.74, 1.77), and no significant between-arm difference was observed (between-arm difference=1.60, 95% CI=-3.67, 6.86).

CONCLUSIONS

Collecting and summarizing digital data for use in mental health treatment was feasible for patients but did not significantly improve their HRQoL or other measures of mental health.

A Digital Mental Health App Incorporating Wearable Biosensing for Teachers of Children on the Autism Spectrum to Support Emotion Regulation: Protocol for a Pilot Randomized Controlled Trial

BACKGROUND

As much as 80% of children on the autism spectrum exhibit challenging behaviors (ie, behaviors dangerous to the self or others, behaviors that interfere with learning and development, and behaviors that interfere with socialization) that can have a devastating impact on personal and family well-being, contribute to teacher burnout, and even require hospitalization. Evidence-based practices to reduce these behaviors emphasize identifying triggers (events or antecedents that lead to challenging behaviors); however, parents and teachers often report that challenging behaviors surface with little warning. Exciting recent advances in biometric sensing and mobile computing technology allow the measurement of momentary emotion dysregulation using physiological indexes.

OBJECTIVE

We present the framework and protocol for a pilot trial that will test a mobile digital mental health app, the KeepCalm app. School-based approaches to managing challenging behaviors in children on the autism spectrum are limited by 3 key factors: children on the autism spectrum often have difficulties in communicating their emotions; it is challenging to implement evidence-based, personalized strategies for individual children in group settings; and it is difficult for teachers to track which strategies are successful for each child. KeepCalm aims to address those barriers by communicating children's stress to their teachers using physiological signaling (emotion dysregulation detection), supporting the implementation of emotion regulation strategies via smartphone pop-up notifications of top strategies for each child according to their behavior (emotion regulation strategy implementation), and easing the task of tracking outcomes by providing the child's educational team with a tool to track the most effective emotion regulation strategies for that child based on physiological stress reduction data (emotion regulation strategy evaluation).

METHODS

We will test KeepCalm with 20 educational teams of students on the autism spectrum with challenging behaviors (no exclusion based on IQ or speaking ability) in a pilot randomized waitlist-controlled field trial over a 3-month period. We will examine the usability, acceptability, feasibility, and appropriateness of KeepCalm as primary outcomes. Secondary preliminary efficacy outcomes include clinical decision support success, false positives or false negatives of stress alerts, and the reduction of challenging behaviors and emotion dysregulation. We will also examine technical outcomes, including the number of artifacts and the proportion of time children are engaged in high physical movement based on accelerometry data; test the feasibility of our recruitment strategies; and test the response rate and sensitivity to change of our measures, in preparation for a future fully powered large-scale randomized controlled trial.

RESULTS

The pilot trial will begin by September 2023.

CONCLUSIONS

Results will provide key data about important aspects of implementing KeepCalm in preschools and elementary schools and will provide preliminary data about its efficacy to reduce challenging behaviors and support emotion regulation in children on the autism spectrum.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05277194; https://www.clinicaltrials.gov/ct2/show/NCT05277194.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/45852.

A comparison of two group cognitive behavioral therapy protocols for anxiety in urban schools: appropriateness, child outcomes, and cost-effectiveness

Background

Cognitive behavioral therapy (CBT) for pediatric anxiety is efficacious for reducing anxiety symptoms and improving functioning, but many children are unable to access CBT for anxiety in community settings. Schools are an important setting in which children access mental health care, including therapy for anxiety. In this setting, therapy is usually delivered by Masters-level therapists.

Objectives

Friends for Life (FRIENDS), a 12-session, manualized, group CBT program for anxiety has demonstrated effectiveness when implemented in schools. However, prior research has also found challenges regarding feasibility and cultural fit when delivering FRIENDS in the urban school context. To address these challenges, we adapted FRIENDS for implementation in the school setting so that it might be more feasible and culturally appropriate for low-income, urban schools in the United States, while maintaining the core components of treatment. The current study uses a mixed-method approach to compare the effectiveness, cost-effectiveness, and perceived appropriateness of FRIENDS and CATS when delivered by Masters-level therapists with train-the-trainer support.

Materials and methods

First, we compared change scores for student outcomes (i.e., child-report MASC-2 total score, parent-report MASC-2 total score, teacher-report Engagement and Disaffection subscale scores) from pre- to post- treatment between students receiving FRIENDS and students receiving CATS to assess whether the two conditions resulted in equivalent outcomes. Second, we compared the cost and cost-effectiveness between the groups. Finally, we used an applied thematic analysis to compare appropriateness of the interventions as perceived by therapists and supervisors.

Results

The mean change score for the child-reported MASC-2 was 1.9 (SE = 1.72) points in the FRIENDS condition and 2.9 (SE = 1.73) points in the CATS condition; results indicated that the conditions were similar in their treatment effects, and symptom reductions were small in both groups. The modified protocol, CATS, was shown to cost significantly less to implement compared to FRIENDS and showed greater cost-effectiveness. Finally, compared to therapists and supervisors in the CATS condition, therapists and supervisors in the FRIENDS condition more strongly described aspects of the intervention that were not appropriate for their context and in need of more extensive adaptations.

Conclusion

Relatively brief, group CBT for anxiety, with adaptations to improve cultural fit, is a promising approach to treat youth anxiety symptom when delivered by school-based therapists with train-the-trainer implementation support.

Parent Coaching in Early Intervention for Autism Spectrum Disorder: A Brief Report

Coaching caregivers of young children on the autism spectrum is a critical component of parent-mediated interventions. Little information is available about how providers implement parent coaching for children on the autism spectrum in publicly funded early intervention systems. This study evaluated providers' use of parent coaching in an early intervention system. Twenty-five early intervention sessions were coded for fidelity to established caregiver coaching techniques. We found low use of coaching techniques overall, with significant variability in use of coaching across providers. When providers did coach caregivers, they used only a few coaching strategies (e.g., collaboration and in-vivo feedback). Results indicate that targeted training and implementation strategies focused on individual coaching components, instead of coaching more broadly, may be needed to improve the use of individual coaching strategies. A focus on strengthening the use of collaboration and in-vivo feedback may be key to improving coaching fidelity overall.

A randomized clinical trial testing two implementation strategies to promote the treatment of tobacco dependence in community mental healthcare

INTRODUCTION

People with serious mental illness (SMI) are more likely to smoke and less likely to receive tobacco treatment. Implementation strategies may address clinician and organizational barriers to treating tobacco in mental healthcare.

METHODS

A cluster-randomized trial (Clinic N=13, Client N=610, Staff N=222) tested two models to promote tobacco treatment in community mental healthcare: standard didactic training vs. Addressing Tobacco Through Organizational Change (ATTOC), an organizational model that provides clinician and leadership training and addresses system barriers to tobacco treatment. Primary outcomes were changes in tobacco treatment from clients, staff, and medical records. Secondary outcomes were changes in smoking, mental health, and quality of life (QOL), and staff skills and barriers to treat tobacco.

RESULTS

Clients at ATTOC sites reported a significant increase in receiving tobacco treatment from clinician at weeks 12 and 24 (ps<0.05) and tobacco treatments and policies from clinics at weeks 12, 24, 36, and 52 (ps<0.05), vs. standard sites. ATTOC staff reported a significant increase in skills to treat tobacco at week 36 (p=0.05), vs. standard sites. For both models, tobacco use medications, from clients (week 52) and medical records (week 36), increased (ps<0.05), while perceived barriers decreased at weeks 24 and 52 (ps<0.05); 4.3% of clients quit smoking which was not associated with model. QOL and mental health improved over 24 weeks for both models (ps<0.05).

CONCLUSIONS

Standard training and ATTOC improve use of evidence-based tobacco treatments in community mental healthcare without worsening mental health, but ATTOC may more effectively address this practice gap.

Testing psychosocial interventions in the contexts they are meant to be delivered

This article discusses psychosocial interventions in the contexts they are meant to be delivered. Prevention and intervention science often follow the linear pathway of preclinical or pre-intervention research-efficacy trials, effectiveness trials, and implementation studies-with the assessment of translation into public and population health impact occurring at the end. This linear translational pathway follows stages developed for ascertaining safe, efficacious, and effective dosages for biological compounds. This approach has created limitations in the need to rapidly deploy complex, multi-component, multilevel approaches to change behavior and improve health into widespread practice for diverse clinical and public health settings. While it is important to use efficacy trials when safety is yet to be established, when the risks are identified to be low, as is often the case for psychosocial interventions, we can go faster to achieve equitable population health impact. The authors recommend that clinical trialists engaged in intervention development incorporate two considerations in the next generation of prevention and intervention research. First, consider moving right to effectiveness or pragmatic trials, as the most valid test of an intervention is the est of that intervention in the context(s) in which it is intended. Second, when designing effectiveness studies, consider investigating questions related to both effectiveness (i.e., does the intervention improve clinical outcomes) and implementation (i.e., what supports are needed to deploy the intervention routinely in that context) to accelerate impact. As a matter of both ethics and equity, there is a need to expedite the research-to-practice pipeline at a pace faster than is made available through current approaches. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Identifying Common and Unique Barriers and Facilitators to Implementing Evidence-Based Practices for Suicide Prevention across Primary Care and Specialty Mental Health Settings

OBJECTIVE

We identified common and unique barriers and facilitators of evidence-based suicide prevention practices across primary care practices with integrated behavioral health services and specialty mental health settings to identify generalizable strategies for enhancing future implementation efforts.

METHOD

Twenty-six clinicians and practice leaders from behavioral health (n = 2 programs) and primary care (n = 4 clinics) settings participated. Participation included a semi-structured qualitative interview on barriers and facilitators to implementing evidence-based suicide prevention practices. Within that interview, clinicians participated in a chart-stimulated recall exercise to gather additional information about decision making regarding suicide screening. Interview guides and qualitative coding were informed by leading frameworks in implementation science and behavioral science, and an integrated approach to interpreting qualitative results was used.

RESULTS

There were a number of similar themes associated with implementation of suicide prevention practices across settings and clinician types, such as the benefits of inter-professional collaboration and uncertainties about managing suicidality once risk was disclosed. Clinicians also highlighted barriers unique to their settings. For primary care settings, time constraints and competing demands were consistently described as barriers. For specialty mental health settings, difficulties coordinating care with schools and other providers in the community made implementation of suicide prevention practices challenging.

CONCLUSION

Findings can inform the development and testing of implementation strategies that are generalizable across primary care and specialty mental health settings, as well as those tailored for unique site needs, to enhance use of evidence-based suicide prevention practices in settings where individuals at risk for suicide are especially likely to present.HIGHLIGHTSWe examined barriers and facilitators to suicide prevention across health settings.Common and unique barriers and facilitators across health-care settings emerged.Findings can enhance suicide prevention implementation across health-care settings.

Youth Trauma Histories are Associated with Under-diagnosis and Under-treatment of Co-occurring Youth Psychiatric Symptoms

OBJECTIVE

We examined whether in the presence of trauma exposure, non-traumatic stress-related symptoms are interpreted by mental health clinicians as less salient than the trauma exposure and are de-emphasized as a treatment target, consistent with a diagnostic overshadowing bias.

METHODS

Using an adapted version of a diagnostic overshadowing bias experimental paradigm, mental health clinicians (N = 266, M age = 34.4 years, 82% female) were randomly assigned to receive two of six clinical vignette variations. Vignette 1 described an adolescent with obsessive-compulsive disorder (OCD). Vignette 2 described a pre-adolescent with oppositional defiant disorder (ODD). Vignettes were identical except for whether the youth reported exposure to a potentially traumatic event (PTE; no PTE, sexual PTE, or physical PTE). Clinicians received one vignette with a PTE and one without, counterbalancing order. Clinicians rated the likelihood the youth met criteria for various diagnoses and the appropriateness of various treatments on 7-point scales.

RESULTS

Across both vignettes, clinicians rated the target diagnosis (OCD in Vignette 1, ODD in Vignette 2) as less likely for vignettes with a PTE than for the same vignettes without a PTE. Clinicians also rated evidence-based treatment modalities for target diagnoses as less appropriate in the presence of a PTE than when a PTE was present.

CONCLUSIONS

Consistent with possible bias, clinicians may under-recognize and under-treat non-traumatic stress-related mental health symptoms in youth with a co-occurring trauma history. Future work to validate this bias in real-world practice is indicated.

Determinants of Blood Culture Use in Critically Ill Children: A Multicenter Qualitative Study

Blood cultures are fundamental in diagnosing and treating sepsis in the pediatric intensive care unit (PICU), but practices vary widely. Overuse can lead to false positive results and unnecessary antibiotics. Specific factors underlying decisions about blood culture use and overuse are unknown. Therefore, we aimed to identify perceived determinants of blood culture use in the PICU.

Methods

We conducted semistructured interviews of clinicians (M.D., D.O., R.N., N.P., P.A.) from 6 PICUs who had participated in a quality improvement collaborative about blood culture practices. We developed interview questions by combining elements of the Consolidated Framework for Implementation Research and behavioral economics. We conducted telephone interviews, open-coded the transcripts, and used modified content analysis to determine key themes and mapped themes to elements of Consolidated Framework for Implementation Research and behavioral economics.

Results

We reached thematic saturation in 24 interviews. Seven core themes emerged across 3 Consolidated Framework for Implementation Research domains: individual characteristics [personal belief in the importance of blood cultures, the perception that blood cultures are a low-risk test]; inner setting [adherence to site-specific usual practices, site-specific overall approach to PICU care (collaborative versus hierarchical), influence of non-PICU clinicians on blood culture decisions]; and outer setting [patient-specific risk factors, sepsis guidelines]. In addition, outcome bias, default bias, and loss aversion emerged as salient behavioral economics concepts.

Conclusions

Determinants of blood culture use include individual clinician characteristics, inner setting, and outer setting, as well as default bias, outcome bias, and loss aversion. These determinants will now inform the development of candidate strategies to optimize culture practices.

How do financial incentives in parenting skills programs effect engagement and outcomes? A systematic review and meta-analysis protocol

OBJECTIVE

This systematic review will investigate the effects of financial incentives on engagement with and outcomes of evidence-based parenting skills programs to prevent and treat disruptive behavior disorders.

INTRODUCTION

Evidence-based parenting skills programs are a first-line treatment in disruptive behavior disorders (ie, oppositional defiant disorder, conduct disorder, and attention-deficit/hyperactivity disorder), but fewer than half of referred parents complete these programs. When untreated, children affected by disruptive behavior disorders are at elevated risk for incarceration, drug misuse, and education under-performance. Financial incentives can improve parents' engagement with parenting skills programs and are increasingly popular strategies in public health policy to increase rates of compliance with health interventions. However, no previous systematic review or meta-analysis of financial incentives in parenting skills programs has been conducted.

INCLUSION CRITERIA

Randomized controlled trials or quasi-experimental studies (ie, studies with a control group allocated through a non-random process) testing the effects of financial incentives on engagement will be included. Study participants must be in a guardian role to a person under 18 years of age. There will be no restrictions on country setting. Only English-language publications will be included.

METHODS

We will search PubMed, CINAHL, Sociological Abstracts, Cochrane Trials, and PsycINFO databases for relevant articles. Two independent reviewers will screen abstracts for eligibility. Data will be extracted from eligible articles by 2 researchers and results will be presented in tabular and narrative format, along with a meta-analysis using a random effects model and assessment of heterogeneity.

SYSTEMATIC REVIEW REGISTRATION NUMBER

PROSPERO CRD42022336210.

Therapist and supervisor perspectives about two train-the-trainer implementation strategies in schools: A qualitative study

Background

Train-the-trainer (TT) implementation strategies (in which designated clinicians are trained to then train others in an intervention) are promising approaches to support mental health clinician use of evidence-based interventions in school contexts. However, there is little evidence to date examining clinicians' perceptions of the acceptability and feasibility of TT strategies, or comparing clinicians' perceptions of different types of TT strategies.

Methods

The current study was conducted as part of a larger hybrid effectiveness-implementation trial, in which school-based therapists and supervisors received one of two different types of implementation support to implement cognitive behavioral therapy (CBT) groups for anxiety: TT (i.e., initial training for therapists and supervisors) or enhanced TT (TT+; i.e., initial training for therapists and supervisors, and ongoing external consultation for supervisors). We used applied thematic analysis to compare qualitative interview transcripts from 28 therapist interviews and 33 supervisor interviews from therapists and supervisors who received TT or TT+ support and report themes that were similar and different across the two groups.

Results

Most themes were similar across the TT and TT+ conditions: therapists and supervisors in both conditions perceived the group anxiety intervention as acceptable and viewed supervision as acceptable, helpful, and feasible. Therapists and supervisors in both conditions had mixed impressions of the contextual appropriateness of the group anxiety intervention, and some reported logistical challenges with weekly supervision. Some unique themes were identified among the TT+ condition, including supervisors experiencing professional growth, and therapists and supervisors perceiving supervision as critically important and enjoyable.

Conclusions

These results suggest that TT implementation support, using a model in which an internal supervisor receives initial training and then provides ongoing supervision, is acceptable and feasible to support a group CBT intervention in schools. The results also highlight additional benefits that therapists and supervisors perceived when supervisors received ongoing consultation.

Clinical Trial Registration Information

The clinical trial from which these data were derived was registered at ClinicalTrials.gov (https://clinicaltrials.gov/) prior to the time of first patient enrollment. The registration number is: NCT02651402.

Implementing trauma-focused cognitive behavioral therapy in Philadelphia: A 10-year evaluation

Background: In 2012, Philadelphia's Department of Behavioral Health and Intellectual disAbility Services (DBHIDS) developed an initiative to implement an evidence-based treatment for posttraumatic stress disorder (PTSD), trauma-focused cognitive behavioral therapy (TF-CBT), across the city's behavioral health system. This report evaluates the initiative's 10-year implementation and effectiveness outcomes. Method: The Exploration, Preparation, Implementation, and Sustainment framework guided our implementation evaluation. The implementation outcomes include adoption, reach, and sustainment; these were obtained during regular evaluation data collection from publicly funded behavioral health agencies participating in the TF-CBT initiative. We analyze effectiveness outcomes (i.e., changes in PTSD symptoms) from a subset of patients receiving TF-CBT, which were collected in 6-month intervals by our research team between 2013 and 2021. Results: From 2012 to 2021, DBHIDS trained 478 clinicians in TF-CBT across 20 behavioral health agencies. During this time, 23,401 youths were screened for potentially traumatic events and PTSD symptoms, and 7,550 youths received TF-CBT. Through the TF-CBT initiative, the city expanded the network of TF-CBT providers from 3 to 20 agencies. DBHIDS sustained this network by maintaining the participation of 16 behavioral health agencies over the course of a decade. The subset of 202 youths who were evaluated to assess TF-CBT effectiveness was drawn from 94 therapists and 20 agencies across Philadelphia. All participating youths completed a baseline assessment, and 151 (75%) completed at least one follow-up assessment. Linear mixed-effects models accounting for observations nested within participants and nested within clinicians found that treatment significantly reduced PTSD symptoms. Conclusion: Between 2012 and 2021, DBHIDS successfully implemented and sustained TF-CBT across the city's behavioral health system. Adoption, reach, and sustainment of TF-CBT were high. Despite the considerable adverse experiences faced by youths seeking treatment in Philadelphia's behavioral health system, TF-CBT was effective. Future directions to improve TF-CBT implementation in the next iteration of the initiative are described.

Metrics to evaluate implementation scientists in the USA: what matters most?

Background

Implementation science has grown rapidly as a discipline over the past two decades. An examination of how publication patterns and other scholarly activities of implementation scientists are weighted in the tenure and promotion process is needed given the unique and applied focus of the field.

Methods

We surveyed implementation scientists (mostly from the USA) to understand their perspectives on the following matters: (1) factors weighted in tenure and promotion for implementation scientists, (2) how important these factors are for success as an implementation scientist, (3) how impact is defined for implementation scientists, (4) top journals in implementation science, and (5) how these journals are perceived with regard to their prestige. We calculated univariate descriptive statistics for all quantitative data, and we used Wilcoxon signed-rank tests to compare the participants’ ratings of various factors. We analyzed open-ended qualitative responses using content analysis.

Results

One hundred thirty-two implementation scientists completed the survey (response rate = 28.9%). Four factors were rated as more important for tenure and promotion decisions: number of publications, quality of publication outlets, success in obtaining external funding, and record of excellence in teaching. Six factors were rated as more important for overall success as an implementation scientist: presentations at professional meetings, involvement in professional service, impact of the implementation scientist’s scholarship on the local community and/or state, impact of the implementation scientist’s scholarship on the research community, the number and quality of the implementation scientist’s community partnerships, and the implementation scientist’s ability to disseminate their work to non-research audiences. Participants most frequently defined and described impact as changing practice and/or policy. This expert cohort identified Implementation Science as the top journal in the field.

Conclusions

Overall, there was a significant mismatch between the factors experts identified as being important to academic success (e.g., tenure and promotion) and the factors needed to be a successful implementation scientist. Findings have important implications for capacity building, although they are largely reflective of the promotion and tenure process in the USA.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00323-0.

Equitable implementation of S.A.F.E. Firearm: A multi-method pilot study

Attention to health equity is critical in the implementation of firearm safety efforts. We present our operationalization of equity-oriented recommendations in preparation for launch of a hybrid effectiveness-implementation trial focused on firearm safety promotion in pediatric primary care as a universal suicide prevention strategy. In Step 1 of our process, pre-trial engagement with clinican partners and literature review alerted us that delivery of a firearm safety program may vary by patients' medical complexity, race, and ethnicity. In Step 2, we selected the Health Equity Implementation Framework to inform our understanding of contextual determinants (i.e., barriers and facilitators). In Step 3, we leveraged an implementation pilot across 5 pediatric primary care clinics in 2 health system sites to study signals of inequities. Eligible well-child visits for 694 patients and 47 clinicians were included. Our results suggested that medical complexity was not associated with program delivery. We did see potential signals of inequities by race and ethnicity but must interpret with caution. Though we did not initially plan to examine differences by sex assigned at birth, we discovered that clinicians may be more likely to deliver the program to parents of male than female patients. Seven qualitative interviews with clinicians provided additional context. In Step 4, we interrogated equity considerations (e.g., why and how do these inequities exist). In Step 5, we will develop a plan to probe potential inequities related to race, ethnicity, and sex in the fully powered trial. Our process highlights that prospective, rigorous, exploratory work is vital for equity-informed implementation trials.

Medical stakeholder perspectives on implementing a computerized battery to identify neurocognitive impairments among youth in Botswana

HIV infection and in utero exposure, common in Sub-Saharan Africa, are associated with pediatric neurocognitive impairment. Cognitive screening can identify impairments, but it is rarely used in this setting. The Penn Computerized Neurocognitive Battery (PennCNB), an evidence-based cognitive screening tool, was adapted for use in Botswana. To facilitate future implementation, 20 semi-structured interviews were conducted to elicit key stakeholders' perspectives on factors likely to be related to successful uptake of the PennCNB in clinical settings. An integrated analytic approach combining constructs from the Consolidated Framework for Implementation Research and modified grounded theory was used. Results underscore the need for cognitive screening in Botswana and the acceptability of the PennCNB. Implementation barriers include limited time and resources, whereas facilitators include standard procedures for introducing new tools into medical settings and for training implementers. Recommended implementation strategies include integrating screening into the existing workflow, implementing the tool in the medical and educational sectors, and targeting selection of children for assessment. This research addresses the research-to-practice gap by engaging in pre-implementation inquiry and designing for implementation. Results will inform the development of strategies to maximize the likelihood of successful implementation of the PennCNB to identify neurocognitive impairment in children in this high-need setting.

Variation in Stakeholder Preferences for Implementing Evidence-Based Practices in Behavioral Health Care

Objective

The authors examined whether stakeholders in behavioral health care differ in their preferences for strategies that support the implementation of evidence-based practices (EBPs).

Methods

Using data collected in March and April 2019 in a survey of stakeholders in Philadelphia Medicaid’s behavioral health care system, the authors compared empirical Bayes preference weights for implementation strategies across clinicians, supervisors, agency executives, and payers.

Results

Preferences for implementation strategies overlapped among the stakeholders (N=357 survey respondents). Financial incentives were consistently ranked as most useful and performance feedback as the least useful for implementing EBPs. However, areas of divergence were identified. For example, payers preferred compensation for EBP delivery, whereas clinicians considered compensation for time spent on preparing for EBPs as equally useful.

Conclusions

The observed variation in stakeholder preferences for strategies to implement EBPs may shed light on why the ongoing shift from volume to value in behavioral health care has had mixed results.

A Randomized Trial to Identify Accurate Measurement Methods for Adherence to Cognitive-Behavioral Therapy

Clinician fidelity to cognitive behavioral therapy (CBT) is an important mechanism by which desired clinical outcomes are achieved and is an indicator of care quality. Despite its importance, there are few fidelity measurement methods that are efficient and have demonstrated reliability and validity. Using a randomized trial design, we compared three methods of assessing CBT adherence-a core component of fidelity-to direct observation, the gold standard. Clinicians recruited from 27 community mental health agencies (n = 126; M age = 37.69 years, SD = 12.84; 75.7% female) were randomized 1:1:1 to one of three fidelity conditions: self-report (n = 41), chart-stimulated recall (semistructured interviews with the chart available; n = 42), or behavioral rehearsal (simulated role-plays; n = 43). All participating clinicians completed fidelity assessments for up to three sessions with three different clients that were recruited from clinicians' caseloads (n = 288; M age = 13.39 years SD = 3.89; 41.7% female); sessions were also audio-recorded and coded for comparison to determine the most accurate method. All fidelity measures had parallel scales that yielded an adherence maximum score (i.e., the highest-rated intervention in a session), a mean of techniques observed, and a count total of observed techniques. Results of three-level mixed effects regression models indicated that behavioral rehearsal produced comparable scores to observation for all adherence scores (all ps > .01), indicating no difference between behavioral rehearsal and observation. Self-report and chart-stimulated recall overestimated adherence compared to observation (ps < .01). Overall, findings suggested that behavioral rehearsal indexed CBT adherence comparably to direct observation, the gold-standard, in pediatric populations. Behavioral rehearsal may at times be able to replace the need for resource-intensive direct observation in implementation research and practice.

Sustainable deimplementation of continuous pulse oximetry monitoring in children hospitalized with bronchiolitis: study protocol for the Eliminating Monitor Overuse (EMO) type III effectiveness-deimplementation cluster-randomized trial

Background

Methods of sustaining the deimplementation of overused medical practices (i.e., practices not supported by evidence) are understudied. In pediatric hospital medicine, continuous pulse oximetry monitoring of children with the common viral respiratory illness bronchiolitis is recommended only under specific circumstances. Three national guidelines discourage its use for children who are not receiving supplemental oxygen, but guideline-discordant practice (i.e., overuse) remains prevalent. A 6-hospital pilot of educational outreach with audit and feedback resulted in immediate reductions in overuse; however, the best strategies to optimize sustainment of deimplementation success are unknown.

Methods

The Eliminating Monitor Overuse (EMO) trial will compare two deimplementation strategies in a hybrid type III effectiveness-deimplementation trial. This longitudinal cluster-randomized design will be conducted in Pediatric Research in Inpatient Settings (PRIS) Network hospitals and will include baseline measurement, active deimplementation, and sustainment phases. After a baseline measurement period, 16–19 hospitals will be randomized to a deimplementation strategy that targets unlearning (educational outreach with audit and feedback), and the other 16–19 will be randomized to a strategy that targets unlearning and substitution (adding an EHR-integrated clinical pathway decision support tool). The primary outcome is the sustainment of deimplementation in bronchiolitis patients who are not receiving any supplemental oxygen, analyzed as a longitudinal difference-in-differences comparison of overuse rates across study arms. Secondary outcomes include equity of deimplementation and the fidelity to, and cost of, each deimplementation strategy. To understand how the deimplementation strategies work, we will test hypothesized mechanisms of routinization (clinicians developing new routines supporting practice change) and institutionalization (embedding of practice change into existing organizational systems).

Discussion

The EMO trial will advance the science of deimplementation by providing new insights into the processes, mechanisms, costs, and likelihood of sustained practice change using rigorously designed deimplementation strategies. The trial will also advance care for a high-incidence, costly pediatric lung disease.

Trial registration

ClinicalTrials.gov,NCT05132322. Registered on November 10, 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01246-z.

Specialist and Patient Perspectives on Strategies to Improve Cardiovascular Disease Prevention Among Persons Living with Psoriatic Disease

Background

Psoriasis is an immune-mediated disease associated with excess risk for cardiovascular disease (CVD). Guidelines recognize psoriasis as a CVD risk enhancer; however, psoriasis patients often do not have CVD risk factors identified nor managed.

Objective

This study examines strategies to improve CVD prevention care from the perspective of dermatologists and patients with psoriasis.

Methods

Qualitative interviews were conducted using the Consolidated Framework for Implementation Research to examine the perspectives of physicians (N = 16) and patients with psoriatic disease (N = 16) on barriers/facilitators to CVD prevention. Interviews were transcribed and coded using an integrated approach designed to enhance reliability and validity using NVivo software.

Results

We found three major themes suggesting areas to target for the future: (1) Appropriateness: perceptions of whether CVD care should be deployed in this setting by both clinicians and patients, (2) Feasibility: whether CVD prevention care could be integrated into the current structure of specialist practice, and (3) Care Coordination: an interest by all parties to better integrate a team approach in CVD preventative care to reduce duplicative efforts, work practically in an already existing system rather than reinventing the wheel, and progress with the patients' best interests in mind.

Conclusions

These findings will inform the design of a clinical trial comparing the effectiveness of specialist clinician implementation of CVD guideline-based prevention care in patients with psoriasis. Ultimately, this study aims to increase the lifespan and health of patients living with psoriatic disease by decreasing barriers to their receiving appropriate CVD prevention care.

Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem

BACKGROUND

Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers.

MAIN BODY

Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches.

CONCLUSION

We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

Implementation mapping to plan for a hybrid trial testing the effectiveness and implementation of a behavioral intervention for HIV medication adherence and care retention

Background

Implementation mapping is a systematic, collaborative, and contextually-attentive method for developing implementation strategies. As an exemplar, we applied this method to strategy development for Managed Problem Solving Plus (MAPS+), an adapted evidence-based intervention for HIV medication adherence and care retention that will be delivered by community health workers and tested in an upcoming trial.

Methods

In Step 1: Conduct Needs Assessment, we interviewed 31 stakeholders to identify determinants of MAPS+ implementation in 13 clinics serving people with HIV in Philadelphia County. In Step 2: Develop Logic Model, we used these determinants as inputs for a working logic model guided by the Consolidated Framework for Implementation Research. In Step 3: Operationalize Implementation Strategies, our team held a virtual stakeholder meeting to confirm determinants. We synthesized stakeholder feedback, then identified implementation strategies that conceptually matched to determinants using the Expert Recommendations for Implementing Change taxonomy. Next, we operationalized implementation strategies with specific examples for clinic settings. We linked strategies to behavior change theories to allow for a mechanistic understanding. We then held a second virtual stakeholder meeting to present the implementation menu for feedback and glean generalizable insights for how these strategies could be operationalized in each stakeholder's clinic. In Step 4: Protocolize Strategies, we incorporated stakeholder feedback and finalized the implementation strategy menu.

Findings

Implementation mapping produced a menu of 39 strategies including revise professional roles, identify and prepare champions, use warm handoffs, and change record systems. The process of implementation mapping generated key challenges for implementation strategy development: lack of implementation strategies targeting the outer setting (i.e., sociopolitical context); tension between a one-size-fits-all and individualized approach for all clinics; conceptual confusion between facilitators and strategies; and challenges in translating the implementation science lexicon for partners.

Implications

This case exemplar advances both MAPS+ implementation and implementation science methods by furthering our understanding of the use of implementation mapping to develop strategies that enhance uptake of evidence-based interventions. The implementation menu will inform MAPS+ deployment across Philadelphia in an upcoming hybrid trial. We will carry out Step 5: Test Strategies to test the effectiveness and implementation of MAPS+.