2
|
Kilbourne A, Chinman M, Rogal S, Almirall D. Adaptive Designs in Implementation Science and Practice: Their Promise and the Need for Greater Understanding and Improved Communication. Annu Rev Public Health 2023; 45:10.1146/annurev-publhealth-060222-014438. [PMID: 37931183 PMCID: PMC11070446 DOI: 10.1146/annurev-publhealth-060222-014438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2023]
Abstract
The promise of adaptation and adaptive designs in implementation science has been hindered by the lack of clarity and precision in defining what it means to adapt, especially regarding the distinction between adaptive study designs and adaptive implementation strategies. To ensure a common language for science and practice, authors reviewed the implementation science literature and found that the term adaptive was used to describe interventions, implementation strategies, and trial designs. To provide clarity and offer recommendations for reporting and strengthening study design, we propose a taxonomy that describes fixed versus adaptive implementation strategies and implementation trial designs. To improve impact, (a) future implementation studies should prespecify implementation strategy core functions that in turn can be taught to and replicated by health system/community partners, (b) funders should support exploratory studies that refine and specify implementation strategies, and (c) investigators should systematically address design requirements and ethical considerations (e.g., randomization, blinding/masking) with health system/community partners. Expected final online publication date for the Annual Review of Public Health, Volume 45 is April 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Amy Kilbourne
- Quality Enhancement Research Initiative, U.S. Department of Veterans Affairs, Washington, District of Columbia, USA
- Department of Learning Health Science, University of Michigan Medical School, Ann Arbor, Michigan, USA;
| | - Matthew Chinman
- RAND Corporation, Pittsburgh, Pennsylvania, USA
- Center for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, Pennsylvania, USA
- Mental Illness Research, Education, and Clinical Center, VA Pittsburgh Healthcare System, Pittsburgh, Pennsylvania, USA
| | - Shari Rogal
- Center for Health Equity Research and Promotion, VA Pittsburgh Healthcare System, Pittsburgh, Pennsylvania, USA
- Departments of Medicine and Surgery, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Daniel Almirall
- Institute for Social Research and Department of Statistics, University of Michigan, Ann Arbor, Michigan, USA
| |
Collapse
|
3
|
Webb S, Drake C, Coffman CJ, Sullivan C, Sperber N, Tucker M, Zullig LL, Hughes JM, Kaufman BG, Pura JA, Anderson L, Hastings SN, Van Houtven CH, Abbate LM, Hoenig H, Ballengee LA, Wang V, Allen KD. Group physical therapy for knee osteoarthritis: protocol for a hybrid type III effectiveness-implementation trial. Implement Sci Commun 2023; 4:125. [PMID: 37828564 PMCID: PMC10571277 DOI: 10.1186/s43058-023-00502-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 09/09/2023] [Indexed: 10/14/2023] Open
Abstract
BACKGROUND Knee osteoarthritis (OA) is a leading cause of chronic pain and disability and one of the most common conditions treated in outpatient physical therapy (PT). Because of the high and growing prevalence of knee OA, there is a need for efficient approaches for delivering exercise-based PT to patients with knee OA. A prior randomized controlled trial (RCT) showed that a 6-session Group Physical Therapy Program for Knee OA (Group PT) yields equivalent or greater improvements in pain and functional outcomes compared with traditional individual PT, while requiring fewer clinician hours per patient to deliver. This manuscript describes the protocol for a hybrid type III effectiveness-implementation trial comparing two implementation packages to support delivery of Group PT. METHODS In this 12-month embedded trial, a minimum of 16 Veterans Affairs Medical Centers (VAMCs) will be randomized to receive one of two implementation support packages for their Group PT programs: a standard, low-touch support based on Replicating Effective Programs (REP) versus enhanced REP (enREP), which adds tailored, high-touch support if sites do not meet Group PT adoption and sustainment benchmarks at 6 and 9 months following launch. Implementation outcomes, including penetration (primary), adoption, and fidelity, will be assessed at 6 and 12 months (primary assessment time point). Additional analyses will include patient-level effectiveness outcomes (pain, function, satisfaction) and staffing and labor costs. A robust qualitative evaluation of site implementation context and experience, as well as site-led adaptations to the Group PT program, will be conducted. DISCUSSION To our knowledge, this study is the first to evaluate the impact of tailored, high-touch implementation support on implementation outcomes when compared to standardized, low-touch support for delivering a PT-based intervention. The Group PT program has strong potential to become a standard offering for PT, improving function and pain-related outcomes for patients with knee OA. Results will provide information regarding the effectiveness and value of this implementation approach and a deeper understanding of how healthcare systems can support wide-scale adoption of Group PT. TRIAL REGISTRATION This study was registered on March 7, 2022 at ClinicalTrials.gov (identifier NCT05282927 ).
Collapse
Affiliation(s)
- Sara Webb
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
| | - Connor Drake
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
| | - Cynthia J Coffman
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, NC, USA
| | - Caitlin Sullivan
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
| | - Nina Sperber
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
| | - Matthew Tucker
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
| | - Leah L Zullig
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
| | - Jaime M Hughes
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Implementation Science, Wake Forest University School of Medicine, Winston-Salem, NC, USA
- Section On Gerontology and Geriatric Medicine, Division of Internal Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Brystana G Kaufman
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
- Margolis Center for Health Policy, Duke University, Durham, NC, USA
| | - John A Pura
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- AstraZeneca, Durham, NC, USA
| | - Livia Anderson
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
| | - Susan N Hastings
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
- Center for the Study of Aging and Human Development, Duke University School of Medicine, Durham, NC, USA
- Geriatric Research, Education, and Clinical Center, Durham VA Health Care System, Durham, NC, USA
- Department of Medicine, Duke University School of Medicine, Durham, NC, USA
| | - Courtney H Van Houtven
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
- Margolis Center for Health Policy, Duke University, Durham, NC, USA
| | - Lauren M Abbate
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- VA Eastern Colorado Geriatric Research Education and Clinical Center and University of Colorado School of Medicine, Aurora, CO, USA
| | - Helen Hoenig
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Center for the Study of Aging and Human Development, Duke University School of Medicine, Durham, NC, USA
- Department of Medicine, Duke University School of Medicine, Durham, NC, USA
- Physical Medicine and Rehabilitation Services, Durham VA Health Care System, Durham, NC, USA
| | - Lindsay A Ballengee
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
| | - Virginia Wang
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Durham, NC, USA
- Margolis Center for Health Policy, Duke University, Durham, NC, USA
- Department of Medicine, Duke University School of Medicine, Durham, NC, USA
| | - Kelli D Allen
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham VA Health Care System, Durham, NC, USA.
- Department of Medicine & Thurston Arthritis Research Center, University of North Carolina at Chapel Hill School of Medicine, Chapel Hill, NC, USA.
| |
Collapse
|
4
|
Kilbourne AM, Geng E, Eshun-Wilson I, Sweeney S, Shelley D, Cohen DJ, Kirchner JE, Fernandez ME, Parchman ML. How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy. Implement Sci Commun 2023; 4:53. [PMID: 37194084 DOI: 10.1186/s43058-023-00435-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Accepted: 05/06/2023] [Indexed: 05/18/2023] Open
Abstract
BACKGROUND Healthcare facilitation, an implementation strategy designed to improve the uptake of effective clinical innovations in routine practice, has produced promising yet mixed results in randomized implementation trials and has not been fully researched across different contexts. OBJECTIVE Using mechanism mapping, which applies directed acyclic graphs that decompose an effect of interest into hypothesized causal steps and mechanisms, we propose a more concrete description of how healthcare facilitation works to inform its further study as a meta-implementation strategy. METHODS Using a modified Delphi consensus process, co-authors developed the mechanistic map based on a three-step process. First, they developed an initial logic model by collectively reviewing the literature and identifying the most relevant studies of healthcare facilitation components and mechanisms to date. Second, they applied the logic model to write vignettes describing how facilitation worked (or did not) based on recent empirical trials that were selected via consensus for inclusion and diversity in contextual settings (US, international sites). Finally, the mechanistic map was created based on the collective findings from the vignettes. FINDINGS Theory-based healthcare facilitation components informing the mechanistic map included staff engagement, role clarification, coalition-building through peer experiences and identifying champions, capacity-building through problem solving barriers, and organizational ownership of the implementation process. Across the vignettes, engagement of leaders and practitioners led to increased socialization of the facilitator's role in the organization. This in turn led to clarifying of roles and responsibilities among practitioners and identifying peer experiences led to increased coherence and sense-making of the value of adopting effective innovations. Increased trust develops across leadership and practitioners through expanded capacity in adoption of the effective innovation by identifying opportunities that mitigated barriers to practice change. Finally, these mechanisms led to eventual normalization and ownership of the effective innovation and healthcare facilitation process. IMPACT Mapping methodology provides a novel perspective of mechanisms of healthcare facilitation, notably how sensemaking, trust, and normalization contribute to quality improvement. This method may also enable more efficient and impactful hypothesis-testing and application of complex implementation strategies, with high relevance for lower-resourced settings, to inform effective innovation uptake.
Collapse
Affiliation(s)
- Amy M Kilbourne
- Health Services Research & Development, VA Office of Research and Development, US Department of Veterans Affairs and University of Michigan, 810 Vermont Ave, NW, Washington, D.C., 20420, USA.
| | - Elvin Geng
- Washington University at St. Louis, St. Louis, MO, USA
| | | | | | - Donna Shelley
- New York University School of Global Public Health, New York, New York, USA
| | | | - JoAnn E Kirchner
- Central Arkansas VA Healthcare System and University of Arkansas for Medical Sciences, North Little Rock, AR, USA
| | - Maria E Fernandez
- University of Texas Health Science Center at Houston, School of Public Health, Houston, TX, USA
| | - Michael L Parchman
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| |
Collapse
|
5
|
Smith SN, Almirall D, Choi SY, Koschmann E, Rusch A, Bilek E, Lane A, Abelson JL, Eisenberg D, Himle JA, Fitzgerald KD, Liebrecht C, Kilbourne AM. Correction: Primary aim results of a clustered SMART for developing a school-level, adaptive implementation strategy to support CBT delivery at high schools in Michigan. Implement Sci 2022; 17:54. [PMID: 35953861 PMCID: PMC9367019 DOI: 10.1186/s13012-022-01229-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Affiliation(s)
- Shawna N Smith
- Department of Health Management and Policy, School of Public Health, University of Michigan, SPH II, 1415 Washington Heights, Ann Arbor, MI, 48109, USA. .,Department of Psychiatry, Michigan Medicine, University of Michigan, Ann Arbor, USA.
| | - Daniel Almirall
- Survey Research Center, Institute of Social Research, University of Michigan, Ann Arbor, USA.,Department of Statistics, University of Michigan, Ann Arbor, USA
| | - Seo Youn Choi
- Department of Health Management and Policy, School of Public Health, University of Michigan, SPH II, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Elizabeth Koschmann
- Department of Psychiatry, Michigan Medicine, University of Michigan, Ann Arbor, USA
| | - Amy Rusch
- Department of Health Management and Policy, School of Public Health, University of Michigan, SPH II, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - Emily Bilek
- Department of Psychiatry, Michigan Medicine, University of Michigan, Ann Arbor, USA
| | - Annalise Lane
- Department of Health Management and Policy, School of Public Health, University of Michigan, SPH II, 1415 Washington Heights, Ann Arbor, MI, 48109, USA
| | - James L Abelson
- Department of Psychiatry, Michigan Medicine, University of Michigan, Ann Arbor, USA
| | - Daniel Eisenberg
- Department of Health Policy and Management, UCLA, Los Angeles, USA
| | - Joseph A Himle
- Department of Psychiatry, Michigan Medicine, University of Michigan, Ann Arbor, USA.,School of Social Work, University of Michigan, Ann Arbor, USA
| | - Kate D Fitzgerald
- Department of Psychiatry, Columbia University Irving Medical Center/New York State Psychiatric Institute, New York City, USA
| | - Celeste Liebrecht
- Department of Learning Health Sciences, Michigan Medicine, University of Michigan, Ann Arbor, USA
| | - Amy M Kilbourne
- Department of Learning Health Sciences, Michigan Medicine, University of Michigan, Ann Arbor, USA.,Quality Enhancement Research Initiative (QUERI), US Department of Veterans Affairs, Washington, DC, USA
| |
Collapse
|