1
|
Coronado GD, Petrik AF, Leo MC, Coury J, Durr R, Badicke B, Thompson JH, Edelmann AC, Davis MM. Mailed Outreach and Patient Navigation for Colorectal Cancer Screening Among Rural Medicaid Enrollees: A Cluster Randomized Clinical Trial. JAMA Netw Open 2025; 8:e250928. [PMID: 40094661 PMCID: PMC11915063 DOI: 10.1001/jamanetworkopen.2025.0928] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/15/2024] [Accepted: 12/29/2024] [Indexed: 03/19/2025] Open
Abstract
Importance Approximately 60 million adults live in rural regions of the US, which historically have low rates of colorectal cancer (CRC) screening and follow-up. Rural residents enrolled in Medicaid have particularly low CRC screening and follow-up rates. Objective To determine the effectiveness and implementation of a collaborative Medicaid health plan-clinic program of mailed fecal immunochemical test (FIT) outreach and patient navigation to colonoscopy following an abnormal FIT result when implemented in rural clinics as part of standard care. Design, Setting, and Participants This cluster randomized clinical trial was conducted at 28 rural clinic units in Oregon affiliated with 3 Medicaid health plans. The clinics were randomized to the intervention (n = 14) or to usual care (n = 14). Participants were Medicaid enrollees (aged 50-75 years) due for CRC screening. The intervention was delivered from May 11, 2021, through June 4, 2022, and analyses were performed from June 2023 through September 2024. Intervention The stepwise intervention involved (1) mailed FIT outreach and (2) patient navigation to colonoscopy following an abnormal FIT result. Implementation support included practice facilitation, training, collaborative learning, and patient tracking tools. Main Outcomes and Measures The primary effectiveness outcome was completion of any CRC screening within 6 months of eligibility determination. An additional effectiveness outcome was follow-up colonoscopy completion within 6 months of an abnormal FIT result. Implementation was measured as (1) the proportion of intervention-eligible enrollees who were mailed an FIT and who were sent an advance notification or reminder and (2) the proportion with an abnormal FIT result who were offered patient navigation. Results This study included 5614 Medicaid enrollees (2613 in intervention clinics and 3001 in usual care clinics). Enrollees had a mean (SD) age of 58.2 (5.5) years; most (4940 [88.0%]) were aged 50 to 64 years. A total of 2948 enrollees (52.5%) were female, 325 (6.2%) were Hispanic and 3774 (67.2%) were White, and 4457 (79.4%) lived in rural regions. Compared with Medicaid enrollees in usual care clinics, enrollees in intervention clinics had a higher adjusted 6-month proportion of any CRC screening completion (11.8% vs 4.5%; difference, 7.3 [95% CI, 5.3-9.2] percentage points). Implementation was 100% (all 1489 intervention-eligible enrollees) for mailed FIT outreach, 88.5% for advance notification, 78.1% for reminders, and 57.9% for patient navigation. Conclusions and Relevance In this cluster randomized clinical trial of rural clinics, mailed FIT outreach and patient navigation boosted participation in CRC screening among Medicaid enrollees. More efforts are needed to address low participation in both FIT testing and follow-up colonoscopy. Trial Registration ClinicalTrials.gov Identifier: NCT04890054.
Collapse
Affiliation(s)
| | | | - Michael C. Leo
- Kaiser Permanente Center for Health Research, Portland, Oregon
| | | | - Robert Durr
- Oregon Rural Practice-Based Research Network, Portland
| | | | | | | | | |
Collapse
|
2
|
Coronado GD, Nyongesa DB, Petrik AF, Thompson JH, Escaron AL, Pham T, Leo MC. The Reach of Calls and Text Messages for Mailed FIT Outreach in the PROMPT Stepped-Wedge Colorectal Cancer Screening Trial. Cancer Epidemiol Biomarkers Prev 2024; 33:525-533. [PMID: 38319289 DOI: 10.1158/1055-9965.epi-23-0940] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 10/27/2023] [Accepted: 02/02/2024] [Indexed: 02/07/2024] Open
Abstract
BACKGROUND Mailed fecal immunochemical test (FIT) outreach can improve colorectal cancer screening participation. We assessed the reach and effectiveness of adding notifications to mailed FIT programs. METHODS We conducted secondary analyses of a stepped-wedge evaluation of an enhanced mailed FIT program (n = 15 clinics). Patients were stratified by prior FIT completion. Those with prior FIT were sent a text message (Group 1); those without were randomized 1:1 to receive a text message (Group 2) or live phone call (Group 3). All groups were sent automated phone call reminders. In stratified analysis, we measured reach and effectiveness (FIT completion within 6 months) and assessed patient-level associations using generalized estimating equations. RESULTS Patients (n = 16,934; 83% Latino; 72% completed prior FIT) were reached most often by text messages (78%), followed by live phone calls (71%), then automated phone calls (56%). FIT completion was higher in patients with prior FIT completion versus without [44% (Group 1) vs. 19% (Group 2 + Group 3); P < 0.01]. For patients without prior FIT, effectiveness was higher in those allocated to a live phone call [20% (Group 3) vs. 18% (Group 2) for text message; P = 0.04] and in those who personally answered the live call (28% vs. 9% no call completed; P < 0.01). CONCLUSIONS Text messages reached the most patients, yet effectiveness was highest in those who personally answered the live phone call. IMPACT Despite the broad reach and low cost of text messages, personalized approaches may more successfully boost FIT completion.
Collapse
Affiliation(s)
- Gloria D Coronado
- Kaiser Permanente Center for Health Research, Portland, Oregon
- University of Arizona Cancer Center, Tucson, Arizona
| | | | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, Portland, Oregon
| | | | - Anne L Escaron
- AltaMed Health Services Corporation, Los Angeles, California
| | - Tuan Pham
- AltaMed Health Services Corporation, Los Angeles, California
| | - Michael C Leo
- Kaiser Permanente Center for Health Research, Portland, Oregon
| |
Collapse
|
3
|
Maleyeff L, Wang R, Haneuse S, Li F. Sample size requirements for testing treatment effect heterogeneity in cluster randomized trials with binary outcomes. Stat Med 2023; 42:5054-5083. [PMID: 37974475 PMCID: PMC10659142 DOI: 10.1002/sim.9901] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 08/24/2023] [Accepted: 09/01/2023] [Indexed: 11/19/2023]
Abstract
Cluster randomized trials (CRTs) refer to a popular class of experiments in which randomization is carried out at the group level. While methods have been developed for planning CRTs to study the average treatment effect, and more recently, to study the heterogeneous treatment effect, the development for the latter objective has currently been limited to a continuous outcome. Despite the prevalence of binary outcomes in CRTs, determining the necessary sample size and statistical power for detecting differential treatment effects in CRTs with a binary outcome remain unclear. To address this methodological gap, we develop sample size procedures for testing treatment effect heterogeneity in two-level CRTs under a generalized linear mixed model. Closed-form sample size expressions are derived for a binary effect modifier, and in addition, a computationally efficient Monte Carlo approach is developed for a continuous effect modifier. Extensions to multiple effect modifiers are also discussed. We conduct simulations to examine the accuracy of the proposed sample size methods. We present several numerical illustrations to elucidate features of the proposed formulas and to compare our method to the approximate sample size calculation under a linear mixed model. Finally, we use data from the Strategies and Opportunities to Stop Colon Cancer in Priority Populations (STOP CRC) CRT to illustrate the proposed sample size procedure for testing treatment effect heterogeneity.
Collapse
Affiliation(s)
- Lara Maleyeff
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Massachusetts, USA
| | - Rui Wang
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Massachusetts, USA
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School Boston, Massachusetts, USA
| | - Sebastien Haneuse
- Department of Biostatistics, Harvard T. H. Chan School of Public Health, Massachusetts, USA
| | - Fan Li
- Department of Biostatistics, Yale School of Public Health, New Haven, Connecticut, USA
- Center for Methods in Implementation and Prevention Science, Yale School of Public Health, Connecticut, United States
| |
Collapse
|
4
|
Coronado GD, Nyongesa DB, Escaron AL, Petrik AF, Thompson JH, Smith D, Davis MM, Schneider JL, Rivelli JS, Laguna T, Leo MC. Effectiveness and Cost of an Enhanced Mailed Fecal Test Outreach Colorectal Cancer Screening Program: Findings from the PROMPT Stepped-Wedge Trial. Cancer Epidemiol Biomarkers Prev 2023; 32:1608-1616. [PMID: 37566431 DOI: 10.1158/1055-9965.epi-23-0597] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 07/18/2023] [Accepted: 08/09/2023] [Indexed: 08/12/2023] Open
Abstract
BACKGROUND Mailed fecal immunochemical test (FIT) outreach can improve colorectal cancer screening rates, yet little is known about how to optimize these programs for effectiveness and cost. METHODS PROMPT was a pragmatic, stepped-wedge, cluster-randomized effectiveness trial of mailed FIT outreach. Participants in the standard condition were mailed a FIT and received live telephone reminders to return it. Participants in the enhanced condition also received a tailored advance notification (text message or live phone call) and two automated phone call reminders. The primary outcome was 6-month FIT completion; secondary outcomes were any colorectal cancer screening completion at 6 months, implementation, and program costs. RESULTS The study included 27,585 participants (80% ages 50-64, 82% Hispanic/Latino; 68% preferred Spanish). A higher proportion of enhanced participants completed FIT at 6 months than standard participants, both in intention-to-treat [+2.8%, 95% confidence interval (CI; 0.4-5.2)] and per-protocol [limited to individuals who were reached; +16.9%, 95% CI (12.3-20.3)] analyses. Text messages and automated calls were successfully delivered to 91% to 100% of participants. The per-patient cost for standard mailed FIT was $10.84. The enhanced program's text message plus automated call reminder cost an additional $0.66; live phone calls plus an automated call reminder cost an additional $10.82 per patient. CONCLUSIONS Adding advance notifications and automated calls to a standard mailed FIT program boosted 6-month FIT completion rates at a small additional per-patient cost. IMPACT Enhancements to mailed FIT outreach can improve colorectal cancer screening participation. Future research might test the addition of educational video messaging for screening-naïve adults.
Collapse
Affiliation(s)
| | | | - Anne L Escaron
- AltaMed Health Services, Corporation, Los Angeles, California
| | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, Portland, Oregon
| | | | - Dave Smith
- Kaiser Permanente Center for Health Research, Portland, Oregon
| | | | | | | | - Tanya Laguna
- AltaMed Health Services, Corporation, Los Angeles, California
| | - Michael C Leo
- Kaiser Permanente Center for Health Research, Portland, Oregon
| |
Collapse
|
5
|
Staman KL, Check DK, Zatzick D, Mor V, Fritz JM, Sluka K, DeBar LL, Jarvik JG, Volandes A, Coronado GD, Chambers DA, Weinfurt KP, George SZ. Intervention delivery for embedded pragmatic clinical trials: Development of a tool to measure complexity. Contemp Clin Trials 2023; 126:107105. [PMID: 36708968 PMCID: PMC10126825 DOI: 10.1016/j.cct.2023.107105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Revised: 01/03/2023] [Accepted: 01/23/2023] [Indexed: 01/27/2023]
Abstract
BACKGROUND Conducting an embedded pragmatic clinical trial in the workflow of a healthcare system is a complex endeavor. The complexity of the intervention delivery can have implications for study planning, ability to maintain fidelity to the intervention during the trial, and/or ability to detect meaningful differences in outcomes. METHODS We conducted a literature review, developed a tool, and conducted two rounds of phone calls with NIH Pragmatic Trials Collaboratory Demonstration Project principal investigators to develop the Intervention Delivery Complexity Tool. After refining the tool, we piloted it with Collaboratory demonstration projects and developed an online version of the tool using the R Shiny application (https://duke-som.shinyapps.io/ICT-ePCT/). RESULTS The 6-item tool consists of internal and external factors. Internal factors pertain to the intervention itself and include workflow, training, and the number of intervention components. External factors are related to intervention delivery at the system level including differences in healthcare systems, the dependency on setting for implementation, and the number of steps between the intervention and the outcome. CONCLUSION The Intervention Delivery Complexity Tool was developed as a standard way to overcome communication challenges of intervention delivery within an embedded pragmatic trial. This version of the tool is most likely to be useful to the trial team and its health system partners during trial planning and conduct. We expect further evolution of the tool as more pragmatic trials are conducted and feedback is received on its performance outside of the NIH Pragmatic Trials Collaboratory.
Collapse
Affiliation(s)
- Karen L Staman
- Duke Clinical Research Institute, CHB Wordsmith, Inc, Raleigh, NC, USA
| | - Devon K Check
- Population Health Sciences and Duke Clinical Research Institute, Durham, NC, USA
| | | | | | | | | | - Lynn L DeBar
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | | | | | | | | | - Kevin P Weinfurt
- Population Health Sciences and Duke Clinical Research Institute, Durham, NC, USA
| | - Steven Z George
- Department of Orthopaedic Surgery and Duke Clinical Research Institute, Durham, NC, USA.
| |
Collapse
|
6
|
Gettel CJ, Yiadom MYA, Bernstein SL, Grudzen CR, Nath B, Li F, Hwang U, Hess EP, Melnick ER. Pragmatic clinical trial design in emergency medicine: Study considerations and design types. Acad Emerg Med 2022; 29:1247-1257. [PMID: 35475533 PMCID: PMC9790188 DOI: 10.1111/acem.14513] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 04/04/2022] [Accepted: 04/25/2022] [Indexed: 01/25/2023]
Abstract
Pragmatic clinical trials (PCTs) focus on correlation between treatment and outcomes in real-world clinical practice, yet a guide highlighting key study considerations and design types for emergency medicine investigators pursuing this important study type is not available. Investigators conducting emergency department (ED)-based PCTs face multiple decisions within the planning phase to ensure robust and meaningful study findings. The PRagmatic Explanatory Continuum Indicator Summary 2 (PRECIS-2) tool allows trialists to consider both pragmatic and explanatory components across nine domains, shaping the trial design to the purpose intended by the investigators. Aside from the PRECIS-2 tool domains, ED-based investigators conducting PCTs should also consider randomization techniques, human subjects concerns, and integration of trial components within the electronic health record. The authors additionally highlight the advantages, disadvantages, and rationale for the use of four common randomized study design types to be considered in PCTs: parallel, crossover, factorial, and stepped-wedge. With increasing emphasis on the conduct of PCTs, emergency medicine investigators will benefit from a rigorous approach to clinical trial design.
Collapse
Affiliation(s)
- Cameron J. Gettel
- Department of Emergency Medicine, Yale School of Medicine, New Haven, CT, USA
- Center for Outcomes Research and Evaluation, Yale School of Medicine, New Haven, CT, USA
| | - Maame Yaa A.B. Yiadom
- Department of Emergency Medicine, Stanford University School of Medicine, Stanford, CA, USA
| | | | - Corita R. Grudzen
- Ronald O. Perelman Department of Emergency Medicine and Department of Population Health, New York University Grossman School of Medicine, New York, NY, USA
| | - Bidisha Nath
- Department of Emergency Medicine, Yale School of Medicine, New Haven, CT, USA
| | - Fan Li
- Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA
| | - Ula Hwang
- Department of Emergency Medicine, Yale School of Medicine, New Haven, CT, USA
- Geriatrics Research, Education and Clinical Center, James J. Peters VA Medical Center, Bronx, NY, USA
| | - Erik P. Hess
- Department of Emergency Medicine, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - Edward R. Melnick
- Department of Emergency Medicine, Yale School of Medicine, New Haven, CT, USA
- Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA
| |
Collapse
|
7
|
Coronado GD, Leo MC, Ramsey K, Coury J, Petrik AF, Patzel M, Kenzie ES, Thompson JH, Brodt E, Mummadi R, Elder N, Davis MM. Mailed fecal testing and patient navigation versus usual care to improve rates of colorectal cancer screening and follow-up colonoscopy in rural Medicaid enrollees: a cluster-randomized controlled trial. Implement Sci Commun 2022; 3:42. [PMID: 35418107 PMCID: PMC9006522 DOI: 10.1186/s43058-022-00285-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 03/19/2022] [Indexed: 11/23/2022] Open
Abstract
Background Screening reduces incidence and mortality from colorectal cancer (CRC), yet US screening rates are low, particularly among Medicaid enrollees in rural communities. We describe a two-phase project, SMARTER CRC, designed to achieve the National Cancer Institute Cancer MoonshotSM objectives by reducing the burden of CRC on the US population. Specifically, SMARTER CRC aims to test the implementation, effectiveness, and maintenance of a mailed fecal test and patient navigation program to improve rates of CRC screening, follow-up colonoscopy, and referral to care in clinics serving rural Medicaid enrollees. Methods Phase I activities in SMARTER CRC include a two-arm cluster-randomized controlled trial of a mailed fecal test and patient navigation program involving three Medicaid health plans and 30 rural primary care practices in Oregon and Idaho; the implementation of the program is supported by training and practice facilitation. Participating clinic units were randomized 1:1 into the intervention or usual care. The intervention combines (1) mailed fecal testing outreach supported by clinics, health plans, and vendors and (2) patient navigation for colonoscopy following an abnormal fecal test result. We will evaluate the effectiveness, implementation, and maintenance of the intervention and track adaptations to the intervention and to implementation strategies, using quantitative and qualitative methods. Our primary effectiveness outcome is receipt of any CRC screening within 6 months of enrollee identification. Our primary implementation outcome is health plan- and clinic-level rates of program delivery, by component (mailed FIT and patient navigation). Trial results will inform phase II activities to scale up the program through partnerships with health plans, primary care clinics, and regional and national organizations that serve rural primary care clinics; scale-up will include webinars, train-the-trainer workshops, and collaborative learning activities. Discussion This study will test the implementation, effectiveness, and scale-up of a multi-component mailed fecal testing and patient navigation program to improve CRC screening rates in rural Medicaid enrollees. Our findings may inform approaches for adapting and scaling evidence-based approaches to promote CRC screening participation in underserved populations and settings. Trial registration Registered at clinicaltrial.gov (NCT04890054) and at the NCI’s Clinical Trials Reporting Program (CTRP #: NCI-2021-01032) on May 11, 2021.
Collapse
Affiliation(s)
- Gloria D Coronado
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave, Portland, OR, 97227, USA.
| | - Michael C Leo
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave, Portland, OR, 97227, USA
| | - Katrina Ramsey
- Oregon Rural Practice-Based Research Network, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA.,OHSU Biostatistics and Design Program, 3181 S.W. Sam Jackson Park Road, Mail code: CB669, Portland, OR, 97239-3098, USA
| | - Jennifer Coury
- Oregon Rural Practice-Based Research Network, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA
| | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave, Portland, OR, 97227, USA
| | - Mary Patzel
- Oregon Rural Practice-Based Research Network, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA
| | - Erin S Kenzie
- Oregon Rural Practice-Based Research Network, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA
| | - Jamie H Thompson
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave, Portland, OR, 97227, USA
| | - Erik Brodt
- OHSU Family Medicine, OHSU School of Medicine, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA
| | - Raj Mummadi
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave, Portland, OR, 97227, USA
| | - Nancy Elder
- Oregon Rural Practice-Based Research Network, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA.,OHSU Family Medicine, OHSU School of Medicine, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA
| | - Melinda M Davis
- Oregon Rural Practice-Based Research Network, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA.,OHSU Family Medicine, OHSU School of Medicine, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA.,OHSU-PSU School of Public Health, 3181 S.W. Sam Jackson Park Road, Mail code: L222, Portland, OR, 97239-3098, USA
| |
Collapse
|
8
|
Wang X, Turner EL, Li F, Wang R, Moyer J, Cook AJ, Murray DM, Heagerty PJ. Two weights make a wrong: Cluster randomized trials with variable cluster sizes and heterogeneous treatment effects. Contemp Clin Trials 2022; 114:106702. [PMID: 35123029 PMCID: PMC8936048 DOI: 10.1016/j.cct.2022.106702] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 01/21/2022] [Accepted: 01/27/2022] [Indexed: 11/30/2022]
Abstract
In cluster randomized trials (CRTs), the hierarchical nesting of participants (level 1) within clusters (level 2) leads to two conceptual populations: clusters and participants. When cluster sizes vary and the goal is to generalize to a hypothetical population of clusters, the unit average treatment effect (UATE), which averages equally at the cluster level rather than equally at the participant level, is a common estimand of interest. From an analytic perspective, when a generalized estimating equations (GEE) framework is used to obtain averaged treatment effect estimates for CRTs with variable cluster sizes, it is natural to specify an inverse cluster size weighted analysis so that each cluster contributes equally and to adopt an exchangeable working correlation matrix to account for within-cluster correlation. However, such an approach essentially uses two distinct weights in the analysis (i.e. both cluster size weights and covariance weights) and, in this article, we caution that it will lead to biased and/or inefficient treatment effect estimates for the UATE estimand. That is, two weights "make a wrong" or lead to poor estimation characteristics. These findings are based on theoretical derivations, corroborated via a simulation study, and illustrated using data from a CRT of a colorectal cancer screening program. We show that, an analysis with both an independence working correlation matrix and weighting by inverse cluster size is the only approach that always provides valid results for estimation of the UATE in CRTs with variable cluster sizes.
Collapse
Affiliation(s)
- Xueqi Wang
- Department of Biostatistics & Bioinformatics and Duke Global Health Institute, Duke University School of Medicine, Durham, NC, USA.
| | - Elizabeth L. Turner
- Department of Biostatistics & Bioinformatics and Duke Global Health Institute, Duke University School of Medicine, Durham, NC, USA
| | - Fan Li
- Department of Biostatistics and Center for Methods in Implementation & Prevention Science, Yale University School of Public Health, New Haven, CT, USA.
| | - Rui Wang
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, MA, USA; Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, MA, USA.
| | - Jonathan Moyer
- Office of Disease Prevention, National Institutes of Health, Bethesda, MD, USA.
| | - Andrea J. Cook
- Biostatistics Unit, Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA,Department of Biostatistics, University of Washington, Seattle, WA, USA
| | - David M. Murray
- Office of Disease Prevention, National Institutes of Health, Bethesda, MD, USA
| | | |
Collapse
|
9
|
Coury JK, Schneider JL, Green BB, Baldwin LM, Petrik AF, Rivelli JS, Schwartz MR, Coronado GD. Two Medicaid health plans' models and motivations for improving colorectal cancer screening rates. Transl Behav Med 2021; 10:68-77. [PMID: 30445511 DOI: 10.1093/tbm/iby094] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022] Open
Abstract
Screening rates for colorectal cancer (CRC) remain low, especially among certain populations. Mailed fecal immunochemical testing (FIT) outreach initiated by U.S. health plans could reach underserved individuals, while solving CRC screening data and implementation challenges faced by health clinics. We report the models and motivations of two health insurance plans implementing a mailed FIT program for age-eligible U.S. Medicaid and Medicare populations. One health plan operates in a single state with ~220,000 enrollees; the other operates in multiple states with ~2 million enrollees. We conducted in-depth qualitative interviews with key stakeholders and observed leadership and clinic staff planning during program development and implementation. Interviews were transcribed and coded using a content analysis approach; coded interview reports and meeting minutes were iteratively reviewed and summarized for themes. Between June and September 2016, nine participants were identified, and all agreed to the interview. Interviews revealed that organizational context was important to both organizations and helped shape program design. Both organizations were hoping this program would address barriers to their prior CRC screening improvement efforts and saw CRC screening as a priority. Despite similar motivations to participate in a mailed FIT intervention, contextual features of the health plans led them to develop distinct implementation models: a collaborative model using some health clinic staffing versus a centralized model operationalizing outreach primarily at the health plan. Data are not yet available on the models' effectiveness. Our findings might help inform the design of programs to deliver mailed FIT outreach.
Collapse
Affiliation(s)
| | - Jennifer L Schneider
- Kaiser Permanente, Center for Health Research, Science Department, Portland, OR, USA
| | - Beverly B Green
- Kaiser Permanente Washington Health Research Institute, Science Department, Seattle, WA, USA
| | - Laura-Mae Baldwin
- University of Washington, Department of Family Medicine, Seattle, WA, USA
| | - Amanda F Petrik
- Kaiser Permanente, Center for Health Research, Science Department, Portland, OR, USA
| | - Jennifer S Rivelli
- Kaiser Permanente, Center for Health Research, Science Department, Portland, OR, USA
| | - Malaika R Schwartz
- University of Washington, Department of Family Medicine, Seattle, WA, USA
| | - Gloria D Coronado
- Kaiser Permanente, Center for Health Research, Science Department, Portland, OR, USA
| |
Collapse
|
10
|
Li F, Tong G. Sample size estimation for modified Poisson analysis of cluster randomized trials with a binary outcome. Stat Methods Med Res 2021; 30:1288-1305. [PMID: 33826454 PMCID: PMC9132618 DOI: 10.1177/0962280221990415] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
The modified Poisson regression coupled with a robust sandwich variance has become a viable alternative to log-binomial regression for estimating the marginal relative risk in cluster randomized trials. However, a corresponding sample size formula for relative risk regression via the modified Poisson model is currently not available for cluster randomized trials. Through analytical derivations, we show that there is no loss of asymptotic efficiency for estimating the marginal relative risk via the modified Poisson regression relative to the log-binomial regression. This finding holds both under the independence working correlation and under the exchangeable working correlation provided a simple modification is used to obtain the consistent intraclass correlation coefficient estimate. Therefore, the sample size formulas developed for log-binomial regression naturally apply to the modified Poisson regression in cluster randomized trials. We further extend the sample size formulas to accommodate variable cluster sizes. An extensive Monte Carlo simulation study is carried out to validate the proposed formulas. We find that the proposed formulas have satisfactory performance across a range of cluster size variability, as long as suitable finite-sample corrections are applied to the sandwich variance estimator and the number of clusters is at least 10. Our findings also suggest that the sample size estimate under the exchangeable working correlation is more robust to cluster size variability, and recommend the use of an exchangeable working correlation over an independence working correlation for both design and analysis. The proposed sample size formulas are illustrated using the Stop Colorectal Cancer (STOP CRC) trial.
Collapse
Affiliation(s)
- Fan Li
- Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA
- Center for Methods in Implementation and Preventive Science, Yale University, New Haven, CT, USA
- Yale Center for Analytical Sciences, Yale University, New Haven, CT, USA
| | - Guangyu Tong
- Department of Biostatistics, Yale School of Public Health, New Haven, CT, USA
- Yale Center for Analytical Sciences, Yale University, New Haven, CT, USA
| |
Collapse
|
11
|
Coronado GD, Nielson CM, Keast EM, Petrik AF, Suls JM. The influence of multi-morbidities on colorectal cancer screening recommendations and completion. Cancer Causes Control 2021; 32:555-565. [PMID: 33687606 DOI: 10.1007/s10552-021-01408-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Accepted: 02/23/2021] [Indexed: 11/29/2022]
Abstract
PURPOSE Patients' chronic disease burden can influence the likelihood that providers will recommend cancer screening and that patients will participate in it. Using data from the STOP CRC pragmatic study, we examined associations between chronic disease burden and colorectal cancer screening recommendation and use. METHODS Participating STOP CRC clinics (n = 26) received either usual care or training to implement a mailed fecal immunochemical test (FIT) outreach program. Selected clinic patients (n = 60,187 patients) were aged 50-74 and overdue for colorectal cancer screening. We used logistic regression to examine the associations between FIT recommendations and completion and patients' chronic disease burden, calculated using the Charlson Comorbidity Index and the Chronic Illness and Disability Payment System. RESULTS For each index, FIT recommendation odds were 8-9% higher among individuals with minimal chronic disease burden and 13-23% lower among individuals with high chronic disease burden (inverted U-shaped association). Among adults who were ordered a FIT, FIT completion odds were 20% lower for individuals with any, versus no, chronic condition and diminished with increasing disease burden (inverse linear association). CONCLUSIONS Analysis showed an inverted U-shaped association between patients' chronic disease burden and providers' recommendation of a FIT and an inverse linear association between patients' chronic disease burden and FIT completion. ClinicalTrials.gov registration: NCT01742065.
Collapse
Affiliation(s)
- Gloria D Coronado
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA.
| | - Carrie M Nielson
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Erin M Keast
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Jerry M Suls
- Center for Personalized Health, Feinstein Institute for Medical Research, New York, NY, 10022, USA
| |
Collapse
|
12
|
Petrik AF, Keast E, Johnson ES, Smith DH, Coronado GD. Development of a multivariable prediction model to identify patients unlikely to complete a colonoscopy following an abnormal FIT test in community clinics. BMC Health Serv Res 2020; 20:1028. [PMID: 33172444 PMCID: PMC7654150 DOI: 10.1186/s12913-020-05883-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2019] [Accepted: 10/31/2020] [Indexed: 12/23/2022] Open
Abstract
Background Colorectal cancer (CRC) is the 3rd leading cancer killer among men and women in the US. The Strategies and Opportunities to STOP Colon Cancer in Priority Populations (STOP CRC) project aimed to increase CRC screening among patients in Federally Qualified Health Centers (FQHCs) through a mailed fecal immunochemical test (FIT) outreach program. However, rates of completion of the follow-up colonoscopy following an abnormal FIT remain low. We developed a multivariable prediction model using data available in the electronic health record to assess the probability of patients obtaining a colonoscopy following an abnormal FIT test. Methods To assess the probability of obtaining a colonoscopy, we used Cox regression to develop a risk prediction model among a retrospective cohort of patients with an abnormal FIT result. Results Of 1596 patients with an abnormal FIT result, 556 (34.8%) had a recorded colonoscopy within 6 months. The model shows an adequate separation of patients across risk levels for non-adherence to follow-up colonoscopy (bootstrap-corrected C-statistic > 0.63). The refined model included 8 variables: age, race, insurance, GINI income inequality, long-term anticoagulant use, receipt of a flu vaccine in the past year, frequency of missed clinic appointments, and clinic site. The probability of obtaining a follow-up colonoscopy within 6 months varied across quintiles; patients in the lowest quintile had an estimated 18% chance, whereas patients in the top quintile had a greater than 55% chance of obtaining a follow-up colonoscopy. Conclusions Knowing who is unlikely to follow-up on an abnormal FIT test could help identify patients who need an early intervention aimed at completing a follow-up colonoscopy. Trial registration This trial was registered at ClinicalTrials.gov (NCT01742065) on December 5, 2012. The protocol is available. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-020-05883-2.
Collapse
Affiliation(s)
- Amanda F Petrik
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Avenue, Portland, OR, 97381, USA.
| | - Erin Keast
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Avenue, Portland, OR, 97381, USA
| | - Eric S Johnson
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Avenue, Portland, OR, 97381, USA
| | - David H Smith
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Avenue, Portland, OR, 97381, USA
| | - Gloria D Coronado
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Avenue, Portland, OR, 97381, USA
| |
Collapse
|
13
|
Hill JE, Stephani AM, Sapple P, Clegg AJ. The effectiveness of continuous quality improvement for developing professional practice and improving health care outcomes: a systematic review. Implement Sci 2020; 15:23. [PMID: 32306984 PMCID: PMC7168964 DOI: 10.1186/s13012-020-0975-2] [Citation(s) in RCA: 69] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Accepted: 02/19/2020] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND Efforts to improve the quality, safety, and efficiency of health care provision have often focused on changing approaches to the way services are organized and delivered. Continuous quality improvement (CQI), an approach used extensively in industrial and manufacturing sectors, has been used in the health sector. Despite the attention given to CQI, uncertainties remain as to its effectiveness given the complex and diverse nature of health systems. This review assesses the effectiveness of CQI across different health care settings, investigating the importance of different components of the approach. METHODS We searched 11 electronic databases: MEDLINE, CINAHL, EMBASE, AMED, Academic Search Complete, HMIC, Web of Science, PsycINFO, Cochrane Central Register of Controlled Trials, LISTA, and NHS EED to February 2019. Also, we searched reference lists of included studies and systematic reviews, as well as checking published protocols for linked papers. We selected randomized controlled trials (RCTs) within health care settings involving teams of health professionals, evaluating the effectiveness of CQI. Comparators included current usual practice or different strategies to manage organizational change. Outcomes were health care professional performance or patient outcomes. Studies were published in English. RESULTS Twenty-eight RCTs assessed the effectiveness of different approaches to CQI with a non-CQI comparator in various settings, with interventions differing in terms of the approaches used, their duration, meetings held, people involved, and training provided. All RCTs were considered at risk of bias, undermining their results. Findings suggested that the benefits of CQI compared to a non-CQI comparator on clinical process, patient, and other outcomes were limited, with less than half of RCTs showing any effect. Where benefits were evident, it was usually on clinical process measures, with the model used (i.e., Plan-Do-Study-Act, Model of Improvement), the meeting type (i.e., involving leaders discussing implementation) and their frequency (i.e., weekly) having an effect. None considered socio-economic health inequalities. CONCLUSIONS Current evidence suggests the benefits of CQI in improving health care are uncertain, reflecting both the poor quality of evaluations and the complexities of health services themselves. Further mixed-methods evaluations are needed to understand how the health service can use this proven approach. TRIAL REGISTRATION Protocol registered on PROSPERO (CRD42018088309).
Collapse
Affiliation(s)
- James E. Hill
- Faculty of Health and Wellbeing, University of Central Lancashire (UCLan), Preston, Lancashire PR1 2HE UK
| | - Anne-Marie Stephani
- Faculty of Health and Wellbeing, University of Central Lancashire (UCLan), Preston, Lancashire PR1 2HE UK
| | | | - Andrew J. Clegg
- Faculty of Health and Wellbeing, University of Central Lancashire (UCLan), Preston, Lancashire PR1 2HE UK
| |
Collapse
|
14
|
O'Connor EA, Nielson CM, Petrik AF, Green BB, Coronado GD. Prospective Cohort study of Predictors of Follow-Up Diagnostic Colonoscopy from a Pragmatic Trial of FIT Screening. Sci Rep 2020; 10:2441. [PMID: 32051454 PMCID: PMC7016148 DOI: 10.1038/s41598-020-59032-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Accepted: 01/23/2020] [Indexed: 01/18/2023] Open
Abstract
The goal of this study was to explore diagnostic colonoscopy completion in adults with abnormal screening fecal immunochemical test (FIT) results. This was a secondary analysis of the Strategies and Opportunities to Stop Colon Cancer in Priority Populations (Stop CRC) study, a cluster-randomized pragmatic trial to increase uptake of CRC screening in federally qualified community health clinics. Diagnostic colonoscopy completion and reasons for non-completion were ascertained through a manual review of electronic health records, and completion was compared across a wide range of individual patient health and sociodemographic characteristics. Among 2,018 adults with an abnormal FIT result, 1066 (52.8%) completed a follow-up colonoscopy within 12 months. Completion was generally similar across a wide range of participant subpopulations; however, completion was higher for participants who were younger, Hispanic, Spanish-speaking, and had zero or one of the Charlson medical comorbidities, compared to their counterparts. Neighborhood-level predictors were not associated with diagnostic colonoscopy completion. Thus, completion of a diagnostic colonoscopy was relatively low in a large sample of community health clinic adults who had an abnormal screening FIT result. While completion was generally similar across a wide range of characteristics, younger, healthier, Hispanic participants tended to have a higher likelihood of completion.
Collapse
Affiliation(s)
- Elizabeth A O'Connor
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA. Elizabeth.O'
| | - Carrie M Nielson
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Beverly B Green
- Kaiser Permanente Washington Health Research Institute, 1730 Minor Avenue, Suite 1600, Seattle, WA, 98101, USA
| | - Gloria D Coronado
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| |
Collapse
|
15
|
O'Connor EA, Vollmer WM, Petrik AF, Green BB, Coronado GD. Moderators of the effectiveness of an intervention to increase colorectal cancer screening through mailed fecal immunochemical test kits: results from a pragmatic randomized trial. Trials 2020; 21:91. [PMID: 31941527 PMCID: PMC6964086 DOI: 10.1186/s13063-019-4027-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Accepted: 12/23/2019] [Indexed: 12/16/2022] Open
Abstract
Background Colorectal cancer (CRC) screening rates remain suboptimal, particularly in low-income and underserved populations. Mailed fecal immunochemical testing (FIT) may overcome common barriers to screening; however, the effect of mailed FIT kits may differ across important subpopulations. The goal of the current study was to examine sociodemographic and health-related factors that moderate the effect of an intervention of automated direct mail of FIT kits at health clinics serving low-income populations. Methods This study is a secondary analysis of the Strategies and Opportunities to Stop Colon Cancer in Priority Populations (STOP CRC) study, a cluster-randomized pragmatic trial to increase uptake of CRC screening in patients seen at federally qualified health centers. The intervention involved tools embedded in the electronic medical records to enable participating clinics to mail FIT kits and related materials to eligible participants. We examined the rate of FIT completion by potential moderating characteristics using electronic health record data supplemented by the American Community Survey and the Centers for Medicare & Medicaid Services Geographic Variation datasets, linked via geocoding to patients’ addresses. All patients aged 50–75 seen in participating health clinics who were eligible for CRC screening were included. Results Although not always statistically significant, we saw a consistent pattern of increased FIT return rates among intervention participants compared to control participants across all subgroups studied, with incidence rate ratios (IRRs) generally ranging from 1.25 to 1.50. FIT completion in the intervention group ranged from 15 and 20% across subpopulations, typically three to six percentage points higher than the control group participants. The only moderator with a statistically significant interaction was race: persons of Asian descent showed a twofold response to the intervention (adjusted incidence rate ratio [aIRR] = 2.06, 95% confidence interval 1.41 to 3.00). Conclusions Response to a mailed FIT intervention was generally consistent across a wide range of individual and neighborhood-level patient characteristics, including typically underserved patients and those in low-resource communities. Trial registration ClinicalTrials.gov, NCT01742065. Registered on 5 December 2012.
Collapse
Affiliation(s)
- Elizabeth A O'Connor
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA.
| | - William M Vollmer
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| | - Beverly B Green
- Kaiser Permanente Washington Health Research Institute, 1730 Minor Avenue, Suite, Seattle, WA, 1600, USA
| | - Gloria D Coronado
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Avenue, Portland, OR, 97227, USA
| |
Collapse
|
16
|
Curtis LH, Dember LM, Vazquez MA, Murray D, DeBar L, Staman KL, Septimus E, Mor V, Volandes A, Wells BL, Huang SS, Green BB, Coronado G, Meyers CM, Tuzzio L, Hernandez AF, Sugarman J. Addressing guideline and policy changes during pragmatic clinical trials. Clin Trials 2019; 16:431-437. [PMID: 31084378 PMCID: PMC6663617 DOI: 10.1177/1740774519845682] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
While conducting a set of large-scale multi-site pragmatic clinical trials involving high-impact public health issues such as end-stage renal disease, opioid use, and colorectal cancer, there were substantial changes to both policies and guidelines relevant to the trials. These external changes gave rise to unexpected challenges for the trials, including decisions regarding how to respond to new clinical practice guidelines, increased difficulty in implementing trial interventions, achieving separation between treatment groups, and differential responses across sites. In this article, we describe these challenges and the approaches used to address them. When deliberating appropriate action in the face of external changes during a pragmatic clinical trial, we recommend considering the well-being of the participants, clinical equipoise, and the strength and quality of the evidence associated with the change; involving those charged with data and safety monitoring; and where possible, planning for potential external changes as the trial is being designed. Any solution must balance the primary obligation to protect the well-being of participants with the secondary obligation to protect the integrity of the trial in order to gain meaningful answers to important public health questions.
Collapse
Affiliation(s)
- Lesley H Curtis
- Lesley Curtis, PhD, (Corresponding Author) Duke University School of Medicine, 2200 West Main Street, Suite 720-A, Erwin Square Building, Durham, NC 27705, USA , Phone: (919) 681-6709
| | - Laura M Dember
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Miguel A Vazquez
- University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - David Murray
- National Institutes of Health, Bethesda, MD, USA
| | - Lynn DeBar
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | | | - Edward Septimus
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA, USA
| | - Vincent Mor
- Department of Health Services, Policy & Practice, Brown University School of Public Health and Providence Veterans Administration Medical Center, Providence, RI, USA
| | | | - Barbara L Wells
- Division of Cardiovascular Sciences, NHLBI, NIH, Bethesda, MD, USA
| | - Susan S Huang
- University of California Irvine School of Medicine, Irvine, CA, USA
| | - Beverly B. Green
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Gloria Coronado
- Kaiser Permanente Center for Health Research, Portland, OR, USA
| | - Catherine M Meyers
- Office of Clinical and Regulatory Affairs, National Center for Complementary and Integrative Health (NCCIH), Bethesda, MD, USA
| | - Leah Tuzzio
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Adrian F Hernandez
- Lesley Curtis, PhD, (Corresponding Author) Duke University School of Medicine, 2200 West Main Street, Suite 720-A, Erwin Square Building, Durham, NC 27705, USA , Phone: (919) 681-6709
| | - Jeremy Sugarman
- Berman Institute of Bioethics and Department of Medicine, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
17
|
Nielson CM, Vollmer WM, Petrik AF, Keast EM, Green BB, Coronado GD. Factors Affecting Adherence in a Pragmatic Trial of Annual Fecal Immunochemical Testing for Colorectal Cancer. J Gen Intern Med 2019; 34:978-985. [PMID: 30684199 PMCID: PMC6544723 DOI: 10.1007/s11606-018-4820-0] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Revised: 09/27/2018] [Accepted: 11/27/2018] [Indexed: 01/20/2023]
Abstract
BACKGROUND Colorectal cancer screening by fecal immunochemical test (FIT) reduces the burden of colorectal cancer. However, effectiveness relies on annual adherence, which presents challenges for clinic staff and patients. OBJECTIVE Describe FIT return rates and identify factors associated with FIT adherence over 2 years in a mailed FIT outreach program in federally qualified health centers. DESIGN Observational study nested in the Strategies and Opportunities to Stop Colon Cancer in Priority Populations (STOP CRC) trial. Five thousand one hundred ninety-five patients had an initial FIT order and were followed for ≥ 2 years (3574 also had a FIT order in the second year). MAIN MEASURES FIT return percent in each year and patient- and neighborhood-level characteristics associated with FIT adherence. KEY RESULTS Overall, the proportion of FIT orders that were completed was 46% in the patients' first year and 41% in the patients' second year. Of the 5195 patients with a FIT order in year 1, 3574 (69%) also had a FIT order in year 2 (71% of year 1 adherers and 67% of year 1 non-adherers, p = 0.009). Among those with a FIT order in the second year, the FIT return rate was about twice as high among those who were adherent in the first year (952/1674, or 57%) as among those who were not (531/1900, or 28%, p < 0.0001). Patient-level characteristics associated with higher odds of FIT return were a history of FIT screening at baseline, age over 65 (vs 50-65), no current tobacco use, recent receipt of a mammogram or flu vaccine, Asian ancestry (compared to non-Hispanic white), and non-English preference. The only neighborhood factor associated with lower FIT return rate was patient's larger residential city size. CONCLUSION Our findings can inform the customization of programs to promote FIT return among patients who receive care at federally qualified health centers. TRIAL REGISTRATION http://www.clinicaltrials.gov.
Collapse
Affiliation(s)
- Carrie M Nielson
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - William M Vollmer
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - Amanda F Petrik
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - Erin M Keast
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - Beverly B Green
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Gloria D Coronado
- Kaiser Permanente Center for Health Research, 3800 N. Interstate Ave., Portland, OR, 97227, USA.
| |
Collapse
|
18
|
Developing Patient-Refined Messaging for a Mailed Colorectal Cancer Screening Program in a Latino-Based Community Health Center. J Am Board Fam Med 2019; 32:307-317. [PMID: 31068395 PMCID: PMC7254880 DOI: 10.3122/jabfm.2019.03.180026] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2018] [Revised: 07/25/2018] [Accepted: 07/30/2018] [Indexed: 01/22/2023] Open
Abstract
INTRODUCTION Colon cancer is the second leading cause of cancer death in the United States, and screening rates are disproportionately low among Latinos. One factor thought to contribute to the low screening rate is the difficulty Latinos encounter in understanding health information, and therefore in taking appropriate health action. Therefore, we used Boot Camp Translation (BCT), a patient engagement approach, to engage Latino stakeholders (ie, patients, clinic staff) in refining the messages and format of colon cancer screening reminders for a clinic-based direct mail fecal immunochemical testing (FIT) program. METHODS Patient participants were Latino, ages 50 to 75 years, able to speak English or Spanish, and willing to participate in the in-person kickoff meeting and follow-up phone calls over a 3-month period. We held separate BCT sessions for English- and Spanish-speaking participants. As part of the in-person meetings, a bilingual colon cancer expert presented on colon health and screening messages and BCT facilitators led interactive sessions where participants reviewed materials and reminder messages in various modalities (eg, letter, text). Participants considered what information about colon cancer screening was important, the best methods to share these messages, and the timing and frequency with which these messages should be delivered to patients to encourage FIT completion. We used follow-up phone calls to iteratively refine materials developed based on key learnings from the in-person meeting. RESULTS Twenty-five adults participated in the in-person sessions (English [n = 12]; Spanish [n = 13]). Patient participants were primarily enrolled in Medicaid/uninsured (76%) and had annual household incomes less than $20,000 (67%). Key themes distilled from the sessions included increasing awareness that screening can prevent colon cancer, stressing the urgency of screening, emphasizing the motivating influence of family, and using personalized messages from the practice such as 'I' or 'we' statements in letters or automated phone call reminders delivered by humans. Participants in both sessions noted the importance of receiving an automated or live alert before a FIT kit is mailed and a reminder within 2 weeks of FIT kit mailing. DISCUSSION Using BCT, we successfully incorporated participant feedback to adapt culturally relevant health messages to promote FIT testing among Latino patients served by community clinics. Materials will be tested in the larger Participatory Research to Advance Colon Cancer Prevention (PROMPT) trial.
Collapse
|
19
|
Patient-Refined Messaging for a Mailed Colorectal Cancer Screening Program: Findings from the PROMPT Study. J Am Board Fam Med 2019; 32:318-328. [PMID: 31068396 PMCID: PMC7331468 DOI: 10.3122/jabfm.2019.03.180275] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Revised: 01/31/2019] [Accepted: 02/01/2019] [Indexed: 01/13/2023] Open
Abstract
BACKGROUND Improving uptake of colorectal cancer screening has the potential of saving thousands of lives. We compared the effectiveness of automated and live prompts and reminders as part of a mailed fecal immunochemical test (FIT) outreach program. DESIGN AND METHODS Participants were 1767 adults aged 50 to 75 eyars who were not up-to-date with colorectal cancer screening recommendations at a participating community health center clinic. In addition to a mailed FIT kit, participants were randomized to receive (1) a text message prompt and 2 automated phone call reminders (automated condition); (2) up to 3 live call reminders (live condition); or (3) a text message prompt, 2 automated call reminders, and up to 3 live reminders (combined automated plus live condition). We assessed FIT completion rates in each group 6 months following randomization. KEY RESULTS Nearly one-third of participants completed an FIT within 6 months. Compared with adults allocated to the automated condition, FIT completion rates were higher in adults allocated to the live condition (32.3% vs 26.0%; adjusted difference, 6.3 percentage points; 95% CI, 1.1-11.4) and in adults allocated to the combined automated plus live condition (35.7% vs 26.0%; adjusted difference, 9.7 percentage points; 95% CI, 4.4-14.9). The number of kits needed to mail to achieve a completed FIT ranged from 2.8 in the combined automated plus live condition to 3.8 in the automated condition. CONCLUSIONS Among unscreened individuals in this population, live phone call reminders either alone or in combination with automated prompts and reminders outperformed automated approaches alone.
Collapse
|
20
|
Tuzzio L, Larson EB, Chambers DA, Coronado GD, Curtis LH, Weber WJ, Zatzick DF, Meyers CM. Pragmatic clinical trials offer unique opportunities for disseminating, implementing, and sustaining evidence-based practices into clinical care: Proceedings of a workshop. HEALTHCARE (AMSTERDAM, NETHERLANDS) 2019; 7:51-57. [PMID: 30594497 PMCID: PMC6557660 DOI: 10.1016/j.hjdsi.2018.12.003] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2018] [Revised: 12/11/2018] [Accepted: 12/19/2018] [Indexed: 11/21/2022]
Abstract
The National Institutes of Health (NIH) Health Care Systems (HCS) Research Collaboratory hosted a workshop to explore challenges and strategies for the dissemination, implementation, and sustainability of findings from pragmatic clinical trials (PCTs) embedded in HCS. PCTs are designed to assess the impact of interventions delivered in usual or real-world conditions and leverage existing infrastructure to answer important clinical questions. The goal of the workshop was to discuss strategies for conducting impactful future PCTs that bridge the gap between evidence, practice, and policy. This paper summarizes presentations about how to design and conduct PCTs embedded in HCS and use dissemination and implementation strategies during the planning and conduct of projects, emphasizing the ever-changing world of care delivery and the need for pragmatic trial operations to adapt at various levels of operation.
Collapse
|
21
|
Meenan RT, Coronado GD, Petrik A, Green BB. A cost-effectiveness analysis of a colorectal cancer screening program in safety net clinics. Prev Med 2019; 120:119-125. [PMID: 30685318 PMCID: PMC6392039 DOI: 10.1016/j.ypmed.2019.01.014] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Revised: 01/17/2019] [Accepted: 01/23/2019] [Indexed: 11/29/2022]
Abstract
STOP CRC is a cluster-randomized pragmatic study of a colorectal cancer (CRC) screening program within eight federally-qualified health centers (FQHCs) in Oregon and California promoting fecal immunochemical testing (FIT) with appropriate colonoscopy follow-up. Results are presented of a cost-effectiveness analysis of STOP CRC. Organization staff completed activity-based costing spreadsheets, assigning labor hours by intervention activity and job-specific wage rates. Non-labor costs were from study data. Data were collected over February 2014-February 2016; analyses were performed in 2016-2017. Incremental cost-effectiveness ratios (ICERs) using completed FITs adjusted for number of screening-eligible patients (SEPs), as the effectiveness measure were calculated overall and by organization. Intervention delivery costs totaled $305 K across eight organizations (range: $10.2 K-$110 K). Overall delivery cost per SEP was $14.43 (range: $10.37-$19.10). The largest cost category across organizations was implementation, specifically mailing preparation. The overall ICER was $483 per SEP-adjusted completed FIT (range: $96-$1021 among organizations with positive effectiveness). Lagged data accounting for implementation delay produced comparable results. The costs of colonoscopies following abnormal FITs decreased the overall ICER to S409 because usual care clinics generated more such colonoscopies than intervention clinics. Using lagged data, follow-up colonoscopies increase the ICER by 4.3% to $460. Results indicate the complex implications for cost-effectiveness of implementing standard CRC screening within a pragmatic setting involving FQHCs with varied patient populations, clinical structures, and resources. Performance variation across organizations emphasizes the need for future evaluations that inform the introduction of efficient CRC screening to underserved populations.
Collapse
Affiliation(s)
- Richard T Meenan
- Kaiser Permanente Center for Health Research, 3800 N Interstate Ave, Portland, OR 97227, USA.
| | - Gloria D Coronado
- Kaiser Permanente Center for Health Research, 3800 N Interstate Ave, Portland, OR 97227, USA
| | - Amanda Petrik
- Kaiser Permanente Center for Health Research, 3800 N Interstate Ave, Portland, OR 97227, USA
| | - Beverly B Green
- Kaiser Permanente Washington Health Research Institute, 1730 Minor Ave, Seattle, WA 98101, USA
| |
Collapse
|
22
|
Predictors of Colorectal Cancer Screening Prior to Implementation of a Large Pragmatic Trial in Federally Qualified Health Centers. J Community Health 2019; 43:128-136. [PMID: 28744716 DOI: 10.1007/s10900-017-0395-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Colorectal cancer screening can prevent cancer deaths. Federally qualified health centers serve a unique patient population that often is not screened. Knowing who in this environment is getting screened via fecal testing and via colonoscopy can assist in tailoring intervention to raise rates of colorectal cancer screening. We examined patient-level and neighborhood-level characteristics associated with being up to date with colorectal cancer screening guidelines. We also examined associations between these factors and being screened with a fecal test. We observed an increase in colorectal cancer screening rates from 2010 to 2015. Adjusted analyses revealed that the following factors were significantly associated with colorectal cancer screening: aged 65 or older, having any type of insurance, previous outpatient visits, and current or other preventive screenings. Among adults aged 50-75 who were up to date with colorectal cancer screening, factors associated with use of fecal testing, as opposed to colonoscopy, were: being younger, speaking a non-English language, being uninsured, having prior office visits, and having had a flu shot in past year. Our findings may inform clinic-based effort to raise rates of colorectal cancer screening, especially in the community clinic setting. TRIAL REGISTRATION ClinicalTrials.gov , NCT01742065.
Collapse
|
23
|
Coronado GD, Petrik AF, Vollmer WM, Taplin SH, Keast EM, Fields S, Green BB. Effectiveness of a Mailed Colorectal Cancer Screening Outreach Program in Community Health Clinics: The STOP CRC Cluster Randomized Clinical Trial. JAMA Intern Med 2018; 178:1174-1181. [PMID: 30083752 PMCID: PMC6142956 DOI: 10.1001/jamainternmed.2018.3629] [Citation(s) in RCA: 98] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/11/2018] [Accepted: 06/11/2018] [Indexed: 01/04/2023]
Abstract
Importance Approximately 24 million US individuals receive care at federally qualified health centers, which historically have low rates of colorectal cancer screening. The US Preventive Services Task Force recommends routine colorectal cancer screening for individuals aged 50 to 75 years. Objective To determine the effectiveness of an electronic health record (EHR)-embedded mailed fecal immunochemical test (FIT) outreach program implemented in health centers as part of standard care. Design, Setting, and Participants This cluster randomized pragmatic clinical trial was conducted in 26 federally qualified health center clinics, representing 8 health centers in Oregon and California, randomized to intervention (n = 13) or usual care (n = 13). All participants were overdue for colorectal cancer screening during the accrual interval (February 4, 2014 to February 3, 2015). Interventions Electronic health record-embedded tools to identify eligible adults and to facilitate implementation of a stepwise mailed intervention involving (1) an introductory letter, (2) a mailed FIT, and (3) a reminder letter; training, collaborative learning, and facilitation through a practice improvement process. Main Outcomes and Measures Effectiveness was measured as clinic-level proportions of adults who completed a FIT, and secondarily, any colorectal cancer screening within 12 months of accrual or by August 3, 2015. Implementation was measured as clinic-level proportions of adults who were mailed an introductory letter and ordered a FIT. Results Twenty-six clinics with 41 193 adults (mean [SD] age, 58.5 [6.3] years; 22 994 women) were randomized to receive the direct mail colorectal screening intervention (13 clinics; 21 134 patients) or usual care (13 clinics; 20 059 patients). Compared with usual care clinics, intervention clinics had significantly higher adjusted clinic-level proportion of participants who completed a FIT (13.9% vs 10.4%; difference, 3.4 percentage points; 95% CI, 0.1%-6.8%) and any colorectal cancer screening (18.3% vs 14.5%; difference, 3.8 percentage points; 95% CI, 0.6%-7.0%). We observed large variation across health centers in effectiveness (FIT completion differences range, -7.4 percentage points to 17.6 percentage points) and implementation (proportion who were mailed a FIT range, 6.5% to 68.2%). The number needed to mail to achieve a completed FIT was 4.8 overall, and 4.0 in clinics that mailed a FIT reminder. Conclusions and Relevance An EHR-embedded mailed FIT outreach intervention significantly improved rates of FIT completion and rates of any colorectal cancer screening. Higher rates of colorectal cancer screening occurred in clinics that successfully implemented the mailed outreach program. Trial Registration ClinicalTrials.gov identifier: NCT01742065.
Collapse
Affiliation(s)
| | | | | | - Stephen H. Taplin
- Center for Global Health, National Cancer Institute, Rockville, Maryland
| | - Erin M. Keast
- Kaiser Permanente Center for Health Research, Portland, Oregon
| | | | - Beverly B. Green
- Kaiser Permanente Washington Health Research Institute, Seattle, Washington
| |
Collapse
|
24
|
Nielson CM, Petrik AF, Jacob L, Vollmer WM, Keast EM, Schneider JL, Rivelli JS, Kapka TJ, Meenan RT, Mummadi RR, Green BB, Coronado GD. Positive predictive values of fecal immunochemical tests used in the STOP CRC pragmatic trial. Cancer Med 2018; 7:4781-4790. [PMID: 30101513 PMCID: PMC6144161 DOI: 10.1002/cam4.1727] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2018] [Revised: 06/06/2018] [Accepted: 07/18/2018] [Indexed: 02/06/2023] Open
Abstract
Annual fecal immunochemical testing (FIT) is cost-effective for colorectal cancer (CRC) screening. However, FIT positivity rates and positive predictive value (PPV) can vary substantially, with false-positive (FP) results adding to colonoscopy burden without improving cancer detection. Our objective was to describe FIT PPV and the factors associated with FP results among patients undergoing CRC screening. In an ongoing pragmatic clinical trial of mailed-FIT outreach, clinics delivered one of three FIT brands (InSure, OC-Micro, and Hemosure). Patients who had a positive FIT result and a follow-up colonoscopy were included in this analysis (N = 1130). Patients' demographic and medical histories were abstracted from electronic health records (EHR). Associations with a FP result (ie, a positive FIT result with no evidence of advanced neoplasia during follow-up colonoscopy) were evaluated for FIT brand and patient factors using mixed-effects multivariable logistic regression. The mean proportion of FIT-positive results ranged from 8% in centers using the OC-Micro test to 21% for Hemosure. PPVs for advanced neoplasia were 0.30 to 0.17, respectively (P for χ2 = 0.08). In multivariable-adjusted models, use of Hemosure was associated with greater odds of a FP result than OC-Micro (OR = 2.00, 95% CI: 0.47-8.56) or InSure (OR = 1.72, 95% CI: 0.44-6.68). However, only female sex (OR = 1.58, 95% CI: 1.19-2.10) and history of a colorectal condition (OR = 2.17, 95% CI: 1.13-4.15) were significantly associated with FP. In conclusion, FIT positivity varied by brand, and FP results differed by patient factors available through the EHR. These results can be used to minimize the frequency of FP results, reducing patient distress and colonoscopy burden.
Collapse
Affiliation(s)
| | | | | | | | - Erin M. Keast
- Kaiser Permanente Center for Health ResearchPortlandOregon
| | | | | | - Tanya J. Kapka
- Kaiser Permanente Center for Health ResearchPortlandOregon
| | | | | | - Beverly B. Green
- Kaiser Permanente Washington Health Research InstituteSeattleWashington
| | | |
Collapse
|
25
|
Coronado GD, Schneider JL, Petrik A, Rivelli J, Taplin S, Green BB. Implementation successes and challenges in participating in a pragmatic study to improve colon cancer screening: perspectives of health center leaders. Transl Behav Med 2018; 7:557-566. [PMID: 28150097 DOI: 10.1007/s13142-016-0461-1] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Abstract
Little is known about the challenges faced by community clinics who must address clinical priorities first when participating in pragmatic studies. We report on implementation challenges faced by the eight community health centers that participated in Strategies and Opportunities to STOP Colon Cancer in Priority Populations (STOP CRC), a large comparative effectiveness cluster-randomized trial to evaluate a direct-mail program to increase the rate of colorectal cancer (CRC) screening. We conducted interviews, at the onset of implementation and 1 year later, with center leaders to identify challenges with implementing and sustaining an electronic medical record (EMR)-driven mailed program to increase CRC screening rates. We used the Consolidated Framework for Implementation Research to thematically analyze the content of meeting discussions and identify anticipated and experienced challenges. Common early concerns were patients' access to colonoscopy, patients' low awareness of CRC screening, time burden on clinic staff to carry out the STOP CRC program, inability to accurately identify eligible patients, and incompatibility of the program's approach with the patient population or organizational culture. Once the program was rolled out, time burden remained a primary concern and new organizational capacity and EMR issues were raised (e.g., EMR staffing resources and turnover in key leadership positions). Cited program successes were improved CRC screening processes and rates, more patients reached, reduced costs, and improved patient awareness, engagement, or satisfaction. These findings may inform any clinic considering mailed fecal testing programs and future pragmatic research efforts in community health centers.
Collapse
Affiliation(s)
- Gloria D Coronado
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave., Portland, OR, 97227, USA.
| | - Jennifer L Schneider
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - Amanda Petrik
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - Jennifer Rivelli
- The Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave., Portland, OR, 97227, USA
| | - Stephen Taplin
- Center for Global Health, National Cancer Institute, Rockville, MD, USA
| | | |
Collapse
|
26
|
Li F, Turner EL, Heagerty PJ, Murray DM, Vollmer WM, DeLong ER. An evaluation of constrained randomization for the design and analysis of group-randomized trials with binary outcomes. Stat Med 2017; 36:3791-3806. [PMID: 28786223 DOI: 10.1002/sim.7410] [Citation(s) in RCA: 65] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2016] [Revised: 06/07/2017] [Accepted: 06/20/2017] [Indexed: 01/18/2023]
Abstract
Group-randomized trials are randomized studies that allocate intact groups of individuals to different comparison arms. A frequent practical limitation to adopting such research designs is that only a limited number of groups may be available, and therefore, simple randomization is unable to adequately balance multiple group-level covariates between arms. Therefore, covariate-based constrained randomization was proposed as an allocation technique to achieve balance. Constrained randomization involves generating a large number of possible allocation schemes, calculating a balance score that assesses covariate imbalance, limiting the randomization space to a prespecified percentage of candidate allocations, and randomly selecting one scheme to implement. When the outcome is binary, a number of statistical issues arise regarding the potential advantages of such designs in making inference. In particular, properties found for continuous outcomes may not directly apply, and additional variations on statistical tests are available. Motivated by two recent trials, we conduct a series of Monte Carlo simulations to evaluate the statistical properties of model-based and randomization-based tests under both simple and constrained randomization designs, with varying degrees of analysis-based covariate adjustment. Our results indicate that constrained randomization improves the power of the linearization F-test, the KC-corrected GEE t-test (Kauermann and Carroll, 2001, Journal of the American Statistical Association 96, 1387-1396), and two permutation tests when the prognostic group-level variables are controlled for in the analysis and the size of randomization space is reasonably small. We also demonstrate that constrained randomization reduces power loss from redundant analysis-based adjustment for non-prognostic covariates. Design considerations such as the choice of the balance metric and the size of randomization space are discussed.
Collapse
Affiliation(s)
- Fan Li
- Department of Biostatistics and Bioinformatics, Duke University, Durham, 27705, NC, USA.,Duke Clinical Research Institute, Durham, 27705, NC, USA
| | - Elizabeth L Turner
- Department of Biostatistics and Bioinformatics, Duke University, Durham, 27705, NC, USA.,Duke Global Health Institute, Durham, 27710, NC, USA
| | - Patrick J Heagerty
- Department of Biostatistics, University of Washington, Seattle, 98195, WA, USA
| | - David M Murray
- Office of Disease Prevention, National Institutes of Health, Rockville, 20892, MD, USA
| | - William M Vollmer
- Center for Health Research, Kaiser Permanente, Portland, 97227, OR, USA
| | - Elizabeth R DeLong
- Department of Biostatistics and Bioinformatics, Duke University, Durham, 27705, NC, USA.,Duke Clinical Research Institute, Durham, 27705, NC, USA
| |
Collapse
|
27
|
Abstract
Objective Variations in processes for different clinics and health systems can dramatically change the way preventive interventions are implemented. We present a method for documenting these variations using workflow diagrams and demonstrate how understanding workflow aided an electronic health record (EHR) embedded colorectal cancer screening intervention. Materials and Methods We mapped variation in processes for ordering and documenting fecal testing, current colonoscopy, prior colonoscopies, and pathology results. This work was part of a multi-site cluster-randomized pragmatic trial to test a mailed approach to offering fecal testing at 26 safety net clinics (in eight organizations) in Oregon and Northern California. We created clinic-specific workflow diagrams and then distilled them into consolidated diagrams that captured the variations. Results Clinics had varied practices for storing and using information about colorectal cancer screening. Developing workflow diagrams of key processes enabled clinics to find optimal ways to send fecal test kits to patients due for screening. The workflows informed the rollout of new EHR tools and identified best practices for data capture. Discussion Diagramming workflows can have great utility when implementing and refining EHR tools for clinical practice, especially when doing so across multiple clinical sites. The process of developing the workflows uncovered successful practice recommendations and revealed limitations and potential effects of a research intervention. Conclusion Our method of documenting clinical process variation might inform other EHR-powered, multi-site research and can improve data feedback from EHR systems to clinical caregivers.
Collapse
|
28
|
Hassmiller Lich K, Cornejo DA, Mayorga ME, Pignone M, Tangka FKL, Richardson LC, Kuo TM, Meyer AM, Hall IJ, Smith JL, Durham TA, Chall SA, Crutchfield TM, Wheeler SB. Cost-Effectiveness Analysis of Four Simulated Colorectal Cancer Screening Interventions, North Carolina. Prev Chronic Dis 2017; 14:E18. [PMID: 28231042 PMCID: PMC5325466 DOI: 10.5888/pcd14.160158] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
INTRODUCTION Colorectal cancer (CRC) screening rates are suboptimal, particularly among the uninsured and the under-insured and among rural and African American populations. Little guidance is available for state-level decision makers to use to prioritize investment in evidence-based interventions to improve their population's health. The objective of this study was to demonstrate use of a simulation model that incorporates synthetic census data and claims-based statistical models to project screening behavior in North Carolina. METHODS We used individual-based modeling to simulate and compare intervention costs and results under 4 evidence-based and stakeholder-informed intervention scenarios for a 10-year intervention window, from January 1, 2014, through December 31, 2023. We compared the proportion of people living in North Carolina who were aged 50 to 75 years at some point during the window (that is, age-eligible for screening) who were up to date with CRC screening recommendations across intervention scenarios, both overall and among groups with documented disparities in receipt of screening. RESULTS We estimated that the costs of the 4 intervention scenarios considered would range from $1.6 million to $3.75 million. Our model showed that mailed reminders for Medicaid enrollees, mass media campaigns targeting African Americans, and colonoscopy vouchers for the uninsured reduced disparities in receipt of screening by 2023, but produced only small increases in overall screening rates (0.2-0.5 percentage-point increases in the percentage of age-eligible adults who were up to date with CRC screening recommendations). Increased screenings ranged from 41,709 additional life-years up to date with screening for the voucher intervention to 145,821 for the mass media intervention. Reminders mailed to Medicaid enrollees and the mass media campaign for African Americans were the most cost-effective interventions, with costs per additional life-year up to date with screening of $25 or less. The intervention expanding the number of endoscopy facilities cost more than the other 3 interventions and was less effective in increasing CRC screening. CONCLUSION Cost-effective CRC screening interventions targeting observed disparities are available, but substantial investment (more than $3.75 million) and additional approaches beyond those considered here are required to realize greater increases population-wide.
Collapse
Affiliation(s)
- Kristen Hassmiller Lich
- Department of Health Policy and Management, University of North Carolina at Chapel Hill, 1105E McGavran-Greenberg, Campus Box 7411, Chapel Hill, NC 27599.
| | - David A Cornejo
- Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, North Carolina
| | - Maria E Mayorga
- Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, North Carolina
| | - Michael Pignone
- Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Center for Health Promotion and Disease Prevention, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Division of General Medicine and Clinical Epidemiology, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Florence K L Tangka
- Division of Cancer Prevention and Control, Centers for Disease Control and Prevention, Atlanta, Georgia
| | - Lisa C Richardson
- Division of Cancer Prevention and Control, Centers for Disease Control and Prevention, Atlanta, Georgia
| | - Tzy-Mey Kuo
- Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Anne-Marie Meyer
- Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Department of Epidemiology, University of North Carolina at Chapel Hill, Chapel Hill North Carolina
| | - Ingrid J Hall
- Division of Cancer Prevention and Control, Centers for Disease Control and Prevention, Atlanta, Georgia
| | - Judith Lee Smith
- Division of Cancer Prevention and Control, Centers for Disease Control and Prevention, Atlanta, Georgia
| | - Todd A Durham
- Department of Health Policy and Management, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Steven A Chall
- Renaissance Computing Institute, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Trisha M Crutchfield
- Center for Health Promotion and Disease Prevention, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Stephanie B Wheeler
- Department of Health Policy and Management, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
- Center for Health Promotion and Disease Prevention, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| |
Collapse
|
29
|
Petrik AF, Green BB, Vollmer WM, Le T, Bachman B, Keast E, Rivelli J, Coronado GD. The validation of electronic health records in accurately identifying patients eligible for colorectal cancer screening in safety net clinics. Fam Pract 2016; 33:639-643. [PMID: 27471224 PMCID: PMC5161488 DOI: 10.1093/fampra/cmw065] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/03/2023] Open
Abstract
BACKGROUND While electronic health records (EHRs) play a key role in increasing colorectal cancer (CRC) screening by identifying individuals who are overdue, important shortfalls remain. OBJECTIVES As part of the Strategies and Opportunities to STOP Colon Cancer (STOP CRC) study, we assessed the accuracy of EHR codes in identifying patients eligible for CRC screening. METHODS We selected a stratified random sample of 800 study participants from 26 participating clinics, in the Pacific Northwest region of the USA. We compared data obtained through codes in the EHR to conduct a manual chart audit. A trained chart abstractor completed the abstraction of eligible and ineligible patients. RESULTS Of 520 individuals in need of CRC screening, identified via the EHR, 459 were confirmed through chart review (positive predictive value = 88%). Of 280 individuals flagged as up-to-date in their screening per EHR data, 269 were confirmed through chart review (negative predictive value = 96%). Among the 61 patients incorrectly classified as eligible, 83.6% of disagreements were due to evidence of a prior colonoscopy or referral that was not captured in recognizable fields in the EHR. CONCLUSIONS Our findings highlight importance of better capture of past screening events in the EHR. While the need for better population-based data is not unique to CRC screening, it provides an important example of the use of population-based data not only for tracking care, but also for delivering interventions.
Collapse
Affiliation(s)
- Amanda F Petrik
- The Center for Health Research, Kaiser Permanente Northwest, Portland, OR,
| | | | - William M Vollmer
- The Center for Health Research, Kaiser Permanente Northwest, Portland, OR
| | | | - Barbara Bachman
- The Center for Health Research, Kaiser Permanente Northwest, Portland, OR
| | - Erin Keast
- The Center for Health Research, Kaiser Permanente Northwest, Portland, OR
| | - Jennifer Rivelli
- The Center for Health Research, Kaiser Permanente Northwest, Portland, OR
| | - Gloria D Coronado
- The Center for Health Research, Kaiser Permanente Northwest, Portland, OR
| |
Collapse
|
30
|
Diagnostic colonoscopy following a positive fecal occult blood test in community health center patients. Cancer Causes Control 2016; 27:881-7. [PMID: 27228991 DOI: 10.1007/s10552-016-0763-0] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2015] [Accepted: 05/13/2016] [Indexed: 01/07/2023]
Abstract
PURPOSE Fecal occult blood testing (FOBT) is a pragmatic screening option for many community health centers (CHCs), but FOBT screening programs will not reduce mortality if patients with positive results do not undergo diagnostic colonoscopy (DC). This study was conducted to investigate DC completion among CHC patients. METHODS This retrospective cohort study used data from three CHCs in the Midwest and Southwest. The primary study outcome was DC completion within 6 months of positive FOBT among adults age 50-75. Patient data was collected using automated electronic queries. Manual chart reviews were conducted if queries produced no evidence of DC. Poisson regression models described adjusted relative risks (RRs) of DC completion. RESULTS The study included 308 patients; 63.3 % were female, 48.7 % were Spanish speakers and 35.7 % were uninsured. Based on combined query and chart review findings, 51.5 % completed DC. Spanish speakers were more likely than English speakers to complete DC [RR 1.19; 95 % confidence interval (CI) 1.04-1.36; P = 0.009], and DC completion was lower among patients with 0 visits than those with 1-2 visits (RR 2.81; 95% CI 1.83-4.33; P < 0.001) or ≥3 visits (RR 3.06; 95% CI 1.57-5.95; P = 0.001). CONCLUSIONS DC completion was low overall, which raises concerns about whether FOBT can reduce CRC mortality in practice. Further research is needed to understand whether CHC navigator programs can achieve very high DC rates. If organizations use FOBT as their primary CRC screening approach and a substantial number of patients receive positive results, both screening rates and DC rates should be measured.
Collapse
|
31
|
Cook AJ, Delong E, Murray DM, Vollmer WM, Heagerty PJ. Statistical lessons learned for designing cluster randomized pragmatic clinical trials from the NIH Health Care Systems Collaboratory Biostatistics and Design Core. Clin Trials 2016; 13:504-12. [PMID: 27179253 DOI: 10.1177/1740774516646578] [Citation(s) in RCA: 53] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND/AIMS Pragmatic clinical trials embedded within health care systems provide an important opportunity to evaluate new interventions and treatments. Networks have recently been developed to support practical and efficient studies. Pragmatic trials will lead to improvements in how we deliver health care and promise to more rapidly translate research findings into practice. METHODS The National Institutes of Health (NIH) Health Care Systems Collaboratory was formed to conduct pragmatic clinical trials and to cultivate collaboration across research areas and disciplines to develop best practices for future studies. Through a two-stage grant process including a pilot phase (UH2) and a main trial phase (UH3), investigators across the Collaboratory had the opportunity to work together to improve all aspects of these trials before they were launched and to address new issues that arose during implementation. Seven Cores were created to address the various considerations, including Electronic Health Records; Phenotypes, Data Standards, and Data Quality; Biostatistics and Design Core; Patient-Reported Outcomes; Health Care Systems Interactions; Regulatory/Ethics; and Stakeholder Engagement. The goal of this article is to summarize the Biostatistics and Design Core's lessons learned during the initial pilot phase with seven pragmatic clinical trials conducted between 2012 and 2014. RESULTS Methodological issues arose from the five cluster-randomized trials, also called group-randomized trials, including consideration of crossover and stepped wedge designs. We outlined general themes and challenges and proposed solutions from the pilot phase including topics such as study design, unit of randomization, sample size, and statistical analysis. Our findings are applicable to other pragmatic clinical trials conducted within health care systems. CONCLUSION Pragmatic clinical trials using the UH2/UH3 funding mechanism provide an opportunity to ensure that all relevant design issues have been fully considered in order to reliably and efficiently evaluate new interventions and treatments. The integrity and generalizability of trial results can only be ensured if rigorous designs and appropriate analysis choices are an essential part of their research protocols.
Collapse
Affiliation(s)
- Andrea J Cook
- Biostatistics Unit, Group Health Research Institute, Seattle, WA, USA Department of Biostatistics, University of Washington, Seattle, WA, USA
| | - Elizabeth Delong
- Department of Biostatistics & Bioinformatics, Duke University School of Medicine, Durham, NC, USA Duke Clinical Research Institute, Durham, NC, USA
| | - David M Murray
- Office of Disease Prevention, Division of Program Coordination Planning and Strategic Initiatives, Office of the Director, National Institutes of Health, Bethesda, MD, USA
| | | | | |
Collapse
|
32
|
Vollmer WM, Green BB, Coronado GD. Analytic Challenges Arising from the STOP CRC Trial: Pragmatic Solutions for Pragmatic Problems. EGEMS 2015; 3:1200. [PMID: 26793738 PMCID: PMC4708092 DOI: 10.13063/2327-9214.1200] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
CONTEXT Pragmatic trials lack the relatively tight quality control of traditional efficacy studies and hence may pose added analytic challenges owing to the practical realities faced in carrying them out. CASE DESCRIPTION STOP CRC is a cluster randomized trial testing the effectiveness of automated, electronic medical record (EMR)-driven strategies to raise colorectal cancer (CRC) screening rates in safety net clinics. Screen-eligible participants were accrued during year 1 and followed for 12 months (measurement window) to assess completion of a fecal screening test. Control clinics implemented the intervention in year 2. IMPLEMENTATION CHALLENGES/ANALYTIC ISSUES Due to limitations on how we could build the intervention tools, the overlap of the year 1 measurement windows with year 2 intervention rollout posed a potential for contamination of the primary outcome for control participants. In addition, a variety of factors led to a lack of synchronization of the measurement windows with actual intervention delivery. In both cases, the net impact of these factors would be to diminish the estimated impact of the intervention. PROPOSED SOLUTIONS We dealt with the overlap issue by delaying the start of intervention rollout to control clinics in year 2 by 6 months and by truncating the measurement windows for intervention and control participants at this point. In addition we formulated three sensitivity analyses to help address the issue of asynchronization. CONCLUSION This case study might help other investigators facing similar challenges think about such issues and the pros and cons of various strategies for dealing with them.
Collapse
|
33
|
McGraw D, Greene SM, Miner CS, Staman KL, Welch MJ, Rubel A. Privacy and confidentiality in pragmatic clinical trials. Clin Trials 2015; 12:520-9. [PMID: 26374682 PMCID: PMC4702499 DOI: 10.1177/1740774515597677] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
With pragmatic clinical trials, an opportunity exists to answer important questions about the relative risks, burdens, and benefits of therapeutic interventions. However, concerns about protecting the privacy of this information are significant and must be balanced with the imperative to learn from the data gathered in routine clinical practice. Traditional privacy protections for research uses of identifiable information rely disproportionately on informed consent or authorizations, based on a presumption that this is necessary to fulfill ethical principles of respect for persons. But frequently, the ideal of informed consent is not realized in its implementation. Moreover, the principle of respect for persons—which encompasses their interests in health information privacy—can be honored through other mechanisms. Data anonymization also plays a role in protecting privacy but is not suitable for all research, particularly pragmatic clinical trials. In this article, we explore both the ethical foundation and regulatory framework intended to protect privacy in pragmatic clinical trials. We then review examples of novel approaches to respecting persons in research that may have the added benefit of honoring patient privacy considerations.
Collapse
Affiliation(s)
- Deven McGraw
- Manatt, Phelps & Phillips, LLP, Washington, DC, USA
| | - Sarah M Greene
- Patient-Centered Outcomes Research Institute, Washington, DC, USA
| | | | | | | | - Alan Rubel
- University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
34
|
Coronado GD, Petrik AF, Bartelmann SE, Coyner LA, Coury J. Health Policy to Promote Colorectal Cancer Screening: Improving Access and Aligning Federal and State Incentives. CLINICAL RESEARCHER (ALEXANDRIA, VA.) 2015; 29:50-55. [PMID: 27135047 DOI: 10.14524/cr-14-0044] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Since implementation of the Affordable Care Act, 7 million+ individuals are newly covered on state-managed Medicaid programs and millions more on subsidized commercial insurance plans. We describe Oregon's experience in including colorectal cancer (CRC) screening as a measure for the state's new pay-for-performance Medicaid program. Using Oregon Health Authority data, we present 1) frequencies of Medicaid enrollees age-eligible for CRC screening, before and after Medicaid expansion; 2) CRC screening rates for 2011 and 2013; and 3) stakeholder perceptions about incentivizing CRC screening. Between December 2013 and June 2014, the size of the Medicaid-enrolled population age-eligible for CRC screening increased by 55% (104,920 to 163,078). Between 2011 and 2013, CRC screening rates improved by more than three percent for 6/15 (40%) CCOs; the majority of stakeholders surveyed (70%) supported the CRC screening metric. Inclusion of CRC screening as a Medicaid quality metric may present a unique opportunity to raise rates among historically underserved populations.
Collapse
|