1
|
Cafaro T, LaRiccia PJ, Bandomer B, Goldstein H, Brobyn TL, Hunter K, Roy S, Ng KQ, Mitrev LV, Tsai A, Thwing D, Maag MA, Chung MK, van Helmond N. Remote and semi-automated methods to conduct a decentralized randomized clinical trial. J Clin Transl Sci 2023; 7:e153. [PMID: 37528946 PMCID: PMC10388435 DOI: 10.1017/cts.2023.574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 05/24/2023] [Accepted: 05/29/2023] [Indexed: 08/03/2023] Open
Abstract
Introduction Designing and conducting clinical trials is challenging for some institutions and researchers due to associated time and personnel requirements. We conducted recruitment, screening, informed consent, study product distribution, and data collection remotely. Our objective is to describe how to conduct a randomized clinical trial using remote and automated methods. Methods A randomized clinical trial in healthcare workers is used as a model. A random group of workers were invited to participate in the study through email. Following an automated process, interested individuals scheduled consent/screening interviews. Enrollees received study product by mail and surveys via email. Adherence to study product and safety were monitored with survey data review and via real-time safety alerts to study staff. Results A staff of 10 remotely screened 406 subjects and enrolled 299 over a 3-month period. Adherence to study product was 87%, and survey data completeness was 98.5% over 9 months. Participants and study staff scored the System Usability Scale 93.8% and 90%, respectively. The automated and remote methods allowed the study maintenance period to be managed by a small study team of two members, while safety monitoring was conducted by three to four team members. Conception of the trial to study completion was 21 months. Conclusions The remote and automated methods produced efficient subject recruitment with excellent study product adherence and data completeness. These methods can improve efficiency without sacrificing safety or quality. We share our XML file for researchers to use as a template for learning purposes or designing their own clinical trials.
Collapse
Affiliation(s)
- Teresa Cafaro
- Department of Anesthesiology, Cooper University Health Care, Camden, NJ, USA
- Cooper Research Institute, Cooper University Health Care, Camden, NJ, USA
- Won Sook Chung Foundation, Moorestown, NJ, USA
| | - Patrick J. LaRiccia
- Won Sook Chung Foundation, Moorestown, NJ, USA
- Center for Clinical Epidemiology and Biostatistics Perelman School of Medicine University of Pennsylvania, Philadelphia, PA, USA
| | | | | | - Tracy L. Brobyn
- Won Sook Chung Foundation, Moorestown, NJ, USA
- The Chung Institute of Integrative Medicine, Moorestown, NJ, USA
- Cooper Medical School of Rowan University, Camden, NJ, USA
- Rowan University School of Osteopathic Medicine, Stratford, NJ, USA
| | - Krystal Hunter
- Cooper Research Institute, Cooper University Health Care, Camden, NJ, USA
- Cooper Medical School of Rowan University, Camden, NJ, USA
| | - Satyajeet Roy
- Cooper Medical School of Rowan University, Camden, NJ, USA
- Division of General Internal Medicine, Cooper University Health Care, Camden, NJ, USA
| | - Kevin Q. Ng
- Won Sook Chung Foundation, Moorestown, NJ, USA
- The Chung Institute of Integrative Medicine, Moorestown, NJ, USA
- Division of Infectious Disease, Cooper University Health Care, Camden, NJ, USA
| | - Ludmil V. Mitrev
- Department of Anesthesiology, Cooper University Health Care, Camden, NJ, USA
- Cooper Medical School of Rowan University, Camden, NJ, USA
| | - Alan Tsai
- Cooper Medical School of Rowan University, Camden, NJ, USA
| | | | | | - Myung K. Chung
- Won Sook Chung Foundation, Moorestown, NJ, USA
- The Chung Institute of Integrative Medicine, Moorestown, NJ, USA
- Cooper Medical School of Rowan University, Camden, NJ, USA
- Department of Family Medicine, Cooper University Health Care, Camden, NJ, USA
| | - Noud van Helmond
- Department of Anesthesiology, Cooper University Health Care, Camden, NJ, USA
| |
Collapse
|
2
|
Dharanikota S, LeRouge CM, Lyon V, Durneva P, Thompson M. Identifying Enablers of Participant Engagement in Clinical Trials of Consumer Health Technologies: Qualitative Study of Influenza Home Testing. J Med Internet Res 2021; 23:e26869. [PMID: 34519664 PMCID: PMC8479603 DOI: 10.2196/26869] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Revised: 06/13/2021] [Accepted: 07/27/2021] [Indexed: 01/26/2023] Open
Abstract
Background A rise in the recent trend of self-managing health using consumer health technologies highlights the importance of efficient and successful consumer health technology trials. Trials are particularly essential to support large-scale implementations of consumer health technologies, such as smartphone-supported home tests. However, trials are generally fraught with challenges, such as inadequate enrollment, lack of fidelity to interventions, and high dropout rates. Understanding the reasons underlying individuals’ participation in trials can inform the design and execution of future trials of smartphone-supported home tests. Objective This study aims to identify the enablers of potential participants’ trial engagement for clinical trials of smartphone-supported home tests. We use influenza home testing as our instantiation of a consumer health technology subject to trial to investigate the dispositional and situational enablers that influenced trial engagement. Methods We conducted semistructured interviews with 31 trial participants using purposive sampling to facilitate demographic diversity. The interviews included a discussion of participants’ personal characteristics and external factors that enabled their trial engagement with a smartphone-supported home test for influenza. We performed both deductive and inductive thematic analyses to analyze the interview transcripts and identify enabler themes. Results Our thematic analyses revealed a structure of dispositional and situational enablers that enhanced trial engagement. Situationally, clinical affiliation, personal advice, promotional recruitment strategies, financial incentives, and insurance status influenced trial engagement. In addition, digital health literacy, motivation to advance medical research, personal innovativeness, altruism, curiosity, positive attitude, and potential to minimize doctors’ visits were identified as the dispositional enablers for trial engagement in our study. Conclusions We organized the identified themes for dispositional and situational enablers of trial engagement with a smartphone-supported home test into a research framework that can guide future research as well as the trial design and execution of smartphone-supported home tests. We suggest several trial design and engagement strategies to enhance the financial and scientific viability of these trials that pave the way for advancements in patient care. Furthermore, our study also offers practical strategies to trial organizers to enhance participants’ enrollment and engagement in clinical trials of these home tests.
Collapse
Affiliation(s)
- Spurthy Dharanikota
- Department of Information Systems and Business Analytics, Florida International University, Miami, FL, United States
| | - Cynthia M LeRouge
- Department of Information Systems and Business Analytics, Florida International University, Miami, FL, United States
| | - Victoria Lyon
- Primary Care Innovation Lab, Department of Family Medicine, University of Washington, Seattle, WA, United States
| | - Polina Durneva
- Department of Information Systems and Business Analytics, Florida International University, Miami, FL, United States
| | - Matthew Thompson
- Primary Care Innovation Lab, Department of Family Medicine, University of Washington, Seattle, WA, United States
| |
Collapse
|
3
|
Graham AK, Greene CJ, Powell T, Lieponis P, Lunsford A, Peralta CD, Orr LC, Kaiser SM, Alam N, Berhane H, Kalan O, Mohr DC. Lessons learned from service design of a trial of a digital mental health service: Informing implementation in primary care clinics. Transl Behav Med 2021; 10:598-605. [PMID: 32766862 DOI: 10.1093/tbm/ibz140] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Implementing a digital mental health service in primary care requires integration into clinic workflow. However, without adequate attention to service design, including designing referral pathways to identify and engage patients, implementation will fail. This article reports results from our efforts designing referral pathways for a randomized clinical trial evaluating a digital service for depression and anxiety delivered through primary care clinics. We utilized three referral pathways: direct to consumer (e.g., digital and print media, registry emails), provider referral (i.e., electronic health record [EHR] order and provider recommendation), and other approaches (e.g., presentations, word of mouth). Over the 5-month enrollment, 313 individuals completed the screen and reported how they learned about the study. Penetration was 13%, and direct to consumer techniques, most commonly email, had the highest yield. Providers only referred 16 patients through the EHR, half of whom initiated the screen. There were no differences in referral pathway based on participants' age, depression severity, or anxiety severity at screening. Ongoing discussions with providers revealed that the technologic implementation and workflow design may not have been optimal to fully affect the EHR-based referral process, which potentially limited patient access. Results highlight the importance of designing and evaluating referral pathways within service implementation, which is important for guiding the implementation of digital services into practice. Doing so can ensure that sustained implementation is not left to post-evaluation bridge-building. Future efforts should assess these and other referral pathways implemented in clinical practice outside of a research trial.
Collapse
Affiliation(s)
- Andrea K Graham
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, USA.,Department of Medical Social Sciences, Northwestern University, Chicago, IL, USA
| | - Carolyn J Greene
- Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Thomas Powell
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | | | - Amanda Lunsford
- Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Chris D Peralta
- Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - L Casey Orr
- Psychiatric Research Institute, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Susan M Kaiser
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, USA.,Department of Preventive Medicine, Northwestern University, Chicago, IL, USA
| | - Nameyeh Alam
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, USA.,Department of Preventive Medicine, Northwestern University, Chicago, IL, USA
| | | | - Ozan Kalan
- Actualize Therapy, Inc., Chicago, IL, USA
| | - David C Mohr
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, USA.,Department of Preventive Medicine, Northwestern University, Chicago, IL, USA
| |
Collapse
|
4
|
von Itzstein MS, Hullings M, Mayo H, Beg MS, Williams EL, Gerber DE. Application of Information Technology to Clinical Trial Evaluation and Enrollment: A Review. JAMA Oncol 2021; 7:1559-1566. [PMID: 34236403 DOI: 10.1001/jamaoncol.2021.1165] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
Importance As cancer treatment has become more individualized, oncologic clinical trials have become more complex. Increasingly numerous and stringent eligibility criteria frequently include tumor molecular or genomic characteristics that may not be readily identified in medical records, rendering it difficult to best match clinical trials with clinical sites and to identify potentially eligible patients once a clinical trial has been selected and activated. Partly because of these factors, enrollment rates for cancer clinical trials remain low, creating delays and increased costs for drug development. Information technology (IT) platforms have been applied to the implementation and conduct of clinical trials to improve efficiencies in several medical fields, and these platforms have recently been introduced to oncologic studies. Observations This review summarizes cancer and noncancer studies that used IT platforms for assistance with clinical trial site selection, patient recruitment, and patient screening. The review does not address the use of IT in other aspects of clinical research, such as wearable physical activity monitors or telehealth visits. A large number of IT platforms (which may be patient facing, site or investigator facing, or sponsor facing) are now commercially available. These applications use artificial intelligence and/or natural language processing to identify and summarize protocol eligibility criteria, institutional patient populations, and individual electronic health records. Although there is an expanding body of literature examining the role of this technology, relatively few studies to date have been performed in oncologic settings. Conclusions and Relevance This review found that an increasing number and variety of IT platforms were available to assist in the planning and conduct of clinical trials. Because oncologic clinical care and clinical trial protocols are particularly complex, nuanced, and individualized, published experience with this technology in other fields may not be fully applicable to cancer settings. The extent to which these services will overcome ongoing and increasing challenges in cancer clinical research remains unclear.
Collapse
Affiliation(s)
- Mitchell S von Itzstein
- Department of Internal Medicine, Division of Hematology-Oncology, The University of Texas Southwestern Medical Center, Dallas.,Harold C. Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas
| | - Melanie Hullings
- Harold C. Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas
| | - Helen Mayo
- Southwestern Health Sciences Digital Library and Learning Center, The University of Texas, Dallas
| | - M Shaalan Beg
- Department of Internal Medicine, Division of Hematology-Oncology, The University of Texas Southwestern Medical Center, Dallas.,Harold C. Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas
| | - Erin L Williams
- Harold C. Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas
| | - David E Gerber
- Department of Internal Medicine, Division of Hematology-Oncology, The University of Texas Southwestern Medical Center, Dallas.,Harold C. Simmons Comprehensive Cancer Center, The University of Texas Southwestern Medical Center, Dallas.,Department of Population and Data Sciences, The University of Texas, Southwestern Medical Center, Dallas
| |
Collapse
|
5
|
Primary care perspectives on implementation of clinical trial recruitment. J Clin Transl Sci 2019; 4:61-68. [PMID: 32257412 PMCID: PMC7103461 DOI: 10.1017/cts.2019.435] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 10/23/2019] [Accepted: 10/23/2019] [Indexed: 12/12/2022] Open
Abstract
Introduction: Poor clinical trial (CT) recruitment is a significant barrier to translating basic science discoveries into medical practice. Improving support for primary care provider (PCP) referral of patients to CTs may be an important part of the solution. However, implementing CT referral support in primary care is not only technically challenging, but also presents challenges at the person and organization levels. Methods: The objectives of this study were (1) to characterize provider and clinical supervisor attitudes and perceptions regarding CT research, recruitment, and referrals in primary care and (2) to identify perceived workflow strategies and facilitators relevant to designing a technology-supported primary care CT referral program. Focus groups were conducted with PCPs, directors, and supervisors. Results: Analysis indicated widespread support for the intrinsic scientific value of CTs, while at the same time deep concerns regarding protecting patient well-being, perceived loss of control when patients participate in trials, concern about the impact of point-of-care referrals on clinic workflow, the need for standard processes, and the need for CT information that enables referring providers to quickly confirm that the burdens are justified by the benefits at both patient and provider levels. PCP suggestions pertinent to implementing a CT referral decision support system are reported. Conclusion: The results from this work contribute to developing an implementation approach to support increased referral of patients to CTs.
Collapse
|
6
|
Mohr DC, Lattie EG, Tomasino KN, Kwasny MJ, Kaiser SM, Gray EL, Alam N, Jordan N, Schueller SM. A randomized noninferiority trial evaluating remotely-delivered stepped care for depression using internet cognitive behavioral therapy (CBT) and telephone CBT. Behav Res Ther 2019; 123:103485. [PMID: 31634738 PMCID: PMC6916718 DOI: 10.1016/j.brat.2019.103485] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2019] [Revised: 08/26/2019] [Accepted: 09/29/2019] [Indexed: 12/12/2022]
Abstract
This trial examined whether a stepped care program for depression, which initiated treatment with internet cognitive behavioral therapy, including telephone and messaging support, and stepped up non-responders to telephone-administered cognitive behavioral therapy (tCBT), was noninferior, less costly to deliver, and as acceptable to patients compared to tCBT alone. Adults with a diagnosis of major depressive episode (MDE) were randomized to receive up to 20 weeks of stepped care or tCBT. Stepped care (n = 134) was noninferior to tCBT (n = 136) with an end-of-treatment effect size of d = 0.03 and a 6-month post-treatment effect size of d = -0.07 [90% CI 0.29 to 0.14]. Therapist time in stepped care was 5.26 (SD = 3.08) hours versus 10.16 (SD 4.01) for tCBT (p < 0.0001), with a delivery cost difference of $-364.32 [95% CI $-423.68 to $-304.96]. There was no significant difference in pre-treatment preferences (p = 0.10) or treatment dropout (39 in stepped care; 27 in tCBT; p = 0.14). tCBT patients were significantly more satisfied than stepped care patients with the treatment they received (p < 0.0001). These findings indicate that stepped care was less costly to deliver, but no less effective than tCBT. There was no significant difference in treatment preference or completion, however satisfaction with treatment was higher in tCBT than stepped care. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01906476.
Collapse
Affiliation(s)
- David C Mohr
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA.
| | - Emily G Lattie
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Kathryn Noth Tomasino
- Department of Medicine, Northwestern University, NMH/Arkes Family Pavilion, Suite 1400, 676 N. Saint Clair St., Chicago, IL, 60611, USA
| | - Mary J Kwasny
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Susan M Kaiser
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Elizabeth L Gray
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Nameyeh Alam
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| | - Neil Jordan
- Department of Psychiatry and Behavioral Sciences, Mental Health Services & Policy Program, Northwestern University Feinberg School of Medicine, 710 N Lake Shore Dr, 12th Flr, Chicago, IL, 60611, USA; Center of Innovation for Complex Chronic Healthcare, Hines VA Hospital, 5000 S 5th Ave., Hines, IL, 60141, USA
| | - Stephen M Schueller
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies, Northwestern University, 750 N. Lakeshore Dr., 10th Floor, Chicago, IL, 60611, USA
| |
Collapse
|
7
|
Bracken K, Keech A, Hague W, Allan C, Conway A, Daniel M, Gebski V, Grossmann M, Handelsman DJ, Inder WJ, Jenkins A, McLachlan R, Robledo KP, Stuckey B, Yeap BB, Wittert G. A high-volume, low-cost approach to participant screening and enrolment: Experiences from the T4DM diabetes prevention trial. Clin Trials 2019; 16:589-598. [PMID: 31581816 DOI: 10.1177/1740774519872999] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND/AIMS Participant recruitment to diabetes prevention randomised controlled trials is challenging and expensive. The T4DM study, a multicentre, Australia-based, Phase IIIb randomised controlled trial of testosterone to prevent Type 2 diabetes in men aged 50-74 years, faced the challenge of screening a large number of prospective participants at a small number of sites, with few staff, and a limited budget for screening activities. This article evaluates a high-volume, low-cost, semi-automated approach to screen and enrol T4DM study participants. METHODS We developed a sequential multi-step screening process: (1) web-based pre-screening, (2) laboratory screening through a network of third-party pathology centres, and (3) final on-site screening, using online data collection, computer-driven eligibility checking, and automated, email-based communication with prospective participants. Phone- and mail-based data collection and communication options were available to participants at their request. The screening process was administered by the central coordinating centre through a central data management system. RESULTS Screening activities required staffing of approximately 1.6 full-time equivalents over 4 years. Of 19,022 participants pre-screened, 13,108 attended a third-party pathology collection centre for laboratory screening, 1217 received final, on-site screening, and 1007 were randomised. In total, 95% of the participants opted for online pre-screening over phone-based pre-screening. Screening costs, including both direct and staffing costs, totalled AUD1,420,909 (AUD75 per subject screened and AUD1411 per randomised participant). CONCLUSION A multi-step, semi-automated screening process with web-based pre-screening facilitated low-cost, high-volume participant enrolment to this large, multicentre randomised controlled trial. Centralisation and automation of screening activities resulted in substantial savings compared to previous, similar studies. Our screening approach could be adapted to other randomised controlled trial settings to minimise the cost of screening large numbers of participants.
Collapse
Affiliation(s)
- Karen Bracken
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia
| | - Anthony Keech
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia
| | - Wendy Hague
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia
| | - Carolyn Allan
- Hudson Institute of Medical Research, Monash University, Melbourne, VIC, Australia
| | - Ann Conway
- ANZAC Research Institute, University of Sydney, Concord Hospital, Sydney, NSW, Australia
| | - Mark Daniel
- University of Canberra, Canberra, ACT, Australia
| | - Val Gebski
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia
| | - Mathis Grossmann
- The Austin Hospital and University of Melbourne, Melbourne, VIC, Australia
| | - David J Handelsman
- ANZAC Research Institute, University of Sydney, Concord Hospital, Sydney, NSW, Australia
| | - Warrick J Inder
- Princess Alexandra Hospital and The University of Queensland, Brisbane, QLD, Australia
| | - Alicia Jenkins
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia
| | - Robert McLachlan
- Hudson Institute of Medical Research, Monash University, Melbourne, VIC, Australia
| | - Kristy P Robledo
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia
| | - Bronwyn Stuckey
- Keogh Institute of Medical Research and The University of Western Australia, Perth, WA, Australia
| | - Bu B Yeap
- Medical School, The University of Western Australia and Department of Endocrinology and Diabetes, Fiona Stanley Hospital, Perth, WA, Australia
| | - Gary Wittert
- Freemasons Foundation Centre for Men's Health, Adelaide Medical School, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
8
|
Mohr DC, Schueller SM, Tomasino KN, Kaiser SM, Alam N, Karr C, Vergara JL, Gray EL, Kwasny MJ, Lattie EG. Comparison of the Effects of Coaching and Receipt of App Recommendations on Depression, Anxiety, and Engagement in the IntelliCare Platform: Factorial Randomized Controlled Trial. J Med Internet Res 2019; 21:e13609. [PMID: 31464192 PMCID: PMC6737883 DOI: 10.2196/13609] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2019] [Revised: 06/06/2019] [Accepted: 07/20/2019] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND IntelliCare is a modular platform that includes 12 simple apps targeting specific psychological strategies for common mental health problems. OBJECTIVE This study aimed to examine the effect of 2 methods of maintaining engagement with the IntelliCare platform, coaching, and receipt of weekly recommendations to try different apps on depression, anxiety, and app use. METHODS A total of 301 participants with depression or anxiety were randomized to 1 of 4 treatments lasting 8 weeks and were followed for 6 months posttreatment. The trial used a 2X2 factorial design (coached vs self-guided treatment and weekly app recommendations vs no recommendations) to compare engagement metrics. RESULTS The median time to last use of any app during treatment was 56 days (interquartile range 54-57), with 253 participants (84.0%, 253/301) continuing to use the apps over a median of 92 days posttreatment. Receipt of weekly recommendations resulted in a significantly higher number of app use sessions during treatment (overall median=216; P=.04) but only marginal effects for time to last use (P=.06) and number of app downloads (P=.08). Coaching resulted in significantly more app downloads (P<.001), but there were no significant effects for time to last download or number of app sessions (P=.36) or time to last download (P=.08). Participants showed significant reductions in the Patient Health Questionnaire-9 (PHQ-9) and Generalized Anxiety Disorder-7 (GAD-7) across all treatment arms (P s<.001). Coached treatment led to larger GAD-7 reductions than those observed for self-guided treatment (P=.03), but the effects for the PHQ-9 did not reach significance (P=.06). Significant interaction was observed between receiving recommendations and time for the PHQ-9 (P=.04), but there were no significant effects for GAD-7 (P=.58). CONCLUSIONS IntelliCare produced strong engagement with apps across all treatment arms. Coaching was associated with stronger anxiety outcomes, and receipt of recommendations enhanced depression outcomes. TRIAL REGISTRATION ClinicalTrials.gov NCT02801877; https://clinicaltrials.gov/ct2/show/NCT02801877.
Collapse
Affiliation(s)
- David C Mohr
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Stephen M Schueller
- Department of Psychological Science, University of California, Irvine, Irvine, CA, United States
| | | | - Susan M Kaiser
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Nameyeh Alam
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Chris Karr
- Audacious Software, Chicago, IL, United States
| | - Jessica L Vergara
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| | - Elizabeth L Gray
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Mary J Kwasny
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Emily G Lattie
- Center for Behavioral Intervention Technologies, Northwestern University, Chicago, IL, United States
| |
Collapse
|
9
|
Lattie EG, Kaiser SM, Alam N, Tomasino KN, Sargent E, Rubanovich CK, Palac HL, Mohr DC. A Practical Do-It-Yourself Recruitment Framework for Concurrent eHealth Clinical Trials: Identification of Efficient and Cost-Effective Methods for Decision Making (Part 2). J Med Internet Res 2018; 20:e11050. [PMID: 30497997 PMCID: PMC6293245 DOI: 10.2196/11050] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2018] [Revised: 09/03/2018] [Accepted: 09/10/2018] [Indexed: 01/26/2023] Open
Abstract
Background The ability to successfully recruit participants for electronic health (eHealth) clinical trials is largely dependent on the use of efficient and effective recruitment strategies. Determining which types of recruitment strategies to use presents a challenge for many researchers. Objective The aim of this study was to present an analysis of the time-efficiency and cost-effectiveness of recruitment strategies for eHealth clinical trials, and it describes a framework for cost-effective trial recruitment. Methods Participants were recruited for one of 5 eHealth trials of interventions for common mental health conditions. A multipronged recruitment approach was used, including digital (eg, social media and Craigslist), research registry-based, print (eg, flyers and posters on public transportation), clinic-based (eg, a general internal medicine clinic within an academic medical center and a large nonprofit health care organization), a market research recruitment firm, and traditional media strategies (eg, newspaper and television coverage in response to press releases). The time costs and fees for each recruitment method were calculated, and the participant yield on recruitment costs was calculated by dividing the number of enrolled participants by the total cost for each method. Results A total of 777 participants were enrolled across all trials. Digital recruitment strategies yielded the largest number of participants across the 5 clinical trials and represented 34.0% (264/777) of the total enrolled participants. Registry-based recruitment strategies were in second place by enrolling 28.0% (217/777) of the total enrolled participants across trials. Research registry-based recruitment had a relatively high conversion rate from potential participants who contacted our center for being screened to be enrolled, and it was also the most cost-effective for enrolling participants in this set of clinical trials with a total cost per person enrolled at US $8.99. Conclusions On the basis of these results, a framework is proposed for participant recruitment. To make decisions on initiating and maintaining different types of recruitment strategies, the resources available and requirements of the research study (or studies) need to be carefully examined.
Collapse
Affiliation(s)
- Emily G Lattie
- Center for Behavioral Intervention Technologies, Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Susan M Kaiser
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Nameyeh Alam
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Kathryn N Tomasino
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Elizabeth Sargent
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - Caryn Kseniya Rubanovich
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | | | - David C Mohr
- Center for Behavioral Intervention Technologies, Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| |
Collapse
|