1
|
Tokita HK, Assel M, Serafin J, Lin E, Sarraf L, Masson G, Moo TA, Nelson JA, Simon BA, Vickers AJ. Optimizing accrual to a large-scale, clinically integrated randomized trial in anesthesiology: A 2-year analysis of recruitment. Clin Trials 2025; 22:57-65. [PMID: 38895970 PMCID: PMC11655704 DOI: 10.1177/17407745241255087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/21/2024]
Abstract
BACKGROUND Performing large randomized trials in anesthesiology is often challenging and costly. The clinically integrated randomized trial is characterized by simplified logistics embedded into routine clinical practice, enabling ease and efficiency of recruitment, offering an opportunity for clinicians to conduct large, high-quality randomized trials under low cost. Our aims were to (1) demonstrate the feasibility of the clinically integrated trial design in a high-volume anesthesiology practice and (2) assess whether trial quality improvement interventions led to more balanced accrual among study arms and improved trial compliance over time. METHODS This is an interim analysis of recruitment to a cluster-randomized trial investigating three nerve block approaches for mastectomy with immediate implant-based reconstruction: paravertebral block (arm 1), paravertebral plus interpectoral plane blocks (arm 2), and serratus anterior plane plus interpectoral plane blocks (arm 3). We monitored accrual and consent rates, clinician compliance with the randomized treatment, and availability of outcome data. Assessment after the initial year of implementation showed a slight imbalance in study arms suggesting areas for improvement in trial compliance. Specific improvement interventions included increasing the frequency of communication with the consenting staff and providing direct feedback to clinician investigators about their individual recruitment patterns. We assessed overall accrual rates and tested for differences in accrual, consent, and compliance rates pre- and post-improvement interventions. RESULTS Overall recruitment was extremely high, accruing close to 90% of the eligible population. In the pre-intervention period, there was evidence of bias in the proportion of patients being accrued and receiving the monthly block, with higher rates in arm 3 (90%) compared to arms 1 (81%) and 2 (79%, p = 0.021). In contrast, in the post-intervention period, there was no statistically significant difference between groups (p = 0.8). Eligible for randomization rate increased from 89% in the pre-intervention period to 95% in the post-intervention period (difference 5.7%; 95% confidence interval = 2.2%-9.4%, p = 0.002). Consent rate increased from 95% to 98% (difference of 3.7%; 95% confidence interval = 1.1%-6.3%; p = 0.004). Compliance with the randomized nerve block approach was maintained at close to 100% and availability of primary outcome data was 100%. CONCLUSION The clinically integrated randomized trial design enables rapid trial accrual with a high participant compliance rate in a high-volume anesthesiology practice. Continuous monitoring of accrual, consent, and compliance rates is necessary to maintain and improve trial conduct and reduce potential biases. This trial methodology serves as a template for the implementation of other large, low-cost randomized trials in anesthesiology.
Collapse
Affiliation(s)
- Hanae K Tokita
- Department of Anesthesiology & Critical Care Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Melissa Assel
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Joanna Serafin
- Department of Anesthesiology & Critical Care Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Emily Lin
- Department of Anesthesiology & Critical Care Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Leslie Sarraf
- Department of Anesthesiology & Critical Care Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Geema Masson
- Department of Anesthesiology & Critical Care Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Tracy-Ann Moo
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Jonas A Nelson
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Brett A Simon
- Department of Anesthesiology & Critical Care Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Andrew J Vickers
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
2
|
Wilson MG, Palmer E, Asselbergs FW, Harris SK. Integrated rapid-cycle comparative effectiveness trials using flexible point of care randomisation in electronic health record systems. J Biomed Inform 2023; 137:104273. [PMID: 36535604 DOI: 10.1016/j.jbi.2022.104273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 10/13/2022] [Accepted: 12/12/2022] [Indexed: 12/23/2022]
Abstract
Whilst the Randomised Controlled Trial remains the gold standard for deriving robust causal estimates of treatment efficacy, too often a traditional design proves prohibitively expensive or cumbersome when it comes to assessing questions regarding the comparative effectiveness of routinely used treatments. As a result, patients experience variation in practice as clinicians lack the evidence needed to personalise treatments effectively. This variation may be classified as unwarranted, where existing evidence is ignored, or legitimate where in the absence of evidence, clinicians rely on experience, expert opinion, and inferred principles from basic science to make decisions. We argue that within the right ethical and technological framework, legitimate variation can be transformed into a mechanism for evidence generation and learning. Learning Health Systems which harness existing variation in practice, represent a novel approach for generating evidence from everyday clinical practice. The development of these systems has gained traction due to the increased availability of modern Electronic Health Record Systems. However, despite their promise, overcoming hurdles to successfully integrating clinical trials within Learning Health Systems has proven challenging. This article describes the origins of integrated clinical trials and explores two main barriers to their further implementation - how best to obtain informed consent from patients to participate in routine comparative effectiveness research, and how to automate and integrate randomisation into a clinical workflow. Having described these barriers, we present a potential solution in the form of a research pipeline using a novel form of flexible point-of-care randomisation to allow clinicians and patients to participate in studies where there is clinical equipoise.
Collapse
Affiliation(s)
- Matthew G Wilson
- Institute of Health Informatics, Faculty of Population Health Sciences, University College London, UK.
| | - Edward Palmer
- Bloomsbury Institute of Intensive Care Medicine, University College London, UK; Whittington Hospital NHS Trust, UK
| | - Folkert W Asselbergs
- Institute of Cardiovascular Science and Institute of Health Informatics, Faculty of Population Health Sciences, University College London, UK; Department of Cardiology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
| | - Steve K Harris
- Institute of Health Informatics, Faculty of Population Health Sciences, University College London, UK; Critical Care Department, University College London Hospital, UK
| |
Collapse
|
3
|
Clements MB, Gmelich CC, Vertosick EA, Hu JC, Sandhu JS, Scardino PT, Eastham JA, Laudone VP, Touijer KA, Coleman JA, Vickers AJ, Ehdaie B. Have urinary function outcomes after radical prostatectomy improved over the past decade? Cancer 2022; 128:1066-1073. [PMID: 34724196 PMCID: PMC8837675 DOI: 10.1002/cncr.33994] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Revised: 08/29/2021] [Accepted: 09/20/2021] [Indexed: 11/07/2022]
Abstract
BACKGROUND Changes in surgical technique and postoperative care that target improvements in functional outcomes are widespread in the literature. Radical prostatectomy (RP) is one such procedure that has seen multiple advances over the past decade. The objective of this study was to leverage RP as an index case to determine whether practice changes over time produced observable improvements in patient-reported outcomes. METHODS This study analyzed patients undergoing RP by experienced surgeons at a tertiary care center with prospectively maintained patient-reported outcome data from 2008 to 2019. Four patient-reported urinary function outcomes at 6 and 12 months after RP were defined with a validated instrument: good urinary function (domain score ≥ 17), no incontinence (0 pads per day), social continence (≤1 pad per day), and severe incontinence (≥3 pads per day). Multivariable logistic regressions evaluated changes in outcomes based on the surgical date. RESULTS Among 3945 patients meeting the inclusion criteria, excellent urinary outcomes were reported throughout the decade but without consistent observable improvements over time. Specifically, there were no improvements in good urinary function at 12 months (P = .087) based on the surgical date, and there were countervailing effects on no incontinence (worsening; P = .005) versus severe incontinence (improving; P = .003). Neither approach (open, laparoscopic, or robotic), nor nerve sparing, nor membranous urethral length mediated changes in outcomes. CONCLUSIONS In a decade with multiple advances in surgical and postoperative care, there was evidence of improvements in severe incontinence, but no measurable improvements across 3 other urinary outcomes. Although worsening disease factors could contribute to the stable observed outcomes, a more systematic approach to evaluating techniques and implementing patient selection and postoperative care advances is needed. LAY SUMMARY Although there have been advances in radical prostatectomy over the past decade, consistent observable improvements in postoperative incontinence were not reported by patients. To improve urinary function outcomes beyond the current high standard, the approach to studying innovations in surgical technique needs to be changed, and further development of other aspects of prostatectomy care is needed.
Collapse
Affiliation(s)
- Matthew B. Clements
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Caroline C. Gmelich
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Emily A. Vertosick
- Department of Epidemiology & Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Jim C. Hu
- Department of Urology, Weill Cornell Medicine, New York, NY
| | - Jaspreet S. Sandhu
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Peter T. Scardino
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - James A. Eastham
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Vincent P. Laudone
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Karim A. Touijer
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Jonathan A. Coleman
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Andrew J. Vickers
- Department of Epidemiology & Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Behfar Ehdaie
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY,Corresponding author: Behfar Ehdaie, Memorial Sloan Kettering Cancer Center, 1275 York Avenue, New York, NY 10065, T: 646-422-4406, F: 212-988-0759,
| |
Collapse
|
4
|
Touijer KA, Sjoberg DD, Benfante N, Laudone VP, Ehdaie B, Eastham JA, Scardino PT, Vickers A. Limited versus Extended Pelvic Lymph Node Dissection for Prostate Cancer: A Randomized Clinical Trial. Eur Urol Oncol 2021; 4:532-539. [PMID: 33865797 DOI: 10.1016/j.euo.2021.03.006] [Citation(s) in RCA: 103] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Revised: 03/08/2021] [Accepted: 03/19/2021] [Indexed: 01/23/2023]
Abstract
BACKGROUND Pelvic lymph node dissection (PLND) is the most reliable procedure for lymph node staging. However, the therapeutic benefit remains unproven; although most radical prostatectomies at academic centers are accompanied by PLND, there is no consensus regarding the optimal anatomical extent of PLND. OBJECTIVE To evaluate whether extended PLND results in a lower biochemical recurrence rate. DESIGN, SETTING, AND PARTICIPANTS We conducted a single-center randomized trial. Patients, enrolled between October 2011 and March 2017, were scheduled to undergo radical prostatectomy and PLND. Patients were assigned to limited or extended PLND by cluster randomization. Specifically, surgeons were randomized to perform limited or extended PLND for 3-mo periods. INTERVENTION Randomization to limited (external iliac nodes) or extended (external iliac, obturator fossa and hypogastric nodes) PLND. OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS The primary endpoint was the rate of biochemical recurrence. RESULTS AND LIMITATIONS Of 1440 patients included in the final analysis, 700 were randomized to limited PLND and 740 to extended PLND. The median number of nodes retrieved was 12 (interquartile range [IQR] 8-17) for limited PLND and 14 (IQR 10-20) extended PLND; the corresponding rate of positive nodes was 12% and 14% (difference -1.9%, 95% confidence interval [CI] -5.4% to 1.5%; p = 0.3). With median follow-up of 3.1 yr, there was no significant difference in the rate of biochemical recurrence between the groups (hazard ratio 1.04, 95% CI 0.93-1.15; p = 0.5). Rates for grade 2 and 3 complications were similar at 7.3% for limited versus 6.4% for extended PLND; there were no grade 4 or 5 complications. CONCLUSIONS Extended PLND did not improve freedom from biochemical recurrence over limited PLND for men with clinically localized prostate cancer. However, there were smaller than expected differences in nodal count and the rate of positive nodes between the two templates. A randomized trial comparing PLND to no node dissection is warranted. PATIENT SUMMARY In this clinical trial we did not find a difference in the rate of biochemical recurrence of prostate cancer between limited and extended dissection of lymph nodes in the pelvis. This study is registered on ClinicalTrials.gov as NCT01407263.
Collapse
Affiliation(s)
- Karim A Touijer
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
| | - Daniel D Sjoberg
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Nicole Benfante
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Vincent P Laudone
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Behfar Ehdaie
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - James A Eastham
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Peter T Scardino
- Urology Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Andrew Vickers
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
5
|
Lam KC, Bacon CEW, Sauers EL, Bay RC. Point-of-Care Clinical Trials in Sports Medicine Research: Identifying Effective Treatment Interventions Through Comparative Effectiveness Research. J Athl Train 2019; 55:217-228. [PMID: 31618071 DOI: 10.4085/1062-6050-307-18] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
CONTEXT Recently, calls to conduct comparative effectiveness research (CER) in athletic training to better support patient care decisions have been circulated. Traditional research methods (eg, randomized controlled trials [RCTs], observational studies) may be ill suited for CER. Thus, innovative research methods are needed to support CER efforts. OBJECTIVES To discuss the limitations of traditional research designs in CER studies, describe a novel methodologic approach called the point-of-care clinical trial (POC-CT), and highlight components of the POC-CT (eg, incorporation of an electronic medical record [EMR], Bayesian adaptive feature) that allow investigators to conduct scientifically rigorous studies at the point of care. DESCRIPTION Practical concerns (eg, high costs and limited generalizability of RCTs, the inability to control for bias in observational studies) may stall CER efforts in athletic training. In short, the aim of the POC-CT is to embed a randomized pragmatic trial into routine care; thus, patients are randomized to minimize potential bias, but the study is conducted at the point of care to limit cost and improve the generalizability of the findings. Furthermore, the POC-CT uses an EMR to replace much of the infrastructure associated with a traditional RCT (eg, research team, patient and clinician reminders) and a Bayesian adaptive feature to help limit the number of patients needed for the study. Together, the EMR and Bayesian adaptive feature can improve the overall feasibility of the study and preserve the typical clinical experiences of the patient and clinician. CLINICAL ADVANTAGES The POC-CT includes the basic tenets of practice-based research because studies are conducted at the point of care, in real-life settings, and during routine clinical practice. If implemented effectively, the POC-CT can be seamlessly integrated into daily clinical practice, allowing investigators to establish patient-reported evidence that may be quickly applied to patient care decisions. This design appears to be a promising approach for CER investigations and may help establish a "learning health care system" in the sports medicine community.
Collapse
Affiliation(s)
- Kenneth C Lam
- Department of Interdisciplinary Health Sciences, A.T. Still University, Mesa
| | - Cailee E Welch Bacon
- Department of Interdisciplinary Health Sciences, A.T. Still University, Mesa.,School of Osteopathic Medicine in Arizona, A.T. Still University, Mesa
| | - Eric L Sauers
- Department of Interdisciplinary Health Sciences, A.T. Still University, Mesa.,School of Osteopathic Medicine in Arizona, A.T. Still University, Mesa
| | - R Curtis Bay
- Department of Interdisciplinary Health Sciences, A.T. Still University, Mesa
| |
Collapse
|
6
|
Abstract
There is growing consensus that the US clinical trials system is broken, with trial costs and complexity increasing exponentially, and many trials failing to accrue. Yet, concerns about the expense and failure rate of randomized trials are only the tip of the iceberg; perhaps what should worry us most is the number of trials that are not even considered because of projected costs and poor accrual. Several initiatives, including the Clinical Trials Transformation Initiative and the "Sensible Guidelines Group" seek to push back against current trends in clinical trials, arguing that all aspects of trials-including design, approval, conduct, monitoring, analysis, and dissemination-should be based on evidence rather than contemporary norms. Proposed here are four methodologic fixes for current clinical trials. The first two aim to simplify trials, reducing costs, and increasing patient acceptability by dramatically reducing eligibility criteria-often to the single criterion that the consenting physician is uncertain which of the two randomized arms is optimal-and by clinical integration, investment in data infrastructure to bring routinely collected data up to research grade to be used as endpoints in trials. The second two methodologic fixes aim to shed barriers to accrual, either by cluster randomization of clinicians (in the case of modifications to existing treatment) or by early consent, where patients are offered the chance of being randomly selected to be offered a novel intervention if disease progresses at a subsequent point. Such solutions may be partial, or result in a new set of problems of their own. Yet, the current crisis in clinical trials mandates innovative approaches: randomized trials have resulted in enormous benefits for patients, and we need to ensure that they continue to do so.
Collapse
|
7
|
Abstract
Tissue-preserving focal therapies, such as brachytherapy, cryotherapy, high-intensity focused ultrasound and photodynamic therapy, aim to target individual cancer lesions rather than the whole prostate. These treatments have emerged as potential interventions for localized prostate cancer to reduce treatment-related adverse-effects associated with whole-gland treatments, such as radical prostatectomy and radiotherapy. In this article, the Prostate Cancer RCT Consensus Group propose that a novel cohort-embedded randomized controlled trial (RCT) would provide a means to study men with clinically significant localized disease, which we defined on the basis of PSA level (≤ 15 ng/ml or ≤ 20 ng/ml), Gleason grade (Gleason pattern ≤ 4 + 4 or ≤ 4 + 3) and stage (≤ cT2cN0M0). This RCT should recruit men who stand to benefit from treatment, with the control arm being whole-gland surgery or radiotherapy. Composite outcomes measuring rates of local and systemic salvage therapies at 3-5 years might best constitute the basis of the primary outcome on which to change practice.
Collapse
|