Optimizing the design of invasive placebo interventions in randomized controlled trials

How pragmatic are randomised controlled trials evaluating minimally invasive surgery for oesophageal cancer? A methodological review of trial design using the Pragmatic-Explanatory Continuum Indicator Summary-2 (PRECIS-2) tool

BACKGROUND

Surgical interventions are inherently complex and designing and conducting surgical randomised controlled trials (RCTs) can be challenging. Trial design impacts the applicability of trial results to clinical practice. Given the recent growth in numbers of surgical RCTs, there is a need to better understand the validity and applicability of trials in this field.

OBJECTIVES

To examine the applicability and validity of RCTs comparing minimally invasive and open surgery for oesophageal cancer and to delineate areas for future research.

ELIGIBILITY CRITERIA

RCTs comparing open with minimal invasive oesophagectomy, published January 2012-June 2023. Abstracts, pilot and feasibility studies, and systematic reviews were excluded.

SOURCES OF EVIDENCE

Three sequential searches of Ovid MEDLINE, Embase and CENTRAL electronic databases and clinical trials registry databases.

CHARTING METHODS

Two independent reviewers screened the articles and used appropriate, validated tools (Pragmatic-Explanatory Continuum Indicator Summary-2 (PRECIS-2) and Risk of Bias 2) to assess study quality. Trials were considered pragmatic if they were conducted in multiple centres and had a mean score of four or above on the PRECIS-2.

RESULTS

Nine RCTs were identified. One was judged to be pragmatic. The remaining eight were limited by narrow eligibility criteria, being single-centred or having strict intervention protocols. Two studies were low risk of bias, of which one was pragmatic, and three high, due to unblinded outcome assessment. The remaining four studies were of 'some concern' due to poor reporting.

CONCLUSIONS

Only one trial identified in this review was considered pragmatic. More lenient criteria, as used in other reviews, may increase the proportion. There is a need for clearer guidance on the cut-off values that define a trial as pragmatic. It is recommended that the intended purpose of the trial, whether explanatory or pragmatic, receives more attention during surgical trial study design and conduct.

Placebo Control and Blinding in Randomized Trials of Procedural Interventions: A Systematic Review and Meta-Regression

Importance

Unlike medications, procedural interventions are rarely trialed against placebo prior to becoming accepted in clinical practice. When placebo-controlled trials are eventually conducted, procedural interventions may be less effective than previously believed.

Objective

To investigate the importance of including a placebo arm in trials of surgical and interventional procedures by comparing effect sizes from trials of the same procedure that do and do not include a placebo arm.

Data Sources

Searches of MEDLINE and Embase identified all placebo-controlled trials for procedural interventions in any specialty of medicine and surgery from inception to March 31, 2019. A secondary search identified randomized clinical trials assessing the same intervention, condition, and end point but without a placebo arm for paired comparison.

Study Selection

Placebo-controlled trials of anatomically site-specific procedures requiring skin incision or endoscopic techniques were eligible for inclusion; these were then matched to trials without placebo control that fell within prespecified limits of heterogeneity.

Data Extraction and Synthesis

Random-effects meta-regression, with placebo and blinding as a fixed effect and intervention and end point grouping as random effects, was used to calculate the impact of placebo control for each end point. Data were analyzed from March 2019 to March 2020.

Main Outcomes and Measures

End points were examined in prespecified subgroups: patient-reported or health care professional-assessed outcomes, quality of life, pain, blood pressure, exercise-related outcomes, recurrent bleeding, and all-cause mortality.

Results

Ninety-seven end points were matched from 72 blinded, placebo-controlled trials (hereafter, blinded) and 55 unblinded trials without placebo control (hereafter, unblinded), including 111 500 individual patient end points. Unblinded trials had larger standardized effect sizes than blinded trials for exercise-related outcomes (standardized mean difference [SMD], 0.59; 95% CI, 0.29 to 0.89; P < .001) and quality-of-life (SMD, 0.32; 95% CI, 0.11 to 0.53; P = .003) and health care professional-assessed end points (SMD, 0.40; 95% CI, 0.18 to 0.61; P < .001). The placebo effect accounted for 88.1%, 55.2%, and 61.3% of the observed unblinded effect size for these end points, respectively. There was no significant difference between unblinded and blinded trials for patient-reported end points (SMD, 0.31; 95% CI, -0.02 to 0.64; P = .07), blood pressure (SMD, 0.26; 95% CI, -0.10 to 0.62; P = .15), all-cause mortality (odds ratio [OR], 0.23; 95% CI, -0.26 to 0.72; P = .36), pain (SMD, 0.03; 95% CI, -0.52 to 0.57; P = .91), or recurrent bleeding events (OR, -0.12; 95% CI, -1.11 to 0.88; P = .88).

Conclusions and Relevance

The magnitude of the placebo effect found in this systematic review and meta-regression was dependent on the end point. Placebo control in trials of procedural interventions had the greatest impact on exercise-related, quality-of-life, and health care professional-assessed end points. Randomized clinical trials of procedural interventions may consider placebo control accordingly.

Randomized controlled trials comparing gastric bypass, gastric band, and sleeve gastrectomy: A systematic review examining validity and applicability to wider clinical practice

Consideration of how applicable the results of surgical trials are to clinical practice is important to inform decision-making. Randomized controlled trials comparing at least two surgical interventions (of gastric bypass, gastric band, and sleeve gastrectomy) for severe and complex obesity were examined using the PRagmatic Explanatory Continuum Indicator Summary-2 tool, to consider how applicable the trial results are to clinical practice, and the Risk of Bias 2 tool, to examine validity. MEDLINE, Embase, and CENTRAL databases were searched for studies published between November 2013 and June 2021, and 15 were identified. Using the PRagmatic Explanatory Continuum Indicator Summary-2 tool, three were classified as pragmatic, with good applicability to clinical practice. Ten had more explanatory domains but did include some pragmatic characteristics, and two were predominantly explanatory. This was due to some trial design features that would not be considered applicable to the wider clinical setting, including being single-centered, having prescribed intervention delivery methods, and intensive follow-up regimens. Only two trials had low risk of bias, of which one was considered pragmatic. Three had high risk of bias. Overall, few trials in bariatric surgery are pragmatic with low risk of bias. Well-designed pragmatic trials are needed to inform practice and reduce research waste.

Coronary sinus reducer for the treatment of refractory angina (ORBITA-COSMIC): a randomised, placebo-controlled trial

BACKGROUND

The coronary sinus reducer (CSR) is proposed to reduce angina in patients with stable coronary artery disease by improving myocardial perfusion. We aimed to measure its efficacy, compared with placebo, on myocardial ischaemia reduction and symptom improvement.

METHODS

ORBITA-COSMIC was a double-blind, randomised, placebo-controlled trial conducted at six UK hospitals. Patients aged 18 years or older with angina, stable coronary artery disease, ischaemia, and no further options for treatment were eligible. All patients completed a quantitative adenosine-stress perfusion cardiac magnetic resonance scan, symptom and quality-of-life questionnaires, and a treadmill exercise test before entering a 2-week symptom assessment phase, in which patients reported their angina symptoms using a smartphone application (ORBITA-app). Patients were randomly assigned (1:1) to receive either CSR or placebo. Both participants and investigators were masked to study assignment. After the CSR implantation or placebo procedure, patients entered a 6-month blinded follow-up phase in which they reported their daily symptoms in the ORBITA-app. At 6 months, all assessments were repeated. The primary outcome was myocardial blood flow in segments designated ischaemic at enrolment during the adenosine-stress perfusion cardiac magnetic resonance scan. The primary symptom outcome was the number of daily angina episodes. Analysis was done by intention-to-treat and followed Bayesian methodology. The study is registered with ClinicalTrials.gov, NCT04892537, and completed.

FINDINGS

Between May 26, 2021, and June 28, 2023, 61 patients were enrolled, of whom 51 (44 [86%] male; seven [14%] female) were randomly assigned to either the CSR group (n=25) or the placebo group (n=26). Of these, 50 patients were included in the intention-to-treat analysis (24 in the CSR group and 26 in the placebo group). 454 (57%) of 800 imaged cardiac segments were ischaemic at enrolment, with a median stress myocardial blood flow of 1·08 mL/min per g (IQR 0·77-1·41). Myocardial blood flow in ischaemic segments did not improve with CSR compared with placebo (difference 0·06 mL/min per g [95% CrI -0·09 to 0·20]; Pr(Benefit)=78·8%). The number of daily angina episodes was reduced with CSR compared with placebo (OR 1·40 [95% CrI 1·08 to 1·83]; Pr(Benefit)=99·4%). There were two CSR embolisation events in the CSR group, and no acute coronary syndrome events or deaths in either group.

INTERPRETATION

ORBITA-COSMIC found no evidence that the CSR improved transmural myocardial perfusion, but the CSR did improve angina compared with placebo. These findings provide evidence for the use of CSR as a further antianginal option for patients with stable coronary artery disease.

FUNDING

Medical Research Council, Imperial College Healthcare Charity, National Institute for Health and Care Research Imperial Biomedical Research Centre, St Mary's Coronary Flow Trust, British Heart Foundation.

A Placebo-Controlled Trial of Percutaneous Coronary Intervention for Stable Angina

BACKGROUND

Percutaneous coronary intervention (PCI) is frequently performed to reduce the symptoms of stable angina. Whether PCI relieves angina more than a placebo procedure in patients who are not receiving antianginal medication remains unknown.

METHODS

We conducted a double-blind, randomized, placebo-controlled trial of PCI in patients with stable angina. Patients stopped all antianginal medications and underwent a 2-week symptom assessment phase before randomization. Patients were then randomly assigned in a 1:1 ratio to undergo PCI or a placebo procedure and were followed for 12 weeks. The primary end point was the angina symptom score, which was calculated daily on the basis of the number of angina episodes that occurred on a given day, the number of antianginal medications prescribed on that day, and clinical events, including the occurrence of unblinding owing to unacceptable angina or acute coronary syndrome or death. Scores range from 0 to 79, with higher scores indicating worse health status with respect to angina.

RESULTS

A total of 301 patients underwent randomization: 151 to the PCI group and 150 to the placebo group. The mean (±SD) age was 64±9 years, and 79% were men. Ischemia was present in one cardiac territory in 242 patients (80%), in two territories in 52 patients (17%), and in three territories in 7 patients (2%). In the target vessels, the median fractional flow reserve was 0.63 (interquartile range, 0.49 to 0.75), and the median instantaneous wave-free ratio was 0.78 (interquartile range, 0.55 to 0.87). At the 12-week follow-up, the mean angina symptom score was 2.9 in the PCI group and 5.6 in the placebo group (odds ratio, 2.21; 95% confidence interval, 1.41 to 3.47; P<0.001). One patient in the placebo group had unacceptable angina leading to unblinding. Acute coronary syndromes occurred in 4 patients in the PCI group and in 6 patients in the placebo group.

CONCLUSIONS

Among patients with stable angina who were receiving little or no antianginal medication and had objective evidence of ischemia, PCI resulted in a lower angina symptom score than a placebo procedure, indicating a better health status with respect to angina. (Funded by the National Institute for Health and Care Research Imperial Biomedical Research Centre and others; ORBITA-2 ClinicalTrials.gov number, NCT03742050.).

How do pilot and feasibility studies inform randomised placebo-controlled trials in surgery? A systematic review

INTRODUCTION

Randomised controlled trials (RCTs) with a placebo comparator are considered the gold standard study design when evaluating healthcare interventions. These are challenging to design and deliver in surgery. Guidance recommends pilot and feasibility work to optimise main trial design and conduct; however, the extent to which this occurs in surgery is unknown.

METHOD

A systematic review identified randomised placebo-controlled surgical trials. Articles published from database inception to 31 December 2020 were retrieved from Ovid-MEDLINE, Ovid-EMBASE and CENTRAL electronic databases, hand-searching and expert knowledge. Pilot/feasibility work conducted prior to the RCTs was then identified from examining citations and reference lists. Where studies explicitly stated their intent to inform the design and/or conduct of the future main placebo-controlled surgical trial, they were included. Publication type, clinical area, treatment intervention, number of centres, sample size, comparators, aims and text about the invasive placebo intervention were extracted.

RESULTS

From 131 placebo surgical RCTs included in the systematic review, 47 potentially eligible pilot/feasibility studies were identified. Of these, four were included as true pilot/feasibility work. Three were original articles, one a conference abstract; three were conducted in orthopaedic surgery and one in oral and maxillofacial surgery. All four included pilot RCTs, with an invasive surgical placebo intervention, randomising 9-49 participants in 1 or 2 centres. They explored the acceptability of recruitment and the invasive placebo intervention to patients and trial personnel, and whether blinding was possible. One study examined the characteristics of the proposed invasive placebo intervention using in-depth interviews.

CONCLUSION

Published studies reporting feasibility/pilot work undertaken to inform main placebo surgical trials are scarce. In view of the difficulties of undertaking placebo surgical trials, it is recommended that pilot/feasibility studies are conducted, and more are reported to share key findings and optimise the design of main RCTs.

PROSPERO REGISTRATION NUMBER

CRD42021287371.

Global trends and hotspots in research on acupuncture for stroke: a bibliometric and visualization analysis

Acupuncture has been widely used in stroke and post-stroke rehabilitation (PSR), but there is no literature on the bibliometric analysis of acupuncture for stroke. This study aimed to characterize the global publications and analyze the trends of acupuncture for stroke in the past 40 years. We identified 1157 publications from the Web of Science Core Collection. The number of publications grew slowly in the first three decades from 1980 until it started to grow after 2010, with significant growth in 2011-2012 and 2019-2020. China, the USA, and South Korea are the top three countries in this field, and China has formed good internal cooperative relations. Early studies focused on the clinical efficacy of acupuncture for stroke. In the last five years, more emphasis has been placed on the effectiveness of acupuncture in treating sequelae and complications, combined with neuroimaging studies to explore the mechanisms of brain injury repair and neurological recovery. Acupuncture for stroke has a vast research potential, and researchers from different countries/regions and organizations still need to remove academic barriers to enhance communication and collaboration.

Further considerations for placebo controls in surgical trials

The use of invasive placebo controls in surgical trials can be challenging. The ASPIRE guidance, published in the Lancet in 2020, provided advice for the design and conduct of surgical trials with an invasive placebo control. Based on a more recent international expert workshop in June 2022, we now provide further insights into this topic. These include the purpose and design of invasive placebo controls, patient information provision and how findings from these trials may be used to inform decision-making.

Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article I): a systematic review and description of methods

ABSTRACT

Blinding is challenging in randomised controlled trials of physical, psychological, and self-management therapies for pain, mainly because of their complex and participatory nature. To develop standards for the design, implementation, and reporting of control interventions in efficacy and mechanistic trials, a systematic overview of currently used sham interventions and other blinding methods was required. Twelve databases were searched for placebo or sham-controlled randomised clinical trials of physical, psychological, and self-management treatments in a clinical pain population. Screening and data extraction were performed in duplicate, and trial features, description of control methods, and their similarity to the active intervention under investigation were extracted (protocol registration ID: CRD42020206590). The review included 198 unique control interventions, published between 2008 and December 2021. Most trials studied people with chronic pain, and more than half were manual therapy trials. The described control interventions ranged from clearly modelled based on the active treatment to largely dissimilar control interventions. Similarity between control and active interventions was more frequent for certain aspects (eg, duration and frequency of treatments) than others (eg, physical treatment procedures and patient sensory experiences). We also provide an overview of additional, potentially useful methods to enhance blinding, as well as the reporting of processes involved in developing control interventions. A comprehensive picture of prevalent blinding methods is provided, including a detailed assessment of the resemblance between active and control interventions. These findings can inform future developments of control interventions in efficacy and mechanistic trials and best-practice recommendations.

The challenges of a randomised placebo-controlled trial of CTO PCI vs. placebo with optimal medical therapy: The ORBITA-CTO pilot study design and protocol

Background

Percutaneous coronary intervention (PCI) for coronary chronic total occlusion (CTO) has been performed for the improvement of symptoms and quality of life in patients with stable angina. The ORBITA study demonstrated the role of the placebo effect in contemporary PCI in non-CTO chronic coronary syndromes. However, the benefit of CTO PCI beyond that of a placebo has not been demonstrated.

Aims

The ORBITA-CTO pilot study will be a double-blind, placebo-controlled study of CTO PCI randomising patients who have: (1) been accepted by a CTO operator for PCI; (2) experienced symptoms due to a CTO; (3) evidence of ischaemia; (4) evidence of viability within the CTO territory; and (5) a J-CTO score ≤3.

Methods

Patients will undergo medication optimisation that will ensure they are on at least a minimum amount of anti-anginals and complete questionnaires. Patients will record their symptoms on an app daily throughout the study. Patients will undergo randomisation procedures, including an overnight stay, and be discharged the following day. All anti-anginals will be stopped after randomisation and re-initiated on a patient-led basis during the 6-month follow-up period. At follow-up, patients will undergo repeat questionnaires and unblinding, with a further 2-week unblinded follow-up.

Results

The co-primary outcomes are feasibility (blinding) in this cohort and angina symptom score using an ordinal clinical outcome scale for angina. Secondary outcomes include changes in quality-of-life measures, Seattle Angina Questionnaire (SAQ), peak VO2, and anaerobic threshold on the cardiopulmonary exercise test.

Conclusion

The feasibility of a placebo-controlled CTO PCI study will lead to future studies assessing efficacy. The impact of CTO PCI on angina measured using a novel daily symptom app may provide improved fidelity in assessing symptoms in patients with CTO's.

Learning from the past to plan for the future: A scoping review of musculoskeletal clinical research in Sweden 2010-2020

Background

The aims of this study are to 1) determine the scope of musculoskeletal (MSK)-related clinical research in Sweden; 2) collate the amount of first-tier funding received; 3) discuss strategies and infrastructure supporting future MSK clinical trials in Sweden.

Methods

A systematic scoping review protocol was applied in PubMed, Scopus, and SweCRIS databases. The articles were examined, and data were extracted in multiple stages by three blinded authors.

Results

The search strategy resulted in 3,025 publications from 479 Swedish-affiliated authors. Primary health care was the basis for 14% of the publications, 84% from secondary health care, and 2% from occupational health care with a similar proportional distribution of first-tier research grant financing. Approximately one in six publications were randomized controlled trials (RCTs), while the majority were of observational cohort design. The majority of publications in primary and occupational health care were related to pain disorders (51 and 67%, respectively), especially diagnosis, prognosis, and healthcare organizational-related interventions (34%) and rehabilitation (15%) with similar proportional distribution of first-tier research grant financing. In secondary health care, rheumatic inflammatory disorder-related publications were most prevalent (30%), most frequently concerning diagnosis, prognosis, and healthcare organizational-related interventions (20%), attracting approximately half of all first-tier funding. Publications related to degenerative joint disorders (25%), fractures (16%), and joint, tendon, and muscle injuries (13%) frequently concerned surgical and other orthopedic-related interventions (16, 6, and 8%, respectively). Pain disorder-related publications (10%) as well as bone health and osteoporosis-related publications (4%) most frequently concerned diagnosis, prognosis, and healthcare organizational-related interventions (5 and 3%, respectively).

Conclusions

Swedish-affiliated MSK disorder research 2010-2020 was predominantly observational cohort rather than RCT based. There was skewed first-tier funding allocation considering prevalence/incidence and burden of disease. Use of infrastructure supporting register-based RCTs, placebo-controlled RCTs, and hybrid effectiveness-implementation studies on prevention and clinical intervention is important strategies for the future in all healthcare sectors.

Placebo comparator group selection and use in surgical trials: the ASPIRE project including expert workshop

BACKGROUND

The use of placebo comparisons for randomised trials assessing the efficacy of surgical interventions is increasingly being considered. However, a placebo control is a complex type of comparison group in the surgical setting and, although powerful, presents many challenges.

OBJECTIVES

To provide a summary of knowledge on placebo controls in surgical trials and to summarise any recommendations for designers, evaluators and funders of placebo-controlled surgical trials.

DESIGN

To carry out a state-of-the-art workshop and produce a corresponding report involving key stakeholders throughout.

SETTING

A workshop to discuss and summarise the existing knowledge and to develop the new guidelines.

RESULTS

To assess what a placebo control entails and to assess the understanding of this tool in the context of surgery is considered, along with when placebo controls in surgery are acceptable (and when they are desirable). We have considered ethics arguments and regulatory requirements, how a placebo control should be designed, how to identify and mitigate risk for participants in these trials, and how such trials should be carried out and interpreted. The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Surgical placebos might be most appropriate when there is poor evidence for the efficacy of the procedure and a justified concern that results of a trial would be associated with a high risk of bias, particularly because of the placebo effect.

CONCLUSIONS

The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Feasibility work is recommended to optimise the design and implementation of randomised controlled trials. An outline for best practice was produced in the form of the Applying Surgical Placebo in Randomised Evaluations (ASPIRE) guidelines for those considering the use of a placebo control in a surgical randomised controlled trial.

LIMITATIONS

Although the workshop participants involved international members, the majority of participants were from the UK. Therefore, although every attempt was made to make the recommendations applicable to all health systems, the guidelines may, unconsciously, be particularly applicable to clinical practice in the UK NHS.

FUTURE WORK

Future work should evaluate the use of the ASPIRE guidelines in making decisions about the use of a placebo-controlled surgical trial. In addition, further work is required on the appropriate nomenclature to adopt in this space.

FUNDING

Funded by the Medical Research Council UK and the National Institute for Health Research as part of the Medical Research Council-National Institute for Health Research Methodology Research programme.