Series: Pragmatic trials and real world evidence: Paper 3. Patient selection challenges and consequences

Instrumental variables for implementation science: exploring context-dependent causal pathways between implementation strategies and evidence-based interventions

BACKGROUND

The impact of both implementation strategies (IS) and evidence-based interventions (EBI) can vary across contexts, and a better understanding of how and why this occurs presents fundamental but challenging questions that implementation science as a field will need to grapple with. We use causal epidemiologic methods to explore the mechanisms of why sharp distinctions between implementation strategies (IS) and efficacy of an evidence-based intervention (EBI) may fail to recognize that the effect of an EBI can be deeply intertwined and dependent on the context of the IS leading to its uptake.

METHODS

We explore the use of instrumental variable (IV) analyses as a critical tool for implementation science methods to isolate three relevant quantities within the same intervention context when exposure to an implementation strategy is random: (1) the effect of an IS on implementation outcomes (e.g., uptake), (2) effect of EBI uptake on patient outcomes, and (3) overall effectiveness of the IS (i.e., ~ implementation*efficacy). We discuss the mechanisms by which an implementation strategy can alter the context, and therefore effect, of an EBI using the underlying IV assumptions. We illustrate these concepts using examples of the implementation of new ART initiation guidelines in Zambia and community-based masking programs in Bangladesh.

RESULTS

Causal questions relevant to implementation science are answered at each stage of an IV analysis. The first stage assesses the effect of the IS (e.g., new guidelines) on EBI uptake (e.g., same-day treatment initiation). The second stage leverages the IS as an IV to estimate the complier average causal effect (CACE) of the EBI on patient outcomes (e.g., effect of same-day treatment initiation on viral suppression). The underlying assumptions of CACE formalize that the causal effect of EBI may differ in the context of a different IS because (1) the mechanisms by which individuals uptake an intervention may differ and (2) the subgroup of individuals who take up an EBI may differ. IV methods thus provide a conceptual framework for how IS and EBIs are linked and that the IS itself needs to be considered a critical contextual determinant. Moreover, it also provides rigorous methodologic tools to isolate the effect of an IS, EBI, and combined effect of the IS and EBI.

DISCUSSION

Leveraging IV methods when exposure to an implementation strategy is random helps to conceptualize the context-dependent nature of implementation strategies, EBIs, and patient outcomes. IV methods formalize that the causal effect of an EBI may be specific to the context of the implementation strategy used to promote uptake. This integration of implementation science concepts and theory with rigorous causal epidemiologic methods yields novel insights and provides important tools for exploring the next generation of questions related to mechanisms and context in implementation science.

Comparison of GUMMETAL® and stainless steel alloy during canine retraction: A pilot split-mouth randomized controlled trial

OBJECTIVES

A TiNb alloy wire (GUMMETAL® [GM], Toyota Central R&D Labs, Inc., Nagakute, Japan) was recently developed with unique properties for orthodontic applications. This pilot split-mouth randomized controlled trial compared maxillary canine retraction during space closure using sliding mechanics on GM vs. stainless steel (SS) archwires.

METHODS

Subjects who met the inclusion criteria were treated with fixed appliances and maxillary first-premolar extractions between September 2020 and March 2022. After leveling and aligning, maxillary archwires, fabricated by crimping together segments of 0.016×0.022" GM and SS archwires, were placed and canine retraction initiated using nickel-titanium coil springs. Digital models of the maxillary arch were superimposed at 0, 4, 8 and 12 weeks and the amount of canine movement (mm), rate of movement (mm/month), and 3-dimensional changes (rotational, vertical extrusion, tip) were measured and compared statistically.

RESULTS

Of the 12 subjects recruited, only six completed the study with a median age of 15.8 years (12.0-17.4 years). At 12 weeks, the median canine retraction was 3.41mm (IQR: 2.10, 4.76) with GM versus 3.71mm (IQR: 1.62, 6.45) with SS. The retraction rate was 1.14mm/month (IQR: 0.69, 1.59) with GM, versus 1.24mm/month (IQR: 0.54, 2.15) with SS. The median rotational, vertical and tip changes of the canine were 7.90̊, 0.59mm and 6.15̊ with GM, and 7.25̊, 0.29mm and 2.05̊ with SS. Intergroup differences with all measurements were not statistically significant.

CONCLUSION

No significant differences were found between GM and SS during maxillary canine retraction. GM demonstrated clinical potential for space closure mechanics, however, future larger studies are needed.

Critical path activities in clinical trial setup and conduct: How to avoid bottlenecks and accelerate clinical trials

Most clinical trials are delayed due to scientific and/or operational challenges. Any effort to minimize delays can generate value for patients and sponsors. This article reviews critical path process steps commonly identified by practitioners, such as during protocol development, site contracting, or patient recruitment. Commonly considered measures, such as adding more trial sites or countries, were contrasted with less frequented measures, such as evidence-based feasibility or real-world evidence analysis, to help validate assumptions before clinical trial initiation. In a broad analysis, we integrated a literature review with a practitioner survey into a framework to help decision makers on the most critical process steps when setting up or conducting clinical trials in order to bring critical treatments to patients faster.

Validation of the GetReal Trial Tool - Facilitating discussion and understanding more pragmatic design choices and their implications

BACKGROUND

The GetReal Trial Tool is a decision support tool to assess the impact of design choices on generalizability of clinical trials to routine clinical practice, while taking into account the risk of bias, precision, acceptability and operational feasibility. This study describes the validation of the GetReal Trial Tool.

METHODS

Twelve experts took part in the GetReal Trial tool validation using the protocols of 6 trials conducted with pragmatic elements. The tool entails 7 domains with a total of 43 questions. A pooled Kappa statistic (95% CI) using random effects model was estimated using Open Meta (analyst) software. The possible operational challenges were collated and discussed with the trialists that conducted the trials.

RESULTS

Agreement in the design choices made for the trial protocols was >50% for all the trials and all teams reached consensus during discussion. The pooled Kappa statistic (95% CI) was 0.236 (0.154-0.318). The GetReal Trial tool highlighted several operational challenges, of which almost half had been experienced previously by the trialists. Out of 25 additional operational challenges mentioned by the trialists, 76% were already highlighted by the tool. The tool was considered helpful to optimize trials right from the design stage.

CONCLUSION

The GetReal Trial Tool helps to scrutinize the choice of study design in the light of Real World Evidence generation. The tool identifies most of the operational challenges experienced by trialists to date. The tool serves the intended purpose of facilitating discussion and understanding more pragmatic design choices and their implications.

Ethics and regulatory complexities posed by a pragmatic clinical trial: a case study from Lilongwe, Malawi

Background

Pragmatic clinical trials generally rely on real world data and have the potential to generate real world evidence. This approach arose from concerns that many trial results did not adequately inform real world practice. However, maintaining the real world setting during the conduct of a trial and ensuring adequate protection for research participants can be challenging. Best practices in research oversight for pragmatic clinical trials are nascent and underdeveloped, especially in developing countries.

Methods

We use the PRECIS-2 tool to present a case study from Lilongwe in Malawi to describe ethical and regulatory challenges encountered during the conduct of a pragmatic trial and suggest possible solutions.

Results

In this article, we highlight the following six issues: (1) one public facility hosting several pragmatic trials within the same period; (2) research participants refusing financial incentives; (3) inadequate infrastructure and high workload to conduct research; (4) silos among partner organisations involved in delivery of health care; (5) individuals influencing the implementation of revised national guidelines; (6) difficulties with access to electronic medical records.

Conclusion

Multiple stakeholder engagement is critical to the conduct of pragmatic trials, and even with careful stakeholder engagement, continuous monitoring by gatekeepers is essential. In the Malawian context, active engagement of the district research committees can complement the work of the research ethics committees (RECs).

Delivery of a Group Hypnosis Protocol for Managing Chronic Pain in Outpatient Integrative Medicine

Although strong evidence exists for using individual hypnosis to treat pain, evidence regarding group applications is limited. This project evaluated changes in multiple outcome measures in persons with chronic pain treated with 8 weeks of group hypnosis. Eighty-five adults with diverse chronic pain etiologies completed an 8-session, structured group hypnosis treatment. Pain intensity, pain interference, and global health were evaluated at baseline, posttreatment, and 3- and 6-months posttreatment. Linear mixed effects models assessed changes in outcomes over time. In a model testing, all three outcome measures simultaneously, participants improved substantially from pre- to posttreatment and maintained improvement across follow-up. Analyses of individual outcomes showed significant pre- to posttreatment reductions in pain intensity and interference, which were maintained for pain intensity and continued to improve for pain interference across follow-up. The findings provide compelling preliminary evidence that a group format is an effective delivery system for teaching individual skills in using hypnosis for chronic pain management. Larger randomized controlled trials are warranted to demonstrate equivalence of outcomes between treatment modes.

A multi-center, pragmatic, effectiveness-implementation (hybrid I) cluster randomized controlled trial to evaluate a child-oriented goal-setting approach in paediatric rehabilitation (the ENGAGE approach): a study protocol

BACKGROUND

Child-oriented goal-setting in pediatric rehabilitation may improve child motivation, engagement in therapy, child outcomes related to therapy, and service delivery efficiency. The primary objective of this trial is to determine the effectiveness of a principles-driven, child-focused approach to goal-setting, Enhancing Child Engagement in Goal-Setting (ENGAGE), on pediatric rehabilitation outcomes compared to usual practice. The three secondary objectives are to 1) compare costs and secondary outcomes of the ENGAGE approach to usual practice, 2) determine the influence of child, parent and therapist characteristics on child engagement in therapy and rehabilitation outcomes, and 3) identify barriers and facilitators to the implementation of ENGAGE.

METHODS

This research protocol describes a pragmatic, multi-site, cluster, effectiveness-implementation (hybrid type 1 design) randomized controlled trial. Therapists (n = 12 clusters of two therapists) at participating sites (n = 6) will be randomized to 1) the ENGAGE intervention group, or 2) usual care (control) using a computer-generated, permuted-block randomization sequence with site as a stratification variable designed by a statistician (RR). Each therapist will recruit four children 5-12 years old with neurodevelopmental conditions (n = 96), who will receive ENGAGE or usual care, according to therapist group allocation. ENGAGE therapists will be trained to use a 'toolbox' of evidence-driven, theory-informed principles to optimize child and parent motivation, engagement in the goal-setting process, and performance feedback strategies. Outcomes include goal performance (primary outcome), engagement in therapy, functional abilities, participation, and parent and child quality of life. Qualitative interviews with children, parents, ENGAGE therapists, and managers will explore challenges to implementation and potential mitigation strategies. Mixed effects multiple linear regression models will be developed for each outcome to assess group differences adjusted for clustering. A cost-effectiveness analysis will combine cost and a measure of effectiveness into an incremental cost-effectiveness ratio. Qualitative data on implementation will be analyzed inductively (thematic analysis) and deductively using established implementation science frameworks.

DISCUSSION

This study will evaluate the effects of collaborative goal-setting in pediatric rehabilitation and inform effective implementation of child-focused goal-setting practices.

TRIAL REGISTRATION

NCT05017363 (registered August 23, 2021 on ClinicalTrials.gov).

WHO Participates in Effectiveness Research? A Comparison of Effectiveness Trial Clinicians to National Survey Samples

Findings from research participants in effectiveness treatment trials (i.e., randomized control trials conducted in community rather than research settings) are considered more generalizable than those from participants in efficacy trials. This is especially true for clinician participants, whose characteristics like attitudes towards evidence-based practices (EBPs) may impact treatment implementation and the generalizability of research findings from effectiveness studies. This study compared background characteristics, attitudes toward EBPs, and attitudes towards measurement-based care (MBC) among clinicians participating in a National Institute of Mental-Health (NIMH) funded effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET), to clinician data from nationally representative U.S. survey samples. Results indicated COMET clinicians were significantly younger, less clinically experienced, and were more likely to have a training background in psychology versus other disciplines compared to national survey samples. After controlling for demographics and professional characteristics, COMET clinicians held more positive attitudes towards EBPs and MBC compared to national survey samples. Implications for implementation efforts are discussed.

Pressure pain thresholds in a real-world chiropractic setting: topography, changes after treatment, and clinical relevance?

BACKGROUND

Changes in pain sensitivity are a commonly suggested mechanism for the clinical effect of spinal manipulative therapy (SMT). Most research has examined pressure pain thresholds (PPT) and has primarily been conducted in controlled experimental setups and on asymptomatic populations. Many important factors are likely to differ between research and clinical settings, which may affect PPT changes following SMT. Therefore, we planned to investigate PPT before and after clinical chiropractic care and investigate relationships with various potentially clinically-relevant factors.

METHODS

We recruited participants from four Danish chiropractic clinics between May and August 2021. A total of 129 participants (72% of the invited) were included. We measured PPT at eight pre-determined test sites (six spinal and two extra-spinal) immediately before (pre-session) and immediately after (post-session) the chiropractic consultation. We used regression analyses to investigate PPT changes, including the following factors: (i) vertebral distance to the nearest SMT site, (ii) rapid clinical response, (iii) baseline PPT, (iv) number of SMTs performed, (v) at the region of clinical pain compared to other regions, and (vi) if other non-SMT treatment was provided. We also performed topographic mapping of pre-session PPTs.

RESULTS

After the consultation, there was a non-significant mean increase in PPT of 0.14 kg (95% CIs = - 0.01 to 0.29 kg). No significant associations were found with the distance between the PPT test site and nearest SMT site, the clinical response of participants to treatment, the pre-session PPT, the total number of SMTs performed, or the region/s of clinical pain. A small increase was observed if myofascial treatment was also provided. Topographic mapping found greater pre-session PPTs in a caudal direction, not affected by the region/s of clinical pain.

CONCLUSIONS

This study of real-world chiropractic patients failed to demonstrate a substantial local or generalized increase in PPT following a clinical encounter that included SMT. This runs counter to prior laboratory research and questions the generalizability of highly experimental setups investigating the effect of SMT on PPT to clinical practice.

An application of PRECIS-2 to evaluate trial design in a pilot cluster randomised controlled trial of a community-based smoking cessation intervention for women living in disadvantaged areas of Ireland

BACKGROUND

"We Can Quit2" (WCQ2) was a pilot cluster randomised controlled trial with an embedded process evaluation assessing the feasibility and acceptability of 'We Can Quit' (WCQ, a peer-delivered community-based stop-smoking programme for women in disadvantaged communities. The control group comprised 'enhanced usual care' offered by the Irish Health Service Executive (HSE). The PRagmatic Explanatory Continuum Indicator Summary (PRECIS-2) is a tool to assess whether a trial design is more explanatory (working under ideal conditions) or pragmatic (working under 'real-world' conditions). The aim of this paper was to retrospectively evaluate the WCQ2 pilot trial using PRECIS-2 to inform the decision-making process on progression to a future definitive trial (DT).

METHODS

The WCQ2 trial protocol and HSE standard stop-smoking service were described across the nine PRECIS-2 domains: eligibility, recruitment, setting, organisation, flexibility-delivery, flexibility-adherence, follow-up and primary outcome. Team members scored the domains as pragmatic or explanatory for each arm in a half-day workshop.

RESULTS

Seven team members (practitioners and researchers) assessed the overall trial design as more explanatory than pragmatic. Important differences emerged between the two arms. WCQ targeted adult women from disadvantaged communities whereas HSE run a limited enhanced service for all quitters. Trial recruitment was challenging, intense efforts were needed as the trial proceeded. WCQ was delivered in a non-clinical community setting, HSE services in a clinical setting. WCQ organisation was co-designed with community partners and comprises peer-to-peer group support delivered by trained lay community facilitators, whereas HSE one-to-one support is delivered by Smoking Cessation Officers with a clinical background. Only WCQ allowed flexibility in delivery and adherence. Follow-up was more intensive in WCQ. Greater efforts to improve participant retention will be required in a future DT.

CONCLUSIONS

PRECIS-2 allowed the reflection of practitioners and researchers on similarities and differences between intervention and control arms. Results will inform the decision on progression to an effectiveness DT, which will require more a pragmatic and less explanatory design. This novel use of PRECIS-2 to retrospectively evaluate a complex community-based pilot trial in advance of a full DT will also support learning for those undertaking hybrid trials of implementation and effectiveness.

TRIAL REGISTRATION

This trial is registered with the ISRCTN registry ( No. 74721694 ).

The GetReal Trial Tool: Design, Assess and Discuss Clinical Drug Trials in Light of RWE Generation

Methodologies incorporating Real World Elements into clinical trial design (also called pragmatic trials) offer an attractive opportunity to assess the effect of a treatment strategy in routine care and as such guide decision making in practice. Uptake of these methods is slow for several reasons, including uncertainty about acceptability of trial results, lack of experience with the methodology and operational challenges. We developed the 'Get Real Trial Tool', an easy-to-use interface, which allows users to assess the impact of design choices on generalisability to routine clinical practice, while taking into account risk of bias, precision, acceptability and operational feasibility. The tool is grounded in the scientific literature on pragmatic trials combined with knowledge of experts from academia, pharmaceutical companies, HTA bodies, patient organisations, and regulators. The aim is to help researchers optimise trial design and facilitate translation of evidence from pragmatic trials to clinical practice. In this paper we describe the development, structure and application of the GetReal Trial Tool.

Mindfulness-based cognitive therapy for Fear of Recurrence in Ovarian Cancer Survivors (FROCS): a single-arm, open-label, pilot study

OBJECTIVE

Fear of recurrence is common following treatment for cancer. Our aim was to assess the feasibility of mindfulness-based cognitive therapy (MBCT) to treat fear of cancer recurrence (FCR) in ovarian cancer survivors.

METHODS

Investigator initiated, single-arm, open-label, pilot study. Women were eligible after completing adjuvant treatment. The intervention was an 8-week MBCT course of weekly 2-h group sessions. The primary outcome was FCR measured by the FCR inventory. Secondary outcomes were depression and anxiety measured by the Hospital Anxiety and Depression Scale (HADS). The study is registered with the Australian and New Zealand Clinical Trials Registry ACTRN12615000213549.

RESULTS

Between May 8, 2015, and May 6, 2019, 33 participants were enrolled. Ten women withdrew. Data were evaluable for 19 participants. There was a significant decrease in FCR at 8 weeks (FCR inventory mean 63.00, SD 27.90) compared to pre-intervention (FCR inventory mean 71.03, SD 31.01) but not at 6 months (FCR inventory mean 63.65, SD 30.08). No differences in depression were observed at baseline (HADS mean 3.42, SD 2.41), 8 weeks (HADS mean 3.10, SD 1.79) and 6 months (HADS mean 2.73, SD 1.88). Anxiety decreased from baseline (HADS mean 8.72, SD 3.99) at both 8 weeks (HADS mean 6.89, SD 2.98) and 6 months (HADS mean 7.06, SD 3.87).

CONCLUSIONS

MBCT may be effective as a treatment for FCR and anxiety in women following diagnosis and treatment of ovarian cancer. A randomised controlled trial is required to assess the efficacy of MBCT for FCR but may not be feasible due to high rates of withdrawal.

Randomized clinical trials and real life studies: Comparison of baseline characteristics of patients in oral target therapies for renal cell carcinoma

INTRODUCTION

Pivotal Randomized Controlled Trials (RCTs) constitute scientific evidence in support of therapeutic choices when a drug is authorized in the market. In RCTs, patients are selected in a rigorous manner, in order to avoid bias that may influence efficacy assessments. Therefore, patients who take the drug in Real Life Studies (RLSs) are not the same as those participating in RCTs, which, in turn, leads to low data transferability from RCTs to RLS. The objective of this study was to evaluate the differences between RCTs and RLS, in terms of patient baseline characteristics.

MATERIALS AND METHODS

Our study includes all oral target therapies for RCC (Renal Cell Carcinoma) marketed in Europe before March 31, 2019. For each treatment, we considered both RCTs and RLSs, the former gathered from Summary of Product Characteristics published on the European Medicine Agency (EMA) website, and the latter yielded by our search in relevant literature. For each drug considered, we then compared the baseline characteristics of patients included in the RCT samples with those of the samples included in the RLSs using the Chi-squared and Mann-Whitney tests.

RESULTS

We considered six medicines, for a total of 9 pivotal RCTs and 31 RLSs. RCTs reported the same type of patient baseline characteristics, whereas RLSs are more varied in reporting. Some patient baseline characteristics (metastases, previous treatments, etc.) were significantly different between RCTs and RLs. Other characteristics, such as ECOG Performance Status, brain metastases, and comorbidities, liver and kidney failure, are comprised in exclusion criteria of RCTs, though are included in RLS.Discussion and Conclusion: While evaluating equal treatments for the same indications, RCTs and RLSs do not always assess patients with the same characteristics. It would be necessary to produce evidence from RLSs so as to have an idea of treatment effectiveness in patients groups that are not eligible or underrepresented in RCTs.

A review of pragmatic trials found a high degree of diversity in design and scope, deficiencies in reporting and trial registry data, and poor indexing

OBJECTIVE

We established a large database of trials to serve as a resource for future methodological and ethical analyses. Here, we use meta-data to describe the broad landscape of pragmatic trials including research areas, identification as pragmatic, quality of trial registry data and enrolment.

STUDY DESIGN AND SETTING

Trials were identified by a validated search filter and included if a primary report of a health-related randomized trial published January 2014-April 2019. Data were collated from MEDLINE, Web of Science, ClinicalTrials.gov, and full text.

RESULTS

4337 eligible trials were identified from 13,065 records, of which 1988 were registered in ClinicalTrials.gov. Research areas were diverse, with the most common being general and internal medicine; public, environmental and occupational health; and health care sciences and services. The term "pragmatic" was seldom used in titles or abstracts. Several domains in ClinicalTrials.gov had questionable data quality. We estimated that one-fifth of trials under-accrued by at least 15%.

CONCLUSION

There is a need to improve reporting of pragmatic trials and quality of trial registry data. Under accrual remains a challenge in pragmatic RCTs despite calls for more streamlined recruitment approaches. The diversity of pragmatic trials should be reflected in future ethical analyses.

The terminology conflict on efficacy and effectiveness in healthcare

Designers and architects created the rule 'form follows function (FFF)' for their own profession. Our paper demonstrates that this FFF rule applies equally well to the designers of clinical studies. Four examples present are as follows: disregarding this FFF rule causes an inconsistent terminology to differentiate between efficacy and effectiveness, inconsistent differentiation of efficacy and effectiveness interferes with the consistent interpretation of the results of clinical studies, inconsistent interpretation of clinical studies results in an unexpectedly variance of recommendations in clinical guidelines and the fusion of the FFF designer rule and of the demands of Cochrane and Bradford Hill ('can it work?', 'does it work?' and 'is it worth it?') avoids the terminology problem and its misleading consequences. This strategy is presented.

Age specific recruitment and retention to a large multicentre observational breast cancer trial in older women: The Age Gap Trial

Introduction

Recruitment and retention are two of the most important factors in successfully running clinical trials. Many trials encounter problems with both, causing delays or preventing study progress. These issues are greater in older adults and patients with cancer.

Materials and methods

We assessed recruitment and retention in a large, multicentre, observational breast cancer study in older female patients (>70 years, N = 3440). Data collected by the Age Gap study were used to assess rates of, and reasons for, patients not being recruited or retained. Statistical analysis assessed the impact of age as a predictor of recruitment and retention.

Results

Between February 2013 and June 2018, 6876 patients were screened and 3456 were consented across 56 United Kingdom (UK) breast units. Reasons for non-recruitment included ineligibility, clinician issues, staffing resource issues, patients' lack of interest or time and trial burden. In comparison with the age demographics of patients with breast cancer in the UK, women aged 70–75 years were over-represented compared to older age groups. Logistic regression demonstrated that older age significantly reduced the odds of consent (OR = 0.96, CI: 0.938–0.982; p < 0.001). Multivariate analysis showed that age (p < 0.001), markers of poor functional ability (Eastern Cooperative Oncology Group Performance Status (p = 0.011)) and instrumental activities of daily living (p = 0.026) were significant predictors of withdrawal.

Discussion

This study has demonstrated that selection and attrition bias for age are apparent despite a range of ‘age friendly’ study design measures. Exploration of the underlying reasons for this and development of measures to address this should be the focus of further research.

Excisional treatment comparison for in situ endocervical adenocarcinoma (EXCISE): A phase 2 pilot randomized controlled trial to compare histopathological margin status, specimen size and fragmentation after loop electrosurgical excision procedure and cold knife cone biopsy

OBJECTIVE

Adenocarcinoma in situ (AIS) of the cervix is a precursor to cervical adenocarcinoma. When AIS is detected by cervical screening an excision biopsy is mandatory to exclude invasion. We aimed to compare margins status, specimen size and fragmentation after loop electrosurgical excision procedure (LEEP) and 'cold knife cone biopsy' (CKC).

METHODS

The EXCISE Trial was an investigator-initiated, multicenter, open-label, parallel-group, phase 2, randomized study. Patients were enrolled at seven hospitals in Australia and New Zealand. We randomly assigned women aged ≥18 to ≤45 years with screen detected AIS to LEEP or CKC. Co-primary endpoints were margin status, specimen size and fragmentation. Analysis was by intention-to-treat.

RESULTS

Between August 2, 2017 and September 6, 2019, 40 patients were randomly assigned 2:1 to LEEP or CKC. Margin status was evaluable in 36 cases. The proportion of patients with involved margins did not differ between groups. 25 of 26 LEEP and all 14 CKC biopsies were excised as single specimens (p = 1·00). There were no differences in specimen dimensions. Patients in the CKC group had more post-operative complications (64.3% compared to 15.4% for LEEP p = ·00). There were no differences in grade three complications (p = ·65).

CONCLUSIONS

LEEP was not associated with a greater likelihood of positive margins, specimen fragmentation or smaller excision compared to CKC when performed according to a standardized protocol. However, the study was not powered to establish non-inferiority of LEEP and a definitive phase 3 trial to compare margin status and rates of treatment failure after LEEP and CKC is warranted.

Design characteristics of comparative effectiveness trials for the relief of symptomatic dyspepsia: A systematic review

Background

Dyspepsia represents a symptom domain rather than a diagnostic condition and covers a wide range of complex, underlying pathophysiologies that are not well understood. The review explores comparative effectiveness interventions for the treatment of symptomatic dyspepsia along a pragmatic-explanatory continuum. The aim is to identify relevant design characteristics applicable to future upper gastrointestinal comparative effectiveness research employing integrative medicine.

Methods

Medline, CINAHL, Scopus, Cochrane Central Register of Controlled Trials (CENTRAL) and WHO Clinical Trials were systematically searched until January 2019. Included articles were original research with two or more comparative intervention arms for the primary outcome; relief of symptomatic dyspepsia. Evaluation of the studies was conducted using the pragmatic-explanatory continuum indicator summary (PRECIS-2) tool.

Results

Thirty-six articles were included in the review. A total of 68 Patient Reported Outcome Measurements (PROMs), utilizing 50 different formats were deployed across the studies. The appraisal process revealed eligibility, flexibility in adherence, flexibility in delivery and organization domains further aligned towards an explanatory design.

Conclusion

This review identified three design characteristics relevant for future comparative effectiveness research for the treatment of upper gastrointestinal disorders in a community setting. Extensive exclusion eligibility criteria limited the generalization of comparative effectiveness study results by removing sub-groups of the target populations more at risk of dyspeptic symptoms. The requirement for entry endoscopy was found to be common and not always pragmatically justifiable. Development of validated PROMs appropriate for a generic application to upper gastrointestinal disorders would be advantageous for future comparative effectiveness research within integrative medicine.

Patient and healthcare professional experiences of the Salford Lung Studies: qualitative insights for future effectiveness trials

Background

Randomized controlled trials (RCTs) conducted in the routine care setting provide the opportunity to better understand the effectiveness of new medicines but can present recruitment difficulties. An improved understanding of the challenges/opportunities for patient and healthcare professional (HCP) engagement in clinical research is needed to enhance participation and trial experience. In this study, we explored patient and HCP drivers for, and experiences of, participation in the Salford Lung Studies (SLS), and their views on future trial participation and the overall value of such trials.

Methods

This was a qualitative study set in Salford, UK, comprising patient telephone interviews (N = 10) and HCP advisory boards (one with general practitioners [GPs], one with practice managers [PMs]); all individuals had participated in the SLS. Semi-structured telephone interviews were recorded, transcribed and analysed thematically. Advisory board meetings were analysed based on transcriptions of audio recordings and field notes.

Results

For patients, key positive aspects of the SLS were the ease/convenience of study assessments and excellent relationships with study nurses. GPs and PMs considered the SLS to be well-organized and highlighted the value of research nurse support; they also described minor challenges relating to trial systems, initial financial strain on practices and staff turnover. All participants indicated that they were very likely to participate in future trials, citing a design closely aligned with routine care practice as essential. Several strategies to encourage trial participation were suggested, such as clearly communicating benefits to patients and ensuring flexible study assessments.

Conclusions

Patients and HCPs had positive experiences of the SLS. The study design, closely aligned with routine care, was considered important to their high likelihood of participating in future trials. The experiences of patients and HCPs in the SLS provide valuable insights that will help inform future best practice in the design and conduct of future real-world effectiveness RCTs in primary care. The detailed first-hand experiences of HCPs will be of significant value to others considering engaging in clinical research and participating in effectiveness RCTs.

Effectiveness of a web-based real-life weight management program: Study design, methods, and participants' baseline characteristics

Obesity is an important public health concern with limited effective treatment options. Internet-based technologies offer a cost-effective means to treat obesity. However, most of the online programs have been of short duration, have focused on a limited number of treatment modalities, and have not utilized the potential of coaching as part of the intervention. In this paper, we present the design, methods and participants’ baseline characteristics in a real-life internet-based weight management program. Healthy Weight Coaching (HWC) is a 12-month web-based intervention for the management of obesity. The program is based on the Acceptance and Commitment Therapy and includes themes important for weight loss, including diet, physical activity, psychological factors, and sleep. In addition to the automated, interactive program, a personal coach is allocated to each participant. The participants are nationally enrolled through referrals from primary care, occupational health, hospitals, and private health care units. Adult individuals with BMI ≥25 kg/m² without severe complications are included. On a weekly basis, participants submit their weight logs, training sessions, and lifestyle targets to the internet portal and are scheduled to have online discussions with their coaches 26 times over the course of a year. Questionnaires on lifestyle, diet, physical activity, psychological factors, sleep, and quality of life are completed at baseline, 3, 6, 9, and 12 months, and thereafter yearly until 5 years. Additionally, log data on the use of the service and discussions with the coach are collected. The main outcome is weight change from baseline to 12 months. Recruitment to the HWC is ongoing. Baseline data of the participants recruited between Oct 2016 and Mar 2019 (n = 1189) are provided. This research will bring insight into how internet-based technologies can be implemented in the virtual management of obesity.

Trial registration

The trial is registered at clinicaltrials.cov (Clinical Trials Identifier NCT04019249).

Variation in the observed effect of Xpert MTB/RIF testing for tuberculosis on mortality: A systematic review and analysis of trial design considerations

Background: Most studies evaluating the effect of Xpert MTB/RIF testing for tuberculosis (TB) concluded that it did not reduce overall mortality compared to usual care. We conducted a systematic review to assess whether key study design and execution features contributed to earlier identification of patients with TB and decreased pre-treatment loss to follow-up, thereby reducing the potential impact of Xpert MTB/RIF testing. Methods: We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, and Scopus for literature published from 1 st January 2009 to February 2019. We included all primary intervention studies that had evaluated the effect of Xpert MTB/RIF on mortality compared to usual care in participants with presumptive pulmonary TB. We critically reviewed features of included studies across: Study setting and context, Study population, Participant recruitment and enrolment, Study procedures, and Study follow-up. Results: We included seven randomised and one non-randomised study.  All included studies demonstrated relative reductions in overall mortality in the Xpert MTB/RIF arm ranging from 6% to 40%. However, mortality reduction was reported to be statistically significant in two studies. Study features that could explain the lack of observed effect on mortality included: the higher quality of care at study sites; inclusion of patients with a higher pre-test probability of TB leading to higher than expected empirical rates; performance of additional diagnostic testing not done in usual care leading to increased TB diagnosis or empiric treatment initiation; the recruitment of participants likely to return for follow-up; and involvement of study staff in ensuring adherence with care and follow-up. Conclusion: Most studies of Xpert MTB/RIF were designed and conducted in a manner that resulted in more patients being diagnosed and treated for TB, minimising the potential difference in mortality Xpert MTB/RIF testing could have achieved compared to usual care.

Improving the Design of Future PCI Trials for Stable Coronary Artery Disease: JACC State-of-the-Art Review

The role of percutaneous coronary interventions in addition to medical therapy for patients with stable coronary artery disease continues to be debated in routine clinical practice, despite more than 2 decades of randomized controlled trials. The residual uncertainty arises from particular challenges facing revascularization trials. Which endpoint do doctors care about, and which do patients care about? Which participants should be enrolled? What background medical therapy should we use? When is placebo control relevant? In this paper, we discuss how these questions can be approached and examine the merits and disadvantages of possible options. Engaging multiple stakeholders, including patients, researchers, regulators, and funders, to ensure the design elements are methodologically valid and clinically meaningful should be an aspirational goal in the development of future trials.

Video-guided exercise after stroke: a feasibility randomised controlled trial

BACKGROUND

Facilitating self-directed upper-limb exercise in people after a stroke whilst not in therapy sessions may increase therapy intensity and improve outcomes. Objectives: To investigate the feasibility and acceptability of video-guided exercise for facilitating upper-limb exercise after stroke.

METHODS

A single-blind feasibility randomized controlled trial with embedded qualitative study in stroke wards at a large teaching hospital in the United Kingdom. Fourteen participants with stroke were randomized to either video-guided exercise intervention or a "treatment-as-usual" control group. Intervention participants received a computer tablet containing filmed individualized exercises to guide out of therapy practice. The primary outcome measure was the Motor status scale (MSS) for the upper limb, which was used to guide possible sample sizes for a future main trial. Qualitative focus group and interview data on feasibility/acceptability were collected and analyzed.

RESULTS

The intervention was acceptable, but the need for motivation/support to exercise was highlighted. Based on similar assumptions to the feasibility study, circa ninety-two patients in each group would be needed to detect a difference of 5 in upper-limb motor status for a main trial.

CONCLUSION

A trial of video-guided exercise is feasible, although an optimal main trial would require some relatively minor changes to design, outcome measures, eligibility, and the intervention.

Engaging Caregivers in Health-Related Housing Decisions for Older Adults With Cognitive Impairment: A Cluster Randomized Trial

Background and Objectives

Informal caregivers are rarely as involved as they want to be in the housing decisions of cognitively impaired older adults. Lack of awareness of available options and their benefits and risks may lead to decisions that do not reflect older adults’ preferences, and to guilt and regret. We assessed the effect of training home care teams in interprofessional shared decision-making (SDM) on the proportion of caregivers who report being active in this decision.

Research Design and Methods

In a two-arm pragmatic cluster randomized trial with home care teams working in health centers in the Province of Quebec, we randomized health centers to receive training in interprofessional SDM (intervention) or not (control). Eligible caregivers had made a housing decision for a cognitively impaired adult aged 65 years or older who was receiving services from a home care team. The primary outcome was the proportion of caregivers reporting an active role in decision making. We performed intention-to-treat multilevel analysis.

Results

We consecutively enrolled a random group of 16 health centers and recruited 309 caregivers, among whom 296 were included in the analysis. In the intervention arm, the proportion of caregivers reporting an active role in decision making increased by 12% (95% CI −2% to 27%; p = .10). After removal of an influential cluster outlier, the proportion increased to 18% (95% CI: 7%–29%; p < .01).

Discussion and Implications

Training home care teams in interprofessional SDM increased caregiver involvement in health-related housing decisions for cognitively impaired older adults.

Real-World Data and Randomised Controlled Trials: The Salford Lung Study

Traditional efficacy double-blind randomised controlled trials (DBRCTs) measure the benefit a treatment produces under near-ideal test conditions in highly selected patient populations; however, the behaviour of patients and investigators in such trials is highly controlled, highly compliant and adherent, and non-representative of routine clinical practice. Pragmatic effectiveness trials measure the benefit a treatment produces in patients in everyday "real-world" practice. Ideally, effectiveness trials should recruit patients as similar as possible to those who will ultimately be prescribed the medicine, and create freedom within the study design to allow normal behaviours of patients and healthcare professionals (HCPs) to be expressed. The Salford Lung Study (SLS) was a world-first, prospective, phase III, pragmatic randomised controlled trial (RCT) programme in patients with chronic obstructive pulmonary disease and asthma to evaluate the effectiveness of a pre-licensed medication (fluticasone furoate/vilanterol) in real-world practice using electronic health records and through collaboratively engaging general practitioners and community pharmacists in clinical research. The real-world aspect of SLS was unique, requiring careful planning and attention to the goals of maximising the external validity of the trials while maintaining scientific rigour and securing suitable electronic processes for proper interpretation of safety data. Key learnings from SLS that may inform the design of future pragmatic effectiveness RCTs include: (1) ensuring the trial setting and operational infrastructure are aligned with routine clinical care; (2) recruiting a broad patient population with characteristics as close as possible to patients in routine clinical practice, to maximise the generalisability and applicability of trial results; (3) ensuring that patients and HCPs are suitably engaged in the trial, to maximise the chances of successful trial delivery; and (4) careful study design, incorporating outcomes of value to patients, HCPs, policymakers and payers, and using pre-planned analyses to address scientifically valid research hypotheses to ensure robustness of the trial data.

Pragmatic Trials in Genomic Medicine: The Integrating Pharmacogenetics In Clinical Care (I-PICC) Study

Pragmatic clinical trials (PCTs) have an established presence in clinical research and yet have only recently garnered attention within the landscape of genomic medicine. Using the PRagmatic-Explanatory Continuum Indicator Summary 2 (PRECIS-2) as a framework, this paper illustrates the application of PCT principles to The Integrating Pharmacogenetics In Clinical Care (I-PICC) Study, a trial of pharmacogenetic testing prior to statin initiation for cardiovascular disease prevention in primary care. The trial achieved high engagement with providers (85% enrolled of those approached) and enrolled a representative sample of participants for which statin therapy would be recommended. The I-PICC Study has a high level of pragmatism, which should enhance the generalizability of its findings. The PRECIS-2 may be useful in the design and evaluation of PCTs of genomic medicine interventions, contributing to the generation of evidence that can bridge the gap between genomics innovation and clinical adoption.

Exclusion rates in randomized controlled trials of treatments for physical conditions: a systematic review

Background

The generalisability of randomized controlled trials (RCTs) can be uncertain because the impact of exclusion criteria is rarely quantified. The aim of this study was to systematically review studies examining the percentage of clinical populations with a physical health condition who would be excluded by RCTs of treatments for that condition.

Methods

Medline and Embase were searched from inception to Feb 11th 2018. Two reviewers independently completed screening, full-text review, data extraction and risk-of-bias assessment. The primary outcome was the percentage of patients in the clinical population who would have been excluded from each examined trial. Subgroup analyses examined exclusion by population setting, publication date and funding source.

Results

Titles/abstracts (20,754) were screened, and 50 studies were included which reported exclusion rates from 305 trials of treatments in 31 physical conditions. Estimated rates of exclusion from trials varied from 0% to 100%, and the median exclusion rate was 77.1% of patients (interquartile range 55.5% to 89.0% exclusion). Median exclusion rates for trials in common chronic conditions were high, including hypertension 83.0%, type 2 diabetes 81.7%, chronic obstructive pulmonary disease 84.3%, and asthma 96.0%. The most commonly applied exclusion criteria related to age, co-morbidity and co-prescribing, whereas more implicit criteria relating to life expectancy or functional status were not typically examined. There was no evidence that exclusion varied by the nature of the clinical population in which exclusion was evaluated or trial funding source. There was no statistically significant change in exclusion rates in more recent compared with older trials.

Conclusions

The majority of trials of treatments for physical conditions examined excluded the majority of patients with the condition being treated. Almost a quarter of the trials studied excluded over 90% of patients, more than half of trials excluded at least three quarters of patients, and four out of five trials excluded at least half of patients. A limitation is that most studies applied only a subset of eligibility criteria, so exclusion rates are likely under-estimated. Exclusion from trials of older people and people with co-morbidity and co-prescribing is increasingly untenable given population aging and increasing multimorbidity.

Trial registration

PROSPERO registration CRD42016042282.

Non-steroidal anti-inflammatory drugs in chronic kidney disease: a systematic review of prescription practices and use in primary care

BACKGROUND

Chronic kidney disease (CKD) management focuses on limiting further renal injury, including avoiding nephrotoxic medications such as non-steroidal anti-inflammatory drugs (NSAIDs). We performed a systematic review to evaluate the prevalence of primary care NSAID prescribing in this population.

METHODS

We systematically searched MEDLINE and Embase from inception to October 2017 for observational studies examining NSAID prescribing practices or use in CKD patients in a primary care setting. The methodological quality of included studies was assessed independently by two authors using a modified version of the Agency for Healthcare Research and Quality's Methodological Evaluation of Observational Research checklist.

RESULTS

Our search generated 8055 potentially relevant publications, 304 of which were retrieved for full-text review. A total of 14 studies from 13 publications met our inclusion criteria. There were eight cohort and three cross-sectional studies, two quality improvement intervention studies and one prospective survey, representing a total of 49 209 CKD patients. Cross-sectional point prevalence of NSAID use in CKD patients ranged from 8 to 21%. Annual period prevalence rates ranged from 3 to 33%. Meta-analysis was not performed due to important clinical heterogeneity across study populations.

CONCLUSIONS

Evidence suggests that NSAID prescriptions/use in primary care among patients with CKD is variable and relatively high. Future research should explore reasons for this to better focus knowledge translation interventions aimed at reducing NSAID use in this patient population.

COVID Feel Good-An Easy Self-Help Virtual Reality Protocol to Overcome the Psychological Burden of Coronavirus

BACKGROUND

Living in the time of the COVID-19 means experiencing not only a global health emergency but also extreme psychological stress with potential emotional side effects such as sadness, grief, irritability, and mood swings. Crucially, lockdown and confinement measures isolate people who become the first and the only ones in charge of their own mental health: people are left alone facing a novel and potentially lethal situation, and, at the same time, they need to develop adaptive strategies to face it, at home. In this view, easy-to-use, inexpensive, and scientifically validated self-help solutions aiming to reduce the psychological burden of coronavirus are extremely necessary.

AIMS

This pragmatic trial aims to provide the evidence that a weekly self-help virtual reality (VR) protocol can help overcome the psychological burden of the Coronavirus by relieving anxiety, improving well-being, and reinforcing social connectedness. The protocol will be based on the "Secret Garden" 360 VR video online (www.covidfeelgood.com) which simulates a natural environment aiming to promote relaxation and self-reflection. Three hundred sixty-degree or spherical videos allow the user to control the viewing direction. In this way, the user can explore the content from any angle like a panorama and experience presence and immersion. The "Secret Garden" video is combined with daily exercises that are designed to be experienced with another person (not necessarily physically together), to facilitate a process of critical examination and eventual revision of core assumptions and beliefs related to personal identity, relationships, and goals.

METHODS

This is a multicentric, pragmatic pilot randomized controlled trial involving individuals who experienced the COVID-19 pandemic and underwent a lockdown and quarantine procedures. The trial is approved by the Ethics Committee of the Istituto Auxologico Italiano. Each research group in all the countries joining the pragmatic trial, aims at enrolling at least 30 individuals in the experimental group experiencing the self-help protocol, and 30 in the control group, over a period of 3 months to verify the feasibility of the intervention.

CONCLUSION

The goal of this protocol is for VR to become the "surgical mask" of mental health treatment. Although surgical masks do not provide the wearer with a reliable level of protection against the coronavirus compared with FFP2 or FFP3 masks, surgical masks are very effective in protecting others from the wearer's respiratory emissions. The goal of the VR protocol is the same: not necessarily to solve complex mental health problems but rather to improve well-being and preserve social connectedness through the beneficial social effects generated by positive emotions.

The ethical challenges raised in the design and conduct of pragmatic trials: an interview study with key stakeholders

Background

There is a concern that the apparent effectiveness of interventions tested in clinical trials may not be an accurate reflection of their actual effectiveness in usual practice. Pragmatic randomized controlled trials (RCTs) are designed with the intent of addressing this discrepancy. While pragmatic RCTs may increase the relevance of research findings to practice they may also raise new ethical concerns (even while reducing others). To explore this question, we interviewed key stakeholders with the aim of identifying potential ethical challenges in the design and conduct of pragmatic RCTs with a view to developing future guidance on these issues.

Methods

Interviews were conducted with clinical investigators, methodologists, patient partners, ethicists, and other knowledge users (e.g., regulators). Interviews covered experiences with pragmatic RCTs, ethical issues relevant to pragmatic RCTs, and perspectives on the appropriate oversight of pragmatic RCTs. Interviews were coded inductively by two coders. Interim and final analyses were presented to the broader team for comment and discussion before the analytic framework was finalized.

Results

We conducted 45 interviews between April and September 2018. Interviewees represented a range of disciplines and jurisdictions as well as varying content expertise. Issues of importance in pragmatic RCTs were (1) identification of relevant risks from trial participation and determination of what constitutes minimal risk; (2) determining when alterations to traditional informed consent approaches are appropriate; (3) the distinction between research, quality improvement, and practice; (4) the potential for broader populations to be affected by the trial and what protections they might be owed; (5) the broader range of trial stakeholders in pragmatic RCTs, and determining their roles and responsibilities; and (6) determining what constitutes “usual care” and implications for trial reporting.

Conclusions

Our findings suggest both the need to discuss familiar ethical topics in new ways and that there are new ethical issues in pragmatic RCTs that need greater attention. Addressing the highlighted issues and developing guidance will require multidisciplinary input, including patient and community members, within a broader and more comprehensive analysis that extends beyond consent and attends to the identified considerations relating to risk and stakeholder roles and responsibilities.

Electroacupuncture plus on-demand gastrocaine for refractory functional dyspepsia: Pragmatic randomized trial

BACKGROUND AND AIM

Treatment options for functional dyspepsia (FD) refractory to pharmacological treatments are limited but the effectiveness of electroacupuncture (EA) is uncertain. We assessed the effectiveness of EA combined with on-demand gastrocaine.

METHODS

We conducted a single-center, assessor-blind, randomized parallel-group 2-arm trial on Helicobacter pylori negative FD patients of the postprandial distress syndrome subtype refractory to proton pump inhibitor, prokinetics, or H₂ antagonists. Enrolled participants were block randomized in a 1:1 ratio, with concealed random sequence. The treatment and control groups both received on-demand gastrocaine for 12 weeks, but only those in treatment group were offered 20 sessions of EA over 10 weeks. The primary endpoint was the between-group difference in proportion of patients achieving adequate relief of symptoms at week 12.

RESULTS

Of 132 participants randomly assigned to EA plus on-demand gastrocaine (n = 66) or on-demand gastrocaine alone (n = 66), 125 (94.7%) completed all follow-up at 12 weeks. The EA group had a compliance rate 97.7%. They had a significantly higher likelihood in achieving adequate symptom relief at 12 weeks, with a clinically relevant number needed to treat (NNT) value of 2.36 (95% CI: 1.74, 3.64). Among secondary outcomes, statistically and clinically significant improvements were observed among global symptom (NNT = 3.85 [95% CI: 2.63, 7.69]); postprandial fullness and early satiation (NNT = 5.00 [95% CI: 2.86, 25.00]); as well as epigastric pain, epigastric burning, and postprandial nausea (NNT = 4.17 [95% CI: 2.56, 11.11]). Adverse events were minimal and nonsignificant.

CONCLUSION

For refractory FD, EA provides significant, clinically relevant symptom relief when added to on-demand gastrocaine (ChiCTR-IPC-15007109).

Variation in the observed effect of Xpert MTB/RIF testing for tuberculosis on mortality: A systematic review and analysis of trial design considerations

Background: Most studies evaluating the effect of Xpert MTB/RIF testing for tuberculosis (TB) concluded that it did not reduce overall mortality compared to usual care. We conducted a systematic review to assess whether key study design and execution features contributed to earlier identification of patients with TB and decreased pre-treatment loss to follow-up, thereby reducing the potential impact of Xpert MTB/RIF testing. Methods: We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, and Scopus for literature published from 1 st January 2009 to February 2019. We included all primary intervention studies that had evaluated the effect of Xpert MTB/RIF on mortality compared to usual care in participants with presumptive pulmonary TB. We critically reviewed features of included studies across: Study setting and context, Study population, Participant recruitment and enrolment, Study procedures, and Study follow-up. Results: We included seven randomised and one non-randomised study.  All included studies demonstrated relative reductions in overall mortality in the Xpert MTB/RIF arm ranging from 6% to 40%. However, mortality reduction was reported to be statistically significant in two studies. Study features that could explain the lack of observed effect on mortality included: the higher quality of care at study sites; inclusion of patients with a higher pre-test probability of TB leading to higher than expected empirical rates; performance of additional diagnostic testing not done in usual care leading to increased TB diagnosis or empiric treatment initiation; the recruitment of participants likely to return for follow-up; and involvement of study staff in ensuring adherence with care and follow-up. Conclusion: Most studies of Xpert MTB/RIF were designed and conducted in a manner that resulted in more patients being diagnosed and treated for TB, minimising the potential difference in mortality Xpert MTB/RIF testing could have achieved compared to usual care.

Using Medical Claims Analyses to Understand Interventions for Parkinson Patients

The scientific evidence to support the value of a range of non-pharmacological interventions for people with Parkinson’s disease (PD) is increasing. However, showing unequivocally that specific interventions are better than usual care is not straightforward because of generic drawbacks of clinical trials. Here, we address these challenges, specifically related to the context of evaluating complex non-pharmacological interventions for people with PD. Moreover, we discuss the potential merits of undertaking “real world” analyses using medical claims data. We illustrate this approach by discussing an interesting recent publication in The Lancet Neurology, which used such an approach to demonstrate the value of specialized physiotherapy for PD patients, over and above usual care physiotherapy.

Healthcare processes of laboratory tests for the prediction of mortality in the intensive care unit: a retrospective study based on electronic healthcare records in the USA

OBJECTIVES

Healthcare process carries important prognostic information for patients, but the healthcare processes of laboratory tests have not yet been investigated for patients in the intensive care unit (ICU). The study aimed to investigate the effect of healthcare processes of laboratory tests on hospital mortality, with the hypothesis that the addition of healthcare processes could improve the discrimination for mortality outcome.

DESIGN

The study included 12 laboratory tests. There were two dimensions for each laboratory test. One was the pathophysiology value; and the other was the healthcare process variables including the clock hour, the number of measurements and the measurement time from ICU admission. Generalised additive model was employed to investigate the effect of continuous variables on mortality. Generalised linear models with and without healthcare process variables were compared for their discrimination power.

SETTING

ICUs in an US-based hospital.

PARTICIPANTS

Adult patients included in the critical care big data Medical Information Mart for Intensive Care.

PRIMARY AND SECONDARY OUTCOME MEASURES

The hospital mortality was the primary outcome.

RESULTS

A total of 52 963 adult patients with complete ICU stay information were included for analysis. The mortality rate was 12.3%. Lower number of tests such as 1-3 times were associated with the lowest mortality for most laboratory tests. However, the hematocrit, glucose and potassium required 6-10 measurements for the first 24 hours to reach the lowest mortality rate. In n of the 12 prediction models involving laboratory tests, the addition of healthcare process variables was associated with significantly increased area under receiver operating characteristics.

CONCLUSIONS

The study showed that healthcare processes of laboratory tests were independently associated with hospital mortality. The addition of healthcare processes to the pathophysiology value could increase the discrimination for mortality outcome.

Declining Mortality in Patients With Acute Respiratory Distress Syndrome: An Analysis of the Acute Respiratory Distress Syndrome Network Trials

OBJECTIVES

There has been multiple advances in the management of acute respiratory distress syndrome, but the temporal trends in acute respiratory distress syndrome-related mortality are not well known. This study aimed to investigate the trends in mortality in acute respiratory distress syndrome patients over time and to explore the roles of daily fluid balance and ventilation variables in those patients.

DESIGN

Secondary analysis of randomized controlled trials conducted by the Acute Respiratory Distress Syndrome Network from 1996 to 2013.

SETTING

Multicenter study involving Acute Respiratory Distress Syndrome Network trials.

PATIENTS

Patients with acute respiratory distress syndrome.

INTERVENTIONS

None.

MEASURES AND MAIN RESULTS

Individual patient data from 5,159 acute respiratory distress syndrome patients (excluding the Late Steroid Rescue Study trial) were enrolled in this study. The crude mortality rate decreased from 35.4% (95% CI, 29.9-40.8%) in 1996 to 28.3% (95% CI, 22.0-34.7%) in 2013. By adjusting for the baseline Acute Physiology and Chronic Health Evaluation III, age, ICU type, and admission resource, patients enrolled from 2005 to 2010 (odds ratio, 0.61; 95% CI, 0.50-0.74) and those enrolled after 2010 (odds ratio, 0.73; 95% CI, 0.58-0.92) were associated with lower risk of death as compared to those enrolled before 2000. The effect of year on mortality decline disappeared after adjustment for daily fluid balance, positive end-expiratory pressure, tidal volume, and plateau pressure. There were significant trends of declines in daily fluid balance, tidal volume, and plateau pressure and an increase in positive end-expiratory pressure over the 17 years.

CONCLUSIONS

Our study shows an improvement in the acute respiratory distress syndrome-related mortality rate in the critically ill patients enrolled in the Acute Respiratory Distress Syndrome Network trials. The effect was probably mediated via decreased tidal volume, plateau pressure, and daily fluid balance and increased positive end-expiratory pressure.

The Feasibility of Examining the Effects of Gastric Bypass Surgery on Intestinal Metabolism: Prospective, Longitudinal Mechanistic Clinical Trial

Background

Bariatric surgery, especially Roux-en-Y gastric bypass (RYGB), is the best treatment for severe obesity and its complications including type 2 diabetes mellitus (T2DM). Understanding the mechanisms responsible for the beneficial metabolic effects will help to engineer ways to improve the procedure or produce these effects without surgery.

Objective

The aim is to present data on recruitment and feasibility of a translational study designed to collect intestinal samples before and after bariatric surgery. The goal of biobanking is to allow future studies to test the hypothesis that the mechanism of action of RYGB involves specific changes in the postsurgical short- and long-term metabolism and morphology of the jejunum (Roux limb). Specifically, to test whether the intestine enhances its metabolism and activity after RYGB and increases its fuel utilization, we designed a prospective, longitudinal study, which involved the recruitment of candidates for RYGB with and without T2DM. We describe the tissue bank that we have generated, and our experience, hoping to further facilitate the performance of longitudinal mechanistic studies in human patients undergoing bariatric surgery and especially those involving post-RYGB intestinal biology.

Methods

We conducted a trial to characterize the effects of RYGB on intestinal metabolism. Intestinal tissue samples were collected from the jejunum at surgery, 1, 6, and 12 months postoperatively for the analysis of intestinal gene expression and metabolomic and morphologic changes. The target number of patients who completed at least the 6-month follow-up was 26, and we included a 20% attrition rate, increasing the total number to 32.

Results

To enroll 26 patients, we had to approach 79 potential participants. A total of 37 agreed to participate and started the study; 33, 30, and 26 active participants completed their 1-month, 6-month, and 12-month studies, respectively. Three participants withdrew, and 30 participants are still active. Altruism and interest in research were the most common reasons for participation. Important factors for feasibility and successful retention included (1) large volume case flow, (2) inclusion and exclusion criteria broad enough to capture a large segment of the patient population but narrow enough to ensure the completion of study aims and protection of safety concerns, (3) accurate assessment of willingness and motivation to participate in a study, (4) seamless integration of the recruitment process into normal clinical flow, (5) financial reimbursement and nonfinancial rewards and gestures of appreciation, and (6) nonburdensome follow-up visits and measures and reasonable time allotted.

Conclusions

Human translational studies of the intestinal mechanisms of metabolic and weight changes after bariatric surgery are important and feasible. A tissue bank with unique samples has been established that could be used by investigators in many research fields, further enabling mechanistic studies on the effects of bariatric surgery.

Trial Registration

ClinicalTrials.gov NCT02710370; https://clinicaltrials.gov/ct2/show/NCT02710370 (Archived by WebCite at http://www.webcitation.org/75HrQT8Dl)

Rare diseases under different levels of economic analysis: current activities, challenges and perspectives

Rare diseases imply clinical and economic burden as well as a significant challenge for health systems. One relevant objective of the activities planned within the European Reference Network on Rare and Complex Connective Tissue and Musculoskeletal Diseases (ERN ReCONNET) is to address the economic dimensions of rare diseases to identify, develop and suggest strategies to improve research and patients' access to orphan drugs (ODs) and highly specialised health technologies. This paper presents a preliminary review of the existing policies on rare diseases in the countries of the Network members. It also introduces and discusses the theme of how to perform health economic evaluations of rare diseases and of existing or new treatments for rare diseases. To obtain a preliminary overview aiming at defining the state of the art of rare diseases policies and initiatives in ERN ReCONNET countries, we collected and analysed the rare diseases national plans of all the eight countries of the ERN ReCONNET participants. The preliminary overview that has been performed showed that in all the ERN ReCONNET countries are in place national plans for rare diseases; however, heterogeneity exists in the reimbursement of ODs, direct provision by the healthcare system, involvement of patients' associations in decision making and implementation of clinical practice guidelines.

Cancer clinical trials - Survey evaluating patient participation and acceptance in a university-based Comprehensive Cancer Center (CCC)

•

>50% of patients are willing to participate in clinical trials, only 18% are currently enrolled.

•

The top reason to participate in trials was to serve medical progress and cancer research.

•

Reasons for refusing were extensive travel time, no therapeutic advantage and too time-consuming.

•

Good information strategies need to be implemented, and doctors need to be aware of running trials.

•

Trial concepts must include patients’ needs, e.g. number of appointments, risk-benefit profile.

Introduction

Prospective clinical trials are essential to translate new therapy concepts or rather any scientific development into the medical routine. Besides a sophisticated trial protocol, the success of clinical trials depends on patient recruitment and participation. Patient recruitment remains a challenge and depends on several factors. To get a current picture of the patients’ attitude, we conducted the present survey.

Methods

We designed a survey with seven questions, which was given to all oncological patients treated within a timeframe of three months between Mai and July 2017. Participation was voluntary and anonymous. The questionnaire mainly inquires patients’ participation in clinical trials in a university-based setting, their attitude towards clinical trials regarding risks and benefits, and their source of information in this context.

Results

771 patients (1:1 male/female) participated with a median age of 61 years (range 18–91 years) with a response rate of 71.5%. Of all, 17.8% (137/771) were participating in a clinical trial. The most mentioned reason was to serve medical progress and cancer research. Out of the patients not currently participating in a trial, 79 (12.7%, 79/623) refusers named the following main reasons: extensive travel time to the clinic, no therapeutic advantage, and too time-consuming. Out of the patients not offered to take part in a trial, 265 (51.0%, 265/520) would participate if offered. Of all patients, 8.3% (64/771) used the clinics' homepage as a source of information, of those 79.7% (51/64) were satisfied with its content. To enhance patient recruitment strategies, we asked how patients wish to be informed about possible trials: More than half (52.0%) of the questioned patients preferred an individual medical consultation with their physician.

We further analyzed the trial participation depending on age, gender, unit, and tumor entity. We could show a significant influence of age (p < 0.001) but not for gender (p = 0.724). The trial participation was also significantly associated with the treating unit (p < 0.001) and tumor entity (p = 0.001).

Conclusion

Patients are willing to participate in clinical trials. Better information strategies need to be implemented. Physicians need to be aware of running trials within their department and must counseling counsel patients effectively to improve recruitment. Trial concepts should keep in mind patients’ needs including an adequate number of appointments, positive risk-benefit profiles, and information material.

Subgroup identification in clinical trials: an overview of available methods and their implementations with R

Randomized controlled trials (RCTs) usually enroll heterogeneous study population, and thus it is interesting to identify subgroups of patients for whom the treatment may be beneficial or harmful. A variety of methods have been developed to do such kind of post hoc analyses. Conventional generalized linear model is able to include prognostic variables as a main effect and predictive variables in an interaction with treatment variable. A statistically significant and large interaction effect usually indicates potential subgroups that may have different responses to the treatment. However, the conventional regression method requires to specify the interaction term, which requires knowledge of predictive variables or becomes infeasible when there is a large number of feature variables. The Least Absolute Shrinkage and Selection Operator (LASSO) method does variable selection by shrinking less clear effects (including interaction effects) to zero and in this way selects only certain variables and interactions for the model. There are many tree-based methods for subgroup identification. For example, model-based recursive partitioning incorporates parametric models such as generalized linear models into trees. The model incorporated is usually a simple model with only the treatment as covariate. Predictive and prognostic variables are found and incorporated automatically via the tree. The present article gives an overview of these methods and explains how to perform them using the free software environment for statistical computing R (version 3.3.2). A simulated dataset is employed for illustrating the performance of these methods.

A prospective cohort and extended comprehensive-cohort design provided insights about the generalizability of a pragmatic trial: the ProtecT prostate cancer trial

OBJECTIVES

Randomized controlled trials (RCTs) deliver robust internally valid evidence but generalizability is often neglected. Design features built into the Prostate testing for cancer and Treatment (ProtecT) RCT of treatments for localized prostate cancer (PCa) provided insights into its generalizability.

STUDY DESIGN AND SETTING

Population-based cluster randomization created a prospective study of prostate-specific antigen (PSA) testing and a comprehensive-cohort study including groups choosing treatment or excluded from the RCT, as well as those randomized. Baseline information assessed selection and response during RCT conduct.

RESULTS

The prospective study (82,430 PSA-tested men) represented healthy men likely to respond to a screening invitation. The extended comprehensive cohort comprised 1,643 randomized, 997 choosing treatment, and 557 excluded with advanced cancer/comorbidities. Men choosing treatment were very similar to randomized men except for having more professional/managerial occupations. Excluded men were similar to the randomized socio-demographically but different clinically, representing less healthy men with more advanced PCa.

CONCLUSION

The design features of the ProtecT RCT provided data to assess the representativeness of the prospective cohort and generalizability of the findings of the RCT. Greater attention to collecting data at the design stage of pragmatic trials would better support later judgments by clinicians/policy-makers about the generalizability of RCT findings in clinical practice.

Rare diseases under different levels of economic analysis: current activities, challenges and perspectives

Rare diseases imply clinical and economic burden as well as a significant challenge for health systems. One relevant objective of the activities planned within the European Reference Network on Rare and Complex Connective Tissue and Musculoskeletal Diseases (ERN ReCONNET) is to address the economic dimensions of rare diseases to identify, develop and suggest strategies to improve research and patients' access to orphan drugs (ODs) and highly specialised health technologies. This paper presents a preliminary review of the existing policies on rare diseases in the countries of the Network members. It also introduces and discusses the theme of how to perform health economic evaluations of rare diseases and of existing or new treatments for rare diseases. To obtain a preliminary overview aiming at defining the state of the art of rare diseases policies and initiatives in ERN ReCONNET countries, we collected and analysed the rare diseases national plans of all the eight countries of the ERN ReCONNET participants. The preliminary overview that has been performed showed that in all the ERN ReCONNET countries are in place national plans for rare diseases; however, heterogeneity exists in the reimbursement of ODs, direct provision by the healthcare system, involvement of patients' associations in decision making and implementation of clinical practice guidelines.

Series: Pragmatic trials and real world evidence: Paper 6. Outcome measures in the real world

Results from pragmatic trials should reflect the comparative treatment effects encountered in patients in real-life clinical practice to guide treatment decisions. Therefore, pragmatic trials should focus on outcomes that are relevant to patients, clinical practice, and treatment choices. This sixth article in the series (see Box) discusses different types of outcomes and their suitability for pragmatic trials, design choices for measuring these outcomes, and their implications and challenges. Measuring outcomes in pragmatic trials should not interfere with real-world clinical practice to ensure generalizability of trial results, and routinely collected outcomes should be prioritized. Typical outcomes include mortality, morbidity, functional status, well-being, and resource use. Surrogate endpoints are typically avoided as primary outcome. It is important to measure outcomes over a relevant time horizon and obtain valid and precise results. As pragmatic trials are often open label, a less subjective outcome can reduce bias. Methods that decrease bias or enhance precision of the results, such as standardization and blinding of outcome assessment, should be considered when a high risk of bias or high variability is expected. The selection of outcomes in pragmatic trials should be relevant for decision making and feasible in terms of executing the trial in the context of interest. Therefore, this should be discussed with all stakeholders as early as feasible to ensure the relevance of study results for decision making in clinical practice and the ability to perform the study.