Patient information leaflets for placebo-controlled surgical trials: a review of current practice and recommendations for developers

INTRODUCTION

Informed consent for participation in an RCT is an important ethical and legal requirement. In placebo surgical trials, further issues are raised, and to date, this has not been explored. Patient information leaflets (PILs) are a core component of the informed consent process. This study aimed to investigate the key content of PILs for recently completed placebo-controlled trials of invasive procedures, including surgery, to highlight areas of good practice, identify gaps in information provision for trials of this type and provide recommendations for practice.

METHODS

PILs were sought from trials included in a recent systematic review of placebo-controlled trials of invasive procedures, including surgery. Trial characteristics and data on surgical and placebo interventions under evaluation were extracted. Directed content analysis was applied, informed by published regulatory and good practice guidance on PIL content and existing research on placebo-controlled surgical trials. Results were analysed using descriptive statistics and presented as a narrative summary.

RESULTS

Of the 62 eligible RCTs, authors of 59 trials were contactable and 14 PILs were received for analysis. At least 50% of all PILs included content on general trial design. Explanations of how the placebo differs or is similar to the surgical intervention (i.e. fidelity) were reported in 6 (43%) of the included PILs. Over half (57%) of the PILs included information on the potential therapeutic benefits of the surgical intervention. One (7%) included information on potential indirect therapeutic benefits from invasive components of the placebo. Five (36%) presented the known risks of the placebo intervention, whilst 8 (57%) presented information on the known risks of the surgical intervention. A range of terms was used across the PILs to describe the placebo component, including 'control', 'mock' and 'sham'.

CONCLUSION

Developers of PILs for placebo-controlled surgical trials should carefully consider the use of language (e.g. sham, mock), be explicit about how the placebo differs (or is similar) to the surgical intervention and provide balanced presentations of potential benefits and risks of the surgical intervention separately from the placebo. Further research is required to determine optimal approaches to design and deliver this information for these trials.

Using healthcare systems data for outcomes in clinical trials: issues to consider at the design stage

BACKGROUND

Healthcare system data (HSD) are increasingly used in clinical trials, augmenting or replacing traditional methods of collecting outcome data. This study, PRIMORANT, set out to identify, in the UK context, issues to be considered before the decision to use HSD for outcome data in a clinical trial is finalised, a methodological question prioritised by the clinical trials community.

METHODS

The PRIMORANT study had three phases. First, an initial workshop was held to scope the issues faced by trialists when considering whether to use HSDs for trial outcomes. Second, a consultation exercise was undertaken with clinical trials unit (CTU) staff, trialists, methodologists, clinicians, funding panels and data providers. Third, a final discussion workshop was held, at which the results of the consultation were fed back, case studies presented, and issues considered in small breakout groups.

RESULTS

Key topics included in the consultation process were the validity of outcome data, timeliness of data capture, internal pilots, data-sharing, practical issues, and decision-making. A majority of consultation respondents (n = 78, 95%) considered the development of guidance for trialists to be feasible. Guidance was developed following the discussion workshop, for the five broad areas of terminology, feasibility, internal pilots, onward data sharing, and data archiving.

CONCLUSIONS

We provide guidance to inform decisions about whether or not to use HSDs for outcomes, and if so, to assist trialists in working with registries and other HSD providers to improve the design and delivery of trials.

Emergency Department Resuscitative Endovascular Balloon Occlusion of the Aorta in Trauma Patients With Exsanguinating Hemorrhage: The UK-REBOA Randomized Clinical Trial

Importance

Bleeding is the most common cause of preventable death after trauma.

Objective

To determine the effectiveness of resuscitative endovascular balloon occlusion of the aorta (REBOA) when used in the emergency department along with standard care vs standard care alone on mortality in trauma patients with exsanguinating hemorrhage.

Design, Setting, and Participants

Pragmatic, bayesian, randomized clinical trial conducted at 16 major trauma centers in the UK. Patients aged 16 years or older with exsanguinating hemorrhage were enrolled between October 2017 and March 2022 and followed up for 90 days.

Intervention

Patients were randomly assigned (1:1 allocation) to a strategy that included REBOA and standard care (n = 46) or standard care alone (n = 44).

Main Outcomes and Measures

The primary outcome was all-cause mortality at 90 days. Ten secondary outcomes included mortality at 6 months, while in the hospital, and within 24 hours, 6 hours, or 3 hours; the need for definitive hemorrhage control procedures; time to commencement of definitive hemorrhage control procedures; complications; length of stay; blood product use; and cause of death.

Results

Of the 90 patients (median age, 41 years [IQR, 31-59 years]; 62 [69%] were male; and the median Injury Severity Score was 41 [IQR, 29-50]) randomized, 89 were included in the primary outcome analysis because 1 patient in the standard care alone group declined to provide consent for continued participation and data collection 4 days after enrollment. At 90 days, 25 of 46 patients (54%) had experienced all-cause mortality in the REBOA and standard care group vs 18 of 43 patients (42%) in the standard care alone group (odds ratio [OR], 1.58 [95% credible interval, 0.72-3.52]; posterior probability of an OR >1 [indicating increased odds of death with REBOA], 86.9%). Among the 10 secondary outcomes, the ORs for mortality and the posterior probabilities of an OR greater than 1 for 6-month, in-hospital, and 24-, 6-, or 3-hour mortality were all increased in the REBOA and standard care group, and the ORs were increased with earlier mortality end points. There were more deaths due to bleeding in the REBOA and standard care group (8 of 25 patients [32%]) than in standard care alone group (3 of 18 patients [17%]), and most occurred within 24 hours.

Conclusions and Relevance

In trauma patients with exsanguinating hemorrhage, a strategy of REBOA and standard care in the emergency department does not reduce, and may increase, mortality compared with standard care alone.

Trial Registration

isrctn.org Identifier: ISRCTN16184981.

How do pilot and feasibility studies inform randomised placebo-controlled trials in surgery? A systematic review

INTRODUCTION

Randomised controlled trials (RCTs) with a placebo comparator are considered the gold standard study design when evaluating healthcare interventions. These are challenging to design and deliver in surgery. Guidance recommends pilot and feasibility work to optimise main trial design and conduct; however, the extent to which this occurs in surgery is unknown.

METHOD

A systematic review identified randomised placebo-controlled surgical trials. Articles published from database inception to 31 December 2020 were retrieved from Ovid-MEDLINE, Ovid-EMBASE and CENTRAL electronic databases, hand-searching and expert knowledge. Pilot/feasibility work conducted prior to the RCTs was then identified from examining citations and reference lists. Where studies explicitly stated their intent to inform the design and/or conduct of the future main placebo-controlled surgical trial, they were included. Publication type, clinical area, treatment intervention, number of centres, sample size, comparators, aims and text about the invasive placebo intervention were extracted.

RESULTS

From 131 placebo surgical RCTs included in the systematic review, 47 potentially eligible pilot/feasibility studies were identified. Of these, four were included as true pilot/feasibility work. Three were original articles, one a conference abstract; three were conducted in orthopaedic surgery and one in oral and maxillofacial surgery. All four included pilot RCTs, with an invasive surgical placebo intervention, randomising 9-49 participants in 1 or 2 centres. They explored the acceptability of recruitment and the invasive placebo intervention to patients and trial personnel, and whether blinding was possible. One study examined the characteristics of the proposed invasive placebo intervention using in-depth interviews.

CONCLUSION

Published studies reporting feasibility/pilot work undertaken to inform main placebo surgical trials are scarce. In view of the difficulties of undertaking placebo surgical trials, it is recommended that pilot/feasibility studies are conducted, and more are reported to share key findings and optimise the design of main RCTs.

PROSPERO REGISTRATION NUMBER

CRD42021287371.

Further considerations for placebo controls in surgical trials

The use of invasive placebo controls in surgical trials can be challenging. The ASPIRE guidance, published in the Lancet in 2020, provided advice for the design and conduct of surgical trials with an invasive placebo control. Based on a more recent international expert workshop in June 2022, we now provide further insights into this topic. These include the purpose and design of invasive placebo controls, patient information provision and how findings from these trials may be used to inform decision-making.

Pragmatic evaluation of methods for retrieving unpublished information on comparator interventions in a systematic review of smoking cessation trials

OBJECTIVE

Reporting of the content and delivery characteristics of comparator interventions in published articles is often incomplete. This study examines the feasibility and validity of two methods for collecting additional information on comparator interventions from trial authors.

METHODS & MEASURES

In a systematic review of smoking cessation trials (IC-Smoke), all trial authors were asked to send unpublished comparator intervention materials and complete a specially-developed comparator intervention checklist. All published and additionally obtained information from authors were coded for behaviour change techniques (BCTs) and other characteristics (type of comparator, provider, provider training, delivery mode and treatment duration). To assess representativeness, we assessed the amount of additional information obtained from trial authors compared with the amount that was published. We examined known-group and convergent validity of comparator intervention data when using only published or also unpublished information.

RESULTS

Additional information were obtained from 91/136 (67%) of trial authors. Representativeness, known-group and convergent validity improved substantially based on the data collected by means of the comparator intervention checklist, but not by requesting authors to send any existing comparator materials.

CONCLUSIONS

Requesting authors for unpublished comparator intervention data, using specially-developed checklists and unpublished materials, substantially improves the quality of data available for systematic reviews.

The effectiveness and cost-effectiveness of resuscitative endovascular balloon occlusion of the aorta (REBOA) for trauma patients with uncontrolled torso haemorrhage: study protocol for a randomised clinical trial (the UK-REBOA trial)

BACKGROUND

Haemorrhage is the most common cause of preventable death after injury. REBOA is a novel technique whereby a percutaneously inserted balloon is deployed in the aorta, providing a relatively quick means of temporarily controlling haemorrhage and augmenting cerebral and coronary perfusion, until definitive control of haemorrhage can be attained. The aim of the UK-REBOA trial is to establish the clinical and cost-effectiveness of a policy of standard major trauma centre treatment plus REBOA, as compared with standard major trauma centre treatment alone, for the management of uncontrolled torso haemorrhage caused by injury.

METHODS

Pragmatic, Bayesian, group-sequential, randomised controlled trial, performed in 16 major trauma centres in England. We aim to randomise 120 injured patients with suspected exsanguinating haemorrhage to either standard major trauma centre care plus REBOA or standard major trauma centre care alone. The primary clinical outcome is 90-day mortality. Secondary clinical outcomes include 3-h, 6-h, and 24-h mortality; in-hospital mortality; 6-month mortality; length of stay (in hospital and intensive care unit); 24-h blood product use; need for haemorrhage control procedure (operation or angioembolisation); and time to commencement of haemorrhage control procedure (REBOA, operation, or angioembolisation). The primary economic outcome is lifetime incremental cost per QALY gained, from a health and personal social services perspective.

DISCUSSION

This study, which is the first to randomly allocate patients to treatment with REBOA or standard care, will contribute high-level evidence on the clinical and cost-effectiveness of REBOA in the management of trauma patients with exsanguinating haemorrhage and will provide important data on the feasibility of implementation of REBOA into mainstream clinical practice.

TRIAL REGISTRATION

ISRCTN16184981.

Behavioural optimisation to address trial conduct challenges: case study in the UK-REBOA trial

BACKGROUND

Clinical trials comprise multiple processes at various stages of the trial lifecycle. These processes often involve complex behaviours such as recruiting vulnerable patient populations and clinicians having to deliver complex trial interventions successfully. Few studies have utilised a behavioural framework to assess challenges and develop strategies for effective trial recruitment and delivery of trial interventions. This study reports the application of an innovative methodological approach to understand core trial processes, namely recruitment and intervention delivery, using a behavioural science approach to develop strategies designed to mitigate trial process problems.

METHODS

The UK-REBOA trial aims to evaluate the clinical and cost-effectiveness of resuscitative endovascular balloon occlusion of the aorta (a novel intervention) in injured patients with exsanguinating haemorrhage. A behavioural investigation ('diagnosis') was conducted using theory-informed (Theoretical Domains Framework, TDF) semi-structured interviews with site staff from the UK-REBOA trial to examine trial processes which could be improved in relation to trial recruitment and delivery of the intervention. Interviews were analysed using the TDF to identify influences on behaviour, which were then mapped to techniques for behaviour change and developed into potential solutions.

RESULTS

The behavioural diagnosis of the challenges experienced during trial processes highlighted factors relevant to a range of TDF domains: Skills, Environmental context and resources, Beliefs about capabilities, Beliefs about consequences, Social influences, and Memory, attention, and decision-making processes. Within the solution development phase, we identified 24 suitable behaviour change techniques that were developed into proposed solutions to target reported process problems with the aim of changing behaviour to improve recruitment and/or intervention delivery. Proposed solutions included targeted changes to trial training content, suggestions to restructure the environment (e.g. reinforced the purpose of the trial with information about the social and environmental consequences) and other strategies to reduce barriers to recruitment and intervention delivery.

CONCLUSIONS

This study demonstrates the feasibility of applying a behavioural approach to investigate ('diagnose') behavioural trial process problems and subsequently develop and implement targeted solutions ('treatment') in an active trauma trial. Understanding the factors that affected behaviour, attitudes and beliefs in this trauma trial allowed us to implement theoretically informed, evidence-based solutions designed to enhance trial practices.

TRIAL REGISTRATION

ISRCTN 16,184,981.

‘Using humanity to change systems’ – understanding the work of online feedback moderation: A case study of Care Opinion Scotland

Objective

To gain a deeper understanding of online patient feedback moderation through the organisation of Care Opinion in Scotland.

Methods

An ethnographic study, initially using in-person participant observations, switching to remote methods due to the pandemic. This involved the use of remote observations and interviews. Interviews were carried out with the whole Scottish team (n = 8).

Results

Our results identify three major themes of work found in online patient feedback moderation. The first is process work, where moderators make decisions on how to edit and publish stories. The second is emotional labour from working with healthcare experiences and with NHS staff. The third is the brokering/mediation role of Care Opinion, where they must manage the relationships between authors, subscribing healthcare providers and Scottish Government. Our results also capture that these different themes are not independent and can at times influence the others.

Conclusion

Our results build on previous literature on Care Opinion and provide novel insights into the emotional and brokering/mediation work they undertake. Care Opinion holds a unique position, where they must balance the interests of the key stakeholders. Care Opinion holds the power to amplify authors’ voices but the power to make changes to services lies with NHS staff and services. Online moderation work is complex, and moderators require support to carry out their work especially given the emotional impact. Further research is planned to understand how patient stories are used by NHS Scotland, and the emotional labour involved with stories, from both the author and NHS staff perspective.

Antibiotic prescribing for respiratory tract infection: exploring drivers of cognitive effort and factors associated with inappropriate prescribing

BACKGROUND

Antibiotics are over-prescribed for upper respiratory tract infection (URTI). It is unclear how factors known to influence prescribing decisions operate 'in the moment': dual process theories, which propose two systems of thought ('automatic' and 'analytical'), may inform this.

OBJECTIVE(S)

Investigate cognitive processes underlying antibiotic prescribing for URTI and the factors associated with inappropriate prescribing.

METHODS

We conducted a mixed methods study. Primary care physicians in Scotland (n = 158) made prescribing decisions for patient scenarios describing sore throat or otitis media delivered online. Decision difficulty and decision time were recorded. Decisions were categorized as appropriate or inappropriate based on clinical guidelines. Regression analyses explored relationships between scenario and physician characteristics and decision difficulty, time and appropriateness. A subgroup (n = 5) verbalized their thoughts (think aloud) whilst making decisions for a subset of scenarios. Interviews were analysed inductively.

RESULTS

Illness duration of 4+ days was associated with greater difficulty. Inappropriate prescribing was associated with clinical factors suggesting viral cause and with patient preference against antibiotics. In interviews, physicians made appropriate decisions quickly for easier cases, with little deliberation, reflecting automatic-type processes. For more difficult cases, physicians deliberated over information in some instances, but not in others, with inappropriate prescribing occurring in both instances. Some interpretations of illness duration and unilateral ear examination findings (for otitis media) were associated with inappropriate prescribing.

CONCLUSION

Both automatic and analytical processes may lead to inappropriate prescribing. Interventions to support appropriate prescribing may benefit from targeting interpretation of illness duration and otitis media ear exam findings and facilitating appropriate use of both modes of thinking.

Total versus partial knee replacement in patients with medial compartment knee osteoarthritis: the TOPKAT RCT

BACKGROUND

Late-stage medial compartment knee osteoarthritis can be treated using total knee replacement or partial (unicompartmental) knee replacement. There is high variation in treatment choice and insufficient evidence to guide selection.

OBJECTIVE

To assess the clinical effectiveness and cost-effectiveness of partial knee replacement compared with total knee replacement in patients with medial compartment knee osteoarthritis. The findings are intended to guide surgical decision-making for patients, surgeons and health-care providers.

DESIGN

This was a randomised, multicentre, pragmatic comparative effectiveness trial that included an expertise component. The target sample size was 500 patients. A web-based randomisation system was used to allocate treatments.

SETTING

Twenty-seven NHS hospitals (68 surgeons).

PARTICIPANTS

Patients with medial compartment knee osteoarthritis.

INTERVENTIONS

The trial compared the overall management strategy of partial knee replacement treatment with total knee replacement treatment. No specified brand or subtype of implant was investigated.

MAIN OUTCOME MEASURES

The Oxford Knee Score at 5 years was the primary end point. Secondary outcomes included activity scores, global health measures, transition items, patient satisfaction (Lund Score) and complications (including reoperation, revision and composite 'failure' - defined by minimal Oxford Knee Score improvement and/or reoperation). Cost-effectiveness was also assessed.

RESULTS

A total of 528 patients were randomised (partial knee replacement, n = 264; total knee replacement, n = 264). The follow-up primary outcome response rate at 5 years was 88% and both operations had good outcomes. There was no significant difference between groups in mean Oxford Knee Score at 5 years (difference 1.04, 95% confidence interval -0.42 to 2.50). An area under the curve analysis of the Oxford Knee Score at 5 years showed benefit in favour of partial knee replacement over total knee replacement, but the difference was within the minimal clinically important difference [mean 36.6 (standard deviation 8.3) (n = 233), mean 35.1 (standard deviation 9.1) (n = 231), respectively]. Secondary outcome measures showed consistent patterns of benefit in the direction of partial knee replacement compared with total knee replacement although most differences were small and non-significant. Patient-reported improvement (transition) and reflection (would you have the operation again?) showed statistically significant superiority for partial knee replacement only, but both of these variables could be influenced by the lack of blinding. The frequency of reoperation (including revision) by treatment received was similar for both groups: 22 out of 245 for partial knee replacement and 28 out of 269 for total knee replacement patients. Revision rates at 5 years were 10 out of 245 for partial knee replacement and 8 out of 269 for total knee replacement. There were 28 'failures' of partial knee replacement and 38 'failures' of total knee replacement (as defined by composite outcome). Beyond 1 year, partial knee replacement was cost-effective compared with total knee replacement, being associated with greater health benefits (measured using quality-adjusted life-years) and lower health-care costs, reflecting lower costs of the index surgery and subsequent health-care use.

LIMITATIONS

It was not possible to blind patients in this study and there was some non-compliance with the allocated treatment interventions. Surgeons providing partial knee replacement were relatively experienced with the procedure.

CONCLUSIONS

Both total knee replacement and partial knee replacement are effective, offer similar clinical outcomes and have similar reoperation and complication rates. Some patient-reported measures of treatment approval were significantly higher for partial knee replacement than for total knee replacement. Partial knee replacement was more cost-effective (more effective and cost saving) than total knee replacement at 5 years.

FUTURE WORK

Further (10-year) follow-up is in progress to assess the longer-term stability of these findings.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN03013488 and ClinicalTrials.gov NCT01352247.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 20. See the NIHR Journals Library website for further project information.

Placebo comparator group selection and use in surgical trials: the ASPIRE project including expert workshop

BACKGROUND

The use of placebo comparisons for randomised trials assessing the efficacy of surgical interventions is increasingly being considered. However, a placebo control is a complex type of comparison group in the surgical setting and, although powerful, presents many challenges.

OBJECTIVES

To provide a summary of knowledge on placebo controls in surgical trials and to summarise any recommendations for designers, evaluators and funders of placebo-controlled surgical trials.

DESIGN

To carry out a state-of-the-art workshop and produce a corresponding report involving key stakeholders throughout.

SETTING

A workshop to discuss and summarise the existing knowledge and to develop the new guidelines.

RESULTS

To assess what a placebo control entails and to assess the understanding of this tool in the context of surgery is considered, along with when placebo controls in surgery are acceptable (and when they are desirable). We have considered ethics arguments and regulatory requirements, how a placebo control should be designed, how to identify and mitigate risk for participants in these trials, and how such trials should be carried out and interpreted. The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Surgical placebos might be most appropriate when there is poor evidence for the efficacy of the procedure and a justified concern that results of a trial would be associated with a high risk of bias, particularly because of the placebo effect.

CONCLUSIONS

The use of placebo controls is justified in randomised controlled trials of surgical interventions provided that there is a strong scientific and ethics rationale. Feasibility work is recommended to optimise the design and implementation of randomised controlled trials. An outline for best practice was produced in the form of the Applying Surgical Placebo in Randomised Evaluations (ASPIRE) guidelines for those considering the use of a placebo control in a surgical randomised controlled trial.

LIMITATIONS

Although the workshop participants involved international members, the majority of participants were from the UK. Therefore, although every attempt was made to make the recommendations applicable to all health systems, the guidelines may, unconsciously, be particularly applicable to clinical practice in the UK NHS.

FUTURE WORK

Future work should evaluate the use of the ASPIRE guidelines in making decisions about the use of a placebo-controlled surgical trial. In addition, further work is required on the appropriate nomenclature to adopt in this space.

FUNDING

Funded by the Medical Research Council UK and the National Institute for Health Research as part of the Medical Research Council-National Institute for Health Research Methodology Research programme.

Providing trial results to participants in phase III pragmatic effectiveness RCTs: a scoping review

Background

There is an ethical imperative to offer the results of trials to those who participated. Existing research highlights that less than a third of trials do so, despite the desire of participants to receive the results of the trials they participated in. This scoping review aimed to identify, collate, and describe the available evidence relating to any aspect of disseminating trial results to participants.

Methods

A scoping review was conducted employing a search of key databases (MEDLINE, EMBASE, PsycINFO, and the Cumulative Index to Nursing & Allied Health Literature (CINAHL) from January 2008 to August 2019) to identify studies that had explored any aspect of disseminating results to trial participants. The search strategy was based on that of a linked existing review. The evidence identified describes the characteristics of included studies using narrative description informed by analysis of relevant data using descriptive statistics.

Results

Thirty-three eligible studies, including 12,700 participants (which included patients, health care professionals, trial teams), were identified and included. Reporting of participant characteristics (age, gender, ethnicity) across the studies was poor. The majority of studies investigated dissemination of aggregate trial results. The most frequently reported mode of disseminating of results was postal. Overall, the results report that participants evaluated receipt of trial results positively, with reported benefits including improved communication, demonstration of appreciation, improved retention, and engagement in future research. However, there were also some concerns about how well the dissemination was resourced and done, worries about emotional effects on participants especially when reporting unfavourable results, and frustration about the delay between the end of the trial and receipt of results.

Conclusions

This scoping review has highlighted that few high-quality evaluative studies have been conducted that can provide evidence on the best ways to deliver results to trial participants. There have been relatively few qualitative studies that explore perspectives from diverse populations, and those that have been conducted are limited to a handful of clinical areas. The learning from these studies can be used as a platform for further research and to consider some core guiding principles of the opportunities and challenges when disseminating trial results to those who participated.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05300-x.

Methods and results used in the development of a consensus-driven extension to the Consolidated Standards of Reporting Trials (CONSORT) statement for trials conducted using cohorts and routinely collected data (CONSORT-ROUTINE)

OBJECTIVES

Randomised controlled trials conducted using cohorts and routinely collected data, including registries, electronic health records and administrative databases, are increasingly used in healthcare intervention research. A Consolidated Standards of Reporting Trials (CONSORT) statement extension for trials conducted using cohorts and routinely collected data (CONSORT-ROUTINE) has been developed with the goal of improving reporting quality. This article describes the processes and methods used to develop the extension and decisions made to arrive at the final checklist.

METHODS

The development process involved five stages: (1) identification of the need for a reporting guideline and project launch; (2) conduct of a scoping review to identify possible modifications to CONSORT 2010 checklist items and possible new extension items; (3) a three-round modified Delphi study involving key stakeholders to gather feedback on the checklist; (4) a consensus meeting to finalise items to be included in the extension, followed by stakeholder piloting of the checklist; and (5) publication, dissemination and implementation of the final checklist.

RESULTS

27 items were initially developed and rated in Delphi round 1, 13 items were rated in round 2 and 11 items were rated in round 3. Response rates for the Delphi study were 92 of 125 (74%) invited participants in round 1, 77 of 92 (84%) round 1 completers in round 2 and 62 of 77 (81%) round 2 completers in round 3. Twenty-seven members of the project team representing a variety of stakeholder groups attended the in-person consensus meeting. The final checklist includes five new items and eight modified items. The extension Explanation & Elaboration document further clarifies aspects that are important to report.

CONCLUSION

Uptake of CONSORT-ROUTINE and accompanying Explanation & Elaboration document will improve conduct of trials, as well as the transparency and completeness of reporting of trials conducted using cohorts and routinely collected data.

An international core outcome set for evaluating interventions to improve informed consent to clinical trials: The ELICIT Study

•

First internationally agreed minimum set of outcomes deemed essential to be measured in all future studies evaluating interventions to improve decisions about participating in an randomized controlled trial.

•

Broad stakeholder involvement, including; potential trial participants (e.g., patients or others who could provide a lay perspective), trialists, research nurses, social scientists, clinicians, bioethicists, and research ethics committee members.

•

Represents outcomes that are of core importance to multiple stakeholders and, if adopted, will improve the relevance of future trials in this field.

Objective

To develop a core outcome set for the evaluation of interventions that aim to improve how people make decisions about whether to participate in randomized controlled trials (of healthcare interventions), the ELICIT Study.

Study Design

International mixed-method study involving a systematic review of existing outcomes, semi-structured interviews, an online Delphi survey, and a face-to-face consensus meeting.

Results

The literature review and stakeholder interviews (n = 25) initially identified 1045 reported outcomes that were grouped into 40 individually distinct outcomes. These 40 outcomes were scored for importance in two rounds of an online Delphi survey (n = 79), with 18 people attending the consensus meeting. Consensus was reached on 12 core outcomes: therapeutic misconception; comfort with decision; authenticity of decision; communication about the trial; empowerment; sense of altruism; equipoise; knowledge; salience of questions; understanding, how helpful the process was for decision making; and trial attrition.

Conclusion

The ELICIT core outcome set is the first internationally agreed minimum set of outcomes deemed essential to be measured in all future studies evaluating interventions to improve decisions about participating in an randomized controlled trial. Use of the ELICIT core set will ensure that results from these trials are comparable and relevant to all stakeholders.

Registration

COMET database - http://www.comet-initiative.org/Studies/Details/595.

Development of a behaviour change workplace-based intervention to improve nurses' eating and physical activity

BACKGROUND

There is a critical need for an intervention to improve nurses' eating and physical activity behaviours. As nurses spend a substantial proportion of their waking hours at work, concerted efforts to deliver such interventions in the workplace is growing. This study formed part of a multiphase programme of research that aimed to systematically develop an evidence-based and theory-informed workplace intervention to promote changes in eating and physical activity among nurses.

METHODS

The intervention was developed iteratively, in line with Medical Research Council complex intervention guidelines. It involved four activities: (1) identifying the evidence base, (2) understanding the determinants of nurses' eating and physical activity behaviour change through theory-based qualitative interviews and survey, (3) identifying intervention options using the Behaviour Change Wheel, and (4) specifying intervention content and implementation options using a taxonomy of behaviour change techniques.

RESULTS

Data from 13 randomised controlled trials indicated that workplace-based behaviour change interventions targeted to this population are effective in changing behaviour. The evidence base was, however, limited in quantity and quality. Nurses' beliefs about important factors determining their eating and physical activity behaviour were identified across 16 qualitative interviews and 245 survey responses, and key determinants included environmental context and resources, behavioural regulation, emotion, beliefs about consequences, knowledge and optimism. Based on these findings, 22 behaviour change techniques suitable for targeting the identified determinants were identified and combined into a potential workplace intervention.

CONCLUSIONS

An evidence-based and theory-informed intervention tailored to the target population and setting has been explicitly conceptualised using a systematic approach. The proposed intervention addresses previous evidence gaps for the user population of nurses. Further to this, such an intervention, if implemented, has the potential to impact nurses' eating and physical activity behaviours and in turn, the health of nurses and the quality of healthcare delivery.

The importance of decision intent within descriptions of pragmatic trials

OBJECTIVE

It is now more than 50 years since the concepts of explanatory and pragmatic attitudes toward trials were first discussed by Schwartz and Lellouch in their influential 1967 paper. Since then, there has been increasing focus on design aspects that may be consistent with more pragmatic attitudes within clinical trials, and a number of tools developed to assist investigators prospectively think about their trial design. Researchers have subsequently expressed interest in using these tools retrospectively to characterize trials as pragmatic or explanatory.

RESULTS

We suggest that recent attempts to retrospectively dichotomize trials solely on the basis of quantitative scoring of trial design features are flawed. Instead, we argue that there is a need to consider both the intent and design when assessing the degree of pragmatism within a trial.

CONCLUSION

The practical implication of our suggestion for trial reporting is that investigators should explicitly state the intent of the trial through a clear articulation of the decision that they hope will be informed by the trial results. This should be coupled with a completed PRagmatic-Explanatory Continuum Indicator Summary 2 assessment (or similar) with an explanation of study design choices to appropriately assess whether the study design is consistent with the study intent. We believe this will assist reviewers and knowledge users in making assessments of trials.

Equity of access to critical care services in Scotland: A Bayesian spatial analysis

Background

There is increasing evidence that access to critical care services is not equitable. We aimed to investigate whether location of residence in Scotland impacts on the risk of admission to an Intensive Care Unit and on outcomes.

Methods

This was a population-based Bayesian spatial analysis of adult patients admitted to Intensive Care Units in Scotland between January 2011 and December 2015. We used a Besag-York-Mollié model that allows us to make direct probabilistic comparisons between areas regarding risk of admission to Intensive Care Units and on outcomes.

Results

A total of 17,596 patients were included. The five-year age- and sex-standardised admission rate was 352 per 100,000 residents. There was a cluster of Council Areas in the North-East of the country which had lower adjusted admission rates than the Scottish average. Midlothian, in South East Scotland had higher spatially adjusted admission rates than the Scottish average. There was no evidence of geographical variation in mortality.

Conclusion

Access to critical care services in Scotland varies with location of residence. Possible reasons include differential co-morbidity burden, service provision and access to critical care services. In contrast, the probability of surviving an Intensive Care Unit admission, if admitted, does not show geographical variation.

Optimizing the design of invasive placebo interventions in randomized controlled trials

Background

Placebo‐controlled trials play an important role in the evaluation of healthcare interventions. However, they can be challenging to design and deliver for invasive interventions, including surgery. In‐depth understanding of the component parts of the treatment intervention is needed to ascertain what should, and should not, be delivered as part of the placebo. Assessment of risk to patients and strategies to ensure that the placebo effectively mimics the treatment are also required. To date, no guidance exists for the design of invasive placebo interventions. This study aimed to develop a framework to optimize the design and delivery of invasive placebo interventions in RCTs.

Methods

A preliminary framework was developed using published literature to: expand the scope of an existing typology, which facilitates the deconstruction of invasive interventions; and identify placebo optimization strategies. The framework was refined after consultation with key stakeholders in surgical trials, consensus methodology and medical ethics.

Results

The resulting DITTO framework consists of five stages: deconstruct treatment intervention into constituent components and co‐interventions; identify critical surgical element(s); take out the critical element(s); think risk, feasibility and role of placebo in the trial when considering remaining components; and optimize placebo to ensure effective blinding of patients and trial personnel.

Conclusion

DITTO considers invasive placebo composition systematically, accounting for risk, feasibility and placebo optimization. Use of the framework can support the design of high‐quality RCTs, which are needed to underpin delivery of healthcare interventions.

Considerations and methods for placebo controls in surgical trials (ASPIRE guidelines)

Placebo comparisons are increasingly being considered for randomised trials assessing the efficacy of surgical interventions. The aim of this Review is to provide a summary of knowledge on placebo controls in surgical trials. A placebo control is a complex type of comparison group in the surgical setting and, although powerful, presents many challenges. This Review outlines what a placebo control entails and present understanding of this tool in the context of surgery. We consider when placebo controls in surgery are acceptable (and when they are desirable) in terms of ethical arguments and regulatory requirements, how a placebo control should be designed, how to identify and mitigate risk for participants in these trials, and how such trials should be done and interpreted. Use of placebo controls is justified in randomised controlled trials of surgical interventions provided there is a strong scientific and ethical rationale. Surgical placebos might be most appropriate when there is poor evidence for the efficacy of the procedure and a justified concern that results of a trial would be associated with high risk of bias, particularly because of the placebo effect. Feasibility work is recommended to optimise the design and implementation of randomised controlled trials. This Review forms an outline for best practice and provides guidance, in the form of the Applying Surgical Placebo in Randomised Evaluations (known as ASPIRE) checklist, for those considering the use of a placebo control in a surgical randomised controlled trial.

Reporting of key methodological issues in placebo-controlled trials of surgery needs improvement: a systematic review

OBJECTIVES

To examine key methodological considerations for using a placebo intervention in randomized controlled trials (RCTs) evaluating invasive procedures, including surgery.

STUDY DESIGN AND SETTING

RCTs comparing an invasive procedure with a placebo were included in this systematic review. Articles published from database inception to December 31, 2017, were retrieved from Ovid MEDLINE, Ovid EMBASE and CENTRAL electronic databases, by handsearching references and expert knowledge. Data on trial characteristics (clinical area, nature of invasive procedure, number of patients and centers) and key methodological (rationale for using placebos, minimization of risk, information provision, offering the treatment intervention to patients randomized to placebo, delivery of cointerventions, and intervention standardization and fidelity) were extracted and summarized descriptively.

RESULTS

One hundred thirteen articles reporting 96 RCTs were identified. Most were conducted in gastrointestinal surgery (n = 40, 42%) and evaluated minimally invasive procedures (n = 44, 46%). Over two-thirds randomized fewer than 100 patients (n = 65, 68%) and a third were single center (n = 31, 32%). A third (n = 33, 34%) did not report a rationale for using a placebo. Most common strategies to minimize patient risk were operator skill (n = 22, 23%) and independent data monitoring (n = 28, 29%). Provision of patient information regarding placebo use was infrequently reported (n = 11, 11%). Treatment interventions were offered to patients randomized to placebo in 43 trials (45%). Cointerventions were inconsistently reported, but 64 trials (67%) stated that anesthesia was matched between groups. Attempts to standardize interventions and monitor their delivery were reported in n = 7, (7%) and n = 4, (4%) trials, respectively.

CONCLUSION

Most placebo-controlled trials in surgery evaluate minor surgical procedures and currently there is inconsistent reporting of key trial methods. There is a need for guidance to optimize the transparency of trial reporting in this area.

Five-Year Outcomes of a Randomized Trial of Treatments for Varicose Veins

BACKGROUND

Endovenous laser ablation and ultrasound-guided foam sclerotherapy are recommended alternatives to surgery for the treatment of primary varicose veins, but their long-term comparative effectiveness remains uncertain.

METHODS

In a randomized, controlled trial involving 798 participants with primary varicose veins at 11 centers in the United Kingdom, we compared the outcomes of laser ablation, foam sclerotherapy, and surgery. Primary outcomes at 5 years were disease-specific quality of life and generic quality of life, as well as cost-effectiveness based on models of expected costs and quality-adjusted life-years (QALYs) gained that used data on participants' treatment costs and scores on the EuroQol EQ-5D questionnaire.

RESULTS

Quality-of-life questionnaires were completed by 595 (75%) of the 798 trial participants. After adjustment for baseline scores and other covariates, scores on the Aberdeen Varicose Vein Questionnaire (on which scores range from 0 to 100, with lower scores indicating a better quality of life) were lower among patients who underwent laser ablation or surgery than among those who underwent foam sclerotherapy (effect size [adjusted differences between groups] for laser ablation vs. foam sclerotherapy, -2.86; 95% confidence interval [CI], -4.49 to -1.22; P<0.001; and for surgery vs. foam sclerotherapy, -2.60; 95% CI, -3.99 to -1.22; P<0.001). Generic quality-of-life measures did not differ among treatment groups. At a threshold willingness-to-pay ratio of £20,000 ($28,433 in U.S. dollars) per QALY, 77.2% of the cost-effectiveness model iterations favored laser ablation. In a two-way comparison between foam sclerotherapy and surgery, 54.5% of the model iterations favored surgery.

CONCLUSIONS

In a randomized trial of treatments for varicose veins, disease-specific quality of life 5 years after treatment was better after laser ablation or surgery than after foam sclerotherapy. The majority of the probabilistic cost-effectiveness model iterations favored laser ablation at a willingness-to-pay ratio of £20,000 ($28,433) per QALY. (Funded by the National Institute for Health Research; CLASS Current Controlled Trials number, ISRCTN51995477.).

The clinical and cost-effectiveness of total versus partial knee replacement in patients with medial compartment osteoarthritis (TOPKAT): 5-year outcomes of a randomised controlled trial

BACKGROUND

Late-stage isolated medial knee osteoarthritis can be treated with total knee replacement (TKR) or partial knee replacement (PKR). There is high variation in treatment choice and little robust evidence to guide selection. The Total or Partial Knee Arthroplasty Trial (TOPKAT) therefore aims to assess the clinical effectiveness and cost-effectiveness of TKR versus PKR in patients with medial compartment osteoarthritis of the knee, and this represents an analysis of the main endpoints at 5 years.

METHODS

Our multicentre, pragmatic randomised controlled trial was done at 27 UK sites. We used a combined expertise-based and equipoise-based approach, in which patients with isolated osteoarthritis of the medial compartment of the knee and who satisfied general requirements for a medial PKR were randomly assigned (1:1) to receive PKR or TKR by surgeons who were either expert in and willing to perform both surgeries or by a surgeon with particular expertise in the allocated procedure. The primary endpoint was the Oxford Knee Score (OKS) 5 years after randomisation in all patients assigned to groups. Health-care costs (in UK 2017 prices) and cost-effectiveness were also assessed. This trial is registered with ISRCTN (ISRCTN03013488) and ClinicalTrials.gov (NCT01352247).

FINDINGS

Between Jan 18, 2010, and Sept 30, 2013, we assessed 962 patients for their eligibility, of whom 431 (45%) patients were excluded (121 [13%] patients did not meet the inclusion criteria and 310 [32%] patients declined to participate) and 528 (55%) patients were randomly assigned to groups. 94% of participants responded to the follow-up survey 5 years after their operation. At the 5-year follow-up, we found no difference in OKS between groups (mean difference 1·04, 95% CI -0·42 to 2·50; p=0·159). In our within-trial cost-effectiveness analysis, we found that PKR was more effective (0·240 additional quality-adjusted life-years, 95% CI 0·046 to 0·434) and less expensive (-£910, 95% CI -1503 to -317) than TKR during the 5 years of follow-up. This finding was a result of slightly better outcomes, lower costs of surgery, and lower follow-up health-care costs with PKR than TKR.

INTERPRETATION

Both TKR and PKR are effective, offer similar clinical outcomes, and result in a similar incidence of re-operations and complications. Based on our clinical findings, and results regarding the lower costs and better cost-effectiveness with PKR during the 5-year study period, we suggest that PKR should be considered the first choice for patients with late-stage isolated medial compartment osteoarthritis.

FUNDING

National Institute for Health Research Health Technology Assessment Programme.

Development and evaluation of decision aids for people considering taking part in a clinical trial: a conceptual framework

Ethical requirements of informed consent stipulate that patients approached to participate in a clinical trial be provided with written information that must cover key aspects of the trial. For consent to be deemed “informed”, potential participants should be provided with a range of information about the trials (e.g., the trial aims, the anticipated benefits and potential risks of the trial, and their right to withdraw consent at any time). However, it is well documented that simple provision of this information does not ensure that participants make truly informed decisions. Decision aids, tools that have been shown in a treatment and screening context to support better-quality decisions, are emerging as a possible vehicle to support decision making about trial participation. However, information on how they should best be developed and evaluated in a clinical trial context is lacking. Therefore, this article, drawing on theoretical and empirical insights, outlines a framework for the development and evaluation of decision aids for people considering taking part in a clinical trial.

Stakeholder views regarding ethical issues in the design and conduct of pragmatic trials: study protocol

Background

Randomized controlled trial (RCT) trial designs exist on an explanatory-pragmatic spectrum, depending on the degree to which a study aims to address a question of efficacy or effectiveness. As conceptualized by Schwartz and Lellouch in 1967, an explanatory approach to trial design emphasizes hypothesis testing about the mechanisms of action of treatments under ideal conditions (efficacy), whereas a pragmatic approach emphasizes testing effectiveness of two or more available treatments in real-world conditions. Interest in, and the number of, pragmatic trials has grown substantially in recent years, with increased recognition by funders and stakeholders worldwide of the need for credible evidence to inform clinical decision-making. This increase has been accompanied by the onset of learning healthcare systems, as well as an increasing focus on patient-oriented research. However, pragmatic trials have ethical challenges that have not yet been identified or adequately characterized. The present study aims to explore the views of key stakeholders with respect to ethical issues raised by the design and conduct of pragmatic trials. It is embedded within a large, four-year project that seeks to develop guidance for the ethical design and conduct of pragmatic trials. As a first step, this study will address important gaps in the current empirical literature with respect to identifying a comprehensive range of ethical issues arising from the design and conduct of pragmatic trials. By opening up a broad range of topics for consideration within our parallel ethical analysis, we will extend the current debate, which has largely emphasized issues of consent, to the range of ethical considerations that may flow from specific design choices.

Methods

Semi-structured interviews with key stakeholders (e.g. trialists, methodologists, lay members of study teams, bioethicists, and research ethics committee members), across multiple jurisdictions, identified based on their known experience and/or expertise with pragmatic trials.

Discussion

We expect that the study outputs will be of interest to a wide range of knowledge users including trialists, ethicists, research ethics committees, journal editors, regulators, healthcare policymakers, research funders and patient groups. All publications will adhere to the Tri-Agency Open Access Policy on Publications.

Electronic supplementary material

The online version of this article (10.1186/s12910-018-0332-z) contains supplementary material, which is available to authorized users.

Protocol for the development of a CONSORT extension for RCTs using cohorts and routinely collected health data

BACKGROUND

Randomized controlled trials (RCTs) are often complex and expensive to perform. Less than one third achieve planned recruitment targets, follow-up can be labor-intensive, and many have limited real-world generalizability. Designs for RCTs conducted using cohorts and routinely collected health data, including registries, electronic health records, and administrative databases, have been proposed to address these challenges and are being rapidly adopted. These designs, however, are relatively recent innovations, and published RCT reports often do not describe important aspects of their methodology in a standardized way. Our objective is to extend the Consolidated Standards of Reporting Trials (CONSORT) statement with a consensus-driven reporting guideline for RCTs using cohorts and routinely collected health data.

METHODS

The development of this CONSORT extension will consist of five phases. Phase 1 (completed) consisted of the project launch, including fundraising, the establishment of a research team, and development of a conceptual framework. In phase 2, a systematic review will be performed to identify publications (1) that describe methods or reporting considerations for RCTs conducted using cohorts and routinely collected health data or (2) that are protocols or report results from such RCTs. An initial "long list" of possible modifications to CONSORT checklist items and possible new items for the reporting guideline will be generated based on the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) and The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statements. Additional possible modifications and new items will be identified based on the results of the systematic review. Phase 3 will consist of a three-round Delphi exercise with methods and content experts to evaluate the "long list" and generate a "short list" of key items. In phase 4, these items will serve as the basis for an in-person consensus meeting to finalize a core set of items to be included in the reporting guideline and checklist. Phase 5 will involve drafting the checklist and elaboration-explanation documents, and dissemination and implementation of the guideline.

DISCUSSION

Development of this CONSORT extension will contribute to more transparent reporting of RCTs conducted using cohorts and routinely collected health data.

Developing a framework for the ethical design and conduct of pragmatic trials in healthcare: a mixed methods research protocol

Background

There is a widely recognized need for more pragmatic trials that evaluate interventions in real-world settings to inform decision-making by patients, providers, and health system leaders. Increasing availability of electronic health records, centralized research ethics review, and novel trial designs, combined with support and resources from governments worldwide for patient-centered research, have created an unprecedented opportunity to advance the conduct of pragmatic trials, which can ultimately improve patient health and health system outcomes. Such trials raise ethical issues that have not yet been fully addressed, with existing literature concentrating on regulations in specific jurisdictions rather than arguments grounded in ethical principles. Proposed solutions (e.g. using different regulations in “learning healthcare systems”) are speculative with no guarantee of improvement over existing oversight procedures. Most importantly, the literature does not reflect a broad vision of protecting the core liberty and welfare interests of research participants. Novel ethical guidance is required. We have assembled a team of ethicists, trialists, methodologists, social scientists, knowledge users, and community members with the goal of developing guidance for the ethical design and conduct of pragmatic trials.

Methods

Our project will combine empirical and conceptual work and a consensus development process. Empirical work will: (1) identify a comprehensive list of ethical issues through interviews with a small group of key informants (e.g. trialists, ethicists, chairs of research ethics committees); (2) document current practices by reviewing a random sample of pragmatic trials and surveying authors; (3) elicit views of chairs of research ethics committees through surveys in Canada, UK, USA, France, and Australia; and (4) elicit views and experiences of community members and health system leaders through focus groups and surveys. Conceptual work will consist of an ethical analysis of identified issues and the development of new ethical solutions, outlining principles, policy options, and rationales. The consensus development process will involve an independent expert panel to develop a final guidance document.

Discussion

Planned output includes manuscripts, educational materials, and tailored guidance documents to inform and support researchers, research ethics committees, journal editors, regulators, and funders in the ethical design and conduct of pragmatic trials.

Surgeons' and methodologists' perceptions of utilising an expertise-based randomised controlled trial design: a qualitative study

BACKGROUND

Randomised controlled trials (RCTs) are widely recognised to be the most rigorous way to test new and emerging clinical interventions. When the interventions under study are two different surgical procedures, however, surgeons are required to be trained and sufficiently proficient in the different surgical approaches to take part in such a trial. It is often the case that even where surgeons can perform both trial surgical procedures, they have a preference and/or have more expertise in one of the procedures. The expertise-based trial design, where participating surgeons only provide the procedure in which they have appropriate expertise, has been proposed to overcome this problem. When expertise-based designs should be best used remains unclear; such approaches may be more suited to addressing specific questions. The aim of this qualitative study was to improve understanding about the range of views that surgeons and methodologists have regarding the use of the expertise-based RCT design.

METHODS

Twelve individual interviews with surgeons and methodologists with experience of surgical trials were conducted. Interviews were semi-structured and conducted face-to-face or by telephone. Interviews were audio-recorded, transcribed and analysed systematically using an interpretive approach.

RESULTS

Both surgeons and methodologists saw potential advantages in the expertise-based design particularly in terms of surgeons' participation and in trials where the procedures being evaluated were significantly different. The main disadvantages identified were methodological (e.g. the potential for surgeons carrying out one of the trial procedure being systematically different) and operational (e.g. the need to 'transfer' patients between surgeons with potential consequences for the surgeon/patient relationship).

CONCLUSION

This study suggests that the expertise-based trial design has significant potential to increase surgeon participation in trials in some settings. In other settings the standard design was generally seen as the preferable design. Particularly suitable conditions for an expertise-based design include those where the surgical procedures under evaluation are substantially different, where they are routinely delivered by different health professionals/surgeons with clear proficiencies in each; and contexts in which a multiple-surgeon model is in use and trust between the patient and surgeons can be suitably protected. The standard design was seen by most participants as the default design. Several logistical and methodological concerns remain to be addressed before the expertise-based design is likely to be more widely adopted.

Relative importance of informational items in participant information leaflets for trials: a Q-methodology approach

OBJECTIVES

To identify which information items potential participants and research nurses rank as the most important, and the reasons for this, when considering participation in a randomised controlled trial.

DESIGN

Q-methodology approach alongside a think-aloud process. Using a vignette outlining a hypothetical trial, participants were asked to rank statements about informational items usually included in a participant information leaflet (PIL) on a Q-grid, while undertaking a real-time think-aloud process to elicit the underpinning decision processes. Analysis of quantitative data was conducted using descriptive statistics and qualitative data was coded using content analysis.

PARTICIPANTS

20 participants (10 potential trial participants and 10 research nurses).

SETTING

UK-based participants.

RESULTS

Ten research nurses and 10 potential trial participants provided data for the study. Both stakeholder groups ranked similar statements in their top three most important statements, with 'What are the possible disadvantages and risks of taking part?' featuring in both. However, considerable variability existed between the groups with regard to their ranking of statements of least importance. Participants identified that sufficient information to make a decision was secured using around 14 items. Participants also identified other items of importance not routinely included in PILs.

CONCLUSIONS

This study has provided a unique insight into how and why different trial stakeholder groups rank informational items currently contained within PILs. These results have implications for those developing future PILs and those who develop guidance on their content; PILs should focus most on the information items that potential trial participants want and need to make an informed choice about trial participation.

Protocol for a scoping review to support development of a CONSORT extension for randomised controlled trials using cohorts and routinely collected health data

INTRODUCTION

Randomised controlled trials (RCTs) conducted using cohorts and routinely collected health data, including registries, electronic health records and administrative databases, are increasingly used in healthcare intervention research. The development of an extension of the CONsolidated Standards of Reporting Trials (CONSORT) statement for RCTs using cohorts and routinely collected health data is being undertaken with the goal of improving reporting quality by setting standards early in the process of uptake of these designs. To develop this extension to the CONSORT statement, a scoping review will be conducted to identify potential modifications or clarifications of existing reporting guideline items, as well as additional items needed for reporting RCTs using cohorts and routinely collected health data.

METHODS AND ANALYSIS

In separate searches, we will seek publications on methods or reporting or that describe protocols or results from RCTs using cohorts, registries, electronic health records and administrative databases. Data sources will include Medline and the Cochrane Methodology Register. For each of the four main types of RCTs using cohorts and routinely collected health data, separately, two investigators will independently review included publications to extract potential checklist items. A potential item will either modify an existing CONSORT 2010, Strengthening the Reporting of Observational Studies in Epidemiology or REporting of studies Conducted using Observational Routinely collected health Data item or will be proposed as a new item. Additionally, we will identify examples of good reporting in RCTs using cohorts and routinely collected health data.

ETHICS AND DISSEMINATION

The proposed scoping review will help guide the development of the CONSORT extension statement for RCTs conducted using cohorts and routinely collected health data.

Patient reported measures of informed consent for clinical trials: A systematic review

INTRODUCTION

The subjective assessment of the adequacy of informed consent for clinical trials, and the potential difficulties associated with it, has led several studies to develop objective measures of informed consent for clinical trials. These objective measures of informed consent are often specific to a particular population or clinical condition and largely focus on understanding of (some or all of) the key elements of informed consent. Many of the developed tools are study-specific, but some validated measures exist. Of these validated measures, those which are reported by participants are of particular interest. Whether these objective tools conceptualize and measure informed consent in the same way is not known. As such, it is not clear whether meta-analyzing data from studies reporting different tools is worthwhile. The aim of this systematic review was to critically appraise the evidence on the overall conceptualisation and item content of validated patient reported measures of informed consent for clinical trials, and to identify core domains of potential importance for informed consent.

METHODS

A systematic search of the literature was conducted to identify relevant articles that described the development, and/or validation, of patient-reported measures of adequacy of informed consent for randomised controlled trials. Data was synthesised by classifying the items identified into domains and sub-domains which were determined by the nomenclature reported in included studies. Both for descriptions of included studies and of the instruments reported in those studies, descriptive statistics were used to describe general information and instrument detail. A narrative synthesis of the instruments and their inter-related domains and subdomains was conducted to identify areas of both convergence and divergence.

RESULTS

The search identified 8193 citations. After screening titles and abstracts, 29 full text articles were retrieved for further assessment. Of these 29, 14 complied with our pre-specified inclusion criteria with 15 not being eligible. Of the 14 instruments, three explicitly reported a theoretical or conceptual framework underpinning their development, a further three implicitly referred to the 'conceptual dimensions of informed consent' or 'principles of research ethics' as informing their development and eight reported no guiding theoretical framework. Only three of the 14 studies reported patient or public involvement in the development of the tool. One hundred and seventy nine items were included across the 14 instruments. The primary focus of the instruments was on understanding. Five core domains were identified which included: Autonomy; Consequences; Expectations; Purpose; and Individualisation. There was substantial variability in the coverage of different domains across measures.

CONCLUSIONS

This study demonstrated the variability in the theoretical underpinning, development and domain coverage of existing patient-reported measures of informed consent for clinical trials. The conceptualisation of informed consent could benefit from being extended from a narrow focus on understanding to include broader considerations of decision-making. Meaningful involvement of potential trial participants during development of measures critical for tool relevance is also lacking. The identification of the key domains relevant to all stakeholders which could be measured to assess the informed consent process for clinical trials is needed.

Inequitable health service use in a Canadian paediatric population: A cross-sectional study of individual- and contextual-level factors

BACKGROUND

Health service use may be influenced by multilevel predisposing, enabling, and need factors but is equitable when driven by need. The study's objectives were as follows: (a) to investigate residential context's effect on child health service use and (b) to examine inequity of child health service use by testing for effect measure modification of need factors.

METHODS

The sample of 1,451 children was from a prenatal cohort recruited from London, Ontario, between 2002 and 2004, with follow-up until children were toddler/preschooler-aged. Individual-level data were linked by residential address to neighbourhood contextual-level data sourced from Statistics Canada. Multilevel logistic regression modelled factors associated with child health service use. Interaction terms were included in the model to test for effect measure modification of need factors by predisposing and enabling factors.

RESULTS

Contextual-level factors were not associated with child health service use. Maternal parity and nativity to Canada modified the effect of the need factor, paediatric health condition, on health service use. Health condition's effect was lowest in children of Canadian-born mothers with one child only (OR = 1.58, p = .04) and highest in children of Canadian-born mothers with three or more children (OR = 3.52, p < .01). Further, its effect was higher in children of Canadian-born mothers compared to children of mothers who migrated to Canada; however, odds ratios were not statistically significant for the latter.

CONCLUSIONS

Results may inform future investigation of the potential inequity of health service use for subgroups of children whose mothers are of lower parity and not Canadian-born. An understanding of these inequities may inform future healthcare policy and care for paediatric populations.

Understanding perceived determinants of nurses' eating and physical activity behaviour: a theory-informed qualitative interview study

BACKGROUND

Unhealthy eating and physical activity behaviours are common among nurses but little is known about determinants of eating and physical activity behaviour in this population. The present study used a theoretical framework which summarises the many possible determinants of different health behaviours (the Theoretical Domains Framework; TDF) to systematically explore the most salient determinants of unhealthy eating and physical activity behaviour in hospital-based nurses.

METHODS

Semi-structured qualitative interviews based on the TDF were conducted with nurses (n = 16) to explore factors that behavioural theories suggest may influence nurses' eating and physical activity behaviour. Important determinants of the target behaviours were identified using both inductive coding (of categories emerging from the data) and deductive coding (of categories derived from the TDF) of the qualitative data.

RESULTS

Thirteen of the fourteen domains in the TDF were found to influence nurses' eating and physical activity behaviour. Within these domains, important barriers to engaging in healthy eating and physical activity behaviour were shift work, fatigue, stress, beliefs about negative consequences, the behaviours of family and friends and lack of planning. Important factors reported to enable engagement with healthy eating and physical activity behaviours were beliefs about benefits, the use of self-monitoring strategies, support from work colleagues, confidence, shift work, awareness of useful guidelines and strategies, good mood, future holidays and receiving compliments.

CONCLUSIONS

This study used a theory-informed approach by applying the TDF to identify the key perceived determinants of nurses' eating and physical activity behaviour. The findings suggest that future efforts to change nurses' eating and physical activity behaviours should consider targeting a broad range of environmental, interpersonal and intrapersonal level factors, consistent with a socio-ecological perspective.

Subversion of allocation concealment in a randomised controlled trial: a historical case study

BACKGROUND

If the randomisation process within a trial is subverted, this can lead to selection bias that may invalidate the trial's result. To avoid this problem, it is recommended that some form of concealment should be put into place. Despite ongoing anecdotal concerns about their susceptibility to subversion, a surprising number of trials (over 10%) still use sealed opaque envelopes as the randomisation method of choice. This is likely due in part to the paucity of empirical data quantifying the potential effects of subversion. In this study we report a historical before and after study that compares the use of the sealed envelope method with a more secure centralised telephone allocation approach in order to provide such empirical evidence of the effects of subversion.

METHODS

This was an opportunistic before and after study set within a multi-centre surgical trial, which involved 654 patients from 28 clinicians from 23 centres in the UK and Ireland. Two methods of randomly allocating subjects to alternative treatments were adopted: (a) a sealed envelope system administered locally, and (b) a centralised telephone system administered by the trial co-ordination centre. Key prognostic variables were compared between randomisation methods: (a) age at trial entry, a key prognostic factor in the study, and (b) the order in which 'randomisation envelopes' were matched to subjects.

RESULTS

The median age of patients allocated to the experimental group with the sealed envelope system, was significantly lower both overall (59 vs 63 years, p < 0.01) and in particular for three clinicians (57 vs 72, p < 0.01; 33 vs 69, p < 0.001; 47 vs 72, p = 0.03). No differences in median age were found between the allocation groups for the centralised system.

CONCLUSIONS

Due to inadequate allocation concealment with the sealed envelope system, the randomisation process was corrupted for patients recruited from three clinicians. Centralised randomisation ensures that treatment allocation is not only secure but seen to be secure. Where this proves to be impossible, allocation should at least be performed by an independent third party. Unless it is an absolute requirement, the use of sealed envelopes should be discontinued forthwith.

Effectiveness of open and arthroscopic rotator cuff repair (UKUFF): a randomised controlled trial

AIMS

The appropriate management for patients with a degenerative tear of the rotator cuff remains controversial, but operative treatment, particularly arthroscopic surgery, is increasingly being used. Our aim in this paper was to compare the effectiveness of arthroscopic with open repair of the rotator cuff.

PATIENTS AND METHODS

A total of 273 patients were recruited to a randomised comparison trial (136 to arthroscopic surgery and 137 to open surgery) from 19 teaching and general hospitals in the United Kingdom. The surgeons used their usual preferred method of repair. The Oxford Shoulder Score (OSS), two years post-operatively, was the primary outcome measure. Imaging of the shoulder was performed at one year after surgery. The trial is registered with Current Controlled Trials, ISRCTN97804283.

RESULTS

The mean OSS improved from 26.3 (standard deviation (sd) 8.2) at baseline, to 41.7 (sd 7.9) two years post-operatively for arthroscopic surgery and from 25.0 (sd 8.0) to 41.5 (sd 7.9) for open surgery. Intention-to-treat (ITT) analysis showed no statistical difference between the groups at two years (difference in OSS score -0.76; 95% confidence interval (CI) -2.75 to 1.22; p = 0.452). The confidence interval excluded the pre-determined clinically important difference in the OSS of three points. The rate of re-tear was not significantly different between the two groups (46.4% for arthroscopic and 38.6% for open surgery; 95% CI -6.9 to 25.8; p = 0.256). Healed repairs had the most improved OSS. These findings were the same when analysed per-protocol.

CONCLUSION

There is no evidence of difference in effectiveness between open and arthroscopic repair of rotator cuff tears. The rate of re-tear is high in both groups, for all sizes of tear and ages and this adversely affects the outcome. Cite this article: Bone Joint J 2017;99-B:107-15.

The effects of an open design on trial participant recruitment, compliance and retention – a randomized controlled trial comparison with a blinded, placebo-controlled design

Background In randomized trials there may be no overriding reason whether or not to have a placebo control.

Purpose We assessed the effects of an open trial design (no placebo and people know what tablets they are given) compared with a blinded, placebo-controlled design on recruitment, compliance and retention within a randomized trial of secondary osteoporotic fracture prevention.

Methods We undertook a randomized controlled comparison nested within a placebo-controlled trial of nutritional supplementation amongst people aged 70 years or over who had previously sustained a fracture, recruited in a UK teaching hospital. Randomization was 2: 1 in favour of the blinded, placebo-controlled trial design.

Results From 180 eligible participants randomized to receive information based on the open trial design, 134 (74.4%) consented to take part, compared with 233 (65.1%) of 358 people randomized to the blinded, placebo-controlled design (difference 9.4%, 95% confidence interval 1.3–17.4%). Reluctance to take a placebo and the desire to know tablet allocation were reasons given for not taking part in the blinded, placebo-controlled design. There was no significant difference in tablet compliance. Open trial participants were more likely to remain in the trial for one year (difference 13.9%, 95% confidence interval 3.1–24.6%), mainly reflecting the high retention of the open trial no tablet group compared to the open trial tablet group (difference 23.6%, 95% confidence interval 11.9–35.2%). The odds ratio for reporting an adverse event in the open trial compared to the blinded, placebo-controlled design was 0.64 (95% confidence interval 0.28–1.49), and for reporting a fracture was 0.81 (0.36–1.85).

Conclusions We conclude that using an open trial design may enhance participant recruitment and retention and thus improve generalizability and statistical power, but withdrawal rates may differ between the study allocations and may threaten the internal validity of the trial.

An integrated approach to consumer representation and involvement in a multicentre randomized controlled trial

Although, consumer involvement in individual studies is often limited, their involvement in guiding health research is generally considered to be beneficial. This paper outlines our experiences of an integrated relationship between the organisers of a clinical trial and a consumer organisation. The PRISM trial is a UK multicentre, randomized controlled trial comparing treatment strategies for Paget's disease of the bone. The National Association for the Relief of Paget's Disease (NARPD) is the only UK support group for sufferers of Paget's disease and has worked closely with the PRISM team from the outset. NARPD involvement is integral to the conduct of the trial and specific roles have included: peer-review; trial steering committee membership; provision of advice to participants, and promotion of the trial amongst Paget's disease patients. The integrated relationship has yielded benefits to both the trial and the consumer organisation. The benefits for the trial have included: recruitment of participants via NARPD contacts; well-informed participants; unsolicited patient advocacy of the trial; and interested and pro-active collaborators. For the NARPD and Paget's disease sufferers, benefits have included: increased awareness of Paget's disease; increased access to relevant health research; increased awareness of the NARPD services; and wider transfer of diagnosis and management knowledge to/from health care professionals. Our experience has shown that an integrated approach between a trial team and a consumer organisation is worthwhile. Adoption of such an approach in other trials may yield significant improvements in recruitment and quality of participant information flow. There are, however, resource implications for both parties.

Clinical effectiveness and cost-effectiveness of open and arthroscopic rotator cuff repair [the UK Rotator Cuff Surgery (UKUFF) randomised trial]

BACKGROUND

Uncertainty exists regarding the best management of patients with degenerative tears of the rotator cuff.

OBJECTIVE

To evaluate the clinical effectiveness and cost-effectiveness of arthroscopic and open rotator cuff repair in patients aged ≥ 50 years with degenerative rotator cuff tendon tears.

DESIGN

Two parallel-group randomised controlled trial.

SETTING

Nineteen teaching and district general hospitals in the UK.

PARTICIPANTS

Patients (n = 273) aged ≥ 50 years with degenerative rotator cuff tendon tears.

INTERVENTIONS

Arthroscopic surgery and open rotator cuff repair, with surgeons using their usual and preferred method of arthroscopic or open repair. Follow-up was by telephone questionnaire at 2 and 8 weeks after surgery and by postal questionnaire at 8, 12 and 24 months after randomisation.

MAIN OUTCOME MEASURES

The Oxford Shoulder Score (OSS) at 24 months was the primary outcome measure. Magnetic resonance imaging evaluation of the shoulder was made at 12 months after surgery to assess the integrity of the repair.

RESULTS

The mean OSS improved from 26.3 [standard deviation (SD) 8.2] at baseline to 41.7 (SD 7.9) at 24 months for arthroscopic surgery and from 25.0 (SD 8.0) at baseline to 41.5 (SD 7.9) at 24 months for open surgery. When effect sizes are shown for the intervention, a negative sign indicates that an open procedure is favoured. For the intention-to-treat analysis, there was no statistical difference between the groups, the difference in OSS score at 24 months was -0.76 [95% confidence interval (CI) -2.75 to 1.22; p = 0.452] and the CI excluded the predetermined clinically important difference in the OSS of 3 points. There was also no statistical difference when the groups were compared per protocol (difference in OSS score -0.46, 95% CI -5.30 to 4.39; p = 0.854). The questionnaire response rate was > 86%. At 8 months, 77% of participants reported that shoulder problems were much or slightly better, and at 24 months this increased to 85%. There were no significant differences in mean cost between the arthroscopic group and the open repair group for any of the component resource-use categories, nor for the total follow-up costs at 24 months. The overall treatment cost at 2 years was £2567 (SD £176) for arthroscopic surgery and £2699 (SD £149) for open surgery, according to intention-to-treat analysis. For the per-protocol analysis there was a significant difference in total initial procedure-related costs between the arthroscopic group and the open repair group, with arthroscopic repair being more costly by £371 (95% CI £135 to £607). Total quality-adjusted life-years accrued at 24 months averaged 1.34 (SD 0.05) in the arthroscopic repair group and 1.35 (SD 0.05) in the open repair group, a non-significant difference of 0.01 (95% CI -0.11 to 0.10). The rate of re-tear was not significantly different across the randomised groups (46.4% and 38.6% for arthroscopic and open surgery, respectively). The participants with tears that were impossible to repair had the lowest OSSs, the participants with re-tears had slightly higher OSSs and the participants with healed repairs had the most improved OSSs. These findings were the same when analysed per protocol.

CONCLUSION

In patients aged > 50 years with a degenerative rotator cuff tear there is no difference in clinical effectiveness or cost-effectiveness between open repair and arthroscopic repair at 2 years for the primary outcome (OSS) and all other prespecified secondary outcomes. Future work should explore new methods to improve tendon healing and reduce the high rate of re-tears observed in this trial.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN97804283.

FUNDING

This project was funded by the National Institute for Health Research Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 19, No. 80. See the NIHR Journals Library website for further project information.

Exploring the role and function of trial steering committees: results of an expert panel meeting

BACKGROUND

The independent oversight of clinical trials, which is recommended by the Medical Research Council (MRC) Guidelines for Good Clinical Practice, is typically provided by an independent advisory Data Monitoring Committee (DMC) and an independent executive committee, to whom the DMC makes recommendations. The detailed roles and function of this executive committee, known as the Trial Steering Committee (TSC), have not previously been studied or reviewed since those originally proposed by the MRC in 1998.

METHODS

An expert panel (n = 7) was convened comprising statisticians, clinicians and trial methodologists with prior TSC experience. Twelve questions about the role and responsibilities of the TSC were discussed by the panel at two full-day meetings. Each meeting was transcribed in full and the discussions were summarised.

RESULTS

The expert panel reached agreement on the role of the TSC, to which it was accountable, the membership, the definition of independence, and the experience and training needed. The management of ethical issues, difficult/complex situations and issues the TSC should not ask the DMC to make recommendations on were more difficult to discuss without specific examples, but support existed for further work to help share issues and to provide appropriate training for TSC members. Additional topics discussed, which had not been identified by previous work relating to the DMCs but were pertinent to the role of the TSC, included the following: review of data sharing requests, indemnity, lifespan of the TSC, general TSC administration, and the roles of both the Funder and the Sponsor.

CONCLUSIONS

This paper presents recommendations that will contribute to the revision and update of the MRC TSC terms of reference. Uncertainty remains in some areas due to the absence of real-life examples; future guidance on these issues would benefit from a repository of case studies. Notably, the role of a patient and public involvement (PPI) contributor was not discussed, and further work is warranted to explore the role of a PPI contributor in independent trial oversight.

Clinical effectiveness and cost-effectiveness of foam sclerotherapy, endovenous laser ablation and surgery for varicose veins: results from the Comparison of LAser, Surgery and foam Sclerotherapy (CLASS) randomised controlled trial

BACKGROUND

Foam sclerotherapy (foam) and endovenous laser ablation (EVLA) have emerged as alternative treatments to surgery for patients with varicose veins, but uncertainty exists regarding their effectiveness in the medium to longer term.

OBJECTIVES

To assess the clinical effectiveness and cost-effectiveness of foam, EVLA and surgery for the treatment of varicose veins.

DESIGN

A parallel-group randomised controlled trial (RCT) without blinding, and economic modelling evaluation.

SETTING

Eleven UK specialist vascular centres.

PARTICIPANTS

Seven hundred and ninety-eight patients with primary varicose veins (foam, n = 292; surgery, n = 294; EVLA, n = 212).

INTERVENTIONS

Patients were randomised between all three treatment options (eight centres) or between foam and surgery (three centres).

PRIMARY OUTCOME MEASURES

Disease-specific [Aberdeen Varicose Vein Questionnaire (AVVQ)] and generic [European Quality of Life-5 Dimensions (EQ-5D), Short Form questionnaire-36 items (SF-36) physical and mental component scores] quality of life (QoL) at 6 months. Cost-effectiveness as cost per quality-adjusted life-year (QALY) gained.

SECONDARY OUTCOME MEASURES

Quality of life at 6 weeks; residual varicose veins; Venous Clinical Severity Score (VCSS); complication rates; return to normal activity; truncal vein ablation rates; and costs.

RESULTS

The results appear generalisable in that participants' baseline characteristics (apart from a lower-than-expected proportion of females) and post-treatment improvement in outcomes were comparable with those in other RCTs. The health gain achieved in the AVVQ with foam was significantly lower than with surgery at 6 months [effect size -1.74, 95% confidence interval (CI) -2.97 to -0.50; p = 0.006], but was similar to that achieved with EVLA. The health gain in SF-36 mental component score for foam was worse than that for EVLA (effect size 1.54, 95% CI 0.01 to 3.06; p = 0.048) but similar to that for surgery. There were no differences in EQ-5D or SF-36 component scores in the surgery versus foam or surgery versus EVLA comparisons at 6 months. The trial-based cost-effectiveness analysis showed that, at 6 months, foam had the highest probability of being considered cost-effective at a ceiling willingness-to-pay ratio of £20,000 per QALY. EVLA was found to cost £26,107 per QALY gained versus foam, and was less costly and generated slightly more QALYs than surgery. Markov modelling using trial costs and the limited recurrence data available suggested that, at 5 years, EVLA had the highest probability (≈ 79%) of being cost-effective at conventional thresholds, followed by foam (≈ 17%) and surgery (≈ 5%). With regard to secondary outcomes, health gains at 6 weeks (p < 0.005) were greater for EVLA than for foam (EQ-5D, p = 0.004). There were fewer procedural complications in the EVLA group (1%) than after foam (7%) and surgery (8%) (p < 0.001). Participants returned to a wide range of behaviours more quickly following foam or EVLA than following surgery (p < 0.05). There were no differences in VCSS between the three treatments. Truncal ablation rates were higher for surgery (p < 0.001) and EVLA (p < 0.001) than for foam, and were similar for surgery and EVLA.

CONCLUSIONS

Considerations of both the 6-month clinical outcomes and the estimated 5-year cost-effectiveness suggest that EVLA should be considered as the treatment of choice for suitable patients.

FUTURE WORK

Five-year trial results are currently being evaluated to compare the cost-effectiveness of foam, surgery and EVLA, and to determine the recurrence rates following each treatment. This trial has highlighted the need for long-term outcome data from RCTs on QoL, recurrence rates and costs for foam sclerotherapy and other endovenous techniques compared against each other and against surgery.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN51995477.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 19, No. 27. See the NIHR Journals Library website for further project information.

Perspectives on financial incentives to health service providers for increasing breast feeding and smoking quit rates during pregnancy: a mixed methods study

OBJECTIVE

To explore the acceptability, mechanisms and consequences of provider incentives for smoking cessation and breast feeding as part of the Benefits of Incentives for Breastfeeding and Smoking cessation in pregnancy (BIBS) study.

DESIGN

Cross-sectional survey and qualitative interviews.

SETTING

Scotland and North West England.

PARTICIPANTS

Early years professionals: 497 survey respondents included 156 doctors; 197 health visitors/maternity staff; 144 other health staff. Qualitative interviews or focus groups were conducted with 68 pregnant/postnatal women/family members; 32 service providers; 22 experts/decision-makers; 63 conference attendees.

METHODS

Early years professionals were surveyed via email about the acceptability of payments to local health services for reaching smoking cessation in pregnancy and breastfeeding targets. Agreement was measured on a 5-point scale using multivariable ordered logit models. A framework approach was used to analyse free-text survey responses and qualitative data.

RESULTS

Health professional net agreement for provider incentives for smoking cessation targets was 52.9% (263/497); net disagreement was 28.6% (142/497). Health visitors/maternity staff were more likely than doctors to agree: OR 2.35 (95% CI 1.51 to 3.64; p<0.001). Net agreement for provider incentives for breastfeeding targets was 44.1% (219/497) and net disagreement was 38.6% (192/497). Agreement was more likely for women (compared with men): OR 1.81 (1.09 to 3.00; p=0.023) and health visitors/maternity staff (compared with doctors): OR 2.54 (95% CI 1.65 to 3.91; p<0.001). Key emergent themes were 'moral tensions around acceptability', 'need for incentives', 'goals', 'collective or divisive action' and 'monitoring and proof'. While provider incentives can focus action and resources, tensions around the impact on relationships raised concerns. Pressure, burden of proof, gaming, box-ticking bureaucracies and health inequalities were counterbalances to potential benefits.

CONCLUSIONS

Provider incentives are favoured by non-medical staff. Solutions which increase trust and collaboration towards shared goals, without negatively impacting on relationships or increasing bureaucracy are required.

Evaluation of interventions for informed consent for randomised controlled trials (ELICIT): protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey

Background

The process of obtaining informed consent for participation in randomised controlled trials (RCTs) was established as a mechanism to protect participants against undue harm from research and allow people to recognise any potential risks or benefits associated with the research. A number of interventions have been put forward to improve this process. Outcomes reported in trials of interventions to improve the informed consent process for decisions about trial participation tend to focus on the ‘understanding’ of trial information. However, the operationalization of understanding as a concept, the tools used to measure it and the timing of the measurements are heterogeneous. A lack of clarity exists regarding which outcomes matter (to whom) and why. This inconsistency between studies results in difficulties when making comparisons across studies as evidenced in two recent systematic reviews of informed consent interventions. As such, no optimal method for measuring the impact of these interventions aimed at improving informed consent for RCTs has been identified.

Methods/Design

The project will adopt and adapt methodology previously developed and used in projects developing core outcome sets for assessment of clinical treatments. Specifically, the work will consist of three stages: 1) A systematic methodology review of existing outcome measures of trial informed consent interventions; 2) Interviews with key stakeholders to explore additional outcomes relevant for trial participation decisions; and 3) A Delphi study to refine the core outcome set for evaluation of trial informed consent interventions. All stages will include the stakeholders involved in the various aspects of RCT consent: users (that is, patients), developers (that is, trialists), deliverers (focusing on research nurses) and authorisers (that is, ethics committees). A final consensus meeting including all stakeholders will be held to review outcomes.

Discussion

The ELICIT study aims to develop a core outcome set for the evaluation of interventions intended to improve informed consent for RCTs for use in future RCTs and reviews, thereby improving the reliability and consistency of research in this area.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-015-1011-8) contains supplementary material, which is available to authorized users.

Using population-based critical care data to evaluate trauma outcomes

BACKGROUND

The analysis of mortality is an integral part of the evaluation of trauma care. When specific data are not available, general prediction models can be used to adjust for case mix. The aim of this study was to evaluate the feasibility of conducting a population-based analysis of trends in trauma mortality, using critical care audit data, and to investigate whether such data could provide a benchmark for the assessment of service reconfiguration.

METHODS

Retrospective cohort study of adult trauma patients, requiring admission to a critical care unit in Scotland, 2002-2011, using nationally collected data. Results are presented as standardised mortality ratios of observed mortality divided by APACHE II predicted mortality. Tests for trends in numbers and ratios over time were performed using linear regression.

FINDINGS

4503 patients were identified. There was a significant increase in the number of trauma patients admitted per year (p = 0.011). The median predicted probability of in-hospital death was 7% (interquartile range 1-13%), against an actual mortality was 11.6%. There was no significant change in the standardised mortality ratios of trauma patients (p = 0.1224).

CONCLUSIONS

This study demonstrated the feasibility of utilising critical care unit audit data for analysing outcomes from trauma care. It also showed the potential of such an approach to establish a baseline against which to compare the impact of future service reconfiguration. In contrast to healthcare systems with regionalised trauma care, there appears to have been little change in the mortality of trauma patients requiring critical care unit admission in Scotland.