Negotiating Tensions Between Theory and Design in the Development of Mailings for People Recovering From Acute Coronary Syndrome

What Are the Best Practices for Co-Creating Patient-Facing Educational Materials? A Scoping Review of the Literature

Co-creating patient-facing educational materials (PEMs) can enhance person-centered care by responding to patient priorities and unmet needs. Little data exist on 'best practices' for co-creation. We followed the Arksey and O'Malley framework to conduct a systematic literature search of nine databases (MEDLINE, PubMed, EMBASE, CINAHL, PsycINFO, Web of Science, Cochrane Library, Joanna Briggs Institute, TRIP-April, 2022) to identify empirical studies published in English on PEM co-creation to distill 'best practices'. Following an independent dual review of articles, data were collated into tables, and thematic analysis was employed to synthesize 'best practices' that were validated by a patient experienced in co-creating PEMs. Bias was not assessed, given the study heterogeneity. Of 6998 retrieved articles, 44 were included for data extraction/synthesis. Studies utilized heterogeneous methods spanning a range of health conditions/populations. Only 5/45 (11%) studies defined co-creation, 14 (32%) used a guiding framework, and 18 (41%) used validated evaluation tools. Six 'best practices' were identified: (1) begin with a review of the literature, (2) utilize a framework to inform the process, (3) involve clinical and patient experts from the beginning, (4) engage diverse perspectives, (5) ensure patients have the final decision, and (6) employ validated evaluation tools. This scoping review highlights the need for clear definitions and validated evaluation measures to guide and assess the co-creation process. Identified 'best practices' are relevant for use with diverse patient populations and health issues to enhance person-centered care.

An emerging framework for digital mental health design with Indigenous young people: a scoping review of the involvement of Indigenous young people in the design and evaluation of digital mental health interventions

BACKGROUND

Indigenous young people worldwide possess unique protective factors that support wellbeing. However, they experience mental illness at higher rates than their non-indigenous counterparts. Digital mental health (dMH) resources can increase access to structured, timely, and culturally tailored mental health interventions by reducing structural and attitudinal barriers to accessing treatment. The involvement of Indigenous young people in dMH resource development is recommended, however, no guidelines exist on how this can best be facilitated.

METHODS

A scoping review examining processes to involve Indigenous young people in developing or evaluating dMH interventions was conducted. Studies reported between 1990 and 2023 involving Indigenous young people aged 12-24 years, originating from Canada, the USA, New Zealand, and Australia, in the development or evaluation of dMH interventions were eligible for inclusion. Following a three-step search process, four electronic databases were searched. Data were extracted, synthesized, and described under three categories: dMH intervention attributes, study design, and alignment with research best practice. Best practice recommendations for Indigenous research and participatory design principles derived from the literature were identified and synthesised. Included studies were assessed against these recommendations. Consultation with two Senior Indigenous Research Officers ensured Indigenous worldviews informed analysis.

RESULTS

Twenty-four studies describing eleven dMH interventions met inclusion criteria. Studies included formative, design, pilot, and efficacy studies. Overall, most included studies demonstrated a high degree of Indigenous governance, capacity building, and community benefit. All studies adapted their research processes to ensure that local community protocols were followed and most aligned these within an Indigenous research paradigm. Formal agreements regarding existing and created intellectual property and implementation evaluations were rare. Outcomes were the primary focus of reporting, with limited detailed descriptions of governance and decision-making processes or strategies for managing predictable tensions between co-design stakeholders.

CONCLUSIONS

This study identified recommendations for undertaking participatory design with Indigenous young people and evaluated the current literature against these criteria. Common gaps were evident in the reporting of study processes. Consistent, in-depth reporting is needed to allow assessment of approaches for this hard-to-reach population. An emergent framework, informed by our findings, for guiding the involvement of Indigenous young people in the design and evaluation of dMH tools is presented.

TRIAL REGISTRATION

Available via osf.io/2nkc6.

Developing a Provincial Surveillance and Support System for Childhood Cancer Survivors: Multiphase User-Centered Design Study

Background

Survivors of childhood cancer are at lifelong risk of morbidity (such as new cancers or heart failure) and premature mortality due to their cancer treatment. These are termed late effects. Therefore, they require lifelong, risk-tailored surveillance. However, most adult survivors of childhood cancer do not complete recommended surveillance tests such as mammograms or echocardiograms.

Objective

In partnership with survivors, family physicians, and health system partners, we are designing a provincial support system for high-priority tests informed by principles of implementation science, behavioral science, and design thinking.

Methods

Our multiphase process was structured as follows. Step 1 consisted of a qualitative study to explore intervention components essential to accessing surveillance tests. Step 2 comprised a workshop with childhood cancer survivors, family physicians, and health system stakeholders that used the Step 1 findings and “personas” (a series of fictional but data-informed characters) to develop and tailor the intervention for different survivor groups. Step 3 consisted of intervention prototype development, and Step 4 involved iterative user testing.

Results

The qualitative study of 30 survivors and 7 family physicians found a high desire for information on surveillance for late effects. Respondents indicated that the intervention should help patients book appointments when they are due in addition to providing personalized information. Insights from the workshop included the importance of partnering with both family physicians and survivorship clinics and providing emotional support for survivors who may experience distress upon learning of their risk for late effects. In our user-testing process, prototypes went through iterations that incorporated feedback from users regarding acceptability, usability, and functionality. We sought to address the needs of survivors and physicians while balancing the capacity and infrastructure available for a lifelong intervention via our health system partners.

Conclusions

In partnership with childhood cancer survivors, family physicians, and health system partners, we elucidated the barriers and enablers to accessing guideline-recommended surveillance tests and designed a multifaceted solution that will support survivors and their family physicians. The next step is to evaluate the intervention in a pragmatic randomized controlled trial.

Impacts of two behavior change interventions on determinants of medication adherence: process evaluation applying the health action process approach and habit theory alongside a randomized controlled trial

Investigating the mechanisms of behavior change interventions provides a more fulsome understanding of how and why interventions work (or don't work). We assessed mechanisms of two interventions (mailouts alone, and mailouts plus telephone support, informed by the Health Action Process Approach (HAPA) and Habit Theory), designed to increase medication adherence after myocardial infarction. We conducted a process evaluation alongside a pragmatic trial. Medication adherence was assessed via self-report at 12-months in the trial, and participants in all trial groups were invited to contemporaneously complete an additional questionnaire assessing targeted mechanisms (HAPA constructs and automaticity). We used multiple regression-based mediation models to investigate indirect effects. Of 589 respondents, 497 were analyzed (92 excluded due to missing data). Mailouts plus telephone support had statistically significant but small effects on intention, social support, action planning, coping planning, and automaticity. There were no indirect effects of interventions on medication adherence via these constructs. Therefore, while this intervention led to changes in proposed mechanisms, these changes were not great enough to lead to behavior change. Refinements (and subsequent evaluation) of the interventions are warranted, and our findings indicate that this could involve offering more intensive support to form plans and identify cues for taking medications, in addition to providing physical supports to encourage self-monitoring, feedback, and habit formation. Trial registration: ClinicalTrials.gov: NCT02382731.

Enhanced feedback interventions to promote evidence-based blood transfusion guidance and reduce unnecessary use of blood components: the AFFINITIE research programme including two cluster factorial RCTs

Background

Blood transfusion is a common but costly treatment. Repeated national audits in the UK suggest that up to one-fifth of transfusions are unnecessary when judged against recommendations for good clinical practice. Audit and feedback seeks to improve patient care and outcomes by comparing clinical care against explicit standards. It is widely used internationally in quality improvement. Audit and feedback generally has modest but variable effects on patient care. A considerable scope exists to improve the impact that audit and feedback has, particularly through head-to-head trials comparing different ways of delivering feedback.

Objectives

The AFFINITIE (Development & Evaluation of Audit and Feedback INterventions to Increase evidence-based Transfusion practIcE) programme aimed to design and evaluate enhanced feedback interventions, within a national blood transfusion audit programme, to promote evidence-based guidance and reduce the unnecessary use of blood components. We developed, piloted and refined two feedback interventions, ‘enhanced content’ and ‘enhanced follow-on’ (workstream 1), evaluated the effectiveness and cost-effectiveness of the two feedback interventions compared with standard feedback practice (workstream 2), examined intervention fidelity and contextual influences (workstream 3) and developed general implementation recommendations and tools for other audit and feedback programmes (workstream 4).

Design

Interviews, observations and documentary analysis in four purposively sampled hospitals explored contemporary practice and opportunities for strengthening feedback. We developed two interventions: ‘enhanced content’, to improve the clarity and utility of feedback reports, and ‘enhanced follow-on’, to help hospital staff with action-planning (workstream 1). We conducted two linked 2 × 2 factorial cross-sectional cluster-randomised trials within transfusion audits for major surgery and haematological oncology, respectively (workstream 2). We randomised hospital clusters (the organisational level at which hospital transfusion teams operate) to enhanced or standard content or enhanced or standard follow-on. Outcome assessment was masked to assignment. Decision-analytic modelling evaluated the costs, benefits and cost-effectiveness of the feedback interventions in both trials from the perspective of the NHS. A parallel process evaluation used semistructured interviews, documentary analyses and web analytics to assess the fidelity of delivery, receipt and enactment and to identify contextual influences (workstream 3). We explored ways of improving the impact of national audits with their representatives (workstream 4).

Setting and participants

All NHS hospital trusts and health boards participating in the National Comparative Audit of Blood Transfusions were invited to take part. Among 189 hospital trusts and health boards screened, 152 hospital clusters participated in the surgical audit. Among 187 hospital trusts and health boards screened, 141 hospital clusters participated in the haematology audit.

Interventions

‘Enhanced content’ aimed to ensure that the content and format of feedback reports were consistent with behaviour change theory and evidence. ‘Enhanced follow-on’ comprised a web-based toolkit and telephone support to facilitate local dissemination, planning and response to feedback.

Main outcome measures

Proportions of acceptable transfusions, based on existing evidence and guidance and algorithmically derived from national audit data.

Data sources

Trial primary outcomes were derived from manually collected, patient-level audit data. Secondary outcomes included routinely collected data for blood transfusion.

Results

With regard to the transfusions in the major surgery audit, 135 (89%) hospital clusters participated from 152 invited. We randomised 69 and 66 clusters to enhanced and standard content, respectively, and 68 and 67 clusters to enhanced and standard follow-on, respectively. We analysed a total of 2222 patient outcomes at 12 months in 54 and 58 (enhanced and standard content, respectively) and 54 and 58 (enhanced and standard follow-on, respectively) hospital clusters. With regard to the haematology audit, 134 hospital clusters (95%) participated from 141 invited. We randomised 66 and 68 clusters to enhanced and standard content, respectively, and 67 clusters to both enhanced and standard follow-on. We analysed a total of 3859 patient outcomes at 12 months in 61 and 61 (enhanced and standard content, respectively) and 63 and 59 (enhanced and standard follow-on) hospital clusters. We found no effect of either of the enhanced feedback interventions in either trial across all outcomes. Incremental enhanced intervention costs ranged from £18 to £248 per site. The enhanced feedback interventions were dominated by the standard intervention in cost-effectiveness analyses. The interventions were delivered as designed and intended, but subsequent local engagement was low. Although the enhancements were generally acceptable, doubts about the credibility of the blood transfusion audits undermined the case for change.

Limitations

Limitations included the number of participating clusters; loss to follow-up of trial clusters, reducing statistical power and validity; incomplete audit and cost data contributing to outcome measures; participant self-selection; reporting; missing data related to additional staff activity generated in response to receiving feedback; and recall biases in the process evaluation interviews.

Conclusions

The enhanced feedback interventions were acceptable to recipients but were more costly and no more effective than standard feedback in reducing unnecessary use of blood components, and, therefore, should not be recommended on economic grounds.

Future work

We have demonstrated the feasibility of embedding ambitious large-scale rigorous research within national audit programmes. Further head-to-head comparisons of different feedback interventions are needed in these programmes to identify cost-effective ways of increasing the impact of the interventions.

Trial registration

This trial is registered as ISRCTN15490813.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 10, No. 2. See the NIHR Journals Library website for further project information.

Determining Priorities in the Aboriginal and Islander Mental Health Initiative for Youth App Second Phase Participatory Design Project: Qualitative Study and Narrative Literature Review

Background

Digital mental health tools can promote access to culturally safe early intervention mental health services for Aboriginal and Torres Strait Islander young people. Participatory design methodology facilitates user engagement in the co-design of digital resources. However, several challenges have been identified that limit the methodological rigor of this approach.

Objective

This paper aims to present an in-depth account of the second phase of participatory design in the development of the Aboriginal and Islander Mental Health Initiative for Youth (AIMhi-Y) app.

Methods

A first idea storyboard, generated from a formative phase of the AIMhi-Y project, was refined through a series of youth co-design workshops and meetings. A narrative review of the literature, 6 service provider interviews, and engagement with an expert reference group also informed the design process. Generative design activities, storyboarding, discussions, and voting strategies were used.

Results

The participatory design process identified the app features preferred by young people and service providers and assessed their alignment with current recommendations from the scientific literature. Findings from the co-design process are presented across 9 app characteristic domains. Integration of findings into app design proved complex. Although most preferred features identified by young people were included to some degree, other inclusions were restricted by budget, time, and the need to integrate best practice recommendations. A process of prioritization was required.

Conclusions

Participatory design is often cited in the development of digital mental health resources; however, methods are diverse and often lack detailed descriptions. This study reports the outcomes and strategies used to determine priorities in the second phase of the development of the AIMhi-Y app. We provide an example and the key learnings to inform others seeking to use participatory design with a similar cohort.

Behaviour change and physical activity interventions for physical activity engagement in community dwelling adults with chronic obstructive pulmonary disease: protocol for a systematic review

Background: Chronic obstructive pulmonary disease (COPD) is a complex respiratory disease and the third leading cause of death worldwide. Pulmonary rehabilitation is recognised as the gold standard of care in the management of COPD, however engagement with pulmonary rehabilitation is low and maintenance of a physically active lifestyle in community dwelling adults with COPD is poor. Supporting positive behaviour change in people with COPD could help to increase their engagement with physical activity. This systematic review will examine behaviour change and physical activity interventions delivered to community dwelling adults with COPD with the aim of increasing physical activity engagement. Interventions will be mapped against Michie’s theoretical domains framework (TDF) to inform clinical practice and health policy.

Methods: The following databases will be searched from inception until December 2021: Web of Science, CENTRAL, MEDLINE (via EBSCO), EMBASE, APA PsychINFO, CINAHL (via EBSCO), AMED, PROSPERO, Cochrane Airways Trials Register. Reference lists of the relevant studies and grey literature will be searched using Grey Literature Report, Open Grey and Google Scholar search engines. Relevant studies will be systematically reviewed and subject to quality appraisal to determine the impact of behaviour change and physical activity interventions on outcomes of community-dwelling adults with COPD. Interventions will be mapped to Michie’s TDF and a narrative synthesis with respect to nature, effectiveness on target population and setting/environment will be provided. Findings will be reported in relation to the generalisability of the primary results and research question, and will include secondary findings on quality of life, self-reported participation in physical activity, exercise capacity, adverse events and intervention adherence. The review will be presented according to the PRISMA guidelines 2020.

Conclusions: This systematic review is necessary to explain the impact of behaviour change and physical activity interventions on outcomes of community dwelling people with COPD.

PROSPERO registration: CRD42021264965 (29.06.2021)

Behaviour change and physical activity interventions for physical activity engagement in community dwelling adults with chronic obstructive pulmonary disease: protocol for a systematic review

Background: Chronic obstructive pulmonary disease (COPD) is a complex respiratory disease and the third leading cause of death worldwide. Pulmonary rehabilitation is recognised as the gold standard of care in the management of COPD, however engagement with pulmonary rehabilitation is low and maintenance of a physically active lifestyle in community dwelling adults with COPD is poor. Supporting positive behaviour change in people with COPD could help to increase their engagement with physical activity. This systematic review will examine behaviour change and physical activity interventions delivered to community dwelling adults with COPD with the aim of increasing physical activity engagement. Interventions will be mapped against Michie’s theoretical domains framework (TDF) to inform clinical practice and health policy. Methods: The following databases will be searched from inception until December 2021: Web of Science, CENTRAL, MEDLINE (via EBSCO), EMBASE, APA PsychINFO, CINAHL (via EBSCO), AMED, PROSPERO, Cochrane Airways Trials Register. Reference lists of the relevant studies and grey literature will be searched using Grey Literature Report, Open Grey and Google Scholar search engines. Relevant studies will be systematically reviewed and subject to quality appraisal to determine the impact of behaviour change and physical activity interventions on outcomes of community-dwelling adults with COPD. Interventions will be mapped to Michie’s TDF and a narrative synthesis with respect to nature, effectiveness on target population and setting/environment will be provided. Findings will be reported in relation to the generalisability of the primary results and research question, and will include secondary findings on quality of life, self-reported participation in physical activity, exercise capacity, adverse events and intervention adherence. The review will be presented according to the PRISMA guidelines 2020. Conclusions: This systematic review is necessary to explain the impact of behaviour change and physical activity interventions on outcomes of community dwelling people with COPD. PROSPERO registration: CRD42021264965 (29.06.2021)

Cardiac Rehabilitation: Under-Utilized Globally

PURPOSE OF REVIEW

Cardiac rehabilitation (CR) is grossly under-utilized. This review summarizes current knowledge about degree of CR utilization, reasons for under-utilization, and strategies to increase use.

RECENT FINDINGS

ICCPR's global CR audit quantified for the first time the number of additional CR spots needed per year to treat indicated patients, so there are programs they may use. The first randomized trial of automatic/systematic CR referral has shown it results in significantly greater patient completion. Moreover, the recent update of the Cochrane review on interventions to increase use has provided unequivocal evidence on the significant impact of clinician CR encouragement at the bedside; a course is now available to train clinicians. The USA is leading the way in implementing automatic referral with inpatient-clinician CR discussions. Suggestions to triage patients based on risk to less resource-intensive, unsupervised program models could simultaneously expand capacity and support patient adherence.

The DAFNEplus programme for sustained type 1 diabetes self management: Intervention development using the Behaviour Change Wheel

AIMS

Self-management programmes for type 1 diabetes, such as the UK's Dose Adjustment for Normal Eating (DAFNE), improve short-term clinical outcomes but difficulties maintaining behavioural changes attenuate long-term impact. This study used the Behaviour Change Wheel (BCW) framework to revise the DAFNE intervention to support sustained behaviour change.

METHODS

A four-step method was based on the BCW intervention development approach: (1) Identifying self-management behaviours and barriers/enablers to maintain them via stakeholder consultation and evidence synthesis, and mapping barriers/enablers to the Capability, Opportunity, Motivation-Behaviour (COM-B) model. (2) Specifying behaviour change techniques (BCTs) in the existing DAFNE intervention using the Behaviour Change Techniques Taxonomy (BCTTv1). (3) Identifying additional BCTs to target the barriers/enablers using the BCW and BCTTv1. (4) Parallel stakeholder consultation to generate recommendations for intervention revision. Revised materials were co-designed by stakeholders (diabetologists, psychologists, specialist nurses and dieticians).

RESULTS

In all, 34 barriers and 5 enablers to sustaining self-management post-DAFNE were identified. The existing DAFNE intervention contained 24 BCTs, which partially addressed the enablers. In all, 27 BCTs were added, including 'Habit formation', 'Credible source' and 'Conserving mental resources'. In total, 15 stakeholder-agreed recommendations for content and delivery were incorporated into the final DAFNEplus intervention, comprising three co-designed components: (1) face-to-face group learning course, (2) individual structured follow-up sessions and (3) technological support, including blood glucose data management.

CONCLUSIONS

This method provided a systematic approach to specifying and revising a behaviour change intervention incorporating stakeholder input. The revised DAFNEplus intervention aims to support the maintenance of behavioural changes by targeting barriers and enablers to sustaining self-management behaviours.

Behavioral and Physical Activity Interventions for HAND

Approximately 30-50% of persons living with HIV manifest some degree of neurocognitive impairment. Even mild-to-moderate forms of HIV-associated neurocognitive disorders (HAND) can result in difficulties with everyday functioning, such as suboptimal medication adherence and impaired driving. Despite the pervasive presence and consequences of HAND, there is a significant unmet need to develop effective behavioral strategies to reduce the incidence and consequences of HAND. Although there is an absence of evidence-based behavioral interventions specific to HAND, the literature reviewed in this chapter suggest the following modifiable lifestyle factors as intervention targets: physical activity, diet, sleep, and antiretroviral medication adherence. Adoption and maintenance of these healthy lifestyle factors may reduce inflammation and oxidative stress, which, in turn, may reduce the incidence and/or severity of HAND.

How and why a multifaceted intervention to improve adherence post-MI worked for some (and could work better for others): an outcome-driven qualitative process evaluation

OBJECTIVES

To explore (1) the extent to which a multicomponent intervention addressed determinants of the desired behaviours (ie, adherence to cardiac rehabilitation (CR) and cardiovascular medications), (2) the associated mechanism(s) of action and (3) how future interventions might be better designed to meet the needs of this patient population.

DESIGN

A qualitative evaluation embedded within a multicentre randomised trial, involving purposive semistructured interviews.

SETTING

Nine cardiac centres in Ontario, Canada.

PARTICIPANTS

Potential participants were stratified according to the trial's primary outcomes of engagement and adherence, resulting in three groups: (1) engaged, adherence outcome positive, (2) engaged, adherence outcome negative and (3) did not engage, adherence outcome negative. Participants who did not engage but had positive adherence outcomes were excluded. Individual domains of the Theoretical Domains Framework were applied as deductive codes and findings were analysed using a framework approach.

RESULTS

Thirty-one participants were interviewed. Participants who were engaged with positive adherence outcomes attributed their success to the intervention's ability to activate determinants including behavioural regulation and knowledge, which encouraged an increase in self-monitoring behaviour and awareness of available supports, as well as reinforcement and social influences. The behaviour of those with negative adherence outcomes was driven by beliefs about consequences, emotions and identity. As currently designed, the intervention failed to target these determinants for this subset of participants, resulting in partial engagement and poor adherence outcomes.

CONCLUSION

The intervention facilitated CR adherence through reinforcement, behavioural regulation, the provision of knowledge and social influence. To reach a broader and more diverse population, future iterations of the intervention should target aberrant beliefs about consequences, memory and decision-making and emotion.

TRIAL REGISTRATION NUMBER

ClinicalTrials.gov registry; NCT02382731.

Interventions supporting long term adherence and decreasing cardiovascular events after myocardial infarction (ISLAND): pragmatic randomised controlled trial

OBJECTIVE

To test a scalable health system intervention to improve long term adherence to secondary prevention treatments among patients who have had a recent myocardial infarction.

DESIGN

Three arm, pragmatic randomised controlled trial with blinded outcome assessment.

SETTING

Nine cardiac centres in Ontario, Canada.

PARTICIPANTS

2632 patients with obstructive coronary artery disease after a myocardial infarction, identified from a centralised cardiac registry.

INTERVENTIONS

Participants were randomised 1:1:1 to receive usual care, five mail-outs developed through a user centred design process, or mail-outs plus phone calls. The phone calls were delivered first by an interactive automated system to screen for non-adherence to treatment. Trained lay health workers followed up as necessary. Interventions were coordinated centrally but delivered from each patient's hospital site.

MAIN OUTCOME MEASURES

Co-primary outcomes were completion of cardiac rehabilitation and adherence to recommended medication. Data were collected by blinded assessors through patient report and from administrative health databases at 12 months.

RESULTS

2632 patients (mean age 66, 71% male) were randomised: 878 to the full intervention (mail plus phone calls), 878 to mail only, and 876 to usual care. Of the respondents, 174 (27%) of 643 in the usual care group, 200 (32%) of 628 in the mail only group, and 196 (37%) of 531 allocated to the full intervention completed cardiac rehabilitation (adjusted odds ratio 1.55, 95% confidence interval 1.18 to 2.03). In the mail plus phone group, 11.7%, 6.0%, 14.4%, 32.9%, and 35.0% reported adherence to 0, 1, 2, 3, and 4 drug classes after one year, respectively, in comparison with 12.5%, 6.8%, 13.6%, 30.2%, and 36.8% in the mail only group, and 12.2%, 8.4%, 13.1%, 30.3%, and 36.1% in the usual care group, respectively (mail only v usual care, odds ratio 0.98, 95% confidence interval 0.81 to 1.19; full intervention v usual care, 0.99, 0.82 to 1.20).

CONCLUSIONS

Scalable interventions delivered by mail plus phone can increase completion of cardiac rehabilitation after myocardial infarction but not adherence to medication. More intensive interventions should be tested to improve adherence to medication and to evaluate the association between attendance at cardiac rehabilitation and adherence to medication.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02382731, registered 9 March 2015 before any patient enrolment.

Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback

Audit and feedback (A&F) is a commonly used quality improvement (QI) approach. A Cochrane review indicates that A&F is generally effective and leads to modest improvements in professional practice but with considerable variation in the observed effects. While we have some understanding of factors that enhance the effects of A&F, further research needs to explore when A&F is most likely to be effective and how to optimise it. To do this, we need to move away from two-arm trials of A&F compared with control in favour of head-to-head trials of different ways of providing A&F. This paper describes implementation laboratories involving collaborations between healthcare organisations providing A&F at scale, and researchers, to embed head-to-head trials into routine QI programmes. This can improve effectiveness while producing generalisable knowledge about how to optimise A&F. We also describe an international meta-laboratory that aims to maximise cross-laboratory learning and facilitate coordination of A&F research.

Designing Emails Aimed at Increasing Family Physicians' Use of a Web-Based Audit and Feedback Tool to Improve Cancer Screening Rates: Cocreation Process

BACKGROUND

Providing clinical performance data to health professionals, a process known as audit and feedback, can play an important role in health system improvement. However, audit and feedback tools can only be effective if the targeted health professionals access and actively review their data. Email is used by Cancer Care Ontario, a provincial cancer agency, to promote access to a Web-based audit and feedback tool called the Screening Activity Report (SAR); however, current emails that lack behavior change content have been ineffective at encouraging log-in to the SAR.

OBJECTIVE

The objective of our study was to describe the process and experience of developing email content that incorporates user input and behavior change techniques (BCTs) to promote the use of the SAR among Ontario primary care providers.

METHODS

Our interdisciplinary research team first identified BCTs shown to be effective in other settings that could be adapted to promote use of the SAR. We then developed draft BCT-informed email content. Next, we conducted cocreation workshops with physicians who had logged in to the SAR more than once over the past year. Participants provided reactions to researcher-developed BCT-informed content and helped to develop an email that they believed would prompt their colleagues to use the SAR. Content from cocreation workshops was brought to focus groups with physicians who had not used the SAR in the past year. We analyzed notes from the cocreation workshops and focus groups to inform decisions about content. Finally, 8 emails were created to test BCT-informed content in a 2×2×2 factorial randomized experiment.

RESULTS

We identified 3 key tensions during the development of the email that required us to balance user input with scientific evidence, organizational policies, and our scientific objectives, which are as follows: conflict between user preference and scientific evidence, privacy constraints around personalizing unencrypted emails with performance data, and using cocreation methods in a study with the objective of developing an email that featured BCT-informed content.

CONCLUSIONS

Teams tasked with developing content to promote health professional engagement with audit and feedback or other quality improvement tools might consider cocreation processes for developing communications that are informed by both users and BCTs. Teams should be cautious about making decisions solely based on user reactions because what users seem to prefer is not always the same as what works. Furthermore, implementing user recommendations may not always be feasible. Teams may face challenges when using cocreation methods to develop a product with the simultaneous goal of having clearly defined variables to test in later studies. The expected role of users, evidence, and the implementation context all warrant consideration to determine whether and how cocreation methods could help to achieve design and scientific objectives.

Developing Behavior Change Interventions for Self-Management in Chronic Illness: An Integrative Overview

More people than ever are living longer with chronic conditions such as obesity, type 2 diabetes, and heart disease. Behavior change for effective self-management can improve health outcomes and quality of life in people living with such chronic illnesses. The science of developing behavior change interventions with impact for patients aims to optimize the reach, effectiveness, adoption, implementation, and maintenance of interventions and rigorous evaluation of outcomes and processes of behavior change. The development of new services and technologies offers opportunities to enhance the scope of delivery of interventions to support behavior change and self-management at scale. Herein, we review key contemporary approaches to intervention development, provide a critical overview, and integrate these approaches into a pragmatic, user-friendly framework to rigorously guide decision-making in behavior change intervention development. Moreover, we highlight novel emerging methods for rapid and agile intervention development. On-going progress in the science of intervention development is needed to remain in step with such new developments and to continue to leverage behavioral science's capacity to contribute to optimizing interventions, modify behavior, and facilitate self-management in individuals living with chronic illness.

Development of a decision aid for cardiopulmonary resuscitation and invasive mechanical ventilation in the intensive care unit employing user-centered design and a wiki platform for rapid prototyping

BACKGROUND

Upon admission to an intensive care unit (ICU), all patients should discuss their goals of care and express their wishes concerning life-sustaining interventions (e.g., cardiopulmonary resuscitation (CPR)). Without such discussions, interventions that prolong life at the cost of decreasing its quality may be used without appropriate guidance from patients.

OBJECTIVES

To adapt an existing decision aid about CPR to create a wiki-based decision aid individually adapted to each patient's risk factors; and to document the use of a wiki platform for this purpose.

METHODS

We conducted three weeks of ethnographic observation in our ICU to observe intensivists and patients discussing goals of care and to identify their needs regarding decision making. We interviewed intensivists individually. Then we conducted three rounds of rapid prototyping involving 15 patients and 11 health professionals. We recorded and analyzed all discussions, interviews and comments, and collected sociodemographic data. Using a wiki, a website that allows multiple users to contribute or edit content, we adapted the decision aid accordingly and added the Good Outcome Following Attempted Resuscitation (GO-FAR) prediction rule calculator.

RESULTS

We added discussion of invasive mechanical ventilation. The final decision aid comprises values clarification, risks and benefits of CPR and invasive mechanical ventilation, statistics about CPR, and a synthesis section. We added the GO-FAR prediction calculator as an online adjunct to the decision aid. Although three rounds of rapid prototyping simplified the information in the decision aid, 60% (n = 3/5) of the patients involved in the last cycle still did not understand its purpose.

CONCLUSIONS

Wikis and user-centered design can be used to adapt decision aids to users' needs and local contexts. Our wiki platform allows other centers to adapt our tools, reducing duplication and accelerating scale-up. Physicians need training in shared decision making skills about goals of care and in using the decision aid. A video version of the decision aid could clarify its purpose.

Interventions Supporting Long-term Adherence aNd Decreasing cardiovascular events (ISLAND): Pragmatic randomized trial protocol

BACKGROUND

Guidelines recommend cardiac rehabilitation and long-term use of cardiac medications for most patients who have had a myocardial infarction (MI), but adherence to these secondary prevention treatments is suboptimal.

METHODS

This is a multicenter, pragmatic, 3-arm randomized trial. Eligible patients (n = 2,742) with obstructive coronary artery disease are randomized post-MI to usual care or 1 of 2 intervention arms. Patients in the first intervention arm receive mail-outs sent on behalf of their cardiologist at 4, 8, 20, 32, and 44 weeks post-MI; content is designed to address determinants of adherence and facilitate discussion between the patient and their health care team. Patients in the second intervention arm receive mail-outs plus automated interactive voice response system telephone calls 2 weeks after each letter, as well as a telephone call by trained lay health workers if the interactive voice response system identifies challenges with adherence. Outcomes are assessed 12 months post-MI via patient self-report and administrative data sources. Co-primary outcomes are adherence to cardiac medications and completion of cardiac rehabilitation. Secondary outcomes include cardiovascular events and mortality. An embedded, theory-informed process evaluation will explore the mechanism of action; an economic evaluation is also planned.

CONCLUSIONS

We describe a complete program evaluation of a highly pragmatic, health-system intervention to support adherence to recommended treatments. Research ethics boards approved waiver of consent for patients enrolled in the trial with provision of multiple opportunities to opt out and a debrief at the time of outcome assessment. The methods used here may provide a model for similar interventions.