Impact and costs of incentives to reduce attrition in online trials: two randomized controlled trials

Understanding Participation in Integrated Youth Mental Health Service Research: Lessons Learned From a Feasibility Study With Jigsaw

INTRODUCTION

Research with integrated youth mental health services (IYMHS) has been criticised for low quality, with difficulties in recruiting and retaining participants in studies which can introduce bias. This feasibility study aimed to investigate the "real-world research" barriers and facilitators to recruitment and retention arising in a longitudinal study with Jigsaw, the National Centre for Youth Mental Health in Ireland, and to provide recommendations for conducting IYMHS research in future.

METHODS

A qualitative study was conducted to investigate recruitment and retention difficulties. Participants were young people attending Jigsaw (n = 14) and members of clinical staff (n = 29), who provided feedback on facilitators and barriers to recruiting and retaining participants in a wider youth mental health intervention study. Data were collected via online surveys. Content analysis was conducted on the findings.

RESULTS

Facilitators included the prosocial motivation of young people to support others through research, providing incentives for participants, clear communication and information sharing, and the supportive role of parents/guardians. Identified barriers included the timing of recruitment, communication difficulties, gatekeeping, and reluctance to participate in research. Suggestions provided to address barriers in future were integrating research teams into services, addressing communication difficulties, and timing the recruitment of youth participants appropriately.

CONCLUSION

Where possible, IYMHS should conduct research in person in services to improve communication and reduce gatekeeping. In addition, services should consider remunerating participating young people in research and involve parents/guardians when designing research in this context.

Digital Interventions to Modify Skin Cancer Risk Behaviors in a National Sample of Young Adults: Randomized Controlled Trial

BACKGROUND

Young adults engage in behaviors that place them at risk for skin cancer. Dissemination of digital health promotion interventions via social media is a potentially promising strategy to modify skin cancer risk behaviors by increasing UV radiation (UVR) protection and skin cancer examinations.

OBJECTIVE

This study aimed to compare 3 digital interventions designed to modify UVR exposure, sun protection, and skin cancer detection behaviors among young adults at moderate to high risk of skin cancer.

METHODS

This study was a hybrid type II effectiveness-implementation randomized controlled trial of 2 active interventions, a digital skin cancer risk reduction intervention (UV4.me [basic]) compared with an enhanced version (UV4.me2 [enhanced]), and an electronic pamphlet (e-pamphlet). Intervention effects were assessed over the course of a year among 1369 US young adults recruited primarily via Facebook and Instagram. Enhancements to encourage intervention engagement and behavior change included more comprehensive goal-setting activities, ongoing proactive messaging related to previously established mediators (eg, self-efficacy) of UVR exposure and protection, embedded incentives for module completion, and ongoing news and video updates. Primary outcome effects assessed via linear regression were UVR exposure and sun protection and protection habits. Secondary outcome effects assessed via logistic regression were skin self-exams, physician skin exams, sunscreen use, indoor tanning, and sunburn.

RESULTS

The active interventions increased sun protection (basic: P=.02; enhanced: P<.001) and habitual sun protection (basic: P=.04; enhanced P=.01) compared with the e-pamphlet. The enhanced intervention increased sun protection more than the basic one. Each active intervention increased sunscreen use at the 3-month follow-up (basic: P=.03; enhanced: P=.01) and skin self-exam at 1 year (basic: P=.04; enhanced: P=.004), compared with the e-pamphlet. Other intervention effects and differences between the Basic and Enhanced Intervention effects were nonsignificant.

CONCLUSIONS

The active interventions were effective in improving several skin cancer risk and skin cancer prevention behaviors. Compared with the basic intervention, the enhanced intervention added to the improvement in sun protection but not other behaviors. Future analyses will explore intervention engagement (eg, proportion of content reviewed).

TRIAL REGISTRATION

ClinicalTrials.gov NCT03313492; http://clinicaltrials.gov/ct2/show/NCT03313492.

More than my appearance: a pilot evaluation of the expand your Horizon Online functionality-based writing programme for adults with visible differences

Background

Adults with conditions that affect their appearance, known as visible differences, can experience appearance concerns, social anxiety, and depression. Interventions have been developed for this population to facilitate adjustment and coping skills; however, they have limited evidence of efficacy. The Expand Your Horizon [Alleva, J. M., Martijn, C., Van Breukelen, G. J., Jansen, A., & Karos, K. (2015). Expand Your Horizon: A programme that improves body image and reduces self-objectification by training women to focus on body functionality. Body Image, 15, 81-89. https://doi.org/10.1016/j.bodyim.2015.07.001] online functionality-based writing programme was adapted for adults with visible differences.

Method

A pilot randomised controlled trial with a wait-list control group was carried out to assess preliminary intervention efficacy and gain information about the acceptability and feasibility of the programme. Forty-four adults aged 21-63 years (M = 40.21; SD = 12.05) with visible differences took part. Various facets of body image (i.e. functionality appreciation and body appreciation) as well as depression and anxiety were assessed immediately pre- and post-intervention and at three-months.

Results

Participants reported enjoying the programme, felt that the format was acceptable, and it significantly increased functionality appreciation, which was maintained at three-months. However, there were no improvements in body appreciation, depression, and anxiety.

Conclusions

In future, a full trial should be carried out with an active control group.

Investigating the effect of providing monetary incentives to participants on completion rates of referred co-respondents: An embedded randomized controlled trial

Background

The use of a second informant (co-respondent) is a common method of identifying potential bias in outcome data (e.g., parent-report child outcomes). There is, however, limited evidence regarding methods of increasing response rates from co-respondents. The use of financial incentives is associated with higher levels of engagement and follow-up data collection in online surveys. This study investigated whether financial incentives paid to index participants in an online trial of a parenting-focused intervention, would lead to higher levels of co-respondent data collection.

Methods

A study within a trial (SWAT) using a parallel group RCT design. Participants in the host study (an RCT of an online intervention) were randomised into one of two SWAT arms: received/did not receive a £15 voucher when referred co-respondent completed baseline measures. Primary outcome was completion (No/Yes) of Spence Children's Anxiety Scale (SCAS or SCAS-Pre) at baseline. Additional analysis explored impact of incentives on data quality.

Results

Intention to treat analysis of 899 parents (183 co-respondents) in the no-incentive arm, and 911 parents (199 co-respondents) in incentive arm. Nomination of co-respondents was similar between incentive arms. The RR for the incentive arm compared to the no incentive arm was 1.13 (95% CI: 0.91 to 1.41, p = 0.264) indicating that incentives did not impact completion of outcomes by consented co-respondents. There were no indications of different data quality between arms.

Discussion

The finding that payment of financial incentives to index participant does not lead to greater levels of co-respondent outcome completion suggests that careful consideration should be made before allocating resources in this way in future trials.

Trial registration

The host study was registered at Study Record | ClinicalTrials.gov and the SWAT study was registered in the SWAT Store | The Northern Ireland Network for Trials Methodology Research (qub.ac.uk): SWAT number 143: Filetoupload,1099612,en.pdf (qub.ac.uk).

Digital health interventions for all? Examining inclusivity across all stages of the digital health intervention research process

Digital interventions offer many possibilities for improving health, as remote interventions can enhance reach and access to underserved groups of society. However, research evaluating digital health interventions demonstrates that such technologies do not equally benefit all and that some in fact seem to reinforce a "digital health divide." By better understanding these potential pitfalls, we may contribute to narrowing the digital divide in health promotion. The aim of this article is to highlight and reflect upon study design decisions that might unintentionally enhance inequities across key research stages-recruitment, enrollment, engagement, efficacy/effectiveness, and retention. To address the concerns highlighted, we propose strategies including (1) the standard definition of "effectiveness" should be revised to include a measure of inclusivity; (2) studies should report a broad range of potential inequity indicators of participants recruited, randomized, and retained and should conduct sensitivity analyses examining potential sociodemographic differences for both the effect and engagement of the digital interventions; (3) participants from historically marginalized groups should be involved in the design of study procedures, including those related to recruitment, consent, intervention implementation and engagement, assessment, and retention; (4) eligibility criteria should be minimized and carefully selected and the screening process should be streamlined; (5) preregistration of trials should include recruitment benchmarks for sample diversity and comprehensive lists of sociodemographic characteristics assessed; and (6) studies within trials should be embedded to systematically test recruitment and retention strategies to improve inclusivity. The implementation of these strategies would enhance the ability of digital health trials to recruit, randomize, engage, and retain a broader and more representative population in trials, ultimately minimizing the digital divide and broadly improving population health.

Age-related positivity effect in emotional memory consolidation from middle age to late adulthood

Background

While younger adults are more likely to attend to, process, and remember negative relative to positive information, healthy older adults show the opposite pattern. The current study evaluates when, exactly, this positivity shift begins, and how it influences memory performance for positive, negative, and neutral information.

Methods

A total of 274 healthy early middle-aged (35-47), late middle-aged (48-59), and older adults (>59) viewed scenes consisting of a negative, positive, or a neutral object placed on a plausible neutral background, and rated each scene for its valence and arousal. After 12 h spanning a night of sleep (n = 137) or a day of wakefulness (n = 137), participants completed an unexpected memory test during which they were shown objects and backgrounds separately and indicated whether the scene component was the "same," "similar," or "new" to what they viewed during the study session.

Results and conclusions

We found that both late middle-aged and older adults rated positive and neutral scenes more positively compared to early middle-aged adults. However, only older adults showed better memory for positive objects relative to negative objects, and a greater positive memory trade-off magnitude (i.e., remembering positive objects at the cost of their associated neutral backgrounds) than negative memory trade-off magnitude (i.e., remembering negative objects at the cost of their associated neutral backgrounds). Our findings suggest that while the positivity bias may not emerge in memory until older adulthood, a shift toward positivity in terms of processing may begin in middle age.

Methods to increase response to postal and electronic questionnaires

BACKGROUND

Self-administered questionnaires are widely used to collect data in epidemiological research, but non-response reduces the effective sample size and can introduce bias. Finding ways to increase response to postal and electronic questionnaires would improve the quality of epidemiological research.

OBJECTIVES

To identify effective strategies to increase response to postal and electronic questionnaires.

SEARCH METHODS

We searched 14 electronic databases up to December 2021 and manually searched the reference lists of relevant trials and reviews. We contacted the authors of all trials or reviews to ask about unpublished trials; where necessary, we also contacted authors to confirm the methods of allocation used and to clarify results presented.

SELECTION CRITERIA

Randomised trials of methods to increase response to postal or electronic questionnaires. We assessed the eligibility of each trial using pre-defined criteria.

DATA COLLECTION AND ANALYSIS

We extracted data on the trial participants, the intervention, the number randomised to intervention and comparison groups and allocation concealment. For each strategy, we estimated pooled odds ratios (OR) and 95% confidence intervals (CI) in a random-effects model. We assessed evidence for selection bias using Egger's weighted regression method and Begg's rank correlation test and funnel plot. We assessed heterogeneity amongst trial odds ratios using a Chi2 test and quantified the degree of inconsistency between trial results using the I2 statistic.

MAIN RESULTS

Postal We found 670 eligible trials that evaluated over 100 different strategies of increasing response to postal questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response almost doubled when: using monetary incentives (odds ratio (OR) 1.86; 95% confidence interval (CI) 1.73 to 1.99; heterogeneity I2 = 85%); using a telephone reminder (OR 1.96; 95% CI 1.03 to 3.74); and when clinical outcome questions were placed last (OR 2.05; 95% CI 1.00 to 4.24). The odds of response increased by about half when: using a shorter questionnaire (OR 1.58; 95% CI 1.40 to 1.78); contacting participants before sending questionnaires (OR 1.36; 95% CI 1.23 to 1.51; I2 = 87%); incentives were given with questionnaires (i.e. unconditional) rather than when given only after participants had returned their questionnaire (i.e. conditional on response) (OR 1.53; 95% CI 1.35 to 1.74); using personalised SMS reminders (OR 1.53; 95% CI 0.97 to 2.42); using a special (recorded) delivery service (OR 1.68; 95% CI 1.36 to 2.08; I2 = 87%); using electronic reminders (OR 1.60; 95% CI 1.10 to 2.33); using intensive follow-up (OR 1.69; 95% CI 0.93 to 3.06); using a more interesting/salient questionnaire (OR 1.73; 95% CI 1.12 to 2.66); and when mentioning an obligation to respond (OR 1.61; 95% CI 1.16 to 2.22). The odds of response also increased with: non-monetary incentives (OR 1.16; 95% CI 1.11 to 1.21; I2 = 80%); a larger monetary incentive (OR 1.24; 95% CI 1.15 to 1.33); a larger non-monetary incentive (OR 1.15; 95% CI 1.00 to 1.33); when a pen was included (OR 1.44; 95% CI 1.38 to 1.50); using personalised materials (OR 1.15; 95% CI 1.09 to 1.21; I2 = 57%); using a single-sided rather than a double-sided questionnaire (OR 1.13; 95% CI 1.02 to 1.25); using stamped return envelopes rather than franked return envelopes (OR 1.23; 95% CI 1.13 to 1.33; I2 = 69%), assuring confidentiality (OR 1.33; 95% CI 1.24 to 1.42); using first-class outward mailing (OR 1.11; 95% CI 1.02 to 1.21); and when questionnaires originated from a university (OR 1.32; 95% CI 1.13 to 1.54). The odds of response were reduced when the questionnaire included questions of a sensitive nature (OR 0.94; 95% CI 0.88 to 1.00). Electronic We found 88 eligible trials that evaluated over 30 different ways of increasing response to electronic questionnaires. We found substantial heterogeneity amongst trial results in half of the strategies. The odds of response tripled when: using a brief letter rather than a detailed letter (OR 3.26; 95% CI 1.79 to 5.94); and when a picture was included in an email (OR 3.05; 95% CI 1.84 to 5.06; I2 = 19%). The odds of response almost doubled when: using monetary incentives (OR 1.88; 95% CI 1.31 to 2.71; I2 = 79%); and using a more interesting topic (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by half when: using non-monetary incentives (OR 1.60; 95% CI 1.25 to 2.05); using shorter e-questionnaires (OR 1.51; 95% CI 1.06 to 2.16; I2 = 94%); and using a more interesting e-questionnaire (OR 1.85; 95% CI 1.52 to 2.26). The odds of response increased by a third when: offering survey results as an incentive (OR 1.36; 95% CI 1.16 to 1.59); using a white background (OR 1.31; 95% CI 1.10 to 1.56); and when stressing the benefits to society of response (OR 1.38; 95% CI 1.07 to 1.78; I2 = 41%). The odds of response also increased with: personalised e-questionnaires (OR 1.24; 95% CI 1.17 to 1.32; I2 = 41%); using a simple header (OR 1.23; 95% CI 1.03 to 1.48); giving a deadline (OR 1.18; 95% CI 1.03 to 1.34); and by giving a longer time estimate for completion (OR 1.25; 95% CI 0.96 to 1.64). The odds of response were reduced when: "Survey" was mentioned in the e-mail subject (OR 0.81; 95% CI 0.67 to 0.97); when the email or the e-questionnaire was from a male investigator, or it included a male signature (OR 0.55; 95% CI 0.38 to 0.80); and by using university sponsorship (OR 0.84; 95%CI 0.69 to 1.01). The odds of response using a postal questionnaire were over twice those using an e-questionnaire (OR 2.33; 95% CI 2.25 to 2.42; I2 = 98%). Response also increased when: providing a choice of response mode (electronic or postal) rather than electronic only (OR 1.76 95% CI 1.67 to 1.85; I2 = 97%); and when administering the e-questionnaire by computer rather than by smartphone (OR 1.62 95% CI 1.36 to 1.94).

AUTHORS' CONCLUSIONS

Researchers using postal and electronic questionnaires can increase response using the strategies shown to be effective in this Cochrane review.

Physical medicine & rehabilitation residents' perspectives on women's musculoskeletal health

INTRODUCTION

Women are either disproportionately or uniquely affected by certain musculoskeletal conditions but have limited access to providers of sex-specific musculoskeletal care. Few physical medicine & rehabilitation (PM&R) residencies offer women's musculoskeletal health training, and it is unknown whether PM&R residents feel prepared to care for women's musculoskeletal health concerns.

OBJECTIVE

To examine PM&R residents' perspectives and experiences in women's musculoskeletal health.

DESIGN

Cross-sectional survey developed through clinical expertise and consistent with sports medicine guidelines.

SETTING

Electronic survey sent to all accredited PM&R residency programs within the United States, distributed through program coordinators and resident representatives.

PARTICIPANTS

PM&R residents.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

The primary outcome was residents' perspective of comfort with women's musculoskeletal health. Secondary outcomes were exposure to formal education on women's musculoskeletal health topics, exposure to various learning formats for these topics; and residents' perspectives on desire for further education, access to field-specific mentors, and interest in incorporating women's musculoskeletal health into future practice.

RESULTS

Two hundred eighty-eight responses were included for analysis (20% response rate, 55% female sex residents). Only 19% of residents self-reported feeling comfortable providing care for women's musculoskeletal health conditions. Comfort did not significantly differ by postgraduate year, program region, or sex. However, with regression modeling, the number of topics learned formally in their curriculum had an increased odds of residents self-reporting comfort (odds ratio [OR] 1.18, confidence interval [CI] 1.08-1.30, adjusted p value .01). The majority of residents viewed learning women's musculoskeletal health as important (94%) and requested more exposure to the field (89%).

CONCLUSIONS

Many PM&R residents do not feel comfortable in caring for women's musculoskeletal health conditions despite their interest in the field. To improve health care access for patients seeking care for these sex-predominant or sex-specific conditions, residency programs may want to consider increasing exposure to women's musculoskeletal health for residents.

Prediction of postpartum depression with an online neurocognitive risk screening tool for pregnant women

Postpartum depression (PPD) is a severe mental illness affecting 10-15% of mothers. Emerging evidence indicates that negative neurocognitive bias in response to infant distress during pregnancy marks an increased risk of PPD. This proof-of-concept study aimed to investigate the association between negatively biased neurocognitive processing of infant distress during pregnancy and subsequent PPD and to explore the feasibility of an online risk screening tool. In the second or third trimester of pregnancy, 87 participants underwent two online tests of reactivity to and evaluation of infant distress and completed questionnaires regarding psychosocial risk factors. After birth, participants rated their depressive symptoms online and underwent a diagnostic telephone interview concerning PPD. Irrespective of depressive symptoms during pregnancy, negative reactivity to and evaluation of infant distress predicted PPD (reactivity: Exp(B)=1.33, p = 0.04) and depressive symptoms after birth (reactivity: B = 0.04, p = 0.048; evaluation: B = 0.10, p = 0.04). The negative reactivity toward infant distress showed high sensitivity and moderate specificity (89% and 77%, respectively), while the evaluation of infant distressed cries showed lower sensitivity and specificity (67% and 66%, respectively). The relatively small sample size prevented the inclusion of additional risk variables in the regression models. The replication of an association between negative neurocognitive bias during pregnancy with PPD risk is noteworthy and has clinical implications in terms of early prevention. However, the low response rate indicates that this tool is not feasible in its current form. Future larger-scale studies are needed to further investigate candidate risk factors in a brief online screening tool.

Investigating the effect of providing monetary incentives to participants on completion rates of referred co-respondents: An embedded randomized controlled trial. Study within a trial (SWAT) protocol

Background

Parent-report questionnaires are a common method of generating data on child outcomes in mental health studies. A second report from another person who knows the child (co-respondent) is implemented to reduce bias and increase objectivity. The success of this approach is dependent on the engagement of co-respondents, which can be difficult. Financial incentives are used to increase data return in clinical trials, and to promote referral rates in online marketing. This protocol describes the use of an embedded randomised controlled trial (RCT) to investigate the effect of financial incentives on rates of co-respondent data completion. In the host RCT (of an online intervention designed to reduce the impact of a parent's anxiety on their child) index participants (i.e. parents) are asked to invite a co-respondent to complete measures on the index child. This study will test the hypothesis that providing monetary incentives to index participants will increase the outcome measure completion rate of co-respondents.

Methods

Embedded RCT of two parallel groups. Participants in the intervention arm will be sent a £10 voucher if their chosen co-respondent completes online baseline measures. Participants in the control arm will not be offered payment regardless of their chosen co-respondent's behaviour. 1754 participants will take part. Analysis will compare co-respondent outcome measure completion rates between the two arms at baseline and follow-up.

Conclusion

Findings from this study will provide evidence on the impact of offering payment to index participants on return rates of co-respondent data. This will inform resource allocation within future clinical trials.

Long-term efficacy of exercise across diagnostically heterogenous mental disorders and the mediating role of affect regulation skills

BACKGROUND

Exercise interventions are efficacious in reducing disorder-specific symptoms in various mental disorders. However, little is known about long-term transdiagnostic efficacy of exercise across heterogenous mental disorders and the potential mechanisms underlying treatment effects.

METHODS

Physically inactive outpatients, with depressive disorders, anxiety disorders, insomnia or attention deficit hyperactivity disorder were randomized to a standardized 12-week exercise intervention, combining moderate exercise with behavior change techniques (BCTs) (n = 38), or a passive control group (n = 36). Primary outcome was global symptom severity (Symptom Checklist-90, SCL-90-R) and secondary outcomes were self-reported exercise (Physical Activity, Exercise, and Sport Questionnaire), exercise-specific affect regulation (Physical Activity-related Health Competence Questionnaire) and depression (SCL-90-R) assessed at baseline (T1), post-treatment (T2) and one year after post-treatment (T3). Intention-to-treat analyses were conducted using linear mixed models and structural equations modeling.

RESULTS

From T1 to T3, the intervention group significantly improved on global symptom severity (d = -0.43, p = .031), depression among a depressed subsample (d = -0.62, p = .014), exercise (d = 0.45, p = .011) and exercise-specific affect regulation (d = 0.44, p = .028) relative to the control group. The intervention group was more likely to reveal clinically significant changes from T1 to T3 (p = .033). Increases in exercise-specific affect regulation mediated intervention effects on global symptom severity (ß = -0.28, p = .037) and clinically significant changes (ß = -0.24, p = .042).

CONCLUSIONS

The exercise intervention showed long-term efficacy among a diagnostically heterogeneous outpatient sample and led to long-lasting exercise behavior change. Long-term increases in exercise-specific affect regulation within exercise interventions seem to be essential for long-lasting symptom reduction.

A Brief Intervention for Improving Alcohol Literacy and Addressing Harmful Alcohol use Among Women Attending an Australian Breast Screening Service (Health4Her): Protocol for a Hybrid Effectiveness-Implementation Trial (Preprint)

BACKGROUND

Alcohol consumption is a major modifiable risk factor for female breast cancer, even in small amounts. However, awareness of this risk remains low. National breast screening programs are uniquely positioned to provide timely and targeted health information and behavior change strategies to improve alcohol literacy and reduce consumption. A breast screening service is a novel health care setting for brief alcohol intervention, with the potential for extensive reach.

OBJECTIVE

This study aimed to conduct a formative evaluation with breast screening service consumers to understand the need for, and acceptability of, brief alcohol intervention in the breast screening setting and collaboratively design a brief alcohol intervention (Health4Her); to test the effectiveness of Health4Her in improving knowledge of alcohol as a breast cancer risk factor (primary outcome), improving alcohol literacy, and reducing consumption among women attending a breast screening service; and to examine the implementation strategy through process evaluation.

METHODS

This was a hybrid type II effectiveness-implementation trial comprising a randomized controlled trial (RCT) alongside a mixed methods program evaluation guided by applicable elements of the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework and Consolidated Framework for Implementation Research. Formative evaluation comprised a retrospective analysis of alcohol consumption data (n=49,240), a web-based survey (n=391), and focus groups and interviews (n=31) with breast screening service consumers. Women attending routine mammography, drinking at any level, were recruited to the single-site, double-blind RCT (n=558), and completed a baseline assessment before randomization (1:1) to receive Health4Her (alcohol brief intervention + lifestyle information) or control (lifestyle information) via animation on an iPad. Follow-up assessments were performed 4 and 12 weeks after randomization. The process evaluation included evaluation of trial administrative data, participant quantitative (n=497) and qualitative feedback (n=30), and site staff qualitative feedback (n=11).

RESULTS

This research was funded in March and May 2019. Data collection for the formative evaluation and trial recruitment occurred between January and April 2020 and February and August 2021, respectively, with finalization of follow-up data collection in December 2021. Quantitative process evaluation data were collected during trial implementation, and collection of participant and staff feedback was finalized in December 2021. Results of the retrospective analysis of alcohol consumption data from breast screening service consumers is anticipated to be published in March 2023 and the results of the RCT to be published in March 2023.

CONCLUSIONS

This study is anticipated to generate new substantial knowledge on the alcohol consumption and literacy needs of women attending breast screening and the extent to which these can be addressed using a novel, tailored brief alcohol intervention. The study design permits the evaluation of the effectiveness and implementation of Health4Her to predict and facilitate uptake in breast screening services.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04715516; https://clinicaltrials.gov/ct2/show/NCT04715516.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR1-10.2196/44867.

Digital culturally tailored marketing for enrolling Latino participants in a web-based registry: Baseline metrics from the Brain Health Registry

INTRODUCTION

This culturally tailored enrollment effort aims to determine the feasibility of enrolling 5000 older Latino adults from California into the Brain Health Registries (BHR) over 2.25 years.

METHODS

This paper describes (1) the development and deployment of culturally tailored BHR websites and digital ads, in collaboration with a Latino community science partnership board and a marketing company; (2) an interim feasibility analysis of the enrollment efforts and numbers, and participant characteristics (primary aim); as well as (3) an exploration of module completion and a preliminary efficacy evaluation of the culturally tailored digital efforts compared to BHR's standard non-culturally tailored efforts (secondary aim).

RESULTS

In 12.5 months, 3603 older Latino adults were enrolled (71% of the total California Latino BHR initiative enrollment goal). Completion of all BHR modules was low (6%).

DISCUSSION

Targeted ad placement, culturally tailored enrollment messaging, and culturally tailored BHR websites increased enrollment of Latino participants in BHR, but did not translate to increased module completion.

HIGHLIGHTS

Culturally tailored social marketing and website improvements were implemented. The efforts enrolled 5662 Latino individuals in 12.5 months. The number of Latino Brain Health Registry (BHR) participants increased by 122.7%. We failed to adequately enroll female Latinos and Latinos with lower education. Future work will evaluate effects of a newly released Spanish-language BHR website.

Efficacy of a transdiagnostic cognitive-behavioral intervention for eating disorder psychopathology delivered through a smartphone app: a randomized controlled trial

BACKGROUND

Although effective treatments exist for diagnostic and subthreshold-level eating disorders (EDs), a significant proportion of affected individuals do not receive help. Interventions translated for delivery through smartphone apps may be one solution towards reducing this treatment gap. However, evidence for the efficacy of smartphones apps for EDs is lacking. We developed a smartphone app based on the principles and techniques of transdiagnostic cognitive-behavioral therapy for EDs and evaluated it through a pre-registered randomized controlled trial.

METHODS

Symptomatic individuals (those who reported the presence of binge eating) were randomly assigned to the app (n = 197) or waiting list (n = 195). Of the total sample, 42 and 31% exhibited diagnostic-level bulimia nervosa and binge-eating disorder symptoms, respectively. Assessments took place at baseline, 4 weeks, and 8 weeks post-randomization. Analyses were intention-to-treat. The primary outcome was global levels of ED psychopathology. Secondary outcomes were other ED symptoms, impairment, and distress.

RESULTS

Intervention participants reported greater reductions in global ED psychopathology than the control group at post-test (d = -0.80). Significant effects were also observed for secondary outcomes (d's = -0.30 to -0.74), except compensatory behavior frequency. Symptom levels remained stable at follow-up. Participants were largely satisfied with the app, although the overall post-test attrition rate was 35%.

CONCLUSION

Findings highlight the potential for this app to serve as a cost-effective and easily accessible intervention for those who cannot receive standard treatment. The capacity for apps to be flexibly integrated within current models of mental health care delivery may prove vital for addressing the unmet needs of people with EDs.

Improving Widescale Monitoring of Ectoparasite Presence in Northern Canadian Wildlife with the Aid of Citizen Science

Simple Summary

Surveying ticks on wildlife hosts consistently over time and across space presents many challenges. In Yukon, Canada, the winter tick, Dermacentor albipictus, is a blood-feeding parasite that can cause significant losses of hair and blood in moose and other wildlife. The impacts of winter tick infestation in wildlife hosts in this northern region are not well documented. To enhance existing surveillance of winter ticks in Yukon, we implemented a three-year citizen science program, the Yukon Winter Tick Monitoring Project (YWTMP) to engage hunters in the collection of underrepresented moose and caribou samples. Social media, participation incentives, and hide-sampling kits distributed to hunters increased the combined number of annual moose and caribou hide submissions almost 100-fold, and the geographical range of samples by almost 500 km, compared with submission numbers in the previous seven years. Citizen science samples were also used to detect previously unknown infection localities on moose in southeastern Yukon that are spatially separate to known infestations found on elk and deer, helping to build a better picture of infection dynamics on different host animals. Engaging with key demographic groups using structured citizen science programs like the YWTMP can significantly expand sampling efforts in remote areas while maintaining systematic sampling methods to monitor parasites of wildlife health concern.

Abstract

Sampling hides from harvested animals is commonly used for passive monitoring of ectoparasites on wildlife hosts, but often relies heavily on community engagement to obtain spatially and temporally consistent samples. Surveillance of winter ticks (Dermacentor albipictus) on moose (Alces alces) and caribou (Rangifer tarandus caribou) hosts in Yukon, Canada, has relied in part on voluntary submission of hides by hunters since 2011, but few samples were submitted. To enhance sampling efforts on underrepresented moose and caribou hosts, we implemented a three-year citizen science program, the Yukon Winter Tick Monitoring Project (YWTMP), to better engage with hunters in hide sample collection. A combination of in-person and social media outreach, incentivized engagement, and standardized hide sampling kits increased voluntary submissions of moose and caribou hides almost 100-fold since surveillance began. Citizen science samples expanded the northernmost geographic extent of existing sampling efforts for moose by 480 km and for caribou by 650 km to reach 67.5° N latitude. Samples also resulted in new detections of winter ticks on moose hides that are spatially separate to those submitted for other cervids in Yukon. Findings from the YWTMP have provided an essential baseline to monitor future winter tick host–parasite dynamics in the region and highlighted priority areas for ongoing tick surveillance.

Persistence and Attrition among Participants in a Multi-Page Online Survey Recruited via Reddit’s Social Media Network

Participant attrition is a major concern for the validity of longer or complex surveys. Unlike paper-based surveys, which may be discarded even if partially completed, multi-page online surveys capture responses from all completed pages until the time of abandonment. This can result in different item response rates, with pages earlier in the sequence showing more completions than later pages. Using data from a multi-page online survey administered to cohorts recruited on Reddit, this paper analyses the pattern of attrition at various stages of the survey instrument and examines the effects of survey length, time investment, survey format and complexity, and survey delivery on participant attrition. The participant attrition rate (PAR) differed between cohorts, with cohorts drawn from Reddit showing a higher PAR than cohorts targeted by other means. Common to all was that the PAR was higher among younger respondents and among men. Changes in survey question design resulted in the greatest rise in PAR irrespective of age, gender or cohort.

Recruitment, adherence and attrition challenges in internet-based indicated prevention programs for eating disorders: lessons learned from a randomised controlled trial of ProYouth OZ

BACKGROUND

Growing evidence supports the effectiveness of Internet-based prevention programs for eating disorders, but the adjunctive benefit of synchronous peer support has yet to be investigated. In the current study, a randomised controlled trial was conducted to evaluate the effectiveness of an indicated Internet-based prevention program (ProYouth OZ) with and without peer-to-peer support in reducing disordered eating behaviours and attitudes.

METHOD

Fifty young adults (18-25 years) with eating disorder symptoms were randomised to one of three study conditions: (1) ProYouth OZ (without peer-to-peer support), (2) ProYouth OZ Peers (with peer-to-peer support), and (3) a waitlist control group. Outcomes were assessed at three different time points. Eating disorder symptoms (primary outcome) were measured with the Eating Disorder Examination Questionnaire.

RESULTS

Of 415 screened participants, 73 (17.6%) were eligible and 213 (51.3%) excluded due to severe eating disorder symptoms. Fifteen participants (30%) completed the post-intervention survey. Of the two intervention groups, 20.6% failed to access any component of the program. Of 17 ProYouth OZ Peers participants, 58.8% attended at least one chat session, 20% attended 2-5 sessions, and 11.8% attended all six sessions. Due to limited outcome data, it was not possible to statistically examine between-group differences in outcomes. Visual inspection of individual profiles revealed that both ProYouth OZ Peers participants who completed the post-intervention survey showed a decrease in disordered eating compared with only one of the six completers in ProYouth OZ.

CONCLUSION

Findings highlight the challenges of trialling Internet-based eating disorder prevention programs in the community. The study identified a large group of emerging adults with eating disorders who were interested in an Internet-based program, suggesting a high level of unmet need. Future research on synchronous peer-to-peer support in Internet-based prevention for eating disorders is warranted. Further studies are required to identify optimal strategies for reaching this population (e.g., online vs. offline) and evaluating the effectiveness of a range of strategies for promoting engagement. Finally, there is an urgent need to develop innovative widely accessible interventions for individuals who experience clinically relevant eating disorder symptomatology but may not be ready or able to seek professional face-to-face treatment.

TRIAL REGISTRATION

ACTRN12615001250527, Registered 16 November 2015, https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12615001250527.

Effects of Internet-Based Cognitive Behavioral Therapy for Harmful Alcohol Use and Alcohol Dependence as Self-help or With Therapist Guidance: Three-Armed Randomized Trial

Background

Alcohol use is a major contributor to health loss. Many persons with harmful use or alcohol dependence do not obtain treatment because of limited availability or stigma. They may use internet-based interventions as an alternative way of obtaining support. Internet-based interventions have previously been shown to be effective in reducing alcohol consumption in studies that included hazardous use; however, few studies have been conducted with a specific focus on harmful use or alcohol dependence. The importance of therapist guidance in internet-based cognitive behavioral therapy (ICBT) programs is still unclear.

Objective

This trial aims to investigate the effects of a web-based alcohol program with or without therapist guidance among anonymous adult help-seekers.

Methods

A three-armed randomized controlled trial was conducted to compare therapist-guided ICBT and self-help ICBT with an information-only control condition. Swedish-speaking adult internet users with alcohol dependence (3 or more International Classification of Diseases, Tenth Revision criteria) or harmful alcohol use (alcohol use disorder identification test>15) were included in the study. Participants in the therapist-guided ICBT and self-help ICBT groups had 12-week access to a program consisting of 5 main modules, as well as a drinking calendar with automatic feedback. Guidance was given by experienced therapists trained in motivational interviewing. The primary outcome measure was weekly alcohol consumption in standard drinks (12 g of ethanol). Secondary outcomes were alcohol-related problems measured using the total alcohol use disorder identification test-score, diagnostic criteria for alcohol dependence and alcohol use disorder, depression, anxiety, health, readiness to change, and access to other treatments or support. Follow-up was conducted 3 (posttreatment) and 6 months after recruitment.

Results

During the recruitment period, from March 2015 to March 2017, 1169 participants were included. Participants had a mean age of 45 (SD 13) years, and 56.72% (663/1169) were women. At the 3-month follow-up, the therapist-guided ICBT and control groups differed significantly in weekly alcohol consumption (−3.84, 95% Cl −6.53 to −1.16; t₄₁₇=2.81; P=.005; Cohen d=0.27). No significant differences were found in weekly alcohol consumption between the self-help ICBT group and the therapist-guided ICBT at 3 months, between the self-help ICBT and the control group at 3 months, or between any of the groups at the 6-month follow-up. A limitation of the study was the large number of participants who were completely lost to follow-up (477/1169, 40.8%).

Conclusions

In this study, a therapist-guided ICBT program was not found to be more effective than the same program in a self-help ICBT version for reducing alcohol consumption or other alcohol-related outcomes. In the short run, therapist-guided ICBT was more effective than information. Only some internet help-seekers may need a multisession program and therapist guidance to change their drinking when they use internet-based interventions.

Trial Registration

ClinicalTrials.gov NCT02377726; https://clinicaltrials.gov/ct2/show/NCT02377726

A web-based, peer-supported self-management intervention to reduce distress in relatives of people with psychosis or bipolar disorder: the REACT RCT

BACKGROUND

Relatives caring for people with severe mental health problems find information and emotional support hard to access. Online support for self-management offers a potential solution.

OBJECTIVE

The objective was to determine the clinical effectiveness and cost-effectiveness of an online supported self-management tool for relatives: the Relatives' Education And Coping Toolkit (REACT).

DESIGN AND SETTING

This was a primarily online (UK), single-blind, randomised controlled trial, comparing REACT plus a resource directory and treatment as usual with the resource directory and treatment as usual only, by measuring user distress and other well-being measures at baseline and at 12 and 24 weeks.

PARTICIPANTS

A total of 800 relatives of people with severe mental health problems across the UK took part; relatives who were aged ≥ 16 years, were experiencing high levels of distress, had access to the internet and were actively seeking help were recruited.

INTERVENTION

REACT comprised 12 psychoeducation modules, peer support through a group forum, confidential messaging and a comprehensive resource directory of national support. Trained relatives moderated the forum and responded to messages.

MAIN OUTCOME MEASURE

The main outcome was the level of participants' distress, as measured by the General Health Questionnaire-28 items.

RESULTS

Various online and offline strategies, including social media, directed potential participants to the website. Participants were randomised to one of two arms: REACT plus the resource directory (n = 399) or the resource directory only (n = 401). Retention at 24 weeks was 75% (REACT arm, n = 292; resource directory-only arm, n = 307). The mean scores for the General Health Questionnaire-28 items reduced substantially across both arms over 24 weeks, from 40.2 (standard deviation 14.3) to 30.5 (standard deviation 15.6), with no significant difference between arms (mean difference -1.39, 95% confidence interval -3.60 to 0.83; p = 0.22). At 12 weeks, the General Health Questionnaire-28 items scores were lower in the REACT arm than in the resource directory-only arm (-2.08, 95% confidence interval -4.14 to -0.03; p = 0.027), but this finding is likely to be of limited clinical significance. Accounting for missing data, which were associated with higher distress in the REACT arm (0.33, 95% confidence interval -0.27 to 0.93; p = 0.279), in a longitudinal model, there was no significant difference between arms over 24 weeks (-0.56, 95% confidence interval -2.34 to 1.22; p = 0.51). REACT cost £142.95 per participant to design and deliver (£62.27 for delivery only), compared with £0.84 for the resource directory only. A health economic analysis of NHS, health and Personal Social Services outcomes found that REACT has higher costs (£286.77), slightly better General Health Questionnaire-28 items scores (incremental General Health Questionnaire-28 items score adjusted for baseline, age and gender: -1.152, 95% confidence interval -3.370 to 1.065) and slightly lower quality-adjusted life-year gains than the resource directory only; none of these differences was statistically significant. The median time spent online was 50.8 minutes (interquartile range 12.4-172.1 minutes) for REACT, with no significant association with outcome. Participants reported finding REACT a safe, confidential environment (96%) and reported feeling supported by the forum (89%) and the REACT supporters (86%). No serious adverse events were reported.

LIMITATIONS

The sample comprised predominantly white British females, 25% of participants were lost to follow-up and dropout in the REACT arm was not random.

CONCLUSIONS

An online self-management support toolkit with a moderated group forum is acceptable to relatives and, compared with face-to-face programmes, offers inexpensive, safe delivery of National Institute for Health and Care Excellence-recommended support to engage relatives as peers in care delivery. However, currently, REACT plus the resource directory is no more effective at reducing relatives' distress than the resource directory only.

FUTURE WORK

Further research in improving the effectiveness of online carer support interventions is required.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN72019945.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 32. See the NIHR Journals Library website for further project information.

Evaluation of the effectiveness of an incentive strategy on the questionnaire response rate in parents of premature babies: a randomised controlled Study Within A Trial (SWAT) nested within SIFT

Background

Loss to follow-up resulting in missing outcomes compromises the validity of trial results by reducing statistical power, negatively affecting generalisability and undermining assumptions made at analysis, leading to potentially biased and misleading results. Evidence that incentives are effective at improving response rates exists, but there is little evidence regarding the best approach, especially in the field of perinatal medicine. The NIHR-funded SIFT trial follow-up of infants at 2 years of age provided an ideal opportunity to address this remaining uncertainty.

Methods

Participants: parents of infants from participating neonatal units in the UK and Ireland followed up for SIFT (multicentre RCT investigating two speeds of feeding in babies with gestational age at birth < 32 weeks and/or birthweight < 1500 g). Interventions: parents were randomly allocated to receive incentives (£15 gift voucher) before or after questionnaire return. The objective was to establish whether offering an unconditional incentive in advance or promising an incentive on completion of a questionnaire (conditional) improved the response rate in parents of premature babies. The primary outcome was questionnaire response rate. Permuted block randomisation was performed (variable size blocks), stratified by SIFT allocation (slower/faster feeds) and single/multiple birth. Multiple births were given the same incentives allocation. Parents were unaware that they were in an incentives SWAT; SIFT office staff were not blinded to allocation.

Results

Parents of 923 infants were randomised: 459 infants allocated to receive incentive before, 464 infants allocated to receive incentive after; analysis was by intention to treat. Allocation to the incentive before completion led to a significantly higher response rate, 83.0% (381/459) compared to the after-completion group, 76.1% (353/464); adjusted absolute difference of 6.8% (95% confidence interval 1.6% to 12.0%). Giving an incentive in advance is the more costly approach, but the mean difference of ~£3 per infant is small given the higher return.

Conclusions

An unconditional incentive in advance led to a significantly higher response rate compared to the promise of an incentive on completion. Against a backdrop of falling response rates to questionnaires, incentives can be an effective way to increase returns.

Trial registration

SIFT (ISRCTN76463425). Registered on March 5, 2013.; SWAT registration (SWAT 69 available from http://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/FileStore/Filetoupload,864297,en.pdf). Registered on June 27, 2016.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05515-y.

Turn on, Tune in, and Drop out: Predictors of Attrition in a Prospective Observational Cohort Study on Psychedelic Use

Background

The resurgence of research and public interest in the positive psychological effects of psychedelics, together with advancements in digital data collection techniques, have brought forth a new type of research design, which involves prospectively gathering large-scale naturalistic data from psychedelic users; that is, before and after the use of a psychedelic compound. A methodological limitation of such studies is their high attrition rate, particularly owing to participants who stop responding after initial study enrollment. Importantly, study dropout can introduce systematic biases that may affect the interpretability of results.

Objective

Based on a previously collected sample (baseline n=654), here we investigated potential determinants of study attrition in web-based prospective studies on psychedelic use.

Methods

Logistic regression models were used to examine demographic, psychological trait and state, and psychedelic-specific predictors of dropout. Predictors were assessed 1 week before, 1 day after, and 2 weeks after psychedelic use, with attrition being defined as noncompletion of the key endpoint 4 weeks post experience.

Results

Predictors of attrition were found among demographic variables including age (β=0.024; P=.007) and educational levels, as well as personality traits, specifically conscientiousness (β=–0.079; P=.02) and extraversion (β=0.082; P=.01). Contrary to prior hypotheses, neither baseline attitudes toward psychedelics nor the intensity of acute challenging experiences were predictive of dropout.

Conclusions

The baseline predictors of attrition identified here are consistent with those reported in longitudinal studies in other scientific disciplines, suggesting their transdisciplinary relevance. Moreover, the lack of an association between attrition and psychedelic advocacy or negative drug experiences in our sample contextualizes concerns about problematic biases in these and related data.

Brief interventions to prevent excessive alcohol use in adolescents at low-risk presenting to Emergency Departments: Three-arm, randomised trial of effectiveness and cost-effectiveness

BACKGROUND

Alcohol consumption and related harm increase rapidly from the age of 12 years. We evaluated whether alcohol screening and brief intervention is effective and cost-effective in delaying hazardous or harmful drinking amongst low-risk or abstaining adolescents attending Emergency Departments (EDs).

METHODS

This ten-centre, three-arm, parallel-group, single-blind, pragmatic, individually randomised trial screened ED attenders aged between 14 and 17 years for alcohol consumption. We sampled at random one third of those scoring at most 2 on AUDIT-C who had access to the internet and, if aged under 16, were Gillick competent or had informed consent from parent or guardian. We randomised them between: screening only (control intervention); one session of face-to-face Personalised Feedback and Brief Advice (PFBA); and PFBA plus an electronic brief intervention (eBI) on smartphone or web. We conducted follow-up after six and 12 months. The principal outcomes were alcohol consumed over the 3 months before 12-month follow up, measured by AUDIT-C; and quality-adjusted life-years.

FINDINGS

Between October 2014 and May 2015, we approached 5,016 eligible patients of whom 3,326 consented to be screened and participate in the trial; 2,571 of these were low-risk drinkers or abstainers, consuming an average 0.14 units per week. We randomised: 304 to screening only; 285 to PFBA; and 294 to PFBA and eBI. We found no significant difference between groups, notably in weekly alcohol consumption: those receiving screening only drank 0.10 units (95% confidence interval 0.05 to 0.18); PFBA 0.12 (0.06 to 0.21); PFBA and eBI 0.10 (0.05 to 0.19).

INTERPRETATION

While drinking levels remained low in this population, this trial found no evidence that PFBA with or without eBI was more effective than screening alone in reducing or delaying alcohol consumption.

Strategies for research participant engagement: A synthetic review and conceptual framework

BACKGROUND

Research participant engagement, which we define as recruitment and retention in clinical trials, is a costly and challenging issue in clinical research. Research teams have leveraged a variety of strategies to increase research participant engagement in clinical trials, although a framework and evidence for effective participant engagement strategies are lacking. We (1) developed a novel conceptual framework for strategies used to recruit and retain participants in clinical trials based on their underlying behavioral principles and (2) categorized empirically tested recruitment and retention strategies in this novel framework.

METHODS

We conducted a synthetic analysis of interventions tested in studies from two Cochrane reviews on clinical trial recruitment and retention, which included studies from 1986 to 2015. We developed a conceptual framework of behavioral strategies for increasing research participant engagement using deductive and inductive approaches with the studies included in the Cochrane reviews. Reviewed interventions were then categorized using this framework. We examined the results of reviewed interventions and categorized the effects on clinical trial recruitment and retention as significantly positive, null, or significantly negative; summary statistics are presented for the frequency and effects of each behavioral strategy type.

RESULTS

We analyzed 141 unique interventions across 96 studies: 91 interventions targeted clinical trial research participant recruitment and 50 targeted retention. Our framework included 14 behavioral strategies to improve research participant engagement grouped into four general approaches: changing attitudes by appealing to social motivators, changing attitudes by targeting individual psychology, reducing barriers and cognitive burdens, and providing incentives. The majority of interventions (54%) aimed to reduce barriers or cognitive burdens, with improving comprehension (27%) as the most common specific strategy identified. For recruitment, the most common behavioral strategies tested were building legitimacy or trust (38%) and framing risks and benefits (32%), while financial or material incentives (32%) and reducing financial, time, and social barriers (32%) were most common for retention interventions. Among interventions tested in randomized controlled trials, 51% had a null effect on research participant engagement, and 30% had a statistically significant positive effect.

DISCUSSION

Clinical researchers have tested a wide range of interventions that leverage distinct behavioral strategies to achieve improved research participant recruitment and retention. Common behavioral strategies include building legitimacy or trust between research teams and participants, as well as improving participant comprehension of trial objectives and procedures. The high frequency of null effects among tested interventions suggests challenges in selecting the optimal interventions for increasing research participant engagement, although the proposed behavioral strategy categories can serve as a conceptual framework for developing and testing future interventions.

Strategies to improve retention in randomised trials

BACKGROUND

Poor retention of participants in randomised trials can lead to missing outcome data which can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to improve retention but few have been formally evaluated.

OBJECTIVES

To quantify the effect of strategies to improve retention of participants in randomised trials and to investigate if the effect varied by trial setting.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Scopus, PsycINFO, CINAHL, Web of Science Core Collection (SCI-expanded, SSCI, CPSI-S, CPCI-SSH and ESCI) either directly with a specified search strategy or indirectly through the ORRCA database. We also searched the SWAT repository to identify ongoing or recently completed retention trials. We did our most recent searches in January 2020.

SELECTION CRITERIA

We included eligible randomised or quasi-randomised trials of evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance.

DATA COLLECTION AND ANALYSIS

We extracted data on: the retention strategy being evaluated; location of study; host trial setting; method of randomisation; numbers and proportions in each intervention and comparator group. We used a risk difference (RD) and 95% confidence interval (CI) to estimate the effectiveness of the strategies to improve retention. We assessed heterogeneity between trials. We applied GRADE to determine the certainty of the evidence within each comparison.

MAIN RESULTS

We identified 70 eligible papers that reported data from 81 retention trials. We included 69 studies with more than 100,000 participants in the final meta-analyses, of which 67 studies evaluated interventions aimed at trial participants and two evaluated interventions aimed at trial staff involved in retention. All studies were in health care and most aimed to improve postal questionnaire response. Interventions were categorised into broad comparison groups: Data collection; Participants; Sites and site staff; Central study management; and Study design. These intervention groups consisted of 52 comparisons, none of which were supported by high-certainty evidence as determined by GRADE assessment. There were four comparisons presenting moderate-certainty evidence, three supporting retention (self-sampling kits, monetary reward together with reminder or prenotification and giving a pen at recruitment) and one reducing retention (inclusion of a diary with usual follow-up compared to usual follow-up alone). Of the remaining studies, 20 presented GRADE low-certainty evidence and 28 presented very low-certainty evidence. Our findings do provide a priority list for future replication studies, especially with regard to comparisons that currently rely on a single study.

AUTHORS' CONCLUSIONS

Most of the interventions we identified aimed to improve retention in the form of postal questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. None of the comparisons are supported by high-certainty evidence. Comparisons in the review where the evidence certainty could be improved with the addition of well-done studies should be the focus for future evaluations.

Smoking cessation avatar-led Acceptance and Commitment Therapy digital intervention: feasibility and acceptability in young adults

Smoking remains a global concern especially among youth and smoking cessation interventions have not been particularly successful with this age group. The aim of the present study was to evaluate the feasibility and acceptability of an innovative avatar-led, digital intervention grounded in Acceptance and Commitment Therapy (ACT) for smoking cessation in youth. Participants were 49 university student smokers, aged 18-28 years old (Mage = 22.50, SD = 2.56; 64.3% females). Participants found the program satisfactory, useful, and motivating. Participants enjoyed the digitally unique components of the intervention, such as videos, metaphors, and games, more than the overall graphics and the appearance of the avatars. Results of this study are encouraging for the acceptability and satisfaction with avatar-led digitized ACT interventions for smoking cessation targeting young smokers. Participants suggested that future program advances should include a more reality-based user experience and more interactive avatars. Future adaptations should consider additional ways to decrease attrition rates and further increase satisfaction and motivation to complete the program and quit smoking.

Volunteering via Smart-Phone for People With Psychosis-Protocol of a Feasibility Trial

The literature suggests that volunteering can be used to address social isolation and support patients with psychosis in the community. However, many expect in person meetings, requiring a greater effort of availability and commitment. There is therefore a need for more flexible, easily accessible support. Volunteering via smart-phone could be a useful intervention for people with psychosis. One patient and one volunteer have been matched for a duration of 12 weeks, and participants have been encouraged to communicate through a variety of communication methods (audio calls, video calls, text messages, WhatsApp messages and e-mails). The Phone Pal study aimed to investigate the feasibility of recruitment, participant retention, data collection procedures, intervention usage of the methods of communication and changes in outcome data. At baseline and follow-up outcome measures collected from patients and volunteers included their quality of life, physical activity, self-esteem and social comparison. Additional outcomes assessed patients' attachment, social contacts and symptoms; for volunteers, their social distance was evaluated. At follow-up both patients and volunteers rank their perception of their relationship with each other. This mixed method feasibility study has been conducted in two phases, the first stage evaluating a smaller sample of patients and volunteers recruited in London, and then a second phase with a larger sample of volunteers recruited from across the United Kingdom. Trial registration: ISRCTN17586238.

Opportunities and challenges of delivering digital clinical trials: lessons learned from a randomised controlled trial of an online behavioural intervention for children and young people

BACKGROUND

Despite being the gold standard of research to determine effectiveness, randomised controlled trials (RCTs) often struggle with participant recruitment, engagement and retention. These issues may be exacerbated when recruiting vulnerable populations, such as participants with mental health issues. We aimed to update understanding of the scope of these problems in trials of health technology and identify possible solutions through reflecting on experiences from an exemplar trial (Online Remote Behavioural Intervention for Tics; ORBIT).

METHOD

We extracted anonymised data on recruitment, retention and requests for more funding and time from trials funded by the largest funder of health technology trials in the UK (the National Institute of Health Research Health Technology Assessment) between 2010 and 2020, and compared these with data from a recent, successful trial (ORBIT). ORBIT aimed to assess the clinical- and cost-effectiveness of blended online and human behavioural therapy for tics in young people. Many of the trial procedures, including recruitment, the intervention and data collection, were undertaken online.

RESULTS

Data were extracted on 51 trials conducted between 2010 and 2020. Sixty per cent of trials failed to reach their original recruitment target and only 44% achieved their follow-up in the specified time frame. In contrast, ORBIT recruited to target and achieved 90% follow-up. We posit that these achievements are related to (a) judicious use of digital technology for trial procedures and (b) adequate numbers of highly trained and motivated trial staff. We provide details of both these to help other research teams plan and cost for successful trials.

CONCLUSION

An approach combining human and online methods may be advantageous in facilitating trial delivery, particularly in paediatric mental health services. Given the importance of successful clinical trials in advancing healthcare delivery and the waste of human and economic resources associated with unsuccessfully delivered trials, it is imperative that trials are appropriately costed and future research focusses on improving trial design and delivery.

TRIAL REGISTRATION

The ORBIT trial is registered with ISRTCN ( ISRCTN70758207 ) Registered on March 20, 2018. and ClinicalTrials.gov ( NCT03483493 ). Registered on March 30, 2018.

Methodological Challenges in Web-Based Trials: Update and Insights From the Relatives Education and Coping Toolkit Trial

RR2-10.1136/bmjopen-2017-016965.

Two speeds of increasing milk feeds for very preterm or very low-birthweight infants: the SIFT RCT

BACKGROUND

Observational data suggest that slowly advancing enteral feeds in preterm infants may reduce necrotising enterocolitis but increase late-onset sepsis. The Speed of Increasing milk Feeds Trial (SIFT) compared two rates of feed advancement.

OBJECTIVE

To determine if faster (30 ml/kg/day) or slower (18 ml/kg/day) daily feed increments improve survival without moderate or severe disability and other morbidities in very preterm or very low-birthweight infants.

DESIGN

This was a multicentre, two-arm, parallel-group, randomised controlled trial. Randomisation was via a web-hosted minimisation algorithm. It was not possible to safely and completely blind caregivers and parents.

SETTING

The setting was 55 UK neonatal units, from May 2013 to June 2015.

PARTICIPANTS

The participants were infants born at < 32 weeks' gestation or a weight of < 1500 g, who were receiving < 30 ml/kg/day of milk at trial enrolment.

INTERVENTIONS

When clinicians were ready to start advancing feed volumes, the infant was randomised to receive daily feed increments of either 30 ml/kg/day or 18 ml/kg/day. In total, 1400 infants were allocated to fast feeds and 1404 infants were allocated to slow feeds.

MAIN OUTCOME MEASURES

The primary outcome was survival without moderate or severe neurodevelopmental disability at 24 months of age, corrected for gestational age. The secondary outcomes were mortality; moderate or severe neurodevelopmental disability at 24 months corrected for gestational age; death before discharge home; microbiologically confirmed or clinically suspected late-onset sepsis; necrotising enterocolitis (Bell's stage 2 or 3); time taken to reach full milk feeds (tolerating 150 ml/kg/day for 3 consecutive days); growth from birth to discharge; duration of parenteral feeding; time in intensive care; duration of hospital stay; diagnosis of cerebral palsy by a doctor or other health professional; and individual components of the definition of moderate or severe neurodevelopmental disability.

RESULTS

The results showed that survival without moderate or severe neurodevelopmental disability at 24 months occurred in 802 out of 1224 (65.5%) infants allocated to faster increments and 848 out of 1246 (68.1%) infants allocated to slower increments (adjusted risk ratio 0.96, 95% confidence interval 0.92 to 1.01). There was no significant difference between groups in the risk of the individual components of the primary outcome or in the important hospital outcomes: late-onset sepsis (adjusted risk ratio 0.96, 95% confidence interval 0.86 to 1.07) or necrotising enterocolitis (adjusted risk ratio 0.88, 95% confidence interval 0.68 to 1.16). Cost-consequence analysis showed that the faster feed increment rate was less costly but also less effective than the slower rate in terms of achieving the primary outcome, so was therefore found to not be cost-effective. Four unexpected serious adverse events were reported, two in each group. None was assessed as being causally related to the intervention.

LIMITATIONS

The study could not be blinded, so care may have been affected by knowledge of allocation. Although well powered for comparisons of all infants, subgroup comparisons were underpowered.

CONCLUSIONS

No clear advantage was identified for the important outcomes in very preterm or very low-birthweight infants when milk feeds were advanced in daily volume increments of 30 ml/kg/day or 18 ml/kg/day. In terms of future work, the interaction of different milk types with increments merits further examination, as may different increments in infants at the extremes of gestation or birthweight.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN76463425.

FUNDING

This project was funded by the National Institute for Health Research Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 18. See the NIHR Journals Library website for further project information.

Effectiveness and Parental Acceptability of Social Networking Interventions for Promoting Seasonal Influenza Vaccination Among Young Children: Randomized Controlled Trial

BACKGROUND

Seasonal influenza vaccination (SIV) coverage among young children remains low worldwide. Mobile social networking apps such as WhatsApp Messenger are promising tools for health interventions.

OBJECTIVE

This was a preliminary study to test the effectiveness and parental acceptability of a social networking intervention that sends weekly vaccination reminders and encourages exchange of SIV-related views and experiences among mothers via WhatsApp discussion groups for promoting childhood SIV. The second objective was to examine the effect of introducing time pressure on mothers' decision making for childhood SIV for vaccination decision making. This was done using countdowns of the recommended vaccination timing.

METHODS

Mothers of child(ren) aged 6 to 72 months were randomly allocated to control or to one of two social networking intervention groups receiving vaccination reminders with (SNI+TP) or without (SNI-TP) a time pressure component via WhatsApp discussion groups at a ratio of 5:2:2. All participants first completed a baseline assessment. Both the SNI-TP and SNI+TP groups subsequently received weekly vaccination reminders from October to December 2017 and participated in WhatsApp discussions about SIV moderated by a health professional. All participants completed a follow-up assessment from April to May 2018.

RESULTS

A total of 84.9% (174/205), 71% (57/80), and 75% (60/80) who were allocated to the control, SNI-TP, and SNI+TP groups, respectively, completed the outcome assessment. The social networking intervention significantly promoted mothers' self-efficacy for taking children for SIV (SNI-TP: odds ratio [OR] 2.69 [1.07-6.79]; SNI+TP: OR 2.50 [1.13-5.55]), but did not result in significantly improved children's SIV uptake. Moreover, after adjusting for mothers' working status, introducing additional time pressure reduced the overall SIV uptake in children of working mothers (OR 0.27 [0.10-0.77]) but significantly increased the SIV uptake among children of mothers without a full-time job (OR 6.53 [1.87-22.82]). Most participants' WhatsApp posts were about sharing experience or views (226/434, 52.1%) of which 44.7% (101/226) were categorized as negative, such as their concerns over vaccine safety, side effects and effectiveness. Although participants shared predominantly negative experience or views about SIV at the beginning of the discussion, the moderator was able to encourage the discussion of more positive experience or views and more knowledge and information. Most intervention group participants indicated willingness to receive the same interventions (110/117, 94.0%) and recommend the interventions to other mothers (102/117, 87.2%) in future.

CONCLUSIONS

Online information support can effectively promote mothers' self-efficacy for taking children for SIV but alone it may not sufficient to address maternal concerns over SIV to achieve a positive vaccination decision. However, the active involvement of health professionals in online discussions can shape positive discussions about vaccination. Time pressure on decision making interacts with maternal work status, facilitating vaccination uptake among mothers who may have more free time, but having the opposite effect among busier working mothers.

TRIAL REGISTRATION

Hong Kong University Clinical Trials Registry HKUCTR-2250; https://tinyurl.com/vejv276.

Assessing effective interventions to improve trial retention: do they contain behaviour change techniques?

BACKGROUND

Clinical trials often struggle to retain the number of participants required to make valid and reliable assessments about the effectiveness of treatments. Several individual randomised comparisons of interventions to improve retention in trials have been shown to be effective. Many of these retention interventions target participants' behaviour (e.g. returning questionnaires or attending a follow-up visit). Although not designed as such, these interventions can be thought of as behaviour change interventions. By coding the constituent behaviour change components of effective retention interventions, the interventions' potential 'active ingredients' responsible for improvements in retention can be identified and maximised for future gains.

METHODS

Studies reporting effective retention interventions were identified from existing meta-analyses in the literature. Published manuscripts and intervention and comparator group material were coded into their behaviour change techniques (BCTs) using the BCT taxonomy version 1. Two authors independently coded materials using a standardised coding manual and discussed any disagreements to reach consensus. Data on study characteristics including host trial context, timing, mode of delivery and dosage of retention intervention were recorded.

RESULTS

Two intervention types were identified as having evidence of improving retention in existing meta-analyses: monetary incentives and electronic prompts. None of the interventions identified from the included studies explicitly stated a theoretical rationale for their development. BCTs were identified in both intervention and comparator groups across both intervention types and there was heterogeneity with regard to their presentation within and across interventions. The BCTs identified in the 'monetary incentive' interventions differed to the comparator group. Contrastingly, the BCTs identified in 'electronic prompts' interventions were identical in both the control and intervention groups (within studies) and differed only in terms of mode of delivery and dosing.

CONCLUSIONS

Attending a measurement visit or returning a questionnaire is a behaviour and trialists should be mindful of this when designing retention interventions. Our work in this area provides some of the first evidence of the impact of implicit use of BCTs in retention interventions and highlights their potential promise for future trials.

Screening and brief interventions for adolescent alcohol use disorders presenting through emergency departments: a research programme including two RCTs

Background

Alcohol consumption and related harm increase steeply from the ages of 12–20 years. Adolescents in the UK are among the heaviest drinkers in Europe. Excessive drinking in adolescents is associated with increased risk of accidents, injuries, self-harm, unprotected or regretted sex, violence and disorder, poisoning and accidental death. However, there is lack of clear evidence for the most clinically effective and cost-effective screening and brief interventions for reducing or preventing alcohol consumption in adolescents attending emergency departments (EDs).

Objectives

To estimate the distribution of alcohol consumption, alcohol-related problems and alcohol use disorders in adolescents attending EDs; to develop age-appropriate alcohol screening and brief intervention tools; and to evaluate the clinical effectiveness and cost-effectiveness of these interventions.

Design

The research has been conducted in three linked stages: (1) a prevalence study, (2) intervention development and (3) two linked randomised controlled trials (RCTs).

Setting

Twelve EDs in England (London, North East, and Yorkshire and The Humber).

Participants

A total of 5376 participants in the prevalence study [mean age 13.0 years, standard deviation (SD) 2.0 years; 46.2% female] and 1640 participants in the two linked RCTs (mean age 15.6 years, SD 1.0 years; 50.7% female).

Interventions

Personalised feedback and brief advice (PFBA) and personalised feedback plus electronic brief intervention (eBI), compared with alcohol screening alone. These age-appropriate alcohol interventions were developed in collaboration with the target audience through a series of focus groups and evaluations during stage 2 of the research programme and following two literature reviews.

Main outcome measures

Total alcohol consumed in standard UK units (1 unit = 8 g of ethanol) over the previous 3 months at 12-month follow-up, assessed using the Alcohol Use Disorders Identification Test, Consumption (3 items) (AUDIT-C).

Results

In the prevalence study, 2112 participants (39.5%) reported having had a drink of alcohol that was more than a sip in their lifetime, with prevalence increasing steadily with age and reaching 89.5% at the age of 17 years. The prevalence of at-risk alcohol consumption was 15% [95% confidence interval (CI) 14% to 16%] and the optimum cut-off point of the AUDIT-C in identifying at-risk drinking was ≥ 3. Associations of alcohol consumption and early onset of drinking with poorer health and social functioning were also found. In the RCT, the analysis of the primary outcome (average weekly alcohol consumption at month 12) identified no significant differences in effect between the three groups in both trials. In the high-risk drinking trial, the mean difference compared with control was 0.57 (95% CI –0.36 to 1.70) for PFBA and 0.19 (95% CI –0.71 to 1.30) for eBI. In the low-risk drinking trial, the mean difference compared with control was 0.03 (95% CI –0.07 to 0.13) for PFBA and 0.01 (95% CI –0.10 to 0.11) for eBI. The health economic analysis showed that eBI and PFBA were not more cost-effective than screening alone.

Conclusions

The ED can offer an opportunity for the identification of at-risk alcohol use in adolescents. A simple, short, self-completed screening instrument, the AUDIT-C, is an effective tool for identifying adolescents who are at risk of alcohol-related problems. Associations of alcohol consumption and earlier onset of drinking with poorer health and social functioning were observed in the prevalence study. The trials were feasible to implement and exceeded the recruitment target and minimum follow-up rates. However, PFBA and eBI were not found to be more effective than screening alone in reducing or preventing alcohol consumption in 14- to 17-year-olds attending EDs.

Limitations and future work

Only one-third of participants engaged with the application program; this is likely to have limited the effect of the intervention. We recommend that future research should focus on methods to maximise engagement with digital interventions and evaluate the effect of such engagement on clinical outcomes.

Trial registration

Current Controlled Trials ISRCTN45300218.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 8, No. 2. See the NIHR Journals Library website for further project information.

Assessing the Psychometric Properties of the Digital Behavior Change Intervention Engagement Scale in Users of an App for Reducing Alcohol Consumption: Evaluation Study

BACKGROUND

The level and type of engagement with digital behavior change interventions (DBCIs) are likely to influence their effectiveness, but validated self-report measures of engagement are lacking. The DBCI Engagement Scale was designed to assess behavioral (ie, amount, depth of use) and experiential (ie, attention, interest, enjoyment) dimensions of engagement.

OBJECTIVE

We aimed to assess the psychometric properties of the DBCI Engagement Scale in users of a smartphone app for reducing alcohol consumption.

METHODS

Participants (N=147) were UK-based, adult, excessive drinkers recruited via an online research platform. Participants downloaded the Drink Less app and completed the scale immediately after their first login in exchange for a financial reward. Criterion variables included the objectively recorded amount of use, depth of use, and subsequent login. Five types of validity (ie, construct, criterion, predictive, incremental, divergent) were examined in exploratory factor, correlational, and regression analyses. The Cronbach alpha was calculated to assess the scale's internal reliability. Covariates included motivation to reduce alcohol consumption.

RESULTS

Responses on the DBCI Engagement Scale could be characterized in terms of two largely independent subscales related to experience and behavior. The experiential and behavioral subscales showed high (α=.78) and moderate (α=.45) internal reliability, respectively. Total scale scores predicted future behavioral engagement (ie, subsequent login) with and without adjusting for users' motivation to reduce alcohol consumption (adjusted odds ratio [ORadj]=1.14; 95% CI 1.03-1.27; P=.01), which was driven by the experiential (ORadj=1.19; 95% CI 1.05-1.34; P=.006) but not the behavioral subscale.

CONCLUSIONS

The DBCI Engagement Scale assesses behavioral and experiential aspects of engagement. The behavioral subscale may not be a valid indicator of behavioral engagement. The experiential subscale can predict subsequent behavioral engagement with an app for reducing alcohol consumption. Further refinements and validation of the scale in larger samples and across different DBCIs are needed.

Small Social Incentives Did Not Improve the Survey Response Rate of Patients Who Underwent Orthopaedic Surgery: A Randomized Trial

BACKGROUND

The generalizability of data derived from patient-reported outcome measures (PROMs) depends largely on the proportion of the relevant population that completes PROM surveys. However, PROM survey responses remain low, despite efforts to increase participation. Social incentives, such as the offer to make a charitable donation on behalf of the survey respondent, have generally not been effective where online surveys are concerned, but this has not been extensively tested in medicine.

QUESTIONS/PURPOSES

(1) Do personalized social incentives increase response rates or response completeness for postoperative PROM surveys in an orthopaedic population? (2) Are there demographic factors associated with response and nonresponse to postoperative PROM surveys? (3) Are some demographic factors associated with increased response to social incentive offers?

METHODS

Participants were selected from an institutional orthopaedics database. Patients were older than 18 years, had an email address on file, and had undergone one of the following procedures 1 to 2 years ago: Achilles tendon repair, ACL reconstruction, meniscectomy, hip arthroscopy, TKA, or THA. Of 4685 eligible patients, 3000 (64%) were randomly selected for inclusion in the study. Participants were randomized to one of four groups: (1) control: no incentive (n = 750); (2) patient donation: offer of a USD 5 donation to provide medical supplies to a pediatric orthopaedic patient (n = 751); (3) research donation: offer of a USD 5 donation to a procedure-specific research program (n = 749); or (4) explanation: explanation that response supports quality improvement (n = 750). The four groups did not differ regarding patient age, gender, race, procedure type, or time since procedure. All patients were sent an email invitation with the same PROM survey link. The proportion of patients who responded (defined here as the response rate) was measured at 4 weeks and compared between intervention groups. We used a logistic regression analysis to identify demographic factors associated with response while controlling for confounding variables and performed subgroup analyses to determine any demographic factors associated with increased response to social incentives.

RESULTS

There was no difference in the overall response rate (research donation: 49% [353 of 725], patient donation: 45% [333 of 734], control: 45% [322 of 723], explanation: 44% [314 of 719]; p = 0.239) or response completeness (research donation: 89% [315 of 353], patient donation: 90% [301 of 333], control: 89% [287 of 322], explanation: 87% [274 of 314]; p = 0.647) between the four groups. Women (odds ratio [OR], 1.175; p = 0.042), older patients (< 58 years: OR, 1.016 per 1-year increase; p = 0.001; 58-64 years: OR, 1.023 per 1-year increase; p < 0.001; > 64 years: OR, 1.021 per 1-year increase; p < 0.001), and white patients (OR 2.034 compared with black patients, p < 0.001) were slightly more likely to respond, after controlling for potential confounding variables such as gender, age, race, and procedure type. In subgroup analyses, men (research donation: 49% [155 of 316], patient donation: 45% [146 of 328], control: 40% [130 of 325], explanation: 39% [127 of 325]; p = 0.041) and patients younger than 58 years (research donation: 40% [140 of 351], control: 35% [130 of 371], patient donation: 32% [113 of 357], explanation: 27% [93 of 340]; p = 0.004) were slightly more likely to respond to the research donation than those with other interventions were.

CONCLUSIONS

Despite small effects in specific subgroups, personalized social incentives did not increase the overall response to postoperative orthopaedic surveys. Novel and targeted strategies will be necessary to reach response thresholds that enable healthcare stakeholders to use PROMs effectively.

LEVEL OF EVIDENCE

Level I, therapeutic study.

Does the addition of a supportive chatbot promote user engagement with a smoking cessation app? An experimental study

OBJECTIVE

The objective of this study was to assess whether a version of the Smoke Free app with a supportive chatbot powered by artificial intelligence (versus a version without the chatbot) led to increased engagement and short-term quit success.

METHODS

Daily or non-daily smokers aged ≥18 years who purchased the 'pro' version of the app and set a quit date were randomly assigned (unequal allocation) to receive the app with or without the chatbot. The outcomes were engagement (i.e. total number of logins over the study period) and self-reported abstinence at a one-month follow-up. Unadjusted and adjusted negative binomial and logistic regression models were fitted to estimate incidence rate ratios (IRRs) and odds ratios (ORs) for the associations of interest.

RESULTS

A total of 57,214 smokers were included (intervention: 9.3% (5339); control: 90.7% (51,875). The app with the chatbot compared with the standard version led to a 101% increase in engagement (IRRadj = 2.01, 95% confidence interval (CI) = 1.92-2.11, p < .001). The one-month follow-up rate was 10.6% (intervention: 19.9% (1,061/5,339); control: 9.7% (5,050/51,875). Smokers allocated to the intervention had greater odds of quit success (missing equals smoking: 844/5,339 vs. 3,704/51,875, ORadj = 2.38, 95% CI = 2.19-2.58, p < .001; follow-up only: 844/1,061 vs. 3,704/5,050, ORadj = 1.36, 95% CI = 1.16-1.61, p < .001).

CONCLUSION

The addition of a supportive chatbot to a popular smoking cessation app more than doubled user engagement. In view of very low follow-up rates, there is low quality evidence that the addition also increased self-reported smoking cessation.

A Web-Based Intervention for Relatives of People Experiencing Psychosis or Bipolar Disorder: Design Study Using a User-Centered Approach

BACKGROUND

Relatives of people experiencing bipolar mood episodes or psychosis face a multitude of challenges (eg, social isolation, limited coping strategies, and issues with maintaining relationships). Despite this, there is limited informational and emotional support for people who find themselves in supporting or caring roles. Digital technologies provide us with an opportunity to offer accessible tools, which can be used flexibly to provide evidence-based information and support, allowing relatives to build their understanding of mental health problems and learn from others who have similar experiences. However, to design tools that are useful to relatives, we first need to understand their needs.

OBJECTIVE

The aim of this study was to use a user-centered design approach to develop an accessible Web-based intervention, based on the Relatives Education And Coping Toolkit (REACT) booklet, to support the informational and emotional needs of relatives of people experiencing psychosis or bipolar disorder.

METHODS

We engaged relatives of people with experiences of bipolar disorder or psychosis in workshops to identify their needs and design requirements for developing a Web-based version of a paper-based toolkit. We used a 2-phase qualitative approach to explore relatives' views on content, design, and functionalities, which are considered to be engaging and useful in a Web-based intervention. In phase 1, we consulted 24 relatives in 2 workshops to better understand their existing support infrastructure, their barriers for accessing support, unmet needs, and relatives' views on online support. On the basis of the results of these workshops, we developed a set of design considerations to be explored in a smaller workshop. Workshop 3 then involved working with 2 digitally literate relatives to design a usable and acceptable interface for our Web-based toolkit. Finally, in phase 2, we conducted a heuristic evaluation to assess the usability of the toolkit.

RESULTS

Our findings indicated that relatives require technologies that (1) they can place their trust in, particularly when discussing a highly sensitive topic, (2) enable learning from the lived experiences of others while retaining confidentiality, and (3) they can work through at their own pace in a personalized manner.

CONCLUSIONS

Our study highlights the need for providing a trustworthy, supportive tool where relatives can engage with people who have similar experiences to their own. Our heuristic evaluation showed promise in terms of perceived usability of the REACT Web-based intervention. Through this work, we emphasize the need to involve stakeholders with various characteristics, including users with limited computer literacy or experience in online support.

A multicentre, randomised controlled trial of position during the late stages of labour in nulliparous women with an epidural: clinical effectiveness and an economic evaluation (BUMPES)

BACKGROUND

Epidural analgesia leads to increased risk of instrumental vaginal delivery (IVD). There is debate about whether or not posture in second-stage labour influences the incidence of spontaneous vaginal birth (SVB).

OBJECTIVES

In nulliparous women with epidural analgesia, does a policy of adopting an 'upright position' throughout second-stage labour increase the incidence of SVB compared with a policy of adopting a 'lying-down' position?

DESIGN

Two-arm randomised controlled trial.

SETTING

Maternity units in England and Wales.

PARTICIPANTS

Nulliparous women aged ≥ 16 years, at ≥ 37 weeks' gestation with singleton cephalic presentation and intended SVB, in second-stage labour with an epidural providing effective pain relief.

INTERVENTIONS

(1) Upright position to maintain the pelvis in as vertical a plane as possible; and (2) lying-down position to maintain the pelvis in as horizontal a plane as possible.

MAIN OUTCOME MEASURES

The primary outcome measure was incidence of SVB. Secondary outcomes included augmentation, interventions to maintain blood pressure, duration of labour, episiotomy, genital tract trauma, post-partum haemorrhage, maternal satisfaction, neonatal metabolic acidosis, 5-minute Apgar score of < 4, resuscitation at birth and admission to neonatal unit. At 1 year for (1) women: urinary or faecal incontinence, dyspareunia and health-related quality of life; (2) for infants: major morbidity. A cost-consequences analysis with a time horizon of 1 year after the birth from a NHS perspective.

RESULTS

Between October 2010 and January 2014, 3236 women were randomised from 41 centres in England and Wales. There was a statistically significant difference in the incidence of SVB between groups, with 35.2% of women achieving a SVB in the upright group, compared with 41.1% in the lying-down group (adjusted risk ratio 0.86, 95% confidence interval 0.78 to 0.94). There was no evidence of differences in most of the secondary maternal or neonatal outcomes, or in long-term outcomes at the 12-month follow-up. No significant overall cost differences were observed between upright and lying-down positions for mothers or their babies.

LIMITATIONS

Measurement of adherence was challenging in this unmasked trial, and adherence could be influenced by midwives' beliefs about the allocated positions. If adherence was poor, this would have diluted the difference between the two groups.

CONCLUSIONS

There is clear evidence of the benefit of adopting a lying-down position in second-stage labour in nulliparous women with epidural analgesia, with no apparent disadvantages in either short- or long-term outcomes for mother or baby, and this is cost neutral for the NHS.

FUTURE WORK

Questions remain about whether or not other positions could increase the incidence of SVB further in this group of women. The results also raise questions about the role of maternal position in second-stage labour in women without an epidural.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN35706297.

FUNDING

This project was funded by the National Institute for Health Research Health Technology Assessment programme and will be published in Health Technology Assessment, Vol 21, No. 65. See the NIHR Journals Library website for further project information.

The Men's Safer Sex project: intervention development and feasibility randomised controlled trial of an interactive digital intervention to increase condom use in men

BACKGROUND

This report details the development of the Men's Safer Sex website and the results of a feasibility randomised controlled trial (RCT), health economic assessment and qualitative evaluation.

OBJECTIVES

(1) Develop the Men's Safer Sex website to address barriers to condom use; (2) determine the best design for an online RCT; (3) inform the methods for collecting and analysing health economic data; (4) assess the Sexual Quality of Life (SQoL) questionnaire and European Quality of Life-5 Dimensions, three-level version (EQ-5D-3L) to calculate quality-adjusted life-years (QALYs); and (5) explore clinic staff and men's views of online research methodology.

METHODS

(1) Website development: we combined evidence from research literature and the views of experts (n = 18) and male clinic users (n = 43); (2) feasibility RCT: 159 heterosexually active men were recruited from three sexual health clinics and were randomised by computer to the Men's Safer Sex website plus usual care (n = 84) or usual clinic care only (n = 75). Men were invited to complete online questionnaires at 3, 6, 9 and 12 months, and sexually transmitted infection (STI) diagnoses were recorded from clinic notes at 12 months; (3) health economic evaluation: we investigated the impact of using different questionnaires to calculate utilities and QALYs (the EQ-5D-3L and SQoL questionnaire), and compared different methods to collect resource use; and (4) qualitative evaluation: thematic analysis of interviews with 11 male trial participants and nine clinic staff, as well as free-text comments from online outcome questionnaires.

RESULTS

(1) Software errors and clinic Wi-Fi access presented significant challenges. Response rates for online questionnaires were poor but improved with larger vouchers (from 36% with £10 to 50% with £30). Clinical records were located for 94% of participants for STI diagnoses. There were no group differences in condomless sex with female partners [incidence rate ratio (IRR) 1.01, 95% confidence interval (CI) 0.52 to 1.96]. New STI diagnoses were recorded for 8.8% (7/80) of the intervention group and 13.0% (9/69) of the control group (IRR 0.75, 95% CI 0.29 to 1.89). (2) Health-care resource data were more complete using patient files than questionnaires. The probability that the intervention is cost-effective is sensitive to the source of data used and whether or not data on intended pregnancies are included. (3) The pilot RCT fitted well around clinical activities but 37% of the intervention group did not see the Men's Safer Sex website and technical problems were frustrating. Men's views of the Men's Safer Sex website and research procedures were largely positive.

CONCLUSIONS

It would be feasible to conduct a large-scale RCT using clinic STI diagnoses as a primary outcome; however, technical errors and a poor response rate limited the collection of online self-reported outcomes. The next steps are (1) to optimise software for online trials, (2) to find the best ways to integrate digital health promotion with clinical services, (3) to develop more precise methods for collecting resource use data and (4) to work out how to overcome barriers to digital intervention testing and implementation in the NHS.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN18649610.

FUNDING

This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 20, No. 91. See the NIHR Journals Library website for further project information.

Using Self-affirmation to Increase the Effects of Emotive Health Warnings on Smoking: A Randomized Exploratory Trial

Introduction

Emotive health messages are widely used tools in tobacco control. However, under some circumstances, they can be less effective than desired by eliciting defensive responses in smokers.

Aims

This study tests whether enhancing a currently used emotive graphic smoking health warning with a self-affirmation component reduces cigarette consumption and whether potential effects are stronger in heavier smokers, as suggested by previous research.

Methods

Participants (n = 265) were randomly allocated to a self-affirmation (reflecting on personal values and positive traits using a questionnaire) or matched control condition before viewing an emotive graphic health message from a current Australian government public health campaign. The primary outcome (cigarettes per day [CPD]) was assessed both before and a week following the intervention.

Results

No main effect of self-affirmation on smoking, but as hypothesized, a significant interaction between baseline smoking and self-affirmation was found that showed that heavier smokers (>21 CPD) who self-affirmed significantly reduced CPD compared to nonaffirmed smokers.

Conclusions

These findings support the use of self-affirmation to enhance smoking awareness campaigns in heavier smokers.

Implications

This study shows that enhancing emotive graphic smoking health messages with self-affirmation (the act of reflecting on positive aspects of oneself) increases their effectiveness in heavier smokers. This suggests that self-affirmation might be a particularly useful tool for health promotion targeting heavier smokers. This study adds to previous research in that it is the first to test the add-on effects of self-affirmation to current graphic health messages on smoking rather than smoking-related cognitions.

Attrition from Web-Based Cognitive Testing: A Repeated Measures Comparison of Gamification Techniques

BACKGROUND

The prospect of assessing cognition longitudinally and remotely is attractive to researchers, health practitioners, and pharmaceutical companies alike. However, such repeated testing regimes place a considerable burden on participants, and with cognitive tasks typically being regarded as effortful and unengaging, these studies may experience high levels of participant attrition. One potential solution is to gamify these tasks to make them more engaging: increasing participant willingness to take part and reducing attrition. However, such an approach must balance task validity with the introduction of entertaining gamelike elements.

OBJECTIVE

This study aims to investigate the effects of gamelike features on participant attrition using a between-subjects, longitudinal Web-based testing study.

METHODS

We used three variants of a common cognitive task, the Stop Signal Task (SST), with a single gamelike feature in each: one variant where points were rewarded for performing optimally; another where the task was given a graphical theme; and a third variant, which was a standard SST and served as a control condition. Participants completed four compulsory test sessions over 4 consecutive days before entering a 6-day voluntary testing period where they faced a daily decision to either drop out or continue taking part. Participants were paid for each session they completed.

RESULTS

A total of 482 participants signed up to take part in the study, with 265 completing the requisite four consecutive test sessions. No evidence of an effect of gamification on attrition was observed. A log-rank test showed no evidence of a difference in dropout rates between task variants (χ22=3.0, P=.22), and a one-way analysis of variance of the mean number of sessions completed per participant in each variant also showed no evidence of a difference (F2,262=1.534, P=.21, partial η2=0.012).

CONCLUSIONS

Our findings raise doubts about the ability of gamification to reduce attrition from longitudinal cognitive testing studies.

The marketing plan and outcome indicators for recruiting and retaining parents in the HomeStyles randomized controlled trial

Background

Despite the critical importance of successful recruitment and retention to study integrity, reporting of recruitment and retention strategies along with factors associated with successful recruitment and retention of participants in health-related interventions remain rare, especially for health and obesity prevention programs. Thus, the purpose of this article is to retrospectively examine the recruitment and retention marketing plan used in the online HomeStyles randomized controlled trial (RCT) and discuss outcomes associated with completion of the intervention.

Methods

The HomeStyles RCT is an online intervention developed to motivate parents of young children to gain the skills and self-confidence needed to shape home environments and lifestyles to be protective against childhood obesity. Using the seven Ps of services marketing (i.e., people, place, product, physical evidence, price, promotion, and process), a comprehensive and systematic plan for recruitment and retention was implemented and outcomes assessed.

Results

A total of 489 parents with a young child aged 2 to < 6 years were eligible to participate, a final capture rate of 33%. Only 23% of Hispanic participants chose to use the Spanish-language version of HomeStyles intervention materials, below the demand anticipated. However, Hispanic enrollment overall was substantially higher than the U.S. population proportion (i.e., 17%). The number of participants prematurely leaving the study was similar in both treatment groups, indicating attrition was not differential. Completers reported high satisfaction of HomeStyles, using a 1–5 scale (strongly disagree to strongly agree) on guide attractiveness, interestingness, and usefulness. Despite all the retention efforts, the average monthly recruitment accrual rate of ~ 33 eligible enrolled participants at baseline (i.e., 489 participants/15-month recruitment period), declined to ~ 18, 11, 9, and 8 remaining recruited participants/month at midpoint, post, follow-up, and long-term follow-up surveys, respectively. In general, survey completers were significantly more likely to be female and perceived their child’s health status to be better, and they were significantly less likely to be restrictive of their child’s food intake.

Conclusions

The findings of the present study highlight the need for far-reaching, concentrated, and varied recruitment strategies; sufficient time in the research plan for recruitment and retention activities; and creative, tireless, flexible, persistent project staff for health-related interventions.

Identifying additional studies for a systematic review of retention strategies in randomised controlled trials: making contact with trials units and trial methodologists

BACKGROUND

Search strategies for systematic reviews aim to identify all evidence relevant to the research question posed. Reports of methodological research can be difficult to find leading to biased results in systematic reviews of research methodology. Evidence suggests that contact with investigators can help to identify unpublished research. To identify additional eligible randomised controlled trials (RCTs) for a Cochrane systematic review of strategies to improve retention in RCTs, we conducted a survey of UK clinical trials units (CTUs) and made contact with RCT methodologists.

METHODS

Key contacts for all UK CTUs were sent a personalised email with a short questionnaire and summary protocol of the Cochrane methodology review. The questionnaire asked whether a RCT evaluating strategies to improve retention embedded in a RCT had ever been conducted by the CTU. Questions about the stage of completion and publication of such RCTs were included. The summary protocol outlined the aims, eligibility criteria, examples of types of retention strategies, and the primary outcome for the systematic review. Personal communication with RCT methodologists and presentations of preliminary results of the review at conferences were also used to identify additional eligible RCTs. We checked the results of our standard searches to see if eligible studies identified through these additional methods were also found using our standard searches.

RESULTS

We identified 14 of the 38 RCTs included in the Cochrane methodology review by contacting trials units and methodologists. Eleven of the 14 RCTs identified by these methods were either published in grey literature, in press or unpublished. Three remaining RCTs were fully published at the time. Six of the RCTs identified were not found through any other searches. The RCTs identified represented data for 6 of 14 RCTs of incentive strategies (52% of randomised participants included in the review), and 6 of 14 RCTs of communication strategies (52% of randomised participants included in the Cochrane review). Data were unavailable for two of the RCTs identified.

CONCLUSIONS

Methodological evaluations embedded in RCTs may be unpublished, published in the grey literature or where published, poorly indexed in bibliographic databases. To identify such studies and minimise selection bias in systematic reviews of methodological evaluations, reviewers should consider contacting CTUs and trial methodologists.

Feasibility of a UK community-based, eTherapy mental health service in Greater Manchester: repeated-measures and between-groups study of 'Living Life to the Full Interactive', 'Sleepio' and 'Breaking Free Online' at 'Self Help Services'

OBJECTIVES

There is increasing evidence to support the effectiveness of eTherapies for mental health, although limited data have been reported from community-based services. Therefore, this service evaluation reports on feasibility and outcomes from an eTherapy mental health service.

SETTING

'Self Help Services', an Increasing Access to Psychological Therapies (IAPT) eTherapy service in Greater Manchester.

PARTICIPANTS

1068 service users referred to the service for secondary care for their mental health difficulties.

INTERVENTIONS

Participants were triaged into one of three eTherapy programmes: 'Living Life to the Full Interactive' for low mood, stress and anxiety; 'Sleepio' for insomnia; and 'Breaking Free Online' for substance misuse, depending on clinical need.

PRIMARY OUTCOMES MEASURES

Standardised psychometric assessments of depression, anxiety and social functioning, collected as part of the IAPT Minimum Data Set, were conducted at baseline and post-treatment.

RESULTS

Data indicated baseline differences, with the Breaking Free Online group having higher scores for depression and anxiety than the Living Life to the Full Interactive (depression CI 1.27 to 3.21, p<0.0001; anxiety CI 077 to 1.72, p<0.0001) and Sleepio (depression CI 1.19 to 4.52, p<0.0001; anxiety CI 2.16 to 5.23, p<0.0001) groups. Promising improvements in mental health scores were found within all three groups (all p<0.0001), as were significant reductions in numbers of service users reaching clinical threshold scores for mental health difficulties (p<0.0001). Number of days of engagement was not related to change from baseline for the Living Life to the Full or Sleepio programmes but was associated with degree of change for Breaking Free Online.

CONCLUSION

Data presented provide evidence for feasibility of this eTherapy delivery model in supporting service users with a range of mental health difficulties and suggest that eTherapies may be a useful addition to treatment offering in community-based services.

Protocol for an online randomised controlled trial to evaluate the clinical and cost-effectiveness of a peer-supported self-management intervention for relatives of people with psychosis or bipolar disorder: Relatives Education And Coping Toolkit (REACT)

INTRODUCTION

Despite clinical guidelines recommendations, many relatives of people with psychosis or bipolar disorder do not currently receive the support they need. Online information and support may offer a solution.

METHODS AND ANALYSIS

This single-blind, parallel, online randomised controlled trial will determine clinical and cost-effectiveness of the Relatives Education And Coping Toolkit (REACT) (including an online resource directory (RD)), compared with RD only, for relatives of people with psychosis or bipolar disorder. Both groups continue to receive treatment as usual. Independent, web-based variable, block, individual randomisation will be used across 666 relatives. Primary outcome is distress at 24 weeks (measured by General Health Questionnaire; GHQ-28) compared between groups using analysis of covariance, adjusting for baseline score. Secondary clinical outcomes are carer well-being and support. Cost-effectiveness analysis will determine cost of a significant unit change (three-point reduction) in the GHQ-28. Costs include offering and supporting the intervention in the REACT arm, relevant healthcare care costs including health professional contacts, medications prescribed and time off (or ability to) work for the relative. Cost utility analysis will be calculated as the marginal cost of changes in quality-adjusted life years, based on EuroQol. We will explore relatives' beliefs, perceived coping and amount of REACT toolkit use as possible outcome mediators. We have embedded two methodological substudies in the protocol to determine the relative effectiveness of a low-value (£10) versus higher value (£20) incentive, and an unconditional versus conditional incentive, on improving follow-up rates.

ETHICS AND DISSEMINATION

The trial has ethical approval from Lancaster National Research Ethics Service (NRES)Committee (15/NW/0732) and is overseen by an independent Data Monitoring and Ethics Committee and Trial Steering Committee. Protocol version 1.5 was approved on 9 January 2017. All updates to protocols are uploaded to the National Institute for Health Research (NIHR) Journals Library. A full statistical analysis plan is available at https://figshare.com/account/home#/projects/19975. Publications will be in peer-reviewed journals (open access wherever possible). Requests for access to the data at the end of the study will be reviewed and granted where appropriate by the Trial Management Group.

TRIAL REGISTRATION NUMBER

ISRCTN72019945, pre-results.

Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis

"Engagement" with digital behaviour change interventions (DBCIs) is considered important for their effectiveness. Evaluating engagement is therefore a priority; however, a shared understanding of how to usefully conceptualise engagement is lacking. This review aimed to synthesise literature on engagement to identify key conceptualisations and to develop an integrative conceptual framework involving potential direct and indirect influences on engagement and relationships between engagement and intervention effectiveness. Four electronic databases (Ovid MEDLINE, PsycINFO, ISI Web of Knowledge, ScienceDirect) were searched in November 2015. We identified 117 articles that met the inclusion criteria: studies employing experimental or non-experimental designs with adult participants explicitly or implicitly referring to engagement with DBCIs, digital games or technology. Data were synthesised using principles from critical interpretive synthesis. Engagement with DBCIs is conceptualised in terms of both experiential and behavioural aspects. A conceptual framework is proposed in which engagement with a DBCI is influenced by the DBCI itself (content and delivery), the context (the setting in which the DBCI is used and the population using it) and the behaviour that the DBCI is targeting. The context and "mechanisms of action" may moderate the influence of the DBCI on engagement. Engagement, in turn, moderates the influence of the DBCI on those mechanisms of action. In the research literature, engagement with DBCIs has been conceptualised in terms of both experience and behaviour and sits within a complex system involving the DBCI, the context of use, the mechanisms of action of the DBCI and the target behaviour.

Best practice guidance for the use of strategies to improve retention in randomized trials developed from two consensus workshops

Objectives

To develop best practice guidance for the use of retention strategies in randomized clinical trials (RCTs).

Study Design and Setting

Consensus development workshops conducted at two UK Clinical Trials Units. Sixty-six statisticians, clinicians, RCT coordinators, research scientists, research assistants, and data managers associated with RCTs participated. The consensus development workshops were based on the consensus development conference method used to develop best practice for treatment of medical conditions. Workshops commenced with a presentation of the evidence for incentives, communication, questionnaire format, behavioral, case management, and methodological retention strategies identified by a Cochrane review and associated qualitative study. Three simultaneous group discussions followed focused on (1) how convinced the workshop participants were by the evidence for retention strategies, (2) barriers to the use of effective retention strategies, (3) types of RCT follow-up that retention strategies could be used for, and (4) strategies for future research. Summaries of each group discussion were fed back to the workshop. Coded content for both workshops was compared for agreement and disagreement. Agreed consensus on best practice guidance for retention was identified.

Results

Workshop participants agreed best practice guidance for the use of small financial incentives to improve response to postal questionnaires in RCTs. Use of second-class post was thought to be adequate for postal communication with RCT participants. The most relevant validated questionnaire was considered best practice for collecting RCT data. Barriers identified for the use of effective retention strategies were: the small improvements seen in questionnaire response for the addition of monetary incentives, and perceptions among trialists that some communication strategies are outdated. Furthermore, there was resistance to change existing retention practices thought to be effective. Face-to-face and electronic follow-up technologies were identified as retention strategies for further research.

Conclusions

We developed best practice guidance for the use of retention strategies in RCTs and identified potential barriers to the use of effective strategies. The extent of agreement on best practice is limited by the variability in the currently available evidence. This guidance will need updating as new retention strategies are developed and evaluated.

Increasing response rates to follow-up questionnaires in health intervention research: Randomized controlled trial of a gift card prize incentive

Background/aims Achieving a high response rate to follow-up questionnaires in randomized controlled trials of interventions is important for study validity. Few studies have tested the value of incentives in increasing response rates to online questionnaires in clinical trials of health interventions. This study evaluated the effect of a gift card prize-draw incentive on response rates to follow-up questionnaires within a trial of an online health intervention. Method The study was embedded in a host randomized controlled trial of an online parenting program for child anxiety. A total of 433 participants were randomly allocated to one of two groups: (1) being informed that they would enter a gift card prize-draw if they completed the final study questionnaire (24-week follow-up) and (2) not informed about the prize-draw. All participants had a 1 in 20 chance of winning an AUD50 gift card after they completed the online questionnaire. Results The odds of the informed group completing the follow-up questionnaire were significantly higher than the uninformed group, (79.6% vs 68.5%, odds ratio = 1.79, 95% confidence interval = 1.15-2.79). This response rate increase of 11.1% (95% confidence interval = 2.8-19.1) occurred in both intervention and control groups in the host randomized controlled trial. The incentive was also effective in increasing questionnaire commencement (84.6% vs 75.9%, odds ratio = 1.74, 95% confidence interval = 1.07-2.84) and reducing the delay in completing the questionnaire (19.9 vs 22.6 days, hazard ratio = 1.34, 95% confidence interval = 1.07-1.67). Conclusion This study adds to evidence for the effectiveness of incentives to increase response rates to follow-up questionnaires in health intervention trials.

Minimizing Attrition for Multisite Emergency Care Research

Loss to follow-up of enrolled patients (a.k.a. attrition) is a major threat to study validity and power. Minimizing attrition can be challenging even under ideal research conditions, including the presence of adequate funding, experienced study personnel, and a refined research infrastructure. Emergency care research is shifting toward enrollment through multisite networks, but there have been limited descriptions of approaches to minimize attrition for these multicenter emergency care studies. This concept paper describes a stepwise approach to minimize attrition, using a case example of a multisite emergency department prospective cohort of over 3,000 patients that has achieved a 30-day direct phone follow-up attrition rate of <3%. The seven areas of approach to minimize attrition in this study focused on patient selection, baseline contact data collection, patient incentives, patient tracking, central phone banks, local enrollment site assistance, and continuous performance monitoring. Appropriate study design, including consideration of these methods to reduce attrition, will be time well spent and may improve study validity.

Methods for Evaluating Respondent Attrition in Web-Based Surveys

BACKGROUND

Electronic surveys are convenient, cost effective, and increasingly popular tools for collecting information. While the online platform allows researchers to recruit and enroll more participants, there is an increased risk of participant dropout in Web-based research. Often, these dropout trends are simply reported, adjusted for, or ignored altogether.

OBJECTIVE

To propose a conceptual framework that analyzes respondent attrition and demonstrates the utility of these methods with existing survey data.

METHODS

First, we suggest visualization of attrition trends using bar charts and survival curves. Next, we propose a generalized linear mixed model (GLMM) to detect or confirm significant attrition points. Finally, we suggest applications of existing statistical methods to investigate the effect of internal survey characteristics and patient characteristics on dropout. In order to apply this framework, we conducted a case study; a seventeen-item Informed Decision-Making (IDM) module addressing how and why patients make decisions about cancer screening.

RESULTS

Using the framework, we were able to find significant attrition points at Questions 4, 6, 7, and 9, and were also able to identify participant responses and characteristics associated with dropout at these points and overall.

CONCLUSIONS

When these methods were applied to survey data, significant attrition trends were revealed, both visually and empirically, that can inspire researchers to investigate the factors associated with survey dropout, address whether survey completion is associated with health outcomes, and compare attrition patterns between groups. The framework can be used to extract information beyond simple responses, can be useful during survey development, and can help determine the external validity of survey results.