The DYD-RCT protocol: an on-line randomised controlled trial of an interactive computer-based intervention compared with a standard information website to reduce alcohol consumption among hazardous drinkers

Study protocol for an individually randomized control trial for India's first roleplay-based mobile game for reproductive health for adolescent girls

BACKGROUND

Go Nisha Go™ (GNG), is a mobile game combining behavioural science, human-centric design, game-based learning, and interactive storytelling. The model uses a direct-to-consumer (DTC) approach to deliver information, products, services, interactive learning, and agency-building experiences directly to girls. The game's five episodes focus on issues of menstrual health management, fertility awareness, consent, contraception, and negotiation for delay of marriage and career. The game's effectiveness on indicators linked to these issues will be measured using an encouragement design in a randomized controlled trial (RCT).

METHODS

A two-arm RCT will be conducted in three cities in India: Patna, Jaipur, and Delhi-NCR. The first arm is the treatment (encouragement) arm (n = 975) where the participants will be encouraged to download and play the game, and the second arm (n = 975) where the participants will not receive any nudges/encouragement to play the game. They may or may not have access to the game. After the baseline recruitment, participants will be randomly assigned to these two arms across the three locations. Participants of the treatment/encouragement arm will receive continuous support as part of the encouragement design to adopt, install the game from the Google Play Store at no cost, and play all levels on their Android devices. The encouragement activity will continue for ten weeks, during which participants will receive creative messages via weekly phone calls and WhatsApp messages. We will conduct the follow-up survey with all the participants (n = 1950) from the baseline survey after ten weeks of exposure. We will conduct 60 in-depth qualitative interviews (20 at each location) with a sub-sample of the participants from the encouragement arm to augment the quantitative surveys.

DISCUSSION

Following pre-testing of survey tools for feasibility of methodologies, we will recruit participants, randomize, collect baseline data, execute the encouragement design, and conduct the follow-up survey with eligible adolescents as written in the study protocol. Our study will add insights for the implementation of an encouragement design in RCTs with adolescent girls in the spectrum of game-based learning on sexual and reproductive health in India. Our study will provide evidence to support the outcome evaluation of the digital mobile game app, GNG. To our knowledge this is the first ever outcome evaluation study for a game-based application, and this study is expected to facilitate scalability of a direct-to-consumer approach to improve adolescent sexual and reproductive health outcomes in India.

TRIAL REGISTRATION NUMBER

ctri.nic.in: CTRI/2023/03/050447.

Engagement With Motivational Interviewing and Cognitive Behavioral Therapy Components of a Web-Based Alcohol Intervention, Elicitation of Change Talk and Sustain Talk, and Impact on Drinking Outcomes: Secondary Data Analysis

Background

Down Your Drink (DYD) is a widely used unguided web-based alcohol moderation program for the general public based on cognitive behavioral therapy (CBT) and motivational interviewing (MI); it provides users with many opportunities to enter free-text responses.

Objective

The aim of this study was to assess participants’ use of key CBT and MI components, the presence of change talk and sustain talk within their responses, and whether these data are associated with drinking outcomes after 3 months.

Methods

An exploratory secondary data analysis was conducted on data collected in 2008 from the definitive randomized trial of DYD (N=503). Past week alcohol use at baseline and 3-month follow-up were measured with the TOT-AL. Covariates included baseline alcohol use, age, gender, education level, and word count of the responses. Use of MI and CBT components and presence of change talk and sustain talk were coded by two independent coders (Cohen κ range 0.91-1). Linear model regressions on the subsample of active users (n=410) are presented along with a negative binomial regression.

Results

The most commonly used component was the listing of pros and cons of drinking. The number of listed high-risk situations was associated with lower alcohol use at 3-month follow-up (B_adj −2.15, 95% CI −3.92 to −0.38, P=.02). Findings on the effects of the percentage of change talk and the number of listed strategies to deal with high-risk situations were inconsistent.

Conclusions

An unguided web-based alcohol moderation program can elicit change talk and sustain talk. This secondary analysis suggests that the number of listed high-risk situations can predict alcohol use at 3-month follow-up. Other components show inconsistent findings and should be studied further.

Validation of the AUDIT-C in adults seeking help with their drinking online

BACKGROUND

The abbreviated Alcohol Use Disorder Identification Test for Consumption (AUDIT-C) is rapidly becoming the alcohol screening tool of choice for busy practitioners in clinical settings and by researchers keen to limit assessment burden and reactivity. Cut-off scores for detecting drinking above recommended limits vary by population, setting, country and potentially format. This validation study aimed to determine AUDIT-C thresholds that indicated risky drinking among a population of people seeking help over the Internet.

METHOD

The data in this study were collected in the pilot phase of the Down Your Drink trial, which recruited people seeking help over the Internet and randomised them to a web-based intervention or an information-only website. Sensitivity, specificity, and positive and negative likelihood ratios were calculated for AUDIT-C scores, relative to weekly consumption that indicated drinking above limits and higher risk drinking. Receiver-operating characteristic (ROC) curves were created to assess the performance of different cut-off scores on the AUDIT-C for men and women. Past week alcohol consumption was used as the reference-standard and was collected via the TOT-AL, a validated online measure of past week drinking.

RESULTS

AUDIT-C scores were obtained from 3720 adults (2053 female and 1667 male) searching the internet for help with drinking, mostly from the UK. The area under the ROC curve for risky drinking was 0.84 (95% CI 0.80, 0.87) (female) and 0.80 (95% CI 0.76, 0.84) (male). AUDIT-C cut-off scores for detecting risky drinking that maximise the sum of sensitivity and specificity were ≥8 for women and ≥8 for men; whereas those identifying the highest proportion of correctly classified individuals were ≥4 for women and ≥5 for men. AUDIT-C cut-off scores for detecting higher risk drinking were also calculated.

CONCLUSIONS

AUDIT-C cut-off scores for identifying alcohol consumption above weekly limits in this largely UK based study population were substantially higher than those reported in other validation studies. Researchers and practitioners should select AUDIT-C cut-off scores according to the purpose of identifying risky drinkers and hence the relative importance of sensitivity and/or specificity.

Pragmatic design in randomized controlled trials

At more than 10 years after the paper by Hotopf and colleagues regarding pragmatic trials in psychiatry, the field has evolved and is evolving further. There have been many developments in our understanding of what pragmatism really means, and excellent examples of truly pragmatic trials in psychiatry are currently available. Funders have helped encourage more emphasis on the need for such studies, but 'local' and trans-national regulations could help more. Consumers of the evidence should have a greater voice in generating the research agenda and, as this happens, the questions generated are more likely to be answered by a pragmatic approach to trials.

Strategies to improve retention in randomised trials

BACKGROUND

Loss to follow-up from randomised trials can introduce bias and reduce study power, affecting the generalisability, validity and reliability of results. Many strategies are used to reduce loss to follow-up and improve retention but few have been formally evaluated.

OBJECTIVES

To quantify the effect of strategies to improve retention on the proportion of participants retained in randomised trials and to investigate if the effect varied by trial strategy and trial setting.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, PreMEDLINE, EMBASE, PsycINFO, DARE, CINAHL, Campbell Collaboration's Social, Psychological, Educational and Criminological Trials Register, and ERIC. We handsearched conference proceedings and publication reference lists for eligible retention trials. We also surveyed all UK Clinical Trials Units to identify further studies.

SELECTION CRITERIA

We included eligible retention trials of randomised or quasi-randomised evaluations of strategies to increase retention that were embedded in 'host' randomised trials from all disease areas and healthcare settings. We excluded studies aiming to increase treatment compliance.

DATA COLLECTION AND ANALYSIS

We contacted authors to supplement or confirm data that we had extracted. For retention trials, we recorded data on the method of randomisation, type of strategy evaluated, comparator, primary outcome, planned sample size, numbers randomised and numbers retained. We used risk ratios (RR) to evaluate the effectiveness of the addition of strategies to improve retention. We assessed heterogeneity between trials using the Chi(2) and I(2) statistics. For main trials that hosted retention trials, we extracted data on disease area, intervention, population, healthcare setting, sequence generation and allocation concealment.

MAIN RESULTS

We identified 38 eligible retention trials. Included trials evaluated six broad types of strategies to improve retention. These were incentives, communication strategies, new questionnaire format, participant case management, behavioural and methodological interventions. For 34 of the included trials, retention was response to postal and electronic questionnaires with or without medical test kits. For four trials, retention was the number of participants remaining in the trial. Included trials were conducted across a spectrum of disease areas, countries, healthcare and community settings. Strategies that improved trial retention were addition of monetary incentives compared with no incentive for return of trial-related postal questionnaires (RR 1.18; 95% CI 1.09 to 1.28, P value < 0.0001), addition of an offer of monetary incentive compared with no offer for return of electronic questionnaires (RR 1.25; 95% CI 1.14 to 1.38, P value < 0.00001) and an offer of a GBP20 voucher compared with GBP10 for return of postal questionnaires and biomedical test kits (RR 1.12; 95% CI 1.04 to 1.22, P value < 0.005). The evidence that shorter questionnaires are better than longer questionnaires was unclear (RR 1.04; 95% CI 1.00 to 1.08, P value = 0.07) and the evidence for questionnaires relevant to the disease/condition was also unclear (RR 1.07; 95% CI 1.01 to 1.14). Although each was based on the results of a single trial, recorded delivery of questionnaires seemed to be more effective than telephone reminders (RR 2.08; 95% CI 1.11 to 3.87, P value = 0.02) and a 'package' of postal communication strategies with reminder letters appeared to be better than standard procedures (RR 1.43; 95% CI 1.22 to 1.67, P value < 0.0001). An open trial design also appeared more effective than a blind trial design for return of questionnaires in one fracture prevention trial (RR 1.37; 95% CI 1.16 to 1.63, P value = 0.0003).There was no good evidence that the addition of a non-monetary incentive, an offer of a non-monetary incentive, 'enhanced' letters, letters delivered by priority post, additional reminders, or questionnaire question order either increased or decreased trial questionnaire response/retention. There was also no evidence that a telephone survey was either more or less effective than a monetary incentive and a questionnaire. As our analyses are based on single trials, the effect on questionnaire response of using offers of charity donations, sending reminders to trial sites and when a questionnaire is sent, may need further evaluation. Case management and behavioural strategies used for trial retention may also warrant further evaluation.

AUTHORS' CONCLUSIONS

Most of the retention trials that we identified evaluated questionnaire response. There were few evaluations of ways to improve participants returning to trial sites for trial follow-up. Monetary incentives and offers of monetary incentives increased postal and electronic questionnaire response. Some other strategies evaluated in single trials looked promising but need further evaluation. Application of the findings of this review would depend on trial setting, population, disease area, data collection and follow-up procedures.

Alcohol assessment & feedback by e-mail for university student hazardous and harmful drinkers: study protocol for the AMADEUS-2 randomised controlled trial

BACKGROUND

Alcohol is responsible for a large and growing proportion of the global burden of disease, as well as being the cause of social problems. Brief interventions are one component of comprehensive policy measures necessary to reduce these harms. Brief interventions increasingly take advantage of the Internet to reach large numbers of high risk groups such as students. The research literature on the efficacy and effectiveness of online interventions is developing rapidly. Although many studies show benefits in the form of reduced consumption, other intervention studies show no effects, for reasons that are unclear. Sweden became the first country in the world to implement a national system in which all university students are offered a brief online intervention via an e-mail.

METHODS/DESIGN

This randomized controlled trial (RCT) aims to evaluate the effectiveness of this national system comprising a brief online intervention among university students who are hazardous and harmful drinkers. This study employs a conventional RCT design in which screening to determine eligibility precedes random allocation to immediate or delayed access to online intervention. The online intervention evaluated comprises three main components; assessment, normative feedback and advice on reducing drinking. Screening is confined to a single question in order to minimise assessment reactivity and to prevent contamination. Outcomes will be evaluated after 2 months, with total weekly alcohol consumption being the primary outcome measure. Invitations to participate are provided by e-mail to approximately 55,000 students in 9 Swedish universities.

DISCUSSION

This RCT evaluates routine service provision in Swedish universities via a delay in offer of intervention to the control group. It evaluates effects in the key population for whom this intervention has been designed. Study findings will inform the further development of the national service provision.

TRIAL REGISTRATION

ISRCTN02335307.

Quality of life among hazardous and harmful drinkers: EQ-5D over a 1-year follow-up period

PURPOSE

To investigate the ability of the EQ-5D to discriminate between levels of alcohol risk in a large sample of hazardous and harmful drinkers, and to explore the relationship between transitions between alcohol risk levels and changes in EQ-5D up to 12 months.

METHODS

This is a web-based randomised controlled trial evaluating a novel intervention for hazardous and harmful alcohol consumption. EQ-5D scores were compared among groups of drinkers at baseline (low/medium/high risk according to self-reported past week alcohol consumption), and changes in EQ-5D scores were estimated as a function of changes in alcohol consumption level.

RESULTS

Baseline EQ-5D scores were dominated by problems with anxiety/depression, which increased with alcohol risk level, whilst high-risk drinkers also experienced more problems with physical HRQoL dimensions. However, the tool demonstrated a considerable ceiling effect. At follow-up, despite considerable reductions in alcohol consumption across the sample, significant changes in aggregated EQ-5D index scores were only observed for high-risk drinkers at baseline who reduced their drinking, with small improvements (0.04-0.06) compared to those who did not reduce.

CONCLUSIONS

Our results suggest that the three-option EQ-5D may not be an optimal primary end point for measuring clinical and cost-effectiveness in randomised controlled trials of interventions among hazardous and harmful alcohol users, although further testing of the sensitivity of the tool in these populations is needed.

The effects of combining Web-based eHealth with telephone nurse case management for pediatric asthma control: a randomized controlled trial

Background

Asthma is the most common pediatric illness in the United States, burdening low-income and minority families disproportionately and contributing to high health care costs. Clinic-based asthma education and telephone case management have had mixed results on asthma control, as have eHealth programs and online games.

Objectives

To test the effects of (1) CHESS+CM, a system for parents and children ages 4–12 years with poorly controlled asthma, on asthma control and medication adherence, and (2) competence, self-efficacy, and social support as mediators. CHESS+CM included a fully automated eHealth component (Comprehensive Health Enhancement Support System [CHESS]) plus monthly nurse case management (CM) via phone. CHESS, based on self-determination theory, was designed to improve competence, social support, and intrinsic motivation of parents and children.

Methods

We identified eligible parent–child dyads from files of managed care organizations in Madison and Milwaukee, Wisconsin, USA, sent them recruitment letters, and randomly assigned them (unblinded) to a control group of treatment as usual plus asthma information or to CHESS+CM. Asthma control was measured by the Asthma Control Questionnaire (ACQ) and self-reported symptom-free days. Medication adherence was a composite of pharmacy refill data and medication taking. Social support, information competence, and self-efficacy were self-assessed in questionnaires. All data were collected at 0, 3, 6, 9, and 12 months. Asthma diaries kept during a 3-week run-in period before randomization provided baseline data.

Results

Of 305 parent–child dyads enrolled, 301 were randomly assigned, 153 to the control group and 148 to CHESS+CM. Most parents were female (283/301, 94%), African American (150/301, 49.8%), and had a low income as indicated by child’s Medicaid status (154/301, 51.2%); 146 (48.5%) were single and 96 of 301 (31.9%) had a high school education or less. Completion rates were 127 of 153 control group dyads (83.0%) and 132 of 148 CHESS+CM group dyads (89.2%). CHESS+CM group children had significantly better asthma control on the ACQ (d = –0.31, 95% confidence limits [CL] –0.56, –0.06, P = .011), but not as measured by symptom-free days (d = 0.18, 95% CL –0.88, 1.60, P = 1.00). The composite adherence scores did not differ significantly between groups (d = 1.48%, 95% CL –8.15, 11.11, P = .76). Social support was a significant mediator for CHESS+CM’s effect on asthma control (alpha = .200, P = .01; beta = .210, P = .03). Self-efficacy was not significant (alpha = .080, P = .14; beta = .476, P = .01); neither was information competence (alpha = .079, P = .09; beta = .063, P = .64).

Conclusions

Integrating telephone case management with eHealth benefited pediatric asthma control, though not medication adherence. Improved methods of measuring medication adherence are needed. Social support appears to be more effective than information in improving pediatric asthma control.

Trial Registration

Clinicaltrials.gov NCT00214383; http://clinicaltrials.gov/ct2/show/NCT00214383 (Archived by WebCite at http://www.webcitation.org/68OVwqMPz)

Alcohol email assessment and feedback study dismantling effectiveness for university students (AMADEUS-1): study protocol for a randomized controlled trial

Background

Alcohol causes huge problems for population health and for society, which require interventions with individuals as well as populations to prevent and reduce harms. Brief interventions can be effective and increasingly take advantage of the internet to reach high-risk groups such as students. The research literature on the effectiveness of online interventions is developing rapidly and is confronted by methodological challenges common to other areas of e-health including attrition and assessment reactivity and in the design of control conditions.

Methods/design

The study aim is to evaluate the effectiveness of a brief online intervention, employing a randomized controlled trial (RCT) design that takes account of baseline assessment reactivity, and other possible effects of the research process. Outcomes will be evaluated after 3 months both among student populations as a whole including for a randomized no contact control group and among those who are risky drinkers randomized to brief assessment and feedback (routine practice) or to brief assessment only. A three-arm parallel groups trial will also allow exploration of the magnitude of the feedback and assessment component effects. The trial will be undertaken simultaneously in 2 universities randomizing approximately 15,300 students who will all be blinded to trial participation. All participants will be offered routine practice intervention at the end of the study.

Discussion

This trial informs the development of routine service delivery in Swedish universities and more broadly contributes a new approach to the study of the effectiveness of online interventions in student populations, with relevance to behaviors other than alcohol consumption. The use of blinding and deception in this study raise ethical issues that warrant further attention.

Trial registration

ISRCTN28328154

Costs and difficulties of recruiting patients to provide e-health support: pilot study in one primary care trust

Background

Better use of e-health services by patients could improve outcomes and reduce costs but there are concerns about inequalities of access. Previous research in outpatients suggested that anonymous personal email support may help patients with long term conditions to use e-health, but recruiting earlier in their 'journey' may benefit patients more. This pilot study explored the feasibility and cost of recruiting patients for an e-health intervention in one primary care trust.

Methods

The sample comprised 46 practices with total patient population of 250,000. We approached all practices using various methods, seeking collaboration to recruit patients via methods agreed with each practice. A detailed research diary was kept of time spent recruiting practices and patients. Researcher time was used to estimate costs. Patients who consented to participate were offered email support for their use of the Internet for health.

Results

Eighteen practices agreed to take part; we recruited 27 patients, most (23/27) from five practices. Practices agreed to recruit patients for an e-health intervention via waiting room leaflets (16), posters (16), practice nurses (15), doctors giving patients leaflets (5), a study website link (7), inclusion in planned mailshots (2), and a special mailshot to patients selected from practice computers (1). After low recruitment response we also recruited directly in five practices through research assistants giving leaflets to patients in waiting rooms. Ten practices recruited no patients. Those practices that were more difficult to recruit were less likely to recruit patients. Leaving leaflets for practice staff to distribute and placing posters in the practice were not effective in recruiting patients. Leaflets handed out by practice nurses and website links were more successful. The practice with lowest costs per patient recruited (£70) used a special mailshot to selected patients.

Conclusion

Recruitment via general practice was not successful and was therefore expensive. Direct to consumer methods and recruitment of patients in outpatients to offer email support may be more cost effective. If recruitment in general practice is required, contacting practices by letter and email, not following up non-responding practices, and recruiting patients with selected conditions by special mailshot may be the most cost-effective approach.

Communicating health promotion and disease prevention information to patients via email: a review

Email could be used in primary health-care settings for delivering health promotion and disease prevention information, providing an alternative method of delivery for brief interventions. We examined the literature on the use of email for this purpose. Systematic review methodology was used. The main medical databases were searched and there were no restrictions by study design, health-care setting or population. The search identified ten relevant articles, only one of which was a randomised controlled trial. Many articles discussed the potential use of email for health promotion and disease prevention but did not provide evidence. There is much scope for further research in this area.

Essential Ingredients for Successful Redesign of Addiction Treatment

Since the passage of healthcare reform, there have been many discussions about how the mental health and substance use disorder (MH/SUD) system will need to change. Of the many components involved in a system redesign, the identification of essential ingredients is crucial to its success. In an effort to determine what essential ingredients the new MH/SUD system requires to optimally meet the needs of its customers, we convened a group of 16 multi-industrial experts who analyzed data collected from a string of 7 focus groups and 15 interviews with people dealing with or working in the SUD field. This paper summarizes the 11 essential ingredients our group identified.

Impact of length or relevance of questionnaires on attrition in online trials: randomized controlled trial

BACKGROUND

There has been limited study of factors influencing response rates and attrition in online research. Online experiments were nested within the pilot (study 1, n = 3780) and main trial (study 2, n = 2667) phases of an evaluation of a Web-based intervention for hazardous drinkers: the Down Your Drink randomized controlled trial (DYD-RCT).

OBJECTIVES

The objective was to determine whether differences in the length and relevance of questionnaires can impact upon loss to follow-up in online trials.

METHODS

A randomized controlled trial design was used. All participants who consented to enter DYD-RCT and completed the primary outcome questionnaires were randomized to complete one of four secondary outcome questionnaires at baseline and at follow-up. These questionnaires varied in length (additional 23 or 34 versus 10 items) and relevance (alcohol problems versus mental health). The outcome measure was the proportion of participants who completed follow-up at each of two follow-up intervals: study 1 after 1 and 3 months and study 2 after 3 and 12 months.

RESULTS

At all four follow-up intervals there were no significant effects of additional questionnaire length on follow-up. Randomization to the less relevant questionnaire resulted in significantly lower rates of follow-up in two of the four assessments made (absolute difference of 4%, 95% confidence interval [CI] 0%-8%, in both study 1 after 1 month and in study 2 after 12 months). A post hoc pooled analysis across all four follow-up intervals found this effect of marginal statistical significance (unadjusted difference, 3%, range 1%-5%, P = .01; difference adjusted for prespecified covariates, 3%, range 0%-5%, P = .05).

CONCLUSIONS

Apparently minor differences in study design decisions may have a measurable impact on attrition in trials. Further investigation is warranted of the impact of the relevance of outcome measures on follow-up rates and, more broadly, of the consequences of what we ask participants to do when we invite them to take part in research studies.

TRIAL REGISTRATION

ISRCTN Register 31070347; http://www.controlled-trials.com/ISRCTN31070347/31070347 Archived by WebCite at (http://www.webcitation.org/62cpeyYaY).

Potential roles for new communication technologies in treatment of addiction

Information and communication technologies offer clinicians the opportunity to work with patients to manage chronic conditions, including addiction. The early research on the efficacy of electronic treatment and support tools is promising. Sensors have recently received increased attention as key components of electronic treatment and recovery management systems. Although results of the research are very promising, concerns at the clinical and policy level must be addressed before widespread adoption of these technologies can become practical. First, clinicians must adapt their practices to incorporate a continuing flow of patient information. Second, payment and regulatory systems must make adjustments far beyond what telemedicine and electronic medical records have required. This paper examines potential roles of information and communication technologies as well as process and regulatory challenges.

Who uses online interventions for problem drinkers?

The goal of this research was to understand why some people use online interventions for drinking problems, whereas others with comparable access to the interventions do not. As part of a randomized controlled trial, 92 participants in the experimental condition were provided access to a password-protected version of a Web-based personalized feedback intervention (the Check Your Drinking [CYD] screener, www.CheckYourDrinking.net). Information collected at baseline was compared between those who accessed the Web site and those who did not. Those who accessed the Web site tended to be more frequent users of the Internet, to drink less, and to perceive that others of the same age and gender drank less as compared with those who did not access the intervention. Some of these results are troubling as the preferred target of this type of intervention would be those who drink more and perceive that others are also heavy alcohol consumers.

Allowing for missing outcome data and incomplete uptake of randomised interventions, with application to an Internet-based alcohol trial

Missing outcome data and incomplete uptake of randomised interventions are common problems, which complicate the analysis and interpretation of randomised controlled trials, and are rarely addressed well in practice. To promote the implementation of recent methodological developments, we describe sequences of randomisation-based analyses that can be used to explore both issues. We illustrate these in an Internet-based trial evaluating the use of a new interactive website for those seeking help to reduce their alcohol consumption, in which the primary outcome was available for less than half of the participants and uptake of the intervention was limited.

For missing outcome data, we first employ data on intermediate outcomes and intervention use to make a missing at random assumption more plausible, with analyses based on general estimating equations, mixed models and multiple imputation. We then use data on the ease of obtaining outcome data and sensitivity analyses to explore departures from the missing at random assumption. For incomplete uptake of randomised interventions, we estimate structural mean models by using instrumental variable methods.

In the alcohol trial, there is no evidence of benefit unless rather extreme assumptions are made about the missing data nor an important benefit in more extensive users of the intervention. These findings considerably aid the interpretation of the trial's results. More generally, the analyses proposed are applicable to many trials with missing outcome data or incomplete intervention uptake. To facilitate use by others, Stata code is provided for all methods. Copyright © 2011 John Wiley & Sons, Ltd.

Pragmatic vs explanatory trials: the pragmascope tool to help measure differences in protocols of mental health randomized controlled trials

In the pragmatic-explanatory continuum, a randomized controlled trial (RCT) can at one extreme investigate whether a treatment could work in ideal circumstances (explanatory), or at the other extreme, whether it would work in everyday practice (pragmatic). How explanatory or pragmatic a study is can have implications for clinicians, policy makers, patients, researchers, funding bodies, and the public. There is an increasing need for studies to be open and pragmatic; however, explanatory trials are also needed. The previously developed Pragmatic-explanatory continuum indicator summary (PRECIS) was adapted into the Pragmascope tool to assist mental health researchers in designing RCTs, taking the pragmatic-explanatory continuum into account. Ten mental health trial protocols were randomly chosen and scored using the tool by three independent raters. Their results were compared for consistency and the tool was found to be reliable and practical. This preliminary work suggests that evaluating different domains of an RCT at the protocol level is useful, and suggests that using the Pragmascope tool presented here might be a practical way of doing this.

On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption

Background

Interventions delivered via the Internet have the potential to address the problem of hazardous alcohol consumption at minimal incremental cost, with potentially major public health implications. It was hypothesised that providing access to a psychologically enhanced website would result in greater reductions in drinking and related problems than giving access to a typical alcohol website simply providing information on potential harms of alcohol. DYD-RCT Trial registration: ISRCTN 31070347.

Methodology/Principal Findings

A two-arm randomised controlled trial was conducted entirely on-line through the Down Your Drink (DYD) website. A total of 7935 individuals who screened positive for hazardous alcohol consumption were recruited and randomized. At entry to the trial, the geometric mean reported past week alcohol consumption was 46.0 (SD 31.2) units. Consumption levels reduced substantially in both groups at the principal 3 month assessment point to an average of 26.0 (SD 22.3) units. Similar changes were reported at 1 month and 12 months. There were no significant differences between the groups for either alcohol consumption at 3 months (intervention: control ratio of geometric means 1.03, 95% CI 0.97 to 1.10) or for this outcome and the main secondary outcomes at any of the assessments. The results were not materially changed following imputation of missing values, nor was there any evidence that the impact of the intervention varied with baseline measures or level of exposure to the intervention.

Conclusions/Significance

Findings did not provide support for the hypothesis that access to a psychologically enhanced website confers additional benefit over standard practice and indicate the need for further research to optimise the effectiveness of Internet-based behavioural interventions. The trial demonstrates a widespread and potentially sustainable demand for Internet based interventions for people with hazardous alcohol consumption, which could be delivered internationally.

Trial Registration

Controlled-Trials.com ISRCTN31070347

Impact and costs of incentives to reduce attrition in online trials: two randomized controlled trials

Background

Attrition from follow-up is a major methodological challenge in randomized trials. Incentives are known to improve response rates in cross-sectional postal and online surveys, yet few studies have investigated whether they can reduce attrition from follow-up in online trials, which are particularly vulnerable to low follow-up rates.

Objectives

Our objective was to determine the impact of incentives on follow-up rates in an online trial.

Methods

Two randomized controlled trials were embedded in a large online trial of a Web-based intervention to reduce alcohol consumption (the Down Your Drink randomized controlled trial, DYD-RCT). Participants were those in the DYD pilot trial eligible for 3-month follow-up (study 1) and those eligible for 12-month follow-up in the DYD main trial (study 2). Participants in both studies were randomly allocated to receive an offer of an incentive or to receive no offer of an incentive. In study 1, participants in the incentive arm were randomly offered a £5 Amazon.co.uk gift voucher, a £5 charity donation to Cancer Research UK, or entry in a prize draw for £250. In study 2, participants in the incentive arm were offered a £10 Amazon.co.uk gift voucher. The primary outcome was the proportion of participants who completed follow-up questionnaires in the incentive arm(s) compared with the no incentive arm.

Results

In study 1 (n = 1226), there was no significant difference in response rates between those participants offered an incentive (175/615, 29%) and those with no offer (162/611, 27%) (difference = 2%, 95% confidence interval [CI] –3% to 7%). There was no significant difference in response rates among the three different incentives offered. In study 2 (n = 2591), response rates were 9% higher in the group offered an incentive (476/1296, 37%) than in the group not offered an incentive (364/1295, 28%) (difference = 9%, 95% CI 5% to 12%, P < .001). The incremental cost per extra successful follow-up in the incentive arm was £110 in study 1 and £52 in study 2.

Conclusion

Whereas an offer of a £10 Amazon.co.uk gift voucher can increase follow-up rates in online trials, an offer of a lower incentive may not. The marginal costs involved require careful consideration.

Trial registration

ISRCTN31070347; http://www.controlled-trials.com/ISRCTN31070347 (Archived by WebCite at http://www.webcitation.org/5wgr5pl3s)

The use of emerging technologies in alcohol treatment

Emerging technologies, such as the Internet and text messaging, have an ever-growing role in providing services to problem drinkers. This article summarizes selected examples of emerging technologies that have been developed and implemented as stand-alone interventions and as part of other face-to-face interventions. It provides a taste of the different opportunities available for implementing emerging technologies as a way to improve the accessibility and effectiveness of services for problem drinkers.

An e-health solution for people with alcohol problems

Self-management of chronic diseases has been a research focus for years. Information and communication technologies (ICTs) have played a significant role in aiding patients and their families with that management task. The recent dramatic increase in smartphone capabilities has expanded the potential of these technologies by facilitating the integration of features specific to cell phones with advanced capabilities that extend the reach of what type of information can be assessed and which services can be provided. A recent review of the literature covering the use of ICTs in managing chronic diseases, including addiction, has examined the effectiveness of ICTs, with an emphasis on technologies tested in randomized controlled trials. One example of an addiction-relapse prevention system currently being tested is the Alcohol Comprehensive Health Enhancement Support System (A-CHESS) Program.

Pragmatic vs explanatory trials: the pragmascope tool to help measure differences in protocols of mental health randomized controlled trials

In the pragmatic-explanatory continuum, a randomized controlled trial (RCT) can at one extreme investigate whether a treatment could work in ideal circumstances (explanatory), or at the other extreme, whether it would work in everyday practice (pragmatic). How explanatory or pragmatic a study is can have implications for clinicians, policy makers, patients, researchers, funding bodies, and the public. There is an increasing need for studies to be open and pragmatic; however, explanatory trials are also needed. The previously developed Pragmatic-explanatory continuum indicator summary (PRECIS) was adapted into the Pragmascope tool to assist mental health researchers in designing RCTs, taking the pragmatic-explanatory continuum into account. Ten mental health trial protocols were randomly chosen and scored using the tool by three independent raters. Their results were compared for consistency and the tool was found to be reliable and practical. This preliminary work suggests that evaluating different domains of an RCT at the protocol level is useful, and suggests that using the Pragmascope tool presented here might be a practical way of doing this.

How big is the elephant in the room? Estimated and actual IT costs in an online behaviour change trial

BACKGROUND

The practical and methodological challenges inherent in online behaviour change studies are both novel and complex. We relate our experiences of estimating and managing information technology (IT) research and intervention costs in an ongoing internet trial in the hope that others will find this information useful.

FINDINGS

Actual IT costs were approximately twice those that had been originally estimated by external contractors. These original estimates for IT costs allowed little scope for the identification of new needs, which was intrinsic to the iterative nature of the research enterprise.

CONCLUSIONS

Making greater provision for the uncertain nature of these costs in future studies is a key practical lesson for the planning of future online behaviour change studies.

Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy

BACKGROUND

The Internet is increasingly used as a medium for the delivery of interventions designed to promote health behavior change. However, reviews of these interventions to date have not systematically identified intervention characteristics and linked these to effectiveness.

OBJECTIVES

The present review sought to capitalize on recently published coding frames for assessing use of theory and behavior change techniques to investigate which characteristics of Internet-based interventions best promote health behavior change. In addition, we wanted to develop a novel coding scheme for assessing mode of delivery in Internet-based interventions and also to link different modes to effect sizes.

METHODS

We conducted a computerized search of the databases indexed by ISI Web of Knowledge (including BIOSIS Previews and Medline) between 2000 and 2008. Studies were included if (1) the primary components of the intervention were delivered via the Internet, (2) participants were randomly assigned to conditions, and (3) a measure of behavior related to health was taken after the intervention.

RESULTS

We found 85 studies that satisfied the inclusion criteria, providing a total sample size of 43,236 participants. On average, interventions had a statistically small but significant effect on health-related behavior (d(+) = 0.16, 95% CI 0.09 to 0.23). More extensive use of theory was associated with increases in effect size (P = .049), and, in particular, interventions based on the theory of planned behavior tended to have substantial effects on behavior (d(+) = 0.36, 95% CI 0.15 to 0.56). Interventions that incorporated more behavior change techniques also tended to have larger effects compared to interventions that incorporated fewer techniques (P < .001). Finally, the effectiveness of Internet-based interventions was enhanced by the use of additional methods of communicating with participants, especially the use of short message service (SMS), or text, messages.

CONCLUSIONS

The review provides a framework for the development of a science of Internet-based interventions, and our findings provide a rationale for investing in more intensive theory-based interventions that incorporate multiple behavior change techniques and modes of delivery.

Twelve-month follow-up results from a randomized controlled trial of a brief personalized feedback intervention for problem drinkers

Aims: To examine the impact of a web-based personalized feedback intervention, the Check Your Drinking (CYD; www.CheckYourDrinking.net) screener at 12-month follow-up.

Methods: Respondents (N = 185) were recruited from a general population telephone survey of Ontario, Canadian adults (≥18 years) by asking risky drinkers if they were willing to help develop and evaluate Internet-based interventions for drinkers. Those randomly assigned to the intervention condition were provided with the web address and a unique password to a study-specific copy of the CYD. Respondents assigned to the control condition were sent a written description of the different components of the CYD and asked how useful they thought each of the components might be. Respondents were followed up at 3, 6 and 12 months.

Results: By the 12-month follow-up, the impact of the intervention previously reported at 3 and 6 months of CYD on problem drinkers’ alcohol consumption was no longer apparent (P > 0.05).

Conclusions: Recognizing that many people with alcohol concerns will never seek treatment, recent years have seen an increase in efforts to find ways to take treatment to problem drinkers. The CYD is one such intervention that has a demonstrated effect on reducing alcohol consumption in the short term (i.e. 6 months). Other more intensive Internet-based interventions or interventions via other modalities may enhance this positive outcome over the short and long term among problem drinkers who would be otherwise unlikely to access treatment for their alcohol concerns.

www.ClinicalTrials.gov registration #NCT00367575.

Methodological challenges in online trials

Health care and health care services are increasingly being delivered over the Internet. There is a strong argument that interventions delivered online should also be evaluated online to maximize the trial's external validity. Conducting a trial online can help reduce research costs and improve some aspects of internal validity. To date, there are relatively few trials of health interventions that have been conducted entirely online. In this paper we describe the major methodological issues that arise in trials (recruitment, randomization, fidelity of the intervention, retention, and data quality), consider how the online context affects these issues, and use our experience of one online trial evaluating an intervention to help hazardous drinkers drink less (DownYourDrink) to illustrate potential solutions. Further work is needed to develop online trial methodology.

Test-retest reliability of an online measure of past week alcohol consumption (the TOT-AL), and comparison with face-to-face interview

OBJECTIVE

This paper reports on the development of a new online measure of beverage-specific past week alcohol consumption (the TOT-AL), its test-retest reliability, and comparability with the face-to-face approach of ascertaining alcohol intake.

METHODS

University students participating in the reliability study completed the TOT-AL twice on the same day with at least 3 h apart. Students in the comparability study attended a face-to-face interview and completed the TOT-AL on the same day, in a randomised order, at least 3 h apart.

RESULTS

There was a strong correlation between the repeated measurements of the TOT-AL (r=0.99; 95% CI: 0.98, 0.99) and between the units calculated by the TOT-AL and the face-to face interview (r=0.97; 95% CI: 0.95, 0.99). A high level of agreement between measurements was also observed in a Bland-Altman analysis.

CONCLUSIONS

The TOT-AL is a reliable, time efficient means of ascertaining alcohol intake, equivalent to that obtained face-to-face. These findings support the use of this approach to online alcohol assessment in populations with access to the Internet.

Assessing the effectiveness of an Internet-based videoconferencing platform for delivering intensified substance abuse counseling

Enhanced schedules of counseling can improve response to routine opioid-agonist treatment, although it is associated with increased time demands that enhance patient resistance and nonadherence. Internet-based counseling can reduce these concerns by allowing patients to participate from home. This study assesses treatment satisfaction and response to Internet-based (CRC Health Group's e-Getgoing) group counseling for partial responders to methadone maintenance treatment. Patients testing positive for an illicit substance (n = 37) were randomly assigned to e-Getgoing or onsite group counseling and followed for 6 weeks. Patients in both conditions responded favorably to intensified treatment by achieving at least 2 consecutive weeks of abstinence and 100% attendance to return to less-intensive care (e-Getgoing: 70% vs. routine: 71%, ns). Treatment satisfaction was good and comparable across conditions. E-Getgoing patients expressed a preference for the Internet-based service, reporting convenience and increased confidentiality as major reasons. Integrating Internet-based group counseling with on-site treatment services could help expand the continuum of care in methadone maintenance clinics.

Development of a psychologically enhanced interactive online intervention for hazardous drinking

Aims: The content of novel interventions is often not well specified. We provide a detailed account of the rationale for and redevelopment of an Internet resource for hazardous drinkers—Down Your Drink (DYD) (www.downyourdrink.org.uk). Development Work: An iterative process blended literature reviews of Internet interventions for health conditions and brief treatments for alcohol problems, feedback from users of the original site and from users panels, and completion of a series of developmental tasks. Intervention: The detailed structure and content of the new version of the website is presented. This permits an appreciation of the intended interaction between the user and the intervention, and emphasizes both the freedom of choice available to the user to access diverse material for personal benefit and the value of a clear organizational structure. Conclusions: Presentation of detailed information on the theoretical underpinning, content and structure of an intervention makes it easier to interpret the results of any evaluation and is likely to be of use to those developing other online interventions for alcohol or other health behaviours.