A Randomized trial of an Asthma Internet Self-management Intervention (RAISIN): study protocol for a randomized controlled trial

Gamification and Adherence to Web-Based Mental Health Interventions: A Systematic Review

BACKGROUND

Adherence to effective Web-based interventions for common mental disorders (CMDs) and well-being remains a critical issue, with clear potential to increase effectiveness. Continued identification and examination of "active" technological components within Web-based interventions has been called for. Gamification is the use of game design elements and features in nongame contexts. Health and lifestyle interventions have implemented a variety of game features in their design in an effort to encourage engagement and increase program adherence. The potential influence of gamification on program adherence has not been examined in the context of Web-based interventions designed to manage CMDs and well-being.

OBJECTIVE

This study seeks to review the literature to examine whether gaming features predict or influence reported rates of program adherence in Web-based interventions designed to manage CMDs and well-being.

METHODS

A systematic review was conducted of peer-reviewed randomized controlled trials (RCTs) designed to manage CMDs or well-being and incorporated gamification features. Seven electronic databases were searched.

RESULTS

A total of 61 RCTs met the inclusion criteria and 47 different intervention programs were identified. The majority were designed to manage depression using cognitive behavioral therapy. Eight of 10 popular gamification features reviewed were in use. The majority of studies utilized only one gamification feature (n=58) with a maximum of three features. The most commonly used feature was story/theme. Levels and game leaders were not used in this context. No studies explicitly examined the role of gamification features on program adherence. Usage data were not commonly reported. Interventions intended to be 10 weeks in duration had higher mean adherence than those intended to be 6 or 8 weeks in duration.

CONCLUSIONS

Gamification features have been incorporated into the design of interventions designed to treat CMD and well-being. Further research is needed to improve understanding of gamification features on adherence and engagement in order to inform the design of future Web-based health interventions in which adherence to treatment is of concern. Conclusions were limited by varied reporting of adherence and usage data.

Home telemonitoring and remote feedback between clinic visits for asthma

BACKGROUND

Asthma is a chronic disease that causes reversible narrowing of the airways due to bronchoconstriction, inflammation and mucus production. Asthma continues to be associated with significant avoidable morbidity and mortality. Self management facilitated by a healthcare professional is important to keep symptoms controlled and to prevent exacerbations.Telephone and Internet technologies can now be used by patients to measure lung function and asthma symptoms at home. Patients can then share this information electronically with their healthcare provider, who can provide feedback between clinic visits. Technology can be used in this manner to improve health outcomes and prevent the need for emergency treatment for people with asthma and other long-term health conditions.

OBJECTIVES

To assess the efficacy and safety of home telemonitoring with healthcare professional feedback between clinic visits, compared with usual care.

SEARCH METHODS

We identified trials from the Cochrane Airways Review Group Specialised Register (CAGR) up to May 2016. We also searched www.clinicaltrials.gov, the World Health Organization (WHO) trials portal and reference lists of other reviews, and we contacted trial authors to ask for additional information.

SELECTION CRITERIA

We included parallel randomised controlled trials (RCTs) of adults or children with asthma in which any form of technology was used to measure and share asthma monitoring data with a healthcare provider between clinic visits, compared with other monitoring or usual care. We excluded trials in which technologies were used for monitoring with no input from a doctor or nurse. We included studies reported as full-text articles, those published as abstracts only and unpublished data.

DATA COLLECTION AND ANALYSIS

Two review authors screened the search and independently extracted risk of bias and numerical data, resolving disagreements by consensus.We analysed dichotomous data as odds ratios (ORs) while using study participants as the unit of analysis, and continuous data as mean differences (MDs) while using random-effects models. We rated evidence for all outcomes using the GRADE (Grades of Recommendation, Assessment, Development and Evaluation Working Group) approach.

MAIN RESULTS

We found 18 studies including 2268 participants: 12 in adults, 5 in children and one in individuals from both age groups. Studies generally recruited people with mild to moderate persistent asthma and followed them for between three and 12 months. People in the intervention group were given one of a variety of technologies to record and share their symptoms (text messaging, Web systems or phone calls), compared with a group of people who received usual care or a control intervention.Evidence from these studies did not show clearly whether asthma telemonitoring with feedback from a healthcare professional increases or decreases the odds of exacerbations that require a course of oral steroids (OR 0.93, 95% confidence Interval (CI) 0.60 to 1.44; 466 participants; four studies), a visit to the emergency department (OR 0.75, 95% CI 0.36 to 1.58; 1018 participants; eight studies) or a stay in hospital (OR 0.56, 95% CI 0.21 to 1.49; 1042 participants; 10 studies) compared with usual care. Our confidence was limited by imprecision in all three primary outcomes. Evidence quality ratings ranged from moderate to very low. None of the studies recorded serious or non-serious adverse events separately from asthma exacerbations.Evidence for measures of asthma control was imprecise and inconsistent, revealing possible benefit over usual care for quality of life (MD 0.23, 95% CI 0.01 to 0.45; 796 participants; six studies; I(2) = 54%), but the effect was small and study results varied. Telemonitoring interventions may provide additional benefit for two measures of lung function.

AUTHORS' CONCLUSIONS

Current evidence does not support the widespread implementation of telemonitoring with healthcare provider feedback between asthma clinic visits. Studies have not yet proven that additional telemonitoring strategies lead to better symptom control or reduced need for oral steroids over usual asthma care, nor have they ruled out unintended harms. Investigators noted small benefits for quality of life, but these are subject to risk of bias, as the studies were unblinded. Similarly, some benefits for lung function are uncertain owing to possible attrition bias.Larger pragmatic studies in children and adults could better determine the real-world benefits of these interventions for preventing exacerbations and avoiding harms; it is difficult to generalise results from this review because benefits may be explained at least in part by the increased attention participants receive by taking part in clinical trials. Qualitative studies could inform future research by focusing on patient and provider preferences, or by identifying subgroups of patients who are more likely to attain benefit from closer monitoring, such as those who have frequent asthma attacks.

Findings from a pilot Randomised trial of an Asthma Internet Self-management Intervention (RAISIN)

OBJECTIVE

To evaluate the feasibility of a phase 3 randomised controlled trial (RCT) of a website (Living Well with Asthma) to support self-management.

DESIGN AND SETTING

Phase 2, parallel group, RCT, participants recruited from 20 general practices across Glasgow, UK. Randomisation through automated voice response, after baseline data collection, to website access for minimum 12 weeks or usual care.

PARTICIPANTS

Adults (age≥16 years) with physician diagnosed, symptomatic asthma (Asthma Control Questionnaire (ACQ) score ≥1). People with unstable asthma or other lung disease were excluded.

INTERVENTION

'Living Well with Asthma' is a desktop/laptop compatible interactive website designed with input from asthma/ behaviour change specialists, and adults with asthma. It aims to support optimal medication management, promote use of action plans, encourage attendance at asthma reviews and increase physical activity.

OUTCOME MEASURES

Primary outcomes were recruitment/retention, website use, ACQ and mini-Asthma Quality of Life Questionnaire (AQLQ). Secondary outcomes included patient activation, prescribing, adherence, spirometry, lung inflammation and health service contacts after 12 weeks. Blinding postrandomisation was not possible.

RESULTS

Recruitment target met. 51 participants randomised (25 intervention group). Age range 16-78 years; 75% female; 28% from most deprived quintile. 45/51 (88%; 20 intervention group) followed up. 19 (76% of the intervention group) used the website, for a mean of 18 min (range 0-49). 17 went beyond the 2 'core' modules. Median number of logins was 1 (IQR 1-2, range 0-7). No significant difference in the prespecified primary efficacy measures of ACQ scores (-0.36; 95% CI -0.96 to 0.23; p=0.225), and mini-AQLQ scores (0.38; -0.13 to 0.89; p=0.136). No adverse events.

CONCLUSIONS

Recruitment and retention confirmed feasibility; trends to improved outcomes suggest use of Living Well with Asthma may improve self-management in adults with asthma and merits further development followed by investigation in a phase 3 trial.

TRIAL REGISTRATION NUMBER

ISRCTN78556552; Results.

Remote versus face-to-face check-ups for asthma

BACKGROUND

Asthma remains a significant cause of avoidable morbidity and mortality. Regular check-ups with a healthcare professional are essential to monitor symptoms and adjust medication.Health services worldwide are considering telephone and internet technologies as a way to manage the rising number of people with asthma and other long-term health conditions. This may serve to improve health and reduce the burden on emergency and inpatient services. Remote check-ups may represent an unobtrusive and efficient way of maintaining contact with patients, but it is uncertain whether conducting check-ups in this way is effective or whether it may have unexpected negative consequences.

OBJECTIVES

To assess the safety and efficacy of conducting asthma check-ups remotely versus usual face-to-face consultations.

SEARCH METHODS

We identified trials from the Cochrane Airways Review Group Specialised Register (CAGR) up to 24 November 2015. We also searched www.clinicaltrials.gov, the World Health Organization (WHO) trials portal, reference lists of other reviews and contacted trial authors for additional information.

SELECTION CRITERIA

We included parallel randomised controlled trials (RCTs) of adults or children with asthma that compared remote check-ups conducted using any form of technology versus standard face-to-face consultations. We excluded studies that used automated telehealth interventions that did not include personalised contact with a health professional. We included studies reported as full-text articles, as abstracts only and unpublished data.

DATA COLLECTION AND ANALYSIS

Two review authors screened the literature search results and independently extracted risk of bias and numerical data. We resolved any disagreements by consensus, and we contacted study authors for missing information.We analysed dichotomous data as odds ratios (ORs) using study participants as the unit of analysis, and continuous data as mean differences using the random-effects models. We rated all outcomes using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach.

MAIN RESULTS

Six studies including a total of 2100 participants met the inclusion criteria: we pooled four studies including 792 people in the main efficacy analyses, and presented the results of a cluster implementation study (n = 1213) and an oral steroid tapering study (n = 95) separately. Baseline characteristics relating to asthma severity were variable, but studies generally recruited people with asthma taking regular medications and excluded those with COPD or severe asthma. One study compared the two types of check-up for oral steroid tapering in severe refractory asthma and we assessed it as a separate question. The studies could not be blinded and dropout was high in four of the six studies, which may have biased the results.We could not say whether more people who had a remote check-up needed oral corticosteroids for an asthma exacerbation than those who were seen face-to-face because the confidence intervals (CIs) were very wide (OR 1.74, 95% CI 0.41 to 7.44; 278 participants; one study; low quality evidence). In the face-to-face check-up groups, 21 participants out of 1000 had exacerbations that required oral steroids over three months, compared to 36 (95% CI nine to 139) out of 1000 for the remote check-up group. Exacerbations that needed treatment in the Emergency Department (ED), hospital admission or an unscheduled healthcare visit all happened too infrequently to detect whether remote check-ups are a safe alternative to face-to-face consultations. Serious adverse events were not reported separately from the exacerbation outcomes.There was no difference in asthma control measured by the Asthma Control Questionnaire (ACQ) or in quality of life measured on the Asthma Quality of Life Questionnaire (AQLQ) between remote and face-to-face check-ups. We could rule out significant harm of remote check-ups for these outcomes but we were less confident because these outcomes are more prone to bias from lack of blinding.The larger implementation study that compared two general practice populations demonstrated that offering telephone check-ups and proactively phoning participants increased the number of people with asthma who received a review. However, we do not know whether the additional participants who had a telephone check-up subsequently benefited in asthma outcomes.

AUTHORS' CONCLUSIONS

Current randomised evidence does not demonstrate any important differences between face-to-face and remote asthma check-ups in terms of exacerbations, asthma control or quality of life. There is insufficient information to rule out differences in efficacy, or to say whether or not remote asthma check-ups are a safe alternative to being seen face-to-face.

Details of development of the resource for adults with asthma in the RAISIN (randomized trial of an asthma internet self-management intervention) study

Background

Around 300 million people worldwide have asthma and prevalence is increasing. Self-management can be effective in improving a range of outcomes and is cost effective, but is underutilised as a treatment strategy. Supporting optimum self-management using digital technology shows promise, but how best to do this is not clear. We aimed to develop an evidence based, theory informed, online resource to support self-management in adults with asthma, called ‘Living well with Asthma’, as part of the RAISIN (Randomized Trial of an Asthma Internet Self-Management Intervention) study.

Methods

We developed Living well with Asthma in two phases.

Phase 1: A low fidelity prototype (paper-based) version of the website was developed iteratively through input from a multidisciplinary expert panel, empirical evidence from the literature, and potential end users via focus groups (adults with asthma and practice nurses). Implementation and behaviour change theories informed this process.

Phase 2: The paper-based designs were converted to a website through an iterative user centred process. Adults with asthma (n = 10) took part in think aloud studies, discussing the paper based version, then the web-based version. Participants considered contents, layout, and navigation. Development was agile using feedback from the think aloud sessions immediately to inform design and subsequent think aloud sessions. Think aloud transcripts were also thematically analysed, further informing resource development.

Results

The website asked users to aim to be symptom free. Key behaviours targeted to achieve this include: optimising medication use (including inhaler technique); attending primary care asthma reviews; using asthma action plans; increasing physical activity levels; and stopping smoking. The website had 11 sections, plus email reminders, which promoted these behaviours. Feedback on the contents of the resource was mainly positive with most changes focussing on clarification of language, order of pages and usability issues mainly relating to navigation difficulties.

Conclusions

Our multifaceted approach to online intervention development underpinned by theory, using evidence from the literature, co-designed with end users and a multidisciplinary panel has resulted in a resource which end users find relevant to their needs and easy to use. Living well with Asthma is undergoing evaluation within a randomized controlled trial.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-015-0177-z) contains supplementary material, which is available to authorized users.

The use of behavior change theory in Internet-based asthma self-management interventions: a systematic review

Background

The high prevalence rate of asthma represents a major societal burden. Advancements in information technology continue to affect the delivery of patient care in all areas of medicine. Internet-based solutions, social media, and mobile technology could address some of the problems associated with increasing asthma prevalence.

Objective

This review evaluates Internet-based asthma interventions that were published between 2004 and October 2014 with respect to the use of behavioral change theoretical frameworks, applied clinical guidelines, and assessment tools.

Methods

The search term (Asthma AND [Online or Internet or Mobile or Application or eHealth or App]) was applied to six bibliographic databases (Ovid MEDLINE, PubMed, BioMed Central, ProQuest Computing, Web of Knowledge, and ACM Digital Library) including only English-language articles published between 2004 and October 2014. In total, 3932 articles matched the priori search terms and were reviewed by the primary reviewer based on their titles, index terms, and abstracts. The matching articles were then screened by the primary reviewer for inclusion or exclusion based on their abstract, study type, and intervention objectives with respect to the full set of priori inclusion and exclusion criteria; 331 duplicates were identified and removed. A total of 85 articles were included for in-depth review and the remaining 3516 articles were excluded. The primary and secondary reviewer independently reviewed the complete content of the 85 included articles to identify the applied behavioral change theories, clinical guidelines, and assessment tools. Findings and any disagreement between reviewers were resolved by in-depth discussion and through a consolidation process for each of the included articles.

Results

The reviewers identified 17 out of 85 interventions (20%) where at least one model, framework, and/or construct of a behavioral change theory were applied. The review identified six clinical guidelines that were applied across 30 of the 85 interventions (35%) as well as a total of 21 assessment tools that were applied across 32 of the 85 interventions (38%).

Conclusions

The findings of this literature review indicate that the majority of published Internet-based interventions do not use any documented behavioral change theory, clinical guidelines, and/or assessment tools to inform their design. Further, it was found that the application of clinical guidelines and assessment tools were more salient across the reviewed interventions. A consequence, as such, is that many Internet-based asthma interventions are designed in an ad hoc manner, without the use of any notable evidence-based theoretical frameworks, clinical guidelines, and/or assessment tools.