Information Architecture of Web-Based Interventions to Improve Health Outcomes: Systematic Review

Is the European Crohn's and Colitis organisation (ECCO) e-guide an acceptable and feasible tool for increasing gastroenterologists' guideline adherence? A mixed methods evaluation

BACKGROUND AND AIMS

Management of inflammatory bowel disease is constantly evolving, increasing the importance for gastroenterologists to keep up to date with guidelines. Traditional implementation strategies have had only small positive impacts on clinical practice. eHealth strategies such as the European Crohn's and Colitis Organisation e-guide may be beneficial for clinician decision making in keeping with guidelines. The aim of this study was to evaluate the feasibility and acceptability of the e-guide.

METHODS

A mixed methods approach was used to evaluate feasibility and acceptability. Cognitive (think-aloud) interviews were conducted with Australian gastroenterologists while using the e-guide. Two clinical scenarios were developed to allow evaluation of various aspects of the e-guide. Content analysis was applied to the qualitative interview data and descriptive analysis to the quantitative and observational data.

RESULTS

Seventeen participants completed the study. Data saturation were reached. The ECCO e-guide was largely feasible and acceptable, as demonstrated by most clinical questions answered correctly, 87% reaching the answer within 3 min, and most feeling it was useful, would be beneficial to their practice and would use it again. Issues raised included difficulties with website navigation, layout of the e-guide and difficulties with access (network firewalls, paid subscription required).

CONCLUSIONS

The ECCO e-guide is largely acceptable and feasible for gastroenterologists to use. Aspects of the e-guide could be modified to improve user experience. This study highlights the importance of engaging end-users in the development and evaluation of clinician educational tools.

Feasibility and preliminary efficacy of iConquerFear: a self-guided digital intervention for fear of cancer recurrence

PURPOSE

Approximately 50% of cancer survivors experience moderate-severe fear of cancer recurrence (FCR). Self-guided digital interventions have potential to address the high level of FCR-related unmet needs at scale, but existing digital interventions have demonstrated variable engagement and efficacy. This study aimed to evaluate the feasibility and preliminary efficacy of iConquerFear, a five-module self-guided digital FCR intervention.

METHODS

Eligible curatively treated breast cancer survivors were recruited. Participants reporting clinically significant FCR (≥ 13 on the Fear of Cancer Recurrence Inventory-Short Form; FCRI-SF) were given access to iConquerFear. Feasibility was indicated by > 50% of eligible participants enrolling in iConquerFear and recording moderate (≥ 120 min) or greater usage. Preliminary efficacy was evaluated via changes in self-reported FCR severity, anxiety, depression, intrusions and metacognitions from baseline to immediately and 3 months post-intervention.

RESULTS

Fifty-four (83%) of 65 eligible participants enrolled in iConquerFear; six subsequently withdrew. Thirty-nine (83%) participants recorded moderate (n = 24; 120-599 min) or high (n = 15; ≥ 600 min) usage. Engagement levels increased with participant age (p = 0.043), but were lower in participants with higher baseline FCR (p = 0.028). Qualitative feedback indicated engagement was sometimes limited by difficulties with navigation and relating to featured survivors. Participants reported significantly improved FCR (mean reduction (95%CI): baseline to post-intervention - 3.44 (- 5.18, - 1.71), baseline to 3-month follow-up - 4.52 (- 6.25, - 2.78), p =  < 0.001).

CONCLUSION

iConquerFear is a feasible and potentially efficacious intervention for reducing FCR in breast cancer survivors. Easier navigation and more relatable examples may enhance engagement.

IMPLICATIONS FOR CANCER SURVIVORS

iConquerFear may help address moderate but burdensome FCR levels in cancer survivors.

Demographic and Psychosocial Characteristics Associated With Use of a Prostate Cancer Survivorship Website: Implications From a Multisite Randomized Controlled Trial

Background

Many prostate cancer (PC) survivors experience disease and treatment-related symptomatology in both the physical and psychosocial domains. Although the benefits and barriers to using web-based resources for cancer patients are well-documented, less research has focused on the personal characteristics important for efficient tailoring and targeting of information that are associated with usage.

Objective

We used the Cognitive-Social Health Information Processing (C-SHIP) framework to guide our exploration of personal characteristics associated with use of PROGRESS, an informational PC survivorship website that addresses physical, emotional, interpersonal, and practical concerns relevant for PC survivors.

Methods

PC survivors (N=217) were randomized to the intervention arm (PROGRESS) of a randomized controlled trial. Of those randomized to the intervention arm, 84 used PROGRESS, and 133 did not use PROGRESS. Multivariable analyses evaluated demographic and psychosocial characteristics (eg, style of coping, health literacy, self-efficacy, affective states of depression, anxiety, and fatigue) associated with website use.

Results

A larger proportion of non-Hispanic White (68/160, 42.5%), compared with non-Hispanic Black (9/40, 23%), participants used PROGRESS (P<.001). Further, PROGRESS users were older in age (P<.001), had a monitoring style of coping (P=.01), and were less depressed (P=.004), anxious (P=.02), and fatigued (P<.001) than nonusers. Education, income, health literacy, blunting style of coping, self-efficacy, and treatment type (radiation therapy or surgery) were not significantly related to use. On multivariable analyses, race (OR 0.28, P<.001), age (OR 1.05, P<.001), monitoring style of coping (OR 1.27, P=.02), and overall mood (OR 0.98, P<.001) remained significant.

Conclusions

A combination of monitoring and low levels of negative affect were associated with website use. Additionally, users were older, non-Hispanic White survivors. To ensure that important survivorship-relevant information reaches users, future efforts need to focus on enhancing patient engagement.

Trial Registration

ClinicalTrials.gov NCT02224482; https://clinicaltrials.gov/ct2/show/NCT02224482

Testing Behavioral Nudges and Prompts in Digital Courses for Self-Guided Treatment of Depression and Anxiety, Protocol for 3-Arm Randomized Controlled Trial (Preprint)

Background

Despite showing strong evidence of positive outcomes, a common problem in the field of digital health is poor engagement and adherence. Non–health care, for-profit digital ventures, such as Facebook, LinkedIn, and Twitter, conduct behavioral experiments to increase user engagement. To our knowledge, digital health organizations have not published similar types of experiments in ad libitum environments, and there are limited published data indicating whether nudges and prompts can be leveraged to increase engagement with digital health interventions.

Objective

The main objective of our 3-arm randomized controlled trial is to test whether registered members in two well-established digital health courses for anxiety and depression will engage with four different types of nudges and prompts, and whether engaging with nudges and prompts increases engagement within the courses.

Methods

New members who register for the self-guided anxiety and depression courses on the Evolution Health platform will be randomized into 1 of 3 arms. The first control arm will feature a member home page without any behavioral nudges or prompts. The second arm will feature a member home page with a Tip-of-the-Day section containing directive content. Arm 3 will feature a member home page with a Tip-of-the-Day section containing social proof and present bias content. The third arm will also feature a to-do item checklist.

Results

The experiment was designed in August 2021 and was launched in November 2021. Initially, we will measure engagement with the tips and the to-do checklist by calculating the frequency of use by age and gender. If members do engage, we will then, according to age and gender, examine whether nudges and prompts result in higher course completion rates and whether specific types of prompts and nudges are more popular than others.

Conclusions

Our 3-arm randomized controlled trial will be the first to compare four distinct types of behavioral prompts and nudges in two self-guided digital health courses that were designed to treat mental health issues. We expect the results to generate insights into which types of behavioral prompts and nudges work best in the population. If they are shown to increase engagement, the insights will then be used to apply prompts and nudges to the platform’s addiction-focused courses. Based on the results of the experiment, the insights will be applied to using artificial intelligence to train the platform to recognize different usage patterns and provide specific engagement recommendations to stratified users.

International Registered Report Identifier (IRRID)

DERR1-10.2196/37231

Web-Based Interventions to Help Australian Adults Address Depression, Anxiety, Suicidal Ideation, and General Mental Well-being: Scoping Review

BACKGROUND

A large number of Australians experience mental health challenges at some point in their lives. However, in many parts of Australia, the wait times to see general practitioners and mental health professionals can be lengthy. With increasing internet use across Australia, web-based interventions may help increase access to timely mental health care. As a result, this is an area of increasing research interest, and the number of publicly available web-based interventions is growing. However, it can be confusing for clinicians and consumers to know the resources that are evidence-based and best meet their needs.

OBJECTIVE

This study aims to scope out the range of web-based mental health interventions that address depression, anxiety, suicidal ideation, or general mental well-being and are freely available to Australian adults, along with their impact, acceptability, therapeutic approach, and key features.

METHODS

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines for scoping reviews (PRISMA-ScR [PRISMA extension for Scoping Reviews]) guided the review process. Keywords for the search were depression, anxiety, suicide, and well-being. The search was conducted using Google as well as the key intervention databases Beacon, Head to Health, and e-Mental Health in Practice. Interventions were deemed eligible if they targeted depression, anxiety, suicidal ideation, or general mental well-being (eg, resilience) in adults; and were web-based, written in English, interactive, free, and publicly available. They also had to be guided by an evidence-based therapeutic approach.

RESULTS

Overall, 52 eligible programs were identified, of which 9 (17%) addressed depression, 15 (29%) addressed anxiety, 13 (25%) addressed general mental well-being, and 13 (25%) addressed multiple issues. Only 4% (2/52) addressed distress in the form of suicidal ideation. The most common therapeutic approach was cognitive behavioral therapy. Half of the programs guided users through exercises in a set sequence, and most programs enabled users to log in and complete the activities on their own without professional support. Just over half of the programs had been evaluated for their effectiveness in reducing symptoms, and 11% (6/52) were being evaluated at the time of writing. Program evaluation scores ranged from 44% to 100%, with a total average score of 85%.

CONCLUSIONS

There are numerous web-based programs for depression, anxiety, suicidal ideation, and general well-being, which are freely and publicly available in Australia. However, identified gaps include a lack of available web-based interventions for culturally and linguistically diverse populations and programs that use newer therapeutic approaches such as acceptance and commitment therapy and dialectical behavior therapy. Despite most programs included in this review being of good quality, clinicians and consumers should pay careful attention when selecting which program to recommend and use, as variations in the levels of acceptability and impact of publicly available programs do exist.

Combining Farmers' Preferences With Evidence-Based Strategies to Prevent and Lower Farmers' Distress: Co-design and Acceptability Testing of ifarmwell

Background

Farming is physically and psychologically hazardous. Farmers face many barriers to help seeking from traditional physical and mental health services; however, improved internet access now provides promising avenues for offering support.

Objective

This study aims to co-design with farmers the content and functionality of a website that helps them adopt transferable coping strategies and test its acceptability in the broader farming population.

Methods

Research evidence and expert opinions were synthesized to inform key design principles. A total of 18 farmers detailed what they would like from this type of website. Intervention logic and relevant evidence-based strategies were mapped. Website content was drafted and reviewed by 2 independent mental health professionals. A total of 9 farmers provided detailed qualitative feedback on the face validity of the draft content. Subsequently, 9 farmers provided feedback on the website prototype. Following amendments and internal prototype testing and optimization, prototype usability (ie, completion rate) was examined with 157 registered website users who were (105/157, 66.9%) female, aged 21-73 years; 95.5% (149/156) residing in inner regional to very remote Australia, and 68.2% (107/157) “sheep, cattle and/or grain farmers.” Acceptability was examined with a subset of 114 users who rated at least module 1. Interviews with 108 farmers who did not complete all 5 modules helped determine why, and detailed interviews were conducted with 18 purposively sampled users. Updates were then made according to adaptive trial design methodology.

Results

This systematic co-design process resulted in a web-based resource based on acceptance and commitment therapy and designed to overcome barriers to engagement with traditional mental health and well-being strategies—ifarmwell. It was considered an accessible and confidential source of practical and relevant farmer-focused self-help strategies. These strategies were delivered via 5 interactive modules that include written, drawn, and audio- and video-based psychoeducation and exercises, as well as farming-related jokes, metaphors, examples, and imagery. Module 1 included distress screening and information on how to speak to general practitioners about mental health–related concerns (including a personalized conversation script). Modules were completed fortnightly. SMS text messages offered personalized support and reminders. Qualitative interviews and star ratings demonstrated high module acceptability (average 4.06/5 rating) and suggested that additional reminders, higher quality audio recordings, and shorter modules would be useful. Approximately 37.1% (52/140) of users who started module 1 completed all modules, with too busy or not got to it yet being the main reason for non-completion, and previous module acceptability not predicting subsequent module completion.

Conclusions

Sequential integration of research evidence, expert knowledge, and farmers’ preferences in the co-design process allowed for the development of a self-help intervention that focused on important intervention targets and was acceptable to this difficult-to-engage group.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12617000506392; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372526

Co-creation with research participants to inform the design of electronic informed consent

Objective

This study aimed to provide recommendations for a personalized electronic informed consent interface that is adapted to research participants’ needs and could enable a longitudinal interaction between the participants and the research team.

Methods

The co-creation process consisted of three co-creation workshops, one focus group discussion, and four semi-structured interviews. In total, 24 participants, who had taken part in four disparate clinical studies in Belgium, were involved. Descriptive statistics and qualitative content analysis were applied to analyze the survey data and audio recordings.

Results

Varying perceptions on the type and amount of information described in an informed consent form were reported. Other findings were related to the structure and presentation of information, setting preferences for data sharing, and electronically signing new informed consent versions. Regarding the long-term interaction, most of the participants wanted to receive progress updates, including the results, of the study in which they had taken part. They proposed to receive a notification, preferably via email, in case new information is made available on the electronic informed consent interface.

Conclusions

To optimally support the design of an electronic informed consent interface, it is key to understand the research participants’ needs. Study findings suggest that an electronic informed consent interface may be a promising technological application to interactively provide study-related information and to keep participants informed during and after the clinical study.

Examining the Preliminary Effectiveness and Acceptability of a Web-Based Training Program for Australian Secondary School Teachers: Pilot Study of the BEAM (Building Educators' Skills in Adolescent Mental Health) Program

BACKGROUND

Secondary schools are increasingly supporting adolescents' mental health and well-being, yet many teachers report that they lack the skills and confidence to do so. Building Educators' skills in Adolescent Mental Health (BEAM) is a web-based training program developed to improve secondary school teachers' knowledge and confidence in caring for students' mental health.

OBJECTIVE

This pilot study examined the preliminary effectiveness and acceptability of the BEAM program for improving mental health knowledge, attitudes, confidence, helping behaviors, and psychological distress among secondary school teachers.

METHODS

A single-arm pilot trial was conducted from July to December 2019 among secondary school teachers located in New South Wales, Australia, who were employed in leadership positions responsible for managing student well-being (ie, Year Advisors). Participants had access to the BEAM program for 6 weeks. Self-report surveys, delivered at baseline, postintervention (6-weeks post baseline) and 3-month follow-up (19 weeks post baseline) were used to measure changes in training outcomes. Acceptability was assessed by program use, barriers, satisfaction, and participants' perceptions of program effectiveness.

RESULTS

A total of 70 secondary school teachers took part (mean age 36.5 years, SD 9.41 years, range 24-60 years). Significant improvements in confidence were reported at postintervention and 3-month follow-up. Significant improvements in helping behaviors were reported at 3-month follow-up only. There was also a significant reduction in psychological distress at postintervention. Participants agreed that the program content was easy to understand and relevant, but program completion was challenged by lack of time, competing priorities, and forgetfulness.

CONCLUSIONS

Findings indicated that a web-based training program may be beneficial for improving secondary school teachers' abilities to care for students' mental health; however, program modifications are required to increase training completions.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12619000821190, Universal Trial Number U1111-1232-7680; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377529.

Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment

Background

Web-based patient education is increasingly offered to improve patients’ ability to learn, remember, and apply health information. Efficient organization, display, and structural design, that is, information architecture (IA), can support patients’ ability to independently use web-based patient education. However, the role of IA in the context of web-based patient education has not been examined systematically.

Objective

To support intervention designers in making informed choices that enhance patients’ learning, this paper describes a randomized experiment on the effects of IA on the effectiveness, use, and user experience of a patient education website and examines the theoretical mechanisms that explain these effects.

Methods

Middle-aged and older adults with self-reported hip or knee joint complaints were recruited to use and evaluate 1 of 3 patient education websites containing information on total joint replacement surgery. Each website contained the same textual content based on an existing leaflet but differed in the employed IA design (tunnel, hierarchical, or matrix design). Participants rated the websites on satisfaction, engagement, control, relevance, trust, and novelty and completed an objective knowledge test. Analyses of variance and structural equation modeling were used to examine the effects of IA and construct a theoretical model.

Results

We included 215 participants in our analysis. IA did not affect knowledge gain (P=.36) or overall satisfaction (P=.07) directly. However, tunnel (mean 3.22, SD 0.67) and matrix (mean 3.17, SD 0.69) architectures were found to provide more emotional support compared with hierarchical architectures (mean 2.86, SD 0.60; P=.002). Furthermore, increased perceptions of personal relevance in the tunnel IA (β=.18) were found to improve satisfaction (β=.17) indirectly. Increased perceptions of active control in the matrix IA (β=.11) also improved satisfaction (β=.27) indirectly. The final model of the IA effects explained 74.3% of the variance in satisfaction and 6.8% of the variance in knowledge and achieved excellent fit (χ²_17,215=14.7; P=.62; root mean square error of approximation=0.000; 95% CI [0.000-0.053]; comparative fit index=1.00; standardized root mean square residual=0.044).

Conclusions

IA has small but notable effects on users’ experiences with web-based health education interventions. Web-based patient education designers can employ tunnel IA designs to guide users through sequentially ordered content or matrix IA to offer users more control over navigation. Both improve user satisfaction by increasing user perceptions of relevance (tunnel) and active control (matrix). Although additional research is needed, hierarchical IA designs are currently not recommended, as hierarchical content is perceived as less supportive, engaging, and relevant, which may diminish the use and, in turn, the effect of the educational intervention.

Adaptive Elements in Internet-Delivered Psychological Treatment Systems: Systematic Review

BACKGROUND

Internet-delivered psychological treatments (IDPTs) are built on evidence-based psychological treatment models, such as cognitive behavioral therapy, and are adjusted for internet use. The use of internet technologies has the potential to increase access to evidence-based mental health services for a larger proportion of the population with the use of fewer resources. However, despite extensive evidence that internet interventions can be effective in the treatment of mental health disorders, user adherence to such internet intervention is suboptimal.

OBJECTIVE

This review aimed to (1) inspect and identify the adaptive elements of IDPT for mental health disorders, (2) examine how system adaptation influences the efficacy of IDPT on mental health treatments, (3) identify the information architecture, adaptive dimensions, and strategies for implementing these interventions for mental illness, and (4) use the findings to create a conceptual framework that provides better user adherence and adaptiveness in IDPT for mental health issues.

METHODS

The review followed the guidelines from Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The research databases Medline (PubMed), ACM Digital Library, PsycINFO, CINAHL, and Cochrane were searched for studies dating from January 2000 to January 2020. Based on predetermined selection criteria, data from eligible studies were analyzed.

RESULTS

A total of 3341 studies were initially identified based on the inclusion criteria. Following a review of the title, abstract, and full text, 31 studies that fulfilled the inclusion criteria were selected, most of which described attempts to tailor interventions for mental health disorders. The most common adaptive elements were feedback messages to patients from therapists and intervention content. However, how these elements contribute to the efficacy of IDPT in mental health were not reported. The most common information architecture used by studies was tunnel-based, although a number of studies did not report the choice of information architecture used. Rule-based strategies were the most common adaptive strategies used by these studies. All of the studies were broadly grouped into two adaptive dimensions based on user preferences or using performance measures, such as psychometric tests.

CONCLUSIONS

Several studies suggest that adaptive IDPT has the potential to enhance intervention outcomes and increase user adherence. There is a lack of studies reporting design elements, adaptive elements, and adaptive strategies in IDPT systems. Hence, focused research on adaptive IDPT systems and clinical trials to assess their effectiveness are needed.

Are web-based personally tailored physical activity videos more effective than personally tailored text-based interventions? Results from the three-arm randomised controlled TaylorActive trial

Objectives

Some online, personally tailored, text-based physical activity interventions have proven effective. However, people tend to ‘skim’ and ‘scan’ web-based text rather than thoroughly read their contents. In contrast, online videos are more engaging and popular. We examined whether web-based personally tailored physical activity videos were more effective in promoting physical activity than personally tailored text and generic information.

Methods

501 adults were randomised into a video-tailored intervention, text-tailored intervention or control. Over a 3-month period, intervention groups received access to eight sessions of web-based personally tailored physical activity advice. Only the delivery method differed between intervention groups: tailored video versus tailored text. The primary outcome was 7-day ActiGraph-GT3X+ measured moderate-to-vigorous physical activity (MVPA) assessed at 0, 3 and 9 months. Secondary outcomes included self-reported MVPA and website engagement. Differences were examined using generalised linear mixed models with intention-to-treat and multiple imputation.

Results

Accelerometer-assessed MVPA increased 23% in the control (1.23 (1.06, 1.43)), 12% in the text-tailored (1.12 (0.95, 1.32)) and 28% in the video-tailored (1.28 (1.06, 1.53)) groups at the 3-month follow-up only, though there were no significant between-group differences. Both text-tailored (1.77 (1.37, 2.28]) and video-tailored (1.37 (1.04, 1.79)) groups significantly increased self-reported MVPA more than the control group at 3 months only, but there were no differences between video-tailored and text-tailored groups. The video-tailored group spent significantly more time on the website compared with text-tailored participants (90 vs 77 min, p=0.02).

Conclusions

The personally tailored videos were not more effective than personally tailored text in increasing MVPA. The findings from this study conflict with pilot study outcomes and previous literature. Process evaluation and mediation analyses will provide further insights.

Trial registration number

ACTRN12615000057583

Optimising Web-Based Computer-Tailored Physical Activity Interventions for Prostate Cancer Survivors: A Randomised Controlled Trial Examining the Impact of Website Architecture on User Engagement

BACKGROUND

Web-based computer-tailored interventions can assist prostate cancer survivors to become more physically active by providing personally relevant behaviour change support. This study aimed to explore how changing the website architecture (free choice vs. tunnelled) impacted engagement within a physical activity computer-tailored intervention targeting prostate cancer survivors.

METHODS

On a 2:2:1 ratio, 71 Australian prostate cancer survivors with local or locally advanced disease (mean age: 66.6 years ± 9.66) were randomised into either a free-choice (N = 27), tunnelled (N = 27) or minimal intervention control arm (N =17). The primary outcome was differences in usage of the physical activity self-monitoring and feedback modules between the two intervention arms. Differences in usage of other website components between the two intervention groups were explored as secondary outcomes. Further, secondary outcomes involving comparisons between all study groups (including the control) included usability, personal relevance, and behaviour change.

RESULTS

The average number of physical activity self-monitoring and feedback modules accessed was higher in the tunnelled arm (M 2.6 SD 1.3) compared to the free-choice arm (M 1.5 SD 1.4), p = 0.01. However, free-choice participants were significantly more likely to have engaged with the social support (p = 0.008) and habit formation (p = 0.003) 'once-off' modules compared to the standard tunnelled arm. There were no other between-group differences found for any other study outcomes.

CONCLUSION

This study indicated that website architecture influences behavioural engagement. Further research is needed to examine the impact of differential usage on mechanisms of action and behaviour change.

Does the structure (tunneled vs. free-roam) and content (if-then plans vs. choosing strategies) of a brief online alcohol intervention effect engagement and effectiveness? A randomized controlled trial

Despite the potential of brief online interventions for reducing alcohol consumption, their effectiveness may be compromised by low levels of engagement and the inclusion of ineffective behavior change techniques. To test whether (i) a tunneled version of an intervention (where the content is delivered in a prespecified order) leads to greater engagement and greater reductions in alcohol consumption than a free-roam version (where the content can be viewed in any order) and (ii) forming if-then plans linking strategies to cut down with high-risk situations leads to greater reductions in alcohol consumption than only choosing strategies to cut down. Participants (N = 286 university staff and students) were randomly allocated to one of four versions of a brief online alcohol intervention in a 2 (structure: tunneled vs. free-roam) by 2 (planning: strategies vs. if-then plans) factorial design. Engagement (pages visited, time) was recorded automatically. Alcohol consumption (weekly units) was assessed at baseline and 1- and 6-month follow-up. Participants who received the tunneled version viewed significantly more pages and spent significantly more time on the website than those who received the free-roam version. Significant reductions in alcohol consumption were observed at follow-up; however, neither the structure of the intervention nor planning had a significant effect on reductions in alcohol consumption. Tunneled online interventions can increase engagement, but this may not translate into greater changes in behavior. Further experimental research using factorial designs is needed to identify the key behavior change techniques to include in brief online interventions.

Development of "Advancing People of Color in Clinical Trials Now!": Web-Based Randomized Controlled Trial Protocol

BACKGROUND

Participation in clinical trials among people of color remains low, compared with white subjects. This protocol describes the development of "Advancing People of Color in Clinical Trials Now!" (ACT Now!), a culturally tailored website designed to influence clinical trial decision making among people of color.

OBJECTIVE

This cluster randomized study aims to test the efficacy of a culturally tailored website to increase literacy, self-efficacy, and willingness to enroll in clinical trials among people of color.

METHODS

ACT Now! is a randomized trial including 2 groups: (1) intervention group (n=50) with access to the culturally tailored website and (2) control group (n=50) exposed to a standard clinical recruitment website. Clinical trial literacy and willingness to enroll in a clinical trial will be measured before and after exposure to the website corresponding to their assigned group (intervention or control). Surveys will be conducted at baseline and during the 1-month postintervention and 3-month follow-up. Website architecture and wireframing will be informed by the literature and experts in the field. Statistical analysis will be conducted using a two-tailed t test, with 80% power, at .05 alpha level, to increase clinical trial literacy, self-efficacy, and willingness to enroll in clinical trials 3 months post intervention.

RESULTS

We will design a culturally tailored website that will provide leverage for community stakeholders to influence clinical trial literacy, self-efficacy, and willingness to enroll in clinical trials among racial and ethnic groups. ACT Now! applies a community-based participatory research approach through the use of a community steering committee (CSC). The CSC provides input during the research study conception, development, implementation, and enrollment. CSC relationships help foster trust among communities of color. ACT Now! has the potential to fill a gap in clinical trial enrollment among people of color through an accessible web-based website. This study was funded in July 2017 and obtained institutional review board approval in spring 2017. As of December 2019, we had enrolled 100 participants. Data analyses are expected to be completed by June 2020, and expected results are to be published in fall 2020.

CONCLUSIONS

ACT Now! has the potential to fill an important gap in clinical trial enrollment among people of color through an accessible web-based website.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03243071; https://clinicaltrials.gov/ct2/show/NCT00102401.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/17589.

Sharing SRP data to reduce environmentally associated disease and promote transdisciplinary research

The National Institute of Environmental Health Sciences (NIEHS) Superfund Basic Research and Training Program (SRP) funds a wide range of projects that span biomedical, environmental sciences, and engineering research and generate a wealth of data resulting from hypothesis-driven research projects. Combining or integrating these diverse data offers an opportunity to uncover new scientific connections that can be used to gain a more comprehensive understanding of the interplay between exposures and health. Integrating and reusing data generated from individual research projects within the program requires harmonization of data workflows, ensuring consistent and robust practices in data stewardship, and embracing data sharing from the onset of data collection and analysis. We describe opportunities to leverage data within the SRP and current SRP efforts to advance data sharing and reuse, including by developing an SRP dataset library and fostering data integration through Data Management and Analysis Cores. We also discuss opportunities to improve public health by identifying parallels in the data captured from health and engineering research, layering data streams for a more comprehensive picture of exposures and disease, and using existing SRP research infrastructure to facilitate and foster data sharing. Importantly, we point out that while the SRP is in a unique position to exploit these opportunities, they can be employed across environmental health research. SRP research teams, which comprise cross-disciplinary scientists focused on similar research questions, are well positioned to use data to leverage previous findings and accelerate the pace of research. Incorporating data streams from different disciplines addressing similar questions can provide a broader understanding and uncover the answers to complex and discrete research questions.

Usage Metrics of Web-Based Interventions Evaluated in Randomized Controlled Trials: Systematic Review

Background

The evaluation of web-based interventions (defined as an intervention that can be downloaded or accessed on the internet through a web browser) in randomized controlled trials (RCTs) has increased over the past two decades. Little is known about how participants’ use of the intervention is measured, reported, and analyzed in these studies.

Objective

This study aimed to review the evaluation of web-based interventions in RCTs, assessing study characteristics and the methods used to record, and adjust for, intervention usage.

Methods

A systematic review of the literature was undertaken to identify all published reports of RCTs that involved a web-based intervention. A random sample of 100 published trials was selected for detailed data extraction. Information on trial characteristics was extracted, including whether web usage data were recorded, and if so, the methods used to gather these data and whether these data were used to inform efficacy analyses.

Results

A PubMed search identified 812 trials of web-based interventions published up to the end of 2017 and demonstrated a growing trend over time. Of the 100 studies reviewed, 90 studies collected web usage data, but more than half (49/90, 54%) of these studies did not state the method used for recording web usage. Only four studies attempted to check on the reliability of their web usage data collection methods. A total of 39% (35/90) studies reported patterns or levels of web intervention use, of which 21% (19/90) studies adjusted for intervention use in their outcome analysis, but only two of these used appropriate statistical methods.

Conclusions

Trialists frequently report a measure of web-based intervention usage but do not always report the collection method or provide enough detail on their analysis of web usage. Appropriate statistical methods to account for intervention use are rarely used and are not well reported even in the very few trials in which they are used. The number of trialists who attempt to check on the reliability of their web usage collection methods is extremely low.

Understanding How Clinicians Use a New Web-based Tool for Disseminating Evidence-Based Practices for the Treatment of PTSD: The PTSD Clinicians Exchange

INTRODUCTION

Web-based interventions hold great promise for the dissemination of best practices to clinicians, and investment in these resources has grown exponentially. Yet, little research exists to understand their impact on intended objectives.

MATERIALS & METHODS

The Post-Traumatic Stress Disorder (PTSD) Clinicians Exchange is a website to support clinicians treating veterans and active duty military personnel with PTSD, evaluated in a randomized controlled trial (N = 605). This manuscript explores how a subset of clinicians, those who utilized the intervention (N = 148), engaged with it by examining detailed individual-level web analytics and qualitative feedback. Stanford University and New England Research Institutes Institutional Review Boards approved this study.

RESULTS

Only 32.7% of clinicians randomized to the intervention ever accessed the website. The number of pages viewed was positively associated with changes from baseline to 12 months in familiarity (P = 0.03) and perceived benefit of practices (P = 0.02). Thus, engagement with the website did predict an improvement in practice familiarity and benefit outcomes despite low rates of use.

CONCLUSIONS

This study demonstrates the importance of methodologically rigorous evaluations of participant engagement with web-based interventions. These approaches provide insight into who accesses these tools, when, how, and with what results, which can be translated into their strategic design, evaluation, and dissemination.

Development and usability evaluation of an online self-management intervention for fear of cancer recurrence (iConquerFear)

OBJECTIVE

To develop and evaluate the usability of iConquerFear, an online self-management adaptation of an efficacious face-to-face therapist-delivered treatment for fear of cancer recurrence (FCR).

METHODS

iConquerFear development was theory based and person based. Development was guided by Ritterband et al's behaviour change model for internet interventions. iConquerFear end users (cancer survivors) provided iterative feedback in accordance with Yardley et al's person-based approach to maximise engagement and usability. Online focus groups and cognitive interviews were conducted to evaluate the usability of iConquerFear. Discussions were recorded, transcribed verbatim, and thematically analysed.

RESULTS

Five online FCR modules were developed. Twenty-three cancer survivors (47% of those eligible) participated; 11/23 (58%) were breast cancer survivors, and average age was 53 years (SD = 10.8). Thematic saturation was reached after six focus groups (n = 16) and seven individual think-aloud interviews. Thematic analysis produced five overarching themes: easy navigation essential; satisfaction and engagement with content; flexible access is key; normalising and empowering; and a useful first step.

CONCLUSIONS

Online self-management interventions like iConquerFear have the potential to address the unmet supportive care needs reported by burgeoning numbers of cancer survivors. However, that potential may not be realised unless interventions are rigorously developed and user tested, as benefits are constrained by limited engagement. Themes from the usability testing of iConquerFear highlight the importance of developing flexible, tailored, interactive, and contextual online self-management interventions for people with cancer.

"WALK30X5": a feasibility study of a physiotherapy walking programme for people with mild to moderate musculoskeletal conditions

OBJECTIVES

To explore the feasibility of delivering and evaluating a web-based walking intervention for people with long term musculoskeletal conditions (LTMCs), to determine its acceptability and the feasibility of conducting a definitive trial.

DESIGN

Prospective randomised feasibility study, with blind outcome assessment at baseline, 3 and 6 months.

SETTING

Hospital based physiotherapy service.

PARTICIPANTS

Forty one adults referred for assessment and advice for any mild/moderate LTMCs. doing <120minutes of moderate intensity activity per week.

INTERVENTIONS

Participants randomised to: 1. Usual care: one usual physiotherapy advice and assessment session, including setting a physical activity goal and one follow up session (8 weeks). 2. "Walk30×5": session one, usual care plus intervention of walking programme. Participants were shown the website and podcasts and practiced how to use them. One follow up session (8 weeks).

OUTCOME MEASURES

Primary: timed six minute walk test (T6MWT). Secondary: step count, self-reported pain, fatigue, mood, self-efficacy, happiness, objective blood pressure, peak expiratory flow rate, and self-report and accelerometer measured physical activity.

RESULTS

Recruitment target achieved. No adverse events occurred. Adherence was high and the intervention acceptable. Loss to follow up n=3 (7%) at 3 months, n=8 (20%) at 6 months. T6MWT and step count proved suitable outcomes, unlike accelerometry. Estimated sample size for a definitive trial is 216.

CONCLUSIONS

"Walk30×5" is ready for evaluation in a future, appropriately powered (n=216), phase III trial. If effective, the intervention will provide a cheap, highly accessible intervention to enable people with mild/moderate LTMCs to achieve UK physical activity guidelines.

CLINICAL TRIAL REGISTRATION NUMBER

ISRCTN78581097.

Outcomes and Device Usage for Fully Automated Internet Interventions Designed for a Smartphone or Personal Computer: The MobileQuit Smoking Cessation Randomized Controlled Trial

Background

Many best practice smoking cessation programs use fully automated internet interventions designed for nonmobile personal computers (desktop computers, laptops, and tablets). A relatively small number of smoking cessation interventions have been designed specifically for mobile devices such as smartphones.

Objective

This study examined the efficacy and usage patterns of two internet-based best practices smoking cessation interventions.

Methods

Overall, 1271 smokers who wanted to quit were randomly assigned to (1) MobileQuit (designed for—and constrained its use to—mobile devices, included text messaging, and embodied tunnel information architecture) or (2) QuitOnline (designed for nonmobile desktop or tablet computers, did not include text messages, and used a flexible hybrid matrix-hierarchical information architecture). Primary outcomes included self-reported 7-day point-prevalence smoking abstinence at 3- and 6-month follow-up assessments. Program visits were unobtrusively assessed (frequency, duration, and device used for access).

Results

Significantly more MobileQuit participants than QuitOnline participants reported quitting smoking. Abstinence rates using intention-to-treat analysis were 20.7% (131/633) vs 11.4% (73/638) at 3 months, 24.6% (156/633) vs 19.3% (123/638) at 6 months, and 15.8% (100/633) vs 8.8% (56/638) for both 3 and 6 months. Using Complete Cases, MobileQuit’s advantage was significant at 3 months (45.6% [131/287] vs 28.4% [73/257]) and the combined 3 and 6 months (40.5% [100/247] vs 25.9% [56/216]) but not at 6 months (43.5% [156/359] vs 34.4% [123/329]). Participants in both conditions reported their program was usable and helpful. MobileQuit participants visited their program 5 times more frequently than did QuitOnline participants. Consistent with the MobileQuit’s built-in constraint, 89.46% (8820/9859) of its visits were made on an intended mobile device, whereas 47.72% (691/1448) of visits to QuitOnline used an intended nonmobile device. Among MobileQuit participants, 76.0% (459/604) used only an intended mobile device, 23.0% (139/604) used both mobile and nonmobile devices, and 0.1% (6/604) used only a nonmobile device. Among QuitOnline participants, 31.3% (137/438) used only the intended nonmobile devices, 16.7% (73/438) used both mobile and nonmobile devices, and 52.1% (228/438) used only mobile devices (primarily smartphones).

Conclusions

This study provides evidence for optimizing intervention design for smartphones over a usual care internet approach in which interventions are designed primarily for use on nonmobile devices such as desktop computers, laptops. or tablets. We propose that future internet interventions should be designed for use on all of the devices (multiple screens) that users prefer. We forecast that the approach of designing internet interventions for mobile vs nonmobile devices will be replaced by internet interventions that use a single Web app designed to be responsive (adapt to different screen sizes and operating systems), share user data across devices, embody a pervasive information architecture, and complemented by text message notifications.

Trial Registration

ClinicalTrials.gov NCT01952236; https://clinicaltrials.gov/ct2/show/NCT01952236 (Archived by WebCite at http://www.webcitation.org/6zdSxqbf8)

Exploring the Challenges of Implementing a Web-Based Telemonitoring Strategy for Teenagers With Inflammatory Bowel Disease: Empirical Case Study

BACKGROUND

We designed a telemonitoring strategy for teenagers with inflammatory bowel disease to prevent an anticipated disease flare and avert unplanned office visits and day care procedures. The strategy was evaluated in a randomized controlled trial that involved 11 Dutch pediatric gastroenterology centers, each using repeated symptom scores and stool calprotectin measurements. In the telemonitoring arm of the trial, teenagers (n=84) as well as their health providers were alerted to out-of-range results, and suggestions for change in therapy were offered. We demonstrated that the technology was a safe and cost saving alternative to health checks by the specialist at fixed intervals.

OBJECTIVE

The aim of this study was to evaluate whether we could move our telemonitoring strategy from a demonstration project to one that is sustained within existing sites.

METHODS

In this empirical case study, we used the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework to explore the challenges to implementing our strategy. The framework distinguishes 7 domains: (1) the illness, (2) the technology, (3) the value proposition, (4) the adopter system, (5) the organization, (6) the societal system, and (7) the time dimension. We summarized the challenges across all 7 domains and classified them as simple (+++), complicated (++), or complex (+). Technologies in which multiple domains are complicated have proven difficult to implement, whereas those with multiple complex domains may not even become mainstreamed.

RESULTS

The technology that we used and the linked program (IBD-live) allowed us to select and target the teenagers who were most likely to benefit from a face-to-face encounter with their specialist (+++). The value proposition of the technology was clear, with a distinct benefit for patients and an affordable service model, but health providers had plausible personal reasons to resist (double data entry, ++). The organization was not yet ready for the innovation, as it requires a shift to new ways of working (+). We had no concerns about reimbursement, as Dutch health insurers agreed that screen-to-screen consultations will be reimbursed at a rate equivalent to face-to-face consultations (+++). Finally, the technology was considered easy to adapt and evolve over time to meet the needs of its users (+++).

CONCLUSIONS

The challenges to be addressed are merely complicated (++) rather than complex (+), which means that our program may be difficult but not impossible to sustain within existing sites. After integrating the technology and its use with local workflows first, we believe that our telemonitoring strategy will be ready for sustained adoption. In contrast with what we did ourselves, we recommend others to use the NASSS framework prospectively and in real time to predict and explore the challenges to implementing new technologies.