Use and Appreciation of a Web-Based, Tailored Intervention (E-health4Uth) Combined With Counseling to Promote Adolescents' Health in Preventive Youth Health Care: Survey and Log-File Analysis

Barriers to and facilitators of user engagement with web-based mental health interventions in young people: a systematic review

Many young people (YP) are diagnosed with mental illnesses and require support. Web-based mental health interventions (W-MHIs) have been increasingly utilized by YP, healthcare providers, and parents due to reasons including convenience and anonymity. W-MHIs are effective in improving mental health in YP. However, real-world engagement with W-MHIs remains low. Therefore, understanding barriers/facilitators of user engagement with W-MHIs is necessary to promote W-MHIs and help users gain optimal benefits through higher engagement. This review aims to identify barriers/facilitators of user engagement with W-MHIs in YP aged 10-24 years. A systematic search of five databases for English language, peer-reviewed publications was conducted between January 2010 and February 2023. Studies examining factors influencing user engagement with W-MHIs, described as barriers or facilitators, were included. Study quality was assessed using the Mixed Methods Appraisal Tool. A narrative synthesis was performed. Of 4088 articles identified, 69 studies were included. Barriers/facilitators were reported by young people (63 studies), providers (17 studies), and parents/caregivers (8 studies). YP perceived that usefulness and connectedness were the most common facilitators, whereas low-perceived need was the most reported barrier. Both providers and parents reported that perceived usefulness for YP was the most common facilitator, whereas concerns about program effectiveness and privacy were noted as barriers. This review found that program- and individual-related factors were important determinants of engagement with W-MHIs. This review provides guidance on the future design and development of new interventions, narrowing the gap between existing W-MHIs and unmet needs of users.

Establishing a Working Definition of User Experience for eHealth Interventions of Self-reported User Experience Measures With eHealth Researchers and Adolescents: Scoping Review

BACKGROUND

Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions.

OBJECTIVE

We conduct a scoping review with subsequent Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations.

METHODS

We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study. Review findings subsequently informed the survey questions used in the Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured.

RESULTS

Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the review. A total of 30 eHealth researchers and 27 adolescents participated in the Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains.

CONCLUSIONS

Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.

Co-creating a large-scale adolescent health survey integrated with access to digital health interventions

Aim

This paper describes how we engaged with adolescents and health providers to integrate access to digital health interventions as part of a large-scale secondary school health and wellbeing survey in New Zealand.

Methods

We conducted nine participatory, iterative co-design sessions involving 29 adolescents, and two workshops with young people (n = 11), digital and health service providers (n = 11) and researchers (n = 9) to gain insights into end-user perspectives on the concept and how best to integrate digital interventions in to the survey.

Results

Students’ perceived integrating access to digital health interventions into a large-scale youth health survey as acceptable and highly beneficial. They did not want personalized/normative feedback, but thought that every student should be offered all the help options. Participants identified key principles: assurance of confidentiality, usability, participant choice and control, and language. They highlighted wording as important for ease and comfort, and emphasised the importance of user control. Participants expressed that it would be useful and acceptable for survey respondents to receive information about digital help options addressing a range of health and wellbeing topics.

Conclusion

The methodology of adolescent-practitioner-researcher collaboration and partnership was central to this research and provided useful insights for the development and delivery of adolescent health surveys integrated with digital help options. The results from the ongoing study will provide useful data on the impact of digital health interventions integrated in large-scale surveys, as a novel methodology. Future research on engaging with adolescents once interventions are delivered will be useful to explore benefits over time.

Developing young men's wellbeing through community and school-based programs: A systematic review

Boys and young men have unique health-related needs that may be poorly met by existing programs and initiatives. The mismatch between the needs of boys and young men and current service offerings-driven largely by social determinants of health such as masculinity-may stymie health status. This is evidenced through high rates of self-stigma, accidental death or suicide, and low rates of help seeking and health literacy among populations of boys and young men. With growing interest in improving wellbeing and educational outcomes for all young people (including boys and young men), this systematic review aimed to evaluate community and school-based programs with specific focus on program features and outcomes directly relevant to young males aged 12-25 years. Five data-bases were searched; Medline, EMBASE, PsycInfo, ERIC, and ERAD. Articles were included if they evaluated an intervention or program with a general or at-risk sample of young men, and measured a psychological, psychosocial, masculinity, or educational outcome. The majority of the 40 included studies had high quality reporting (62.5%). Synthesised data included theoretical frameworks, intervention characteristics, outcomes, and key results. Of the included studies, 14 were male-focussed programs, with masculinity approaches directed towards program aims and content information. The emergent trend indicated that male-targeted interventions may be more beneficial for young men than gender-neutral programs, however, none of these studies incorporated masculine-specific theory as an overarching framework. Furthermore, only three studies measured masculine-specific variables. Studies were limited by a lack of replication and program refinement approaches. It is concluded that there is significant scope for further development of community and school-based health promotion programs that target young men through incorporation of frameworks that consider the impact of gendered social and environmental determinants of health. Evaluation of these programs will provide researchers and practitioners with the capacity for translating beneficial outcomes into best-practice policy.

Internet-based interventions for smoking cessation

BACKGROUND

Tobacco use is estimated to kill 7 million people a year. Nicotine is highly addictive, but surveys indicate that almost 70% of US and UK smokers would like to stop smoking. Although many smokers attempt to give up on their own, advice from a health professional increases the chances of quitting. As of 2016 there were 3.5 billion Internet users worldwide, making the Internet a potential platform to help people quit smoking.

OBJECTIVES

To determine the effectiveness of Internet-based interventions for smoking cessation, whether intervention effectiveness is altered by tailoring or interactive features, and if there is a difference in effectiveness between adolescents, young adults, and adults.

SEARCH METHODS

We searched the Cochrane Tobacco Addiction Group Specialised Register, which included searches of MEDLINE, Embase and PsycINFO (through OVID). There were no restrictions placed on language, publication status or publication date. The most recent search was conducted in August 2016.

SELECTION CRITERIA

We included randomised controlled trials (RCTs). Participants were people who smoked, with no exclusions based on age, gender, ethnicity, language or health status. Any type of Internet intervention was eligible. The comparison condition could be a no-intervention control, a different Internet intervention, or a non-Internet intervention. To be included, studies must have measured smoking cessation at four weeks or longer.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed and extracted data. We extracted and, where appropriate, pooled smoking cessation outcomes of six-month follow-up or more, reporting short-term outcomes narratively where longer-term outcomes were not available. We reported study effects as a risk ratio (RR) with a 95% confidence interval (CI).We grouped studies according to whether they (1) compared an Internet intervention with a non-active control arm (e.g. printed self-help guides), (2) compared an Internet intervention with an active control arm (e.g. face-to-face counselling), (3) evaluated the addition of behavioural support to an Internet programme, or (4) compared one Internet intervention with another. Where appropriate we grouped studies by age.

MAIN RESULTS

We identified 67 RCTs, including data from over 110,000 participants. We pooled data from 35,969 participants.There were only four RCTs conducted in adolescence or young adults that were eligible for meta-analysis.Results for trials in adults: Eight trials compared a tailored and interactive Internet intervention to a non-active control. Pooled results demonstrated an effect in favour of the intervention (RR 1.15, 95% CI 1.01 to 1.30, n = 6786). However, statistical heterogeneity was high (I2 = 58%) and was unexplained, and the overall quality of evidence was low according to GRADE. Five trials compared an Internet intervention to an active control. The pooled effect estimate favoured the control group, but crossed the null (RR 0.92, 95% CI 0.78 to 1.09, n = 3806, I2 = 0%); GRADE quality rating was moderate. Five studies evaluated an Internet programme plus behavioural support compared to a non-active control (n = 2334). Pooled, these studies indicated a positive effect of the intervention (RR 1.69, 95% CI 1.30 to 2.18). Although statistical heterogeneity was substantial (I2 = 60%) and was unexplained, the GRADE rating was moderate. Four studies evaluated the Internet plus behavioural support compared to active control. None of the studies detected a difference between trial arms (RR 1.00, 95% CI 0.84 to 1.18, n = 2769, I2 = 0%); GRADE rating was moderate. Seven studies compared an interactive or tailored Internet intervention, or both, to an Internet intervention that was not tailored/interactive. Pooled results favoured the interactive or tailored programme, but the estimate crossed the null (RR 1.10, 95% CI 0.99 to 1.22, n = 14,623, I2 = 0%); GRADE rating was moderate. Three studies compared tailored with non-tailored Internet-based messages, compared to non-tailored messages. The tailored messages produced higher cessation rates compared to control, but the estimate was not precise (RR 1.17, 95% CI 0.97 to 1.41, n = 4040), and there was evidence of unexplained substantial statistical heterogeneity (I2 = 57%); GRADE rating was low.Results should be interpreted with caution as we judged some of the included studies to be at high risk of bias.

AUTHORS' CONCLUSIONS

The evidence from trials in adults suggests that interactive and tailored Internet-based interventions with or without additional behavioural support are moderately more effective than non-active controls at six months or longer, but there was no evidence that these interventions were better than other active smoking treatments. However some of the studies were at high risk of bias, and there was evidence of substantial statistical heterogeneity. Treatment effectiveness in younger people is unknown.

Psychometric properties of self-sufficiency assessment tools in adolescents in vocational education

Background

Self-sufficiency is the realisation of an acceptable level of functioning either by the person him/herself or through the adequate organisation of help from informal or formal care providers. Assessment of self-sufficiency for determining an individual’s functional strengths and areas for improvement is increasingly being applied among adolescents in vocational education, a group considered vulnerable with high school dropout rates and often characterised by an accumulation of problems. This study examined the psychometric properties of two instruments, i.e. a self-report questionnaire assessing self-sufficiency and the Self-Sufficiency Matrix for professionals (SSM-D) conducted among adolescents in vocational education.

Methods

The self-report questionnaire used to assess self-sufficiency was completed by 581 adolescents. Professionals completed the SSM-D for 224 of the 581 adolescents. Furthermore, constructs related to the domains of self-sufficiency were assessed with self-report questionnaires and information about school absenteeism was monitored via the school registration system.

Results

For both self-report and professional-report ratings, the internal consistency was satisfactory (Cronbach’α > 0.70) and various minor to strong correlations were found between the domains of self-sufficiency and related constructs. For most of the domains, there was little or no agreement between professionals and adolescents.

Conclusions

Both the self-report questionnaire assessing self-sufficiency and the SSM-D applied in this study seem to possess adequate psychometric properties. The results indicated that adolescents and professionals provide different views of adolescents’ self-sufficiency, which merits further study. In the meantime, we recommend assessment of adolescents’ self-sufficiency by using both the self-report questionnaire and the SSM-D to get a comprehensive measure of adolescents’ self-sufficiency.

Trial registration

Netherlands Trial Register: NTR3545; 30 July 2012.

Electronic supplementary material

The online version of this article (doi:10.1186/s40359-015-0091-2) contains supplementary material, which is available to authorized users.

Socioeconomic gradients in the effects of universal school-based health behaviour interventions: a systematic review of intervention studies

BACKGROUND

Socioeconomic inequalities in health behaviour emerge in early life before tracking into adulthood. Many interventions to improve childhood health behaviours are delivered via schools, often targeting poorer areas. However, targeted approaches may fail to address inequalities within more affluent schools. Little is known about types of universal school-based interventions which make inequalities better or worse.

METHODS

Seven databases were searched using a range of natural language phrases, to identify trials and quasi-experimental evaluations of universal school-based interventions focused on smoking, alcohol, diet and/or physical activity, published from 2008-14. Articles which examined differential effects by socioeconomic status (N = 20) were synthesised using harvest plot methodology. Content analysis of 98 intervention studies examined potential reasons for attention or inattention to effects on inequality.

RESULTS

Searches identified approximately 12,000 hits. Ninety-eight evaluations were identified, including 90 completed studies, of which 20 reported effects on SES inequality. There were substantial geographical biases in reporting of inequality, with only 1 of 23 completed North American studies testing differential effects, compared to 15 out of 52 completed European studies. Studies reported a range of positive, neutral or negative SES gradients in effects. All studies with a negative gradient in effect (i.e. which widened inequality) included educational components alone or in combination with environmental change or family involvement. All studies with positive gradients in effects included environmental change components, alone or combined with education. Effects of multi-level interventions on inequality were inconsistent. Content analyses indicated that in approximately 1 in 4 studies SES inequalities were discussed in defining the problem or rationale for intervention. Other potential barriers to testing effect on inequality included assumptions that universal delivery guaranteed universal effect, or that interventions would work better for poorer groups because they had most to gain.

CONCLUSIONS

Universal school-based interventions may narrow, widen or have no effect on inequality. There is a significant need for more routine testing of the effects of such interventions on inequality to enable firmer conclusions regarding types of interventions which affect inequality.

PROSPERO REGISTRATION NUMBER

CRD42014014548.

Your health, an intervention at senior vocational schools to promote adolescents' health and health behaviors

This study evaluates the appreciation, application and effects of an intervention (Your Health), in which adolescents received a consultation with the school nurse. A cluster randomized controlled trial with an intervention and control group (care-as-usual) was conducted among first-grade senior vocational students. Adolescents (n = 418) completed a questionnaire at baseline and 6-month follow-up assessing health and health behaviors. School absenteeism was monitored via the school registration system. After the consultation, adolescents and nurses evaluated the consultation by questionnaire. Adolescents appreciated being invited for the consultation and gave the consultation a positive mean rating of 8.78 on a 10-point scale. Adolescents rated the other nine items on the appreciation of the consultation also high. In 36.8% of the adolescents, nurses suspected problems. Most often these adolescents were given tailored advice (59.3%) or they were referred to another professional (40.7%). No statistically significant effects of the intervention were found on the health and health behaviors of adolescents. This study supports the use of Your Health as a promising intervention to reach senior vocational students. Future research is needed to evaluate long-term effects and the effects and appreciation of the subsequent help that is offered.

TRIAL REGISTRATION

www.trialregister.nl, NTR3545.

[Preferences in the format of questionnaires and use of the Internet by schoolchildren]

OBJECTIVES

To describe the preferences to complete questionnaires via the internet by schoolchildren, as well as to analyze the attitude towards the use of internet to communicate with health professionals.

METHODS

Cross-sectional study of a school population in Palafolls (Barcelona, n=923) was conducted in October and November 2013. Participants completed both internet and paper versions on a single school day, in random order, and with at least an interval of 2 hours. Preferences to answer internet vs paper version were recorded, along with the willingness to share information with health professionals. Percentages of use preferences and attitudes were estimated, and logistic regression models were fitted to analyze the association with the preferences and willingness to share information with health professionals.

RESULTS

Participation rates were 77% (n=715), of whom 42.4% (38.7 to 46.0) preferred the internet version, and 20.6% (17.6 to 23.6) the paper version. Older children (odds ratio [OR]=0.89, 0.84 to 0.95 for age), and those from families with secondary school (OR=0.63, 0.43 to 0.93), and university degree (OR=0.61, 0.38 to 0.97) were less likely to prefer the internet version, while boys (OR=1.55, 1.10 to 2.16) and those children reporting sedentary habits (OR=1.78, 1.06 to 3.0) were more likely to prefer the internet version. Those scoring higher quality of life (OR=1.03, 1.01-1.05) and not reporting sedentary habits (OR=0.33, 0.15 to 0.73) were factors associated with a positive attitude to share information with health professionals.

CONCLUSIONS

Younger children prefer to use the internet. Although Internet use is very widespread, it is less used to communicate with health professionals.

Effectiveness of a Web-based tailored intervention (E-health4Uth) and consultation to promote adolescents' health: randomized controlled trial

Background

To promote well-being and health behaviors among adolescents, 2 interventions were implemented at 12 secondary schools. Adolescents in the E-health4Uth group received Web-based tailored messages focused on their health behaviors and well-being. Adolescents in the E-health4Uth and consultation group received the same tailored messages, but were subsequently referred to a school nurse for a consultation if they were at risk of mental health problems.

Objective

This study evaluated the effect of E-health4Uth and E-health4Uth and consultation on well-being (ie, mental health status and health-related quality of life) and health behaviors (ie, alcohol and drug use, smoking, safe sex).

Methods

A cluster randomized controlled trial was conducted among third- and fourth-year secondary school students (mean age 15.9, SD 0.69). School classes (clusters) were randomly assigned to (1) E-health4Uth group, (2) E-health4Uth and consultation group, or (3) control group (ie, care as usual). Adolescents completed a questionnaire at baseline and at 4-month follow-up assessing alcohol consumption, smoking, drug use, condom use, mental health via the Strengths and Difficulties Questionnaire (SDQ) and the Youth Self Report (YSR; only measured at follow-up), and health-related quality of life. Multilevel logistic, ordinal, and linear regression analyses were used to reveal differences in health behavior and well-being between the intervention groups and the control group at follow-up. Subsequently, it was explored whether demographics moderated the effects.

Results

Data from 1256 adolescents were analyzed. Compared to the control intervention, the E-health4Uth intervention, as a standalone intervention, showed minor positive results in health-related quality of life (B=2.79, 95% CI 0.72-4.87) and condom use during intercourse among adolescents of Dutch ethnicity (OR 3.59, 95% CI 1.71-7.55) not replicated in the E-health4Uth and consultation group. The E-health4Uth and consultation intervention showed minor positive results in the mental health status of adolescents (SDQ: B=−0.60, 95% CI −1.17 to −0.04), but a negative effect on drug use among boys (OR 0.36, 95% CI 0.13-0.96). In the subgroup of adolescents who were at risk of mental health problems at baseline (and referred for a consultation with the nurse), the E-health4Uth and consultation group showed minor to moderate positive results in mental health status (SDQ: B=−1.79, 95% CI −3.35 to −0.22; YSR: B=−9.11, 95% CI −17.52 to −0.71) and health-related quality of life (B=7.81, 95% CI 2.41-13.21) at follow-up compared to adolescents in the control group who were at risk of mental health problems at baseline.

Conclusions

Findings from this study support the use of the E-health4Uth and consultation intervention in promoting the well-being of adolescents at risk of mental health problems. Future research is needed to further evaluate the effects of the consultation as a standalone intervention, and the dual approach of further tailored eHealth messages and a consultation.

Trial Registration

Nederlands Trial Register: NTR 3596; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=3596 (Archived by WebCite at http://www.webcitation.org/6PmgrPOuv).