Adaptation of a Group-Based HIV RISK Reduction Intervention to a Mobile App for Young Sexual Minority Men

Development and evaluation of visualizations of smoking data for integration into the Sense2Quit app for tobacco cessation

IMPORTANCE

Due to insufficient smoking cessation apps for persons living with HIV, our study focused on designing and testing the Sense2Quit app, a patient-facing mHealth tool which integrated visualizations of patient information, specifically smoking use.

OBJECTIVES

The purpose of this paper is to detail rigorous human-centered design methods to develop and refine visualizations of smoking data and the contents and user interface of the Sense2Quit app. The Sense2Quit app was created to support tobacco cessation and relapse prevention for people living with HIV.

MATERIALS AND METHODS

Twenty people living with HIV who are current or former smokers and 5 informaticians trained in human-computer interaction participated in 5 rounds of usability testing. Participants tested the Sense2Quit app with use cases and provided feedback and then completed a survey.

RESULTS

Visualization of smoking behaviors was refined through each round of usability testing. Further, additional features such as daily tips, games, and a homescreen were added to improve the usability of the app. A total of 66 changes were made to the Sense2Quit app based on end-user and expert recommendations.

DISCUSSION

While many themes overlapped between usability testing with end-users and heuristic evaluations, there were also discrepancies. End-users and experts approached the app evaluation from different perspectives which ultimately allowed us to fill knowledge gaps and make improvements to the app.

CONCLUSION

Findings from our study illustrate the best practices for usability testing for development and refinement of an mHealth-delivered consumer informatics tool for improving tobacco cessation yet further research is needed to fully evaluate how tools informed by target user needs improve health outcomes.

Efficacy of MyPEEPS Mobile, an HIV Prevention Intervention Using Mobile Technology, on Reducing Sexual Risk Among Same-Sex Attracted Adolescent Males: A Randomized Clinical Trial

IMPORTANCE

HIV transmission rates in the United States have increased among men who have sex with men. However, there are no published randomized trials examining interventions to reduce sexual risk for HIV acquisition in males younger than 18 years.

OBJECTIVE

To determine the efficacy of MyPEEPS Mobile, a mobile-delivered HIV prevention intervention, to reduce sexual risk behavior in same-sex attracted young males.

DESIGN, SETTING, AND PARTICIPANTS

This was a national randomized clinical trial of the efficacy MyPEEPS Mobile vs a delayed intervention among males aged 13 to 18 years to prevent or reduce sexual risk for HIV acquisition. Study activities were completed through 4 study sites in Birmingham, Alabama; New York, New York; Seattle, Washington; and Chicago, Illinois. Study staff at each site met with participants in person or via video conferencing. Data were collected from June 1, 2018, to April 7, 2020, and analyzed from July to October 2021.

INTERVENTIONS

The MyPEEPS Mobile intervention contains 21 online psychoeducational and skill-building modules, which participants completed over a 3-month period. Participants randomized to the intervention group received access to MyPEEPS Mobile for the first 3 months, while those randomized to the delayed intervention group received access at their 9-month visit after data for the primary efficacy analysis had been collected.

MAIN OUTCOMES AND MEASURES

The self-reported primary outcome was change in the number of condomless anal sex acts between study conditions. Secondary outcomes were change in the number of sex partners, number of condomless anal sex partners, the number of sex acts while under the influence of substances, preexposure prophylactic uptake, nonoccupational postexposure prophylaxis use, and HIV and sexually transmitted infection testing.

RESULTS

In the analytic sample of 763 racially and ethnically diverse study participants, the mean (SD) age was 16.2 (1.4) years; 736 participants (97%) were male, 13 (2%) nonbinary; and 6 (1%) genderqueer; 158 (21%) were Black or African American, 311 (41%) were Hispanic or Latino, and 284 (37%) were White. Overall, 382 were randomized to the intervention group and 381 to the delayed intervention group. At 3-month follow-up, there was a significant reduction in the number of condomless anal sex acts in the intervention group compared with the delayed intervention group (incidence rate ratio [IRR], 0.56; 95% CI, 0.32-0.99); however, there was no significant difference between groups at 6 or 9 months. In subgroup analyses, the intervention effect was pronounced among Black non-Hispanic participants at 3-month follow-up (IRR, 0.19; 95% CI, 0.04-0.94) and 6-month follow-up (IRR, 0.15; 95% CI, 0.03-0.78) compared with the delayed intervention group. There were no significant differences in the change in the number of sex partners, number of condomless anal sex partners, the number of sex acts while under the influence of substances, preexposure prophylactic uptake, nonoccupational postexposure prophylaxis use, and HIV and sexually transmitted infection testing between the intervention and delayed intervention groups.

CONCLUSIONS AND RELEVANCE

In this study, the MyPEEPS Mobile intervention demonstrated a 44% overall reduction in condomless anal sex at 3-month follow-up compared with the delayed intervention group, but not at 6 or 9 months. To our knowledge, MyPEEPS Mobile is the first intervention to demonstrate evidence of short-term efficacy for reducing sexual risk among same-sex attracted young males.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03167606.

mHealth to reduce HIV-related stigma among youth in the United States: a scoping review

Multiple intersecting stigmas and discrimination related to sex, gender, HIV, and race/ethnicity may challenge HIV prevention and treatment service utilization, particularly among youth. This scoping review describes recent and ongoing innovative mobile health (mHealth) interventions among youth in the United States that aim to reduce stigma as an outcome or as part of the intervention model. To identify examples of stigma-mitigation via mHealth, we searched peer-reviewed published literature using keyword strategies related to mHealth, HIV, stigma, and youth (ages 10 to 29). We identified eleven articles that met our inclusion criteria, including three describing data from two randomized controlled trials (RCTs), five describing pilot studies, one describing the process evaluation of an ongoing intervention, one describing formative work for intervention development, and one published study protocol for an ongoing intervention. We review these articles, grouped by HIV prevention and care continuum stages, and describe the mHealth approach used, including telehealth, simulation video games, motion comics, smartphone applications (apps), social media forums, online video campaigns, video vignettes, and a computerized behavioral learning module. Four studies focused on preventing primary acquisition through individual-level behavior change (e.g., reducing condomless anal intercourse), three focused on increasing HIV testing, three focused on linking to prevention services [e.g., pre-exposure prophylaxis (PrEP) and post-exposure prophylaxis (PEP)] and one focused on promoting adherence to antiretroviral therapy (ART). Our review did not identify any published studies using mHealth with a primary aim to reduce stigma as a way to improve care engagement and increase viral suppression among youth in the United States. Additional RCTs and implementation studies examining the effectiveness of mHealth stigma-reduction interventions on HIV-related outcomes are needed to end the HIV epidemic among youth. mHealth offers unique advantages to address the complex intersecting stigma barriers along the HIV continuum to improve HIV-related outcomes for youth.

Increasing HIV Testing and Viral Suppression via Stigma Reduction in a Social Networking Mobile Health Intervention Among Black and Latinx Young Men and Transgender Women Who Have Sex With Men (HealthMpowerment): Protocol for a Randomized Controlled Trial

BACKGROUND

Stigma and discrimination related to sexuality, race, ethnicity, and HIV status negatively impact HIV testing, engagement in care, and consistent viral suppression (VS) among young Black and Latinx men who have sex with men and transgender women who have sex with men (YBLMT). Few interventions address the effects of intersectional stigma among youth living with HIV and those at risk for HIV within the same virtual space.

OBJECTIVE

Building on the success of the HealthMpowerment (HMP) mobile health (mHealth) intervention (HMP 1.0) and with the input of a youth advisory board, HMP 2.0 is an app-based intervention that promotes user-generated content and social support to reduce intersectional stigma and improve HIV-related outcomes among YBLMT. The primary objective of this study is to test whether participants randomized to HMP 2.0 report improvement in HIV prevention and care continuum outcomes compared with an information-only control arm. We will also explore whether participant engagement, as measured by paradata (data collected as users interact with an mHealth intervention, eg, time spent using the intervention), mediates stigma- and HIV care-related outcomes. Finally, we will assess whether changes in intersectional stigma and improvements in HIV care continuum outcomes vary across different types of social networks formed within the intervention study arms.

METHODS

We will enroll 1050 YBLMT aged 15 to 29 years affected by HIV across the United States. Using an HIV-status stratified, randomized trial design, participants will be randomly assigned to 1 of the 3 app-based conditions (information-only app-based control arm, a researcher-created network arm of HMP 2.0, or a peer-referred network arm of HMP 2.0). Behavioral assessments will occur at baseline, 3, 6, 9, and 12 months. For participants living with HIV, self-collected biomarkers (viral load) are scheduled for baseline, 6, and 12 months. For HIV-negative participants, up to 3 HIV self-testing kits will be available during the study period.

RESULTS

Research activities began in September 2018 and are ongoing. The University of Pennsylvania is the central institutional review board for this study (protocol #829805) with institutional reliance agreements with the University of North Carolina at Chapel Hill, Duke University, and SUNY Downstate Health Sciences University. Study recruitment began on July 20, 2020. A total of 205 participants have been enrolled as of November 20, 2020.

CONCLUSIONS

Among a large sample of US-based YBLMT, this study will assess whether HMP 2.0, an app-based intervention designed to ameliorate stigma and its negative sequelae, can increase routine HIV testing among HIV-negative participants and consistent VS among participants living with HIV. If efficacious and brought to scale, this intervention has the potential to significantly impact the disproportionate burden of HIV among YBLMT in the United States.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03678181; https://clinicaltrials.gov/ct2/show/study/NCT03678181.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/24043.

Awareness, Willingness, and Perceived Efficacy of Pre-exposure Prophylaxis among Adolescent Sexual Minority Males

Despite the approval of PrEP for adolescents by the FDA in 2018, little is known about the awareness and attitudes about PrEP use among adolescent sexual minority males, who are at the greatest risk for HIV. We analyzed baseline data from the MyPEEPS Mobile study, a multi-site randomized controlled trial evaluating the effectiveness of a mobile behavioral HIV prevention intervention. A substantial proportion (68.2%) of study participants (ages 13-18) had previously heard about PrEP, and an overwhelming majority (90.8%) reported willingness to take PrEP, to prevent HIV. On the other hand, only about one third (34.6%) of participants indicated that taking a daily HIV pill would be "very" or "completely" effective in preventing HIV when having sex without a condom. These findings suggest that high awareness and willingness to use PrEP across various adolescent subgroups present opportunities for increased PrEP advocacy among this young age group.

A Mobile Sexual Health App on Empowerment, Education, and Prevention for Young Adult Men (MyPEEPS Mobile): Acceptability and Usability Evaluation

Background

HIV incidence among young adult men who have sex with men (MSM), particularly among black and Latino men, continues to rise. As such, continued HIV prevention interventions for young MSM of color are of utmost importance. Male Youth Pursuing Empowerment, Education and Prevention around Sexuality (MyPEEPS) Mobile is a comprehensive HIV prevention and sexual health education smartphone app initially created to promote sexual health and HIV prevention among adolescent sexual minority young men aged 13 to 18 years.

Objective

The objective of this study was to critically appraise the acceptability and usability of MyPEEPS Mobile for young adult MSM aged 19 to 25 years.

Methods

Study participants used the mobile app, completed usability questionnaires and in-depth interviews, and reported their experience using the app. Analysis of interview data was guided by the Unified Theory of Acceptance and Use of Technology (UTAUT) to better understand the usability and acceptability of this intervention for young adults. Interview data were coded using the following constructs from the UTAUT model: performance expectancy, effort expectancy, and social influence.

Results

A total of 20 young adult MSM (n=10 in Chicago, Illinois, and n=10 in New York, New York) were enrolled in the study. Participants reported that MyPEEPS Mobile was free of functional problems (Health Information Technology Usability Evaluation Scale scores and Post-Study System Usability Questionnaire scores consistent with high usability), easy to use, and useful, with an engaging approach that increased acceptability, including the use of avatars and animation, and inclusive representation of the diverse identities by race and ethnicity, gender identity, and sexual orientation. Recommended areas for improving MyPEEPS Mobile for the target demographic included more adult-oriented graphics, advanced educational content, scenarios for youth with more sexual experience, and search function to increase accessibility of key content.

Conclusions

Overall, young adult MSM aged 19 to 25 years described the MyPEEPS Mobile as educational, informative, and usable for their sexual health education and HIV prevention needs, and they provided actionable recommendations to optimize its use and applicability for this age group.

A randomized controlled efficacy trial of an mHealth HIV prevention intervention for sexual minority young men: MyPEEPS mobile study protocol

BACKGROUND

Young sexual minority men in the United States have a high incidence rate of HIV infection. Early intervention among this group, that is timed to precede or coincide with sexual initiation, is of critical importance to prevent HIV infection. Despite this, there are very few published randomized controlled efficacy trials testing interventions to reduce sexual vulnerability for HIV acquisition among racially/ethnically diverse, very young, sexual minority men (aged ≤18 years). This paper describes the design of a mobile app-based intervention trial to reduce sexual risk for HIV acquisition and promote health protection in this group.

METHODS

This study is a randomized controlled trial of an mHealth-based HIV prevention intervention, MyPEEPS Mobile, among diverse sexual minority cisgender young men, aged 13-18 years. The mobile intervention was adapted from a prior group-based intervention curriculum with evidence of efficacy, designed to be specific to the risk contexts and realities of young sexual minority men, and to include psychoeducational and skill-building components with interactive games and activities. Participants are recruited locally within four regional hubs (Birmingham, AL, Chicago, IL, New York City, NY, Seattle, WA) and nationwide via the Internet, enrolled in-person or remotely (via videoconference), and randomized (1:1) to either the MyPEEPS Mobile intervention or delayed intervention condition. Post-hoc stratification by age, race/ethnicity, and urban/suburban vs. rural statuses is used to ensure diversity in the sample. The primary outcomes are number of male anal sex partners and frequency of sexual acts with male partners (with and without condoms), sex under the influence of substances, and uptake of pre-and post-exposure prophylaxis, as well as testing for HIV and other sexually transmitted infections at 3-, 6- and 9-month follow-up.

DISCUSSION

Behavioral interventions for very young sexual minority men are needed to prevent sexual risk early in their sexual development and maturation. This study will provide evidence to determine feasibility and efficacy of a mobile app-based HIV prevention intervention to reduce sexual risk among this very young group.

TRIAL REGISTRATION

ClinicalTrials.gov number, NCT03167606, registered May 30, 2017.

Eye-tracking retrospective think-aloud as a novel approach for a usability evaluation

OBJECTIVE

To report on the use of an eye-tracking retrospective think-aloud for usability evaluation and to describe its application in assessing the usability of a mobile health app.

MATERIALS AND METHODS

We used an eye-tracking retrospective think-aloud to evaluate the usability of an HIV prevention mobile app among 20 young men (15-18 years) in New York City, NY; Birmingham, AL; and Chicago, IL. Task performance metrics, critical errors, a task completion rate per participant, and a task completion rate per task, were measured. Eye-tracking metrics including fixation, saccades, time to first fixation, time spent, and revisits were measured and compared among participants with/without a critical error.

RESULTS

Using task performance analysis, we identified 19 critical errors on four activities, and of those, two activities had a task completion rate of less than 78%. To better understand these usability issues, we thoroughly analyzed participants' corresponding eye movements and verbal comments using an in-depth problem analysis. In areas of interest created for the activity with critical usability problems, there were significant differences in time spent (p = 0.008), revisits (p = 0.004), and total numbers of fixations (p = 0.007) by participants with/without a critical error. The overall mean score of perceived usability rated by the Health IT Usability Evaluation Scale was 4.64 (SD = 0.33), reflecting strong usability of the app.

DISCUSSION AND CONCLUSION

An eye-tracking retrospective think-aloud enabled us to identify critical usability problems as well as gain an in-depth understanding of the usability issues related to interactions between end-users and the app. Findings from this study highlight the utility of an eye-tracking retrospective think-aloud in consumer health usability evaluation research.

Pilot feasibility trial of the MyPEEPS mobile app to reduce sexual risk among young men in 4 cities

Objectives

Our study team adapted the MyPEEPS (Male Youth Pursuing Empowerment, Education, and Prevention around Sexuality) curriculum, an evidence-based human immunodeficiency virus (HIV) prevention intervention, from a face-to-face, group-based intervention to an individual-level mobile responsive web-based intervention to improve HIV risk behaviors in very young men, aged 13–18 years.

Materials and methods

In adapting the MyPEEPS intervention to mobile app, we used a series of methodologies, including expert panel reviews, weekly team meetings with the software development company, and conducted in-depth interviews with very young men. Following the iterative process, we conducted a 6-week pre–post feasibility pilot trial with 40 young men in Birmingham, AL; Chicago, IL; New York City, NY; and Seattle, WA. Primary outcomes of interest were uptake of the app, accessibility and satisfaction.

Results

Across all 4 sites, 62.5% (25/40) of participants completed all modules in the app in an average of 28.85 (SD 21.69) days. Participants who did not attend to the follow-up visit did not complete any of the app modules. Overall participants reported that the app was easy to use, useful and has the potential to improve their sexual health knowledge and behavior and awareness in risky contexts. Participants also highly rated the app, information and interface quality of the app.

Discussion

Lessons learned from the pilot included the need for reminder systems and providing anticipatory guidance about Internet connectivity when using the app. These changes will be incorporated into study procedures for our multisite trial.

Conclusion

Overall, participants found the app to be highly usable and have the potential to positively improve their sexual risk behavior.