Protocol of the randomized control trial: the WiseApp trial for improving health outcomes in PLWH (WiseApp)

Social Marketing Perspective on Participant Recruitment in Informatics-Based Intervention Studies

Effective recruitment strategies are pivotal for informatics-based intervention trials success, particularly for people living with HIV (PLWH), where engagement can be challenging. Although informatics interventions are recognized for improving health outcomes, the effectiveness of their recruitment strategies remains unclear. We investigated the application of a social marketing framework in navigating the nuances of recruitment for informatics-based intervention trials for PLWH by examining participant experiences and perceptions. We used qualitative descriptive methodology to conduct semi-structured interviews with 90 research participants from four informatics-based intervention trials. Directed inductive and deductive content analyses were guided by Howcutt et al.'s social marketing framework on applying the decision-making process to research recruitment. The majority were male (86.7%), living in the Northeast United States (56%), and identified as Black (32%) or White (32%). Most participants (60%) completed the interview remotely. Sixteen subthemes emerged from five themes: motivation, perception, attitude formation, integration, and learning. Findings from our interview data suggest that concepts from Howcutt et al.'s framework informed participants' decisions to participate in an informatics-based intervention trial. We found that the participants' perceptions of trust in the research process were integral to the participants across the four trials. However, the recruitment approach and communication medium preferences varied between older and younger age groups. Social marketing framework can provide insight into improving the research recruitment process. Future work should delve into the complex interplay between the type of informatics-based interventions, trust in the research process, and communication preferences, and how these factors collectively influence participants' willingness to engage.

Comparison of evaluation methods for improving the usability of a Spanish mHealth tool

OBJECTIVE

Mobile health (mHealth) technology is now widely used across health conditions and populations. The rigorous development of these tools has yielded improved health outcomes, yet the ideal approach for developing mHealth tools continues to evolve, indicating the need for rigorous usability evaluation methods. This study compares two usability evaluation methods - cognitive interviews and usability assessments employing a think-aloud approach - for adapting an evidence-based mHealth tool from English into Spanish.

METHODS

We conducted cognitive interviews and usability assessments using a think-aloud protocol to evaluate the usability of an HIV mHealth application among 40 Spanish-speaking adults with HIV in New York City, NY, and La Romana, Dominican Republic. The Health IT Usability Evaluation Model (Health-ITUEM) was used to guide the analysis of qualitative data collected from each method.

RESULTS

Participants (N = 40) averaged 43 years old (SD = 12.26; range 20-79), identified primarily Hispanic/Latino (92.5 %), and resided in La Romana (50 %) or New York City (50 %). Both usability evaluation methods yielded similar findings, highlighting learnability and information needs as crucial components of participant feedback for the mHealth application. Cognitive interviews captured participants' perspectives on the app's interface and design. On the other hand, results from usability assessments offered insights into participants' competency while interacting with the mHealth tool.

CONCLUSION

Findings from this study highlight the contributions and limitations of including cognitive interviews and task-based usability assessments using a think-aloud approach in mHealth usability testing. Future research should employ a multi-method approach, incorporating complementary usability evaluation methods and engaging participants in multiple assessments. Using complementary usability evaluation methods may provide a more comprehensive understanding of the usability and participant experience aspects of a mHealth tool compared to using a single usability evaluation method.

A randomized controlled trial of the dissemination of an mHealth intervention for improving health outcomes: the WiseApp for Spanish-speakers living with HIV study protocol

BACKGROUND

While there is no cure for HIV, adherence to antiretroviral therapy can extend the lifespan and improve the quality of life of people with HIV. Despite the global reduction of HIV infection rates in recent years, New York City and La Romana, Dominican Republic, continue to report high infection rates among Latino populations. Many people with HIV remain virally unsuppressed in these geographic hotspots, suggesting a need for additional interventions to overcome medication adherence barriers. Tailored and culturally appropriate mobile health (mHealth) technology can be an engaging way to improve adherence. The primary objective of this trial is to test the effectiveness of an mHealth tool to improve HIV medication adherence among Spanish-speaking people living in New York City and the Dominican Republic.

METHODS

The WiseApp study is a two-arm randomized controlled trial among 248 people with HIV across the New York and Dominican Republic sites over the course of 12 months. Participants are randomly assigned to either receive a CleverCap pill bottle that is linked to the WiseApp (intervention) or standard of care (control). All participants complete surveys at baseline, 3-month, 6-month, and 12-month follow-up visits and the study team obtains HIV-1 viral load and CD4 count results through blood draw at each study timepoint.

DISCUSSION

The use of mHealth technologies to improve medication adherence among people with HIV has been implemented in recent years. Although some studies have found improvement in adherence to antiretroviral therapy in the short term, there is limited information about how these interventions improve adherence among Spanish-speaking populations. Disproportionate rates of HIV infection among Latinos in New York City suggest an existing inequitable approach in reaching and treating this population. Due to a lack of mHealth studies with Latino populations, and apps tailored to Spanish-speakers, the WiseApp study will not only demonstrate the effectiveness of this particular mHealth app but will also contribute to the mHealth research community as a whole.

TRIAL REGISTRATION

This trial was registered with Clinicaltrials.gov (NCT05398185) on 5/31/2022.

Understanding Physical Activity Determinants in an HIV Self-Management Intervention: Qualitative Analysis Guided by the Theory of Planned Behavior

BACKGROUND

People living with HIV have long life expectancy and are experiencing more comorbid conditions, being at an increased risk for developing cardiovascular disease (CVD) and diabetes, further exacerbated due to the HIV or inflammatory process. One effective intervention shown to decrease mortality and improve health outcomes related to CVD and diabetes in people living with HIV is increased regular physical activity. However, people living with HIV often fall short of the daily recommended physical activity levels. While studies show that mobile health (mHealth) can potentially help improve people's daily activity levels and reduce mortality rates due to comorbid conditions, these studies do not specifically focus on people living with HIV. As such, it is essential to understand how mHealth interventions, such as wearables, can improve the physical activity of people living with HIV.

OBJECTIVE

This study aimed to understand participants' experiences wearing a fitness tracker and an app to improve their physical activity.

METHODS

In total, 6 focus groups were conducted with participants who completed the control arm of a 6-month randomized controlled trial (ClinicalTrials.gov NCT03205982). The control arm received daily walk step reminders to walk at least 5000 steps per day and focused on the overall wellness of the individual. The analysis of the qualitative focus groups used inductive content analysis using the theory of planned behavior as a framework to guide and organize the analysis.

RESULTS

In total, 41 people living with HIV participated in the focus groups. The majority (n=26, 63%) of participants reported their race as Black or African American, and 32% (n=13) of them identified their ethnicity as Hispanic or Latino. In total, 9 major themes were identified and organized following the theory of planned behavior constructs. Overall, 2 major themes (positive attitude toward tracking steps and tracking steps is motivating) related to attitudes toward the behavior, 2 major themes (social support or motivation from the fitness tracker and app and encouragement from family and friends) related to participant's subjective norms, 1 theme (you can adjust your daily habits with time) related to perceived behavioral control, 2 themes (reach their step goal and have a healthier lifestyle) related to participant's intention, and 2 themes (continuing to walk actively and regularly wearing the fitness tracker) related to participant's changed behavior. Participants highlighted how the mHealth interface with the avatar and daily step tracking motivated them to both begin and continue to engage in physical activity by adjusting their daily routines.

CONCLUSIONS

Findings from this study illustrate how features of mHealth apps may motivate people living with HIV to start and continue sustained engagement in physical activities. This sustained increase in physical activity is crucial for reducing the risk of comorbid conditions such as diabetes or CVD.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03205982; https://classic.clinicaltrials.gov/ct2/show/NCT03205982.

Efficacy of an mHealth self-management intervention for persons living with HIV: the WiseApp randomized clinical trial

IMPORTANCE

Progression of HIV disease, the transmission of the disease, and premature deaths among persons living with HIV (PLWH) have been attributed foremost to poor adherence to HIV medications. mHealth tools can be used to improve antiretroviral therapy (ART) adherence in PLWH and have the potential to improve therapeutic success.

OBJECTIVE

To determine the efficacy of WiseApp, a user-centered design mHealth intervention to improve ART adherence and viral suppression in PLWH.

DESIGN, SETTING, AND PARTICIPANTS

A randomized (1:1) controlled efficacy trial of the WiseApp intervention arm (n = 99) versus an attention control intervention arm (n = 101) among persons living with HIV who reported poor adherence to their treatment regimen and living in New York City.

INTERVENTIONS

The WiseApp intervention includes the following components: testimonials of lived experiences, push-notification reminders, medication trackers, health surveys, chat rooms, and a "To-Do" list outlining tasks for the day. Both study arms also received the CleverCap pill bottle, with only the intervention group linking the pill bottle to WiseApp.

RESULTS

We found a significant improvement in ART adherence in the intervention arm compared to the attention control arm from day 1 (69.7% vs 48.3%, OR = 2.5, 95% CI 1.4-3.5, P = .002) to day 59 (51.2% vs 37.2%, OR = 1.77, 95% CI 1.0-1.6, P = .05) of the study period. From day 60 to 120, the intervention arm had higher adherence rates, but the difference was not significant. In the secondary analyses, no difference in change from baseline to 3 or 6 months between the 2 arms was observed for all secondary outcomes.

CONCLUSIONS

The WiseApp intervention initially improved ART adherence but did not have a sustained effect on outcomes.

A Smoking Cessation Mobile App for Persons Living With HIV: Preliminary Efficacy and Feasibility Study

BACKGROUND

The prevalence of smoking in the United States general population has gradually declined to the lowest rate ever recorded; however, this has not been true for persons with HIV.

OBJECTIVE

We conducted a pilot test to assess the feasibility and efficacy of the Lumme Quit Smoking mobile app and smartwatch combination with sensing capabilities to improve smoking cessation in persons with HIV.

METHODS

A total of 40 participants were enrolled in the study and randomly assigned 1:1 to the control arm, which received an 8-week supply of nicotine replacement therapy, a 30-minute smoking cessation counseling session, and weekly check-in calls with study staff, or to the intervention arm, which additionally received the Lumme Quit Smoking app and smartwatch.

RESULTS

Of the 40 participants enrolled, 37 completed the follow-up study assessments and 16 used the app every day during the 56-day period. During the 6-month recruitment and enrollment period, 122 people were screened for eligibility, with 67.2% (82/122) deemed ineligible. Smoking criteria and incompatible tech were the major reasons for ineligibility. There was no difference in the proportion of 7-day point prevalence abstinence by study arm and no significant decrease in exhaled carbon monoxide for the intervention and control arms separately. However, the average exhaled carbon monoxide decreased over time when analyzing both arms together (P=.02).

CONCLUSIONS

Results suggest excellent feasibility and acceptability of using a smoking sensor app among this smoking population. The knowledge gained from this research will enable the scientific community, clinicians, and community stakeholders to improve tobacco cessation outcomes for persons with HIV.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04808609; https://clinicaltrials.gov/ct2/show/NCT04808609.

Efficacy of a password-protected, pill-dispensing device with mail return capacity to enhance disposal of unused opioids after cancer surgery

BACKGROUND

Opioid misuse is a public health crisis, and unused postoperative opioids are an important source. Although 70% of pills prescribed go unused, only 9% are discarded. This study evaluated whether an inexpensive pill-dispensing device with mail return capacity could enhance disposal of unused opioids after cancer surgery.

METHODS

A prospective pilot study was conducted among adult patients who underwent major cancer-related surgery. Patients received opioid prescriptions in a mechanical device (Addinex) linked to a smartphone application (app). The app provided passwords on a prescriber-defined schedule. Patients could enter a password into the device and receive a pill if the prescribed time had elapsed. Patients were instructed to return the device and any unused pills in a disposal mailer. The primary end point was feasibility of device return, defined as ≥50% of patients returning the device within 6 weeks of surgery. Also explored was total pill use and return as well as patient satisfaction.

RESULTS

Among 30 patients enrolled, the majority (n = 24, 80%) returned the device, and 17 (57%) returned it within 6 weeks of surgery. In total, 567 opioid pills were prescribed and 170 (30%) were used. Of 397 excess pills, 332 (84% of unused pills, 59% of all pills prescribed) were disposed of by mail. Among 19 patients who obtained opioids from the device, most (n = 14, 74%) felt the benefits of the device justified the added steps involved.

CONCLUSIONS

Use of an inexpensive pill-dispensing device with mail return capacity is a feasible strategy to enhance disposal of unused postoperative opioids.

Establishing a usability cut-point for the Health Information Technology Usability Evaluation Scale (Health-ITUES)

OBJECTIVE

The Health Information Technology Usability Evaluation Scale (Health-ITUES) is a validated and reliable instrument to evaluate usability of information technology (IT) tools. In this study, we aimed to establish the optimal cut-point of the Health-ITUES to identify usability of IT tools.

METHODS

Adult participants were recruited to a trial evaluating a mobile app for self-managing HIV. Participants completed the Health-ITUES at the 3- and 6-month follow-up. Health-ITUES is a 20-item questionnaire that assesses four subscales: impact, perceived usefulness, perceived ease of use, and user control. The total score ranged from 1 to 5 and a higher score indicates greater usability. App use was defined as the proportion of activities completed by participants in both study arms. The selection of an optimal cut-point involved a series of multiple linear regression models with 500 bootstrap replications to examine the relationship between the Health-ITUES total score and app use, controlling for potential covariates.

RESULTS

We included 158 participants; mean age was 49.7 years (SD 10.3), 71% were African American/Black, and 72% were non-Hispanic. Mean Health-ITUES total scores at 3 and 6 months were 4.39 (SD 0.75) and 4.43 (SD 0.75), respectively. App use completedby participants from baseline to the 3-month follow-up visits was 0.61 (SD 0.36, range 0-1.72) and from 3-month to the 6-month follow-up visits was 0.51 (SD 0.37). Participants who reported greater Health-ITUES total score completed more activities [β = 0.18, 95% Confidence Interval (CI) 0.10-0.27]. The optimal cut-point of 4.32 (95% CI: 4.25-4.56) yielded the lowest p-value to identify usability of IT tools.

CONCLUSIONS

In this study of adults with HIV, we identified an optimal cut-point of 4.32 on the Health-ITUES total score to define usability. Further studies are needed to validate this cut-point.

Evaluación de la usabilidad de una aplicación móvil para pacientes con catéter central de inserción periférica

Resumen Objetivo: evaluar la usabilidad de la aplicación Meu PICC para el seguimiento extrahospitalario de pacientes que usan catéter central de inserción periférica por medio del instrumento validado System Usability Scale. Método: estudio transversal que aplicó el System Usability Scale a 30 pacientes que usan catéter central de inserción periférica, diez enfermeros y ocho profesionales en tecnología de la información para evaluar la usabilidad de la aplicación. Resultados: hubo diferencia estadística entre la edad y la usabilidad (p=0,006), así como una correlación negativa entre el tiempo de uso de la aplicación y la usabilidad (p=0,002). Según la escala de clasificación de adjetivos del System Usability Scale, el 40,0% de los pacientes consideró que la aplicación era mejor imaginable y el 33,3% excelente. En cuanto a las enfermeras, el 70,0% consideró que la aplicación era mejor imaginable y el 20,0% excelente; de los profesionales en tecnologías de la información, el 50,0% consideró que la aplicación era mejor imaginable y el 50,0% excelente. Conclusión: la evaluación de usabilidad determinó que los pacientes, enfermeros y profesionales en TIC consideraron que la aplicación era útil para el seguimiento de pacientes que utilizan PICC y la calificaron como adecuada, otorgándole la calificación de mejor imaginable o excelente. Estos resultados confirman el uso de la aplicación Meu PICC en el seguimiento de pacientes que usan PICC fuera del hospital.

Usability assessment of a mobile app for patients with peripherally inserted central catheters

OBJECTIVE

to evaluate usability of the Meu PICC (My PICC) app for follow-up of outpatients using peripherally inserted central catheters through the validated System Usability Scale instrument.

METHOD

a cross-sectional study that applied the System Usability Scale to 30 patients using peripherally inserted central catheters, ten nurses and eight Information and Communication Technology professionals to assess usability of the app.

RESULTS

a statistical difference was observed between age and usability (p=0.006), as well as a negative correlation between app use time and usability (p=0.002). As per the System Usability Scale adjectival classification, 40.0% and 33.3% of the patients considered the app as the best possible to be imagined and as excellent, respectively. In relation to the nurses, 70.0% considered the app as the best possible to be imagined and 20.0% as excellent; of the Information and Communication Technology professionals, 50.0% considered the app as the best possible to be imagined and the other 50.0%, as excellent.

CONCLUSION

the usability assessment showed that patients, nurses and ICT professionals considered the app useful for monitoring patients using PICCs and evaluated it as appropriate, evaluating it as the best possible to be imagined or as excellent. These results corroborate use of the Meu PICC app in the monitoring of outpatient use of PICCs.

Avaliação de usabilidade de aplicativo móvel para pacientes com cateter central de inserção periférica

Resumo Objetivo: avaliar a usabilidade do aplicativo Meu PICC para o acompanhamento extra-hospitalar de pacientes em uso de cateter central de inserção periférica por meio do instrumento validado System Usability Scale. Método: estudo transversal que aplicou o System Usability Scale a 30 pacientes em uso de cateter central de inserção periférica, dez enfermeiros e oito profissionais de tecnologia da informação para avaliar a usabilidade do aplicativo. Resultados: observou-se diferença estatística entre idade e usabilidade (p=0,006), bem como correlação negativa entre o tempo de utilização do aplicativo e usabilidade (p=0,002). Pela classificação adjetiva do System Usability Scale, 40,0% dos pacientes consideraram o aplicativo como o melhor imaginável e 33,3% como excelente. Com relação aos enfermeiros, 70,0% consideraram o aplicativo como o melhor imaginável e 20,0% como excelente; dos profissionais de tecnologia da informação, 50,0% consideraram o aplicativo como o melhor imaginável e 50,0% excelente. Conclusão: a avaliação de usabilidade mostrou que pacientes, enfermeiros e profissionais de TIC consideraram o aplicativo útil para o acompanhamento de pacientes em uso de PICC e o avaliaram como adequado, atribuindo-lhe a qualificação de melhor imaginável ou excelente. Estes resultados corroboram para o uso do aplicativo Meu PICC no acompanhamento de pacientes em uso extra-hospitalar de PICC.