Comparison of evaluation methods for improving the usability of a Spanish mHealth tool

OBJECTIVE

Mobile health (mHealth) technology is now widely used across health conditions and populations. The rigorous development of these tools has yielded improved health outcomes, yet the ideal approach for developing mHealth tools continues to evolve, indicating the need for rigorous usability evaluation methods. This study compares two usability evaluation methods - cognitive interviews and usability assessments employing a think-aloud approach - for adapting an evidence-based mHealth tool from English into Spanish.

METHODS

We conducted cognitive interviews and usability assessments using a think-aloud protocol to evaluate the usability of an HIV mHealth application among 40 Spanish-speaking adults with HIV in New York City, NY, and La Romana, Dominican Republic. The Health IT Usability Evaluation Model (Health-ITUEM) was used to guide the analysis of qualitative data collected from each method.

RESULTS

Participants (N = 40) averaged 43 years old (SD = 12.26; range 20-79), identified primarily Hispanic/Latino (92.5 %), and resided in La Romana (50 %) or New York City (50 %). Both usability evaluation methods yielded similar findings, highlighting learnability and information needs as crucial components of participant feedback for the mHealth application. Cognitive interviews captured participants' perspectives on the app's interface and design. On the other hand, results from usability assessments offered insights into participants' competency while interacting with the mHealth tool.

CONCLUSION

Findings from this study highlight the contributions and limitations of including cognitive interviews and task-based usability assessments using a think-aloud approach in mHealth usability testing. Future research should employ a multi-method approach, incorporating complementary usability evaluation methods and engaging participants in multiple assessments. Using complementary usability evaluation methods may provide a more comprehensive understanding of the usability and participant experience aspects of a mHealth tool compared to using a single usability evaluation method.

A Systematic Review of Self-Management Interventions Conducted Across Global Settings for Depressive Symptoms in Persons with HIV

Depressive symptoms can affect health outcomes in people living with HIV (PLWH) including adherence to treatment and disease prognosis. Self-management interventions targeting depressive symptoms have been effective in preventing these negative sequelae of depressive symptoms. The processes of self-management include learning skills related to living with the illness needs, accessing resources to manage the illness, and coping with the illness. A systematic literature review was conducted to appraise and synthesize the current evidence of self-management interventions targeting depressive symptoms in PLWH. Following the PRISMA guidelines, an electronic search of 4 databases was conducted. Original studies written in English that used a randomized controlled trial design to test the effect of self-management intervention on depressive symptoms were included. Studies were selected that were published on/before April 19, 2022, thus yielding 13 relevant articles. Risk of bias was assessed using the NIH Quality Assessment Tool for Controlled Intervention Studies and narrative synthesis was used to synthesize the results. 40 to 755 participants were included in the studies, with each using various measures to assess depressive symptoms pre-and post-intervention, and timepoints for assessing depressive symptoms post-intervention varied. While 12 studies showed a significant reduction in depressive symptoms post-intervention, only 4 studies that used individual coaching or technology showed lower depressive symptoms in intervention groups in comparison to the control groups. This review can be used to inform scale-up and dissemination of these interventions to improve depressive symptoms in PLWH.