Usability and acceptability of a two-way texting intervention for post-operative follow-up for voluntary medical male circumcision in Zimbabwe

Expanding two-way texting for post-operative follow-up: A cost analysis of the implementation and scale-up in routine voluntary medical male circumcision settings in South Africa

Up to 98% of adult voluntary medical male circumcision (VMMC) clients heal without adverse events (AEs) in South Africa and in the sub-Saharan Africa region. Yet, all clients in South Africa are required to attend in-person reviews, creating added effort for providers and clients. A randomized controlled trial (RCT) using our fee-free, open-source, two-way texting (2wT) approach showed that males could independently monitor their healing with nurse-led telehealth support. 2wT was more cost-effective than routine visits for quality post-operative monitoring. The objectives of this study were:1) assess the additive cost of 2wT vs. standard of care (SoC) during a stepped wedge design (SWD) expansion trial; 2) determine the cost of augmenting 2wT implementation with dedicated personnel during peak VMMC periods; and 3) estimate the cost savings of 2wT from the payer perspective if scaled in routine settings. Data were collected from routine financial reports and complemented by previous RCT time-motion estimates. We conducted activity-based costing of SWD and peak season periods. Sensitivity analysis to estimates 2wT costs at scale. Data included 6,842 males; 2,586 (38%) opted for 2wT. 2wT participants attended an average of zero in-person visits; SoC males had an average of 2 in-person visits. Under 2wT, quality care improved: AE ascertainment increased while loss to follow-up decreased. Given a VMMC population of 10,000 adults, scenario analysis suggests that: 1) 2wT becomes cost neutral with 45% 2wT enrollment; 2) 2wT saves $0.29/client with 60% 2wT enrollment; and 3) 2wT saves $0.46/client with 80% 2wT enrollment. When scaled, 2wT appears to significantly reduce healthcare system costs while improving the quality of post-operative care without additional client costs. Further scale-up of 2wT for eligible males across VMMC and other post-operative contexts in South Africa would likely increase cost savings while dramatically reducing the burden of in-person visits on patients and clinics.

Acceptability, feasibility and appropriateness of intensified health education, SMS/phone tracing and transport reimbursement for uptake of voluntary medical male circumcision in a sexually transmitted infections clinic in Malawi: A mixed methods study

INTRODUCTION

Uptake of voluntary medical male circumcision (VMMC) remains a challenge in many settings. Innovative implementation strategies are required to scale-up VMMC uptake.

METHODOLOGY

RITe was a multi-faceted intervention comprising transport reimbursement (R), intensified health education (IHE) and SMS/Telephone tracing (Te), which increased the uptake of VMMC among uncircumcised men with sexually transmitted infections (STIs) in Malawi. Using a concurrent exploratory mixed-method approach, we assessed the intervention's acceptability, feasibility and appropriateness among men with STIs and healthcare workers (HCWs) at Bwaila District Hospital. Participants completed Likert scale surveys and participated in-depth interviews (IDIs) and focus group discussions (FGDs). We calculated percentages of responses to survey items and summarized common themes using thematic analysis. Median scores and interquartile ranges (IQR) were calculated for acceptability, feasibility and appropriateness of each strategy at baseline and end-line and compared using the Wilcoxon signed rank test.

RESULTS

A total of 300 surveys, 17 IDIs and 4 FGDs were conducted with men and HCWs between baseline and end-line. The mean age for men in the survey was 29 years (SD ±8) and most were married/cohabiting (59.3%). Mean age for HCWs was 38.5 years (SD ±7), and most were female (59.1%). For acceptability, participants agreed that RITe was welcome, approvable, and likable. Despite participants agreeing that RITe was a good idea, fit and suitability influenced appropriateness, particularly at baseline, which improved at end-line for Te and R. For feasibility, HCWs agreed that RITe was easy to implement, but expressed concerns that R (end-line median = 4, IQR: 2, 4) and Te (end-line median = 4, IQR: 4, 4), were unsustainable. Interviews corroborated the survey results. Participants reported that IHE provided important information, Te was a good reminder and R was attractive, but they reported barriers to R and Te such as electricity, limited access to phones and distrust in the government.

CONCLUSIONS

The RITe intervention was acceptable, feasible and appropriate. However, culture/religion and structural barriers affected perceptions of appropriateness and feasibility, respectively. Continued awareness raising on VMMC and addressing setting-specific structural factors are required to overcome barriers that impede demand-creation interventions for VMMC.

Strengthening evidence for text-based telehealth in post-operative care: A pragmatic study of the reach and effectiveness of two-way, text-based follow-up after voluntary medical male circumcision in South Africa

Building upon evidence of safety and efficiency gains from a randomized control trial (RCT) in South Africa, we further scaled implementation of two-way, short message service (SMS), text-based (2wT) follow-up after voluntary medical male circumcision (VMMC). We aimed to determine if gains in adverse event (AE) identification and reduced follow-up visits could be maintained when 2wT was implemented in routine VMMC settings. A pragmatic, stepped wedge design (SWD) study was implemented across three districts in South Africa. Men ages 15 and older could opt into the 2wT telehealth follow-up approach when their facility was in the intervention period. Men in routine periods were offered the standard of care (SoC): in-person post-operative visits on days 2 and 7 as per national VMMC guidelines. 2wT participants were not required to attend any postoperative visits but could return for care if desired or referred. Two quality of care markers, safety (AE ascertainment rate) and efficiency (# in-person follow-up visits), were compared between groups. We aimed for at least 200 men per step to have 80% power to detect a change in AE rate from before to after 2wT was implemented. Secondary analysis explored response rates; client and site uptake; and AE details. Among 6842 clients in the intervention period, 2856 opted into 2wT (37.8%) across three intervention waves and two platforms (SMS or WhatsApp). Among those with post-operative follow-up, the AE ascertainment rate was higher among 2wT (0.60%) than SoC (0.13%) clients (p = 0.0018), demonstrating safety gains. On average, 2wT participants had 2.1 fewer visits compared to SoC clients (p<0.001), demonstrating gains in follow-up efficiency. Among 2wT men, 2069/2586 (80%) responded via 2wT over 14 days, demonstrating engagement in post-operative care. Of all intervention clients, 93 2wT (3.6%) and 342 (8.0%) SoC were considered lost to follow-up. In this expansion trial, we provided additional evidence that the 2wT approach maintains the quality of post-operative care for adult VMMC clients. 2wT should be scaled to augment in-person, post-operative visits after VMMC for eligible, interested males ages 15 and older. To achieve potential impact, effort is needed to improve access and uptake to 2wT among providers and sites, expanding the 2wT approach for other acute follow-up care especially among men.

What does it cost to expand two-way texting for post-operative follow-up? A cost analysis in routine voluntary medical male circumcision settings in South Africa

Up to 98% of adult voluntary medical male circumcision (VMMC) clients heal without adverse events (AEs) in South Africa and in the sub-Saharan Africa (SSA) region, yet all clients in South Africa (SA) are still required to attend in-person reviews, creating added work for providers and barriers for clients. A randomized controlled trial (RCT) using our fee-free, open-source, two-way texting (2wT) approach showed that males could independently monitor their healing with support from VMMC nurse-led telehealth and that 2wT was more cost-effective than routine visits for quality post-operative monitoring. The objectives of this costing activity were to assess the additive cost of 2wT vs. SoC during a stepped wedge design (SWD) expansion trial; costing an augmentation of 2wT with dedicated personnel during peak VMMC periods; and estimate the cost savings of 2wT from the payer perspective if scaled in routine VMMC settings. Data was collected from routine financial reports and complemented by previous RCT time-motion estimates. We conducted activity-based costing of SWD and peak season periods; sensitivity analysis estimated 2wT costs at scale. We included data from 6,842 males, with 2,586 (38%) opting for 2wT. 2wT participants attended an average of zero visits; SoC males had an average of 2 visits. Under 2wT, quality care markers improved and AE ascertainment increased while loss to follow-up (LTFU) decreased. Given a VMMC population of 10,000 adults, scenario analysis suggests that: 1) 2wT becomes cost neutral with 45% 2wT enrollment; 2) 2wT saves $0.29/client with 60% 2wT enrollment; and 3) 2wT saves $0.46/client with 80% 2wT enrollment. When implemented at scale, 2wT appears to significantly reduce costs to the healthcare system while improving the quality of post-operative care and requiring no additional client costs. 2wT should be expanded for eligible males across VMMC and other post-operative contexts in South Africa.

The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: Findings from a quasi-experimental study in Lilongwe, Malawi

BACKGROUND

Retaining clients on antiretroviral therapy (ART) is challenging, especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi.

METHODS

Between August 2021-June 2023, in a quasi-experimental study, outcomes were compared between two cohorts of new ART clients: 1) those opting into 2wT who received automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as "the proportion clients ≤6 months of ART initiation eligible for 2wT". 2wT effectiveness was assessed in time-to-event analysis. Retention was presented in a Kaplan-Meier plot and compared between 2wT and SoC using a log-rank test. The effect of 2wT on ART dropout (lost to follow-up or stopped ART) was estimated using Fine-Gray competing risk regression models, adjusting for sex, age and WHO HIV stage at ART initiation.

RESULTS

Of 1,146 clients screened, 501 were eligible for 2wT, a reach of 44%. Lack of phone (393/645; 61%) and illiteracy (149/645; 23%) were the most common ineligibility reasons. Among 468 participants exposed to 2wT, 12-month probability of ART retention was 91% (95% CI: 88% - 94%) compared to 76% (95% CI: 72% - 80%) among 468 SoC participants (p<0.001). Compared to SoC, 2wT participants had a 65% lower hazard of ART dropout at any timepoint (sub-distribution hazard ratio 0.35, 95% CI: 0.24-0.51; p<0.001).

CONCLUSIONS

2wT did not reach all clients. For those who opted-in, 2wT significantly increased 12-month ART retention. Expansion of 2wT as a complement to other retention interventions should be considered in other low-resource, routine ART settings.

"Endless opportunities": A qualitative exploration of facilitators and barriers to scale-up of two-way texting follow-up after voluntary medical male circumcision in Zimbabwe

In Zimbabwe, the ZAZIC consortium employs two-way, text-based (2wT) follow-up to strengthen post-operative care for voluntary medical male circumcision (VMMC). 2wT scaled nationally with evidence of client support and strengthened follow-up. However, 2wT uptake among healthcare providers remains suboptimal. Understanding the gap between mobile health (mHealth) potential for innovation expansion and scale-up realization is critical for 2wT and other mHealth innovations. Therefore, we conducted an exploratory qualitative study with the objective of identifying 2wT program strengths, challenges, and suggestions for scale up as part of routine VMMC services. A total of 16 in-depth interviews (IDIs) with diverse 2wT stakeholders were conducted, including nurses, monitoring & evaluation teams, and technology partners-a combination of perspectives that provide new insights. We used both inductive and deductive coding for thematic analysis. Among 2wT drivers of expansion success, interviewees noted: 2wT care benefits for clients; effective hands-on 2wT training; ease of app use for providers; 2wT saved time and money; and 2wT strengthened client/provider interaction. For 2wT scale-up challenges, staff shortages; network infrastructure constraints; client costs; duplication of paper and electronic reporting; and complexity of digital tools integration. To improve 2wT robustness, respondents suggested: more staff training to offset turnover; making 2wT free for clients; using 2wT to replace paper VMMC reporting; integrating with routine VMMC reporting systems; and expanding 2wT to other health areas. High stakeholder participation in app design, implementation strengthening, and evaluation were appreciated. Several 2wT improvements stemmed from this study, including enrollment of multiple people on one number to account for phone sharing; 2wT inclusion of minors ages 15+; clients provided with $1 to offset SMS costs; and reduced SMS messages to clients. Continued 2wT mentoring for staff, harmonization of 2wT with Ministry e-health data systems, and increased awareness of 2wT's client and provider benefits will help ensure successful 2wT scale-up.

Acceptability, feasibility and appropriateness of intensified health education, SMS/phone tracing and transport reimbursement for uptake of voluntary medical male circumcision in a sexually transmitted infections clinic in Malawi: a mixed methods study

Introduction

Uptake of voluntary medical male circumcision (VMMC) remains a challenge in many settings. Innovative implementation strategies are required to scale-up VMMC uptake.

Methodology

RITe was a multi-faceted intervention comprising transport reimbursement (R), intensified health education (IHE) and SMS/Telephone tracing (Te), which increased the uptake of VMMC among uncircumcised men with sexually transmitted infections (STIs) in Malawi. Using a concurrent exploratory mixed-method approach, we assessed the intervention's acceptability, feasibility and appropriateness among men with STIs and healthcare workers (HCWs) at Bwaila District Hospital. Participants completed Likert scale surveys and participated in-depth interviews (IDIs) and focus group discussions (FGDs). We calculated percentages of responses to survey items and summarized common themes using thematic analysis. Median scores and interquartile ranges (IQR) were calculated for acceptability, feasibility and appropriateness of each strategy at baseline and end-line and compared using the Wilcoxon signed rank test.

Results

A total of 300 surveys, 17 IDIs and 4 FGDs were conducted with men and HCWs between baseline and end-line. The mean age for men in the survey was 29 years (SD ±8) and most were married/cohabiting (59.3%). Mean age for HCWs was 38.5 years (SD ±7), and most were female (59.1%). For acceptability, participants agreed that RITe was welcome, approvable, and likable. Despite participants agreeing that RITe was a good idea, culture and religion influenced appropriateness, particularly at baseline, which improved at end-line for Te and R. For feasibility, HCWs agreed that RITe was easy to implement, but expressed concerns that R (end-line median = 4, IQR: 2, 4) and Te (end-line median = 4, IQR: 4, 4), were resource intensive, hence unsustainable. Interviews corroborated the survey results. Participants reported that IHE provided important information, Te was a good reminder and R was attractive, but they reported barriers to R and Te such as electricity, limited access to phones and distrust in the government.

Conclusions

The RITe intervention was acceptable, feasible and appropriate. However, culture/religion and structural barriers affected perceptions of appropriateness and feasibility, respectively. Continued awareness raising on VMMC and addressing setting-specific structural factors are required to overcome barriers that impede demand-creation interventions for VMMC.

Study registration

ClinicalTrials.gov identifier: NCT04677374. Registered on December 18, 2020.

Centering healthcare workers in digital health design: Usability and acceptability of two-way texting to improve retention in antiretroviral therapy in a public HIV clinic in Lilongwe, Malawi

New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low- and middle-income countries, like Malawi, appropriate digital health applications (apps) must fit into local clinic, connectivity and resource constraints. We describe the human centered design (HCD) and development process of an open-source, hybrid, two-way texting (2wT) system to improve ART retention. We detail the critical role of diverse healthcare workers (HCWs) in the HCD process to inform app usability, create buy-in, and ensure appropriate optimization for the local context. We optimized 2wT usability and acceptability over three HCD phases: 1) informal feedback sessions with diverse 2wT stakeholders, 2) a small pilot, and 3) key informant interviews. Phase one included four sessions with diverse HCWs, including "expert ART clients", clinical, technical, supervisory, and evaluation teams to inform 2wT design. In phase 2, a small pilot with 50 participating ART clients aimed to inform implementation improvement. Phase three included interviews with ten HCWs to deepen understanding of 2wT acceptability and usability, documenting strengths and weaknesses to inform optimization. Multi-phase feedback sessions with HCWs helped refine 2wT language and message timing for both weekly and tailored client-specific visit reminders. The pilot led to improvements in educational materials to guide client responses and ease interaction with HCWs. In interviews, the HCWs appreciated the HCD co-creation process, suggested ways to increase access for low-literacy clients or those without consistent phone access, and felt integrating 2wT with other eHealth platforms would improve scalability. Inclusion of HCWs across phases of HCD design, adaption, and optimization increased 2wT usability and acceptability among HCWs in this setting. Engaging HCWs into 2wT co-ownership from inception appears successful in co-creation of an app that will meet HCW needs, and therefore, enhance support for 2wT clients to attend visits and remain in care.

The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: findings from a quasi-experimental study in Lilongwe, Malawi

Background

Retaining clients on antiretroviral therapy (ART) is challenging especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi.

Methods

Between August 2021 - June 2023, a quasi-experimental study compared outcomes between two cohorts of new ART clients: 1) those opting into 2wT with combined automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as "the proportion clients ≤6 months of ART initiation eligible for 2wT". 2wT effectiveness was assessed in time-to-event analysis comparing Kaplan-Meier plots of 6- and 12-month retention between 2wT and SoC using a log-rank test. The effect of 2wT on ART drop out was estimated using multivariable Cox proportional hazard models, adjusting for sex, age and WHO stage at ART initiation.

Results

Of the 1,146 clients screened, 645 were ineligible (56%) largely due to lack of phone access (393/645; 61%) and illiteracy (149/645; 23%): a reach of 44%. Among 468 2wT participants, the 12-month probability of ART retention was 91% (95%CI: 88% - 93%) compared to 75% (95%CI: 71% - 79%) among 468 SoC participants (p<0.0001). Compared to SoC participants, 2wT participants had a 62% lower hazard of dropping out of ART care at all time points (hazard ratio 0.38, 95% CI: 0.26-0.54; p<0.001).

Conclusions

Not all clients were reached with 2wT. For those who opted-in, 2wT reduced drop out throughout the first year on ART and significantly increased 12-month retention. The proactive 2wT approach should be expanded as a complement to other interventions in routine, low-resource settings to improve ART retention.

Cost savings in male circumcision post-operative care using two-way text-based follow-up in rural and urban South Africa

INTRODUCTION

Voluntary medical male circumcision (VMMC) clients are required to attend multiple post-operative follow-up visits in South Africa. However, with demonstrated VMMC safety, stretched clinic staff in SA may conduct more than 400,000 unnecessary reviews for males without complications, annually. Embedded into a randomized controlled trial (RCT) to test safety of two-way, text-based (2wT) follow-up as compared to routine in-person visits among adult clients, the objective of this study was to compare 2wT and routine post-VMMC care costs in rural and urban South African settings.

METHODS

Activity-based costing (ABC) estimated the costs of post-VMMC care, including counselling, follow-ups, and tracing in $US dollars. Transportation for VMMC and follow-up was provided for rural clients in outreach settings but not for urban clients in static sites. Data were collected from National Department of Health VMMC forms, RCT databases, and time-and-motion surveys. Sensitivity analysis presents different follow-up scenarios. We hypothesized that 2wT would save per-client costs overall, with higher savings in rural settings.

RESULTS

VMMC program costs were estimated from 1,084 RCT clients: 537 in routine care and 547 in 2wT. On average, 2wT saved $3.56 per client as compared to routine care. By location, 2wT saved $7.73 per rural client and increased urban costs by $0.59 per client. 2wT would save $2.16 and $7.02 in follow-up program costs if men attended one or two post-VMMC visits, respectively.

CONCLUSION

Quality 2wT follow-up care reduces overall post-VMMC care costs by supporting most men to heal at home while triaging clients with potential complications to timely, in-person care. 2wT saves more in rural areas where 2wT offsets transportation costs. Minimal additional 2wT costs in urban areas reflect high care quality and client engagement, a worthy investment for improved VMMC service delivery. 2wT scale-up in South Africa could significantly reduce overall VMMC costs while maintaining service quality.

A Community-Based, Mobile Electronic Medical Record System App for High-Quality, Integrated Antiretroviral Therapy in Lilongwe, Malawi: Design Process and Pilot Implementation

BACKGROUND

Differentiated service delivery (DSD) increases antiretroviral therapy (ART) access in sub-Saharan Africa by moving clients out of congested ART clinics to communities for care. However, DSD settings challenge provider adherence to complex, chronic care treatment guidelines and have burdensome systems for client monitoring and evaluation (M&E), reducing data for decision-making. Electronic medical record systems (EMRS) improve client outcomes and reduce M&E workload. Traditional EMRS cannot operate in most DSD settings with unreliable power and poor connectivity.

OBJECTIVE

This study aims to detail the human-centered design (HCD) process of developing a mobile EMRS for community-based DSD services in Lilongwe, Malawi.

METHODS

Lighthouse Trust (LT) operates 2 Ministry of Health (MoH) clinics in Lilongwe, Malawi, with a combined total of >35,000 ART clients. LT's real-time, point-of-care EMRS collects complex client M&E data and provides decision-making support, ensuring adherence to integrated HIV and tuberculosis guidelines that optimize client and program outcomes. LT's EMRS scaled to all large MoH ART clinics. LT also implements a nurse-led community-based ART program (NCAP), a DSD model to provide ART and rapid assessment for 2400 stable LT clients in the community. LT, alongside collaborators, from the University of Washington's International Training and Education Center for Health and technology partner, Medic, used the open-source Community Health Toolkit (CHT) and HCD to develop an open-source, offline-first, mobile EMRS-like app, "community-based ART retention and suppression" (CARES). CARES aims to bring EMRS-like provider benefits to NCAP's DSD clients.

RESULTS

CARES design took approximately 12 months and used an iterative process of highly participatory feedback sessions with provider, data manager, and M&E team inputs to ensure CARES optimization for the NCAP and LT settings. The CARES mobile EMRS prototype supports NCAP providers with embedded prompts and alerts to ensure adherence to integrated MoH ART guidelines, aiming to improve the quality of client care. CARES facilitates improved data quality and flow for NCAP M&E, aiming to reduce data gaps between community and clinic settings. The CARES pilot demonstrates the potential of a mobile, point-of-care EMRS-like app that could benefit NCAP clients, providers, and program teams with integrated client care and complete M&E data for decision-making. CARES challenges include app speed, search features to align longitudinal records, and CARES to EMRS integration that supports timely care alerts.

CONCLUSIONS

Leveraging the CHT and HCD processes facilitated the design of a locally specified and optimized mobile app with the promise to bring EMRS-like benefits to DSD settings. Moving from the CARES prototype to routine NCAP implementation should result in improved client care and strengthened M&E while reducing workload. Our transparent and descriptive process shares the progress and pitfalls of the CARES design and development, helping others in this digital innovation area to learn from our experiences at this stage.

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi

BACKGROUND

Early retention of people living with HIV (PLHIV) in antiretroviral therapy (ART) programs is critical to improve individual clinical outcomes and viral load suppression. Although many mobile health (mHealth) interventions aim to improve retention in care, there is still lack of evidence on mHealth success or failure, including from patient's perspectives. We describe the human-centered design (HCD) process and assess patient usability and acceptability of a two-way texting (2wT) intervention to improve early retention among new ART initiates at Lighthouse Trust clinic in Lilongwe, Malawi.

METHODS

An iterative HCD approach focused on patient and provider users' needs, incorporating feedback from multidisciplinary teams to adapt 2wT for the local, public clinic context. We present mixed-methods usability and acceptability results from 100 participants, 50 at 3-months and 50 at 6-months, post 2wT enrollment, and observations of these same patients completing core tasks of the 2wT system.

RESULTS

Among the 100 usability respondents, 95% were satisfied with visit reminders, and 88% would recommend reminders and motivational messages to friends; however, 17% were worried about confidentiality. In observation of participant task completion, 94% were able to successfully confirm visit attendance and 73% could request appointment date change. More participants in 4-6 months group completed tasks correctly compared to 1-3 months group, although not significantly different (78% vs. 66%, p = 0.181). Qualitative results were overwhelmingly positive, but patients did note confusion with transfer reporting and concern that 2wT would not reach patients without mobile phones or with lower literacy.

CONCLUSION

The 2wT app for early ART retention appears highly usable and acceptable, hopefully creating a solid foundation for lifelong engagement in care. The HCD approach put the local team central in this process, ensuring that both patients' and Lighthouse's priorities, policies, and practices were forefront in 2wT optimization, raising the likelihood of 2wT success in other routine program contexts.

Expanding the Evidence on the Safety and Efficiency of 2-Way Text Messaging-Based Telehealth for Voluntary Medical Male Circumcision Follow-up Compared With In-Person Reviews: Randomized Controlled Trial in Rural and Urban South Africa

BACKGROUND

There is a dearth of high-quality evidence from digital health interventions in routine program settings in low- and middle-income countries. We previously conducted a randomized controlled trial (RCT) in Zimbabwe, demonstrating that 2-way texting (2wT) was safe and effective for follow-up after adult voluntary medical male circumcision (VMMC).

OBJECTIVE

To demonstrate the replicability of 2wT, we conducted a larger RCT in both urban and rural VMMC settings in South Africa to determine whether 2wT improves adverse event (AE) ascertainment and, therefore, the quality of follow-up after VMMC while reducing health care workers' workload.

METHODS

A prospective, unblinded, noninferiority RCT was conducted among adult participants who underwent VMMC with cell phones randomized in a 1:1 ratio between 2wT and control (routine care) in North West and Gauteng provinces. The 2wT participants responded to a daily SMS text message with in-person follow-up only if desired or an AE was suspected. The control group was requested to make in-person visits on postoperative days 2 and 7 as per national VMMC guidelines. All participants were asked to return on postoperative day 14 for study-specific review. Safety (cumulative AEs ≤day 14 visit) and workload (number of in-person follow-up visits) were compared. Differences in cumulative AEs were calculated between groups. Noninferiority was prespecified with a margin of -0.25%. The Manning score method was used to calculate 95% CIs.

RESULTS

The study was conducted between June 7, 2021, and February 21, 2022. In total, 1084 men were enrolled (2wT: n=547, 50.5%, control: n=537, 49.5%), with near-equal proportions of rural and urban participants. Cumulative AEs were identified in 2.3% (95% CI 1.3-4.1) of 2wT participants and 1.0% (95% CI 0.4-2.3) of control participants, demonstrating noninferiority (1-sided 95% CI -0.09 to ∞). Among the 2wT participants, 11 AEs (9 moderate and 2 severe) were identified, compared with 5 AEs (all moderate) among the control participants-a nonsignificant difference in AE rates (P=.13). The 2wT participants attended 0.22 visits, and the control participants attended 1.34 visits-a significant reduction in follow-up visit workload (P<.001). The 2wT approach reduced unnecessary postoperative visits by 84.8%. Daily response rates ranged from 86% on day 3 to 74% on day 13. Among the 2wT participants, 94% (514/547) responded to ≥1 daily SMS text messages over 13 days.

CONCLUSIONS

Across rural and urban contexts in South Africa, 2wT was noninferior to routine in-person visits for AE ascertainment, demonstrating 2wT safety. The 2wT approach also significantly reduced the follow-up visit workload, improving efficiency. These results strongly suggest that 2wT provides quality VMMC follow-up and should be adopted at scale. Adaptation of the 2wT telehealth approach to other acute follow-up care contexts could extend these gains beyond VMMC.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04327271; https://www.clinicaltrials.gov/ct2/show/NCT04327271.

Centering Frontline Health Care Workers in Digital Innovation Design to Inform the Optimization of an App for Improved Male Circumcision Follow-up in South Africa: Qualitative Usability Study

BACKGROUND

Voluntary medical male circumcision (VMMC) is a safe and effective HIV prevention strategy. However, adherence to recommended in-person, postoperative follow-up is inefficient for procedures with few adverse events. Two-way texting (2wT)-based follow-up appears to be a safe and an efficient alternative to scheduled clinic visits for low-risk patients who underwent VMMC. To ensure that 2wT responds to the needs of health care workers (HCWs) and patients, HCWs were closely involved in app design using a human-centered design (HCD) approach.

OBJECTIVE

Embedded within an ongoing randomized controlled trial of 2wT in South Africa and complementary HCD processes of 2wT app optimization, this qualitative study aimed to use key informant interviews (KIIs) to explore the thoughts, suggestions, and opinions on and perceptions of 2wT's usability and acceptability among HCWs involved in 2wT implementation in both urban and rural South Africa.

METHODS

A total of 7 HCWs using 2wT in Gauteng and the North West province participated in KIIs regarding the usability and acceptability of 2wT. HCWs were asked for their opinions on 2wT as a viable, useful, appropriate, and accessible method of postoperative VMMC care. They were also asked about 2wT-related working, exploring areas where 2wT could add to or reduce their daily tasks. The KII data were explored, coded, and analyzed by 3 qualitative researchers using thematic content analysis and the ATLAS.ti (ATLAS.ti Scientific Software Development GmbH) software.

RESULTS

Most HCWs felt confident, comfortable, satisfied, and well supported using a 2wT-based follow-up as an alternative to in-person clinical reviews. They felt that 2wT was easy to use and required little technical support after initial mentoring on how to use the 2wT system. Few noted safety concerns, as men can receive clinical guidance, reassurance, and referral via 2wT. Although fewer in-person visits reduced the in-person review workload and eased clinical flow, HCWs noted the added burden of having to interact with clients via SMS text messages on evenings or weekends. HCWs reinforced the need for enhanced postoperative counseling to ensure that 2wT patients could recognize and understood how to respond to early signs of complications. HCWs suggested a rotation to spread the evening and weekend workload and ensure swift patient responses.

CONCLUSIONS

In this formative qualitative study focused on HCWs, 2wT was a highly usable alternative to in-person postoperative reviews for patients who underwent VMMC in South Africa. The HCD processes likely improved the usability and acceptability of 2wT for HCWs. HCWs supported the scale-up of 2wT given the distance from the clinic to the men's homes and the potential for reducing workload. To ensure success, providers urged sensitizing patients to the fact that 2wT augments, but does not replace, the existing after-hours and emergency care services.

Centering healthcare workers in developing digital health interventions: usability and acceptability of a two-way texting retention intervention in a public HIV clinic in Lilongwe, Malawi

Background

New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low-resource settings, like Malawi, appropriate digital health applications must fit into local connectivity and resource constraints. Target users' perspectives are critical for app usability, buy-in and optimization. We describe the formative stages of the design of a two-way text-based (2wT) system of tailored reminders and adherence messages for new ART initiates and share results from key informant interviews with HCWs focused on app usability and acceptability.

Methods

Using a co-creation approach with clients, clinical, technical and evaluation teams and over app development, we held four informal user feedback sessions, a small pilot with 50 clients, and ten key informant (KIIs) to deepen our understanding of healthcare workers (HCWs) needs, acceptability and usability.

Results

Formative research informed the design of interactive client-to-HCW communication, refining of the language and timing of weekly text blast motivational messages and tailored client-specific visit reminders. Informal feedback from HCW stakeholders also informed educational materials to enhance 2wT client understanding of how to report transfers, request visit date changes and ask questions related to their visits. In KII, HCWs noted their appreciation for the co-creation process, believing that the participatory HCD process and responsive design team enabled the development of a highly acceptable and usable 2wT digital tool. HCWs also suggested future improvements to promote inclusion of clients of varying literacy levels and economic backgrounds as well as integrating with other health platforms to improve uptake of 2wT.

Conclusions

Inclusion of HCWs increased perceptions of app usability and acceptability among HCWs. HCWs believe that 2wT will improve on-time ART visit attendance and provide valuable early retention in care support. The co-creation approach appears successful in designing an app that will meet HCW needs and, therefore, support client adherence to visits.

'I understood the texting process well'. Participant perspectives on usability and acceptability of SMS-based telehealth follow-up after voluntary medical male circumcision in South Africa

Background

Voluntary medical male circumcision (MC) is a biomedical HIV prevention method that requires post-operative follow-up for healing confirmation. Recent research found that a two-way texting (2wT) app providing SMS-based telehealth for MC patients was safe and reduced provider workload. We evaluated 2wT usability among MC clients in South Africa assigned the 2wT intervention within a larger randomized controlled trial (RCT) of 2wT safety and workload.

Methods

This quantitative usability study is within an RCT where 547 men used 2wT to interact with an MC provider via SMS. The sub-study involved the first 100 men assigned to 2wT who completed a usability survey 14 days after surgery. Acceptability was assessed through 2wT response rates of the 547 men. Regression models analyzed associations between age, wage, location, potential adverse events (AEs), and 2wT responses.

Results

Men assigned to 2wT found it safe, comfortable, and convenient, reporting time and cost savings. High response rates (88%) to daily messages indicated acceptability. Age, wage, and location didn't affect text responses or potential AEs.

Conclusion

2wT for post-MC follow-up was highly usable and acceptable, suggesting its viability as an alternative to in-person visits. It enhanced confidence in wound self-management. This SMS-based telehealth can enhance MC care quality and be adapted to similar contexts for independent healing support, particularly for men.

A Digital Mental Health Intervention (Inuka) for Common Mental Health Disorders in Zimbabwean Adults in Response to the COVID-19 Pandemic: Feasibility and Acceptability Pilot Study

BACKGROUND

Common mental health disorders (CMDs) are leading causes of disability globally. The ongoing COVID-19 pandemic has further exacerbated the burden of CMDs. COVID-19 containment measures, including lockdowns, have disrupted access to in-person mental health care. It is therefore imperative to explore the utility of digital mental health interventions to bridge the treatment gap. Mobile health technologies are effective tools for increasing access to treatment at a lower cost. This study explores the utility of Inuka, a chat-based app hinged on the Friendship Bench problem-solving therapy intervention. The Inuka app offers double anonymity, and clients can book or cancel a session at their convenience. Inuka services can be accessed either through a mobile app or the web.

OBJECTIVE

We aimed to explore the feasibility of conducting a future clinical trial. Additionally, we evaluated the feasibility, acceptability, appropriateness, scalability, and preliminary effectiveness of Inuka.

METHODS

Data were collected using concurrent mixed methods. We used a pragmatic quasiexperimental design to compare the feasibility, acceptability, and preliminary clinical effectiveness of Inuka (experimental group) and WhatsApp chat-based counseling (control). Participants received 6 problem-solving therapy sessions delivered by lay counselors. A reduction in CMDs was the primary clinical outcome. The secondary outcomes were health-related quality of life (HRQoL), disability and functioning, and social support. Quantitative outcomes were analyzed using descriptive and bivariate statistics. Finally, we used administrative data and semistructured interviews to gather data on acceptability and feasibility; this was analyzed using thematic analysis.

RESULTS

Altogether, 258 participants were screened over 6 months, with 202 assessed for eligibility, and 176 participants were included in the study (recruitment ratio of 29 participants/month). The participants' mean age was 24.4 (SD 5.3) years, and most participants were female and had tertiary education. The mean daily smartphone usage was 8 (SD 3.5) hours. Eighty-three users signed up and completed at least one session. The average completion rate was 3 out of 4 sessions. Inuka was deemed feasible and acceptable in the local context, with connectivity challenges, app instability, expensive mobile data, and power outages cited as potential barriers to scale up. Generally, there was a decline in CMDs (F2,73=2.63; P=.08), depression (F2,73=7.67; P<.001), and anxiety (F2,73=2.95; P=.06) and a corresponding increase in HRQoL (F2,73=7.287; P<.001) in both groups.

CONCLUSIONS

Study outcomes showed that it is feasible to run a future large-scale randomized clinical trial (RCT) and lend support to the feasibility and acceptability of Inuka, including evidence of preliminary effectiveness. The app's double anonymity and structured support were the most salient features. There is a great need for iterative app updates before scaling up. Finally, a large-scale hybrid RCT with a longer follow-up to evaluate the clinical implementation and cost-effectiveness of the app is needed.

Transitioning a digital health innovation from research to routine practice: Two-way texting for male circumcision follow-up in Zimbabwe

Adult medical male circumcision (MC) is safe: global notifiable adverse event (AE) rates average below 2.0%. With Zimbabwe's shortage of health care workers (HCWs) compounded by COVID-19 constraints, two-way text-based (2wT) MC follow-up may be advantageous over routinely scheduled in-person reviews. A 2019 randomized control trial (RCT) found 2wT to be safe and efficient for MC follow-up. As few digital health interventions successfully transition from RCT to scale, we detail the 2wT scale-up approach from RCT to routine MC practice comparing MC safety and efficiency outcomes. After the RCT, 2wT transitioned from a site-based (centralized) system to hub-and-spoke model for scale-up where one nurse triaged all 2wT patients, referring patients in need to their local clinic. No post-operative visits were required with 2wT. Routine patients were expected to attend at least one post-operative review. We compare 1) AEs and in-person visits between 2wT men from RCT and routine MC service delivery; and 2) 2wT-based and routine follow-up among adults during the 2wT scale-up period, January to October 2021. During scale-up period, 5084 of 17417 adult MC patients (29%) opted into 2wT. Of the 5084, 0.08% (95% CI: 0.03, 2.0) had an AE and 71.0% (95% CI: 69.7, 72.2) responded to ≥1 daily SMS, a significant decrease from the 1.9% AE rate (95% CI: 0.7, 3.6; p<0.001) and 92.5% response rate (95% CI: 89.0, 94.6; p<0.001) from 2wT RCT men. During scale-up, AE rates did not differ between routine (0.03%; 95% CI: 0.02, 0.08) and 2wT (p = 0.248) groups. Of 5084 2wT men, 630 (12.4%) received telehealth reassurance, wound care reminders, and hygiene advice via 2wT; 64 (19.7%) were referred for care of which 50% had visits. Similar to RCT outcomes, routine 2wT was safe and provided clear efficiency advantages over in-person follow-up. 2wT reduced unnecessary patient-provider contact for COVID-19 infection prevention. Rural network coverage, provider hesitancy, and the slow pace of MC guideline changes slowed 2wT expansion. However, immediate 2wT benefits for MC programs and potential benefits of 2wT-based telehealth for other health contexts outweigh limitations.

Uptake of voluntary medical male circumcision among men with sexually transmitted infections in Lilongwe, Malawi: a protocol for a pre-interventional and post-interventional study

INTRODUCTION

Voluntary medical male circumcision (VMMC) is one of the key interventions for HIV prevention. However, its uptake among men in Malawi is low. Implementation science strategies for demand creation of VMMC increase uptake. We designed an implementation science demand-creation intervention to increase the uptake of VMMC among men with sexually transmitted infections (STIs).

METHODS AND ANALYSIS

We designed a pragmatic pre-interventional and post-interventional quasi-experimental study combined with a prospective observational design to determine the uptake, acceptability, appropriateness and feasibility of a multifaceted intervention for scale up of uptake of VMMC among men with STIs at Bwaila STI clinic in Lilongwe, Malawi. The intervention includes transport reimbursement (R), intensified health education (I) and short messaging service (SMS)/telephonic tracing (Te) (RITe). The intervention will be implemented in phases: pre-implementation and implementation. Pre-implementation phase will be used for collecting baseline data, while the RITe intervention will be rolled-out in the implementation phase. The RITe intervention will be implemented in a sequential and incremental manner called implementation blocks: block 1: intensified health education; block 2: intensified health education and SMS/telephonic tracing; and block 3: intensified health education, SMS/telephonic tracing and transport reimbursement. The target sample size is 80 uncircumcised men for each intervention block, including the pre-implementation sample, making a total of 320 men (280 total, 70 per block will be surveyed). The primary outcome is uptake of VMMC during the implementation period. Mixed methods assessments will be conducted to evaluate the acceptability, appropriateness and feasibility of the RITe intervention.

ETHICS AND DISSEMINATION

The study protocol was approved by the Malawi's National Health Sciences Research Ethics Committee (approval number: 19/10/2412), University of North Carolina at Chapel Hill's Institutional Review Board (approval number: 19-2559) and University of the Witwatersrand's Health Research Ethics Committee (approval number: M200328). Results will be disseminated via publication in a peer-reviewed journal and presentations at relevant scientific conferences and meetings.

TRIAL REGISTRATION NUMBER

NCT04677374.

The 4 Youth By Youth mHealth Photo Verification App for HIV Self-testing in Nigeria: Qualitative Analysis of User Experiences

Background

Despite the global expansion of HIV self-testing (HIVST), many research studies still rely on self-reported outcomes. New HIVST verification methods are needed, especially in resource-limited settings.

Objective

This study aims to evaluate the user experience of a mobile health (mHealth) app to enhance HIVST result reporting and verification.

Methods

Semistructured, in-depth interviews were used to evaluate the user experience of the 4 Youth By Youth mHealth photo verification app for HIVST. We used a think-aloud approach, and participants performed usability tasks and completed a qualitative exit interview. The app included HIV educational resources, step-by-step video instructions for performing HIVST, a 20-minute timer, a guide on interpreting results with linkages to care, an offline version, and a photo verification system. Demographic characteristics were reported by using descriptive statistics. Qualitative data were analyzed by using thematic analysis.

Results

A total of 19 users—12 women and 7 men—with a mean age of 22 years, participated in the study. The users completed the usability tasks and successfully uploaded a photo of their test results by using the app without assistance. Four main themes were identified in the data. First, in terms of user-friendly design, the participants noted the user-friendly features of the offline version and the app’s low data use. However, some wanted the app to work in the background when using their mobile phone, and the font used should be more youth friendly. Second, in terms of ease of use, participants remarked that the app’s self-explanatory nature and instructions that guided them on how to use the app enhanced its use. Third, in terms of a user’s privacy, many participants reinforced the importance of privacy settings and tools that protect confidentiality among users. Finally, in terms of linkage to care, participants noted that the app’s linkage to care features were useful, particularly in relation to referrals to trained counselors upon the completion of the test. All the participants noted that the app provided a convenient and private means of verifying the HIV test results.

Conclusions

Our findings demonstrated the importance of engaging end users in the development phase of health technology innovations that serve youth. Clinical trials are needed to determine the efficacy of using an mHealth app to verify HIVST results among young people.