An Implementation Strategy to Expand Mobile Health Use in HIV Care Settings: Rapid Evaluation Study Using the Consolidated Framework for Implementation Research

Three-Year Follow-up of PositiveLinks: Higher Use of mHealth Platform Associated with Sustained HIV Suppression

PositiveLinks (PL) is a mHealth platform to support care engagement by people with HIV (PWH). Daily reminders prompt the user to report medication adherence, mood, and daily stress. Higher response rate to PL check-ins has been associated with better suppression of viral load over 6-18 months. We conducted a retrospective chart review for a three-year period collecting demographic information, average mood and stress scores, and all viral loads obtained in usual patient care. We performed multivariable logistic regression modeling to identify factors associated with loss of viral load suppression and a time-to-event survival analysis until first unsuppressed viral load stratified by PL usage. Of the 513 PWH included, 103 had at least one episode of viral non-suppression. Low users of PL were more likely to have an unsuppressed viral load with an adjusted Odds Ratio (aOR) of 5.8 (95% CI 3.0-11.5, p < 0.001). Protective factors included older age (aOR 0.96; 95% CI 0.93-0.98, p = 0.003) and income above the federal poverty level (FPL) (aOR 0.996; 95% CI 0.995-0.998, p < 0.001). High PL use was also associated with better viral load suppression (VLS) over time (p < 0.0001 ((aHR) of 0.437 (95% CI 0.290-0.658, p < 0.001)) after adjusting for age and FPL. High stress scores were related to subsequent loss of viral suppression in an exploratory analysis. High check-in response rate on the PL app, older age, and higher income are associated with sustained VLS over time. Conversely, lack of response to check-ins or increased reported stress may signal a need for additional support.

"Your Package Could Not Be Delivered": The State of Digital HIV Intervention Implementation in the US

PURPOSE OF REVIEW

Despite continuous innovations and federal investment to create digital interventions addressing the HIV prevention and care continua, these interventions have not reached people in the U.S. at scale. This article reviews what is known about U.S. implementation of digital HIV interventions and presents a strategy to cross the research-to-practice chasm for these types of interventions.

RECENT FINDINGS

We conducted a narrative review of U.S.-based original research on implementation of digital HIV interventions and identified few studies reporting on implementation determinants, strategies, processes, or outcomes, particularly outside the context of effectiveness trials. To supplement the literature, in 2023, we surveyed 47 investigators representing 64 unique interventions about their experiences with implementation after their research trials. Respondents placed high importance on intervention implementation, but major barriers included lack of funding and clear implementation models, technology costs, and difficulty identifying partners equipped to deliver digital interventions. They felt that responsibility for implementation should be shared between intervention developers, deliverers (e.g., clinics), and a government entity. If an implementation center were to exist, most respondents wanted to be available for guidance or technical assistance but largely wanted less involvement. Numerous evidence-based, effective digital interventions exist to address HIV prevention and care. However, they remain "on the shelf" absent a concrete and sustainable model for real-world dissemination and implementation. Based on our findings, we call for the creation of national implementation centers, analogous to those in other health systems, to facilitate digital HIV intervention delivery and accelerate progress toward ending the U.S. epidemic.

An mHealth Platform for People With HIV Receiving Care in Washington, District of Columbia: Qualitative Analysis of Stakeholder Feedback

BACKGROUND

HIV viral suppression and retention in care continue to be challenging goals for people with HIV in Washington, District of Columbia (DC). The PositiveLinks mobile app is associated with increased retention in care and viral load suppression in nonurban settings. The app includes features such as daily medication reminders, mood and stress check-ins, an anonymized community board for peer-to-peer social support, secure messaging to care teams, and resources for general and clinic-specific information, among other features. PositiveLinks has not been tailored or tested for this distinct urban population of people with HIV.

OBJECTIVE

This study aimed to inform the tailoring of a mobile health app to the needs of people with HIV and their providers in Washington, DC.

METHODS

We conducted a 3-part formative study to guide the tailoring of PositiveLinks for patients in the DC Cohort, a longitudinal cohort of >12,000 people with HIV receiving care in Washington, DC. The study included in-depth interviews with providers (n=28) at study clinics, focus groups with people with HIV enrolled in the DC Cohort (n=32), and a focus group with members of the DC Regional Planning Commission on Health and HIV (COHAH; n=35). Qualitative analysis used a constant comparison iterative approach; thematic saturation and intercoder agreement were achieved. Emerging themes were identified and grouped to inform an adaptation of PositiveLinks tailored for patients and providers.

RESULTS

Emerging themes for patients, clinic providers, and COHAH providers included population needs and concerns, facilitators and barriers to engagement in care and viral suppression, technology use, anticipated benefits, questions and concerns, and suggestions. DC Cohort clinic and COHAH provider interviews generated an additional theme: clinic processes. For patients, the most commonly discussed potential benefits included improved health knowledge and literacy (mentioned n=10 times), self-monitoring (n=7 times), and connection to peers (n=6 times). For providers, the most common anticipated benefits were improved communication with the clinic team (n=21), connection to peers (n=14), and facilitation of self-monitoring (n=11). Following data review, site principal investigators selected core PositiveLinks features, including daily medication adherence, mood and stress check-ins, resources, frequently asked questions, and the community board. Principal investigators wanted English and Spanish versions depending on the site. Two additional app features (messaging and documents) were selected as optional for each clinic site. Overall, 3 features were not deployed as not all participating clinics supported them.

CONCLUSIONS

Patient and provider perspectives of PositiveLinks had some overlap, but some themes were unique to each group. Beta testing of the tailored app was conducted (August 2022). This formative work prepared the team for a cluster randomized controlled trial of PositiveLinks' efficacy. Randomization of clinics to PositiveLinks or usual care occurred in August 2022, and the randomized controlled trial launched in November 2022.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/37748.

Development of an App for Tracking Family Engagement With Early Intervention Services: Focus Groups and Pilot Evaluation Study

BACKGROUND

Expedient access to early intervention (EI) systems has been identified as a priority for children with developmental delays, identified disabilities, and other special health care needs. Despite the mandated availability of EI, it remains challenging for families to navigate referral processes and establish appropriate services. Such challenges disproportionately affect families from traditionally underserved communities. Mobile health apps can improve clinical outcomes, increase accessibility to health services, and promote adherence to health-related interventions. Though promising, the implementation of apps within routine care is in its infancy, with limited research examining the components of what makes an effective app or how to reach families most impacted by inequities in health care delivery.

OBJECTIVE

In study 1, we conducted focus groups to access a broad range of perspectives on the process of navigating the EI system, with the dual goals of identifying ways in which a patient-facing app might facilitate this process and identifying barriers to use with traditionally underrepresented and underserved groups. In study 2, focus group findings informed the development of a patient-facing app, which was subsequently tested with a pilot sample of 5 families.

METHODS

In study 1, the focus groups included 29 participants from 4 shareholder groups. Targeted sampling was used to recruit participants from traditionally underrepresented groups. Focus group questions sought information about barriers families experience as they navigate the EI system, ideal features of a patient-facing app designed to track family engagement with the EI system, and potential barriers. Focus group procedures were informed by the Consolidated Framework for Implementation Research framework. In study 2, a pilot app was developed. The app was tested with a sample of 5 families of young children involved in the EI system. Families provided information on app functionality and usability.

RESULTS

Qualitative analysis revealed a desire for increased communication and information about the process of accessing EI services, potential utility of an app for communication purposes, and clear recommendations for app features. Insights from focus groups were used to inform the development of the Family on Track app and related implementation supports. App features included survey customization, timing and delivery of prompts, and questions related to barriers and service satisfaction. Implementation supports include a visual guide for app installation, resources related to common family questions, and availability of study personnel to guide families through installation and provide ongoing support. Field testing provided preliminary information about app usability, including identifying future directions.

CONCLUSIONS

The results of this study could support the development of a new way for the EI system to communicate and connect with families, provide families with a means to communicate satisfaction and frustration, and access the supports they need to be active participants in their child's care.

Implementation and scaling-up of an effective mHealth intervention to increase adherence to triage of HPV-positive women (ATICA study): perceptions of health decision-makers and health-care providers

BACKGROUND

The ATICA study was a Hybrid I type randomized effectiveness-implementation trial that demonstrated effectiveness of a multicomponent mHealth intervention (Up to four SMS messages sent to HPV-positive women, and one SMS message to CHWs to prompt a visit of women with no triage Pap 60 days after a positive-test), to increase adherence to triage of HPV positive women (ATICA Study). We report data on perceptions of health decision-makers and health-care providers regarding the intervention implementation and scaling-up.

METHODS

A qualitative study was carried out based on individual, semi-structured interviews with health decision-makers (n = 10) and health-care providers (n = 10). The themes explored were selected and analyzed using domains and constructs of the Consolidated Framework for Implementation Research (CFIR) and the maintenance dimension of the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework.

RESULTS

Both health-care providers and decision-makers had a positive assessment of the intervention through most included constructs: knowledge of the intervention, intervention source, design quality, adaptability, compatibility, access to knowledge and information, relative advantage, women's needs, and relative priority. However, some potential barriers were also identified including: complexity, leadership engagement, external policies, economic cost, women needs and maintenance. Stakeholders conditioned the strategy's sustainability to the political commitment of national and provincial health authorities to prioritize cervical cancer prevention, and to the establishment of the ATICA strategy as a programmatic line of work by health authorities. They also highlighted the need to ensure, above all, that there was staff to take Pap tests and carry out the HPV-lab work, and to guarantee a constant provision of HPV-tests.

CONCLUSION

Health decision-makers and health-care providers had a positive perception regarding implementation of the multicomponent mHealth intervention designed to increase adherence to triage among women with HPV self-collected tests. This increases the potential for a successful scaling-up of the intervention, with great implications not only for Argentina but also for middle and low-income countries considering using mHealth interventions to enhance the cervical screening/follow-up/treatment process.

Approaches to enabling rapid evaluation of innovations in health and social care: a scoping review of evidence from high-income countries

OBJECTIVE

The COVID-19 pandemic increased the demand for rapid evaluation of innovation in health and social care. Assessment of rapid methodologies is lacking although challenges in ensuring rigour and effective use of resources are known. We mapped reports of rapid evaluations of health and social care innovations, categorised different approaches to rapid evaluation, explored comparative benefits of rapid evaluation, and identified knowledge gaps.

DESIGN

Scoping review.

DATA SOURCES

MEDLINE, EMBASE and Health Management Information Consortium (HMIC) databases were searched through 13 September 2022.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

We included publications reporting primary research or methods for rapid evaluation of interventions or services in health and social care in high-income countries.

DATA EXTRACTION AND SYNTHESIS

Two reviewers developed and piloted a data extraction form. One reviewer extracted data, a second reviewer checked 10% of the studies; disagreements and uncertainty were resolved through consensus. We used narrative synthesis to map different approaches to conducting rapid evaluation.

RESULTS

We identified 16 759 records and included 162 which met inclusion criteria.We identified four main approaches for rapid evaluation: (1) Using methodology designed specifically for rapid evaluation; (2) Increasing rapidity by doing less or using less time-intensive methodology; (3) Using alternative technologies and/or data to increase speed of existing evaluation method; (4) Adapting part of non-rapid evaluation.The COVID-19 pandemic resulted in an increase in publications and some limited changes in identified methods. We found little research comparing rapid and non-rapid evaluation.

CONCLUSIONS

We found a lack of clarity about what 'rapid evaluation' means but identified some useful preliminary categories. There is a need for clarity and consistency about what constitutes rapid evaluation; consistent terminology in reporting evaluations as rapid; development of specific methodologies for making evaluation more rapid; and assessment of advantages and disadvantages of rapid methodology in terms of rigour, cost and impact.

A scoping review of applications of the Consolidated Framework for Implementation Research (CFIR) to telehealth service implementation initiatives

BACKGROUND

The Consolidated Framework for Implementation Research (CFIR), introduced in 2009, has the potential to provide a comprehensive understanding of the determinants of implementation-effectiveness of health service innovations. Although the CFIR has been increasingly used in recent years to examine factors influencing telehealth implementation, no comprehensive reviews currently exist on the scope of knowledge gained exclusively from applications of the CFIR to telehealth implementation initiatives. This review sought to address this gap.

METHODS

PRISMA-ScR criteria were used to inform a scoping review of the literature. Five academic databases (PUBMED, PROQUEST, SCIDIRECT, CINAHL, and WoS) were searched for eligible sources of evidence from 01.01.2010 through 12.31.2021. The initial search yielded a total of 18,388 records, of which, 64 peer-reviewed articles met the inclusion criteria for the review. Included articles were reviewed in full to extract data, and data collected were synthesized to address the review questions.

RESULTS

Most included articles were published during or after 2020 (64%), and a majority (77%) were qualitative or mixed-method studies seeking to understand barriers or facilitators to telehealth implementation using the CFIR. There were few comparative- or implementation-effectiveness studies containing outcome measures (5%). The database search however, revealed a growing number of protocols for implementation-effectiveness studies published since 2020. Most articles (91%) reported the CFIR Inner Setting domain (e.g., leadership engagement) to have a predominant influence over telehealth implementation success. By comparison, few articles (14%) reported the CFIR Outer Setting domain (e.g., telehealth policies) to have notable influence. While more (63%) telehealth initiatives were focused on specialty (vs primary) care, a vast majority (78%) were focused on clinical practice over medical education, healthcare administration, or population health.

CONCLUSIONS

Organized provider groups have historically paid considerable attention to advocating for telehealth policy (Outer Setting) reform. However, results suggest that for effective telehealth implementation, provider groups need to refocus their efforts on educating individual providers on the complex inter-relationships between Inner Setting constructs and telehealth implementation-effectiveness. On a separate note, the growth in implementation-effectiveness study protocols since 2020, suggests that additional outcome measures may soon be available, to provide a more nuanced understanding of the determinants of effective telehealth implementation based on the CFIR domains and constructs.

Evaluation of the implementation and effectiveness of a mobile health intervention to improve outcomes for people with HIV in the DC Cohort: a study protocol for a cluster randomized controlled trial

Background

Gaps remain in achieving retention in care and durable HIV viral load suppression for people with HIV in Washington, DC (hereafter DC). Although people with HIV seeking care in DC have access to a range of supportive services, innovative strategies are needed to enhance patient engagement in this setting. Mobile health (mHealth) interventions have shown promise in reaching previously underengaged groups and improving HIV-related outcomes in various settings.

Objective

This study will evaluate the implementation and effectiveness of a clinic-deployed, multifeature mHealth intervention called PositiveLinks (PL) among people with HIV enrolled in the DC Cohort, a longitudinal cohort of people with HIV receiving care in DC. A cluster randomized controlled trial will be conducted using a hybrid effectiveness-implementation design and will compare HIV-related outcomes between clinics randomized to PL versus usual care.

Methods

The study aims are threefold: (1) We will perform a formative evaluation of PL in the context of DC Cohort clinics to test the feasibility, acceptability, and usability of PL and tailor the platform for use in this context. (2) We will conduct a cluster randomized controlled trial with 12 DC Cohort clinics randomized to PL or usual care (n=6 [50%] per arm) and measure the effectiveness of PL by the primary outcomes of patient visit constancy, retention in care, and HIV viral load suppression. We aim to enroll a total of 482 participants from DC Cohort clinic sites, specifically including people with HIV who show evidence of inconsistent retention in care or lack of viral suppression. (3) We will use the Consolidated Framework for Implementation Research (CFIR) and the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to measure implementation success and identify site, patient, provider, and system factors associated with successful implementation. Evaluation activities will occur pre-, mid-, and postimplementation.

Results

Formative data collection was completed between April 2021 and January 2022. Preliminary mHealth platform modifications have been performed, and the first round of user testing has been completed. A preimplementation evaluation was performed to identify relevant implementation outcomes and design a suite of instruments to guide data collection for evaluation of PL implementation throughout the trial period. Instruments include those already developed to support DC Cohort Study activities and PL implementation in other cohorts, which required modification for use in the study, as well as novel instruments designed to complete data collection, as guided by the CFIR and RE-AIM frameworks.

Conclusions

Formative and preimplementation evaluations will be completed in spring 2022 when the trial is planned to launch. Specifically, comprehensive formative data analysis will be completed following data collection, coding, preliminary review, and synthesis. Corresponding platform modifications are ready for beta testing within the DC Cohort. Finalization of the platform for use in the trial will follow beta testing.

Trial Registration

ClinicalTrials.gov NCT04998019; https://clinicaltrials.gov/ct2/show/NCT04998019

International Registered Report Identifier (IRRID)

PRR1-10.2196/37748