Avoiding the Road to Nowhere: Policy Insights on Scaling up and Sustaining Digital Health

Digital tools for youth health promotion: principles, policies and practices in sub-Saharan Africa

Although digital health promotion (DHP) technologies for young people are increasingly available in low- and middle-income countries (LMICs), there has been insufficient research investigating whether existing ethical and policy frameworks are adequate to address the challenges and promote the technological opportunities in these settings. In an effort to fill this gap and as part of a larger research project, in November 2022, we conducted a workshop in Cape Town, South Africa, entitled 'Unlocking the Potential of Digital Health Promotion for Young People in Low- and Middle-Income Countries'. The workshop brought together 25 experts from the areas of digital health ethics, youth health and engagement, health policy and promotion and technology development, predominantly from sub-Saharan Africa (SSA), to explore their views on the ethics and governance and potential policy pathways of DHP for young people in LMICs. Using the World Café method, participants contributed their views on (i) the advantages and barriers associated with DHP for youth in LMICs, (ii) the availability and relevance of ethical and regulatory frameworks for DHP and (iii) the translation of ethical principles into policies and implementation practices required by these policies, within the context of SSA. Our thematic analysis of the ensuing discussion revealed a willingness to foster such technologies if they prove safe, do not exacerbate inequalities, put youth at the center and are subject to appropriate oversight. In addition, our work has led to the potential translation of fundamental ethical principles into the form of a policy roadmap for ethically aligned DHP for youth in SSA.

Users' involvement in digital health collaborative projects

PURPOSE

This research analyzes the roles of users in innovative digital health collaborative projects from the perspective of the user by considering three dimensions: their motivation, project activities and the support of the partnership for their effective involvement.

DESIGN/METHODOLOGY/APPROACH

The authors unraveled profiles of users by using a Q-methodological analysis of 24 statements and 44 service users. The statements for the three dimensions were designed according to previous models of stakeholder identification and customer participation in new product management.

FINDINGS

The authors obtained two profiles that advocate active participation of users, though with a different degree of involvement. One of them supports the role of users as "advisors" of users' preferences and needs, and the other indicates a higher involvement of users as "cocreators" of the innovation, with the same contribution and responsibility as the other partners.

ORIGINALITY/VALUE

Previous research has analyzed user involvement in digital health, as part of wider research on factors leading to the success and adoption of innovations. Moreover, previous research has analyzed user involvement in innovation projects, but without differentiating between projects carried out by an individual organization and those conducted by a partnership. This research contributes to filling this gap by revealing users' expectations about their involvement and how they think they will fit in with the dynamics of collaborative projects.

Mapping digital health ecosystems in Africa in the context of endemic infectious and non-communicable diseases

Investments in digital health technologies such as artificial intelligence, wearable devices, and telemedicine may support Africa achieve United Nations (UN) Sustainable Development Goal for Health by 2030. We aimed to characterize and map digital health ecosystems of all 54 countries in Africa in the context of endemic infectious and non-communicable diseases (ID and NCD). We performed a cross-national ecological analysis of digital health ecosystems using 20-year data from the World Bank, UN Economic Commission for Africa, World Health Organization, and Joint UN Programme on HIV/AIDS. Spearman's rank correlation coefficients were used to characterize ecological correlations between exposure (technology characteristics) and outcome (IDs and NCDs incidence/mortality) variables. Weighted linear combination model was used as the decision rule, combining disease burden, technology access, and economy, to explain, rank, and map digital health ecosystems of a given country. The perspective of our analysis was to support government decision-making. The 20-year trend showed that technology characteristics have been steadily growing in Africa, including internet access, mobile cellular and fixed broadband subscriptions, high-technology manufacturing, GDP per capita, and adult literacy, while many countries have been overwhelmed by a double burden of IDs and NCDs. Inverse correlations exist between technology characteristics and ID burdens, such as fixed broadband subscription and incidence of tuberculosis and malaria, or GDP per capita and incidence of tuberculosis and malaria. Based on our models, countries that should prioritize digital health investments were South Africa, Nigeria, and Tanzania for HIV; Nigeria, South Africa, and Democratic Republic of the Congo (DROC) for tuberculosis; DROC, Nigeria, and Uganda for malaria; and Egypt, Nigeria, and Ethiopia for endemic NCDs including diabetes, cardiovascular disease, respiratory diseases, and malignancies. Countries such as Kenya, Ethiopia, Zambia, Zimbabwe, Angola, and Mozambique were also highly affected by endemic IDs. By mapping digital health ecosystems in Africa, this study provides strategic guidance about where governments should prioritize digital health technology investments that require preliminary analysis of country-specific contexts to bring about sustainable health and economic returns. Building digital infrastructure should be a key part of economic development programs in countries with high disease burdens to ensure more equitable health outcomes. Though infrastructure developments alongside digital health technologies are the responsibility of governments, global health initiatives can cultivate digital health interventions substantially by bridging knowledge and investment gaps, both through technology transfer for local production and negotiation of prices for large-scale deployment of the most impactful digital health technologies.

Can we design the next generation of digital health communication programs by leveraging the power of artificial intelligence to segment target audiences, bolster impact and deliver differentiated services? A machine learning analysis of survey data from rural India

OBJECTIVES

Direct to beneficiary (D2B) mobile health communication programmes have been used to provide reproductive, maternal, neonatal and child health information to women and their families in a number of countries globally. Programmes to date have provided the same content, at the same frequency, using the same channel to large beneficiary populations. This manuscript presents a proof of concept approach that uses machine learning to segment populations of women with access to phones and their husbands into distinct clusters to support differential digital programme design and delivery.

SETTING

Data used in this study were drawn from cross-sectional survey conducted in four districts of Madhya Pradesh, India.

PARTICIPANTS

Study participant included pregnant women with access to a phone (n=5095) and their husbands (n=3842) RESULTS: We used an iterative process involving K-Means clustering and Lasso regression to segment couples into three distinct clusters. Cluster 1 (n=1408) tended to be poorer, less educated men and women, with low levels of digital access and skills. Cluster 2 (n=666) had a mid-level of digital access and skills among men but not women. Cluster 3 (n=1410) had high digital access and skill among men and moderate access and skills among women. Exposure to the D2B programme 'Kilkari' showed the greatest difference in Cluster 2, including an 8% difference in use of reversible modern contraceptives, 7% in child immunisation at 10 weeks, 3% in child immunisation at 9 months and 4% in the timeliness of immunisation at 10 weeks and 9 months.

CONCLUSIONS

Findings suggest that segmenting populations into distinct clusters for differentiated programme design and delivery may serve to improve reach and impact.

TRIAL REGISTRATION NUMBER

NCT03576157.

Cost-effectiveness of a direct to beneficiary mobile communication programme in improving reproductive and child health outcomes in India

INTRODUCTION

Kilkari is the largest maternal messaging programme of its kind globally. Between its initiation in 2012 in Bihar and its transition to the government in 2019, Kilkari was scaled to 13 states across India and reached over 10 million new and expectant mothers and their families. This study aims to determine the cost-effectiveness of exposure to Kilkari as compared with no exposure across 13 states in India.

METHODS

The study was conducted from a programme perspective using an analytic time horizon aligned with national scale-up efforts from December 2014 to April 2019. Economic costs were derived from the financial records of implementing partners. Data on incremental changes in the practice of reproductive maternal newborn and child health (RMNCH) outcomes were drawn from an individually randomised controlled trial in Madhya Pradesh and inputted into the Lives Saved Tool to yield estimates of maternal and child lives saved. One-way and probabilistic sensitivity analyses were carried out to assess uncertainty.

RESULTS

Inflation adjusted programme costs were US$8.4 million for the period of December 2014-April 2019, corresponding to an average cost of US$264 298 per year of implementation in each state. An estimated 13 842 lives were saved across 13 states, 96% among children and 4% among mothers. The cost per life saved ranged by year of implementation and with the addition of new states from US$392 ($385-$393) to US$953 ($889-$1092). Key drivers included call costs and incremental changes in coverage for key RMNCH practices.

CONCLUSION

Kilkari is highly cost-effective using a threshold of India's national gross domestic product of US$1998. Study findings provide important evidence on the cost-effectiveness of a national maternal messaging programme in India.

TRIAL REGISTRATION

NCT03576157.

A cluster randomized controlled trial of an electronic decision-support system to enhance antenatal care services in pregnancy at primary healthcare level in Telangana, India: trial protocol

BACKGROUND

India contributes 15% of the total global maternal mortality burden. An increasing proportion of these deaths are due to Pregnancy Induced Hypertension (PIH), Gestational Diabetes Mellitus (GDM), and anaemia. This study aims to evaluate the effectiveness of a tablet-based electronic decision-support system (EDSS) to enhance routine antenatal care (ANC) and improve the screening and management of PIH, GDM, and anaemia in pregnancy in primary healthcare facilities of Telangana, India. The EDSS will work at two levels of primary health facilities and is customized for three cadres of healthcare providers - Auxiliary Nurse Midwifes (ANMs), staff nurses, and physicians (Medical Officers).

METHODS

This will be a cluster randomized controlled trial involving 66 clusters with a total of 1320 women in both the intervention and control arms. Each cluster will include three health facilities-one Primary Health Centre (PHC) and two linked sub-centers (SC). In the facilities under the intervention arm, ANMs, staff nurses, and Medical Officers will use the EDSS while providing ANC for all pregnant women. Facilities in the control arm will continue to provide ANC services using the existing standard of care in Telangana. The primary outcome is ANC quality, measured as provision of a composite of four selected ANC components (measurement of blood pressure, blood glucose, hemoglobin levels, and conducting a urinary dipstick test) by the healthcare providers per visit, observed over two visits. Trained field research staff will collect outcome data via an observation checklist.

DISCUSSION

To our knowledge, this is the first trial in India to evaluate an EDSS, targeted to enhance the quality of ANC and improve the screening and management of PIH, GDM, and anaemia, for multiple levels of health facilities and several cadres of healthcare providers. If effective, insights from the trial on the feasibility and cost of implementing the EDSS can inform potential national scale-up. Lessons learned from this trial will also inform recommendations for designing and upscaling similar mHealth interventions in other low and middle-income countries.

TRIAL REGISTRATION

CLINICALTRIALS

gov, NCT03700034, registered 9 Oct 2018, https://www.

CLINICALTRIALS

gov/ct2/show/NCT03700034 CTRI, CTRI/2019/01/016857, registered on 3 Mar 2019, http://www.ctri.nic.in/Clinicaltrials/pdf_generate.php?trialid=28627&EncHid=&modid=&compid=%27,%2728627det%27.

Digital humanitarianism and crisis management: an empirical study of antecedents and consequences

Purpose

This study proposes a digital humanitarianism dynamic capability (DHDC) paradigm that explores the direct effects of DHDC on disaster risk reduction (DRR) and the mediating effects of process-oriented dynamic capabilities (PODC) on the relationship between DHDC and DRR.

Design/methodology/approach

To validate the proposed model, the authors used an offline survey to gather data from 260 district magistrates in India managing the COVID-19 pandemic.

Findings

The results affirm the importance of the DHDC system for DRR. The findings depict that the impact of PODC on DRR in the DHDC system is negligible. This study can help policymakers in planning during emergencies.

Research limitations/implications

Technological innovation has reshaped the way humanitarian organizations (HOs) respond to humanitarian crises. These organizations are able to provide immediate aid to affected communities through digital humanitarianism (DH), which involves significant innovations to match the specific needs of people in real-time through online platforms. Despite the growing need for DH, there is still limited know-how regarding how to leverage such technological concepts into disaster management. Moreover, the impact of DH on DRR is rarely examined.

Originality/value

The present study examines the impact of the dynamic capabilities of HOs on DRR by applying the resource-based view (RBV) and dynamic capability theory (DCT).

Can digitally enabling community health and nutrition workers improve services delivery to pregnant women and mothers of infants? Quasi-experimental evidence from a national-scale nutrition programme in India

Background

India’s 1.4 million community health and nutrition workers (CHNWs) serve 158 million beneficiaries under the Integrated Child Development Services (ICDS) programme. We assessed the impact of a data capture, decision support, and job-aid mobile app for the CHNWs on two primary outcomes—(1) timeliness of home visits and (2) appropriate counselling specific to the needs of pregnant women and mothers of children <12 months.

Methods

We used a quasi-experimental pair-matched controlled trial using repeated cross-sectional surveys to evaluate the intervention in Bihar and Madhya Pradesh (MP) separately using an intention-to-treat analysis. The study was powered to detect difference of 5–9 percentage points (pp) with type I error of 0.05 and type II error of 0.20 with endline sample of 6635 mothers of children <12 months and 2398 pregnant women from a panel of 841 villages.

Results

Among pregnant women and mothers of children <12 months, recall of counselling specific to the trimester of pregnancy or age of the child as per ICDS guidelines was higher in both MP (11.5pp (95% CI 7.0pp to 16.0pp)) and Bihar (8.0pp (95% CI 5.3pp to 10.7pp)). Significant differences were observed in the proportion of mothers of children <12 months receiving adequate number of home visits as per ICDS guidelines (MP 8.3pp (95% CI 4.1pp to 12.5pp), Bihar: 7.9pp (95% CI 4.1pp to 11.6pp)). Coverage of children receiving growth monitoring increased in Bihar (22pp (95% CI 0.18 to 0.25)), but not in MP. No effects were observed on infant and young child feeding practices.

Conclusion

The at-scale app integrated with ICDS improved provision of services under the purview of CHNWs but not those that depended on systemic factors, and was relatively more effective when baseline levels of services were low. Overall, digitally enabling CHNWs can complement but not substitute efforts for strengthening health systems and addressing structural barriers.

Trial registration number

ISRCTN83902145.

The impact of a direct to beneficiary mobile communication program on reproductive and child health outcomes: a randomised controlled trial in India

Background

Direct-to-beneficiary communication mobile programmes are among the few examples of digital health programmes to have scaled widely in low-resource settings. Yet, evidence on their impact at scale is limited. This study aims to assess whether exposure to mobile health information calls during pregnancy and postpartum improved infant feeding and family planning practices.

Methods

We conducted an individually randomised controlled trial in four districts of Madhya Pradesh, India. Study participants included Hindi speaking women 4–7 months pregnant (n=5095) with access to a mobile phone and their husbands (n=3842). Women were randomised to either an intervention group where they received up to 72 Kilkari messages or a control group where they received none. Intention-to-treat (ITT) and instrumental variable (IV) analyses are presented.

Results

An average of 65% of the 2695 women randomised to receive Kilkari listened to ≥50% of the cumulative content of calls answered. Kilkari was not observed to have a significant impact on the primary outcome of exclusive breast feeding (ITT, relative risk (RR): 1.04, 95% CI 0.88 to 1.23, p=0.64; IV, RR: 1.10, 95% CI 0.67 to 1.81, p=0.71). Across study arms, Kilkari was associated with a 3.7% higher use of modern reversible contraceptives (RR: 1.12, 95% CI 1.03 to 1.21, p=0.007), and a 2.0% lower proportion of men or women sterilised since the birth of the child (RR: 0.85, 95% CI 0.74 to 0.97, p=0.016). Higher reversible method use was driven by increases in condom use and greatest among those women exposed to Kilkari with any male child (9.9% increase), in the poorest socioeconomic strata (15.8% increase), and in disadvantaged castes (12.0% increase). Immunisation at 10 weeks was higher among the children of Kilkari listeners (2.8% higher; RR: 1.03, 95% CI 1.00 to 1.06, p=0.048). Significant differences were not observed for other maternal, newborn and child health outcomes assessed.

Conclusion

Study findings provide evidence to date on the effectiveness of the largest mobile health messaging programme in the world.

Trial registration number

Trial registration clinicaltrials.gov; ID 90075552, NCT03576157.

Methods and Lessons From Costing a Large mHealth Intervention at Scale in India

The use of mobile devices to deliver public health interventions is rapidly increasing, particularly in low resource settings. Despite their proliferation, several mHealth interventions in developing countries fail to reach geographical scale, and long-term sustainability for most remains uncertain. There is a need to cost for such programs, to enable better planning and budgeting and tailor programs as required. Cost estimates can contribute to a more informed debate on resource allocation priorities and help make choices clearer for policymakers. This paper has two main objectives: (1) present a detailed protocol on determining the costs of a large national mHealth job aid and behavior change communication tool known as Integrated Child Development Services - Common Application Software (ICDS-CAS) in India, and (2) to present lessons for policymakers on how to ensure financial planning for scaling mHealth interventions. The study uses the Activity Based Costing—Ingredients (ABC-I) method. The major advantage of the ABC-I method is the clarity it brings to costs for each input and activity, across levels and geographies. It also accounts for indirect costs. There are five key lessons while costing for mHealth programs. First, that there are many activities and ingredients that must be budgeted for and discussed while planning and implementing mHealth programs. Second, the ABC-I method described in this paper provides great clarity on costs, yet its major limitation is the availability of data, which must be mitigated with the careful use of assumptions. Third, mHealth technology life cycles have financial implications which must be accounted for. Fourth, determining cost locations and all sources of funding including non-government sources is crucial. Fifth, since costing estimates are subject to a set of assumptions, a disaggregation of costs allows for scenario-building, which is useful while planning ahead and accounting for program changes. The evidence generated can be used for more informed debate on resource allocation priorities, given competing priorities in low- and middle-income countries.

Making Digital Health “Solutions” Sustainable in Healthcare Systems: A Practitioner Perspective

Digital health solutions have the potential to bring about great improvements in the delivery and quality of services in healthcare systems. In this paper, we draw on the extensive experience of NHS (National Health Service) England to develop a practitioner perspective on the challenges of effectively implementing and sustaining such solutions. We argue that a properly sustainable approach requires a shift in both thinking and practice when it comes to the spread and adoption of such technologies. Our thinking needs to shift from a focus on the technology itself to how we bring about the changes needed to deliver more efficient and effective care for patients. In practical terms, this means focussing on the changes involved to integrate digital health solutions into the delivery of services. In particular, it requires greater attention to the motivations, constraints and specific contexts that influence users and patients. The technical expertise of innovators therefore needs to be complemented by other forms of insight into change processes, including clinical and behavioral insight, process engineering and knowledge management. In this paper, we show how these different pillars of the NHS Sustainable Healthcare approach help to ensure the effective implementation and use of digital solutions. We draw out the implications of this approach for policy-makers in healthcare systems, highlighting the need to give greater attention and resources to the downstream challenges of implementing digital health solutions.

Capacity and Readiness Assessment of Healthcare Facilities for Digital Health Interventions Against Tuberculosis and HIV in Addis Ababa, Ethiopia

Background

There is a high level of concern that low-income countries lack the capacity and readiness to effectively adopt, implement, and scale up digital health interventions (DHIs). We aimed to assess the infrastructure and human resource capacity and readiness of healthcare facilities to adopt and implement any new DHI for tuberculosis (TB) and HIV care and treatment in Addis Ababa, Ethiopia.

Method

We carried out a cross-sectional, mixed-methods study in 14 public healthcare facilities that provide TB and HIV care and treatment services. Providers' perceived readiness to adopt and implement digital health was assessed using a self-administered questionnaire designed based on an adapted eHealth readiness assessment model that covers six domains: core readiness, organizational cultural readiness, value proposition readiness, technological readiness, regulatory policy readiness, and operational resource readiness. The infrastructure and human resource capacity were assessed on-site using a tool adapted from the Technology Infrastructure Checklist. Internal consistency was assessed using Cronbach's alpha, and the significant relationship between the composite variables was assessed using Pearson's correlation coefficients (r).

Result

We assessed 14 facilities on-site and surveyed 60 TB and HIV healthcare providers. According to Cronbach's alpha test, all the six technology acceptance domains had a value of >0.8, suggesting a strong interrelatedness between the measuring items. The correlation between technological readiness and operational resource readiness was significant (r = 0.8). The providers perceived their work environment as good enough in electronic data protection, while more efforts are needed in planning, training, adapting, and implementing digital health. Of the 14 facilities, 64.3% lack the plan to establish a functional local area network, and 43% lack skilled staff on payroll to provide maintenance of computers and other digital technologies.

Conclusion

Like many developing countries, there was a modest infrastructure and human resource capacity and readiness of public healthcare facilities in Addis Ababa, Ethiopia, to nurture and strengthen DHIs across the TB and HIV cascades of care. Technological and operational resource readiness, including funding and a Well-trained workforce, are essential for successful implementation and use of digital health against the two infectious diseases of global importance in such settings.

A tale of 'politics and stars aligning': analysing the sustainability of scaled up digital tools for front-line health workers in India

INTRODUCTION

India has become a lighthouse for large-scale digital innovation in the health sector, particularly for front-line health workers (FLHWs). However, among scaled digital health solutions, ensuring sustainability remains elusive. This study explores the factors underpinning scale-up of digital health solutions for FLHWs in India, and the potential implications of these factors for sustainability.

METHODS

We assessed five FLHW digital tools scaled at the national and/or state level in India. We conducted in-depth interviews with implementers, technology and technical partners (n=11); senior government stakeholders (n=5); funders (n=1) and evaluators/academics (n=3). Emergent themes were grouped according to a broader framework that considered the (1) digital solution; (2) actors; (3) processes and (4) context.

RESULTS

The scale-up of digital solutions was facilitated by their perceived value, bounded adaptability, support from government champions, cultivation of networks, sustained leadership and formative research to support fit with the context and population. However, once scaled, embedding digital health solutions into the fabric of the health system was hampered by challenges related to transitioning management and ownership to government partners; overcoming government procurement hurdles; and establishing committed funding streams in government budgets. Strong data governance, continued engagement with FLHWs and building a robust evidence base, while identified in the literature as critical for sustainability, did not feature strongly among respondents. Sustainability may be less elusive once there is more consensus around the roles played between national and state government actors, implementing and technical partners and donors.

CONCLUSION

The use of digital tools by FLHWs offers much promise for improving service delivery and health outcomes in India. However, the pathway to sustainability is bespoke to each programme and should be planned from the outset by investing in people, relationships and service delivery adjustments to navigate the challenges involved given the dynamic nature of digital tools in complex health systems.