Incentivizing appropriate malaria case management in the private sector: a study protocol for two linked cluster randomized controlled trials to evaluate provider- and client-focused interventions in western Kenya and Lagos, Nigeria

The PICOTS-ComTeC Framework for Defining Digital Health Interventions: An ISPOR Special Interest Group Report

OBJECTIVES

Digital health definitions are abundant, but often lack clarity and precision. We aimed to develop a minimum information framework to define patient-facing digital health interventions (DHIs) for outcomes research.

METHODS

Definitions of digital-health-related terms (DHTs) were systematically reviewed, followed by a content analysis using frameworks, including PICOTS (population, intervention, comparator, outcome, timing, and setting), Shannon-Weaver Model of Communication, Agency for Healthcare Research and Quality Measures, and the World Health Organization's Classification of Digital Health Interventions. Subsequently, we conducted an online Delphi study to establish a minimum information framework, which was pilot tested by 5 experts using hypothetical examples.

RESULTS

After screening 2610 records and 545 full-text articles, we identified 101 unique definitions of 67 secondary DHTs in 76 articles, resulting in 95 different patterns of concepts among the definitions. World Health Organization system (84.5%), message (75.7%), intervention (58.3%), and technology (52.4%) were the most frequently covered concepts. For the Delphi survey, we invited 47 members of the ISPOR Digital Health Special Interest Group, 18 of whom became the Delphi panel. The first, second, and third survey rounds were completed by 18, 11, and 10 respondents, respectively. After consolidating results, the PICOTS-ComTeC acronym emerged, involving 9 domains (population, intervention, comparator, outcome, timing, setting, communication, technology, and context) and 32 optional subcategories.

CONCLUSIONS

Patient-facing DHIs can be specified using PICOTS-ComTeC that facilitates identification of appropriate interventions and comparators for a given decision. PICOTS-ComTeC is a flexible and versatile tool, intended to assist authors in designing and reporting primary studies and evidence syntheses, yielding actionable results for clinicians and other decision makers.

A cluster-randomized trial of client and provider-directed financial interventions to align incentives with appropriate case management in retail medicine outlets: Results of the TESTsmART Trial in western Kenya

ACTs are responsible for a substantial proportion of the global reduction in malaria mortality over the last ten years, made possible by publicly-funded subsidies making these drugs accessible and affordable in the private sector. However, inexpensive ACTs available in retail outlets have contributed substantially to overconsumption. We test an innovative, scalable strategy to target ACT-subsidies to clients with a confirmatory diagnosis. We supported malaria testing(mRDTs) in 39 medicine outlets in western Kenya, randomized to three study arms; control arm offering subsidized mRDT testing (0.4USD), client-directed intervention where all clients who received a positive RDT at the outlet were eligible for a free (fully-subsidized) ACT, and a combined client and provider directed intervention where clients with a positive RDT were eligible for free ACT and outlets received 0.1USD for every RDT performed. Our primary outcome was the proportion of ACT dispensed to individuals with a positive diagnostic test. Secondary outcomes included proportion of clients tested at the outlet and adherence to diagnostic test results. 43% of clients chose to test at the outlet. Test results informed treatment decisions, resulting in targeting of ACTs to confirmed malaria cases- 25.3% of test-negative clients purchased an ACT compared to 75% of untested clients. Client-directed and client+provider-directed interventions did not offer further improvements, compared to the control arm, in testing rates(RD = 0.09, 95%CI:-0.08,0.26) or dispensing of ACTs to test-positive clients(RD = 0.01,95% CI:-0.14, 0.16). Clients were often unaware of the price they paid for the ACT leading to uncertainty in whether the ACT subsidy was passed on to the client. This uncertainty undermines our ability to definitively conclude that client-directed subsidies are not effective for improving testing and appropriate treatment. We conclude that mRDTs could reduce ACT overconsumption in the private retail sector, but incentive structures are difficult to scale and their value to private providers is uncertain. Trial registration: ClinicalTrials.gov NCT04428307.

A cluster-randomized trial of client and provider directed financial interventions to align incentives with appropriate case management in private medicine retailers: results of the TESTsmART Trial in Lagos, Nigeria

Malaria remains a major health priority in Nigeria. Among children with fever who seek care, less than a quarter gets tested for malaria, leading to inappropriate use of the recommended treatment for malaria; Artemether Combination Therapies (ACT). Here we test an innovative strategy to target ACT subsidies to clients seeking care in Nigeria's private retail health sector who have a confirmed malaria diagnosis. We supported point-of-care malaria testing (mRDTs) in 48 Private Medicine Retailers (PMRs) in the city of Lagos, Nigeria and randomized them to two study arms; a control arm offering subsidized mRDT testing for USD $0.66, and an intervention arm where, in addition to access to subsidized testing as in the control arm, clients who received a positive mRDT at the PMR were eligible for a free (fully subsidized) first-line ACT and PMRs received USD $0.2 for every mRDT performed. Our primary outcome was the proportion of ACTs dispensed to individuals with a positive diagnostic test. Secondary outcomes included proportion of clients who were tested at the PMR and adherence to diagnostic test results. Overall, 23% of clients chose to test at the PMR. Test results seemed to inform treatment decisions and resulted in enhanced targeting of ACTs to confirmed malaria cases with only 26% of test-negative clients purchasing an ACT compared to 58% of untested clients. However, the intervention did not offer further improvements, compared to the control arm, in testing rates or dispensing of ACTs to test-positive clients. We found that ACT subsidies were not passed on to clients testing positive in the intervention arm. We conclude that RDTs could reduce ACT overconsumption in Nigeria's private retail health sector, but PMR-oriented incentive structures are difficult to implement and may need to be complemented with interventions targeting clients of PMRs to increase test uptake and adherence. Clinical Trials Registration Number: NCT04428307.

Adherence to national malaria treatment guidelines in private drug outlets: a cross-sectional survey in the malaria-endemic Kisumu County, Kenya

BACKGROUND

Malaria prevalence in Kenya is 6%, with a three-fold higher prevalence in western Kenya. Adherence to malaria treatment guidelines improves care for suspected malaria cases and can reduce unnecessary anti-malarial use. Data on adherence to guidelines in retail drug outlets (DOs) is limited, yet approximately 50% of people with fever access treatment first in these outlets. This study assessed adherence to the national malaria treatment guidelines among DOs in a high transmission area of Western Kenya.

METHODS

In a cross-sectional survey of DOs in Kisumu Central and Seme sub-counties in 2021, DO staff were interviewed using structured questionnaires to assess outlet characteristics (location, testing services), staff demographics (age, sex, training), and health system context (supervision, inspection). Mystery shoppers (research assistants disguised as clients) observed malaria management practices and recorded observations on a standardized tool. Adherence was defined as dispensing artemether-lumefantrine (AL) to patients with a confirmed positive test, accompanied by appropriate medication counseling. Logistic regression was used to test for association between adherence to guidelines and DO-related factors.

RESULTS

None of the 70 DOs assessed had a copy of the guidelines, and 60 (85.7%) were in an urban setting. Staff adhered to the guidelines in 14 (20%) outlets. The odds of adherence were higher among staff who had a bachelor's degree {odds ratio (OR) 6.0, 95% confidence interval (95% CI) 1.66-21.74}, those trained on malaria rapid diagnostic test (RDT) {OR 4.4, 95% CI 1.29-15.04}, and those who asked about patient's symptoms {OR 3.6, 95% CI 1.08-12.25}. DOs that had higher odds of adherence included those with functional thermometers {OR 5.3, 95% CI 1.46-19.14}, those recently inspected (within three months) by Pharmacy and Poisons Board (PPB) {OR 9.4, 95% CI 2.55-34.67}, and those with all basic infrastructure {OR 3.9, 95% CI 1.01-15.00}. On logistic regression analysis, recent PPB inspection {adjusted OR (AOR) 4.6, 95% CI 1.03-20.77} and malaria RDT-trained staff (aOR 4.5, 95% CI 1.02-19.84) were independently associated with adherence.

CONCLUSION

Most outlets didn't adhere to malaria guidelines. Regular interaction with regulatory bodies could improve adherence. Ministry of Health should enhance private sector engagement and train DOs on RDT use.

A cluster-randomized trial of client and provider-directed financial interventions to align incentives with appropriate case management in retail medicine outlets: results of the TESTsmART Trial in western Kenya

ACTs are responsible for a substantial proportion of the global reduction in malaria mortality over the last ten years. These reductions would not have been possible without publicly-funded subsidies making these drugs accessible and affordable in the private sector. However, inexpensive ACTs available in retail outlets have contributed substantially to their overconsumption. We test an innovative, scalable, and sustainable strategy to target ACT subsidies to clients with a confirmatory diagnosis. We supported point-of-care malaria testing (mRDTs) in 39 retail medicine outlets in western Kenya and randomized them to three study arms; control arm offering subsidized RDT testing for 0.4USD, client-directed intervention where all clients who received a positive RDT at the outlet were eligible for a free (fully subsidized) first-line ACT, and a combined client and provider directed intervention where clients with a positive RDT were eligible for free ACT and outlets received 0.1USD for every RDT performed. Our primary outcome was the proportion of ACT dispensed to individuals with a positive diagnostic test. Secondary outcomes included proportion of clients tested at the outlet and adherence to diagnostic test results. 43% of clients chose to test at the outlet. Test results informed treatment decisions and resulted in targeting of ACTs to confirmed malaria cases - 25.3% of test-negative clients purchased an ACT compared to 75% of untested clients. Client-directed and client+provider-directed interventions did not offer further improvements, compared to the control arm, in testing rates (RD=0.09, 95%CI:-0.08,0.26) or dispensing of ACTs to test-positive clients (RD=0.01,95% CI: -0.14, 0.16). Clients were often unaware of the price they paid for the ACT leading to uncertainty in whether the ACT subsidy was passed on to the client. We conclude that mRDTs could reduce ACT overconsumption in the private retail sector, but incentive structures are difficult to scale and their value to private providers is uncertain.

The fight against malaria: Diminishing gains and growing challenges

Since the year 2000, historic reductions in malaria incidence and mortality have been driven by the widespread distribution of bed nets, drugs, and insecticides for the prevention and treatment of malaria. Scale-up of these tools has been enabled by an increase in malaria financing compounded by price reductions, yet these trends are unlikely to continue at the same rate. Rapid population growth in high-endemic areas requires procurement of more of these tools just to maintain current coverage, even as prices are likely to increase as resistance to drugs and insecticides forces shifts to newer products. Further progress toward the long-term goal of malaria eradication requires a combination of greater funding, more cost-effective resource allocation, and fundamental changes to the global malaria control strategy.

Constrained randomization and statistical inference for multi‐arm parallel cluster randomized controlled trials

A practical limitation of cluster randomized controlled trials (cRCTs) is that the number of available clusters may be small, resulting in an increased risk of baseline imbalance under simple randomization. Constrained randomization overcomes this issue by restricting the allocation to a subset of randomization schemes where sufficient overall covariate balance across comparison arms is achieved. However, for multi-arm cRCTs, several design and analysis issues pertaining to constrained randomization have not been fully investigated. Motivated by an ongoing multi-arm cRCT, we elaborate the method of constrained randomization and provide a comprehensive evaluation of the statistical properties of model-based and randomization-based tests under both simple and constrained randomization designs in multi-arm cRCTs, with varying combinations of design and analysis-based covariate adjustment strategies. In particular, as randomization-based tests have not been extensively studied in multi-arm cRCTs, we additionally develop most-powerful randomization tests under the linear mixed model framework for our comparisons. Our results indicate that under constrained randomization, both model-based and randomization-based analyses could gain power while preserving nominal type I error rate, given proper analysis-based adjustment for the baseline covariates. Randomization-based analyses, however, are more robust against violations of distributional assumptions. The choice of balance metrics and candidate set sizes and their implications on the testing of the pairwise and global hypotheses are also discussed. Finally, we caution against the design and analysis of multi-arm cRCTs with an extremely small number of clusters, due to insufficient degrees of freedom and the tendency to obtain an overly restricted randomization space.

Correction to: Incentivizing appropriate malaria case management in the private sector: a study protocol for two linked cluster randomized controlled trials to evaluate provider- and client-focused interventions in western Kenya and Lagos, Nigeria

An amendment to this paper has been published and can be accessed via the original article.