Unravelling how and why the Antiretroviral Adherence Club Intervention works (or not) in a public health facility: A realist explanatory theory-building case study

Mental health policy implementation in low- and middle-income countries: a realist review protocol

INTRODUCTION

Formulating and implementing mental health policy is foundational to public mental health. The implementation of mental health policy varies in low- and middle-income countries (LMICs), with some countries having better implementation outcomes than others. Low implementation poses challenges relating to addressing the high burden and wide treatment gaps of mental health conditions. While different implementation strategies are applied to implement mental health policy in different contexts, there is little knowledge of what category of strategies are being used and how and why their implementation produces varied outcomes. To this end, we propose to conduct a realist synthesis to explain how, why, for whom, and under what health system conditions certain policy implementation strategies work or not in LMICs.

METHODS AND ANALYSIS

This paper will detail the protocol on conducting a realist review of the literature on mental health policy implementation in LMICs. Realist reviews/syntheses are theory-driven reviews designed to formulate and test (confirm, refute, or refine) initial programme theories to explain how, why, for whom and under what contexts a programme, intervention or policy works as intended or not. Theory is built by exploring and abstracting context-mechanism-outcome (CMO) configurations in the data. These CMO configurations are identified through retroductive theorizing, a mechanism-centred approach to theory development. We will adopt these steps to guide the process of realist synthesis: i) identify the research question, clarifying the scope of the review and formulating the initial programme theory (ii) conducting background searches in PubMed, PsycINFO, Africa-Wide Information, African. Index Medicus (AIM), CINAHL and Scopus databases, and grey literature (iii) appraising the quality of studies and data extraction and (iv) synthesising data.

REGISTRATION

The review is part of a realist evaluation exploring mental health policy implementation in LMICs and is registered under PROSPERO (registration number: CRD42024580312). Findings will inform the development of initial mental health policy implementation programme theories explaining why and how mental health policy implementation in LMICs works.

A realist evaluation of a multi-component program with disengaged students

Periods spent in the absence of education, employment, or training (NEET) are associated with adverse psychological wellbeing, social marginalisation, and premature mortality. Implementing effective programs to re-engage young people who are classified, or are at risk of becoming NEET, is of importance to these individuals, family, and society. We conducted a realist evaluation to understand how, and under which circumstances a multi-component program may impact the engagement, behavioural, and psychosocial outcomes of disengaged students at risk of becoming NEET. During the early project phase, a narrative review of the literature and key stakeholder discussions were conducted to develop our initial program theories regarding how the program was expected to achieve its outcomes. Participant observations, video footage, and forty-two interviews were then conducted with teachers and students to form context-mechanism-outcome configurations and to refine these theories. Overall, refined program theories relating to positions of authority, the power of collective experience, exploration of possible life directions, constructivist pedagogies and active learning, and the endorsement of an ethic of caring and strengths-based orientation were developed. Collectively, our findings provide a detailed understanding of the architecture of programs that may benefit disengaged students and help inform the design of future programs aimed at reducing disaffection.

TRIPLE C reporting principles for case study evaluations of the role of context in complex interventions

BACKGROUND

Guidance and reporting principles such as CONSORT (for randomised trials) and PRISMA (for systematic reviews) have greatly improved the reporting, discoverability, transparency and consistency of published research. We sought to develop similar guidance for case study evaluations undertaken to explore the influence of context on the processes and outcomes of complex interventions.

METHODS

A range of experts were recruited to an online Delphi panel, sampling for maximum diversity in disciplines (e.g. public health, health services research, organisational studies), settings (e.g. country), and sectors (e.g. academic, policy, third sector). To inform panel deliberations, we prepared background materials based on: [a] a systematic meta-narrative review of empirical and methodological literatures on case study, context and complex interventions; [b] the collective experience of a network of health systems and public health researchers; and [c] the established RAMESES II standards (which cover one kind of case study). We developed a list of topics and issues based on these sources and encouraged panel members to provide free text comments. Their feedback informed development of a set of items in the form of questions for potential inclusion in the reporting principles. We circulated these by email, asking panel members to rank each potential item twice (for relevance and validity) on a 7-point Likert scale. This sequence was repeated twice.

RESULTS

We recruited 51 panel members from 50 organisations across 12 countries, who brought experience of a range of case study research methods and applications. 26 completed all three Delphi rounds, reaching over 80% consensus on 16 items covering title, abstract, definitions of terms, philosophical assumptions, research question(s), rationale, how context and complexity relates to the intervention, ethical approval, empirical methods, findings, use of theory, generalisability and transferability, researcher perspective and influence, conclusions and recommendations, and funding and conflicts of interest.

CONCLUSION

The 'Triple C' (Case study, Context, Complex interventions) reporting principles recognise that case studies are undertaken in different ways for different purposes and based on different philosophical assumptions. They are designed to be enabling rather than prescriptive, and to make case study evaluation reporting on context and complex health interventions more comprehensive, accessible and useable.

Strengthening capacity in hospitals to reduce perinatal morbidity and mortality through a codesigned intervention package: protocol for a realist evaluation as part of a stepped-wedge trial of the Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) in sub-Saharan Africa project

INTRODUCTION

Despite a strong evidence base for developing interventions to reduce child mortality and morbidity related to pregnancy and delivery, major knowledge-implementation gaps remain. The Action Leveraging Evidence to Reduce perinatal morTality and morbidity (ALERT) in sub-Saharan Africa project aims to overcome these gaps through strengthening the capacity of multidisciplinary teams that provide maternity care. The intervention includes competency-based midwife training, community engagement for study design, mentoring and quality improvement cycles. The realist process evaluation of ALERT aims at identifying and testing the causal pathway through which the intervention achieves its impact.

METHODS AND ANALYSIS

This realist process evaluation complements the effectiveness evaluation and the economic evaluation of the ALERT intervention. Following the realist evaluation cycle, we will first elicit the initial programme theory on the basis of the ALERT theory of change, a review of the evidence on adoption and diffusion of innovations and the perspectives of the stakeholders. Second, we will use a multiple embedded case study design to empirically test the initial programme theory in two hospitals in each of the four intervention countries. Qualitative and quantitative data will be collected, using in-depth interviews with hospital staff and mothers, observations, patient exit interviews and (hospital) document reviews. Analysis will be guided by the Intervention-Actors-Context-Mechanism-Outcome configuration heuristic. We will use thematic coding to analyse the qualitative data. The quantitative data will be analysed descriptively and integrated in the analysis using a retroductive approach. Each case study will end with a refined programme theory (in-case analysis). Third, we will carry out a cross-case comparison within and between the four countries. Comparison between study countries should enable identifying relevant context factors that influence effectiveness and implementation, leading to a mid-range theory that may inform the scaling up the intervention.

ETHICS AND DISSEMINATION

In developing this protocol, we paid specific attention to cultural sensitivity, the do no harm principle, confidentiality and non-attribution. We received ethical approval from the local and national institutional review boards in Tanzania, Uganda, Malawi, Benin, Sweden and Belgium. Written or verbal consent of respondents will be secured after explaining the purpose, potential benefits and potential harms of the study using an information sheet. The results will be disseminated through workshops with the hospital staff and national policymakers, and scientific publications and conferences.

TRIAL REGISTRATION NUMBER

PACTR202006793783148.

Comparing Patients' Experiences in Three Differentiated Service Delivery Models for HIV Treatment in South Africa

Differentiated service delivery for HIV treatment seeks to enhance medication adherence while respecting the preferences of people living with HIV. Nevertheless, patients' experiences of using these differentiated service delivery models or approaches have not been qualitatively compared. Underpinned by the tenets of descriptive phenomenology, we explored and compared the experiences of patients in three differentiated service delivery models using the National Health Services' Patient Experience Framework. Data were collected from 68 purposively selected people living with HIV receiving care in facility adherence clubs, community adherence clubs, and quick pharmacy pick-up. Using the constant comparative thematic analysis approach, we compared themes identified across the different participant groups. Compared to facility adherence clubs and community adherence clubs, patients in the quick pharmacy pick-up model experienced less information sharing; communication and education; and emotional/psychological support. Patients' positive experience with a differentiated service delivery model is based on how well the model fits into their HIV disease self-management goals.

What key conditions and mechanisms generate health inequalities research in different contexts? Study protocol for two realist explanatory case studies

Evidence on health inequalities has grown in recent decades, however, the capacity to generate health inequalities research is uneven, worldwide. A recent bibliometric analysis found notable inequalities of the global production of health inequalities scientific research across countries. What determines the capacity to produce high volumes of health inequalities scientific research, in different settings? What mechanisms are involved? To answer these questions requires in-depth knowledge on the health inequalities research production process, in different settings. We plan to conduct two realist explanatory case studies, to understand why and how particular settings (e.g. the United Kingdom and the city of Barcelona) have generated high volumes of health inequalities research over past decades, and identify the potential key contextual conditions and causal mechanisms involved. This study protocol outlines the rationale and methodology involved, highlights the strengths and limitations of the approach, and provides guidance on how to overcome certain operational challenges and ensure validity of research findings. Valuable learning may be derived from these case experiences, with implications for research, policy and practice. This work can serve as a tool for researcher and planners to guide the development of further case studies to evaluate health inequalities research capacities in other settings.

A guide to systems-level, participatory, theory-informed implementation research in global health

Implementation research is a multidisciplinary field that addresses the complex phenomenon of how context influences our ability to deliver evidence-informed healthcare. There is increasing realisation of the importance of applying robust implementation research to scale-up life-saving interventions that meet health-related sustainable development goals. However, the lack of high-quality implementation research is impeding our ability to meet these targets, globally. Within implementation research, theory refers to the proposed hypothesis and/or explanation of how an intervention is expected to interact with the local context and actors to bring about change. Although there is increasing interest in applying theory to understand how and why implementation programmes work in real-world settings, global health actors still tend to favour impact evaluations conducted in controlled environments. This may, in part, be due to the relative novelty as well as methodological complexity of implementation research and the need to draw on divergent disciplines, including epidemiology, implementation science and social sciences. Because of this, implementation research is faced with a particular set of challenges about how to reconcile different ways of thinking and constructing knowledge about healthcare interventions. To help translate some of the ambiguity surrounding how divergent theoretical approaches and methods contribute to implementation research, we draw on our multidisciplinary expertise in the field, particularly in global health. We offer an overview of the different theoretical approaches and describe how they are applied to continuously select, monitor and evaluate implementation strategies throughout the different phases of implementation research. In doing so, we offer a relatively brief, user-focused guide to help global health actors implement and report on evaluation of evidence-based and scalable interventions, programmes and practices.

Evaluating complex interventions in context: systematic, meta-narrative review of case study approaches

BACKGROUND

There is a growing need for methods that acknowledge and successfully capture the dynamic interaction between context and implementation of complex interventions. Case study research has the potential to provide such understanding, enabling in-depth investigation of the particularities of phenomena. However, there is limited guidance on how and when to best use different case study research approaches when evaluating complex interventions. This study aimed to review and synthesise the literature on case study research across relevant disciplines, and determine relevance to the study of contextual influences on complex interventions in health systems and public health research.

METHODS

Systematic meta-narrative review of the literature comprising (i) a scoping review of seminal texts (n = 60) on case study methodology and on context, complexity and interventions, (ii) detailed review of empirical literature on case study, context and complex interventions (n = 71), and (iii) identifying and reviewing 'hybrid papers' (n = 8) focused on the merits and challenges of case study in the evaluation of complex interventions.

RESULTS

We identified four broad (and to some extent overlapping) research traditions, all using case study in a slightly different way and with different goals: 1) developing and testing complex interventions in healthcare; 2) analysing change in organisations; 3) undertaking realist evaluations; 4) studying complex change naturalistically. Each tradition conceptualised context differently-respectively as the backdrop to, or factors impacting on, the intervention; sets of interacting conditions and relationships; circumstances triggering intervention mechanisms; and socially structured practices. Overall, these traditions drew on a small number of case study methodologists and disciplines. Few studies problematised the nature and boundaries of 'the case' and 'context' or considered the implications of such conceptualisations for methods and knowledge production.

CONCLUSIONS

Case study research on complex interventions in healthcare draws on a number of different research traditions, each with different epistemological and methodological preferences. The approach used and consequences for knowledge produced often remains implicit. This has implications for how researchers, practitioners and decision makers understand, implement and evaluate complex interventions in different settings. Deeper engagement with case study research as a methodology is strongly recommended.

Exploring Sustainability in the Era of Differentiated HIV Service Delivery in Sub-Saharan Africa: A Systematic Review

INTRODUCTION

The World Health Organization recommends differentiated service delivery (DSD) to support resource-limited health systems in providing patient-centered HIV care. DSD offers alternative care models to clinic-based care for people living with HIV who are stable on antiretroviral therapy (ART). Despite good patient-related outcomes, there is limited evidence of their sustainability. Our review evaluated the reporting of sustainability indicators of DSD interventions conducted in sub-Saharan Africa (SSA).

METHODS

We searched PubMed and EMBASE for studies conducted between 2000 and 2019 assessing DSD interventions targeting HIV-positive individuals who are established in ART in sub-Saharan Africa. We evaluated them through a comprehensive sustainability framework of constructs categorized into 6 domains (intervention design, process, external environment, resources, organizational setting, and people involvement). We scored each construct 1, 2, or 3 for no, partial, or sufficient level of evidence, respectively. Interventions with a calculated sustainability score (overall and domain-specific) of >90% or domain-specific median score >2.7 were considered likely to be sustainable.

RESULTS

Overall scores ranged from 69% to 98%. Top scoring intervention types included adherence clubs (98%) and community ART groups (95%) which comprised more than half of interventions. The highest scoring domains were design (2.9) and organizational setting (2.8). The domains of resources (2.4) and people involvement (2.3) scored lowest revealing potential areas for improvement to support DSD sustainability.

CONCLUSIONS

With the right investment in stakeholder involvement and domestic funding, DSD models generally show potential for sustainability. Our results could guide informed decisions on which DSD intervention is likely to be sustainable per setting and highlight areas that could motivate further research.

Implementing 'universal' access to antiretroviral treatment in South Africa: a scoping review on research priorities

'Universal' access to antiretroviral treatment (ART) has become the global standard for treating people living with HIV and achieving epidemic control; yet, findings from numerous 'test and treat' trials and implementation studies in sub-Saharan Africa suggest that bringing 'universal' access to ART to scale is more complex than anticipated. Using South Africa as a case example, we describe the research priorities and foci in the literature on expanded ART access. To do so, we adapted Arksey and O'Malley's six-stage scoping review framework to describe the peer-reviewed literature and opinion pieces on expanding access to ART in South Africa between 2000 and 2017. Data collection included systematic searches of two databases and hand-searching of a sub-sample of reference lists. We used an adapted socio-ecological thematic framework to categorize data according to where it located the challenges and opportunities of expanded ART eligibility: individual/client, health worker-client relationship, clinic/community context, health systems infrastructure and/or policy context. We included 194 research articles and 23 opinion pieces, of 1512 identified, addressing expanded ART access in South Africa. The peer-reviewed literature focused on the individual and health systems infrastructure; opinion pieces focused on changing roles of individuals, communities and health services implementers. We contextualized our findings through a consultative process with a group of researchers, HIV clinicians and programme managers to consider critical knowledge gaps. Unlike the published literature, the consultative process offered particular insights into the importance of researching and intervening in the relational aspects of HIV service delivery as South Africa's HIV programme expands. An overwhelming focus on individual and health systems infrastructure factors in the published literature on expanded ART access in South Africa may skew understanding of HIV programme shortfalls away from the relational aspects of HIV services delivery and delay progress with finding ways to leverage non-medical modalities for achieving HIV epidemic control.

Community Group-Based Models of Medication Delivery: Applicability to Cardiovascular Diseases

The rising global burden of chronic non-communicable diseases (NCDs) has put a strain on healthcare systems globally, especially in low- and middle-income countries, which have seen disproportionate mortality rates due to non-communicable diseases. These deaths are in part due to challenges with medication adherence, which are compounded by lack of access to medication and weak community support systems. This paper aims to propose a potential solution using models of service delivery in HIV/AIDS, given the many similarities between NCD and HIV/AIDS. Models that have been particularly effective in HIV/AIDS are the community-based peer-support medication delivery groups: medication adherence clubs and community antiretroviral therapy (ART) groups. The positive outcomes from these models, including improved medication adherence and patient satisfaction, provide evidence for their potential success when applied to non-communicable diseases, particularly hypertension and cardiovascular disease.

Explaining the impact of mHealth on maternal and child health care in low- and middle-income countries: a realist synthesis

Background

Despite the growing global application of mobile health (mHealth) technology in maternal and child health, contextual factors, and mechanisms by which interventional outcomes are generated, have not been subjected to a systematic examination. In this study, we sought to uncover context, mechanisms, and outcome elements of various mHealth interventions based on implementation and evaluation studies to formulate theories or models explicating how mHealth interventions work (or not) both for health care providers and for pregnant women and mothers.

Method

We undertook a realist synthesis. An electronic search of five online databases (PubMed/Medline, Google Scholar, Scopus, Academic Search Premier and Health Systems Evidence) was performed. Using appropriate Boolean phrases terms and selection procedures, 32 articles were identified. A theory-driven approach, narrative synthesis, was applied to synthesize the data. Thematic content analysis was used to delineate elements of the intervention, including its context, actors, mechanisms, and outcomes. Abduction and retroduction were applied using a realist evaluation heuristic tool to formulate generative theories.

Results

We formulated two configurational models illustrating how and why mHealth impacts implementation and uptake of maternal and child health care. Implementation-related mechanisms include buy-in from health care providers, perceived support of health care providers’ motivation and perceived ease of use and usefulness. These mechanisms are influenced by adaptive health system conditions including organization, resource availability, policy implementation dynamics, experience with technology, network infrastructure and connectivity. For pregnant women and mothers, mechanisms that trigger mHealth use and consequently uptake of maternal and child health care include perceived satisfaction, motivation and positive psychological support. Information overload was identified as a potential negative mechanism impacting the uptake of maternal and child health care. These mechanisms are influenced by health system conditions, socio-cultural characteristics, socio-economic and demographics characteristics, network infrastructure and connectivity and awareness.

Conclusion

Models developed in this study provide a detailed understanding of implementation and uptake of mHealth interventions and how and why they impact maternal and child health care in low- and middle-income countries. These models provide a foundation for the ‘white box’ of theory-driven evaluation of mHealth interventions and can improve rollout and implementation where required.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12884-021-03684-x.

Using implementation science theories and frameworks in global health

In global health, researchers and decision makers, many of whom have medical, epidemiology or biostatistics background, are increasingly interested in evaluating the implementation of health interventions. Implementation science, particularly for the study of public policies, has existed since at least the 1930s. This science makes compelling use of explicit theories and analytic frameworks that ensure research quality and rigour. Our objective is to inform researchers and decision makers who are not familiar with this research branch about these theories and analytic frameworks. We define four models of causation used in implementation science: intervention theory, frameworks, middle-range theory and grand theory. We then explain how scientists apply these models for three main implementation studies: fidelity assessment, process evaluation and complex evaluation. For each study, we provide concrete examples from research in Cuba and Africa to better understand the implementation of health interventions in global health context. Global health researchers and decision makers with a quantitative background will not become implementation scientists after reading this article. However, we believe they will be more aware of the need for rigorous implementation evaluations of global health interventions, alongside impact evaluations, and in collaboration with social scientists.

'At this [adherence] club, we are a family now': A realist theory-testing case study of the antiretroviral treatment adherence club, South Africa

Background

An estimated 7.9 million people were living with HIV in South Africa in 2017, with 63.3% of them remaining in antiretroviral therapy (ART) care and 62.9% accessing ART. Poor retention in care and suboptimal adherence to ART undermine the successful efforts of initiating people living with HIV on ART. To address these challenges, the antiretroviral adherence club intervention was designed to streamline ART services to 'stable' patients. Nevertheless, it is poorly understood exactly how and why and under what health system conditions the adherence club intervention works.

Objectives

The aim of this study was to test a theory on how and why the adherence club intervention works and in what health system context(s) in a primary healthcare facility in the Western Cape Province.

Method

Within the realist evaluation framework, we applied a confirmatory theory-testing case study approach. Kaplan-Meier descriptions were used to estimate the rates of dropout from the adherence club intervention and virological failure as the principal outcomes of the adherence club intervention. Qualitative interviews and non-participant observations were used to explore the context and identify the mechanisms that perpetuate the observed outcomes or behaviours of the actors. Following the retroduction logic of making inferences, we configured information obtained from quantitative and qualitative approaches using the intervention-context-actor-mechanism-outcome heuristic tool to formulate generative theories.

Results

We confirmed that patients on ART in adherence clubs will continue to adhere to their medication and remain in care because their self-efficacy is improved; they are motivated or are being nudged.

Conclusion

A theory-based understanding provides valuable lessons towards the adaptive implementation of the adherence club intervention.

What do the implementation outcome variables tell us about the scaling-up of the antiretroviral treatment adherence clubs in South Africa? A document review

Background

The successful initiation of people living with HIV on antiretroviral treatment (ART) in South Africa fomented challenges of poor retention in care and suboptimal adherence to medication. Following evidence of the potential of adherence clubs (ACs) to improve patient retention in ART and adherence to medication, the South African National Department of Health drafted a policy in 2016 encouraging the rollout of ACs nationwide. However, little guidance on the rollout strategy has been provided to date, and the national adoption status of the AC programme is unclear. To this end, we aimed to review the effectiveness of the rollout of the antiretroviral AC intervention in South Africa to date through an implementation research framework.

Methods

We utilised a deductive thematic analysis of documents of the AC programme in South Africa obtained from searching various databases from December 2017 to July 2018. The implementation outcome variables (acceptability, appropriateness, adoption, feasibility, fidelity, implementation cost, coverage and sustainability) were applied to frame and describe the effectiveness of the national rollout of the AC programme in South Africa.

Results

We identified 32 eligible documents that were included for analysis. Our analysis showed that ACs were highly acceptable by patients and health stakeholders given the observed benefits, including decongestion of clinics, increased social support for patients and the low cost of implementation. Evidence suggests that the AC model proved to be effective in improving adherence to ART and retention in care. Based on the success of ACs in the Western Cape, ACs are currently being implemented in all of the other South African provinces.

Conclusion

The inherent adaptability of the AC model should allow innovative strategies to maximise the use of existing resources. Therefore, the challenge is not limited to acquiring additional resources and support, but also includes the efficient use of available resources. Emerging challenges with AC programmes need to be addressed by increasing communication between stakeholders and fostering a culture of learning between facilities. As the AC programme expands and adapts to accommodate more people living with HIV and different population groups, policies should be designed to overcome present and anticipated challenges to enable its success.