Accounting for complexity - Intervention design in the context of studying social accountability for reproductive health

The role of social accountability in changing service users' values, attitudes, and interactions with the health services: a pre-post study

This study evaluated the effects of community engagement through social accountability on service users' values, attitudes and interactions. We conducted a pre-post study of the community and provider driven social accountability intervention (CaPSAI) over a 12-month period among 1,500 service users in 8 health facilites in Ghana and in Tanzania (n = 3,000).In both countries, there were significant improvements in women's participation in household decision-making and in how service users' perceive their treatment by health workers. In both settings, however, there was a decline in women's knowledge of rights, perception of service quality, awareness of accountability mechanisms and collective efficacy in the community. Though CaPSAI intervention set out to change the values, attitudes, and interactions between community members and those providing contraceptive services, there were changes in different directions that require closer examination.

The impact of community and provider-driven social accountability interventions on contraceptive use: findings from a cohort study of new users in Ghana and Tanzania

BACKGROUND

Although contraceptive use has increased over 15 years, discontinuation rates remain high. Contraceptive use is becoming more important when addressing unmet need for family planning. Social accountability, defined here as collective processes for holding duty bearers to account for their actions, is a rights-based participatory process that supports service provision and person-centred care, as well as, informed decision-making among community members regarding their health. A study implemented in Ghana and Tanzania was designed to understand and evaluate how social accountability and participatory processes influences quality of care and client satisfaction and whether this results in increased contraceptive uptake and use. We report here on the relationship between social accountability and the use of modern contraceptives, i.e., contraceptive method discontinuation, contraceptive method switching, and contraceptive discontinuation.

METHODS

As part of Community and Provider driven Social Accountability Intervention (CaPSAI) Project, a cohort of women aged 15 to 49 years who were new users of contraception and accessing family planning and contraceptives services at the study facilities across both intervention and control groups were followed-up over a 12-month period to measure changes contraceptive use.

RESULTS

In this cohort study over a one-year duration, we did not find a statistically significant difference in Ghana and Tanzania in overall method discontinuation, switching, and contraceptive discontinuation after exposure to a social accountability intervention. In Ghana but not in Tanzania, when stratified by the type of facility (district level vs. health centre), there were significantly less method and contraceptive discontinuation in the district level facility and significantly more method and contraceptive discontinuation in the health centres in the intervention group. In Ghana, the most important reasons reported for stopping a method were fear of side-effects, health concerns and wanting to become pregnant in the control group and fear of side-effects wanting a more effective method and infrequent sex in the intervention group. In Tanzania, the most important reasons reported for stopping a method were fear of side-effects, wanting a more effective method, and method not available in the control group compared to wanting a more effective method, fear of side-effects and health concerns in the intervention group.

CONCLUSIONS

We did not demonstrate a statistically significant impact of a six-month CaPSAI intervention on contraceptives use among new users in Tanzania and Ghana. However, since social accountability have important impacts beyond contraceptive use it is important consider results of the intermediate outcomes, cases of change, and process evaluation to fully understand the impact of this intervention.

TRIAL REGISTRATION

The CaPSAI Project has been registered at Australian New Zealand Clinical Trials Registry (ACTRN12619000378123, 11/03/2019).

Research and implementation interactions in a social accountability study: utilizing guidance for conducting process evaluations of complex interventions

BACKGROUND

In recent years, researchers and evaluators have made efforts to identify and use appropriate and innovative research designs that account for the complexity in studying social accountability. The relationship between the researchers and those implementing the activities and how this impacts the study have received little attention. In this paper, we reflect on how we managed the relationship between researchers and implementers using the United Kingdom Medical Research Council (MRC) guidance on process evaluation of a complex intervention.

MAIN BODY

The MRC guidance focuses on three areas of interaction between researchers and stakeholders involved in developing and delivering the intervention: (i) working with program developers and implementers; (ii) communication of emerging findings between researchers/evaluators and implementers; and (iii) overlapping roles of the intervention and research/evaluation. We summarize how the recommendations for each of the three areas were operationalized in the Community and Provider driven Social Accountability Intervention (CaPSAI) Project and provide reflections based on experience. We co-developed various tools, including standard operating procedures, contact lists, and manuals. Activities such as training sessions, regular calls, and meetings were also conducted to enable a good working relationship between the different partners.

CONCLUSIONS

Studying social accountability requires the collaboration of multiple partners that need to be planned to ensure a good working relationship while safeguarding both the research and intervention implementation. The MRC guidance is a useful tool for making interaction issues explicit and establishing procedures. Planning procedures for dealing with research and implementers' interactions could be more comprehensive and better adapted to social accountability interventions if both researchers and implementers are involved. There is a need for social accountability research to include clear statements explaining the nature and types of relationships between researchers and implementers involved in the intervention.

Impact of community and provider-driven social accountability interventions on contraceptive uptake in Ghana and Tanzania

Background

Social accountability, which is defined as a collective process for holding duty bearers and service providers to account for their actions, has shown positive outcomes in addressing the interrelated barriers to quality sexual and reproductive health services. The Community and Provider driven Social Accountability Intervention (CaPSAI) Project contributes to the evidence on the effects of social accountability processes in the context of a family planning and contraceptive programme.

Methods

A quasi-experimental study utilizing an interrupted time series design with a control group (ITS-CG) was conducted to determine the actual number of new users of contraception amongst women 15–49 years old in eight intervention and eight control facilities per country in Ghana and Tanzania. A standardized facility audit questionnaire was used to collect facility data and completed every year in both intervention and control groups in each country from 2018–2020.

Results

In Ghana, the two-segmented Poisson Generalized Estimating Equation (GEE) model demonstrated no statistically significant difference at post-intervention, between the intervention and control facilities, in the level of uptake of contraceptives (excess level) (p-value = 0.07) or in the rate of change (excess rate) in uptake (p-value = 0.07) after adjusting for baseline differences. Similarly, in Tanzania, there was no statistical difference between intervention and control facilities, in the level of uptake of contraceptives (excess level) (p-value = 0.20), with the rate of change in uptake (p-value = 0.05) after adjusting for the baseline differences. There was no statistical difference in the level of or rate of change in uptake in the two groups in a sensitivity analysis excluding new users recruited in outreach activities in Tanzania.

Conclusions

The CAPSAI project intervention did not result in a statistically significant increase in uptake of contraceptives as measured by the number of or increase in new users. In evaluating the impact of the intervention on the intermediate outcomes such as self-efficacy among service users, trust and countervailing power among social groups/networks, and responsiveness of service providers, cases of change and process evaluation should be considered.

Trial registration

The CaPSAI Project has been registered at the Australian New Zealand Clinical Trials Registry (ACTRN12619000378123, 11/03/2019).