Strengthening Community Roots: Anchoring Newcomers in Wellness and Sustainability (SCORE!): A protocol for the co-design and evaluation of a healthy active living program among a newcomer community in Canada

BACKGROUND

The burden of childhood obesity and cardiometabolic risk factors affecting newcomer Canadians living in lower socioeconomic circumstances is a concerning public health issue. This paper describes Strengthening Community Roots: Anchoring Newcomers in Wellness and Sustainability (SCORE!), an academic-community research partnership to co-design interventions that nurture and optimize healthy activity living (HAL) among a community of children and families new to Canada in Hamilton, Ontario, Canada.

METHODS/DESIGN

Our overarching program is informed by a socio-ecological model, and will co-create HAL interventions for children and families new to Canada rooted in outdoor, nature-based physical activity. We will proceed in three phases: Phase 1) synthesis of existing evidence regarding nature based HAL interventions among children and families; Phase 2) program development through four data collection activities including: i) community engagement activities to build trustful relationships and understand barriers and facilitators, including establishing a community advisory and action board, qualitative studies including a photovoice study, and co-design workshops to develop programs; ii) characterizing the demographics of the community through a household survey; iii) characterizing the built environment and HAL programs/services available in the community by developing an accessible real-time systems map; and iv) reviewing municipal policies relevant to HAL and sustainability; leading to Phase 3) implementation and evaluation of the feasibility of co-designed HAL programs.

CONCLUSION

The etiology of childhood obesity and related chronic diseases is complex and multifactorial, as are intervention strategies. The SCORE! program of research brings together partners including community members, service providers, academic researchers, and organizational leaders to build a multi-component intervention that promotes the health and wellness of newcomer children and families.

eHealth Implementation Issues in Low-Resource Countries: Model, Survey, and Analysis of User Experience

BACKGROUND

The implementation of eHealth in low-resource countries (LRCs) is challenged by limited resources and infrastructure, lack of focus on eHealth agendas, ethical and legal considerations, lack of common system interoperability standards, unreliable power, and shortage of trained workers.

OBJECTIVE

The aim of this study is to describe and study the current situation of eHealth implementation in a small number of LRCs from the perspectives of their professional eHealth users.

METHODS

We developed a structural equation model that reflects the opinions of professional eHealth users who work on LRC health care front lines. We recruited country coordinators from 4 LRCs to help recruit survey participants: India, Egypt, Nigeria, and Kenya. Through a web-based survey that focused on barriers to eHealth implementation, we surveyed 114 participants. We analyzed the information using a structural equation model to determine the relationships among the constructs in the model, including the dependent variable, eHealth utilization.

RESULTS

Although all the model constructs were important to participants, some constructs, such as user characteristics, perceived privacy, and perceived security, did not play a significant role in eHealth utilization. However, the constructs related to technology infrastructure tended to reduce the impact of concerns and uncertainties (path coefficient=-0.32; P=.001), which had a negative impact on eHealth utilization (path coefficient=-0.24; P=.01). Constructs that were positively related to eHealth utilization were implementation effectiveness (path coefficient=0.45; P<.001), the countries where participants worked (path coefficient=0.29; P=.004), and whether they worked for privately or publicly funded institutions (path coefficient=0.18; P<.001). As exploratory research, the model had a moderately good fit for eHealth utilization (adjusted R2=0.42).

CONCLUSIONS

eHealth success factors can be categorized into 5 groups; our study focused on frontline eHealth workers' opinions concerning 2 of these groups: technology and its support infrastructure and user acceptance. We found significant disparities among the responses from different participant groups. Privately funded organizations tended to be further ahead with eHealth utilization than those that were publicly funded. Moreover, participant comments identified the need for more use of telemedicine in remote and rural regions in these countries. An understanding of these differences can help regions or countries that are lagging in the implementation and use of eHealth technologies. Our approach could also be applied to detailed studies of the other 3 categories of success factors: short- and long-term funding, organizational factors, and political or legislative aspects.

Improving prescribing practices with rapid diagnostic tests (RDTs): synthesis of 10 studies to explore reasons for variation in malaria RDT uptake and adherence

OBJECTIVES

The overuse of antimalarial drugs is widespread. Effective methods to improve prescribing practice remain unclear. We evaluated the impact of 10 interventions that introduced rapid diagnostic tests for malaria (mRDTs) on the use of tests and adherence to results in different contexts.

DESIGN

A comparative case study approach, analysing variation in outcomes across different settings.

SETTING

Studies from the ACT Consortium evaluating mRDTs with a range of supporting interventions in 6 malaria endemic countries. Providers were governmental or non-governmental healthcare workers, private retail sector workers or community volunteers. Each study arm in a distinct setting was considered a case.

PARTICIPANTS

28 cases from 10 studies were included, representing 148 461 patients seeking care for suspected malaria.

INTERVENTIONS

The interventions included different mRDT training packages, supervision, supplies and community sensitisation.

OUTCOME MEASURES

Analysis explored variation in: (1) uptake of mRDTs (% febrile patients tested); (2) provider adherence to positive mRDTs (% Plasmodium falciparum positive prescribed/given Artemisinin Combination Treatment); (3) provider adherence to negative mRDTs (% P. falciparum negative not prescribed/given antimalarial).

RESULTS

Outcomes varied widely across cases: 12-100% mRDT uptake; 44-98% adherence to positive mRDTs; 27-100% adherence to negative mRDTs. Providers appeared more motivated to perform well when mRDTs and intervention characteristics fitted with their own priorities. Goodness of fit of mRDTs with existing consultation and diagnostic practices appeared crucial to maximising the impact of mRDTs on care, as did prior familiarity with malaria testing; adequate human resources and supplies; possible alternative treatments for mRDT-negative patients; a more directive intervention approach and local preferences for ACTs.

CONCLUSIONS

Basic training and resources are essential but insufficient to maximise the potential of mRDTs in many contexts. Programme design should respond to assessments of provider priorities, expectations and capacities. As mRDTs become established, the intensity of supporting interventions required seems likely to reduce.

Examining Intervention Design: Lessons from the Development of Eight Related Malaria Health Care Intervention Studies

Abstract—Rigorous evidence of “what works” to improve health care is in demand, but methods for the development of interventions have not been scrutinized in the same ways as methods for evaluation. This article presents and examines intervention development processes of eight malaria health care interventions in East and West Africa. A case study approach was used to draw out experiences and insights from multidisciplinary teams who undertook to design and evaluate these studies. Four steps appeared necessary for intervention design: (1) definition of scope, with reference to evaluation possibilities; (2) research to inform design, including evidence and theory reviews and empirical formative research; (3) intervention design, including consideration and selection of approaches and development of activities and materials; and (4) refining and finalizing the intervention, incorporating piloting and pretesting. Alongside these steps, projects produced theories, explicitly or implicitly, about (1) intended pathways of change and (2) how their intervention would be implemented.The work required to design interventions that meet and contribute to current standards of evidence should not be underestimated. Furthermore, the process should be recognized not only as technical but as the result of micro and macro social, political, and economic contexts, which should be acknowledged and documented in order to infer generalizability. Reporting of interventions should go beyond descriptions of final intervention components or techniques to encompass the development process. The role that evaluation possibilities play in intervention design should be brought to the fore in debates over health care improvement.

Strengthening patient-centred communication in rural Ugandan health centres: A theory-driven evaluation within a cluster randomized trial

This article describes a theory-driven evaluation of one component of an intervention to improve the quality of health care at Ugandan public health centres. Patient-centred services have been advocated widely, but such approaches have received little attention in Africa. A cluster randomized trial is evaluating population-level outcomes of an intervention with multiple components, including 'patient-centred services.' A process evaluation was designed within this trial to articulate and evaluate the implementation and programme theories of the intervention. This article evaluates one hypothesized mechanism of change within the programme theory: the impact of the Patient Centred Services component on health-worker communication. The theory-driven approach extended to evaluation of the outcome measures. The study found that the proximal outcome of patient-centred communication was rated 10 percent higher (p < 0.008) by care seekers consulting with the health workers who were at the intervention health centres compared with those at control health centres. This finding will strengthen interpretation of more distal trial outcomes.

The practice of 'doing' evaluation: lessons learned from nine complex intervention trials in action

Background

There is increasing recognition among trialists of the challenges in understanding how particular ‘real-life’ contexts influence the delivery and receipt of complex health interventions. Evaluations of interventions to change health worker and/or patient behaviours in health service settings exemplify these challenges. When interpreting evaluation data, deviation from intended intervention implementation is accounted for through process evaluations of fidelity, reach, and intensity. However, no such systematic approach has been proposed to account for the way evaluation activities may deviate in practice from assumptions made when data are interpreted.

Methods

A collective case study was conducted to explore experiences of undertaking evaluation activities in the real-life contexts of nine complex intervention trials seeking to improve appropriate diagnosis and treatment of malaria in varied health service settings. Multiple sources of data were used, including in-depth interviews with investigators, participant-observation of studies, and rounds of discussion and reflection.

Results and discussion

From our experiences of the realities of conducting these evaluations, we identified six key ‘lessons learned’ about ways to become aware of and manage aspects of the fabric of trials involving the interface of researchers, fieldworkers, participants and data collection tools that may affect the intended production of data and interpretation of findings. These lessons included: foster a shared understanding across the study team of how individual practices contribute to the study goals; promote and facilitate within-team communications for ongoing reflection on the progress of the evaluation; establish processes for ongoing collaboration and dialogue between sub-study teams; the importance of a field research coordinator bridging everyday project management with scientific oversight; collect and review reflective field notes on the progress of the evaluation to aid interpretation of outcomes; and these approaches should help the identification of and reflection on possible overlaps between the evaluation and intervention.

Conclusion

The lessons we have drawn point to the principle of reflexivity that, we argue, needs to become part of standard practice in the conduct of evaluations of complex interventions to promote more meaningful interpretations of the effects of an intervention and to better inform future implementation and decision-making.

Community case management of malaria: exploring support, capacity and motivation of community medicine distributors in Uganda

BACKGROUND

In Uganda, community services for febrile children are expanding from presumptive treatment of fever with anti-malarials through the home-based management of fever (HBMF) programme, to include treatment for malaria, diarrhoea and pneumonia through Integrated Community Case Management (ICCM). To understand the level of support available, and the capacity and motivation of community health workers to deliver these expanded services, we interviewed community medicine distributors (CMDs), who had been involved in the HBMF programme in Tororo district, shortly before ICCM was adopted.

METHODS

Between October 2009 and April 2010, 100 CMDs were recruited to participate by convenience sampling. The survey included questionnaires to gather information about the CMDs' work experience and to assess knowledge of fever case management, and in-depth interviews to discuss experiences as CMDs including motivation, supervision and relationships with the community. All questionnaires and knowledge assessments were analysed. Summary contact sheets were made for each of the 100 interviews and 35 were chosen for full transcription and analysis.

RESULTS

CMDs faced multiple challenges including high patient load, limited knowledge and supervision, lack of compensation, limited drugs and supplies, and unrealistic expectations of community members. CMDs described being motivated to volunteer for altruistic reasons; however, the main benefits of their work appeared related to 'becoming someone important', with the potential for social mobility for self and family, including building relationships with health workers. At the time of the survey, over half of CMDs felt demotivated due to limited support from communities and the health system.

CONCLUSIONS

Community health worker programmes rely on the support of communities and health systems to operate sustainably. When this support falls short, motivation of volunteers can wane. If community interventions, in increasingly complex forms, are to become the solution to improving access to primary health care, greater attention to what motivates individuals, and ways to strengthen health system support are required.

The PROCESS study: a protocol to evaluate the implementation, mechanisms of effect and context of an intervention to enhance public health centres in Tororo, Uganda

BACKGROUND

Despite significant investments into health improvement programmes in Uganda, health indicators and access to healthcare remain poor across the country. The PRIME trial aims to evaluate the impact of a complex intervention delivered in public health centres on health outcomes of children and management of malaria in rural Uganda. The intervention consists of four components: Health Centre Management; Fever Case Management; Patient- Centered Services; and support for supplies of malaria diagnostics and antimalarial drugs.

METHODS

The PROCESS study will use mixed methods to evaluate the processes, mechanisms of change, and context of the PRIME intervention by addressing five objectives. First, to develop a comprehensive logic model of the intervention, articulating the project's hypothesised pathways to trial outcomes. Second, to evaluate the implementation of the intervention, including health worker training, health centre management tools, and the supply of artemether-lumefantrine (AL) and rapid diagnostic tests (RDTs) for malaria. Third, to understand mechanisms of change of the intervention components, including testing hypotheses and interpreting realities of the intervention, including resistance, in context. Fourth, to develop a contextual record over time of factors that may have affected implementation of the intervention, mechanisms of change, and trial outcomes, including factors at population, health centre and district levels. Fifth, to capture broader expected and unexpected impacts of the intervention and trial activities among community members, health centre workers, and private providers. Methods will include intervention logic mapping, questionnaires, recorded consultations, in-depth interviews, focus group discussions, and contextual data documentation.

DISCUSSION

The findings of this PROCESS study will be interpreted alongside the PRIME trial results. This will enable a greater ability to generalise the findings of the main trial. The investigators will attempt to assess which methods are most informative in such evaluations of complex interventions in low-resource settings.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT01024426.

The PRIME trial protocol: evaluating the impact of an intervention implemented in public health centres on management of malaria and health outcomes of children using a cluster-randomised design in Tororo, Uganda

Background

In Africa, inadequate health services contribute to the lack of progress on malaria control. Evidence of the impact of interventions to improve health services on population-level malaria indicators is needed. We are conducting a cluster-randomised trial to assess whether a complex intervention delivered at public health centres in Uganda improves health outcomes of children and treatment of malaria, as compared to the current standard of care.

Methods/Design

Twenty public health centres (level II and III) in Tororo district will be included; 10 will be randomly assigned to the intervention and 10 to control. Clusters will include households located within 2 km of health centres. The trial statistician will generate the random allocation sequence and assign clusters. Health centres will be stratified by level, and restricted randomisation will be employed to ensure balance on cluster location and size. Allocation will not be blinded. The intervention includes training in health centre management, fever case management with use of rapid diagnostic tests (RDTs) for malaria, and patient-centered services, and provision of artemether-lumefantrine (AL) and RDTs when stocks run low. The impact of the intervention on population-level health indicators will be assessed through community surveys conducted at baseline in randomly selected children from each cluster, and repeated annually for two years. The impact on individuals over time will be assessed in a cohort study of children recruited from households randomly selected per cluster. The impact on health centres will be assessed using patient exit interviews, monthly surveillance, and assessment of health worker knowledge and skills. The primary outcome is the prevalence of anaemia (haemoglobin <11.0 g/dL) in individual children under five measured in the annual community surveys. The primary analysis will be based on the cluster-level results.

Discussion

The PRIME trial findings will be supplemented by the PROCESS study, an evaluation of the process, context, and wider impact of the PRIME intervention which will be conducted alongside the main trial, together providing evidence of the health impact of a public sector intervention in Uganda.

Trial registration and funding

This trial is registered at Clinicaltrials.gov (NCT01024426) and is supported by the ACT Consortium.

Aspirations for quality health care in Uganda: How do we get there?

BACKGROUND

Despite significant investments and reforms, health care remains poor for many in Africa. To design an intervention to improve access and quality of health care at health facilities in eastern Uganda, we aimed to understand local priorities for qualities in health care, and factors that enable or prevent these qualities from being enacted.

METHODS

In 2009 to 2010, we carried out 69 in-depth interviews and 6 focus group discussions with 65 health workers at 17 health facilities, and 10 focus group discussions with 113 community members in Tororo District, Uganda.

RESULTS

Health-care workers and seekers valued technical, interpersonal and resource qualities in their aspirations for health care. However, such qualities were frequently not enacted, and our analysis suggests that meeting aspirations required social and financial resources to negotiate various power structures.

CONCLUSIONS

We argue that achieving aspirations for qualities valued in health care will require a genuine reorientation of focus by health workers and their managers toward patients, through renewed respect and support for these providers as professionals.