Process evaluation of Samoa's national salt reduction strategy (MASIMA): what interventions can be successfully replicated in lower-income countries?

Strengthening national salt reduction strategies using multiple methods process evaluations: case studies from Malaysia and Mongolia

OBJECTIVE

To understand the extent to which national salt reduction strategies in Malaysia and Mongolia were implemented and achieving their intended outcomes.

DESIGN

Multiple methods process evaluations conducted at the mid-point of strategy implementation, guided by theoretical frameworks.

SETTING

Malaysia (2018-2019) and Mongolia (2020-2021).

PARTICIPANTS

Desk-based reviews of related documents, interviews with key stakeholders (n 12 Malaysia, n 10 Mongolia), focus group discussions with health professionals in Malaysia (n 43) and health provider surveys in Mongolia (n 12).

RESULTS

Both countries generated high-quality local evidence about salt intake and levels in foods and culturally specific education resources. In Malaysia, education and reformulation activities were delivered with moderate dose (quantity) but reach among the population was low. Within 5 years, Mongolia implemented education among schools, health professionals and food producers on salt reduction with high reach, but with moderate dose (quantity) and reach among the general population. Both countries faced challenges in implementing legislative interventions (mandatory salt labelling and salt limits in packaged foods) and both could improve the scaling up of their reformulation and education activities.

CONCLUSIONS

In the first half of Malaysia's and Mongolia's strategies, both countries generated necessary evidence and education materials, mobilised health professionals to deliver salt reduction education and achieved small-scale reformulation in foods. Both subsequently should focus on implementing regulatory policies and achieving population-wide reach and impact. Process evaluations of existing salt reduction strategies can help strengthen intervention delivery, aiding achievement of WHO's 30 % reduction in salt intake by 2025 target.

Perceptions, barriers and enablers on salt reduction in the out-of-home sectors in Malaysia (MySaltOH) from the perspective of street food vendors, caterers and consumers

OBJECTIVE

To explore the perspectives, barriers and enablers on salt reduction in out-of-home sectors in Malaysia among street food vendors, caterers and consumers.

DESIGN

A qualitative study involving twenty-two focus group discussions and six in-depth interviews was conducted, recorded and transcribed verbatim. An inductive thematic analysis approach was employed to analyse the data.

SETTING

Two in-depth interviews and twenty-two focus group discussions were conducted face-to-face. Four in-depth interviews were conducted online.

PARTICIPANTS

Focus group discussions were conducted among twenty-three street food vendors, twenty-one caterers and seventy-six consumers of various eateries. In-depth interviews were conducted among two street food vendors and four caterers, individually.

RESULTS

Consumers and food operators perceived a high-salt intake within Malaysia's out-of-home food sectors. Food operators emphasised the necessity for a comprehensive salt reduction policy in the out-of-home sector involving all stakeholders. Consumers faced limited awareness and knowledge, counterproductive practices among food operators and challenges in accessing affordable low-Na food products, whereas food operators faced the lack of standardised guidelines and effective enforcement mechanisms and uncooperative consumer practices. Both groups expressed that food quality and price of salt were also the barriers, and they advocated for awareness promotion, enhanced regulation of manufactured food products and stricter enforcement targeting vendors. Consumers also suggested promoting and recognising health-conscious food premises, whereas food operators suggested on knowledge enhancement tailored to them, strategies for gaining consumers acceptance and maintaining food quality.

CONCLUSIONS

These findings provide valuable insights that serve as foundational evidence for developing and implementing salt reduction policies within Malaysia's out-of-home sectors.

Theory-guided process evaluation of a multicomponent, technology-based 'SMART Eating' trial among Indian adults: an embedded mixed-methods study

We report process evaluation findings from the 'SMART Eating' intervention trial, which significantly improved fat, sugar and salt (FSS), and fruits and vegetables (FVs) intake among adults. Intervention used information technology [short message service (SMS), WhatsApp and website] and interpersonal communication (distribution of SMART Eating kit) and pamphlet for comparison group. Guided by UK Medical Research Council's framework, using embedded mixed-methods design, continuous process evaluation documented fidelity, dose, reach, acceptability and mechanisms. Intervention was implemented as intended, with high reach (91%) in both groups: 'comparison group' (n = 366): inadequate use of pamphlets (46%); 'intervention group' (n = 366): with timely remedial measures to remove implementation/usage barriers, dose of SMS (93%), WhatsApp (89%) and 'SMART Eating' kit (100%) was adequate, but website usage was low (50%); compliance was evident from participants' interactions with the implementor and observations on kit usage. All these might have improved attitude, social influence, self-efficacy and household behaviours, which, in turn, mediated intervention's effect on improving FSS and FV intake. Among poor performers, lack of effect on FV intake was perceived to be related to high cost/pesticides use and FSS intake was related to lack of family support. Low website usage, challenges with WhatsApp messaging and contextual factors (cost, pesticides abuse and family support) need to be considered while designing similar future interventions.

Stakeholder perspectives on Nigeria's national sodium reduction program: Lessons for implementation and scale-up

BACKGROUND

To reduce excess dietary sodium consumption, Nigeria's 2019 National Multi-sectoral Action Plan (NMSAP) for the Prevention and Control of Non-communicable Diseases includes policies based on the World Health Organization SHAKE package. Priority actions and strategies include mandatory sodium limits in processed foods, advertising restrictions, mass-media campaigns, school-based interventions, and improved front-of-package labeling. We conducted a formative qualitative evaluation of stakeholders' knowledge, and potential barriers as well as effective strategies to implement these NMSAP priority actions.

METHODS

From January 2021 to February 2021, key informant interviews (n = 23) and focus group discussions (n = 5) were conducted with regulators, food producers, consumers, food retailers and restaurant managers, academia, and healthcare workers in Nigeria. Building on RE-AIM and the Consolidated Framework for Implementation Research, we conducted directed content qualitative analysis to identify anticipated implementation outcomes, barriers, and facilitators to implementation of the NMSAP sodium reduction priority actions.

RESULTS

Most stakeholders reported high appropriateness of the NMSAP because excess dietary sodium consumption is common in Nigeria and associated with high hypertension prevalence. Participants identified multiple barriers to adoption and acceptability of implementing the priority actions (e.g., poor population knowledge on the impact of excess salt intake on health, potential profit loss, resistance to change in taste) as well as facilitators to implementation (e.g., learning from favorable existing smoking reduction and advertising strategies). Key strategies to strengthen NMSAP implementation included consumer education, mandatory and improved front-of-package labeling, legislative initiatives to establish maximum sodium content limits in foods and ingredients, strengthening regulation and enforcement of food advertising restrictions, and integrating nutrition education into school curriculum.

CONCLUSION

We found that implementation and scale-up of the Nigeria NMSAP priority actions are feasible and will require several implementation strategies ranging from community-focused education to strengthening current and planned regulation and enforcement, and improvement of front-of-package labeling quality, consistency, and use.

Research protocol for impact assessment of a project to scale up food policies in the Pacific

Background

One of the challenges for countries implementing food policy measures has been the difficulty in demonstrating impact and retaining stakeholder support. Consequently, research funded to help countries overcome these challenges should assess impact and translation into practice, particularly in low-resource settings. However, there are still few attempts to prospectively, and comprehensively, assess research impact. This protocol describes a study co-created with project implementers, collaborative investigators and key stakeholders to optimize and monitor the impact of a research project on scaling up food policies in Fiji.

Methods

To develop this protocol, our team of researchers prospectively applied the Framework to Assess the Impact from Translational health research (FAIT). Activities included (i) developing a logic model to map the pathway to impact and establish domains of benefit; (ii) identifying process and impact indicators for each of these domains; (iii) identifying relevant data for impact indicators and a cost–consequence analysis; and (iv) establishing a process for collecting quantitative and qualitative data to measure progress. Impact assessment data will be collected between September 2022 and December 2024, through reports, routine monitoring activities, group discussions and semi-structured interviews with key implementers and stakeholders. The prospective application of the protocol, and interim and final research impact assessments of each project stream and the project as a whole, will optimize and enable robust measurement of research impact.

Discussion

By applying this protocol, we aim to increase understanding of pathways to impact and processes that need to be put in place to achieve this. This impact evaluation will inform future projects with a similar scope and will identify transferable and/or translatable lessons for other Pacific Island states and low- and middle-income countries.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00927-x.

Interventions in Small Island Developing States to improve diet, with a focus on the consumption of local, nutritious foods: a systematic review

Introduction

Food security in Small Island Developing States (SIDS) is an international policy priority. SIDS have high rates of nutrition-related non-communicable diseases, including obesity and type 2 diabetes, micronutrient deficiencies and, in many, persistent childhood stunting. This is associated with an increasing reliance on imported processed food of poor nutritional quality. Calls have been made for strengthening local food systems, resilient to climate change, to increase the consumption of nutritious locally produced food. We aimed to systematically review interventions intended to improve diet in SIDS, and specifically explore whether these interventions applied a local food approach.

Methods

The search strategy was applied to 11 databases, including in health, social science and agriculture. Screening of titles, abstracts and data extraction was undertaken in duplicate. Risk of bias was assessed using Cochrane tools. Narrative synthesis of the results was undertaken. The study protocol was registered (PROSPERO registration number: 2020CRD42020201274).

Results

From 26 062 records, 154 full texts were reviewed and 24 were eligible. Included studies were from the Caribbean, Pacific, Mauritius and Singapore. Five were a randomised study design, one an interrupted time series analysis, eight controlled and ten uncontrolled pre-test and post-test. Nine studies included some aspect of a local food approach. Most interventions (n=15) included nutrition education, with evidence of effectiveness largely limited to those that also included practical skills training, such as vegetable gardening or food preparation. Three studies were considered low risk of bias, with the majority (n=13) of moderate risk.

Conclusion

There is a lack of robust evidence on interventions to improve diet in SIDS. The evidence suggests that multifaceted approaches are likely to be the most effective, and local food approaches may promote effectiveness, through mechanisms of cultural and contextual relevance. Further development and evaluation of interventions is urgently required to increase the comparability of these studies, to help guide policy on improving nutrition in SIDS.

Partnerships and Community Engagement Key to Policy, Systems, and Environmental Achievements for Healthy Eating and Active Living: a Systematic Mapping Review

INTRODUCTION

Policy, systems, and environmental (PSE) change approaches frequently address healthy eating and active living (HEAL) priorities. However, the health effects of PSE HEAL initiatives are not well known because of their design complexity and short duration. Planning and evaluation frameworks can guide PSE activities to generate collective impact. We applied a systematic mapping review to the Individual plus PSE Conceptual Framework for Action (I+PSE) to describe characteristics, achievements, challenges, and evaluation strategies of PSE HEAL initiatives.

METHODS

We identified peer-reviewed articles published from January 2009 through January 2021 by using CINAHL, Web of Science, MEDLINE, PsycINFO, and CAB Abstracts databases. Articles describing implementation and results of PSE HEAL initiatives were included. Activities were mapped against I+PSE components to identify gaps in evaluation efforts.

RESULTS

Independent reviewers examined 437 titles and abstracts; 52 peer-reviewed articles met all inclusion criteria. Twenty-four focused on healthy eating, 5 on active living, and 23 on HEAL. Descriptive analyses identified federal funding of initiatives (typically 1-3 years), multisector settings, and mixed-methods evaluation strategies as dominant characteristics. Only 11 articles reported on initiatives that used a formal planning and evaluation framework. Achievements focused on partnership development, individual behavior, environmental or policy changes, and provision of technical assistance. Challenges included lack of local coalition and community engagement in initiatives and evaluation activities and insufficient time and resources to accomplish objectives. The review team noted vague or absent descriptions of evaluation activities, resulting in questionable characterizations of processes and outcomes. Although formation of partnerships was the most commonly reported accomplishment, I+PSE mapping revealed a lack of engagement assessment and its contributions toward initiative impact.

CONCLUSION

PSE HEAL initiatives reported successes in multiple areas but also challenges related to partnership engagement and community buy-in. These 2 areas are essential for the success of PSE HEAL initiatives and need to be adequately evaluated so improvements can be made.

Non-communicable disease policy implementation in Libya: A mixed methods assessment

The Libyan Ministry of Health is keen to understand how it can introduce policies to protect its population from non-communicable diseases (NCDs). We aimed to perform an implementation research assessment of the current situation, including challenges and opportunities. We used an explanatory sequential mixed methods design. We started with a quantitative assessment of NCD policy performance based on review of the WHO NCD Progress Monitor Reports. Once we had identified Libya's NCD policy gaps we performed a systematic review to identify international lessons around barriers and successful strategies for the policies Libya has not yet implemented. Finally, we performed a series of key stakeholder interviews with senior policymakers to explore their perspectives around promising policy actions. We used a realist paradigm, methods triangulation, and a joint display to synthesise the interpretation of our findings and develop recommendations. Libya has not fully implemented any of the recommended policies for diet, physical activity, primary care guidelines & therapeutics, or data collection, targets & surveillance. It does not have robust tobacco policies in place. Evidence from the international literature and policymaker interviews emphasised the centrality of according strong political leadership, governance structures, multisectoral engagement, and adequate financing to policy development activities. Libya's complex political and security situation are major barriers for policy implementation. Whilst some policies will be very challenging to develop and deploy, there are a number of simple policy actions that could be implemented with minimum effort; from inviting WHO to conduct a second STEPS survey, to signing the international code on breast-milk substitutes. Like many other fragile and conflict-affected states, Libya has not accorded NCDs the policy attention they demand. Whilst strong high-level leadership is the ultimate key to providing adequate protections, there are a range of simple measures that can be implemented with relative ease.

Process Evaluation in Health Communication Media Campaigns: A Systematic Review

Objective. The objective is to examine the scope of health communication media campaign process evaluation methods, findings, and dissemination practices. Data Source. A systematic review of peer-reviewed literature was conducted using database searches. Study Inclusion and Exclusion Criteria. Published studies on process and implementation evaluation of health campaigns with a media component were included. Exclusion criteria included not health, non-empirical, no media campaign, or a focus on other evaluation types. Data Extraction. Articles were assessed for general campaign information, theory use, and details about process evaluation plan and procedures. Data Synthesis. A coding scheme based on 9 process evaluation best practice elements (e.g., fidelity and context) was applied. Process evaluation methods, measures, and reporting themes were synthesized. Results. Among 691 unique records, 46 articles were included. Process evaluation was the main focus for 71.7% of articles, yet only 39.1% reported how process evaluation informed campaign implementation strategy. Articles reported 4.39 elements on average (SD = 1.99; range 1-9), with reach (87.0%) and recruitment (73.9%) described most frequently, yet reporting was inconsistent. Further, the level of detail in reporting methods, theory, and analysis varied. Conclusions. Process evaluation provides insight about mechanisms and intervening variables that could meaningfully impact interpretations of outcome evaluations; however, process evaluations are less often included in literature. Recommendations for evidence-based process evaluation components to guide evaluation are discussed.

Factors Associated With the Use of a Salt Substitute in Rural China

IMPORTANCE

Lowering sodium intake reduces blood pressure and may reduce the risk of cardiovascular diseases. The use of reduced-sodium salt (a salt substitute) may achieve sodium reduction, but its effectiveness may be associated with the context of its use.

OBJECTIVE

To identify factors associated with the use of salt substitutes in rural populations in China within the Salt Substitute and Stroke Study, a large-scale cluster randomized trial.

DESIGN, SETTING, AND PARTICIPANTS

This sequential mixed-methods qualitative evaluation, conducted from July 2 to August 28, 2018, in rural communities across 3 provinces in China, included a quantitative survey, collection of 24-hour urine samples, and face-to-face interviews. A random subsample of trial participants, selected from the 3 provinces, completed the quantitative survey (n = 1170) and provided urine samples (n = 1025). Interview respondents were purposively selected from the intervention group based on their different ranges of urinary sodium excretion levels. Statistical analysis was performed from September 18, 2018, to February 22, 2019.

EXPOSURES

The intervention group of the Salt Substitute and Stroke Study was provided with the free salt substitute while the control group continued to use regular salt.

MAIN OUTCOMES AND MEASURES

Knowledge, attitudes, and behaviors regarding the use of the salt substitute were measured using quantitative surveys, and urinary sodium levels were measured using 24-hour urine samples. Contextual factors were explored through semistructured interviews and integrated findings from surveys and interviews.

RESULTS

A total of 1170 individuals participated in the quantitative survey. Among the 1025 participants with successful urine samples, the mean (SD) age was 67.4 (7.5) years, and 502 (49.0%) were female. The estimated salt intake of participants who believed that high salt intake was good for health was higher; however, it was not significantly different (0.84 g/d [95% CI, -0.04 to 1.72 g/d]) from those who believed that high salt intake was bad for health. Thirty individuals participated in the qualitative interviews (18 women [60.0%]; mean [SD] age, 70.3 [6.0] years). Quantitative and qualitative data indicated high acceptability of and adherence to the salt substitute. Contextual factors negatively associated with the use of the salt substitute included a lack of knowledge about the benefits associated with salt reduction and consumption of high-sodium pickled foods. In addition, reduced antihypertensive medication was reported by a few participants using the salt substitute.

CONCLUSIONS AND RELEVANCE

This study suggests that lack of comprehensive understanding of sodium reduction and salt substitutes and habitual consumption of high-sodium foods (such as pickled foods) were the main barriers to the use of salt substitutes to reduce sodium intake. These factors should be considered in future population-based, sodium-reduction interventions.

A Systematic Review of Salt Reduction Initiatives Around the World: A Midterm Evaluation of Progress Towards the 2025 Global Non-Communicable Diseases Salt Reduction Target

In 2013, the WHO recommended that all member states aim to reduce population salt intake by 30% by 2025. The year 2019 represents the midpoint, making it a critical time to assess countries' progress towards this target. This review aims to identify all national salt reduction initiatives around the world in 2019, and to quantify countries' progress in achieving the salt reduction target. Relevant data were identified through searches of peer-reviewed and gray literature, supplemented with responses from prefilled country questionnaires sent to known country leads of salt reduction or salt champions, WHO regional representatives, and international experts to request further information. Core characteristics of each country's strategy, including evaluations of program impact, were extracted and summarized. A total of 96 national salt reduction initiatives were identified, representing a 28% increase in the number reported in 2014. About 90% of the initiatives were multifaceted in approach, and 60% had a regulatory component. Approaches include interventions in settings (n= 74), food reformulation (n = 68), consumer education (n = 50), front-of-pack labeling (n = 48), and salt taxation (n = 5). Since 2014, there has been an increase in the number of countries implementing each of the approaches, except consumer education. Data on program impact were limited. There were 3 countries that reported a substantial decrease (>2 g/day), 9 that reported a moderate decrease (1-2 g/day), and 5 that reported a slight decrease (<1 g/day) in the mean salt intake over time, but none have yet met the targeted 30% relative reduction in salt intake from baseline. In summary, there has been an increase in the number of salt reduction initiatives around the world since 2014. More countries are now opting for structural or regulatory approaches. However, efforts must be urgently accelerated and replicated in other countries and more rigorous monitoring and evaluation of strategies is needed to achieve the salt reduction target.

Strengthening Knowledge to Practice on Effective Salt Reduction Interventions in Low- and Middle-Income Countries

PURPOSE OF REVIEW

The objective of this review was to consolidate available published information on the implementation and evaluation of salt reduction interventions in low- and middle-income countries (LMICs).

RECENT FINDINGS

The Science of Salt database (made up of studies identified in a weekly Medline search) was used to retrieve articles related to the implementation of salt reduction interventions from June 2013 to February 2020. Studies that measured the effects of the interventions in LMICs, based on four outcome measures-salt intake; sodium levels in foods; knowledge, attitudes, and behaviours (KABs) towards salt; and blood pressure-were included. Results were summarised overall and according to subgroups of intervention type, duration, sample size, country's income class, and regional classification. The review identified 32 studies, representing 13 upper middle-income and four lower middle-income countries. The main salt reduction interventions were education, food reformulation, and salt substitution; and many interventions were multi-faceted. More studies reported a positive effect of the interventions (decreased salt intake (12/17); lower sodium levels in foods or compliance with agreed targets (6/6); improved KAB (17/19); and decreased blood pressure (10/14)) than a null effect, and no study reported a negative effect of the intervention. However, many studies were of small scale and targeted specific groups, and none was from low-income countries. Consumer education, food reformulation, and salt substitution, either alone or in combination, were effective in their target populations. Supporting scale-up of salt reduction interventions in LMICs is essential to cover broader populations and to increase their public health impact.

Stakeholder perspectives on the effectiveness of the Victorian Salt Reduction Partnership: a qualitative study

BACKGROUND

Interventions to reduce population salt intake are feasible and cost-effective. The Victorian Salt Reduction Partnership implemented a complex, multi-faceted salt reduction intervention between 2014 and 2020 in the Australian state of Victoria. This study aimed to understand stakeholder perspectives on the effectiveness of the Victorian Salt Reduction Partnership.

METHODS

Semi-structured interviews were conducted with Partnership and food industry stakeholders. The Consolidated Framework for Implementation Research was adapted for the Partnership intervention and used to guide the qualitative analysis.

RESULTS

Fourteen Partnership and seven food industry stakeholders were interviewed. The Partnership was viewed as essential for intervention planning and decision-making and an enabler for intervention delivery. The goals of capacity building and collaborative action were perceived to have been achieved. The implementation team executed intended intervention activities and outputs, with some adaptations to strategy. Barriers and enablers to implementation were identified by interviewees, such as compatibility of individual, organisational and Partnership values and building positive relationships between the Partnership and food industry, respectively. Legal, political, social, environmental, technological and economic factors affecting intervention design, delivery and outcomes were identified.

CONCLUSIONS

Establishing a Partnership with diverse skills and experience facilitated collaborative action, capacity building and execution of the intervention. Monitoring and evaluating implementation informed strategy adaptations, which allowed optimisation of Partnership strategy. The importance of developing strong communication networks between strategic and implementation-levels was a key lesson.

Sodium intake, health implications, and the role of population-level strategies

Evidence to date suggests that high sodium intake affects health adversely, yet the role of a population-level strategy to reduce sodium intake is often contested. This review focuses on current available evidence on regional sodium intake levels, health implications of sodium intake, and population-level strategies implemented worldwide. The limitations in evidence, the difficulties in implementing population-wide strategies to reduce sodium intake, and the need for such strategies are critically reviewed. Evidence clearly shows that sodium has an adverse effect on blood pressure, cardiovascular disease, and mortality. However, whether reduced sodium intake benefits all individuals or only hypertensive individuals is still unclear. Methodological issues and publication bias in current evidence are other matters of concern in sodium-related research. While it is essential to continue working toward the World Health Organization's target of 30% reduction in sodium intake, due consideration should be given to improving the quality of research, reducing bias in publications, and reviewing evidence more critically.

The role of contextualisation in enhancing non-communicable disease programmes and policy implementation to achieve health for all

The September 2019 United Nations’ High-Level Meeting renewed political commitments to invest in universal health coverage by strengthening health systems, programmes and policies to achieve ‘health for all’. This Political Declaration is relevant to addressing the increasing global burden of non-communicable diseases, but how can evidence-based programmes and policies be meaningfully implemented and integrated into local contexts? In this Commentary, we describe how the process of contextualisation and associated tools, such as ecological frameworks, implementation research frameworks, health system indicators, effective system strengthening strategies and evidence mapping databases with priority-setting, can enhance the implementation and integration of non-communicable disease prevention and control policies and programmes. Examples across health platforms include (1) population approaches to reducing excess sodium intake, (2) fixed-dose combination therapy for cardiovascular disease prevention and control, and (3) health systems strengthening for improving the quality and safety of cardiovascular care. Contextualisation is needed to transfer evidence into locally relevant and impactful policies and programmes. The systematic and comprehensive use of contextualisation tools leverages key implementation research principles to achieve ‘health for all’.

Process evaluation in the field: global learnings from seven implementation research hypertension projects in low-and middle-income countries

BACKGROUND

Process evaluation is increasingly recognized as an important component of effective implementation research and yet, there has been surprisingly little work to understand what constitutes best practice. Researchers use different methodologies describing causal pathways and understanding barriers and facilitators to implementation of interventions in diverse contexts and settings. We report on challenges and lessons learned from undertaking process evaluation of seven hypertension intervention trials funded through the Global Alliance of Chronic Diseases (GACD).

METHODS

Preliminary data collected from the GACD hypertension teams in 2015 were used to inform a template for data collection. Case study themes included: (1) description of the intervention, (2) objectives of the process evaluation, (3) methods including theoretical basis, (4) main findings of the study and the process evaluation, (5) implications for the project, policy and research practice and (6) lessons for future process evaluations. The information was summarized and reported descriptively and narratively and key lessons were identified.

RESULTS

The case studies were from low- and middle-income countries and Indigenous communities in Canada. They were implementation research projects with intervention arm. Six theoretical approaches were used but most comprised of mixed-methods approaches. Each of the process evaluations generated findings on whether interventions were implemented with fidelity, the extent of capacity building, contextual factors and the extent to which relationships between researchers and community impacted on intervention implementation. The most important learning was that although process evaluation is time consuming, it enhances understanding of factors affecting implementation of complex interventions. The research highlighted the need to initiate process evaluations early on in the project, to help guide design of the intervention; and the importance of effective communication between researchers responsible for trial implementation, process evaluation and outcome evaluation.

CONCLUSION

This research demonstrates the important role of process evaluation in understanding implementation process of complex interventions. This can help to highlight a broad range of system requirements such as new policies and capacity building to support implementation. Process evaluation is crucial in understanding contextual factors that may impact intervention implementation which is important in considering whether or not the intervention can be translated to other contexts.

Dissemination and Implementation Program in Hypertension in Rwanda: Report on Initial Training and Evaluation

BACKGROUND

Cardiovascular disease (CVD) is the leading cause of morbidity and mortality worldwide and in low- and middle-income countries, and hypertension (HTN) is a major risk factor for CVD. Although effective evidence-based interventions for control of HTN in high-income countries exist, implementation of these in low- and middle-income countries has been challenging due to limited capacity and infrastructure for late-phase translational research. In Rwanda, the 2015 STEPS NCD (STEPwise Approach to Surveillance of Noncommunicable Diseases) risk survey reported an overall prevalence of HTN of 15% (95% confidence interval [CI]: 13.8 to 16.3) for those ages 15 to 64 years; prevalence increased with increasing age to 39% (95% CI: 35.7 to 43.1) for those ages 55 to 64 years; CVD was the third most common cause of mortality (7%). Suboptimal infrastructure and capacity in Rwanda hinders research and community knowledge for HTN control.

OBJECTIVES

To address the issue of suboptimal capacity to implement evidence-based interventions in HTN, this project was designed with the following objectives: 1) to develop a regional needs assessment of infrastructure for dissemination and implementation (D & I) strategies for HTN-CVD control; 2) to develop HTN-CVD research capacity through creation of countrywide resources such as core research facilities and training in the fields of HTN-CVD, D & I, and biostatistics; and 3) to engage and train multiple stakeholders in D & I and HTN-CVD evidence-based interventions.

METHODS

A weeklong training program in HTN-CVD, biostatistics, and D & I was conducted in Rwanda in August 2018, and pre- and post-D & I training competency questionnaires were administered.

RESULTS

Questionnaire results show a statistically significant increase in D & I knowledge and skills as a result of training (full scale pre- to post-test scores: 2.12 ± 0.78 vs. 3.94 ± 0.42; p < 0.0001).

CONCLUSIONS

Using principles of community engagement and train-the-trainer methods, we will continue to adapt guidelines and treatments for HTN-CVD developed in high-income countries to the context of Rwanda with the goal of establishing a sustainable platform to address the burden of disease from HTN-CVD.

Strengthening and measuring research impact in global health: lessons from applying the FAIT framework

Background

To date, efforts to measure impact have largely focused on health research in high-income countries, reflecting where the majority of health research funding is spent. Nevertheless, there is a growing body of health and medical research being undertaken in low- and middle-income countries (LMICs), supported by both development aid and established research funders. The Framework to Assess the Impact of Translational health research (FAIT) combines three approaches to measuring research impact (Payback, economic assessment and case study narrative). Its aim is to strengthen the focus on translation and impact measurement in health research. FAIT has been used by several Australian research initiatives; however, it has not been used in LMICs. Our aim was to apply FAIT in an LMIC context and evaluate its utility.

Methods

We retrospectively applied all three FAIT methods to two LMIC studies using available data, supplemented with group discussion and further economic analyses. Results were presented in a scorecard format.

Results

FAIT helped clarify pathways of impact for the projects and provided new knowledge on areas of impact in several domains, including capacity-building for research, policy development and economic impact. However, there were constraints, particularly associated with calculating the return on investment in the LMIC context. The case study narrative provided a layperson’s summary of the research that helped to explain outcomes and succinctly communicate lessons learnt.

Conclusion

Use of FAIT to assess the impact of LMIC research was both feasible and useful. We make recommendations related to prospective use, identification of metrics to support use of the Payback framework, and simplification of the economic assessment, which may facilitate further application in LMIC environments.

Electronic supplementary material

The online version of this article (10.1186/s12961-019-0451-0) contains supplementary material, which is available to authorized users.