The Structured Operational Research and Training Initiative for public health programmes

Implementing evidence ecosystems in the public health service: Development of a framework for designing tailored training programs

The COVID-19 pandemic has highlighted the importance of local evidence ecosystems in which academia and practice in the Public Health Service (PHS) are interconnected. However, appropriate organizational structures and well-trained staff are lacking and evidence use in local public health decision-making has to be integrated into training programs in Germany. To address this issue, we developed a framework incorporating a toolbox to conceptualize training programs designed to qualify public health professionals for working at the interface between academia and practice. We conducted a scoping review of training programs, key-informant interviews with public health experts, and a multi-professional stakeholder workshop and triangulated their output. The resulting toolbox consists of four core elements, encompassing 15 parameters: (1) content-related aspects, (2) context-related aspects, (3) aspects relevant for determining the training format, and (4) aspects relevant for consolidation and further development. Guiding questions with examples supports the application of the toolbox. Additionally, we introduced a how-to-use guidance to streamline the creation of new training programs, fostering knowledge transfer at the academia-practice interface, equipping public health researchers and practitioners with relevant skills for needs-based PHS research. By promoting collaborative training development across institutions, our approach encourages cross-institutional cooperation, enhances evidence utilization, and enables efficient resource allocation. This collaborative effort in developing training programs within local evidence ecosystems not only strengthens the scientific and practical impact but also lays a foundation for implementing complex public health measures effectively at the local level.

Evidence-based Decision Making: Infectious Disease Modeling Training for Policymakers in East Africa

Background

Mathematical modeling of infectious diseases is an important decision-making tool for outbreak control. However, in Africa, limited expertise reduces the use and impact of these tools on policy. Therefore, there is a need to build capacity in Africa for the use of mathematical modeling to inform policy. Here we describe our experience implementing a mathematical modeling training program for public health professionals in East Africa.

Methods

We used a deliverable-driven and learning-by-doing model to introduce trainees to the mathematical modeling of infectious diseases. The training comprised two two-week in-person sessions and a practicum where trainees received intensive mentorship. Trainees evaluated the content and structure of the course at the end of each week, and this feedback informed the strategy for subsequent weeks.

Findings

Out of 875 applications from 38 countries, we selected ten trainees from three countries - Rwanda (6), Kenya (2), and Uganda (2) - with guidance from an advisory committee. Nine trainees were based at government institutions and one at an academic organization. Participants gained skills in developing models to answer questions of interest and critically appraising modeling studies. At the end of the training, trainees prepared policy briefs summarizing their modeling study findings. These were presented at a dissemination event to policymakers, researchers, and program managers. All trainees indicated they would recommend the course to colleagues and rated the quality of the training with a median score of 9/10.

Conclusions

Mathematical modeling training programs for public health professionals in Africa can be an effective tool for research capacity building and policy support to mitigate infectious disease burden and forecast resources. Overall, the course was successful, owing to a combination of factors, including institutional support, trainees' commitment, intensive mentorship, a diverse trainee pool, and regular evaluations.

--Eleven tips for operational researchers working with health programmes: our experience based on implementing differentiated tuberculosis care in south India

Due to the workload and lack of a critical mass of trained operational researchers within their ranks, health systems and programmes may not be able to dedicate sufficient time to conducting operational research (OR). Hence, they may need the technical support of operational researchers from research/academic organisations. Additionally, there is a knowledge gap regarding implementing differentiated tuberculosis (TB) care in programme settings. In this 'how we did it' paper, we share our experience of implementing a differentiated TB care model along with an inbuilt OR component in Tamil Nadu, a southern state in India. This was a health system initiative through a collaboration of the State TB cell with the Indian Council of Medical Research institutes and the World Health Organisation country office in India. The learnings are in the form of eleven tips: four broad principles (OR on priority areas and make it a health system initiative, implement simple and holistic ideas, embed OR within routine programme settings, aim for long-term engagement), four related to strategic planning (big team of investigators, joint leadership, decentralised decision-making, working in advance) and three about implementation planning (conducting pilots, smart use of e-tools and operational research publications at frequent intervals). These may act as a guide for other Indian states, high TB burden countries that want to implement differentiated care, and for operational researchers in providing technical assistance for strengthening implementation and conducting OR in health systems and programmes (TB or other health programmes). Following these tips may increase the chances of i) an enriching engagement, ii) policy/practice change, and iii) sustainable implementation.

Managing Comorbidities, Determinants and Disability at Start and End of TB Treatment under Routine Program Conditions in China

Many patients with tuberculosis (TB) have comorbidities, risk determinants and disability that co-exist at diagnosis, during and after TB treatment. We conducted an observational cohort study in 11 health facilities in China to assess under routine program conditions (i) the burden of these problems at the start and end of TB treatment and (ii) whether referral mechanisms for further care were functional. There were 603 patients registered with drug-susceptible TB who started TB treatment: 84% were symptomatic, 14% had diabetes, 14% had high blood pressure, 19% smoked cigarettes, 10% drank excess alcohol and in 45% the 6 min walking test (6MWT) was abnormal. Five patients were identified with mental health disorders. There were 586 (97%) patients who successfully completed TB treatment six months later. Of these, 18% were still symptomatic, 12% had diabetes (the remainder with diabetes failed to complete treatment), 5% had high blood pressure, 5% smoked cigarettes, 1% drank excess alcohol and 25% had an abnormal 6MWT. Referral mechanisms for the care of comorbidities and determinants worked well except for mental health and pulmonary rehabilitation for disability. There is need for more programmatic-related studies in other countries to build the evidence base for care of TB-related conditions and disability.

Capacity building in operational research on obstetric fistula: Experience in the Democratic Republic of Congo, 2017-2021

OBJECTIVE

To implement a Flexible Operational Research Training (FORT) course within the Fistula Care Plus Project, Democratic Republic of Congo, from 2017 to 2021.

METHODS

A descriptive study using design and implementation (process and outcome) data. Two to four members of medical teams from three supported sites were selected for the training based on their research interests and level of involvement in the program.

RESULTS

Two courses (13-14 months each) involving nine facilitators and 17 participants overall were conducted between 2017 and 2021. Most participants in both courses were medical doctors (67% and 71%, respectively) from the supported hospitals (83% and 77%, respectively). About half were women. In addition to classic face-to-face didactic modules, the courses integrated online platforms to cope with the changing contexts (Ebola virus and COVID-19). Most participants reported having gained new skills in developing research protocols, collecting, managing, and analyzing data, and developing research manuscripts. The two courses resulted in six scientific manuscripts and three presentations at international conferences. Participants subsequently published five papers from their research after the first course. The total direct costs for both courses were representing a cost of $3669 per participant trained.

CONCLUSION

The FORT model proved feasible, efficient, and successful. However, scaling up will require more adaptation efforts from programs and participating sites.

Developing a capacity building training model for public health managers of low and middle income countries

BACKGROUND

The challenges faced by the low and middle-income countries (LMIC) in the field of public health management calls for the capacity building of qualified and trained public health managers in order to improve the effectiveness and efficiency of the health care delivery system. Most of the existing training programs for public health management are based in the settings of developed countries, which hinders their application in LMIC countries. The objective of this paper is to document the process of development and evaluation of a capacity building program for public health managers of various LMICs.

MATERIAL AND METHODS

A training program was developed using Kern's six-step framework with several innovative learning and assessment methodologies and evaluation using Kirkpatrick training evaluation model. Delphi technique was used for program development.

RESULTS

This five to ten-day partly/fully funded six International Public Health Management Development Programs (IPHMDP) programs was conceptualized which enrolled 178 participants from 42 countries between years 2016 and 2019. Based upon the elaborative discussion in four rounds of Delphi technique, the problem and challenges faced by public health mangers and eight key competencies (viz. Leadership and governance, Project/ program planning, financial management, supply chain management, quality management, Human Resource management, monitoring and evaluation, and communication.) were identified. The group consensually agree upon a blended teaching methodology comprising of chalk and talk approach, inquiry based learning, participatory student based learning, small group instructions, gamification, project-based learning and field-based learning. There was a significant increase in participants' knowledge score (P<0.0001) after all programs especially in the competencies of monitoring and evaluation, followed by project/ program planning, supply chain management and quality management. The majority (90%) submitted their action plan one week following the program, out of which 64% implemented their action plans within six months. A majority (54.7%) of participants were able to implement their learning once they went back by conducting similar training/ workshop/webinars in their settings.

CONCLUSION

The comprehensive public health management program in LMIC settings strengthens the competencies of public health managers which can be replicated in similar settings across LMIC to mitigate diverse challenges in public health management.

Strengthening Health Research and Ethics Systems in Timor-Leste

Introduction

Meaningful health research should lead to evidence-based decision-making that can be translated into policy and practice. Every country needs to have a well-functioning and resourced ethics review and clearance system to ensure health and medical research is conducted in line with ethical standards, preventing harm to research participants, and contributing to better health outcomes and national priorities. The purpose of this study is to describe the origins of the system for managing health research and ethics in Timor-Leste and how it has evolved over time; to identify the strengths and limitations of the current system; and to recommend areas for improvement.

Materials and Methods

A narrative review of the literature (published papers, gray literature, and unpublished data) was conducted alongside key informant interviews with 15 Ministry of Health (MOH) policymakers and National Institute of Health staff between October 2020 and March 2021.

Results

The system for managing health research and ethics in Timor-Leste has remained largely the same since it was first established in 2009, with some adaptations to cope with a progressively increasing workload. Main findings include: the Department of Research and Studies (DRS) oversees complex ethics approval process in addition to other responsibilities; the DRS lacks the legal authority, policies, and procedures to help implement its full range of functions and responsibilities; national research priorities should be identified; MOH experiences difficulties in securing funding to support health research; training in health research, ethics and governance is an important priority for DRS.

Conclusion

It is timely and important to invest in strengthening key components of health research and ethics systems in Timor-Leste. Despite limited resources, improvements can be achieved in key areas with focused assistance and collaboration with local, national, and international partners.

Quality, Equity and Partnerships in Mixed Methods and Qualitative Research during Seven Years of Implementing the Structured Operational Research and Training Initiative in 18 Countries

Introduction: Qualitative studies are often inadequately reported, making it difficult to judge their appropriateness for decision making in public health. We assessed the publication characteristics and quality of reporting of qualitative and mixed-method studies from the Structured Operational Research and Training Initiative (SORT IT), a global partnership for operational research capacity building. Methods: A cross-sectional analysis of publications to assess the qualitative component using an adapted version of the Consolidated Criteria for Reporting Qualitative Research (COREQ) checklist. Results: In 67 publications involving 18 countries, 32 journals and 13 public health themes, 55 were mixed-methods studies and 12 were qualitative studies. First authorship from low-and-middle-income (LMIC) countries was present in 64 (96%), LMIC last authorship in 55 (82%), and female first authorship in 30 (45%). The mean LMIC institutions represented per publication was five (range 1–11). Sixty-three (94%) publications were open access. Reporting quality was graded as ‘good’ to ‘excellent’ in 60 (89%) publications, ‘fair’ in five (8%) and ‘poor’ in two (3%). Conclusion: Most SORT IT publications adhered to COREQ standards, while supporting gender equity in authorship and the promotion of LMIC research leadership. SORT IT plays an important role in ensuring quality of evidence for decision making to improve public health.

Building Capacity for Cancer Research in the Era of COVID-19: Implementation and Results From an International Virtual Clinical Research Training Program in Zambia

The incidence of cancer in sub-Saharan Africa is increasing rapidly, yet cancer research in the region continues to lag. One contributing factor is limited exposure to clinical research among trainees. We describe implementation and results of a virtual clinical research training program for Zambian clinical oncology fellows developed jointly by the Cancer Diseases Hospital in Zambia and the MD Anderson Cancer Center to address this need.

Revamping of Chronic Respiratory Diseases in Low- and Middle-Income Countries

Low- and middle-income countries (LMICs) endure an asymmetrically high burden of worldwide disease and death caused by chronic respiratory diseases (CRDs), i.e., asthma, emphysema, bronchiectasis, and post-tuberculosis lung disease (PTLD). CRDs are firmly related with indigence, infectious diseases, and other non-communicable diseases (NCDs) and add to complex multi-disease with great impact on the lives and livelihood of those affected. The pertinence of CRDs to health and demographic wellbeing is relied upon to increment in the long time ahead, as expectations of life rise and the contending dangers of right on time youth mortality and irresistible infections level. The WHO has distinguished the counteraction and control of NCDs as an earnest improvement issue and crucial for the sustainable development goals (SDSs) by 2030. In this review, we center on CRDs in LMICs. We examine the early life roots of CRDs, challenges in their avoidance, identification and administration in LMICs, and the pathways to resolve for accomplish valid widespread wellbeing inclusion.

Strengthening research capacity: a systematic review of manuscript writing and publishing interventions for researchers in low-income and middle-income countries

INTRODUCTION

Health researchers from low-income and middle-income countries (LMICs) are under-represented in the academic literature. Scientific writing and publishing interventions may help researchers publish their findings; however, we lack evidence about the prevalence and effectiveness of such interventions. This review describes interventions for researchers in LMICs aimed at strengthening capacity for writing and publishing academic journal articles.

METHODS

We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to report literature searches in PubMed, Embase, Global Health, Scopus and ERIC. Our keywords included LMICs, low-income and middle-income countries, health research and writing/publication support interventions, with no restrictions on publication date. Our screening process consisted of title screening, abstract review and full-text review. We collected information about the content, implementation and evaluation of each intervention, if included.

RESULTS

We identified 20 interventions designed to strengthen capacity for scientific writing and publishing. We summarised information from the 14 interventions that reported submitted or published papers as outcomes separately, reasoning that because they provide quantifiable metrics of success, they may offer particular insights into intervention components leading to publication. The writing and publishing components in this 'Publications Reported' group were an average length of 5.4 days compared with 2.5 days in the other group we refer to as 'Other Interventions.' Whereas all 14 Publications Reported interventions incorporated mentors, only two of five in the Other Interventions group incorporated mentors. Across interventions, leaders expressed the importance of a high ratio of mentors to participants, the need to accommodate time demands of busy researchers, and the necessity of a budget for open access fees and high-quality internet connectivity.

CONCLUSION

Writing and publishing interventions in LMICs are an underutilised opportunity for capacity strengthening. To facilitate the implementation of high-quality interventions, future writing and publishing interventions should share their experiences by publishing detailed information about the approach and effectiveness of the interventions.

Mbarara University Research Training Initiative: Experiences and Accomplishments of the MEPI Junior D43 TW010128 Award in Uganda

OBJECTIVE

In 2015, Mbarara University of Science and Technology was awarded the Mbarara University Research Training Initiative (MURTI) under grant number D43 TW010128 to build capacity of junior faculty to become the next generation of researchers in Africa. In this paper, we document the experiences and achievements of the research capacity building efforts at MUST.

METHODS

We conducted a descriptive evaluation study which involved document review and in-depth interviews. We used "Reach" and 'Effectiveness' from the RE-AIM framework to guide the document review, and the organizational theory of implementation effectiveness to guide the in-depth interviews.

RESULTS

In the MURTI program, we conducted 17 short courses between August 2015 and July 2021, a total of 6597 attendances were recorded. The most attended courses were responsible conduct of research (n = 826), qualitative research methods (n = 744), and data management (n = 613). Thirty-three fellows were recruited and funded to conduct mentored research leading to 48 publications and 14 extramural grant applications were yielded. From the in-depth interviews, the participants appreciated the research training program, the enhanced research skills attained, and the institutional capacity built. They attributed the success of the program to the training approach of using short courses, readiness of the junior faculty to change, and the supportive environment by the mentors and trainers in the program.

CONCLUSION

The D43 TW010128 research training grant-built capacity for the junior faculty at MUST, enhanced their research skills, promoted research capacity institutionally and provided career development for the junior faculty. This was possible due to the positive attitude of the junior faculty (organizational readiness) to change and the supportive environment (mentors and trainers) during implementation of the grant. These two factors provided a favorable institutional climate that guaranteed success of the funding goals.

One Coin, Two Sides: Eliciting Expert Knowledge From Training Participants in a Capacity-Building Program for Veterinary Professionals

Scientific research may include the elicitation of judgment from non-academic subject-matter experts in order to improve the quality and/or impact of research studies. Elicitation of expert knowledge or judgment is used when data are missing, incomplete, or not representative for the specific setting and processes being studied. Rigorous methods are crucial to ensure robust study results, and yet the quality of the elicitation can be affected by a number of practical constraints, including the understanding that subject-matter experts have of the elicitation process itself. In this paper, we present a case of expert elicitation embedded within an extended training course for veterinary professionals as an example of overcoming these constraints. The coupling of the two activities enabled extended opportunities for training and a relationship of mutual respect to be the foundation for the elicitation process. In addition, the participatory research activities reinforced knowledge synthesis objectives of the educational program. Finally, the synergy between the two concurrent objectives may produce benefits which transcend either independent activity: solutions and ideas built by local professionals, evolving collaborative research and training approaches, and a network of diverse academic and practicing professionals. This approach has the versatility to be adapted to many training and research opportunities.

Research capacity training for surveillance and response in the Indo-Pacific: a case study of implementation

SETTING

Surveillance and response workforce in the Indo-Pacific region, including Papua New Guinea (PNG), Solomon Islands, Fiji, Eastern Indonesia and Timor-Leste.

OBJECTIVE

To evaluate the implementation of a modified WHO SORT IT research training programme which included a workplace-based research project. The training was designed for surveillance and response frontline workforce in the Indo-Pacific region.

DESIGN

This was a programme evaluation using mixed methods. Fifty-three health and biosecurity workers from Fiji, Indonesia, PNG, Solomon Islands and Timor-Leste participated in the research training programme.

RESULTS

Implementation of the programme was modified to reflect the context of participant countries. Work-place research projects focused on priority issues identified by local policy makers and in-country stakeholders. Self-reported research skills showed a significant increase (P < 0.01) after the completion of training. Participants reported high scores for satisfaction with training.

CONCLUSIONS

This case study provides lessons learnt for future research training, and demonstrates that the SORT IT model can be modified to reflect the context of implementation without compromising purpose or outcomes.

Real-Time Operational Research: Case Studies from the Field of Tuberculosis and Lessons Learnt

Real-time operational research can be defined as research on strategies or interventions to assess if they are feasible, working as planned, scalable and effective. The research involves primary data collection, periodic analysis during the conduct of the study and dissemination of the findings to policy makers for timely action. This paper aims to illustrate the use of real-time operational research and discuss how to make it happen. Four case studies are presented from the field of tuberculosis. These include (i) mis-registration of recurrent tuberculosis in Malawi; (ii) HIV testing and adjunctive cotrimoxazole to reduce mortality in TB patients in Malawi; (iii) screening TB patients for diabetes mellitus in India; and (iv) mitigating the impact of COVID-19 on TB case detection in capital cities in Kenya, Malawi and Zimbabwe. The important ingredients of real-time operational research are sound ethics; relevant research; adherence to international standards of conducting and reporting on research; consideration of comparison groups; timely data collection; dissemination to key stakeholders; capacity building; and funding. Operational research can improve the delivery of established health interventions and ensure the deployment of new interventions as they become available, irrespective of diseases. This is particularly important when public health emergencies, including pandemics, threaten health services.

Characteristics, utilisation and influence of viewpoint articles from the Structured Operational Research and Training Initiative (SORT IT) - 2009-2020

Background: The Structured Operational Research and Training Initiative (SORT IT) teaches the practical skills of conducting and publishing operational research (OR) to influence health policy and/or practice. In addition to original research articles, viewpoint articles are also produced and published as secondary outputs of SORT IT courses. We assessed the characteristics, use and influence of viewpoint articles derived from all SORT IT courses. Methods: This was a cross-sectional study involving all published viewpoint articles derived from the SORT IT courses held from August 2009 - March 2020. Characteristics of these papers were sourced from the papers themselves and from SORT-IT members involved in writing the papers. Data on use were sourced from the metrics provided on the online publishing platforms and from Google Scholar. Influence on policy and practice was self-assessed by the authors of the papers and was performed only for papers deemed to be 'calls for action'. Results: A total of 41 viewpoint papers were published. Of these, 15 (37%) were 'calls for action'. In total, 31 (76%) were published in open-access journals and the remaining 10 in delayed access journals. In 12 (29%) of the papers, first authors were from low and middle-income countries (LMICs). Female authors (54%) were included in 22, but only four (10%) and two (5%) of first and last authors respectively, were female. Only seven (17%) papers had available data regarding online views and downloads. The median citation score for the papers was four (IQR 1-9). Of the 15 'call for action' papers, six influenced OR capacity building, two influenced policy and practice, and three influenced both OR capacity building within SORT IT and policy and practice. Conclusion: Viewpoint articles generated during SORT IT courses appear to complement original OR studies and are valued contributors to the dissemination of OR practices in LMICs.

Improving lung health in low-income and middle-income countries: from challenges to solutions

Low-income and middle-income countries (LMICs) bear a disproportionately high burden of the global morbidity and mortality caused by chronic respiratory diseases (CRDs), including asthma, chronic obstructive pulmonary disease, bronchiectasis, and post-tuberculosis lung disease. CRDs are strongly associated with poverty, infectious diseases, and other non-communicable diseases (NCDs), and contribute to complex multi-morbidity, with major consequences for the lives and livelihoods of those affected. The relevance of CRDs to health and socioeconomic wellbeing is expected to increase in the decades ahead, as life expectancies rise and the competing risks of early childhood mortality and infectious diseases plateau. As such, the World Health Organization has identified the prevention and control of NCDs as an urgent development issue and essential to the achievement of the Sustainable Development Goals by 2030. In this Review, we focus on CRDs in LMICs. We discuss the early life origins of CRDs; challenges in their prevention, diagnosis, and management in LMICs; and pathways to solutions to achieve true universal health coverage.

What is operational research and how can national tuberculosis programmes in low- and middle-income countries use it to end TB?

Despite considerable progress over the years, tuberculosis (TB) still remains the top cause of death among the infectious diseases and has devastating socio-economic consequences for people in low- and middle-income countries. To add to this, the emergence of the COVID-19 pandemic has worsened delivery of TB care across the globe. As a global community, we have committed to end the TB epidemic by 2030. The World Health Organization has framed a strategy to achieve this goal which consists of three pillars namely i) integrated patient-centred care and prevention, ii) bold policies and systems and iii) intensified research and innovation. An analysis of the performance of national tuberculosis programmes (NTPs) across the globe against the ten priority indicators recommended for monitoring the end TB strategy show that there are huge gaps at every step in the cascade of care of TB patients. In our view, these gaps reflect suboptimal implementation of existing strategies known to be efficacious and operational research (OR) is one of the best available tools to plug the gaps. In this paper, we define what operational research is and how it differs from other kinds of research. We also share our views and experiences about how operational research can be used by NTPs to identify implementation gaps and their reasons, and develop and test possible solutions - which are then integrated to make changes to policy and practice and eventually improve programme outcomes. OR can be defined as research into interventions, strategies and tools which produces practical useable knowledge that can be used to enhance the quality, coverage, effectiveness and efficiency of disease control programmes, health services or health systems in which the research is conducted. The key steps in integrating operational research in the NTPs include: i) securing political commitment reflected by inclusion of OR in the national strategic plans of NTPs and earmarked funding, ii) having a critical mass of dedicated and trained human resources in OR within the NTP, iii) setting research priorities and steering the direction of research in the country, iv) using output-oriented models of capacity building such as the Structured Operational Research Training Initiative (SORT IT) model and building communities of practice, v) harnessing existing capacity in the country by forging partnerships with academia, vi) NTP-led nationwide, multicentre OR studies, vii) providing access to anonymized patient and programme surveillance data, vii) creating a forum for evidence dissemination and fostering policy change and ix) monitoring and accountability. In conclusion, ending the TB epidemic will not be possible without new tools (diagnostics, drugs, vaccines) and a multi-sectoral response involving stakeholders beyond the health ministry, including private providers, patients and communities. However, timely conduct of operational research to fine-tune programme implementation and ensuring proper deployment of new tools will be equally crucial to maximize the effectiveness and efficiency of interventions and ultimately contribute towards ending TB.

Quality, Equity and Utility of Observational Studies during 10 Years of Implementing the Structured Operational Research and Training Initiative in 72 Countries

Introduction: Observational studies are often inadequately reported, making it difficult to assess their validity and generalizability and judge whether they can be included in systematic reviews. We assessed the publication characteristics and quality of reporting of observational studies generated by the Structured Operational Research and Training Initiative (SORT IT). Methods: A cross-sectional analysis of original publications from SORT IT courses. SORT IT is a global partnership-based initiative aimed at building sustainable capacity for conducting operational research according to country priorities and using the generated evidence for informed decision-making to improve public health. Reporting quality was independently assessed using an adapted version of ‘Strengthening the Reporting of Observational Studies in Epidemiology’ (STROBE) checklist. Results: In 392 publications, involving 72 countries, 50 journals, 28 publishers and 24 disease domains, low- and middle-income countries (LMICs) first authorship was seen in 370 (94%) and LMIC last authorship in 214 (55%). Publications involved LMIC-LMIC collaboration in 90% and high-income-country-LMIC collaboration in 87%. The majority (89%) of publications were in immediate open access journals. A total of 346 (88.3%) publications achieved a STROBE reporting quality score of >85% (excellent), 41 (10.4%) achieved a score of 76–85% (good) and 5 (1.3%) a score of 65–75% (fair). Conclusion: The majority of publications from SORT IT adhere to STROBE guidelines, while also ensuring LMIC equity and collaborative partnerships. SORT IT is, thus, playing an important role in ensuring high-quality reporting of evidence for informed decision-making in public health.

Implementation, Outputs, and Cost of a National Operational Research Training in Rwanda

Background

Training and mentorship in research skills are essential to developing a critical mass of researchers in low- and middle-income countries (LMICs). However, reporting on the details of such training programs, especially regarding the cost of the training, is limited.

Objectives

This paper describes a year-long operational research training and mentorship course in Rwanda, implemented between 2013 and 2017.

Approach

We describe motivations for the design of the Intermediate Operational Research Training Course (IORT) across four iterations. We also report outputs, evaluate trainee experiences, and estimate training and mentorship costs.

Findings

Of the 132 applicants to the course, 55 (41.7%) were selected, and 53 (96.4%) completed the training. The ratio of female-to-male trainees in the course increased from 1:8 in 2013 to 1:3 in 2017. Trainees developed and co-first-authored 28 research manuscripts, 96.4% (n = 27) of which are published in peer-reviewed journals. For the 15 trainees who completed the post-course evaluation, 93.3% and 86.7% reported improvement in their research and analytical skills, respectively. The median cost per trainee to complete the course was US$908 (Range: US$739-US$1,253) and per research project was US$2,708 (US$1,748-US$6,741). The median annual training delivery and mentorship cost was US$47,170 (US$30,563-US$63,849) for a course with a Rwanda-based senior mentor, junior mentor, and training coordinator. The total essential cost for a year-long IORT course with 16 trainees co-leading eight research projects and mentored by two senior and four junior mentors was US$101,254 (US$73,486-US$157,569).

Conclusion

We attribute the high course completion rates, publication rates, and skills acquisition to the learning-by-doing approach and intensive hands-on mentorship provided in the course. IORT was costly and funded through institutional resources and international partnerships. We encourage funders to prioritize comprehensive research capacity-building initiatives that provide intensive mentorship as these are likely to improve the pool of skilled researchers in LMICs.

Incorporating operational research in programmes funded by the Global Fund to Fight AIDS, Tuberculosis and Malaria in four sub-Saharan African countries

Background

The current study builds upon a previous situation analysis of the extent to which grants from the Global Fund to Fight AIDS, Tuberculosis and Malaria (Global Fund) are being utilized to support operational research and implementation research (OR/IR) activities in recipient countries. The objective of this follow-up study was to identify approaches and pathways to implement an OR component into grants to the Global Fund, in four sub-Saharan African countries. Special focus was given to the Structured Operational Research and Training IniTiative (SORT IT).

Methods

The conceptual framework was based on an analysis to identify elements supporting and blocking the integration of OR, called force field analysis, and a behavioural change assessment covering aspects such as opportunity, motivation, capability and triggers to do the integration. Data were collected through online surveys and stakeholder interviews both via telephone/online conference tools and in person in four countries with a high burden of malaria and tuberculosis. These countries were Ghana, Sierra Leone, the United Republic of Tanzania and Zimbabwe. The stakeholders included programme managers, implementation partners, representatives from international organisations, academic and governmental research institutions and other individuals involved in the countries’ needs assessment and National Strategic Plan development.

Results

We identified opportunities to integrate OR into the countries’ programmes during the funding process, the country’s needs assessment being the most important one, including the need of OR-related capacity. Both the force field analysis and the behavioural change assessment showed that the necessary elements to integrate OR were present in the countries. Motivation, capability and efficiency were found to be a managerial value omnipresent across stakeholders. However, those elements were influenced by the tendency to favour tangible assets over any abstract ones, such as increasing organisational capacity in OR.

Conclusions

In each of the countries assessed, there is potential to integrating OR into the programmes supported by the Global Fund. However, given the relative lack of OR-related capacity and skills encountered, a capacity strengthening tool, such as SORT IT, would be of benefit helping to identify and carry forward OR activities sustainably.

Investing in Operational Research Capacity Building for Front-Line Health Workers Strengthens Countries' Resilience to Tackling the COVID-19 Pandemic

(1) Introduction. The Structured Operational Research and Training IniTiative (SORT IT) supports countries to build operational research capacity for improving public health. We assessed whether health workers trained through SORT IT were (1) contributing to the COVID-19 pandemic response and if so, (2) map where and how they were applying their SORT IT skills. (2) Methods. An online questionnaire survey of SORT IT alumni trained between 2009 and 2019. (3) Results. Of 895 SORT IT alumni from 93 countries, 652 (73%) responded to the survey and 417 were contributing to the COVID-19 response in 72 countries. Of those contributing, 307 (74%) were applying their SORT IT skills to tackle the pandemic in 60 countries and six continents including Africa, Asia, Europe, South Pacific and North/South America. Skills were applied to all the pillars of the emergency response with the highest proportions of alumni applying their skills in data generation/analysis/reporting (56%), situation analysis (55%) and surveillance (41%). Skills were also being used to mitigate the health system effects of COVID-19 on other diseases (27%) and in conducting research (26%). (4) Conclusion. Investing in people and in research training ahead of public health emergencies generates downstream dividends by strengthening health system resilience for tackling pandemics. It also strengthens human resources for health and the integration of research within health systems.

Building sustainable operational research capacity in Pakistan: starting with tuberculosis and expanding to other public health problems

Background: For many years, operational research capacity has been a challenge and has remained a low priority for the health sector in Pakistan. Building research capacity for developing a critical mass of researchers in Pakistan was done through Structured Operational Research and Training Initiative (SORT IT) courses in Paris and Asia between 2010 and 2016.

Objective: The aim of this paper is to describe the journey of SORT-IT in Pakistan from its inception to progressive expansion and discuss the challenges and ways forward.

Methods: The journey began with the training of the Pakistan NTP research team lead in 2010 in an international SORT IT course at Paris. This was followed by training of two team members in Asia SORT IT courses in 2014 and 2015. These three then worked together to conceive and implement the first national Pakistan SORT IT course supported by WHO/TDR and the Global Fund in 2016. This was facilitated by international facilitators and local trained SORT-IT participants from Paris and Asia. This was followed by two further national SORT IT courses in 2017 and 2018.

Results: Between 2010 and 2017, a total of 34 participants from Pakistan had been enrolled in national and international SORT IT courses. Of the 23 participants from completed courses, 18(78%) successfully completed the course. In total 18 papers were submitted and up until June 2018, 15(83%) have been published and 21 institutions in Pakistan involved with operational research as a result of the SORT IT initiative.

Conclusions: The SORT IT course has been an effective way to build operational research capacity at national level and this has resulted in a large number of published papers providing local evidence for decision making on TB and other disease control programmes. The experience from Pakistan should stimulate other countries to adopt the SORT-IT model.

Overcoming limitations of tuberculosis information systems: researcher and clinician perspectives

Setting

Tuberculosis (TB) diagnosis and treatment requires patients to have multiple encounters with health care systems and the different stakeholders who play a role in curing them to coordinate their efforts. To optimize this process, high-quality, readily available data are required. Data systems to facilitate these linkages are a neglected priority which, if weak, fundamentally undermine TB control interventions.

Objective

To describe lessons learnt from the use of programmatic data for TB patient care and research.

Design

We did a survey of researcher and clinical provider experiences with information systems and developed a tiered approach to addressing frequently reported barriers to high-quality care.

Results

Unreliable linkages, incomplete data, lack of a reliable unique patient identifier, and lack of data management expertise were the most important data-related barriers to high-quality patient care and research. We propose the creation of health service delivery environments that facilitate, prioritize, and evaluate high-quality data entry during patient or specimen registration.

Conclusion

An integrated approach, focused on high-quality data, and centered on unique patient identification will form the foundation for linkages across health systems that reduce patient management errors, bolster surveillance, and enhance the quality of research based on programmatic data.

Adapting the Structured Operational Research Training Initiative (SORT IT) for high-income countries

SORT IT (Structured Operational Research Training InitiaTive) is a successful capacity building programme started 10 years ago to develop operational research skills in low- and middle-income countries. Public Health England (PHE) aims to embed a culture of research in front-line staff, and SORT IT has been adapted to train frontline health protection professionals at PHE North West (PHE NW) to collate, analyse and interpret routinely collected data for evidence-informed decision-making. Six participants from the PHE NW Health Protection team were selected to attend a two-module course in Liverpool, UK, in May and in November 2018. Five participants finished the course with completed papers on characteristics and burden of influenza-like illness in elderly care homes (two papers), use of dried blood spots for blood-borne virus screening in prisons, uptake of meningococcal ACWY (groups A, C, W-135 and Y) vaccine in schoolchildren and fires in waste management sites. The SORT IT course led to 1) new evidence being produced to inform health protection practice, and 2) agreement within PHE NW to continue SORT IT with two courses per year, and 3) showed how a research capacity building initiative for low- and middle-income countries that combines 'learning with doing' can be adapted and used in a high-income country.

How Can Operational Research Help to Eliminate Tuberculosis in the Asia Pacific Region?

Broad multi-sectoral action is required to end the tuberculosis (TB) epidemic by 2030 and this includes National TB Programmes (NTPs) fully delivering on quality-assured diagnostic, treatment and preventive services. Large implementation gaps currently exist in the delivery of these services, which can be addressed and closed through the discipline of operational research. This paper outlines the TB disease burden and disease-control programme implementation gaps in the Asia-Pacific region; discusses the key priority areas in diagnosis, treatment and prevention where operational research can be used to make a difference; and finally provides guidance about how best to embed operational research within a TB programme setting. Achieving internationally agreed milestones and targets for case finding and treatment requires the NTP to be streamlined and efficient in the delivery of its services, and operational research provides the necessary evidence-based knowledge and support to allow this to happen.

Blended SORT-IT for operational research capacity building: the model, its successes and challenges

The Structured Operational Research Training Initiative (SORT-IT) has been shown to be very effective in strengthening capacity for conducting operational research, publishing in scientific journals and fostering policy and practice change. The ‘classic’ model includes three face-to-face modules during which, respectively, a study protocol, a data analysis plan, and a manuscript are elaborated. Meanwhile, the lectures of the SORT-IT are available online as YouTube videos. Given the availability of this online material and the experiences with online mentorship of the faculty, we piloted a first blended distance/residential SORT-IT. To inform future implementers of our experience with blended operational research courses, we summarize the model, successes, and challenges of this approach in this perspective paper. The blended SORT-IT consisted of an online phase, covering modules 1 and 2, followed by a face-to-face writing module 3. Four out of six participants successfully completed the course, and submitted a manuscript to a peer-reviewed journal within four weeks of completing module 3. A blended approach may make the SORT-IT course more accessible to future participants and may favour the adoption of the course by other institutions, such as national Ministries of Health.

Does the Structured Operational Research and Training Initiative (SORT IT) continue to influence health policy and/or practice?

Background: The Structured Operational Research and Training Initiative (SORT IT) is a successful model of integrated operational research and capacity building with about 90% of participants completing the training and publishing in scientific journals.

Objective: The study aims at assessing the influence of research papers from six SORT IT courses conducted between April 2014 and January 2015 on policy and/or practice.

Methods: This was a cross-sectional mixed-method study involving e-mail based, self-administered questionnaires sent to course participants coupled with telephone/Skype/in-person responses from participants, senior facilitators and local co-authors of course papers. A descriptive content analysis was performed to generate themes.

Results: Of 71 participants, 67 (94%) completed the course. A total of 67 papers (original research) were submitted for publication, of which 61 (91%) were published or were in press at the censor date (31 December 2016). Among the 67 eligible participants, 65 (97%) responded to the questionnaire. Of the latter, 43 (66%) research papers were self-reported to have contributed to a change in policy and/or practice by the course participants: 38 to a change in government policy or practice (26 at the national level, six at the subnational level and six at the local/hospital level); four to a change in organisational policy or practice; and one study fostered global policy development.

Conclusion: Nearly two-thirds of SORT IT course papers contributed to a change in policy and/or practice as reported by the participants. Identifying the actual linkage of research to policy/practice change requires more robust methodology, in-depth assessment and independent validation of the reported change with all concerned stakeholders.

Operational research within a Global Fund supported tuberculosis project in India: why, how and its contribution towards change in policy and practice

BACKGROUND

The Global Fund encourages operational research (OR) in all its grants; however very few reports describe this aspect. In India, Project Axshya was supported by a Global Fund grant to improve the reach and visibility of the government Tuberculosis (TB) services among marginalised and vulnerable communities. OR was incorporated to build research capacity of professionals working with the national TB programme and to generate evidence to inform policies and practices.

OBJECTIVES

To describe how Project Axshya facilitated building OR capacity within the country, helped in addressing several TB control priority research questions, documented project activities and their outcomes, and influenced policy and practice.

METHODS

From September 2010 to September 2016, three key OR-related activities were implemented. First, practical output-oriented modular training courses were conducted (n = 3) to build research capacity of personnel involved in the TB programme, co-facilitated by The Union, in collaboration with the national TB programme, WHO country office and CDC, Atlanta. Second, two large-scale Knowledge, Attitude and Practice (KAP) surveys were conducted at baseline and mid-project to assess the changes pertaining to TB knowledge, attitudes and practices among the general population, TB patients and health care providers over the project period. Third, studies were conducted to describe the project's core activities and outcomes.

RESULTS

In the training courses, 44 participant teams were supported to develop research protocols on topics of national priority, resulting in 28 peer-reviewed scientific publications. The KAP surveys and description of project activities resulted in 14 peer-reviewed publications. Of the published papers at least 12 have influenced change in policy or practice.

CONCLUSIONS

OR within a Global Fund supported TB project has resulted in building OR capacity, facilitating research in areas of national priority and influencing policy and practice. We believe this experience will provide guidance for undertaking OR in Global Fund projects.

Adapting operational research training to the Rwandan context: the Intermediate Operational Research Training programme

Background: Promoting national health research agendas in low- and middle-income countries (LMICs) requires adequate numbers of individuals with skills to initiate and conduct research. Recently, non-governmental organizations (NGOs) have joined research capacity building efforts to increase research leadership by LMIC nationals. Partners In Health, an international NGO operating in Rwanda, implemented its first Intermediate Operational Research Training (IORT) course to cultivate Rwandan research talent and generate evidence to improve health care delivery.

Objective: This paper describes the implementation of IORT to share experiences with other organizations interested in developing similar training programmes.

Methods: The Intermediate Operational Research Training utilized a deliverable-driven training model, using learning-by-doing pedagogy with intensive hands-on mentorship to build research skills from protocol development to scientific publication. The course had short (two-day) but frequent training sessions (seven sessions over eight months). Trainees were clinical and programme staff working at the district level who were paired to jointly lead a research project.

Results: Of 10 trainees admitted to the course from a pool of 24 applicants, nine trainees completed the course with five research projects published in peer-reviewed journals. Strengths of the course included supportive national and institutional research capacity guidelines, building from a successful training model, and trainee commitment. Challenges included delays in ethical review, high mentorship workload of up to 250 hours of practicum mentorship, lack of access to literature in subscription journals and high costs of open access publication.

Conclusions: The IORT course was an effective way to support the district-based government and NGO staff in gaining research skills, as well as answering research questions relevant to health service delivery at district hospitals. Other NGOs should build on successful programmes while adapting course elements to address context-specific challenges. Mentorship for LMIC trainees is critical for effectiveness of research capacity building initiatives.

Practical challenges and solutions to TB control in a lower-middle-income country: experiences from Mongolia

The challenges of tuberculosis (TB) control vary significantly between countries with a low and high incidence of TB. A major focus of TB control efforts in countries with a low incidence of TB is on treatment of latent TB infection in high-risk groups [1] including contacts of patients with active TB [2], patients with medical conditions that increase the risk of TB reactivation [3–5] and migrants from settings with a high incidence of TB [6, 7].

Operational research, community initiatives and NGOs play an important role in improving TB care in low- and middle-income countrieshttp://ow.ly/wpjO30kA3fu

Addressing the under-reporting of adverse drug reactions in public health programs controlling HIV/AIDS, Tuberculosis and Malaria: A prospective cohort study

BACKGROUND

Adverse Drug Reactions (ADRs) are a major clinical and public health problem world-wide. The prompt reporting of suspected ADRs to regulatory authorities to activate drug safety surveillance and regulation appears to be the most pragmatic measure for addressing the problem. This paper evaluated a pharmacovigilance (PV) training model that was designed to improve the reporting of ADRs in public health programs treating the Human Immunodeficiency Virus (HIV), Tuberculosis (TB) and Malaria.

METHODS

A Structured Pharmacovigilance and Training Initiative (SPHAR-TI) model based on the World Health Organization accredited Structured Operational Research and Training Initiative (SOR-IT) model was designed and implemented over a period of 12 months. A prospective cohort design was deployed to evaluate the outcomes of the model. The primary outcomes were knowledge gained and Individual Case Safety Reports (ICSR) (completed adverse drug reactions monitoring forms) submitted, while the secondary outcomes were facility based Pharmacovigilance Committees activated and health facility healthcare workers trained by the participants.

RESULTS

Fifty-five (98%) participants were trained and followed up for 12 months. More than three quarter of the participants have never received training on pharmacovigilance prior to the course. Yet, a significant gain in knowledge was observed after the participants completed a comprehensive training for six days. In only seven months, 3000 ICSRs (with 100% completeness) were submitted, 2,937 facility based healthcare workers trained and 46 Pharmacovigilance Committees activated by the participants. Overall, a 273% increase in ICSRs submission to the National Agency for Food and Drug Administration and Control (NAFDAC) was observed.

CONCLUSION

Participants gained knowledge, which tended to increase the reporting of ADRs. The SPHAR-TI model could be an option for strengthening the continuous reporting of ADRs in public health programs in resource limited settings.

Building the capacity of public health programmes to become data rich, information rich and action rich

Good quality, timely data are the cornerstone of health systems, but in many countries these data are not used for evidence-informed decision making and/or for improving public health. The SORT IT (Structured Operational Research and Training Initiative) model has, over 8 years, trained health workers in low- and middle-income countries to use data to answer important public health questions by taking research projects through to completion and publication in national or international journals. The D2P (data to policy) training initiative is relatively new, and it teaches health workers how to apply 'decision analysis' and develop policy briefs for policy makers: this includes description of a problem and the available evidence, quantitative comparisons of policy options that take into account predicted health and economic impacts, and political and feasibility assessments. Policies adopted from evidence-based information generated through the SORT IT and D2P approaches can be evaluated to assess their impact, and the cycle repeated to identify and resolve new public health problems. Ministries of Health could benefit from this twin-training approach to make themselves 'data rich, information rich and action rich', and thereby use routinely collected data in a synergistic manner to improve public health policy making and health care delivery.

Research capacity building integrated into PHIT projects: leveraging research and research funding to build national capacity

Background

Inadequate research capacity impedes the development of evidence-based health programming in sub-Saharan Africa. However, funding for research capacity building (RCB) is often insufficient and restricted, limiting institutions’ ability to address current RCB needs. The Doris Duke Charitable Foundation’s African Health Initiative (AHI) funded Population Health Implementation and Training (PHIT) partnership projects in five African countries (Ghana, Mozambique, Rwanda, Tanzania and Zambia) to implement health systems strengthening initiatives inclusive of RCB.

Methods

Using Cooke’s framework for RCB, RCB activity leaders from each country reported on RCB priorities, activities, program metrics, ongoing challenges and solutions. These were synthesized by the authorship team, identifying common challenges and lessons learned.

Results

For most countries, each of the RCB domains from Cooke’s framework was a high priority. In about half of the countries, domain specific activities happened prior to PHIT. During PHIT, specific RCB activities varied across countries. However, all five countries used AHI funding to improve research administrative support and infrastructure, implement research trainings and support mentorship activities and research dissemination. While outcomes data were not systematically collected, countries reported holding 54 research trainings, forming 56 mentor-mentee relationships, training 201 individuals and awarding 22 PhD and Masters-level scholarships. Over the 5 years, 116 manuscripts were developed. Of the 59 manuscripts published in peer-reviewed journals, 29 had national first authors and 18 had national senior authors. Trainees participated in 99 conferences and projects held 37 forums with policy makers to facilitate research translation into policy.

Conclusion

All five PHIT projects strongly reported an increase in RCB activities and commended the Doris Duke Charitable Foundation for prioritizing RCB, funding RCB at adequate levels and time frames and for allowing flexibility in funding so that each project could implement activities according to their trainees’ needs. As a result, many common challenges for RCB, such as adequate resources and local and international institutional support, were not identified as major challenges for these projects. Overall recommendations are for funders to provide adequate and flexible funding for RCB activities and for institutions to offer a spectrum of RCB activities to enable continued growth, provide adequate mentorship for trainees and systematically monitor RCB activities.

Electronic supplementary material

The online version of this article (10.1186/s12913-017-2657-6) contains supplementary material, which is available to authorized users.

Operational research within the national tuberculosis control programme in Benin

OBJECTIVE

To document whether the placement of operational research (OR) fellows within disease control programmes in low and middle income countries leads to the implementation of operational research and improvements in policy and practice.

RESULT

In 2012, an OR fellow was placed within the National TB Programme, Benin, to strengthen the implementation of operational research. From 2012 to 2015, eight OR projects were implemented, of which three contributed to changes in programme practice and five provided information which was not previously available from quarterly/annual reports. Two of these projects-one on the burden and treatment outcomes of childhood TB and one on tracing patients who had discontinued treatment-are discussed in more detail. OR should be strongly encouraged within national TB programme settings and an OR fellow facilitates this process.

Operational and implementation research within Global Fund to Fight AIDS, Tuberculosis and Malaria grants: a situation analysis in six countries

Background

Operational/implementation research (OR/IR) is a key activity to improve disease control programme performance. We assessed the extent to which malaria and tuberculosis (TB) grants from the Global Fund to Fight AIDS, Tuberculosis and Malaria (“Global Fund”) include support for OR/IR, and discuss the implications of the current Global Fund operating mechanisms for OR/IR support.

Methods

The situation analysis focussed on malaria and TB, while HIV was excluded. Stakeholder interviews were conducted at the Global Fund secretariat and in six purposefully selected high disease burden countries, namely the Democratic Republic of the Congo, Ethiopia, India, Indonesia, Myanmar and Zimbabwe. Interviewed in-country stakeholders included the relevant disease control programme managers, project implementation partners, representatives from international organisations with a stake in global health, academic and governmental research institutions, and other relevant individuals such as members of the country coordination mechanism. Additionally, documentation of grants and OR/IR obtained from the Global Fund was reviewed.

Results

The Global Fund provides substantial resources for malaria and TB surveys, and supports OR/IR if such support is requested and the application is well justified. We observed considerable variations from one country to another and between programmes with regards to need, demand, absorption capacity and funding for OR/IR related to malaria and TB. Important determinants for the extent of such funding are the involvement of national research coordination bodies, established research agendas and priorities, human and technical research capacity, and involvement of relevant stakeholders in concept note development. Efforts to disseminate OR/IR findings were generally weak, and the Global Fund does not maintain a central OR/IR database. When faced with a need to choose between procurement of commodities for disease control and supporting research, countries tend to seek research funding from other donors. The Global Fund is expected to issue more specific guidance on the conditions under which it supports OR/IR, and to adapt administrative procedures to facilitate research.

Conclusions

The importance of OR/IR for optimising disease control programmes is generally accepted but countries vary in their capacity to demand and implement studies. Countries expect guidance on OR/IR from the Global Fund. Administrative procedures specifically related to the budget planning should be modified to facilitate ad-hoc OR/IR funding. More generally, several countries expressed a need to strengthen capacity for planning, negotiating and implementing research.

Electronic supplementary material

The online version of this article (doi:10.1186/s12992-017-0245-5) contains supplementary material, which is available to authorized users.

Social multiplier effects: academics' and practitioners' perspective on the benefits of a tuberculosis operational research capacity-building program in Indonesia

BACKGROUND

The Tuberculosis Operational Research Group (TORG) implemented a capacity-building model involving academics and practitioners (i.e. clinicians or program staff) in an operational research (OR) team in Indonesia.

OBJECTIVE

This study explored academics' and practitioners' perspectives regarding the benefits of participating in a tuberculosis (TB) OR capacity-building program in Indonesia.

METHODS

We conducted a qualitative study involving in-depth interviews with 36 academics and 23 practitioners undertaking the TORG capacity-building program. We asked open-ended questions about their experience of the program. Data were analyzed via content analysis.

RESULTS

The findings demonstrated the social multiplier effects of the OR capacity-building program. Both academics and practitioners reported perceived improvements in research knowledge, skills, and experience, and described additional individual- and institutional-level benefits. The individual-level benefits level included improvements in understanding of the TB program, motivation for research and self-satisfaction, the development/enhancement of individual networking, receipt of recognition, and new opportunities. The additional benefits reported at an institutional level included improvement in research curricula, in-house training, and program management and the development/enhancement of institutional partnerships.

CONCLUSIONS

The program improved not only individuals' capacity for conducting OR but also the quality of the TB program management and public health education. OR should be included in research methodology curricula for postgraduate public health/disease control programs. The capacity-building model, in which academics and program staff collaborated within an OR team, should be promoted.

The effects of placing an operational research fellow within the Viet Nam National Tuberculosis Programme

In April 2009, an operational research fellow was placed within the Viet Nam National Tuberculosis Control Programme (NTP). Over the 6 years from 2010 to 2015, the OR fellow co-authored 21 tuberculosis research papers (as principal author in 15 [71%]). This constituted 23% of the 91 tuberculosis papers published in Viet Nam during this period. Of the 21 published papers, 16 (76%) contributed to changes in policy (n = 8) and practice (n = 8), and these in turn improved programme performance. Many papers also contributed important evidence for better programme planning. Highly motivated OR fellows embedded within NTPs can facilitate high-quality research and research uptake.

Building Global Capacity for Conducting Operational Research Using the SORT IT Model: Where and Who?

Setting

Research capacity is weakest in low and middle-income countries (LMICs) where operational research is highly relevant and needed. Structured Operational Research and Training Initiative (SORT IT) courses have been developed to train participants to conduct and publish operational research and influence policy and practice. Twenty courses were completed in Asia, Africa, Europe and the South Pacific between 2009 and 2014.

Objectives

In the 20 completed SORT IT courses, to assess where the research was conducted, who was trained, who became facilitators in subsequent courses and course outcomes.

Design

A cohort study of completed SORT IT courses

Results

There were 236 participants (41% female) including 64 nationalities who conducted research in 59 countries, mostly from Asia and Africa (mean course duration = 9.7 months). Most participants (68%) were from government health programs and non-governmental agencies. A total of 213(90%) participants completed all milestones successfully with 41(19%) becoming subsequent course facilitators, 88% of whom were from LMICs. Of 228 manuscripts submitted to scientific journals, 197(86%) were either published or in press; in 86%, the principal investigator (first author) was a LMIC national. Papers were published in 23 scientific journals (impact factor 0.5–4.4) and covered 21 disease categories (median publication time = 5.7 months). Published papers (186) had 94,794 cumulative article views/downloads. Article views/downloads for immediate open access articles were double those from closed access journals.

Conclusion

The SORT IT model has been effective in training personnel to produce relevant operational research in LMICs. It merits continued commitment and support for further scale-up and development.

Does research through Structured Operational Research and Training (SORT IT) courses impact policy and practice?

SETTING

Structured Operational Research and Training Initiative (SORT IT) courses are well known for their output, with nearly 90% of participants completing the course and publishing in scientific journals.

OBJECTIVE

We assessed the impact of research papers on policy and practice that resulted from six SORT IT courses initiated between July 2012 and March 2013.

DESIGN

This was a cross-sectional study involving e-mail-based, self-administered questionnaires and telephone/skype/in-person responses from first and/or senior co-authors of course papers. A descriptive content analysis of the responses was performed and categorised into themes.

RESULTS

Of 72 participants, 63 (88%) completed the course. Course output included 81 submitted papers, of which 76 (94%) were published. Of the 81 papers assessed, 45 (55%) contributed to a change in policy and/or practice: 29 contributed to government policy/practice change (20 at national, 4 at subnational and 5 at hospital level), 11 to non-government organisational policy change and 5 to reinforcing existing policy. The changes ranged from modifications of monitoring and evaluation tools, to redrafting of national guidelines, to scaling up existing policies.

CONCLUSION

More than half of the SORT IT course papers contributed to a change in policy and/or practice. Future assessments should include more robust and independent verification of the reported change(s) with all stakeholders.

Research output after participants complete a Structured Operational Research and Training (SORT IT) course

Eighteen months after successfully completing one of six Structured Operational Research and Training Initiative (SORT IT) courses, e-mail questionnaires assessing post-course research output were returned by 63 participants (100% response rate). Thirty-two (51%) participants had completed new research projects, 24 (38%) had published papers, 28 (44%) had presented abstracts at conferences, 15 (24%) had facilitated at further OR courses, and 21 (33%) had reviewed scientific papers. Seven (11%) had secured further research funding and 22 (35%) stated that their institutions were involved in implementation or capacity building in operational research. Significant research output continues beyond course completion, further endorsing the value of the SORT IT model.

Drug-resistant tuberculosis in Eastern Europe: challenges and ways forward

Encouragingly, global rates of new tuberculosis (TB) cases have been falling since 2005, in line with the Millennium Development Goal targets; however, cases of multidrug-resistant (MDR-) and extensively drug-resistant TB (XDR-TB) have been increasing. Fifteen of the world's 27 high MDR- and XDR-TB burden countries are in the World Health Organization (WHO) European Region, of which 10 are in Eastern Europe (including Baltic and Caucasus countries). To address the MDR- and XDR-TB situation in the WHO European Region, a Consolidated Action Plan to Prevent and Combat M/XDR-TB (2011-2015) was developed for all 53 Member States and implemented in 2011. Since the implementation of the Action Plan, the proportion of MDR-TB appears largely to have levelled off among bacteriologically confirmed TB cases in high-burden countries with universal or near universal (>95%) first-line drug susceptibility testing (DST). The treatment success rate, however, continues to decrease. A contributing factor is the substantial proportion of MDR-TB cases that are additionally resistant to either a fluoroquinolone, a second-line injectable agent or both (XDR-TB); high-burden country proportions range from 12.6% to 80.4%. Proportions of XDR-TB range from 5% to 24.8%. Despite much progress in Eastern Europe, critical challenges remain as regards access to appropriate treatment regimens; patient hospitalisation; scale-up of laboratory capacity, including the use of rapid diagnostics and second-line DST; vulnerable populations; human resources; and financing. Solutions to these challenges are aligned with the Post-2015 Global TB strategy. As a first step, the global strategy should be adapted at regional and country levels to serve as a framework for immediate actions as well as longer-term ways forward.

Promoting operational research through fellowships: a case study from the South-East Asia Union Office

In 2009, the International Union Against Tuberculosis and Lung Disease (The Union) and Médecins Sans Frontières (MSF) jointly developed a new paradigm for operational research (OR) capacity building and started a new process of appointing and supporting OR fellows in the field. This case study describes 1) the appointment of two OR fellows in The Union South-East Asia Office (USEA), New Delhi, India; 2) how this led to the development of an OR unit in that organisation; 3) achievements over the 5-year period from June 2009 to June 2014; and 4) challenges and lessons learnt. In June 2009, the first OR fellow in India was appointed on a full-time basis and the second was appointed in February 2012-both had limited previous experience in OR. From 2009 to 2014, annual research output and capacity building initiatives rose exponentially, and included 1) facilitation at 61 OR training courses/modules; 2) publication of 96 papers, several of which had a lasting impact on national policy and practice; 3) providing technical assistance in promoting OR; 4) building the capacity of medical college professionals in data management; 5) support to programme staff for disseminating their research findings; 6) reviewing 28 scientific papers for national or international peer-reviewed journals; and 7) developing 45 scientific abstracts for presentation at national and international conferences. The reasons for this success are highlighted along with ongoing challenges. This experience from India provides good evidence for promoting similar models elsewhere.

Operational research capacity building using 'The Union/MSF' model: adapting as we go along

Background

We have conducted 23 operational research (OR) courses since 2009, based on ‘The Union/ Médecins Sans Frontières (MSF)’ model, now popularly known as SORT-IT (Structured Operational Research and Training Initiative) model - wherein participants are mentored through the whole research process from protocol development (module 1) to data analysis (module 2) to publication (module 3) over a period of 9–12 months. We have faced a number of challenges including shortage of time, especially for data analysis and interpretation, and a heavy mentorship burden on limited numbers of experienced facilitators. To address these challenges, we have made several modifications to the structure of the OR course. In this article, we describe the revised structure and our experience (successes and challenges) of implementing it in Asia in 2013.

Findings

The key changes introduced included extending the duration of the course modules (by a day each in module 1 and 2 and by three days in module 3), increasing the numbers of facilitators and standardizing milestones related to data entry and analysis. We successfully implemented this revised structure in the second Asian OR Course held in Nepal in 2013. Eleven of twelve participants successfully completed all the milestones and submitted 13 scientific manuscripts (two participants completed two projects) to international peer-reviewed journals. Though, this posed two challenges – increased costs and increased time away for faculty and participants.

Conclusions

The revised structure of ‘The Union/MSF’ model of OR capacity building addressed previous issues of insufficient time and overburdened mentors and we intend to continue with this model for future courses.

Embedding operational research into national disease control programme: lessons from 10 years of experience in Indonesia

There is growing recognition that operational research (OR) should be embedded into national disease control programmes. However, much of the current OR capacity building schemes are still predominantly driven by international agencies with limited integration into national disease control programmes. We demonstrated that it is possible to achieve a more sustainable capacity building effort across the country by establishing an OR group within the national tuberculosis (TB) control programme in Indonesia. Key challenges identified include long-term financial support, limited number of scientific publications, and difficulties in documenting impact on programmatic performance. External evaluation has expressed concerns in regard to utilisation of OR in policy making. Efforts to address this concern have been introduced recently and led to indications of increased utilisation of research evidence in policy making by the national TB control programme. Embedding OR in national disease control programmes is key in establishing an evidence-based disease control programme.