Open access for operational research publications from low- and middle-income countries: who pays?

Quality, Equity and Partnerships in Mixed Methods and Qualitative Research during Seven Years of Implementing the Structured Operational Research and Training Initiative in 18 Countries

Introduction: Qualitative studies are often inadequately reported, making it difficult to judge their appropriateness for decision making in public health. We assessed the publication characteristics and quality of reporting of qualitative and mixed-method studies from the Structured Operational Research and Training Initiative (SORT IT), a global partnership for operational research capacity building. Methods: A cross-sectional analysis of publications to assess the qualitative component using an adapted version of the Consolidated Criteria for Reporting Qualitative Research (COREQ) checklist. Results: In 67 publications involving 18 countries, 32 journals and 13 public health themes, 55 were mixed-methods studies and 12 were qualitative studies. First authorship from low-and-middle-income (LMIC) countries was present in 64 (96%), LMIC last authorship in 55 (82%), and female first authorship in 30 (45%). The mean LMIC institutions represented per publication was five (range 1–11). Sixty-three (94%) publications were open access. Reporting quality was graded as ‘good’ to ‘excellent’ in 60 (89%) publications, ‘fair’ in five (8%) and ‘poor’ in two (3%). Conclusion: Most SORT IT publications adhered to COREQ standards, while supporting gender equity in authorship and the promotion of LMIC research leadership. SORT IT plays an important role in ensuring quality of evidence for decision making to improve public health.

Quality, Equity and Utility of Observational Studies during 10 Years of Implementing the Structured Operational Research and Training Initiative in 72 Countries

Introduction: Observational studies are often inadequately reported, making it difficult to assess their validity and generalizability and judge whether they can be included in systematic reviews. We assessed the publication characteristics and quality of reporting of observational studies generated by the Structured Operational Research and Training Initiative (SORT IT). Methods: A cross-sectional analysis of original publications from SORT IT courses. SORT IT is a global partnership-based initiative aimed at building sustainable capacity for conducting operational research according to country priorities and using the generated evidence for informed decision-making to improve public health. Reporting quality was independently assessed using an adapted version of ‘Strengthening the Reporting of Observational Studies in Epidemiology’ (STROBE) checklist. Results: In 392 publications, involving 72 countries, 50 journals, 28 publishers and 24 disease domains, low- and middle-income countries (LMICs) first authorship was seen in 370 (94%) and LMIC last authorship in 214 (55%). Publications involved LMIC-LMIC collaboration in 90% and high-income-country-LMIC collaboration in 87%. The majority (89%) of publications were in immediate open access journals. A total of 346 (88.3%) publications achieved a STROBE reporting quality score of >85% (excellent), 41 (10.4%) achieved a score of 76–85% (good) and 5 (1.3%) a score of 65–75% (fair). Conclusion: The majority of publications from SORT IT adhere to STROBE guidelines, while also ensuring LMIC equity and collaborative partnerships. SORT IT is, thus, playing an important role in ensuring high-quality reporting of evidence for informed decision-making in public health.

NGOs' experiences of navigating the open access landscape

Grant-led consortia working in the global development sector rely on the input of local and national non-government organisations in low- and middle-income countries. However, the open access mandates and mechanisms embedded within grants and promoted by funders and publishers are designed almost exclusively with large universities and research institutions in mind. Experiences from the consortium of health research non-government organisations comprising the Communicable Diseases Health Service Delivery research programme show that implementing open access mandates is not as simple or frictionless as it initially appears.

Building Global Capacity for Conducting Operational Research Using the SORT IT Model: Where and Who?

Setting

Research capacity is weakest in low and middle-income countries (LMICs) where operational research is highly relevant and needed. Structured Operational Research and Training Initiative (SORT IT) courses have been developed to train participants to conduct and publish operational research and influence policy and practice. Twenty courses were completed in Asia, Africa, Europe and the South Pacific between 2009 and 2014.

Objectives

In the 20 completed SORT IT courses, to assess where the research was conducted, who was trained, who became facilitators in subsequent courses and course outcomes.

Design

A cohort study of completed SORT IT courses

Results

There were 236 participants (41% female) including 64 nationalities who conducted research in 59 countries, mostly from Asia and Africa (mean course duration = 9.7 months). Most participants (68%) were from government health programs and non-governmental agencies. A total of 213(90%) participants completed all milestones successfully with 41(19%) becoming subsequent course facilitators, 88% of whom were from LMICs. Of 228 manuscripts submitted to scientific journals, 197(86%) were either published or in press; in 86%, the principal investigator (first author) was a LMIC national. Papers were published in 23 scientific journals (impact factor 0.5–4.4) and covered 21 disease categories (median publication time = 5.7 months). Published papers (186) had 94,794 cumulative article views/downloads. Article views/downloads for immediate open access articles were double those from closed access journals.

Conclusion

The SORT IT model has been effective in training personnel to produce relevant operational research in LMICs. It merits continued commitment and support for further scale-up and development.

Does research through Structured Operational Research and Training (SORT IT) courses impact policy and practice?

SETTING

Structured Operational Research and Training Initiative (SORT IT) courses are well known for their output, with nearly 90% of participants completing the course and publishing in scientific journals.

OBJECTIVE

We assessed the impact of research papers on policy and practice that resulted from six SORT IT courses initiated between July 2012 and March 2013.

DESIGN

This was a cross-sectional study involving e-mail-based, self-administered questionnaires and telephone/skype/in-person responses from first and/or senior co-authors of course papers. A descriptive content analysis of the responses was performed and categorised into themes.

RESULTS

Of 72 participants, 63 (88%) completed the course. Course output included 81 submitted papers, of which 76 (94%) were published. Of the 81 papers assessed, 45 (55%) contributed to a change in policy and/or practice: 29 contributed to government policy/practice change (20 at national, 4 at subnational and 5 at hospital level), 11 to non-government organisational policy change and 5 to reinforcing existing policy. The changes ranged from modifications of monitoring and evaluation tools, to redrafting of national guidelines, to scaling up existing policies.

CONCLUSION

More than half of the SORT IT course papers contributed to a change in policy and/or practice. Future assessments should include more robust and independent verification of the reported change(s) with all stakeholders.