Resources supporting trustworthy, rapid and equitable evidence synthesis and guideline development: results from the COVID-19 evidence network to support decision-making (COVID-END)

Methods resources for authors new to conducting systematic reviews with network meta-analysis: a scoping review

OBJECTIVES

To support systematic reviewers new to network meta-analysis (NMA), we (1) identified and described published methods resources for conducting systematic reviews (SRs) with NMA of randomized controlled trials (RCTs); (2) mapped the resources to the typical steps for conducting NMAs; and (3) identified NMA guidance gaps.

STUDY DESIGN AND SETTING

We performed a scoping review and comprehensively searched major databases, gray literature sources, and websites for methods resources that described or informed any steps in conducting SRs with NMA to guide review authors, particularly those new to the method. Title, abstract, and full-text screening were conducted independently in duplicate using Covidence. NMA resources were narratively described and tabulated by guidance type, review steps, and topic and mapped to the steps of conducting a systematic review with NMA.

RESULTS

We considered documents in the 2011-2025 date range and included 90; the majority (39%) were published between 2021 and 2025. Most were classified as guides/guidance (29%), methods/methodology (22%), or reviews (27%). We found that the rate of published guidance around most steps of NMA increased or remained stable over time. Most resources for software were guidance for R and Stata. Guidance documents on assumptions and certainty of evidence were abundant (in excess of 13 documents per topic), whereas fewer guidance documents were available on elements of protocol development and presentation of results. We mapped methods resources across steps in conducting SRs with NMA, identifying areas with sparse guidance.

CONCLUSION

This scoping review provides a comprehensive reference for conducting SRs using NMA, especially for those new to the methods. It highlights the significant increase in guidance since 2011, particularly on evidence certainty and NMA assumptions, and the availability of user-friendly web tools. Future work should focus on advanced NMA guidance and decision tools to aid reviewers in further navigating NMA complexities.

Addressing evidence needs during health crises in the province of Quebec (Canada): a proposed action plan for rapid evidence synthesis

BACKGROUND

The COVID-19 pandemic necessitated the rapid availability of evidence to respond in a timely manner to the needs of practice settings and decision-makers in health and social services. Now that the pandemic is over, it is time to put in place actions to improve the capacity of systems to meet knowledge needs in a situation of crisis. The main objective of this project was thus to develop an action plan for the rapid syntheses of evidence in times of health crisis in Quebec (Canada).

METHODS

We conducted a three-phase collaborative research project. First, we carried out a survey with producers and users of rapid evidence syntheses (n = 40) and a group interview with three patient partners to prioritize courses of action. In parallel, we performed a systematic mapping of the literature to identify rapid evidence synthesis initiatives developed during the pandemic. The results of these two phases were used in a third phase, in which we organized a deliberative workshop with 26 producers and users of rapid evidence syntheses to identifying strategies to operationalize priorities. The data collected at each phase were compared to identify common courses of action and integrated to develop an action plan.

RESULTS

A total of 14 specific actions structured into four main axes were identified over the three phases. In axis 1, actions on raising awareness of the importance of evidence-informed decision-making among stakeholders in the health and social services network are presented. Axis 2 includes actions to promote optimal collaboration of key stakeholders in the production of rapid evidence synthesis to support decision-making. Actions advocating the use of a variety of rapid evidence synthesis methodologies known to be effective in supporting decision-making are presented in axis 3. Finally, axis 4 is about actions on the use of effective knowledge translation strategies to promote the use of rapid evidence synthesis products to support decision-making.

CONCLUSIONS

This project led to the development of a collective action plan aimed at preparing the Quebec ecosystem and other similar jurisdictions to meet knowledge needs more effectively in times of health emergency. The implementation of this plan and its evaluation will enable us to continue to fine-tune it.

Evaluation of a strategic academic-government partnership to advance COVID-19 clinical practice guidelines access and uptake in South Africa

INTRODUCTION

Academic-government partnerships are important to advance timely, responsive and relevant evidence for decision-making (policy, guideline, law and regulation) deliberations. Deliberate and strategic integrated knowledge translation (KT) approaches within such partnerships have been shown to facilitate evidence-informed decision-making (EIDM). We used Cochrane's KT Framework to map and analyse COVID-19 response activities instituted by a strategic academic-government partnership to support EIDM during the COVID-19 pandemic in South Africa.

METHODS

We used Cochrane's KT Framework to map and analyse COVID-19 response activities instituted by a strategic academic-government partnership to support EIDM during the COVID-19 pandemic in South Africa. The COVID-19 response activities included coproducing rapid therapeutics reviews, engaging stakeholders with review evidence, packaging and disseminating review products, facilitating access to rapid reviews for evidence users and adapting partnership processes for rapid review production.

RESULTS

This paper highlights the importance of (a) authentic partnerships between evidence producers and users (motivated by context-specific goals, trust and relationships); (b) intentional and systematic stakeholder engagement to promote the rapid exchange of information; (c) using tailored, responsive and relevant KT to promote the uptake of evidence and (d) monitoring and evaluating the implementation of KT to identify lessons learnt and adaptation of KT approaches.

CONCLUSION

In responding to future emergencies, a comprehensive KT strategy, including the expertise of KT practitioners and science communicators to make evidence and guideline recommendations accessible, should be embedded. Additionally, streamlining bureaucratic processes for approving and communicating information; identifying and addressing decision-maker capacity needs; engaging a range of stakeholders and integrating KT in usual decision-making processes, is recommended. Adequate investment by governments is needed for sustaining KT approaches that can enhance EIDM for improving public health outcomes.

Building sustainable capacity to adopt, adapt or develop child health guidelines, Malawi, Nigeria and South Africa

Problem

Many national child health guidelines in Malawi, Nigeria and South Africa are outdated and score poorly on rigorous methods and stakeholder participation.

Approach

In line with the World Health Organization's (WHO) emphasis on local guideline contextualization, the Global Evidence-Local Adaptation (GELA) project supported multistakeholder processes to adapt evidence-informed recommendations for child health in Malawi, Nigeria and South Africa. The GELA project team convened national steering groups, which conducted structured, iterative priority-setting exercises to identify priority topics. We identified appropriate source guidelines by systematically searching and screening available guidelines. We then matched recommendations in potential source guidelines to the relevant questions, and assessed the guidelines for timeliness and quality. Drawing on WHO's guideline process, we applied the GRADE-ADOLOPMENT process to develop contextualized recommendations from existing guidelines. If no source guideline or reviews were identified, we conducted new evidence syntheses.

Local setting

Malawi, Nigeria and South Africa are countries with varying health priorities and systems, all transitioning to universal health coverage. Guideline structures differ between countries, with processes largely led from national health ministries.

Relevant changes

National guideline groups, supported by GELA researchers and government-academic partners, developed five contextually-tailored child health recommendations. For most of these recommendations, additional evidence was required to inform contextually appropriate national decision-making. Formal capacity-building and on-the-job learning enhanced the competencies of national contributors and researchers in evidence-informed decision-making.

Lessons learnt

Developing context-relevant recommendations requires considerable resources and time. Further investment in strengthening local capacity is needed for sustainable national guideline development.

Evaluating the impact of the global evidence, local adaptation (GELA) project for enhancing evidence-informed guideline recommendations for newborn and young child health in three African countries: a mixed-methods protocol

BACKGROUND

Poverty-related diseases (PRD) remain amongst the leading causes of death in children under-5 years in sub-Saharan Africa (SSA). Clinical practice guidelines (CPGs) based on the best available evidence are key to strengthening health systems and helping to enhance equitable health access for children under five. However, the CPG development process is complex and resource-intensive, with substantial scope for improving the process in SSA, which is the goal of the Global Evidence, Local Adaptation (GELA) project. The impact of research on PRD will be maximized through enhancing researchers and decision makers' capacity to use global research to develop locally relevant CPGs in the field of newborn and child health. The project will be implemented in three SSA countries, Malawi, South Africa and Nigeria, over a 3-year period. This research protocol is for the monitoring and evaluation work package of the project. The aim of this work package is to monitor the various GELA project activities and evaluate the influence these may have on evidence-informed decision-making and guideline adaptation capacities and processes. The specific project activities we will monitor include (1) our ongoing engagement with local stakeholders, (2) their capacity needs and development, (3) their understanding and use of evidence from reviews of qualitative research and, (4) their overall views and experiences of the project.

METHODS

We will use a longitudinal, mixed-methods study design, informed by an overarching project Theory of Change. A series of interconnected qualitative and quantitative data collections methods will be used, including knowledge translation tracking sheets and case studies, capacity assessment online surveys, user testing and in-depth interviews, and non-participant observations of project activities. Participants will comprise of project staff, members of the CPG panels and steering committees in Malawi, South Africa and Nigeria, as well as other local stakeholders in these three African countries.

DISCUSSION

Ongoing monitoring and evaluation will help ensure the relationship between researchers and stakeholders is supported from the project start. This can facilitate achievement of common goals and enable researchers in South Africa, Malawi and Nigeria to make adjustments to project activities to maximize stakeholder engagement and research utilization. Ethical approval has been provided by South African Medical Research Council Human Research Ethics Committee (EC015-7/2022); The College of Medicine Research and Ethics Committee, Malawi (P.07/22/3687); National Health Research Ethics Committee of Nigeria (01/01/2007).

Informing pandemic management in Germany with trustworthy living evidence syntheses and guideline development: lessons learned from the COVID-19 evidence ecosystem

OBJECTIVES

We present the 'COVID-19 evidence ecosystem' (CEOsys) as a German network to inform pandemic management and to support clinical and public health decision-making. We discuss challenges faced when organizing the ecosystem and derive lessons learned for similar networks acting during pandemics or health-related crises.

STUDY DESIGN AND SETTING

Bringing together 18 university hospitals and additional institutions, CEOsys key activities included research prioritization, conducting living systematic reviews (LSRs), supporting evidence-based (living) guidelines, knowledge translation (KT), detecting research gaps, and deriving recommendations, backed by technical infrastructure and capacity building.

RESULTS

CEOsys rapidly produced 31 high-quality evidence syntheses and supported three living guidelines on COVID-19-related topics, while also developing methodological procedures. Challenges included CEOsys' late initiation in relation to the pandemic outbreak, the delayed prioritization of research questions, the continuously evolving COVID-19-related evidence, and establishing a technical infrastructure. Methodological-clinical tandems, the cooperation with national guideline groups and international collaborations were key for efficiency.

CONCLUSION

CEOsys provided a proof-of-concept for a functioning evidence ecosystem at the national level. Lessons learned include that similar networks should, among others, involve methodological and clinical key stakeholders early on, aim for (inter)national collaborations, and systematically evaluate their value. We particularly call for a sustainable network.

Using a priority setting exercise to identify priorities for guidelines on newborn and child health in South Africa, Malawi, and Nigeria

BACKGROUND

Sub-Saharan Africa is the region with the highest under-five mortality rate globally. Child healthcare decisions should be based on rigorously developed evidence-informed guidelines. The Global Evidence, Local Adaptation (GELA) project is enhancing capacity to use global research to develop locally relevant guidelines for newborn and child health in South Africa (SA), Malawi, and Nigeria. The first step in this process was to identify national priorities for newborn and child health guideline development, and this paper describes our approach.

METHODS

We followed a good practice method for priority setting, including stakeholder engagement, online priority setting surveys and consensus meetings, conducted separately in South Africa, Malawi and Nigeria. We established national Steering Groups (SG), comprising 10-13 members representing government, academia, and other stakeholders, identified through existing contacts and references, who helped prioritise initial topics identified by research teams and oversaw the process. Various stakeholders were consulted via online surveys to rate the importance of topics, with results informing consensus meetings with SGs where final priority topics were agreed.

RESULTS

Based on survey results, nine, 10 and 11 topics were identified in SA, Malawi, and Nigeria respectively, which informed consensus meetings. Through voting and discussion within meetings, and further engagement after the meetings, the top three priority topics were identified in each country. In SA, the topics concerned anemia prevention in infants and young children and post-discharge support for caregivers of preterm and LBW babies. In Malawi, they focused on enteral nutrition in critically ill children, diagnosis of childhood cancers in the community, and caring for neonates. In Nigeria, the topics focused on identifying pre-eclampsia in the community, hand hygiene compliance to prevent infections, and enteral nutrition for LBW and preterm infants.

CONCLUSIONS

Through dynamic and iterative stakeholder engagement, we identified three priority topics for guideline development on newborn and child health in SA, Malawi and Nigeria. Topics were specific to contexts, with no overlap, which highlights the importance of contextualised priority setting as well as of the relationships with key decisionmakers who help define the priorities.

GRADE Concept 7: Issues and Insights Linking Guideline Recommendations to Trustworthy Essential Medicine Lists

OBJECTIVES

Guidelines and essential medicine lists (EMLs) bear similarities and differences in the process that lead to decisions. Access to essential medicines is central to achieve universal health coverage. The World Health Organization (WHO) EML has guided prioritization of essential medicines globally for nearly 50 years, and national EMLs (NEMLs) exist in over 130 countries. Guideline and EML decisions, at WHO or national levels, are not always coordinated and aligned. We sought to explore challenges, and potential solutions, for decision-making to support trustworthy medicine selection for EMLs from a Grading of Recommendations, Assessment, Development and Evaluations (GRADE) Working Group perspective. We primarily focus on the WHO EML; however, our findings may be applicable to NEML decisions as well.

STUDY DESIGN AND SETTING

We identified key challenges in connecting the EML to health guidelines by involving a broad group of stakeholders and assessing case studies including real applications to the WHO EML, South Africa NEML, and a multiple sclerosis guideline connected to a WHO EML application for multiple sclerosis treatments. To address challenges, we utilized the results of a survey and feedback from the stakeholders, and iteratively met as a project group. We drafted a conceptual framework of challenges and potential solutions. We presented a summary of the results for feedback to all attendees of the GRADE Working Group meetings in November 2022 (approximately 120 people) and in May 2023 (approximately 100 people) before finalizing the framework.

RESULTS

We prioritized issues and insights/solutions that addressed the connections between the EML and health guidelines. Our suggested solutions include early planning alignment of guideline groups and EMLs, considering shared participation to strengthen linkage, further clarity on price/cost considerations, and using explicit shared criteria to make guideline and EML decisions. We also provide recommendations to strengthen the connection between WHO EML and NEMLs including through contextualization methods.

CONCLUSION

This GRADE concept article, jointly developed by key stakeholders from the guidelines and EMLs field, identified key conceptual issues and potential solutions to support the continued advancement of trustworthy EMLs. Adopting structured decision criteria that can be linked to guideline recommendations bears the potential to advance health equity and gaps in availability of essential medicines within and between countries.

Exploring trial publication and research waste in COVID-19 randomised trials of hydroxychloroquine, corticosteroids, and vitamin D: a meta-epidemiological cohort study

BACKGROUND

The global research response to the COVID-19 pandemic was impressive, but also led to an infodemic and considerable research waste. Registered, but unpublished trials added to this noise. We aimed to determine the proportion of registered randomised trials of common COVID-19 treatments that were published and to describe the characteristics of these trials to examine the association between trial characteristics, publication status and research waste.

METHODS

This meta-epidemiological cohort study used a sample of randomised trials of corticosteroids, hydroxychloroquine or vitamin D as treatments for COVID-19, registered between 1 November 2019 and 31 December 2021 and available via the WHO ICTRP portal. We searched for the trials' published results up to 20 October 2022. We extracted the trial characteristics, analysing with descriptive statistics. We performed univariate logistic regression to examine the association between trials' characteristics and publication status, followed by multiple logistic regression using significant characteristics to assess the association between trial characteristics and publication status.

RESULTS

We identified 357 eligible trials on ICTRP. Of these, 107 (30%) had published or made their results available publicly by 20 October 2022, while 250 (70%) had not been published or shared their results publicly. Multiple logistic regression analysis showed that a larger target sample size was a significant positive predictor of publication with target sample sizes above 300 almost tripling the odds of publication (aOR: 2.75, 95% CI: 1.35 to 5.62).

CONCLUSIONS

Less than one third of registered trials made their results public and our findings identified that many trialists had not updated their trial registry entry with the trial status, results or both. Failure to share trial results publicly is a disservice to patients, clinicians and policy makers and adds to research waste.

Building capacity for network meta-analysis in Sub-Saharan Africa: reflections and future direction

Robust, relevant, comprehensive, and up-to-date evidence syntheses are the cornerstone for evidence-informed healthcare decisions. When considering multiple treatment options, network meta-analysis (NMA) systematic reviews play a key role in informing impactful decisions and clinical practice guidelines. However, the capacity and literacy to conduct NMA systematic reviews and interpret its results remains out of reach for many clinicians and review authors, especially in low-to-middle-income countries. Despite ample resources and guides, NMA capacity and training opportunities remain limited to non-existent in Sub-Saharan Africa. Towards solutions and strengthening evidence synthesis and NMA capacity in the Sub-Saharan African region, we describe and reflect on two courses that build NMA capacity and aim to address NMA literacy in Sub-Saharan Africa.The Primer in NMA systematic reviews aimed for participants to be able to find, appraise, interpret, and consider the use of NMA SRs of intervention effects. It is a 6-week online course for clinicians, policy-makers, and researchers wanting to learn more about using NMA systematic reviews. The Global NMA Masterclass workshop aimed for participants to be able to understand and apply pairwise and NMA in STATA and R, evaluate NMA assumptions and confidence in NMA results, and appropriately report NMA results. This course was offered over 5 weeks to clinicians, biostatisticians, and researchers with basic knowledge of epidemiology and biostatics. Although the bulk of learning occurred through self-study, we had weekly, synchronous question-and-answer sessions for both courses. Using relevant examples throughout the courses helped to enable an authentic learning environment.This was the first NMA training developed in Africa for Africa. Development of the courses was a collaborative effort from a multi-disciplinary team. Both NMA courses were well received and attended by a diverse group of participants spread across Sub-Saharan African countries. Participants felt the courses were applicable to their setting. Although most participants appreciated the benefits of online learning, we also experienced some challenges. There is great potential to conduct NMA systematic reviews in Sub-Saharan Africa. The NMA Primer and NMA workshop can play an essential role in expanding and developing NMA SR capacity and literacy in SSA.

Living evidence and adaptive policy: perfect partners?

BACKGROUND

While there has been widespread global acceptance of the importance of evidence-informed policy, many opportunities to inform health policy with research are missed, often because of a mismatch between when and where reliable evidence is needed, and when and where it is available. 'Living evidence' is an approach where systematic evidence syntheses (e.g. living reviews, living guidelines, living policy briefs, etc.) are continually updated to incorporate new relevant evidence as it becomes available. Living evidence approaches have the potential to overcome a major barrier to evidence-informed policy, making up-to-date systematic summaries of policy-relevant research available at any time that policy-makers need them. These approaches are likely to be particularly beneficial given increasing calls for policy that is responsive, and rapidly adaptive to changes in the policy context. We describe the opportunities presented by living evidence for evidence-informed policy-making and highlight areas for further exploration.

DISCUSSION

There are several elements of living approaches to evidence synthesis that might support increased and improved use of evidence to inform policy. Reviews are explicitly prioritised to be 'living' by partnerships between policy-makers and researchers based on relevance to decision-making, as well as uncertainty of existing evidence, and likelihood that new evidence will arise. The ongoing nature of the work means evidence synthesis teams can be dynamic and engage with policy-makers in a variety of ways over time; and synthesis topics, questions and methods can be adapted as policy interests or contextual factors shift. Policy-makers can sign-up to be notified when relevant new evidence is found, and can be confident that living syntheses are up-to-date and contain all research whenever they access them. The always up-to-date nature of living evidence syntheses means producers can rapidly demonstrate availability of relevant, reliable evidence when it is needed, addressing a frequently cited barrier to evidence-informed policymaking.

CONCLUSIONS

While there are challenges to be overcome, living evidence provides opportunities to enable policy-makers to access up-to-date evidence whenever they need it and also enable researchers to respond to the issues of the day with up-to-date research; and update policy-makers on changes in the evidence base as they arise. It also provides an opportunity to build flexible partnerships between researchers and policy-makers to ensure that evidence syntheses reflect the changing needs of policy-makers.

Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study

Introduction

Reliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the methodological quality of systematic reviews published in African emergency medicine journals, comparing them to those published in international emergency medicine journals. Additionally, we describe the types of review literature published in the African journals.

Methods

We performed a cross-sectional methodological study of systematic reviews published in selected African and international emergency medicine journals from 2012 to 2021. Studies were eligible if they were i) a systematic review on an emergency medicine topic, ii) published in one of the top five emergency medicine journals in the African region or internationally and iii) published between January 2012 and December 2021 in English or French. We searched PubMed, Web of Science and Scopus databases and hand-searched selected journals. Two authors screened titles, abstracts and full texts independently and in duplicate. Data extraction was performed by one reviewer, using a standardised form, after completing a calibration exercise. We described the characteristics of systematic reviews and assessed methodological quality using AMSTAR II.

Results

We identified 34 (37%) African and 511 (54%) international systematic reviews from 92 and 948 review articles respectively across 10 journals. We included all 34 African and a random sample of 100 international systematic reviews. Methodological quality was low or critically low for all the African systematic reviews (n=34, 100%) and all but three international systematic reviews (n=97, 97%). The median number of critical domain weaknesses was 4 (IQR 4;5) and 2 (IQR 2;4) for African and international systematic reviews respectively. The most common weaknesses across both African and international systematic reviews were i) not establishing a priori review protocols, ii) unclear selection of study designs iii) not providing a list of excluded studies and iv) unclear reporting on funding sources for included studies.

Conclusion

Emergency medicine systematic reviews published in African and international journals are lacking in methodological quality. Reporting an a priori protocol, developing a comprehensive search strategy, appropriate evidence synthesis and adequate assessment of risk of bias, heterogeneity and evidence certainty may improve the quality of systematic reviews.

Ketamine as adjunctive or monotherapy for post-intubation sedation in patients with trauma on mechanical ventilation: A rapid review

Background

The effectiveness of ketamine as adjunctive or monotherapy for post-intubation sedation in adults with trauma on mechanical ventilation is unclear.

Methods

A rapid review of systematic reviews of randomized controlled trials, then randomized controlled trials or observational studies was conducted searching three electronic databases (PubMed, Embase, Cochrane Library) and one clinical trial registry on June 1, 2022. We used a prespecified protocol following Cochrane rapid review methods.

Results

We identified eight systematic reviews of randomized controlled trials and observational studies. Among the included reviews, only the most relevant, up to date, highest quality-assessed reviews and reviews that reported on critical outcomes were considered. Adjunctive ketamine showed a morphine sparing effect (MD -13.19 µmg kg-1 h-1, 95 % CI -22.10 to -4.28, moderate certainty of evidence, 6 RCTs), but no to little effect on midazolam sparing effect (MD 0.75 µmg kg-1 h-1, 95 % CI -1.11 to 2.61, low certainty of evidence, 6 RCTs) or duration of mechanical ventilation in days (MD -0.17 days, 95 % CI -3.03 to 2.69, moderate certainty of evidence, 3 RCTs).Adjunctive ketamine therapy may reduce mortality (OR 0.88, 95 % CI 0.54 to 1.43, P = 0.60, very low certainty of evidence, 5 RCTs, n = 3076 patients) resulting in 30 fewer deaths per 1000, ranging from 132 fewer to 87 more, but the evidence is very uncertain. Ketamine results in little to no difference in length of ICU stay (MD 0.04 days, 95 % CI -0.12 to 0.20, high certainty of evidence, 5 RCTs n = 390 patients) or length of hospital stay (MD -0.53 days, 95 % CI -1.36 to 0.30, high certainty of evidence, 5 RCTs, n = 277 patients).Monotherapy may have a positive effect on respiratory and haemodynamic outcomes, however the evidence is very uncertain.

Conclusion

Adjunctive ketamine for post-intubation analgosedation results in a moderate meaningful net benefit but there is uncertainty for benefit and harms as monotherapy.

Advancing guideline quality through country-wide and regional quality assessment of CPGs using AGREE: a scoping review

BACKGROUND AND OBJECTIVE

Clinical practice guidelines (CPGs) are evaluated for quality with the Appraisal of Guidelines for Research and Evaluation (AGREE) tool, and this is increasingly done for different countries and regional groupings. This scoping review aimed to describe, map, and compare these geographical synthesis studies, that assessed CPG quality using the AGREE tool. This allowed a global interpretation of the current landscape of these country-wide or regional synthesis studies, and a closer look at its methodology and results.

STUDY DESIGN AND METHODS

A scoping review was conducted searching databases Medline, Embase, Epistemonikos, and grey literature on 5 October 2021 for synthesis studies using the later versions of AGREE (AGREE II, AGREE-REX and AGREE GRS) to evaluate country-wide or regional CPG quality. Country-wide or regional synthesis studies were the units of analysis, and simple descriptive statistics was used to conduct the analysis. AGREE scores were analysed across subgroups into one of the seven Sustainable Development Goal regions, to allow for meaningful interpretation.

RESULTS

Fifty-seven studies fulfilled our eligibility criteria, which had included a total of 2918 CPGs. Regions of the Global North, and Eastern and South-Eastern Asia were most represented. Studies were consistent in reporting and presenting their AGREE domain and overall results, but only 18% (n = 10) reported development methods, and 19% (n = 11) reported use of Grading of Recommendations Assessment, Development, and Evaluation (GRADE). Overall scores for domains Rigor of development and Editorial independence were low, notably in middle-income countries. Editorial Independence scores, especially, were low across all regions with a maximum domain score of 46%. There were no studies from low-income countries.

CONCLUSION

There is an increasing tendency to appraise country-wide and regionally grouped CPGs, using quality appraisal tools. The AGREE tool, evaluated in this scoping review, was used well and consistently across studies. Findings of low report rates of development of CPGs and of use of GRADE is concerning, as is low domain scores globally for Editorial Independence. Transparent reporting of funding and competing interests, as well as highlighting evidence-to-decision processes, should assist in further improving CPG quality as clinicians are in dire need of high-quality guidelines.

Signal of harm in morphine use in adults with acute pulmonary oedema: A rapid systematic review

BACKGROUND

Heart failure affects nearly 65 million people globally, resulting in recurrent hospital admissions and substantial healthcare expenditure. The use of morphine in the management of acute pulmonary oedema remains controversial, with conflicting guidance and significant variation in practice. Synthesised evidence is needed to inform standard treatment guidelines and clinical practice.

OBJECTIVE

To determine whether morphine should be used in the treatment of acute pulmonary oedema (APE) in adults.

METHODS

A rapid review of systematic reviews of randomised controlled trials or observational studies, and then randomised controlled trials, was conducted searching three electronic databases (PubMed, Embase, Cochrane Library) and one clinical trial registry on 12 February 2022. We used a prespecified protocol following Cochrane rapid review methods and aligned to the National Standard Treatment Guidelines and Essential Medicines List methodology. We first considered relevant high-quality systematic reviews of randomised controlled trials or observational studies, then (if required) randomised controlled trials to inform time-sensitive or urgent evidence requests, clinical practice, policy, or standard treatment guidelines.

RESULTS

We identified four systematic reviews of observational studies. The two most relevant, up-to-date, and highest-quality reviews were used to inform evidence for critical outcomes. Morphine may increase in-hospital mortality (odds ratio (OR) 1.78; 95% confidence interval (CI) 1.01 - 3.13; low certainty of evidence; six observational studies, n=151 735 participants), resulting in 15 more per 1 000 hospital deaths, ranging from 0 to 40 more hospital deaths. Morphine may result in a large increase in invasive mechanical ventilation (OR 2.72; 95% CI 1.09 - 6.80; low certainty of evidence; four observational studies, n=167 847 participants), resulting in 45 more per 1 000 ventilations, ranging from 2 more to 136 more. Adverse events and hospital length of stay were not measured across reviews or trials.

CONCLUSION

Based on the most recent, relevant and best-available quality evidence, morphine use in adults with APE may increase in-hospital and all-cause mortality and may result in a large increase in the need for invasive mechanical ventilation compared to not using morphine. Recommending against the use of morphine in pulmonary oedema may improve patient outcomes. Disinvesting in morphine for this indication may result in cost savings, noting the possible accrued benefits of fewer patients requiring invasive ventilation and management of morphine-related side-effects.