A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit

Appraisal of Australian and New Zealand paediatric sepsis guidelines

OBJECTIVE

Clinical practice guidelines (CPGs) are an important tool for the management of children with sepsis. The quality, consistency and concordance of Australian and New Zealand (ANZ) childhood sepsis CPGs with the Australian Commission on Safety and Quality in Healthcare (ACSQHC) sepsis clinical care standards and international sepsis guidelines is unclear.

METHODS

We accessed childhood sepsis CPGs for all ANZ states and territories through Paediatric Research in Emergency Departments International Collaborative members. The guidelines were assessed for quality using the AGREE-II instrument. Consistency between CPG treatment recommendations was assessed, as was concordance with the ACSQHC sepsis clinical care standards and international sepsis guidelines.

RESULTS

Overall, eight CPGs were identified and assessed. CPGs used a narrative and pathway format, with those using both having the highest quality overall. CPG quality was highest for description of scope and clarity of presentation, and lowest for editorial independence. Consistency between guidelines for initial treatment recommendations was poor, with substantial variation in the choice and urgency of empiric antimicrobial administration; the choice, volume and urgency of fluid resuscitation; and the choice of first-line vasoactive agent. Most CPGs were concordant with time-critical components of the ACSQHC sepsis clinical care standard, although few addressed post-acute care. Concordance with international sepsis guidelines was poor.

CONCLUSION

Childhood sepsis CPGs in current use in ANZ are of variable quality and lack consistency with key treatment recommendations. CPGs are concordant with the ACSQHC care standard, but not with international sepsis guidelines. A bi-national sepsis CPG may reduce unnecessary variation in care.

Critical appraisal of Australian and New Zealand paediatric vision screening clinical practice guidelines using the AGREE II tool

CLINICAL RELEVANCE

Vision disorders in children impact health-related quality of life, with early detection and intervention improving outcomes and educational performance. Eye health professionals should be aware of paediatric vision screening guidelines and their development to understand the components of local programmes and the differences in sensitivity and specificity between protocols.

BACKGROUND

High-quality clinical practice guidelines (CPGs) for vision screening enable the early detection of common vision disorders; however, they require rigorous development to ensure optimal accuracy in detecting vision disorders, enabling timely interventions. This study evaluated the quality of available vision screening CPGs on vision screening of children in Australia and New Zealand.

METHODS

A systematic search of academic databases, guideline databases, professional associations and Google search engines was conducted to identify relevant paediatric vision screening CPGs. Four independent reviewers used the Appraisal of Guidelines, Research and Evaluation (AGREE II) instrument to assess the quality of individual guidelines and scores were aggregated and reported as the percentage of the total possible score across the six AGREE II domains: scope and purpose, stakeholder involvement, rigour of development, clarity of presentation, applicability, and editorial independence.

RESULTS

Initial 2,999 items were evaluated, with seven guidelines included. AGREE-II quality score agreement ranged from 43.3% to 95.8%. All guidelines scored >60.0% in the scope and purpose, however, most had poor scores of <26.5% in the rigour of development and <3.3% in editorial independence domains. All guidelines recommended screening using measures of habitual distance vision.

CONCLUSION

Of the guidelines developed for use in Australia and New Zealand, most guidelines scored poorly when assessed against the AGREE II tool, because of lack of editorial independence and rigour of development. Paediatric vision screening guidelines should prioritise systematic review of literature to inform practice and include statements regarding competing interests.

Quality appraisal of clinical guidelines for Helicobacter pylori infection and systematic analysis of the level of evidence for recommendations

OBJECTIVES

To systematically assess the quality of clinical practice guidelines (CPGs) for Helicobacter pylori (HP) infection and identify gaps that limit their development.

STUDY DESIGN AND SETTING

CPGs for HP infection were systematically collected from PubMed, Embase, the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature, and six online guideline repositories. Three researchers independently used the AGREE Ⅱ tool to evaluate the methodological quality of the eligible CPGs. In addition, the reporting and recommendation qualities were appraised by using the RIGHT and AGREE-REX tools, respectively. The distribution of the level of evidence and strength of recommendation among evidence-based CPGs was determined.

RESULTS

A total of 7,019 records were identified, and 24 CPGs met the eligibility criteria. Of the eligible CPGs, 19 were evidence-based and 5 were consensus-based. The mean overall rating score of AGREE II was 50.7% (SD = 17.2%). Among six domains, the highest mean score was for scope and purpose (74.4%, SD = 17.7%) and the lowest mean score was for applicability (24.3%, SD = 8.9). Only three of 24 CPGs were high-quality. The mean overall score of recommendation quality was 35.5% (SD = 12.2%), and the mean scores in each domain of AGREE-REX and RIGHT were all ≤ 60%, with values and preferences scoring the lowest (16.6%, SD = 11.9%). A total of 505 recommendations were identified. Strong recommendations accounted for 64.1%, and only 34.3% of strong recommendations were based on high-quality evidence.

CONCLUSION

The overall quality of CPGs for HP infection is poor, and CPG developers tend to neglect some domains, resulting in a wide variability in the quality of the CPGs. Additionally, CPGs for HP infection lack sufficient high-quality evidence, and the grading of recommendation strength should be based on the quality of evidence. The CPGs for HP infection have much room for improvement and further researches are required to minimize the evidence gap.

Appraisal of clinical practice guidelines for salivary gland cancer management utilizing AGREE II instrument

OBJECTIVE

Salivary gland cancers (SGC) are rare neoplasms which comprise 1-5 % of all head and neck cancers. SGCs can be managed by resection, radiosurgery, chemotherapy, or a combination of these. Our team appraised the quality of clinical practice guidelines (CPGs) for SGC treatment and management using the Appraisal of Guidelines for Research and Evaluation (AGREE-II) instrument.

DATA SOURCES

PubMed, Scopus, & EMBASE were reviewed for CPGs regarding SGC management from database inception to January 1st, 2023.

REVIEW METHODS

The AGREE-II instrument was used by 4 reviewers to independently evaluate guidelines. Domain scores were generated with a satisfactory threshold being >60 % - a "high" quality CPG required >4 satisfactory domains. Intraclass correlation coefficients (ICCs) were used, via R 4.2.1., to determine inter-reviewer variability.

RESULTS

Literature review identified 645 articles, with six being included after applying inclusion and exclusion criteria. Of the six included articles, one CPG was "high" quality and 5 were "low" quality. The domains with the highest scores were "Editorial Independence" (72.57 ± 36.60) and "Clarity and Presentation" (63.19 ± 26.08), while the lowest were "Rigor of Development" (34.03 ± 30.63) and "Applicability" (30.21 ± 30.46). ICC scores for each domain ranged from 0.937 to 0.983, indicating a high level of inter-rater agreement.

CONCLUSION

This study found that most CPGs for the treatment and management of SGC were of "low" quality, with only one guideline being considered "high" quality based on the standard set by the AGREE-II instrument. These findings indicate that there is a high level of variability and little standardization when it comes to the quality of CPGs.

Clinical practice guidelines in the management of pediatric foreign body aspiration and ingestion: a systematic evaluation using the AGREE II instrument

PURPOSE

Several clinical practice guidelines (CPGs) have been produced to optimize the diagnosis and management of pediatric foreign body aspiration and ingestion. However, to date there have been no critical evaluations of their methodological rigor or quality. Herein, we address this need via the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.

METHODS

A literature search of Embase, MEDLINE via PubMed, and Scopus was performed up until February 25, 2021. Identified CPGs were then assessed by four independent reviewers trained in AGREE II. A scaled domain score of >60% was indicated as satisfactory quality. Intraclass correlation coefficients (ICC) were calculated to assess inter-reviewer agreement.

RESULTS

11 guidelines were assessed with only one being classified as high quality and others being either average (two) or low quality (eight). Domain 4 (clarity of presentation) achieved the highest mean score (66.41 ± 13.33%), while domain 5 (applicability) achieved the lowest score (10.80 ± 10.37%). ICC analysis revealed generally strong agreement between reviewers with a range of 0.60-0.98.

CONCLUSION

Quality appraisal using the AGREE II instrument suggests that the methodologic rigor and quality of current guidelines for the diagnosis and management of pediatric foreign body aspiration and ingestion need significant improvement.

Clinical practice guidelines for the nutrition of colorectal cancer patients: a systematic review

PURPOSE

The aim of this study is to rigorously assess the methodological quality of published clinical practice guidelines (CPGs) related to nutrition among colorectal cancer patients, to compile consensus recommendations, and to evaluate the quality of the included CPGs.

METHODS

The systematic search covered eight electronic databases, two relevant professional association websites, and six guideline websites from their inception up to January 22, 2023. The methodological quality of the eligible guidelines was evaluated using the Appraisal of Guidelines Research and Evaluation II (AGREE II) instrument, and then, consensus recommendations were synthesized. The scores for each domain were expressed as the mean ± standard deviation (SD). Using the mean score as the benchmark for comparison, they were subsequently ranked from highest to lowest. The included guidelines were then categorized as having "high," "moderate," or "low" quality based on their scores.

RESULTS

The literature search yielded ten guidelines. The findings indicated that the "Clarity of presentation" domain had the highest mean score (65.2 ± 7.7). This demonstrates how the guidelines effectively articulate recommendations. Additionally, the "Scope and purpose" domain achieved a mean score of 60.7 ± 10.9, followed by "Rigor of development" (51.7 ± 15.7), "Editorial independence" (51.1 ± 21), "Stakeholder involvement" (48 ± 16.8), and "Applicability" domains (47.5 ± 17.3). Two CPGs received an overall rating of "high quality" and were recommended; four CPGs received an overall rating of "moderate" and were recommended with modifications; and four CPGs received an overall rating of "low quality" and were not recommended. Furthermore, this study compiled twenty consensus recommendations related to nine distinct clinical issues.

CONCLUSION

This study identified disparities in the methodological quality of the included CPGs, particularly in the "Applicability" domain, thus emphasizing the need for advancement in clinical feasibility and implementation. Notably, there is few guidelines specifically targeting colorectal cancer nutrition. These synthesized findings provided an intuitive, convenient, and comprehensive reference for evaluating nutrition among colorectal cancer patients. When applying these results, users should make careful decisions based on their specific situations.

Anticancer drug-induced interstitial lung disease: a critical appraisal of clinical practice guidelines and consensus statements

Anticancer drug-induced interstitial lung disease (DIILD) has received increasing clinical attention, and the quality of relevant guidance documents has become critical. Our purpose was to assess the quality of documents for anticancer DIILD and summarize the recommendations. Clinical practice guidelines (CPGs) and consensus statements with recommendations were searched in electronic databases, websites of guideline organizations, and professional societies. The quality of documents was assessed using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) methodology, and the specific recommendations were aggregated and compared. A total of 11 documents were eligible, including 6 CPGs and 5 consensus statements, and the quality of AGREE II assessments differed greatly. The domains of scope and purpose and clarity of presentation received the highest median scores, while the stakeholder involvement domain received the lowest score. Recommendations were inconsistent between documents, particularly regarding the selection of steroid regimens. The methodological quality of the guidance documents needs to be enhanced, especially in the domain of stakeholder involvement. Inconsistencies exist in documents, and further discussions among multidisciplinary experts are needed. Particularly, differences in steroid regimens require attentions, and researches on the risks of adverse events and discovery of precise biomarkers are necessary.

Management of the Difficult Airway: An Appraisal of Clinical Practice Guidelines

OBJECTIVE

Management of the difficult airway can be a challenging process, which necessitates actionable recommendations from well-established guidelines. Herein, clinical practice guideline (CPG) quality is evaluated using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.

STUDY DESIGN

A systematic literature search was performed using Scopus, EMBASE, and MEDLINE via PubMed.

SETTING

Literature database.

METHODS

Data were abstracted from relevant guidelines and appraised by 4 expert reviewers in the 6 domains of quality defined by AGREE II. Intraclass correlation coefficients (ICC) were calculated across domains to quantify interrater reliability.

RESULTS

Twelve guidelines met the inclusion criteria. With a mean quality score of 83.1%, the highest quality guideline was authored by the American Society of Anesthesiologists (ASA). Low-quality content was observed in CPGs authored by the Japanese Society of Anesthesiologists (JSA) and the Chinese Collaboration Group for Emergency Airway Management (CCGEAM). Overall, deficits were most pronounced in domains describing the involvement of stakeholders, developmental rigor, and editorial independence. These findings were consistent among the panel of independent reviewers, with high ICC inter-rater reliability scores of 58.0% to 70.0% for the referenced domains.

CONCLUSION

By providing a comprehensive appraisal of guidelines, this report may serve as a reference for clinicians seeking to understand and improve upon the developmental quality of difficult airway management resources. According to AGREE II criteria for the quality of the guideline creation process, the 2022 ASA guideline outperforms its predecessors.

Critical appraisal of the Colombian clinical practice guide for the prevention, diagnosis and treatment of suicidal ideation and/or behaviour (adoption)

INTRODUCTION

Suicide is a complex, global public health problem. The Colombian clinical practice guideline provides relevant input for its prevention, diagnosis and treatment. The objective was to evaluate the methodological quality, credibility and applicability of the Colombian clinical practice guideline for suicidal behaviour.

METHODS

An academic group of 12 evaluators was established to assess the guide and its recommendations in a standardised way, using the AGREE-II and AGREE-REX instruments. The evaluations were given in the range of 0.0-1.0 with 0.7 as a cut-off point for appropriate quality.

RESULTS

The global assessment of the AGREE-II was greater than 0.7 in the dimensions: "scope and objective" (0.86), "clarity of presentation" (0.89), "applicability" (0.73) and "editorial independence" (0.89). The lowest scores were for "participation of those involved" (0.67) and "rigour in preparation" (0.69). With the AGREE-REX, the results in all dimensions were below 0.70, which indicates lower quality and suitability for use.

CONCLUSIONS

The adoption process of the Colombian guideline for suicidal behaviour was a rigorous methodological process, while the practice recommendations were valued as of low applicability due to low support in local evidence. It is necessary to strengthen the generation and synthesis of evidence at the national level to give greater support and applicability to the practice recommendations.

Radioactive Iodine in Differentiated Thyroid Carcinoma: A Systematic AGREE II Clinical Practice Guideline Appraisal

OBJECTIVE

Identify and appraise clinical practice guidelines (CPGs) for radioactive iodine (RAI) indications in differentiated thyroid carcinoma (DTC), and the treatment for radioactive iodine refractory (RAI-R) DTC using the Appraisal of Guidelines for Research and Evaluation II tool.

DATA SOURCES

MEDLINE (Pubmed), Ovid (EMBASE), and Scopus.

REVIEW METHODS

A systematic literature search was conducted to identify CPGs addressing RAI in DTC. CPGs were appraised by 4 independent reviewers in 6 distinct areas of quality. Scaled domain scores were subsequently calculated for each domain. Intraclass correlation coefficients were calculated for each domain to assess interrater reliability.

RESULTS

Sixteen guidelines were found addressing RAI indications for DTC. Of these 16, 9 also addressed the treatment of RAI-R DTC. A further 6 unique guidelines were identified that exclusively address RAI-R DTC, bringing the total number of guidelines to 22. The American Thyroid Association (ATA) guidelines for adult thyroid cancer were the highest scoring with a mean score of 83.5%. Two guidelines scored >60% in 5 or more domains, qualifying as "high" quality: ATA and British Thyroid Association. The highest scoring domain was domain 4: clarity of presentation (80.4%) while the lowest scoring domain was domain 5: applicability (38.6%).

CONCLUSION

Of the 22 guidelines identified, only two were "high quality." CPGs exclusively addressing the treatment of RAI-R DTC were weak with most guidelines scoring in the "low" quality range. This report reveals an unmet need for rigorously developed guidelines addressing indications for RAI in DTC, as well as the treatment for RAI-R DTC.

Identifying complementary and alternative medicine recommendations for anxiety treatment and care: a systematic review and critical assessment of comprehensive clinical practice guidelines

Background

Clinical practice guidelines (CPGs) are used to guide decision-making, especially regarding complementary and alternative medicine (CAM) therapies that are unfamiliar to orthodox healthcare providers. This systematic review aimed to critically review and summarise CAM recommendations associated with anxiety management included in the existing CPGs.

Methods

Seven databases, websites of six international guidelines developing institutions, and the National Centre for Complementary and Integrative Health website were systematically searched. Their reporting and methodological quality were evaluated using the Reporting Items for practice Guidelines in Healthcare checklist and the Appraisal of Guidelines for Research and Evaluation (2nd version) instrument, respectively.

Results

Ten CPGs were included, with reporting rates between 51.4 and 88.6%. Seven of these were of moderate to high methodological quality. Seventeen CAM modalities were implicated, involving phytotherapeutics, mind-body practice, art therapy, and homeopathy. Applied relaxation was included in 70% CPGs, which varied in degree of support for its use in the treatment of generalised anxiety disorder. There were few recommendations for other therapies/products. Light therapy was not recommended for use in generalised anxiety disorder, and St John's wort and mindfulness were not recommended for use in social anxiety disorder in individual guidelines. Recommendations for the applicability of other therapies/products for treating a specific anxiety disorder were commonly graded as "unclear, unambiguous, or uncertain". No CAM recommendations were provided for separation anxiety disorder, specific phobia or selective mutism.

Conclusion

Available guidelines are limited in providing logically explained graded CAM recommendations for anxiety treatment and care. A lack of high-quality evidence and multidisciplinary consultation during the guideline development are two major reasons. High quality and reliable clinical evidence and the engagement of a range of interdisciplinary stakeholders are needed for future CPG development and updating.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022373694, identifier CRD42022373694.

A systematic review of clinical practice guidelines and recommendations for the management of pain, sedation, delirium and iatrogenic withdrawal syndrome in pediatric intensive care

Introduction

This systematic review aimed to evaluate the quality of clinical practice guidelines (CPGs) and recommendations for managing pain, sedation, delirium, and iatrogenic withdrawal syndrome in pediatric intensive care (PICU). The objectives included evaluating the quality of recommendations, synthesizing recommendations, harmonizing the strength of the recommendation (SoR) and the certainty of evidence (CoE), and assessing the relevance of supporting evidence.

Methods

A comprehensive search in four electronic databases (Medline, Embase.com, CINAHL and JBI EBP Database), 9 guideline repositories, and 13 professional societies was conducted to identify CPGs published from January 2010 to the end of May 2023 in any language. The quality of CPGs and recommendations was assessed using the AGREE II and AGREE-REX instruments. Thematic analysis was used to synthesize recommendations, and the GRADE SoR and CoE harmonization method was used to interpret the credibility of summary recommendations.

Results

A total of 18 CPGs and 170 recommendations were identified. Most CPGs were of medium-quality, and three were classified as high. A total of 30 summary recommendations were synthesized across each condition, focused on common management approaches. There was inconsistency in the SoRs and CoE for summary recommendations, those for assessment showed the highest consistency, the remaining were conditional, inconsistent, inconclusive, and lacked support from evidence.

Conclusion

This systematic review provides an overview of the quality of CPGs for these four conditions in the PICU. While three CPGs achieved high-quality ratings, the overall findings reveal gaps in the evidence base of recommendations, patient and family involvement, and resources for implementation. The findings highlight the need for more rigorous and evidence-based approaches in the development and reporting of CPGs to enhance their trustworthiness. Further research is necessary to enhance the quality of recommendations for this setting. The results of this review can provide a valuable foundation for future CPG development.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=274364, PROSPERO (CRD42021274364).

A critical appraisal and recommendation synthesis of delirium clinical practice guidelines relevant to the care of older adults in the emergency department: An umbrella review

RATIONALE

Older adults are at high risk of developing delirium in the emergency department (ED); however, it is often missed or undertreated. Improving ED delirium care is challenging in part due to a lack of standards to guide best practice. Clinical practice guidelines (CPGs) translate evidence into recommendations to improve practice.

AIM

To critically appraise and synthesize CPG recommendations for delirium care relevant to older ED patients.

METHODS

We conducted an umbrella review to retrieve relevant CPGs. Quality of the CPGs and their recommendations were critically appraised using the Appraisal of Guidelines, Research, and Evaluation (AGREE)-II; and Appraisal of Guidelines Research and Evaluation-Recommendations Excellence (AGREE-REX) instruments. A threshold of 70% or greater in the AGREE-II Rigour of Development domain was used to define high-quality CPGs. Delirium recommendations from CPGs meeting this threshold were included in the synthesis and narrative analysis.

RESULTS

AGREE-II Rigour of Development scores ranged from 37% to 83%, with 5 of 10 CPGs meeting the predefined threshold. AGREE-REX overall calculated scores ranged from 44% to 80%. Recommendations were grouped into screening, diagnosis, risk reduction, and management. Although none of the included CPGs were ED-specific, many recommendations incorporated evidence from this setting. There was agreement that screening for nonmodifiable risk factors is important to define high-risk populations, and those at risk should be screened for delirium. The '4A's Test' was the recommended tool to use in the ED specifically. Multicomponent strategies were recommended for delirium risk reduction, and for its management if it occurs. The only area of disagreement was for the short-term use of antipsychotic medication in urgent situations.

CONCLUSION

This is the first known review of delirium CPGs including a critical appraisal and synthesis of recommendations. Researchers and policymakers can use this synthesis to inform future improvement efforts and research in the ED.

REGISTRATION

This study has been registered in the Open Science Framework registries: https://doi.org/10.17605/OSF.IO/TG7S6OSF.IO/TG7S6.

The Evidence for Screening Older Adults for Nutrition Risk in Primary Care: An Umbrella Review

It is not known if nutrition risk screening of older adults should be a standard practice in primary care. The evidence in support of nutrition risk screening of older adults in primary care was examined and critically analyzed using an umbrella review. The peer reviewed and grey literature were searched for clinical practice guidelines (CPGs) and systematic reviews (SRs). Titles and abstracts were independently screened by the two authors. Resources were excluded if they did not apply to older adults, did not discuss nutrition/malnutrition risk screening, or were in settings other than primary care. Full texts were independently screened by both authors, resulting in the identification of six CPGs and three SRs that met the review criteria. Guidelines were appraised with the AGREE II tool and SRs with the AMSTAR 2 tool. The quality of the CPGs was high, while the quality of the SRs was low. The CPGs and SRs acknowledged a lack of high-quality research on the benefits of regular nutrition risk screening for older adults in primary care; however, CPGs recommended annual screening for older adults in primary care practices or other community settings. High-quality research investigating nutrition risk screening of older adults in primary care is needed.

Clinical Practice Guidelines in an Era of Accountability, Saudi Arabia: A Call for Action

INTRODUCTION

Clinical Practice Guidelines (CPGs) development and implementation in the Kingdom of Saudi Arabia are suboptimal. The Kingdom's Vision 2030 envisages a transformational change to achieve an effective, integrated, value-based ecosystem focused on patient health.

OBJECTIVES

This study aimed to develop a CPG appraisal tool that will support the realization of the Kingdom's Vision 2030 through the development of high-quality and highly implementable CPGs. To maximize its impact, all vital healthcare paradigms, such as systems thinking, value-based healthcare, and information technology, will robustly be incorporated in the tool.

METHODS

The Saudi Health Council through its National Center of Evidence-Based Medicine (NCEBM) embarked on a program to develop this appraisal tool. A taskforce of experts was selected based on their experience in evidence-based practice and training. The task force, through a methodology of extensive literature review, deliberation, outside experts' feedback, and Delphi and consensus voting, developed a prototype appraisal tool that was named the Holistic Appraisal Tool for CPGs (HAT-CPG).

RESULTS

The HAT-CPG was developed comprising three sections: an initial basic information section, an internal validity section, and an external validity section with a total of 13 section items and 73 reporting elements.

CONCLUSION

It is envisaged that the Holistic Appraisal Tool will support CPG developers and users in Saudi Arabia in realizing the objectives for which it was developed.

Clinical practice guidelines for management of head and neck squamous cell carcinoma of unknown primary: an AGREE II appraisal

IMPORTANCE

Squamous cell carcinoma without a known primary is an uncommon form of head and neck cancer that requires multidisciplinary collaboration for effective management.

OBJECTIVE

To evaluate the quality of clinical practice guidelines (CPG) using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.

DESIGN

A systematic literature search was performed to identify CPGs pertaining to the diagnosis and treatment of head and neck squamous cell carcinoma of unknown primary (HNSCCUP). Data were abstracted from guidelines meeting inclusion criteria and appraised by four independent reviewers in the six domains of quality defined by the AGREE II.

SETTING

Online database.

PARTICIPANTS

None.

EXPOSURE

None.

MAIN OUTCOME(S) AND MEASURE(S)

Quality domain scores and intraclass correlation coefficients (ICC) were calculated across domains to qualify inter-rater reliability.

RESULTS

Seven guidelines met inclusion criteria. Two guidelines achieved a score of > 60% in five or more AGREE II quality domains to gain designation as 'high'-quality content. One "average-quality" guideline authored by the ENT UK Head and Neck Society Council achieved a score of > 60% in three quality domains. The remaining four CPGs demonstrated low-quality content, with deficits most pronounced in domains 3 and 5, suggesting a lack of rigorously developed and clinically applicable information.

CONCLUSIONS AND RELEVANCE

As the diagnosis and treatment of head and neck cancer continues to evolve, identification of high-quality guidelines will become increasingly important. The authors recommend consulting HNSCCUP guidelines from the National Institute for Health and Care Excellence (NICE) or the American Society of Clinical Oncology (ASCO).

TRIAL REGISTRATION

None.

Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines

BACKGROUND

This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability.

METHODS

This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument's intrinsic and interrater reliability, content and criterion validity, and usability.

RESULTS

STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach's α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen's kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson's r correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min.

CONCLUSION

The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines.

Identifying complementary and alternative medicine recommendations for insomnia treatment and care: a systematic review and critical assessment of comprehensive clinical practice guidelines

Background

There is a need for evidence-informed guidance on the use of complementary and alternative medicine (CAM) for insomnia because of its widespread utilization and a lack of guidance on the balance of benefits and harms. This systematic review aimed to identify and summarize the CAM recommendations associated with insomnia treatment and care from existing comprehensive clinical practice guidelines (CPGs). The quality of the eligible guidelines was appraised to assess the credibility of these recommendations.

Methods

Formally published CPGs incorporating CAM recommendations for insomnia management were searched for in seven databases from their inception to January 2023. The NCCIH website and six websites of international guideline developing institutions were also retrieved. The methodological and reporting quality of each included guideline was appraised using the AGREE II instrument and RIGHT statement, respectively.

Results

Seventeen eligible GCPs were included, and 14 were judged to be of moderate to high methodological and reporting quality. The reporting rate of eligible CPGs ranged from 42.9 to 97.1%. Twenty-two CAM modalities were implicated, involving nutritional or natural products, physical CAM, psychological CAM, homeopathy, aromatherapy, and mindful movements. Recommendations for these modalities were mostly unclear, unambiguous, uncertain, or conflicting. Logically explained graded recommendations supporting the CAM use in the treatment and/or care of insomnia were scarce, with bibliotherapy, Tai Chi, Yoga, and auriculotherapy positively recommended based on little and weak evidence. The only consensus was that four phytotherapeutics including valerian, chamomile, kava, and aromatherapy were not recommended for insomnia management because of risk profile and/or limited benefits.

Conclusions

Existing guidelines are generally limited in providing clear, evidence-informed recommendations for the use of CAM therapies for insomnia management due to a lack of high-quality evidence and multidisciplinary consultation in CPG development. More well-designed studies to provide reliable clinical evidence are therefore urgently needed. Allowing the engagement of a range of interdisciplinary stakeholders in future updates of CPGs is also warranted.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=369155, identifier: CRD42022369155.

Quality appraisal of clinical nutrition practice guidelines for critically ill adult patients: a systematic review using the Advancing Guideline Development, Reporting and Evaluation in Health Care instrument II (AGREE-II) and AGREE-Recommendation Excellence (AGREE-REX)

Nutritional therapy should follow evidence-based practice, thus several societies regarding nutrition and critical care have developed specific Clinical Practice Guidelines (CPG). However, to be regarded as trustworthy, the quality of the CPG for critically ill patients and its recommendations need to be high. This systematic review aimed to appraise the methodology and recommendations of nutrition CPG for critically ill patients. We performed a systematic review (protocol number CRD42020184199) with literature search conducted on PubMed, Embase, Cochrane Library and other four specific databases of guidelines up to October 2021. Two reviewers, independently, assessed titles and abstracts and potentially eligible full-text reports to determine eligibility and subsequently four reviewers appraised the guidelines quality using the Advancing Guideline Development, Reporting and Evaluation in Health Care instrument II (AGREE-II) and AGREE-Recommendation Excellence (AGREE-REX). Ten CPG for nutrition in critically ill patients were identified. Only Academy of Nutrition and Dietetics and European Society of Intensive Care Medicine had a total acceptable quality and were recommended for daily practice according AGREE-II. None of the CPG recommendations had an overall quality score above 70 %, thus being classified as moderate quality according AGREE-REX. The methodological evaluation of the critically ill adult patient CPG revealed significant discrepancies and showed a need for improvement in its development and/or reporting. In addition, recommendations about nutrition care process presented a moderate quality.

Quality of Palliative Care Guidelines in Patients with Heart Failure: A Systematic Review of Quality Appraisal using AGREE II Instrument

Objectives

While the principles for developing clinical practice guidelines (CPGs) are well established, the quality of published guidelines is very diverse. The present study was conducted to evaluate the quality of existing CPGs in palliative care for heart failure patients.

Material and Methods

The study was conducted according to the Preferred Reporting Items for Systematic reviews and Meta-analyses. A systematic search was conducted in the Excerpta Medica Database, MEDLINE/PubMed, CINAHL databases and Guideline internet sites: National Institute for Clinical Excellence, National Guideline Clearinghouse, Scottish Intercollegiate Guidelines Network, Guidelines International Network and National Health and Medical Research Council for CPGs published through April 2021. Criteria for including CPGs were: Containing palliative measures for patients with heart failure over 18 years old and preferably interprofessional guidelines that focus on only one dimension of palliative care or focus on diagnosis, definition and treatment were excluded from the study. After initial screening, five appraisers rated the quality of the final selection of CPGs using the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II).

Results

From 1501 records, seven guidelines were selected for analysis. The 'scope and purpose' and 'clarity of presentation' domains obtained the highest mean and 'rigor of development' and 'applicability' domains obtained the lowest mean scores. Three categories of recommendations were: (1) Strongly recommended (guidelines 1, 3, 6 and 7); (2) recommended with modifications (guideline 2) and (3) not recommended (guidelines 4 and 5).

Conclusion

Clinical guidelines for palliative care in patients with heart failure were of moderate-to-high quality, with the main deficiencies occurring in the rigor of development and applicability domains. The results inform clinicians and guideline developers of the strengths and weaknesses of each CPG. To improve the quality of palliative care CPGs in the future, it is recommended that developers pay detailed attention to all domains of the AGREE II criteria. Funding agent: Isfahan University of Medical Sciences. (IR.MUI.NUREMA.REC.1400.123).

Clinical practice guidelines on nutrition management in head and neck cancer: a systematic quality appraisal using the Appraisal of Guidelines for Research and Evaluation 2nd edition instrument

OBJECTIVE

Several guidelines have been produced for the management of nutrition in patients with head and neck cancer. However, no systematic evaluation of the quality of these guidelines has been performed to date.

METHOD

A comprehensive search was conducted up to August 2020. The quality of guidelines was assessed by four independent reviewers using the Appraisal of Guidelines for Research and Evaluation, 2nd edition.

RESULTS

Nine guidelines were assessed for critical evaluation. Only two guidelines were classified as 'high quality'. The 'scope and purpose' domain achieved the highest mean score (75.5 ± 17.0 per cent), and the lowest domain mean score was 'applicability' (37.6 ± 23.0 per cent).

CONCLUSION

These findings highlight the variability in the methodological quality of guidelines for the management of nutrition in head and neck cancer. These results may help to improve the reporting of future guidelines and guide the selection for use in clinical practice.

Clinical practice guidelines for the management of recurrent head and neck cancer: a systematic review and quality appraisal

PURPOSE

Recurrent head and neck cancer (HNC) has a significant global disease burden and its treatment is complex. Multiple clinical practice guidelines (CPGs) have been developed to improve management of these patient populations; however, no study has systematically reviewed the quality and rigor in development of these guidelines. Here, we identify and systematically appraise existing recommendations for the management of recurrent HNC and assess their clinical applicability, methodologic rigor, and transparency of development.

METHODS

A systematic search of the PubMed, Embase, and Scopus databases was conducted for recurrent HNC CPGs. Each guideline was scored independently by four reviewers trained in the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II) methodology. Salient recommendations from the selected guidelines were summarized.

RESULTS

Our literature search yielded 1799 articles; after iterative title/abstract and full text screening, five remaining guidelines met inclusion criteria. CPGs received the lowest scores in 'Applicability' and 'Rigor of development,' with scores of 12.9% and 22.3%, respectively. Overall quality of available guidelines for management of recurrent HNC is poor, with an average overall scaled domain score of 40.9% (± 11.0), and with four guidelines (80.0%) receiving an overall quality rating of 'low'.

CONCLUSION

We found significant variability in quality and overall lack of methodologic rigor among available guidelines for the management of recurrent HNC. Future groups developing recommendations for this purpose should implement the AGREE II framework to improve quality and standardization of their guidelines.

A critical appraisal of delirium clinical practice guidelines relevant to the care of older adults in the emergency department with a synthesis of recommendations: an umbrella review protocol

BACKGROUND

Up to 35% of older adults present to the emergency department (ED) with delirium or develop the condition during their ED stay. Delirium associated with an ED visit is independently linked to poorer outcomes such as loss of independence, increased length of hospital stay, and mortality. Improving the quality of delirium care for older ED patients is hindered by a lack of knowledge and standards to guide best practice. High-quality clinical practice guidelines (CPGs) have the power to translate the complexity of scientific evidence into recommendations to improve and standardize practice. This study will identify and synthesize recommendations from high-quality delirium CPGs relevant to the care of older ED patients.

METHODS

We will conduct a multi-phase umbrella review to retrieve relevant CPGs. Quality of the CPGs and their recommendations will be critically appraised using the Appraisal of Guidelines, Research, and Evaluation (AGREE)-II; and Appraisal of Guidelines Research and Evaluation - Recommendations Excellence (AGREE-REX) instruments, respectively. We will also synthesize and conduct a narrative analysis of high-quality CPG recommendations.

DISCUSSION

This review will be the first known evidence synthesis of delirium CPGs including a critical appraisal and synthesis of recommendations. Recommendations will be categorized according to target population and setting as a means to define the bredth of knowledge in this area. Future research will use consensus building methods to identify which are most relevant to older ED patients.

TRIAL REGISTRATION

This study has been registered in the Open Science Framework registries: https://doi.org/10.17605/OSF.IO/TG7S6 .

Methodological quality in guidelines for enhanced recovery after surgery was suboptimal

OBJECTIVE

We aimed to appraise the methodological quality of existing guidelines for Enhanced Recovery After Surgery (ERAS) using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument and to identify the concordance of different recommendations.

STUDY DESIGN AND SETTING

PubMed, Embase, Google Scholar, Web of Science, and clinical practice guideline websites were systematically searched. Four reviewers independently assessed the guidelines using the AGREE II instrument. The mean score of each AGREE II item, number of recommendations, strength of recommendation, and level of evidence were calculated. Agreement among reviewers was assessed using the intraclass correlation coefficient.

RESULTS

We identified 23 guidelines from 7,127 records. The overall agreement among reviewers was considered good (intraclass correlation coefficient, 0.92; 95% confidence interval [CI], 0.86-0.96). The mean scores of the six AGREE domains were scope and purpose, 60.1% (95% CI, 55.9-64.1); stakeholder involvement, 40.7% (95% CI, 35.4-46.0); rigor of development, 44.7% (95% CI, 42.2-47.2); clarity and presentation, 69.8% (95% CI, 65.3-74.3); applicability, 37.2% (95% CI, 31.8-42.6); and editorial independence, 47.8% (95% CI, 39.0-56.7). Only 2/23 ERAS guidelines were considered applicable without modifications.

CONCLUSIONS

The methodological quality of the ERAS management guidelines varied and was generally low. Future guideline development should adhere to the use of the AGREE II instrument and the GRADE system to better guide clinical practice and improve individualized treatment strategies.

The quality of guidelines for treatment of carotid artery disease: a critical appraisal using the AGREE II instrument

Clinical Practice Guidelines (CPG) are structured recommendations based on systematic reviews of the available evidence and are useful tools to support clinical decision-making. However, studies have raised concerns about the methodological and scientific quality of several CPG, which can affect their application in clinical practice. The objective of this study was to perform a systematic appraisal of the methodological quality of carotid atherosclerotic disease clinical guidelines, published from 2000 to 2019, using the AGREE II instrument (Appraisal of Guidelines for Research and Evaluation Instrument II). The appraisers independently assessed the quality of the CPG included in the study for each of the 6 domains of the AGREE II tool. The CPG were rated as high, moderate, or low quality using a points scale. A total of 9 CPGs were selected for appraisal. Except for domain 2 (kappa=0.715), excellent agreement was observed between the appraisers (kappa>0.75). Five of the CPGs were rated as high overall methodological quality rating, 5 were rated as moderate overall methodological quality, and 2 were rated low overall methodological quality. The authors conclude that: (1) appraisal of carotid atherosclerotic disease clinical guidelines using the AGREE II instrument is feasible, with a high degree of agreement among appraisers; and (2) that most CPGs on the management of atherosclerotic carotid disease have high methodological quality.

Clinical practice guidelines on management of infantile hemangioma: a systematic quality appraisal using the AGREE II instrument

Infantile hemangiomas (IH) are the most common benign tumors of childhood. Timely diagnosis and management of higher-risk IH is key in avoiding permanent disfigurement, visual impairment, and life-threatening airway compromise. Here, we identify and critically appraise existing clinical practice guidelines (CPGs) for IH diagnosis and management. A systematic search of MEDLINE, SCOPUS, and EMBASE was conducted until August 2021. Four independent reviewers assessed each CPG utilizing the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II). An scaled domain score of ≥60% demonstrated adequacy in a given domain. Intraclass correlation coefficients (ICC) assessed agreement and scoring consistency between the reviewers. Eight CPGs were eligible and included for critical appraisal. Only one CPG was classified as 'high quality', with the remaining seven guidelines being 'average' (n = 3) or 'low' (n = 4) quality. Six guidelines (75.0%) were conducted via nonsystematic literature searches. The 'Applicability' (40.4%±14.0) and 'Rigor of development' (46.9%±17.3) domains achieved the lowest scores, while the highest average scores were in 'Scope and purpose' (76.7%±11.3) and 'Editorial independence' (90.8%±13.0). We found high consistency between the four independent reviewers, with 'very good' (n = 5) or 'good' (n = 1) interrater reliability in all six AGREE II domains. Based on the AGREE II instrument, there is only one available high-quality consensus statement on the diagnosis and management of IH. Low scores in 'Rigor of development' and 'Applicability' suggest notable weaknesses in the development process and reporting quality of existing IH CPGs. Future guidelines should be backed by systematic literature searches and focus on guideline clinical translation.

Clinical practice guidelines for the management of patients with chronic regional pain syndrome: a systematic appraisal using the AGREE II instrument

Aim: Chronic regional pain syndrome (CRPS) is a debilitating, painful condition of limbs that often arises after an injury and is associated with significant morbidity. Materials & methods: The Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument, used to assess the quality of clinical practice guidelines (CPGs), was used to evaluate seven CRPS management guideline. Results: Out of the seven CPGs evaluated using the AGREE II instrument, only one from Royal College of Physicians was found to have high-quality consensus guidelines for diagnosis and management of CRPS. Conclusion: Future CPGs should be backed by systematic literature searches, focus on guidelines clinical translation into clinical practice and applicability to the desired patient population.

Palliative care nurse: A quantitative study of caring for neonates at end-of-life stage

Objective

This study aimed to evaluate the quality of the care provided to newborns at End-of-Life (EOL) stages and compare the care which is already being given to the infants admitted to the NICUs of the selected hospital in (XXX) with the existing standards. Knowing how End-of-Life nursing care is provided, compared with the standard in the terminal stage of neonates’ life can provide accurate information for policies, research, and educational practices.

Methods

In this descriptive study, 100 nursing care services, provided to neonates at the EOL stages and their parents, were observed and compared to the standard checklist which had been developed based on the literature review and existing standards in 2015. The study setting included the NICUs of the four hospitals affiliated to (XXX) The Content and Face Validity of the checklist were determined based on specialists’ comments. The Content Validity Index was 94.85%, and its reliability was evaluated too through the inter-rater correlation coefficient (ICC = 0.715).

Results

Only 11.49% of EOL nursing care services were given properly and 77.92% were not given at all. Results showed that 10.59% of EOL nursing care services were performed improperly.

Conclusion

The overall rate of accordance with the EOL nursing care standards was poor (16.78%). Nursing care given to infants and their parents at EOL stages is far from the standards. This can be due to various reasons, such as inadequate training and the lack of comprehensive guidelines.

•

Knowing how End-of-Life nursing care is provided, comparing with the standard in the terminal stage of neonates' life.

•

The overall rate of accordance with the EOL nursing care standards was poor (16.78%).

•

Nursing care given to infants and their parents at EOL stages is far from the standards.

•

This can be due to various reasons, such as inadequate training and the lack of comprehensive guidelines.

Clinical Practice Guidelines on Sentinel Lymph Node Biopsy for Melanoma: A Systematic Review and Quality Appraisal Using the AGREE II Instrument

Sentinel lymph node biopsy (SLNB) is a minimally invasive surgical procedure that is standard of care for the evaluation of clinically negative regional lymph nodes in patients with cutaneous melanoma. As the presence of metastases dictates patient prognosis and determines the need for further regional disease control or adjuvant therapy, SLNB is invaluable to clinical decision-making in patients presenting with melanoma. However, the indications for SLNB, specifically among patients with thin (<1 mm) or thick (>4 mm) melanomas, remain unclear. A number of clinical practice guidelines (CPGs) have been developed outlining recommendations for the role of lymph node biopsy in the management of melanoma. However, to date, their quality has not been critically appraised. Our objective was to systematically evaluate all available CPGs on this topic using the validated Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Four total guidelines met the inclusion criteria and underwent appraisal. Only one CPG achieved a "high" quality rating, indicating scores of >60% in at least five of the six AGREE II domains. Across all CPGs, the lowest scoring domains were "Applicability" and "Stakeholder involvement," which had average scores of 41.2% and 48.3%, respectively. Based on the AGREE II instrument, the quality of existing CPGs for the indications of SLNB for melanoma is low. Future guidelines should be pilot tested to evaluate barriers to application and should utilize multidisciplinary guideline development teams that include patients and key stakeholders in addition to clinical experts from all relevant disciplines.

Clinical practice guidelines for management of medullary thyroid carcinoma: An AGREE II appraisal

PURPOSE

Medullary thyroid carcinoma (MTC) is a rare and aggressive form of thyroid neoplasia that requires multidisciplinary collaboration for effective management. We systematically appraise the quality of clinical practice guidelines (CPG) for the diagnosis and treatment of MTC using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.

MATERIALS AND METHODS

A systematic literature search was performed to identify CPGs pertaining to the diagnosis and treatment of MTC. Data were abstracted from guidelines meeting inclusion criteria and appraised by four independent reviewers in the six domains of quality defined by the AGREE II. Intraclass correlation coefficients (ICC) were calculated across domains to qualify interrater reliability.

RESULTS

Fourteen guidelines met inclusion criteria. No guideline achieved a score of >60 % in five or more AGREE II quality domains, which is required to gain designation as 'high' quality. One "average quality" guideline authored by the British Thyroid Association achieved a score of >60 % in three quality domains. The remaining thirteen (92.9 %) CPGs demonstrated low quality content, with deficits most pronounced in domains 3, 5, and 6, suggesting a lack of rigorously developed, clinically applicable, and transparent information.

CONCLUSIONS

As the diagnosis and treatment of MTC continues to evolve, the development of high-quality guidelines becomes increasingly important; few existing meet appropriate standards.

Policy Analysis for Prevention and Control of Influenza in Aged Care

OBJECTIVE

This study aimed to analyze national influenza infection control policy documents within aged care settings by identifying the consistencies, inconsistencies, and gaps with the current evidence and by evaluating methodological quality. Aged care providers can use these findings to identify their policy documents' strengths and weaknesses.

DESIGN

A quality and content analysis of national level policy documents.

SETTING AND PARTICIPANTS

Aged care settings rely on national agencies' policy recommendations to control and prevent outbreaks. There is limited research on the effectiveness of control measures to prevent and treat influenza within aged care settings. Because of the complexities around aged care governance, the primary responsibility in developing a comprehensive facility-level, infection-prevention policy, falls to the providers.

METHODS

The analysis was conducted using the (1) International Appraisal of Guidelines, Research and Evaluation assessment tool, containing 23 items across 6 domains; and the (2) Influenza Related Control Measures in Aged Care settings checklist, developed by the authors, with 82 recommendations covering: medical interventions, nonmedical interventions, and physical layout.

RESULTS

There were 19 documents from 9 different high-income countries, with a moderately high methodological quality in general. The quality assessment's average score was 40.2% (95% CI 31.9%-44.7%). "Stakeholder involvement" ranked third, and "Editorial independence" and "Rigor of development" had the lowest average scores across all domains. The content analysis' average score was 37.2% (95% CI 10.5%-21.5%). The highest scoring document (59.1%) included term definitions, cited evidence for recommendations, and clear measurable instructions. "Physical Layout" had the least coverage and averaged 21.9% (95% CI 4.2%-37.5%), which shows a substantial gap in built environment recommendations.

CONCLUSIONS AND IMPLICATIONS

Existing policy documents vary in their comprehensiveness. The higher scoring documents provide an ideal model for providers. The checklist tools can be used to assess and enhance documents. Further research on document end-user evaluation would be useful, as there is room for improvement in methodological quality and coverage of recommendation coverage, especially related to physical layout.

Quality appraisal of clinical practice guidelines for the use of radiofrequency ablation in the treatment of thyroid nodules and cancer

INTRODUCTION

Radiofrequency ablation (RFA) has gained significant recent global interest in the treatment of benign thyroid nodules and thyroid cancer. It is a relatively new, minimally invasive, thermal ablation technique that is an alternative to surgery. Several clinical practice guidelines (CPGs), consensus statements, and recommendations currently exist for the use of RFA in the treatment of benign thyroid nodules and thyroid cancers. These documents have considerable variability amongst them, and to date, their quality and methodologic rigor have not been appraised.

OBJECTIVE

To identify and perform a quality appraisal of clinical practice guidelines for RFA in the treatment of benign thyroid nodules and thyroid cancer using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool.

METHODS

A comprehensive literature search was performed in MEDLINE (via PubMed), EMBASE, and SCOPUS databases from inception to November 1, 2021. Four reviewers independently evaluated each guideline using the AGREE II instrument. Scaled domain scores were generated and the threshold used for satisfactory quality was >60%. Additionally, intraclass correlation coefficients (ICCs) were calculated to determine level of agreement between reviewers.

RESULTS

Seven guidelines were selected for final evaluation based on inclusion/exclusion criteria. Two guidelines were classified "high" quality, one "average" quality, and the rest "low" quality. The "Clarity and Presentation" (65.68 ± 26.1) and "Editorial Independence" (61.32 ± 25.8) domains received the highest mean scores, while the "Applicability" (32.14 ± 22.8) and "Rigor of Development" (45.02 ± 29.8) domains received the lowest mean scores. ICC statistical analysis showed high magnitude of agreement between reviewers with a range of (0.722-0.944).

CONCLUSION

Reflecting upon our quality appraisal, it is evident that the quality and methodologic rigor of RFA guidelines can be improved upon in the future. Our findings also elucidate the existing variability/discrepancies amongst guidelines in the indications and use of RFA.

Community engagement by faculties of medicine: A scoping review of current practices and practical recommendations

PURPOSE

Social accountability (SA) is the responsibility of faculties of medicine (FoMs) to address the health priorities of the communities they serve. Community engagement (CE) is a vital, but often ambiguous, component of SA. Practical guidance on how to engage community partners (CPs) is key for meaningful CE. We conducted a systematic scoping review of CE involving FoMs to map out how FoMs engage their communities, to provide practical recommendations for FoMs to take part in CE, and to highlight gaps in the literature.

MATERIALS AND METHODS

We searched electronic databases for articles describing projects or programs involving FoMs and CPs. Descriptive information was analyzed thematically.

RESULTS

Thirty-eight of 1406 articles were included, revealing three themes: (1) Partners (Who to Engage)-deciding who to engage establishes the basis for responsibility and creates space for communities to engage FoMs; (2) Partnerships (How to Engage)-fostering creative and authentic collaboration, enabling meaningful community contributions; and (3) Projects and Programs (With What to Engage)-identifying opportunities for communities to have a voice in many spaces within FoMs. Under these themes emerged 32 practical recommendations.

CONCLUSION

Practical guidance facilitates meaningful commitments to communities. The literature is rich with examples of community-FoM partnerships. We provide recommendations for CE that are clear, evidence-based, and responsive.

Extra-Cranial Carotid Artery Stenosis: An Objective Analysis of the Available Evidence

Background and Purpose

Carotid stenosis is arterial disease narrowing of the origin of the internal carotid artery (main brain artery). Knowing how to best manage this is imperative because it is common in older people and an important cause of stroke. Inappropriately high expectations have grown regarding the value of carotid artery procedures, such as surgery (endarterectomy) and stenting, for lowering the stroke risk associated with carotid stenosis. Meanwhile, the improving and predominant value of medical intervention (lifestyle coaching and medication) continues to be underappreciated.

Methods and Results

This article aims to be an objective presentation and discussion of the scientific literature critical for decision making when the primary goal is to optimize patient outcome. This compilation follows from many years of author scrutiny to separate fact from fiction. Common sense conclusions are drawn from factual statements backed by original citations. Detailed research methodology is given in cited papers. This article has been written in plain language given the importance of the general public understanding this topic. Issues covered include key terminology and the economic impact of carotid stenosis. There is a summary of the evidence-base regarding the efficacy and safety of procedural and medical (non-invasive) interventions for both asymptomatic and symptomatic patients. Conclusions are drawn with respect to current best management and research priorities. Several "furphies" (misconceptions) are exposed that are commonly used to make carotid stenting and endarterectomy outcomes appear similar. Ongoing randomized trials are mentioned and why they are unlikely to identify a routine practice indication for carotid artery procedures. There is a discussion of relevant worldwide guidelines regarding carotid artery procedures, including how they should be improved. There is an outline of systematic changes that are resulting in better application of the evidence-base.

Conclusion

The cornerstone of stroke prevention is medical intervention given it is non-invasive and protects against all arterial disease complications in all at risk. The "big" question is, does a carotid artery procedure add patient benefit in the modern era and, if so, for whom?

The International Guideline Evaluation Screening Tool (IGEST): development and validation

Background

Guideline adaptation provides an important alternative to de novo guideline development by making the process more efficient and reducing unnecessary duplication. The quality evaluation of international guidelines is an essential part of the adaptation process.

The study aims at describing the development and validation of a new tool to screen trustworthy Clinical Practice Guidelines (CPGs) for their adoption/adaption: the International Guideline Evaluation Screening Tool (IGEST).

Methods

The process of developing the IGEST involved two main phases: 1) tool development and 2) content validation. The tool development phase comprised three stages, where the scope of the IGEST was defined and the item pool was generated and refined. The content validation was performed through the computation of a content validity index (CVI) based on the opinions of an expert panel.

Results

All the items obtained a CVI >0.78, which resulted in the validation of the instrument. The final instrument comprised four preliminary conditions and 12 criteria organised into three dimensions: (i) the management of conflict of interest; (ii) the quality of evidence and the coherence between evidence and recommendations; and (iii) the panel composition.

Conclusion

The IGEST showed good content validity for assessing the quality of international guidelines. Using the new tool to select trustworthy guidelines might increase the likelihood that international clinical practice guidelines will be adopted/adapted to the local context by allowing a quick screening of existing guidelines trustworthiness and providing an acceptability threshold that supports the decision-making process.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01618-5.

Clinical practice guidelines for pain management after tonsillectomy: Systematic quality appraisal using the AGREE II instrument

PURPOSE

We identified and appraised clinical practice guidelines (CPGs) for the management of post-tonsillectomy pain using the Appraisal of Guidelines for Research and Evaluation (AGREE II) guideline research tool.

MATERIALS AND METHODS

We conducted a literature search to identify CPGs addressing pain management after tonsillectomy. CPGs meeting inclusion criteria were then appraised by four independent reviewers in six areas of quality, as defined by AGREE II. Scaled domain scores were calculated for each quality domain. Intraclass correlation coefficients (ICC) were calculated in each domain to assess interrater reliability across guideline appraisals.

RESULTS

Nine guidelines meeting inclusion criteria were identified from a systematic search of the literature. The American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) guideline detailing tonsillectomy and postoperative management in pediatric patients received the highest average score, with a mean of 90.1% in the six areas of quality. Three guidelines scored higher than >60% in five domains or more, defining 'high' quality per AGREE II: AAO-HNS, Scottish Intercollegiate Guides Network (SIGN), and Ontario Ministry of Health CPGs. The highest-scoring domain was domain 4: Clarity of presentation (87.4%) across guidelines, while the lowest scoring domain was domain 5: Applicability (49.4%). Variability in scaled domain scores between all CPGs was relatively consistent across domains, with a mean standard deviation of 22.4%. The average ICC calculated across all six domains was 0.78, indicating 'strong agreement' between reviewers regarding guideline quality.

CONCLUSION

Of the nine available guidelines detailing pain management following tonsillectomy we identified, only three (33%) were deemed 'high'-quality after appraisal using the AGREE II instrument, suggesting a need for development of novel, methodologically rigorous CPGs.

Quality appraisal of clinical practice guidelines for temporomandibular joint disorders using the AGREE II instrument

OBJECTIVE

We sought to systematically assess the quality of all clinical practice guidelines (CPGs) describing diagnosis and management of temporomandibular joint disorders (TMDs) using the Appraisal of Guidelines for Research and Evaluation instrument.

STUDY DESIGN

CPGs detailing all aspects of diagnosis and management (both conservative and nonconservative) for TMDs were reviewed.

RESULTS

Thirteen guidelines met inclusion criteria. The highest-scoring domain across guidelines was clarity of presentation (68.3%); the lowest-scoring domain was editorial independence (31.9%). The highest-scoring guideline described traditional Korean medicine approaches to the management of TMDs, earning a mean score of 79.2% across the six quality domains. Only three CPGs met a quality threshold of >60% in at least five domains, qualifying as 'high' per the Appraisal of Guidelines for Research and Evaluation criteria: these guidelines were the Korean medicine guidelines, Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) guidelines for diagnostic classification of TMDs, and the Japanese Society for the Temporomandibular Joint guidelines. An average intraclass correlation coefficient of 0.79 was calculated across all domains, denoting very strong agreement between independent reviewers.

CONCLUSION

We identified a significant lack of quality in multiple areas of CPG development for the diagnosis and therapeutic management of TMDs, suggesting a need for new comprehensive and rigorously developed guidelines addressing TMDs.

Clinical Practice Guidelines in the Management of Breakthrough Cancer Pain: A Systematic Review using the Appraisal of Guidelines for Research and Evaluation (AGREE II) Instrument

BACKGROUND

Several clinical practice guidelines (CPGs), consensus statements, and recommendations currently exist for the diagnosis and management of breakthrough cancer pain (BTcP). These documents have considerable variability amongst them, and to date, their quality and methodologic rigor have not been appraised.

AIM

We aim to identify and perform a quality appraisal of CPGs for the diagnosis and management of BTcP using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool.

METHODS

A comprehensive literature search was performed in MEDLINE (via PubMed), EMBASE, and SCOPUS databases up until January 1, 2021. Four reviewers independently evaluated each guideline using the AGREE II instrument. Scaled domain scores were generated and the threshold used for satisfactory quality was >60%. Additionally, intraclass correlation coefficients (ICC) were calculated to determine level of agreement between reviewers.

RESULTS

Eleven guidelines were selected for final evaluation based on inclusion/exclusion criteria. Only one guideline was classified of "average" quality while the rest were classified as "low" quality. The "Editorial Independence" (70.46 ± 35.7) and "Scope and Purpose" (64.78 ± 12.5) domains received the highest mean scores, while the "Applicability" (32.58 ± 13.5) and "Rigor of Development" (35.04 ± 9.0) domains received the lowest mean scores. ICC statistical analysis showed high magnitude of agreement between reviewers with a range of (0.790-0.988).

CONCLUSIONS

Reflecting upon our quality appraisal, it is evident that the quality and methodologic rigor of BTcP guidelines can be improved upon in the future. Our findings also elucidate the existing variability/discrepancies among guidelines in diagnostic criteria and management of BTcP.

European clinical practice guidelines on the use of chemotherapy for advanced oesophageal and gastric cancers: a critical review using the AGREE II and the AGREE-REX instruments

PURPOSE

To assess the methodological quality of all relevant and recent European clinical practice guidelines (CPGs) for advanced oesophageal and gastric cancers, and to synthesise their recommendations on the use of chemotherapy.

METHODS

We searched PubMed, EMBASE, guidelines repositories, and other sources from 2010 onwards. We appraised quality using AGREE-II and AGREE-REX.

RESULTS

11 CPGs were included (five high, five low, and one moderate quality). Most guidelines showed deficiencies in the domain "applicability", with only three scoring above 60%. Nine did not report having sought the views and preferences of the target population. The lowest scores for AGREE-REX were item Values and Preferences of Target Users (1.6; SD 1.3), and item Values and Preferences of Policy/Decision-Makers (1.8; SD 1.7). The domain Clinical Applicability got the highest score and the domain Implementability got the lowest.

CONCLUSIONS

An urgent area of research is how to develop credible and implementable recommendations on the clinical use of CT for advanced oesophageal and gastric cancer.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO (CRD42021236753).

Clinical Practice Guidelines on Pediatric Gastroesophageal Reflux Disease: A Systematic Quality Appraisal of International Guidelines

PURPOSE

While regurgitation is a common and often benign phenomenon in infants and younger children, it can also be a presenting symptom of gastroesophageal reflux disease (GERD). If untreated, GERD can lead to dangerous or lifelong complications. Clinical practice guidelines (CPGs) have been published to inform clinical diagnosis and management of pediatric GERD, but to date there has been no comprehensive review of guideline quality or methodological rigor.

METHODS

A systematic literature search was performed, and a total of eight CPGs pertaining to pediatric GERD were identified. These CPGs were evaluated using the Appraisal of Guidelines for Research and Evaluation instrument.

RESULTS

Three CPGs were found to be "high" quality, with 5 of 6 domains scoring >60%, one "average" quality, with 4 of 6 domains meeting that threshold, and the remaining four "low" quality.

CONCLUSION

Areas of strength among the CPGs included "Scope and Purpose" and "Clarity and Presentation," as they tended to be well-written and easily understood. Areas in need of improvement were "Stakeholder Involvement," "Rigor of Development," and "Applicability," suggesting these CPGs may not be appropriate for all patients or providers. This analysis found that while strong CPGs pertaining to the diagnosis and treatment of pediatric GERD exist, many published guidelines lack methodological rigor and broad applicability.

Quality of recent clinical practice guidelines in anaesthesia publications using the Appraisal of Guidelines for Research and Evaluation II instrument

Clinical practice guidelines are a valuable resource aiding medical decision-making based on scientific evidence. In anaesthesia, guidelines are increasing in both number and scope, influencing individual practice and shaping local departmental policy. The aim of this review is to assess the quality of clinical practice guidelines published in high impact anaesthesia journals over the past 5 yr using the internationally validated Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. A literature search was conducted in Scopus to identify all guidelines published in the top 10 anaesthesia journals as per Clarivate Analytics Impact Factor from 2016 and 2020. Fifty-one guidelines were included for analysis by five independent appraisers using AGREE II. Each guideline was assessed across six domains and 23 items. Individual domain scores were calculated with a threshold agreed via consensus to represent high-quality guidelines. There was a significant increase in overall score over time (P=0.041), driven by Domain 3 (Rigour of Development, P=0.046). The raw overall score for Domain 3, however, was low. The other domains performed as expected based on previous studies, with Domains 1, 4, and 6 achieving high scores and Domains 2 and 5 incurring poor ratings. Most guidelines studied involved international collaboration but emerged from a single professional society. Use of an appraisal tool was stated as high but poorly detailed. The improvement in the overall score of guidelines and rigour of development is promising; however, only seven guidelines met high-quality criteria, suggesting room for improvement for the overall integrity of guidelines in anaesthesia.

The quality of guidelines for treatment of carotid artery disease: a critical appraisal using the AGREE II instrument

Abstract Clinical Practice Guidelines (CPG) are structured recommendations based on systematic reviews of the available evidence and are useful tools to support clinical decision-making. However, studies have raised concerns about the methodological and scientific quality of several CPG, which can affect their application in clinical practice. The objective of this study was to perform a systematic appraisal of the methodological quality of carotid atherosclerotic disease clinical guidelines, published from 2000 to 2019, using the AGREE II instrument (Appraisal of Guidelines for Research and Evaluation Instrument II). The appraisers independently assessed the quality of the CPG included in the study for each of the 6 domains of the AGREE II tool. The CPG were rated as high, moderate, or low quality using a points scale. A total of 9 CPGs were selected for appraisal. Except for domain 2 (kappa=0.715), excellent agreement was observed between the appraisers (kappa>0.75). Five of the CPGs were rated as high overall methodological quality rating, 5 were rated as moderate overall methodological quality, and 2 were rated low overall methodological quality. The authors conclude that: (1) appraisal of carotid atherosclerotic disease clinical guidelines using the AGREE II instrument is feasible, with a high degree of agreement among appraisers; and (2) that most CPGs on the management of atherosclerotic carotid disease have high methodological quality.

A quality assessment of clinical practice guidelines with recommendations for family involvement in the care of individuals diagnosed with schizophrenia, bipolar mood disorder, and major depressive disorder: Critical appraisal utilizing AGREE II

INTRODUCTION

Evidence suggests that family-center collaborative care is useful for individuals identified with chronic mental illness. Clinical practice guidelines offer specific recommendations primarily based on to be had studies and are beneficial in informing evidence-based practice and guiding destiny studies.

OBJECTIVE

Identify current scientific practice guidelines including family-center collaborative care suggestions for individuals with Bipolar Mood Disorder, Schizophrenia, and Major Depressive Disorder and analyze the selection of guidelines for their methodological quality.

METHODS

A systematic search was conducted on seven electronic databases (G-I-N), (NICE), (MOH), (SIGN), (WHO), (NIH) and (APA) and additional sources. Three referees independently reviewed articles and selected guidelines for inclusion criteria. Subsequently, 18 trained appraisers independently assessed all 15 guidelines using AGREE II.

RESULTS

The mean scores for domains and overall quality were computed. For the overall assessment of the guidelines, 60% reached the quality threshold with domain scores of 60%. The overall average quality rating for these guidelines was 58/29%.

CONCLUSION

The applicability of the guidelines needs to be improved in order to improve their relevance and clinical utilization. As individuals with chronic mental illnesses progress through their disease course, families and health care providers play a crucial role in helping them. The analysis of research knowledge on effective rehabilitation techniques, including the involvement of families in treatment, can be enhanced by using well-developed and appropriate methods.

Appraisal and development of evidence-based clinical decision support to enable perioperative pharmacogenomic application

Variable responses to medications complicates perioperative care. As a potential solution, we evaluated and synthesized pharmacogenomic evidence that may inform anesthesia and pain prescribing to identify clinically actionable drug/gene pairs. Clinical decision-support (CDS) summaries were developed and were evaluated using Appraisal of Guidelines for Research and Evaluation (AGREE) II. We found that 93/180 (51%) of commonly-used perioperative medications had some published pharmacogenomic information, with 18 having actionable evidence: celecoxib/diclofenac/flurbiprofen/ibuprofen/piroxicam/CYP2C9, codeine/oxycodone/tramadol CYP2D6, desflurane/enflurane/halothane/isoflurane/sevoflurane/succinylcholine/RYR1/CACNA1S, diazepam/CYP2C19, phenytoin/CYP2C9, succinylcholine/mivacurium/BCHE, and morphine/OPRM1. Novel CDS summaries were developed for these 18 medications. AGREE II mean ± standard deviation scores were high for Scope and Purpose (95.0 ± 2.8), Rigor of Development (93.2 ± 2.8), Clarity of Presentation (87.3 ± 3.0), and Applicability (86.5 ± 3.7) (maximum score = 100). Overall mean guideline quality score was 6.7 ± 0.2 (maximum score = 7). All summaries were recommended for clinical implementation. A critical mass of pharmacogenomic evidence exists for select medications commonly used in the perioperative setting, warranting prospective examination for clinical utility.

A systematic quality appraisal of clinical practice guidelines for Ménière's disease using the AGREE II instrument

PURPOSE

To systematically appraise clinical practice guidelines for the diagnosis and treatment of Ménière's disease using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument.

MATERIALS AND METHODS

A systematic literature search was performed to identify guidelines pertaining to the diagnosis and treatment of Ménière's disease. Data were abstracted from guidelines that met inclusion criteria and appraised by four independent reviewers in the six domains of quality defined by the AGREE II. Domain scores reflecting quality in each domain were calculated. Intraclass correlation coefficients (ICC) were calculated across domains to qualify interrater reliability.

RESULTS

Six guidelines were found to meet inclusion criteria after a systematic literature search. Of the six clinical practice guidelines appraised using the AGREE II, the American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) guideline received the highest average score, with a mean of 90.7% spanning six quality domains. The guideline with the lowest average score across all domains was the European Position Statement on diagnosis and treatment of Ménière's disease, receiving an average score across domains of 34.6%. Overall quality scores of clinical practice guidelines for Ménière's disease had a standard deviation of 21.3%. Two guidelines met the quality threshold of > 60% in at least five domains, qualifying as 'high': AAO-HNS and National Institute for Health and Care Excellence. Average ICC across all six domains was 0.87, suggesting near total agreement between reviewers.

CONCLUSION

Ménière's disease remains a challenging entity to diagnose and treat; few existing clinical guidelines meet the standards of quality established by the AGREE II appraisal instrument.

Clinical practice guidelines for the prevention and management of frailty: A systematic review

AIMS

To systematically search for clinical practice guidelines focusing on the prevention and management of frailty, to evaluate their methodological quality and to synthesize the consensus recommendations.

DESIGN

A systematic review.

DATA SOURCES

Guideline websites, related professional association websites and electronic databases were systematically searched through 4 November 2020.

REVIEW METHODS

We evaluated the methodological quality of the eligible guidelines using the Appraisal of Guidelines Research and Evaluation II (AGREE II). Two reviewers synthesized the consensus recommendations proposed by at least two guidelines.

RESULTS

Eight guidelines met the eligibility criteria and were included in the review. The mean scores of the six domains were as follows: the 'scope and purpose' domain scored 88.0%, the 'clarity of presentation' domain scored 81.9%, the 'stakeholder involvement' domain scored 63.4%, the 'editorial independence' domain scored 62.2%, the 'rigour of development' domain scored 61.1% and the 'applicability' domain scored 57.8%. In total, we synthesized 23 recommendations for the prevention and management of frailty that are consistent among the included guidelines.

CONCLUSIONS

The number of clinical practice guidelines for the prevention and management of frailty is limited. The methodological quality of existing guidelines needs to be improved. Our synthesized findings provide an intuitive, convenient and summative reference resource for frailty prevention and management. It' is worth noting that recommendations described in the included guidelines require additional detail.

IMPACT

Although the prevention and management of frailty is urgent, there is currently a lack of evidences guiding these processes, especially in the prevention. The methodological quality of existing guidelines is insufficient, and the recommendations described in the guidelines require additional detail. Therefore, users of these guidelines, especially nurses, should make a careful decision according to the specific situation when using. Nurses also have a key role in providing more clinical evidences for the improvement of the quality of the guidelines.

What Determines the Quality of Rehabilitation Clinical Practice Guidelines?: An Overview Study

OBJECTIVE

The aim of the study was to determine what factors determine the quality of rehabilitation clinical practice guidelines.

DESIGN

Six databases were searched for articles that had applied the Appraisal of Guidelines for Research & Evaluation II quality assessment tool to rehabilitation clinical practice guidelines. The 573 deduplicated abstracts were independently screened by two authors, resulting in 81 articles, the full texts of which were independently screened by two authors for Appraisal of Guidelines for Research & Evaluation II application to rehabilitation clinical practice guidelines, resulting in a final selection of 40 reviews appraising 504 clinical practice guidelines. Data were extracted from these by one author and checked by a second. Data on each clinical practice guideline included the six Appraisal of Guidelines for Research & Evaluation II domain scores, as well as the two Appraisal of Guidelines for Research & Evaluation II global evaluations.

RESULTS

All six Appraisal of Guidelines for Research & Evaluation II domain scores were statistically significant predictors of overall clinical practice guideline quality rating; D3 (rigor of development) was the strongest and D1 (scope and purpose) the weakest (overall model P < 0.001, R2 = 0.53). Five of the six domain scores were significant predictors of the clinical practice guideline use recommendation, with D3 the strongest predictor and D5 (applicability) the weakest (overall model P < 0.001, pseudo R2 = 0.53).

CONCLUSIONS

Quality of rehabilitation clinical practice guidelines may be improved by addressing key domains such as rigor of development.

EAU, AUA and NICE Guidelines on Surgical and Minimally Invasive Treatment of Benign Prostate Hyperplasia: A Critical Appraisal of the Guidelines Using the AGREE-II Tool

OBJECTIVE

To critically appraise the methodological rigour of the clinical practice guidelines (CPGs) vis-à-vis BPH surgery as used by specialist research associations in the US, Europe and UK, and to compare whether the guidelines cover all or only some of the available treatments.

METHODS

The current guidelines issued by the EUA, AUA and NICE associations have been analyzed by 4 appraisers using the AGREE-II instrument. We also compared the recommendations given in the guidelines for surgical and minimally invasive treatment to find out which of these CPGs include most of the available treatment options.

RESULTS

According to the AGREE II tool, the median scores of domains were: domain 1 scope and purpose 66.7%, domain 2 stakeholder involvement 50.0%, domain 3 rigor of development 65.1%, domain 4 clarity of presentation 80.6%, domain 5 applicability 33.3%, domain 6 editorial independence 72.9%. The overall assessment according to AGREE II is 83.3%. The NICE guideline scored highest on 5 out of 6 domains and the highest overall assessment score (91.6%). The EAU guideline scored lowest on 4 out of 6 domains and has the lowest overall assessment score (79.1%).

CONCLUSIONS

The analyzed CPGs comprehensively highlight the minimally invasive and surgical treatment options for BPH. According to the AGREE II tool, the domains for clarity of presentation and editorial independence received the highest scores. The stakeholder involvement and applicability domains were ranked as the lowest. Improving the CPG in these domains may help to improve the clinical utility and applicability of CPGs.

Methodological quality of guidelines for the management of opioid use disorder: A systematic review

WHAT IS KNOWN AND OBJECTIVE

Opioid Use Disorder (OUD) has a high mortality rate and affects millions of people worldwide. Many organizations and societies develop Clinical Practice Guidelines (CPGs) to serve as a framework for healthcare providers to decide and support best practice to manage and treat OUD. However, not all CPGs sufficiently address all the important aspects of optimal care for managing OUD. This study aims to review current CPGs for management of OUD, evaluate their methodological quality and summarize their recommendations.

METHODS

We conducted this systematic review according to Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA). Various databases were searched for CPGs and Appraisal of Guidelines for Research and Evaluation (AGREE-II) instrument was used to assess the methodological quality. We also summarized the treatments plans of CPGs across continuum of care (diagnosis and assessment, treatment initiation, pharmacotherapy and psychosocial).

RESULTS

This review included 28 CPGs of varying qualities. CPGs from high-income countries and international organizations rated high for their methodological quality. Most CPGs scored high for the scope and purpose domain and scored low for applicability domain. Recommendations for the continuum of care for OUD varied across CPGs. Buprenorphine was recommended in most of the CPGs, followed by methadone. Recommendations for psychosocial interventions also varied, with cognitive behaviour therapies and counselling or education being the common recommendations in many CPGs WHAT IS NEW AND CONCLUSION: We found most CPGs have scope and purpose and clarity of presentation. However, the methodological rigour and applicability scored low. CPGs need to frame health questions in a comprehensible manner and provide an update as evidence grows. It is important for CPG developers to consider methodological quality as a factor when developing CPG recommendations.