Evaluation of the reporting quality of clinical practice guidelines on lung cancer using the RIGHT checklist

Quality appraisal of clinical guidelines for Helicobacter pylori infection and systematic analysis of the level of evidence for recommendations

OBJECTIVES

To systematically assess the quality of clinical practice guidelines (CPGs) for Helicobacter pylori (HP) infection and identify gaps that limit their development.

STUDY DESIGN AND SETTING

CPGs for HP infection were systematically collected from PubMed, Embase, the Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature, and six online guideline repositories. Three researchers independently used the AGREE Ⅱ tool to evaluate the methodological quality of the eligible CPGs. In addition, the reporting and recommendation qualities were appraised by using the RIGHT and AGREE-REX tools, respectively. The distribution of the level of evidence and strength of recommendation among evidence-based CPGs was determined.

RESULTS

A total of 7,019 records were identified, and 24 CPGs met the eligibility criteria. Of the eligible CPGs, 19 were evidence-based and 5 were consensus-based. The mean overall rating score of AGREE II was 50.7% (SD = 17.2%). Among six domains, the highest mean score was for scope and purpose (74.4%, SD = 17.7%) and the lowest mean score was for applicability (24.3%, SD = 8.9). Only three of 24 CPGs were high-quality. The mean overall score of recommendation quality was 35.5% (SD = 12.2%), and the mean scores in each domain of AGREE-REX and RIGHT were all ≤ 60%, with values and preferences scoring the lowest (16.6%, SD = 11.9%). A total of 505 recommendations were identified. Strong recommendations accounted for 64.1%, and only 34.3% of strong recommendations were based on high-quality evidence.

CONCLUSION

The overall quality of CPGs for HP infection is poor, and CPG developers tend to neglect some domains, resulting in a wide variability in the quality of the CPGs. Additionally, CPGs for HP infection lack sufficient high-quality evidence, and the grading of recommendation strength should be based on the quality of evidence. The CPGs for HP infection have much room for improvement and further researches are required to minimize the evidence gap.

Treatments for non-small cell lung cancer: a systematic quality assessment of clinical practice guidelines

AIM

To evaluate the methodological quality of clinical practice guidelines (CPGs) on treatments for non-small cell lung cancer (NSCLC).

METHODS

We searched MEDLINE, CPG developer websites, lung cancer societies, and oncology organizations to identify CPGs providing recommendations on treatments for NSCLC. The methodological quality for each CPG was determined independently by three appraisers using the AGREE II (Appraisal of Guidelines for Research and Evaluation II) instrument.

RESULTS

Twenty-two CPGs met the eligibility criteria. The median scores per AGREE II domain were: scope and purpose 90.7% (64.8-100%), stakeholder involvement 76.9% (27.8-96.3%); rigor of development 80.9% (27.1-92.4%); clarity of presentation 89.8% (50-100%); applicability 46.5% (12.5-87.5%); and editorial independence 91.7% (27.8-100%). Most of the CPGs (54.5%) were rated as "recommended with modifications" for clinical use.

CONCLUSIONS

Overall, the methodological quality of CPGs proving recommendations on the management of NSCLC is moderate, but there is still room for improvement in their development and implementation.

Evidence mapping of clinical practice guidelines recommendations and quality for depression in children and adolescents

This study systematically reviewed the clinical practice guidelines (CPGs) for depression in children and adolescents and assessed the quality and recommendation consistency of those CPGs. Evidence mapping was presented to illustrate the research trends and identify gaps to guide future research. Literature on CPGs for depression was systematically collected from PubMed, Embase, Web of Science, guideline databases, and psychiatric association/ society websites. The basic information, recommendations, methodological quality, and reporting quality of CPGs were extracted, and the supporting evidence strength for the included CPGs was analyzed in Excel. Four appraisers independently assessed the eligible CPGs using AGREE II instrument and the RIGHT checklist. All recommendations from the CPGs were summarized and analyzed, and the evidence mapping bubble charts were plotted in Excel. After excluding 15,184 records, 12 depression CPGs were eventually proved eligible, six of which were of high quality and six medium quality. A total of 39 major recommendations were summarized, 35 of which were supported by high-quality CPGs. Although direct comparisons are challenging due to differences in grading schemes and research quality, most CPGs share many pivotal recommendations that can help guide clinical practice. However, the evidence for some clinical problems is still lacking. Thus, more research is necessary on the screening and treatment of children and adolescents to put forward more evidence-based and high-quality recommendations.

Initial low-dose computed tomography screening results and summary of participant characteristics: based on the latest Chinese guideline

Background

Low-dose computed tomography (LDCT) has been promoted as a promising screening strategy for early detection of lung cancer. China released the latest lung cancer screening guideline in 2021. The compliance of the individuals who received LDCT for lung cancer screening with the guideline is unknown yet. It is necessary to summarize the distribution of guideline-defined lung cancer-related risk factors in the Chinese population so as to inform the selection of target population for the future lung cancer screening.

Methods

A single-center, cross-sectional study design was adopted. All participants were individuals who underwent LDCT at a tertiary teaching hospital in Hunan, China, between 1 January and 31 December 2021. LDCT results were derived along with guideline-based characteristics for descriptive analysis.

Results

A total of 5,486 participants were included. Over one-quarter (1,426, 26.0%) of the participants who received screening did not meet the guideline-defined high-risk population, even among non-smokers (36.4%). Most of the participants (4,622, 84.3%) were found to have lung nodules, while no clinical intervention was required basically. The detection rate of positive nodules varied from 46.8% to 71.2% when using different cut-off values for positive nodules. Among non-smoking women, ground glass opacity appeared to be more significantly common compared with non-smoking men (26.7% vs. 21.8%).

Conclusion

Over one-quarter of individuals who received LDCT screening did not meet the guideline-defined high-risk populations. Appropriate cut-off values for positive nodules need to be continuously explored. More precise and localized criteria for high-risk individuals are needed, especially for non-smoking women.

A critical appraisal of clinical practice guidelines on insomnia using the RIGHT statement and AGREE II instrument

OBJECTIVE

Clinical Practice Guidelines (CPGs) have an indispensable role in guiding the selection of various treatments for insomnia, however, little is known about the quality of released insomnia CPGs. This study aims to critically appraise the quality of existing insomnia CPGs and identify quality limitations.

METHODS

PubMed, Web of Science, Embase, China National Knowledge Infrastructure, Wanfang, China Biology Medicine disc, and 6 databases of international guideline developing institutions were systematically searched. CPGs on the diagnosis or treatment of insomnia were included. Reviewers independently extracted basic information and development methods, and assessed methodological quality and reporting quality using the Appraisal of Guidelines for Research and Evaluation (AGREE) II tool and Reporting Items for practice Guidelines in Healthcare (RIGHT) checklist respectively. Intraclass correlation coefficients (ICCs) were used to measure the agreement among reviewers and assess inter-rater reliability.

RESULTS

Twenty-six CPGs were identified that focused on adults, children, or children with autistic spectrum disorder, patients in the intensive care unit, patients with cancer and pregnant, lactating or menopausal women. Twenty-two CPGs used nine grading systems to rate the level of evidence and strength of recommendation. 53.85% CPGs were classified as "recommended with modification" according to the AGREE II scores (ICC from 0.64 to 0.90), and 2 CPGs were "recommended". The "clarity of presentation" domain achieved the highest mean score (67.9% ± 11.04%) but the "applicability" domain (37.1% ± 12.67%) achieved the lowest. The average reporting rate of RIGHT items in all guidelines was 67.87%.

CONCLUSIONS

The quality of guidelines varied substantially. Guideline developers should realize the importance of guideline applicability, patients' preferences and values.

Quality Assessment of Cancer Pain Clinical Practice Guidelines

Introduction

Several clinical practice guidelines (CPGs) for cancer pain have been published; however, the quality of these guidelines has not been evaluated so far. The purpose of this study was to evaluate the quality of CPGs for cancer pain and identify gaps limiting knowledge.

Methods

We systematically searched seven databases and 12 websites from their inception to July 20, 2021, to include CPGs related to cancer pain. We used the validated Appraisal of Guidelines for Research and Evaluation Instrument II (AGREE II) and Reporting Items for Practice Guidelines in Healthcare (RIGHT) checklist to assess the methodology and reporting quality of eligible CPGs. The overall agreement among reviewers with the intraclass correlation coefficient (ICC) was calculated. The development methods of CPGs, strength of recommendations, and levels of evidence were determined.

Results

Eighteen CPGs published from 1996 to 2021 were included. The overall consistency of the reviewers in each domain was acceptable (ICC from 0.76 to 0.95). According to the AGREE II assessment, only four CPGs were determined to be recommended without modifications. For reporting quality, the average reporting rates for all seven domains of CPGs was 57.46%, with the highest domain in domain 3 (evidence, 68.89%) and the lowest domain in domain 5 (review and quality assurance, 33.3%).

Conclusion

The methodological quality of cancer pain CPGs fluctuated widely, and the complete reporting rate in some areas is very low. Researchers need to make greater efforts to provide high-quality guidelines in this field to clinical decision-making.