The quality of guidelines on the end-of-life care: a systematic quality appraisal using AGREE II instrument

Reflections on an Evidence Review Process to Inform the Co-Design of a Toolkit for Supporting End-of-Life Care Planning With People With Intellectual Disabilities

INTRODUCTION

There is growing recognition that healthcare inequalities faced by people with intellectual disabilities extend to their experiences at the end of life, resulting in calls for more inclusive research to help address these inequities. Our study aimed to address this through the co-design of a toolkit for supporting end-of-life care planning with people with intellectual disabilities. To inform the co-design process, we undertook an evidence review to identify existing tools, resources and approaches that were already being used in practice.

METHODS

Our evidence review comprised three components: (i) a rapid scoping review of the academic literature, (ii) a desk-based search of the grey literature and (iii) an online survey to capture unpublished resources that were distributed to services, professionals, third-sector organisations and family members. A longlist of existing materials was appraised using an adapted version of the AGREE II instrument, resulting in a shortlist that was shared with the co-design team.

RESULTS

The evidence review played a critical role in the co-design of a new toolkit of end-of-life care resources for people with intellectual disabilities. However, AGREE II proved to be limited for our purposes.

CONCLUSIONS

The survey was particularly useful in helping us identify resources, tools and approaches in current use. We identified evidence review processes that served to support co-design team activities and elements that were more problematic. We argue that evidence review practices might be enhanced to better aid co-design activities in health and care research, particularly for studies involving people with intellectual disabilities.

PATIENT OR PUBLIC CONTRIBUTION

This article reflects on an evidence review that was conducted as part of The Victoria and Stuart Project. People with intellectual disabilities were deeply involved at every stage of project design, delivery and dissemination. The project employed people with intellectual disabilities as members of the core research team. People with intellectual disabilities and family carers were members of the project co-design team and the project Advisory Group. The evidence review process itself was led by academic members of the research team with contributions from colleagues with intellectual disabilities via the Advisory Group and core research team. The findings from the evidence review were used by the co-design team to inform the development of an end-of-life care planning toolkit for people with intellectual disabilities.

Quality of Palliative Care Guidelines in Patients with Heart Failure: A Systematic Review of Quality Appraisal using AGREE II Instrument

Objectives

While the principles for developing clinical practice guidelines (CPGs) are well established, the quality of published guidelines is very diverse. The present study was conducted to evaluate the quality of existing CPGs in palliative care for heart failure patients.

Material and Methods

The study was conducted according to the Preferred Reporting Items for Systematic reviews and Meta-analyses. A systematic search was conducted in the Excerpta Medica Database, MEDLINE/PubMed, CINAHL databases and Guideline internet sites: National Institute for Clinical Excellence, National Guideline Clearinghouse, Scottish Intercollegiate Guidelines Network, Guidelines International Network and National Health and Medical Research Council for CPGs published through April 2021. Criteria for including CPGs were: Containing palliative measures for patients with heart failure over 18 years old and preferably interprofessional guidelines that focus on only one dimension of palliative care or focus on diagnosis, definition and treatment were excluded from the study. After initial screening, five appraisers rated the quality of the final selection of CPGs using the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II).

Results

From 1501 records, seven guidelines were selected for analysis. The 'scope and purpose' and 'clarity of presentation' domains obtained the highest mean and 'rigor of development' and 'applicability' domains obtained the lowest mean scores. Three categories of recommendations were: (1) Strongly recommended (guidelines 1, 3, 6 and 7); (2) recommended with modifications (guideline 2) and (3) not recommended (guidelines 4 and 5).

Conclusion

Clinical guidelines for palliative care in patients with heart failure were of moderate-to-high quality, with the main deficiencies occurring in the rigor of development and applicability domains. The results inform clinicians and guideline developers of the strengths and weaknesses of each CPG. To improve the quality of palliative care CPGs in the future, it is recommended that developers pay detailed attention to all domains of the AGREE II criteria. Funding agent: Isfahan University of Medical Sciences. (IR.MUI.NUREMA.REC.1400.123).

Key Components for the Delivery of Palliative and End-of-Life Care in Care Homes in Hong Kong: A Modified Delphi Study

Integrating the palliative care approach into care home service to address the complex care needs of older adults with frailty or advanced diseases has been increasingly recognized. However, such a service is underdeveloped in Hong Kong owing to socio-cultural and legal concerns. We adopted a modified Delphi study design to identify the key components for the delivery of palliative and end-of-life care in care home settings for the local context. It was an iterative staged method to assimilate views of experts in aged care, palliative care, and care home management. A multidisciplinary expert panel of 18 members consented to participate in the study. They rated their level of agreement with 61 candidate statements identified through a scoping review in two rounds of anonymous surveys. The steering group revised the statements in light of the survey findings. Eventually, the finalized list included 28 key statements concerning structure and process of care in seven domains, namely policy and infrastructure, education, assessment, symptom management, communication, care for dying patients, and family support. The findings of this study underscored concerns regarding the feasibility of statements devised at different levels of palliative care development. This list would be instrumental for regions where the development of palliative and end-of-life care services in care home setting is at an initial stage.

Clinical practice guideline for end-of-life care in patients with cancer: a modified ADAPTE process

PURPOSE

This study seeks to adapt a guideline for end-of-life care in patients with cancer to be used by healthcare teams.

METHODS

This methodological study was conducted by modifying the ADAPTE process and adding to it a qualitative study and consensus ratings by a multidisciplinary panel of experts. A qualitative study was thus performed to identify the end-of-life needs of patients with cancer. Then, the source guidelines and the results of the qualitative study were used to draft the initial version of the guideline, with 85 adaptation recommendations. A multidisciplinary panel of healthcare experts performed the external review of the recommendations based on the four criteria of relatedness, comprehensibility, usefulness, and feasibility and scored them on a scale of 1-9. The mean score of each recommendation was calculated, and the recommendations were classified into three categories: appropriate (mean score of 7-9), uncertain (mean score of 4-6.99), and inappropriate (mean score of 1-3.99).

RESULTS

All the recommendations were approved, as they all had a mean score of 7 or higher, and were then categorized into 11 dimensions: communication management; participatory and evidence-based decision-making management; pain management; dyspnea management; nausea and vomiting management; anorexia and cachexia management; constipation management; death rattle management; management of delirium, anxiety, and restlessness; hydration management; and pharmacological considerations.

CONCLUSION

The adaptation of the guideline for end-of-life care in patients with cancer in Iran was performed by modifying the ADAPTE process with the participation of multidisciplinary stakeholders and based on the local needs.

Clinical Practice Guidelines for the Management of Patients With Cleft Lip and Palate: A Systematic Quality Appraisal Using the Appraisal of Guidelines for Research and Evaluation II Instrument

ABSTRACT

Patients with cleft lip and/or palate require complex and longitudinal care by a multidisciplinary cleft team. Unfortunately, delivery of cleft care is often fragmented, and care practices can vary significantly. Multiple clinical practice guidelines (CPGs) have been proposed to provide a standardized framework for cleft care delivery. As CPGs have gained popularity, there has been increasing demand to maintain the quality of existing guidelines. A comprehensive search of EMBASE, MEDLINE via PubMed, Scopus, Cochrane and grey literature sources published from January 1, 1990 to December 31, 2020 was conducted to identify CPGs for the care of cleft patients. The Appraisal of Guidelines for Research and Evaluation, 2nd edition II tool was used to assess the quality of selected CPGs. Intraclass coefficients were calculated to assess agreement among appraisers. Eleven guidelines were identified for study inclusion. One guideline was classified as "high" quality by Appraisal of Guidelines for Research and Evaluation II criteria, and the remaining guidelines were classified as "average" or "low" quality. The "Clarity of Presentation" domain achieved the highest mean score (76.9% ± 11.7%) across CPGs, whereas the "Rigor of Development" domain scored the lowest (35.6% ± 21.2%). Intraclass coefficients analysis reflected very good inter-rater reliability across all domains (0.853-0.987). These findings highlight significant variability in the quality of existing CPGs for the global management of patients with cleft lip and/or palate. The "Rigor of Development" domain reflects the greatest opportunity for improvement. Given these findings, future guidelines may prioritize incorporating a systematic review of existing evidence into recommendations.

What Determines the Quality of Rehabilitation Clinical Practice Guidelines?: An Overview Study

OBJECTIVE

The aim of the study was to determine what factors determine the quality of rehabilitation clinical practice guidelines.

DESIGN

Six databases were searched for articles that had applied the Appraisal of Guidelines for Research & Evaluation II quality assessment tool to rehabilitation clinical practice guidelines. The 573 deduplicated abstracts were independently screened by two authors, resulting in 81 articles, the full texts of which were independently screened by two authors for Appraisal of Guidelines for Research & Evaluation II application to rehabilitation clinical practice guidelines, resulting in a final selection of 40 reviews appraising 504 clinical practice guidelines. Data were extracted from these by one author and checked by a second. Data on each clinical practice guideline included the six Appraisal of Guidelines for Research & Evaluation II domain scores, as well as the two Appraisal of Guidelines for Research & Evaluation II global evaluations.

RESULTS

All six Appraisal of Guidelines for Research & Evaluation II domain scores were statistically significant predictors of overall clinical practice guideline quality rating; D3 (rigor of development) was the strongest and D1 (scope and purpose) the weakest (overall model P < 0.001, R2 = 0.53). Five of the six domain scores were significant predictors of the clinical practice guideline use recommendation, with D3 the strongest predictor and D5 (applicability) the weakest (overall model P < 0.001, pseudo R2 = 0.53).

CONCLUSIONS

Quality of rehabilitation clinical practice guidelines may be improved by addressing key domains such as rigor of development.

Clinical practice guidelines on newborn hearing screening: A systematic quality appraisal using the AGREE II instrument

INTRODUCTION

Several guidelines and consensus statements have been produced and disseminated for the detection and management of newborn hearing loss. However, to date, the quality and methodologic rigor of these screening and management protocols have not been appraised.

OBJECTIVE

To identify and evaluate existing guidelines and consensus statements for the detection and management of neonatal hearing loss.

METHODS

A comprehensive search of EMBASE, MEDLINE/PubMed, SCOPUS and grey literature sources was conducted until August 2020. The quality of these guidelines was assessed by four independent reviewers using the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II). Domain scores were considered satisfactory quality if they scored >60%, and intraclass correlation coefficients (ICC) were calculated to assess agreement among the appraisers.

RESULTS

Twelve guidelines were assessed for critical evaluation. Only two guidelines were classified as 'high quality', and the remaining were 'average' or 'low quality'. The 'Scope and Purpose' domain achieved the highest mean score (91.3% ± 5.8%), and lowest was 'Rigor of Development' (35.8% ± 19.1%). ICC analysis showed good to very good agreement across all domains (0.63-0.95).

CONCLUSION

These findings highlight the variability in methodologic quality of guidelines and consensus statement for the detection and management of neonatal hearing loss. These results may help to improve the reporting of future guidelines and guide the selection and use of these guidelines in clinical practice.

Clinical practice guidelines in idiopathic facial paralysis: systematic review using the appraisal of guidelines for research and evaluation (AGREE II) instrument

Bell's palsy, or idiopathic facial paralysis, is a peripheral facial palsy of unknown cause that presents as sudden, unilateral weakness of the muscles of the face. Prompt treatment of Bell's palsy is critical in order for patients to achieve complete recovery of facial function. Delays in diagnosis and management can result in permanent facial defects. A number of clinical practice guidelines (CPG) exist to guide clinical decision-making in patients presenting with idiopathic facial paralysis. However, to date, there has been no comprehensive review of the methodological rigor and quality of these CPGs. Thus, the objective of the authors is to appraise the existing CPGs to ensure safe and effective practices. A total of eight guidelines met the inclusion criteria and were appraised. Only two CPGs achieved an overall rating of 'High', having five or more quality domains scoring > 60%. Across the CPGs, the domains of rigor of development, stakeholder involvement, and applicability has the lowest overall scores with 48.1%, 43.9%, and 43.1%, respectively. Based on the AGREE II instrument, the methodological rigor and quality of CPGs for Bell's palsy is low to average. In particular, future guidelines for Bell's palsy should look to the quality domains of rigor of development, stakeholder involvement, and applicability as the greatest opportunities for improvement.