How to decide whether a clinical practice guideline is trustworthy

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Patients With Chiari Malformation: Diagnosis

BACKGROUND

Chiari I malformation (CIM) is characterized by descent of the cerebellar tonsils through the foramen magnum, potentially causing symptoms from compression or obstruction of the flow of cerebrospinal fluid. Diagnosis and treatment of CIM is varied, and guidelines produced through systematic review may be helpful for clinicians.

OBJECTIVE

To perform a systematic review of the medical literature to answer specific questions on the diagnosis and treatment of CIM.

METHODS

PubMed and Embase were queried between 1946 and January 23, 2021, using the search strategies provided in Appendix I of the full guidelines.

RESULTS

The literature search yielded 567 abstracts, of which 151 were selected for full-text review, 109 were then rejected for not meeting the inclusion criteria or for being off-topic, and 42 were included in this systematic review.

CONCLUSION

Three Grade C recommendations were made based on Level III evidence. The full guidelines can be seen online at https://www.cns.org/guidelines/browse-guidelines-detail/1-imaging .

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Patients With Chiari Malformation: Surgical Interventions

BACKGROUND

Chiari malformation type I (CIM) diagnoses have increased in recent years. Controversy regarding the best operative management prompted a review of the literature to offer guidance on surgical interventions.

OBJECTIVE

To assess the literature to determine (1) whether posterior fossa decompression or posterior fossa decompression with duraplasty is more effective in preoperative symptom resolution; (2) whether there is benefit from cerebellar tonsillar resection/reduction; (3) the role of intraoperative neuromonitoring; (4) in patients with a syrinx, how long should a syrinx be observed for improvement before additional surgery is performed; and 5) what is the optimal duration of follow-up care after preoperative symptom resolution.

METHODS

A systematic review was performed using the National Library of Medicine/PubMed and Embase databases for studies on CIM in children and adults. The most appropriate surgical interventions, the use of neuromonitoring, and clinical improvement during follow-up were reviewed for studies published between 1946 and January 23, 2021.

RESULTS

A total of 80 studies met inclusion criteria. Posterior fossa decompression with or without duraplasty or cerebellar tonsil reduction all appeared to show some benefit for symptom relief and syrinx reduction. There was insufficient evidence to determine whether duraplasty or cerebellar tonsil reduction was needed for specific patient groups. There was no strong correlation between symptom relief and syringomyelia resolution. Many surgeons follow patients for 6-12 months before considering reoperation for persistent syringomyelia. No benefit or harm was seen with the use of neuromonitoring.

CONCLUSION

This evidence-based clinical guidelines for the treatment of CIM provide 1 Class II and 4 Class III recommendations. In patients with CIM with or without syringomyelia, treatment options include bone decompression with or without duraplasty or cerebellar tonsil reduction. Improved syrinx resolution may potentially be seen with dural patch grafting. Symptom resolution and syrinx resolution did not correlate directly. Reoperation for a persistent syrinx was potentially beneficial if the syrinx had not improved 6 to 12 months after the initial operation. The full guidelines can be seen online at https://www.cns.org/guidelines/browse-guidelines-detail/3-surgical-interventions .

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Patients With Chiari Malformation: Symptoms

BACKGROUND

Chiari I malformation (CIM) is characterized by descent of the cerebellar tonsils through the foramen magnum, potentially causing symptoms from compression or obstruction of the flow of cerebrospinal fluid. Diagnosis and treatment of CIM is varied, and guidelines produced through systematic review may be helpful for clinicians.

OBJECTIVE

To perform a systematic review of the medical literature to answer specific questions on the diagnosis and treatment of CIM.

METHODS

PubMed and Embase were queried between 1946 and January 23, 2021, using the search strategies provided in Appendix I of the full guidelines.

RESULTS

The literature search yielded 430 abstracts, of which 79 were selected for full-text review, 44 were then rejected for not meeting the inclusion criteria or for being off-topic, and 35 were included in this systematic review.

CONCLUSION

Four Grade C recommendations were made based on Class III evidence, and 1 question had insufficient evidence. The full guidelines can be seen online at https://www.cns.org/guidelines/browse-guidelines-detail/2-symptoms .

The quality of paediatric asthma guidelines: evidence underpinning diagnostic test recommendations from a meta-epidemiological study

BACKGROUND

Asthma is one of the most frequent reasons children visit a general practitioner (GP). The diagnosis of childhood asthma is challenging, and a variety of diagnostic tests for asthma exist. GPs may refer to clinical practice guidelines when deciding which tests, if any, are appropriate, but the quality of these guidelines is unknown.

OBJECTIVES

To determine (i) the methodological quality and reporting of paediatric guidelines for the diagnosis of childhood asthma in primary care, and (ii) the strength of evidence supporting diagnostic test recommendations.

DESIGN

Meta-epidemiological study of English-language guidelines from the United Kingdom and other high-income countries with comparable primary care systems including diagnostic testing recommendations for childhood asthma in primary care. The AGREE-II tool was used to assess the quality and reporting of the guidelines. The quality of the evidence was assessed using GRADE.

RESULTS

Eleven guidelines met the eligibility criteria. The methodology and reporting quality varied across the AGREE II domains (median score 4.5 out of 7, range 2-6). The quality of evidence supporting diagnostic recommendations was generally of very low quality. All guidelines recommended the use of spirometry and reversibility testing for children aged ≥5 years, however, the recommended spirometry thresholds for diagnosis differed across guidelines. There were disagreements in testing recommendations for 3 of the 7 included tests.

CONCLUSIONS

The variable quality of guidelines, lack of good quality evidence, and inconsistent recommendations for diagnostic tests may contribute to poor clinician adherence to guidelines and variation in testing for diagnosing childhood asthma.

Appraising the quality of guidelines for peripheral arterial catheters care: A systematic review of reviews

INTRODUCTION

Catheter-related bloodstream infections are among the most critical adverse events in critical patients with peripheral arterial catheters (ACs). Adherence to evidence-based guidelines can prevent and reduce arterial bloodstream infections.

OBJECTIVE

The objectives of this study were to assess clinical practice guidelines for AC care and analyse methodological factors related to their development for effective dissemination and implementation in clinical practice.

REVIEW METHOD USED

This was a systematic review of guidelines.

DATA SOURCES

We searched PubMed, CINAHL, EMBASE, CNKI, and WANFANG databases from inception until September 2021 and evaluated websites of organisations that complied or produced guidelines.

REVIEW METHODS

A comprehensive list of guidelines for ACs care was included. We excluded incomplete guidelines, guidelines translated in other languages, duplicate publications, and summaries of multiple guidelines. Two reviewers independently extracted and collected the data, and three authors conducted quality assessments independently using the Appraisal of Guidelines for Research and Evaluation, Second Edition (AGREE II) tool. The intraclass correlation coefficient (two-way random) with a 95% confidence interval was used to evaluate the concordance between reviewers.

RESULTS

Of the 738 total publications screened, seven were selected for evaluation. The concordance between observers was substantial (intraclass correlation coefficient >0.9, P < 0.001). Most guidelines (4/6) were developed in the United States and the United Kingdom. The median scores for the six domains were 89.0%, 65.5%, 58.0%, 86.0%, 65.0%, and 86.0%. The domains of stakeholder involvement, rigour of development, and applicability had the lowest scores. Guidelines by the United Kingdom's National Institute for Health and Care Excellence showed the highest quality.

CONCLUSIONS

The guidelines we included scored poorly on crucial domains (rigour of development, applicability, and stakeholder involvement). Most of the current recommendations on ACs were included in the guidelines for vascular catheter-related bloodstream infections. Therefore, targeted guidelines created specifically for ACs are warranted to reduce the incidence of catheter-related complications and ensure patient safety.

The International Guideline Evaluation Screening Tool (IGEST): development and validation

Background

Guideline adaptation provides an important alternative to de novo guideline development by making the process more efficient and reducing unnecessary duplication. The quality evaluation of international guidelines is an essential part of the adaptation process.

The study aims at describing the development and validation of a new tool to screen trustworthy Clinical Practice Guidelines (CPGs) for their adoption/adaption: the International Guideline Evaluation Screening Tool (IGEST).

Methods

The process of developing the IGEST involved two main phases: 1) tool development and 2) content validation. The tool development phase comprised three stages, where the scope of the IGEST was defined and the item pool was generated and refined. The content validation was performed through the computation of a content validity index (CVI) based on the opinions of an expert panel.

Results

All the items obtained a CVI >0.78, which resulted in the validation of the instrument. The final instrument comprised four preliminary conditions and 12 criteria organised into three dimensions: (i) the management of conflict of interest; (ii) the quality of evidence and the coherence between evidence and recommendations; and (iii) the panel composition.

Conclusion

The IGEST showed good content validity for assessing the quality of international guidelines. Using the new tool to select trustworthy guidelines might increase the likelihood that international clinical practice guidelines will be adopted/adapted to the local context by allowing a quick screening of existing guidelines trustworthiness and providing an acceptability threshold that supports the decision-making process.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12874-022-01618-5.

Quality appraisal of clinical practice guidelines for temporomandibular joint disorders using the AGREE II instrument

OBJECTIVE

We sought to systematically assess the quality of all clinical practice guidelines (CPGs) describing diagnosis and management of temporomandibular joint disorders (TMDs) using the Appraisal of Guidelines for Research and Evaluation instrument.

STUDY DESIGN

CPGs detailing all aspects of diagnosis and management (both conservative and nonconservative) for TMDs were reviewed.

RESULTS

Thirteen guidelines met inclusion criteria. The highest-scoring domain across guidelines was clarity of presentation (68.3%); the lowest-scoring domain was editorial independence (31.9%). The highest-scoring guideline described traditional Korean medicine approaches to the management of TMDs, earning a mean score of 79.2% across the six quality domains. Only three CPGs met a quality threshold of >60% in at least five domains, qualifying as 'high' per the Appraisal of Guidelines for Research and Evaluation criteria: these guidelines were the Korean medicine guidelines, Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) guidelines for diagnostic classification of TMDs, and the Japanese Society for the Temporomandibular Joint guidelines. An average intraclass correlation coefficient of 0.79 was calculated across all domains, denoting very strong agreement between independent reviewers.

CONCLUSION

We identified a significant lack of quality in multiple areas of CPG development for the diagnosis and therapeutic management of TMDs, suggesting a need for new comprehensive and rigorously developed guidelines addressing TMDs.

Consumer engagement in health care policy, research and services: A systematic review and meta-analysis of methods and effects

To assess the effects of consumer engagement in health care policy, research and services. We updated a review published in 2006 and 2009 and revised the previous search strategies for key databases (The Cochrane Central Register of Controlled Trials; MEDLINE; EMBASE; PsycINFO; CINAHL; Web of Science) up to February 2020. Selection criteria included randomised controlled trials assessing consumer engagement in developing health care policy, research, or health services. The International Association for Public Participation, Spectrum of Public Participation was used to identify, describe, compare and analyse consumer engagement. Outcome measures were effects on people; effects on the policy/research/health care services; or process outcomes. We included 23 randomised controlled trials with a moderate or high risk of bias, involving 136,265 participants. Most consumer engagement strategies adopted a consultative approach during the development phase of interventions, targeted to health services. Based on four large cluster-randomised controlled trials, there is evidence that consumer engagement in the development and delivery of health services to enhance the care of pregnant women results in a reduction in neonatal, but not maternal, mortality. From other trials, there is evidence that involving consumers in developing patient information material results in material that is more relevant, readable and understandable for patients, and can improve knowledge. Mixed effects are reported of consumer-engagement on the development and/or implementation of health professional training. There is some evidence that using consumer interviewers instead of staff in satisfaction surveys can have a small influence on the results. There is some evidence that consumers may have a role in identifying a broader range of health care priorities that are complementary to those from professionals. There is some evidence that consumer engagement in monitoring and evaluating health services may impact perceptions of patient safety or quality of life. There is growing evidence from randomised controlled trials of the effects of consumer engagement on the relevance and positive outcomes of health policy, research and services. Health care consumers, providers, researchers and funders should continue to employ evidence-informed consumer engagement in their jurisdictions, with embedded evaluation.

Systematic review registration: PROSPERO CRD42018102595.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Perioperative Spine: Preoperative Surgical Risk Assessment

BACKGROUND

Patient factors (increased body mass index [BMI], smoking, and diabetes) may impact outcomes after spine surgery. There is a lack of consensus regarding which factors should be screened for and potentially modified preoperatively to optimize outcome.

OBJECTIVE

The purpose of this evidence-based clinical practice guideline is to determine if preoperative patient factors of diabetes, smoking, and increased BMI impact surgical outcomes.

METHODS

A systematic review of the literature for studies relevant to spine surgery was performed using the National Library of Medicine PubMed database and the Cochrane Library. Clinical studies evaluating the impact of diabetes or increased BMI with reoperation and/or surgical site infection (SSI) were selected for review. In addition, the impact of preoperative smoking on patients undergoing spinal fusion was reviewed.

RESULTS

A total of 699 articles met inclusion criteria and 64 were included in the systematic review. In patients with diabetes, a preoperative hemoglobin A1c (HbA1c) >7.5 mg/dL is associated with an increased risk of reoperation or infection after spine surgery. The review noted conflicting studies regarding the relationship between increased BMI and SSI or reoperation. Preoperative smoking is associated with increased risk of reoperation (Grade B). There is insufficient evidence that cessation of smoking before spine surgery decreases the risk of reoperation.

CONCLUSION

This evidence-based guideline provides a Grade B recommendation that diabetic individuals undergoing spine surgery should have a preoperative HbA1c test before surgery and should be counseled regarding the increased risk of reoperation or infection if the level is >7.5 mg/dL. There is conflicting evidence that BMI correlates with greater SSI rate or reoperation rate (Grade I). Smoking is associated with increased risk of reoperation (Grade B) in patients undergoing spinal fusion.The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/2-preoperative-surgical-risk-assessement.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Perioperative Spine: Preoperative Nutritional Assessment

BACKGROUND

Preoperative malnutrition has been implicated in adverse events after elective surgery, potentially impacting patient outcomes.

OBJECTIVE

As a potentially modifiable risk factor, we sought to determine which assessments of nutritional status were associated with specific adverse events after spine surgery. In addition, we explored if a preoperative nutritional improvement intervention may be beneficial in lowering the rates of these adverse events.

METHODS

The literature search yielded 115 abstracts relevant to the PICO (patient/population, intervention, comparison, and outcomes) questions included in this chapter. The task force selected 105 articles for full text review, and 13 met criteria for inclusion in this systematic review.

RESULTS

Malnutrition, assessed preoperatively by a serum albumin <3.5 g/dL or a serum prealbumin <20 mg/dL, is associated with a higher rate of surgical site infections (SSIs), other wound complications, nonunions, hospital readmissions, and other medical complications after spine surgery. A multimodal nutrition management protocol decreases albumin and electrolyte deficiencies in patients with normal preoperative nutritional status. It also improves overall complication rates but does not specifically impact SSIs.

CONCLUSION

It is recommended to assess nutritional status using either serum albumin or prealbumin preoperatively in patients undergoing spine surgery.The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/4-preoperative-nutritional-assessment.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Perioperative Spine: Preoperative Osteoporosis Assessment

BACKGROUND

Osteoporosis is a metabolic bone disease that commonly affects the elderly. Degenerative spinal disease that may require surgical intervention is also prevalent in this susceptible population. If undiagnosed or untreated before spine surgery, osteoporosis may result in an increased risk of postoperative adverse events. Nontreatment of osteoporosis preoperatively may be related to a poor understanding of bone physiology, a lack of standardized treatment algorithms, limited cost-effective interventions, and reluctance by spine surgeons to be the primary provider of osteoporosis management.

OBJECTIVE

The objective of this evidence-based review is to develop guidelines for the preoperative assessment and treatment of osteoporosis in patients undergoing spine surgery.

METHODS

A systematic review of the literature was performed using the National Library of Medicine/PubMed database and Embase for studies relevant to preoperative diagnostic studies that predict increased risk of osteoporosis-related postoperative adverse events and whether the preoperative treatment of low bone mineral density (BMD) in patients with osteoporosis improves outcome.

RESULTS

Out of 281 studies, 17 met the inclusion criteria and were included for systematic review. The task force affirmed a Grade B recommendation that preoperative osteoporosis testing with a dual-energy X-ray absorptiometry scan (T-score < -2.5), a computed tomography scan (Hounsfield units <97.9), and serum vitamin D3 level (<20 ng/mL) predict an increased risk of osteoporosis-related adverse events after spine surgery. The task force determined a Grade B recommendation that preoperative osteoporosis treatment with teriparatide increases BMD, induces earlier and more robust fusion, and may improve select patient outcomes. There is insufficient evidence regarding preoperative treatment with bisphosphonates alone and postoperative outcome.

CONCLUSION

This evidence-based clinical guideline provides a recommendation that patients with suspected osteoporosis undergo preoperative assessment and be appropriately counseled about the risk of postoperative adverse events if osteoporosis is confirmed. In addition, preoperative optimization of BMD with select treatments improves certain patient outcomes.The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/3-preoperative-osteoporosis-assessment.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Perioperative Spine: Preoperative Pulmonary Evaluation and Optimization

BACKGROUND

There are no current recommendations for preoperative pulmonary evaluation and management of patients undergoing elective spine surgery.

OBJECTIVE

The aim of this guideline is to determine preoperative risk factors for perioperative and postoperative pulmonary adverse events and to determine the optimal preoperative evaluation and management of at-risk patients.

METHODS

A systematic review of the literature was performed using the National Library of Medicine PubMed database and the Cochrane Library for studies relevant to postoperative pulmonary adverse events in patients undergoing spine surgery. Clinical studies evaluating preoperative patient risk factors and preoperative diagnostic and treatment interventions were selected for review.

RESULTS

The literature search yielded 152 abstracts relevant to the PICO (patient/population, intervention, comparison, and outcomes) questions included in this chapter. The task force selected 65 articles for full-text review, and 24 were selected for inclusion in this systematic review. Twenty-three articles addressed preoperative patient risk factors. One article addressed preoperative diagnostic studies of pulmonary function. There were no studies meeting the inclusion criteria for preoperative pulmonary treatment.

CONCLUSION

There is substantial evidence for multiple preoperative patient factors that predict an increased risk of a postoperative pulmonary adverse event. Individuals with these risk factors (functional dependence, advanced age [≥65 yr], chronic obstructive pulmonary disease, congestive heart failure, weight loss, and obstructive sleep apnea) who are undergoing spine surgery should be counseled regarding the potential increased risk of a perioperative and postoperative pulmonary adverse events. There is insufficient evidence to support any specific preoperative diagnostic test for predicting the risk of postoperative pulmonary adverse events or any treatment intervention that reduces risk. It is suggested, however, to consider appropriate preoperative pulmonary diagnostic testing and treatment to address active pulmonary symptoms of existing or suspected disease.The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/5-preoperative-pulmonary-evaluation-optimization.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Perioperative Spine: Preoperative Opioid Evaluation

BACKGROUND

Opioid use disorders in the United States have rapidly increased, yet little is known about the relationship between preoperative opioid duration and dose and patient outcomes after spine surgery. Likewise, the utility of preoperative opioid weaning is poorly understood.

OBJECTIVE

The purpose of this evidence-based clinical practice guideline is to determine if duration and dose of preoperative opioids or preoperative opioid weaning is associated with patient-reported outcomes or adverse events after elective spine surgery for degenerative conditions.

METHODS

A systematic review of the literature was performed using the National Library of Medicine/PubMed database and Embase for studies relevant to opioid use among adult patients undergoing spine surgery. Clinical studies evaluating preoperative duration, dose, and opioid weaning and outcomes were selected for review.

RESULTS

A total of 41 of 845 studies met the inclusion criteria and none were Level I evidence. The use of any opioids before surgery was associated with longer postoperative opioid use, and longer duration of opioid use was associated with worse outcomes, such as higher complications, longer length of stay, higher costs, and increased utilization of resources. There is insufficient evidence to support the efficacy of opioid weaning on postoperative opioid use, improving outcome, or reducing adverse events after spine surgery.

CONCLUSION

This evidence-based clinical guideline provides Grade B recommendations that preoperative opioid use and longer duration of preoperative opioid use are associated with chronic postoperative opioid use and worse outcome after spine surgery. Insufficient evidence supports the efficacy of an opioid wean before spine surgery (Grade I).The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/1-preoperative-opioid-evaluation.

Bibliometrics and Co-Citation Network Analysis of Systematic Reviews of Evidence-Based Nursing Guidelines for Preventing Inpatient Falls

Advances in bibliometrics and co-citation analysis provide the opportunity to analyze quantitatively the large amount of nursing research used in evidence-based nursing. Numerous nursing researchers have attempted to obtain evidence that using evidence-based nursing improves the quality of nursing practices. However, little is known about how these efforts comply with the rigorous methods required for a systematic review in a subject area. This study explored the comprehensiveness of systematic reviews in four guidelines for preventing inpatient falls using bibliometrics and a co-citation network technique. Citations (n = 659) and 9417 unique bibliographic records written by 6537 authors were collected from the guidelines in January 2020. The results showed none of the references spanned all four authoring bodies, whereas only 0.1% and 4.7% of the references spanned three and two of the authoring bodies, respectively. The co-citation analysis revealed differences in the scope and primary concerns among the development groups, even in the same setting, with differences in the highly influential articles and authors. These findings imply that although the systematic reviews of guidelines on fall prevention were of good quality, there remain areas for improvement in terms of harmonizing the selection of bibliographic citations comprehensively.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guidelines for Deep Brain Stimulations for Obsessive-Compulsive Disorder: Update of the 2014 Guidelines

BACKGROUND

In 2020, the Guidelines Task Force conducted another systematic review of the relevant literature on deep brain stimulation (DBS) for obsessive-compulsive disorder (OCD) to update the original 2014 guidelines to ensure timeliness and accuracy for clinical practice.

OBJECTIVE

To conduct a systematic review of the literature and update the evidence-based guidelines on DBS for OCD.

METHODS

The Guidelines Task Force conducted another systematic review of the relevant literature, using the same search terms and strategies as used to search PubMed and Embase for relevant literature. The updated search included studies published between 1966 and December 2019. The same inclusion/exclusion criteria as the original guideline were also applied. Abstracts were reviewed and relevant full-text articles were retrieved and graded. Of 864 articles, 10 were retrieved for full-text review and analysis. Recommendations were updated according to new evidence yielded by this update.

RESULTS

Seven studies were included in the original guideline, reporting the use of bilateral DBS as more effective in improving OCD symptoms than sham treatment. An additional 10 studies were included in this update: 1 class II and 9 class III.

CONCLUSION

Based on the data published in the literature, the following recommendations can be made: (1) It is recommended that clinicians utilize bilateral subthalamic nucleus DBS over best medical management for the treatment of patients with medically refractory OCD (level I). (2) Clinicians may use bilateral nucleus accumbens or bed nucleus of stria terminalis DBS for the treatment of patients with medically refractory OCD (level II). There is insufficient evidence to make a recommendation for the identification of the most effective target.The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/deep-brain-stimulation-obsessive-compulsive-disord.

Congress of Neurological Surgeons Systematic Review and Evidence-Based Guideline on Neuroablative Procedures for Patients With Cancer Pain

BACKGROUND

Managing cancer pain once it is refractory to conventional treatment continues to challenge caregivers committed to serving those who are suffering from a malignancy. Although neuromodulation has a role in the treatment of cancer pain for some patients, these therapies may not be suitable for all patients. Therefore, neuroablative procedures, which were once a mainstay in treating intractable cancer pain, are again on the rise. This guideline serves as a systematic review of the literature of the outcomes following neuroablative procedures.

OBJECTIVE

To establish clinical practice guidelines for the use of neuroablative procedures to treat patients with cancer pain.

METHODS

A systematic review of neuroablative procedures used to treat patients with cancer pain from 1980 to April 2019 was performed using the United States National Library of Medicine PubMed database, EMBASE, and Cochrane CENTRAL. After inclusion criteria were established, full text articles that met the inclusion criteria were reviewed by 2 members of the task force and the quality of the evidence was graded.

RESULTS

In total, 14 646 relevant abstracts were identified by the literature search, from which 189 met initial screening criteria. After full text review, 58 of the 189 articles were included and subdivided into 4 different clinical scenarios. These include unilateral somatic nociceptive/neuropathic body cancer pain, craniofacial cancer pain, midline subdiaphragmatic visceral cancer pain, and disseminated cancer pain. Class II and III evidence was available for these 4 clinical scenarios. Level III recommendations were developed for the use of neuroablative procedures to treat patients with cancer pain.

CONCLUSION

Neuroablative procedures may be an option for treating patients with refractory cancer pain. Serious adverse events were reported in some studies, but were relatively uncommon. Improved imaging, refinements in technique and the availability of new lesioning modalities may minimize the risks of neuroablation even further.The full guidelines can be accessed at https://www.cns.org/guidelines/browse-guidelines-detail/guidelines-on-neuroablative-procedures-patients-wi.

SAGES guidelines: an appraisal of their quality and value by SAGES members

BACKGROUND

The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) Guidelines Committee develops evidence-based guidelines for practicing surgeons using standard methodology. Our objective was to survey the SAGES membership regarding guidelines' quality, use, and value and identify topics of interest for new guideline development.

METHODS

An anonymous online survey was emailed in October 2019 to SAGES members. Respondents were asked 18 questions on their use and evaluation of SAGES guidelines and SAGES reviews and to provide suggestions for new guideline topics and areas of improvement. The survey was open for 6 weeks with a 3-week reminder.

RESULTS

Of 548 responders, most were minimally invasive (41%) or general surgeons (33%). There was an even distribution between academic (46%) and non-academic practice (24% private practice, 23% hospital employed). Most used SAGES guidelines frequently (22%) or occasionally (68%) and found them to be of value (83%), above average quality (86%), and easy to use (74%). While most stated it was important (35%) or very important (58%) that SAGES continues to follow "rigorous guidelines development processes," common suggestions were for more timely updates and improved web access. Of 442 overlapping topic suggestions, 60% fell into overarching categories of hernia, bariatric, robotic, HPB, and colorectal surgery.

CONCLUSIONS

The SAGES guidelines are used frequently and valued by its users for their quality and content. Topics proposed by SAGES members and valuable insight from this survey can guide creation of new guidelines and refinement of established guidelines and processes.

Evidence-based appraisal of blood pressure reduction in spontaneous intracerebral hemorrhage: A scoping review and overview

BACKGROUND AND AIM

There is a current debate on the best approach for blood pressure (BP) reduction in patients with spontaneous intracerebral hemorrhage (ICH). Through this scoping review, we aimed to examine how research on reducing BP in ICH patients has been conducted and to clarify the evidence on which approach is the best (intensive vs. standard BP reductions).

METHODS

We performed a scoping review and overview of reviews of the literature. We systematically searched clinical practice guidelines (CPGs), systematic reviews (SRs), and randomized controlled trials (RCTs) that compared intensive versus standard BP reduction. We searched in three databases from inception until March 2020. Two independent authors conducted the study selection, data extraction, quality assessment, and overlapping analysis of SRs. We performed a description and critical appraisal of the current body of evidence.

RESULTS

We included three CPGs (with moderate to high quality); all of them recommended intensive reduction in specific clinical settings. We included eight SRs (with high overlap and critically low quality): two supported intensive reduction and four supported its safety, but not effectiveness. One SR reported that patients with intensive reduction had a significant risk of renal adverse events. We included seven RCTs (with limitations in randomization process); trials with large population did not found significant differences in mortality and disability. One RCT reported a significantly higher number of renal adverse events.

CONCLUSIONS

CPGs support the use of intensive BP reduction; however, most recent SRs partially supported or did not support it due to the association with renal events. It seems the range goal between 140 and 180 mmHg could be safe and equally effective than intensive reduction. We recommend further research in serious and non-serious events promoted by intensive reduction and outcomes homogenization across studies to ensure correct comparison.

Clinical preventive guidelines for school-aged children and adolescents in primary care: a protocol for a systematic review

INTRODUCTION

Guidelines for clinical preventive services targeting school-aged children and adolescents in primary care are limited, often inconsistent and difficult to apply in clinical contexts. This publication describes the protocol concerning a comprehensive systematic review that primarily aims to collect and synthesise available guidelines for prevention in primary care focused on school-aged children living in high-income regions. A second objective is to assess the quality of identified documents.

METHODS AND ANALYSIS

We will search for reports providing clinical practice guidelines or consensus or expert opinion on preventive actions in paediatric primary care. We will use the WHO definition of prevention. We will focus on children aged 6-18 years living in the European region, the USA, Canada and Australia. We will search PubMed, Embase, Web of Science and Cochrane Library and guidelines-specific databases from 1 January 2010. We will also explore the grey literature using web search engines (Google and Google Scholar). We will finally obtain unpublished information through personal contact with national paediatric societies. We will summarise all identified documents as well as their potential methodological bias. We will further use the Appraisal of Guidelines Research and Evaluation Instrument, version II tool to critically appraise their quality.

ETHICS AND DISSEMINATION

Our findings will contribute to the identification of clinical preventive guidelines for which implementation in routine paediatric primary care should be considered. We intend to disseminate our results through publication in peer-reviewed journals and conference proceedings.PROSPERO registration numberCRD42020163184.

Financial conflicts of interest between pharmaceutical companies and the authors of urology clinical practice guidelines in Japan

INTRODUCTION AND HYPOTHESIS

In Japan, the authors of urology clinical practice guidelines (UCPG) used in patient-centered care are often targeted by pharmaceutical companies with financial payments. However, the financial relationship between UCPG authors and pharmaceutical companies remains unclear. This study aimed to determine the characteristics of industry payments to physicians that may influence recommendations in UCPG and to assess the transparency of payment disclosure.

METHODS

We considered 193 UCPG authors receiving payments from 79 companies between 2016 and 2017 and the 13 UCPG published by the Japanese Urological Association between 2015 and 2018. We determined 2-year combined mean and median payments to authors, total company payments, and associations between author attributes and payment values using multivariate negative binomial regression. Also, we assessed the extent of the financial disclosure policies among the 13 UCPG.

RESULTS

Overall, 171 (88.6%) authors received payments with a combined value of $6,169,333. Median and mean payments were $7147 (interquartile range, $1512-$44,807) and $31,965 (standard deviation, $51,684), respectively. University professors working on multiple UCPG with new drug approvals were associated with higher payments. Twelve (92.3%) UCPG failed to disclose financial conflicts.

CONCLUSIONS

While it remains unclear whether financial entanglements improperly influence the contents of UCPG, most Japanese authors received substantial payments from pharmaceutical companies with little or no disclosure. Because insufficient transparency in disclosure of these financial entanglements may compromise the integrity of UCPG, more rigorous regulation and greater disclosure of financial conflicts of interest are needed.

The Development of Cancer Screening Guidelines

Clinicians and the public have always depended on expert advice to guide clinical practice. However, since the 1970s, a growing emphasis on evidence-based medicine has led to clinical practice guidelines being less expert based and increasingly evidence based and judgments about the balance between the two. Because the existence of standards for guidelines development is no guarantee that a guideline will be trustworthy, tools and instruments have been developed to measure the degree to which a guideline has been developed with rigorous adherence to methodology, and has not been influenced by conflicts of interest.

Rethinking the Hydroxychloroquine Dosing and Retinopathy Screening Guidelines

PURPOSE

To describe the rationale for revising the hydroxychloroquine (HCQ) dosing and screening guidelines and to identify the barriers to more effective guidelines in the future.

DESIGN

Literature review.

METHODS

A PubMed query of studies on HCQ dosing and HCQ retinopathy (HCQR) screening was conducted with a selective review of the English language literature.

RESULTS

Three iterations of the American Academy of Ophthalmology HCQ dosing and HCQR screening guidelines have been published without including prescribing physicians on the writing committees. This may contribute to prescribing physicians' low adherence to the guidelines. As ancillary tests have improved, asymptomatic HCQR is being detected earlier, leading to a higher reported prevalence of HCQR and a drop in the ceiling for safe dosing. These trends put stricter constraints on prescribers and their patients, who may have had well-controlled autoimmune disease on HCQ doses that were previously considered to be below the high-risk threshold for HCQR. Indeed, stopping HCQ at the earliest sign of HCQR should be reconsidered; for cases of early HCQR, dose reduction and more intensive monitoring for retinopathy may strike a more appropriate balance between HCQ risk and benefits. A prospective study using the Diabetic Retinopathy Clinical Research Retina Network with standardized collection of data, HCQ blood levels, centralized grading of ancillary tests, and community and academic ophthalmologists would provide a stronger evidence base for future HCQ guidelines.

CONCLUSIONS

The HCQ dosing and screening guidelines should be updated and a prospective study of HCQ dosing and HCQR should be initiated with the joint efforts of ophthalmologists and prescribing physicians.

Ethical challenges in nephrology: a call for action

The American Society of Nephrology, the European Renal Association-European Dialysis and Transplant Association and the International Society of Nephrology Joint Working Group on Ethical Issues in Nephrology have identified ten broad areas of ethical concern as priority challenges that require collaborative action. Here, we describe these challenges - equity in access to kidney failure care, avoiding futile dialysis, reducing dialysis costs, shared decision-making in kidney failure care, living donor risk evaluation and decision-making, priority setting in kidney disease prevention and care, the ethical implications of genetic kidney diseases, responsible advocacy for kidney health and management of conflicts of interest - with the aim of highlighting the need for ethical analysis of specific issues, as well as for the development of tools and training to support clinicians who treat patients with kidney disease in practising ethically and contributing to ethical policy-making.

Healthcare Rationing Cutoffs and Sorites Indeterminacy

Rationing is an unavoidable mechanism for reining in healthcare costs. It entails establishing cutoff points that distinguish between what is and is not offered or available to patients. When the resource to be distributed is defined by vague and indeterminate terms such as "beneficial," "effective," or even "futile," the ability to draw meaningful boundary lines that are both ethically and medically sound is problematic. In this article, I draw a parallel between the challenges posed by this problem and the ancient Greek philosophical conundrum known as the "sorites paradox." I argue, like the paradox, that the dilemma is unsolvable by conventional means of logical analysis. However, I propose another approach that may offer a practical solution that could be applicable to real-life situations in which cutoffs must be decided (such as rationing).

Clinical practice guidelines in pediatric anesthesia: What constitutes high-quality guidance?

The explosion of scientific evidence has outstripped the ability of individual clinicians to acquire, process, and apply it within a clinical context. Clinical practice guidelines bridge the gap between this large body of evidence and clinical practice by translating evidence into recommendations. As such, they are an important extension of the evidence-based medicine paradigm. Guidelines promise to translate evidence into actionable clinical recommendations. However, this promise can only be realized if they are both useful and trustworthy. As the number of guidelines increases users' question their role, the quality of the scientific evidence behind them and the strength of the recommendations made. In this article, we provide definitions and outline the features of the common forms of clinical guidance. We then describe the essential characteristics of good quality clinical guidance and outline initiatives aimed at improving quality. Specific issues and limitations related to guideline development in perioperative care of children are discussed. Finally, two clinical guidance documents, published recently in Pediatric Anesthesia, are discussed based upon these criteria.

Characteristics of knowledge content in a curated online evidence library

Objective

To describe types of recommendations represented in a curated online evidence library, report on the quality of evidence-based recommendations pertaining to diagnostic imaging exams, and assess underlying knowledge representation.

Materials and Methods

The evidence library is populated with clinical decision rules, professional society guidelines, and locally developed best practice guidelines. Individual recommendations were graded based on a standard methodology and compared using chi-square test. Strength of evidence ranged from grade 1 (systematic review) through grade 5 (recommendations based on expert opinion). Finally, variations in the underlying representation of these recommendations were identified.

Results

The library contains 546 individual imaging-related recommendations. Only 15% (16/106) of recommendations from clinical decision rules were grade 5 vs 83% (526/636) from professional society practice guidelines and local best practice guidelines that cited grade 5 studies (P < .0001). Minor head trauma, pulmonary embolism, and appendicitis were topic areas supported by the highest quality of evidence. Three main variations in underlying representations of recommendations were "single-decision," "branching," and "score-based."

Discussion

Most recommendations were grade 5, largely because studies to test and validate many recommendations were absent. Recommendation types vary in amount and complexity and, accordingly, the structure and syntax of statements they generate. However, they can be represented in single-decision, branching, and score-based representations.

Conclusion

In a curated evidence library with graded imaging-based recommendations, evidence quality varied widely, with decision rules providing the highest-quality recommendations. The library may be helpful in highlighting evidence gaps, comparing recommendations from varied sources on similar clinical topics, and prioritizing imaging recommendations to inform clinical decision support implementation.

Lack of Regulations and Conflict of Interest Transparency of New Hernia Surgery Technologies

BACKGROUND

Medical devices introduced to market through the 510K process often have limited research of low quality and substantial conflict of interest (COI). By the time high-quality safety and effectiveness research is performed, thousands of patients may have already been treated by the device. Our aim was to systematically review the trends of outcomes, research quality, and financial relationships of published studies related to de-adopted meshes for ventral hernia repair.

MATERIALS AND METHODS

Literature was systematically reviewed using PubMed to obtain all published studies related to three de-adopted meshes: C-QUR, Physiomesh, and meshes with polytetrafluoroethylene. Primary outcome was change in cumulative percentage of subjects with positive published outcomes. Secondary outcome was percentage of published manuscript with COI.

RESULTS

A total of 723 articles were screened, of which, 129 were analyzed and included a total of 8081 subjects. Percentage of subjects with positive outcomes decreased over time for all groups: (1) C-QUR from 100% in 2009 to 22% in 2018, (2) Physiomesh from 100% in 2011 to 20% in 2018, and (3) polytetrafluoroethylene from 100% in 1979 to 49% in 2018. Authors of only 20% of articles self-reported no COI, most representing later publications and were more likely to show neutral or negative results.

CONCLUSIONS

Among three de-adopted meshes, early publications demonstrated overly optimistic results followed by disappointing outcomes. Skepticism over newly introduced, poorly proven therapies is essential to prevent adoption of misleading practices and products. Devices currently approved under the 510K processes should undergo blinded, randomized controlled trials before introduction to the market.

Treatment Options in Oncology

Multiple treatment strategies exist for many oncologic problems. In this review, we provide a summary of various reasons for the existence of multiple treatment options in oncology, including factors that concern the treating physician (eg, treatment preferences), environmental factors (eg, financial, regulatory, and scientific aspects), and individual patient-specific factors (eg, medical condition, preferences). We demonstrate the vital role of available treatment options and their origins for clinical decision making and patient communication. These aspects are particularly helpful in the process of shared decision making, which is increasingly favored in situations where there are multiple medically reasonable options.

The quality of guidelines for diabetic foot ulcers: A critical appraisal using the AGREE II instrument

This study aims to evaluate the quality of clinical practice guidelines(CPGs) for patients with diabetic foot worldwide. A search of guidelines websites, databases and academic institutions websites was performed from January 1^st, 2010, until June 30^th, 2018. Four assessors independently rated the quality of each CPG using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. Twelve CPGs satisfied the inclusion criteria. The median scores for the 6 AGREE II domains (scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence) were 92.5%, 72.5%, 71.5%, 89%, 47%, and 77%, respectively. The overall quality of the CPGs was good since the majority of the CPGs reached an overall guideline quality between 5 and 7 points. Different CPGs had widely varying scores in the same area, ranging from 25 to 94 points.

Evaluation of Industry Relationships Among Authors of Otolaryngology Clinical Practice Guidelines

Importance

Financial relationships between physicians and industry have influence on patient care. Therefore, organizations producing clinical practice guidelines (CPGs) must have policies limiting financial conflicts during guideline development.

Objectives

To evaluate payments received by physician authors of otolaryngology CPGs, compare disclosure statements for accuracy, and investigate the extent to which the American Academy of Otolaryngology-Head and Neck Surgery complied with standards for guideline development from the Institute of Medicine (IOM).

Design, Setting, and Participants

This cross-sectional analysis retrieved CPGs from the American Academy of Otolaryngology-Head and Neck Surgery Foundation that were published or revised from January 1, 2013, through December 31, 2015, by 49 authors. Data were retrieved from December 1 through 31, 2016. Industry payments received by authors were extracted using the Centers for Medicare & Medicaid Services Open Payments database. The values and types of these payments were then evaluated and used to determine whether self-reported disclosure statements were accurate and whether guidelines adhered to applicable IOM standards.

Main Outcomes and Measures

The monetary amounts and types of payments received by physicians who author otolaryngology guidelines and the accuracy of disclosure statements.

Results

Of the 49 physicians in this sample, 39 (80%) received an industry payment. Twenty-one authors (43%) accepted more than $1000; 12 (24%), more than $10 000; 7 (14%), more than $50 000; and 2 (4%), more than $100 000. Mean (SD) financial payments amounted to $18 431 ($53 459) per physician. Total reimbursement for all authors was $995 282. Disclosure statements disagreed with the Open Payments database for 3 authors, amounting to approximately $20 000 among them. Of the 3 IOM standards assessed, only 1 was consistently enforced.

Conclusions and Relevance

Some CPG authors failed to fully disclose all financial conflicts of interest, and most guideline development panels and chairpersons had conflicts. In addition, adherence to IOM standards for guideline development was lacking. This study is relevant to CPG panels authoring recommendations, physicians implementing CPGs to guide patient care, and the organizations establishing policies for guideline development.

Developing and Testing the Agency for Healthcare Research and Quality's National Guideline Clearinghouse Extent of Adherence to Trustworthy Standards (NEATS) Instrument

In 2011, the Institute of Medicine (IOM) (now the National Academy of Medicine) published standards for trustworthy guidelines and recommended that the National Guideline Clearinghouse (NGC) of the Agency for Healthcare Research and Quality clearly indicate the extent to which guidelines adhere to these standards. To accomplish this, the authors developed and tested the NGC Extent of Adherence to Trustworthy Standards (NEATS) instrument. The standards were operationalized as an instrument containing 15 items that cover disclosure of the funding source; disclosure and management of conflicts of interest; multidisciplinary input; incorporation of patient perspectives; rigorous systematic review; recommendations accompanied by rationale, assessment of benefits and harms, clear linkage to the evidence, and assessment of strength of evidence and strength of recommendation; clear articulation of recommendations; external review by diverse stakeholders; and plans for updating. After multiple rounds of feedback from experts on clinical practice guideline development, the external validity and interrater reliability of the instrument were evaluated. For each item, 80% to 100% of survey respondents judged it to be a good measure of the IOM standards. All external stakeholders stated that NEATS was suitable for its intended goal. Interrater reliability for the final NEATS instrument had a weighted κ of 0.73. The NEATS instrument is a focused tool that provides a concise evaluation of a guideline's adherence to the IOM standards for trustworthy guidelines. It has good external validity among guideline developers and good interrater reliability across trained reviewers.

Use of Machine Learning to Identify Follow-Up Recommendations in Radiology Reports

PURPOSE

The aims of this study were to assess follow-up recommendations in radiology reports, develop and assess traditional machine learning (TML) and deep learning (DL) models in identifying follow-up, and benchmark them against a natural language processing (NLP) system.

METHODS

This HIPAA-compliant, institutional review board-approved study was performed at an academic medical center generating >500,000 radiology reports annually. One thousand randomly selected ultrasound, radiography, CT, and MRI reports generated in 2016 were manually reviewed and annotated for follow-up recommendations. TML (support vector machines, random forest, logistic regression) and DL (recurrent neural nets) algorithms were constructed and trained on 850 reports (training data), with subsequent optimization of model architectures and parameters. Precision, recall, and F1 score were calculated on the remaining 150 reports (test data). A previously developed and validated NLP system (iSCOUT) was also applied to the test data, with equivalent metrics calculated.

RESULTS

Follow-up recommendations were present in 12.7% of reports. The TML algorithms achieved F1 scores of 0.75 (random forest), 0.83 (logistic regression), and 0.85 (support vector machine) on the test data. DL recurrent neural nets had an F1 score of 0.71; iSCOUT also had an F1 score of 0.71. Performance of both TML and DL methods by F1 scores appeared to plateau after 500 to 700 samples while training.

CONCLUSIONS

TML and DL are feasible methods to identify follow-up recommendations. These methods have great potential for near real-time monitoring of follow-up recommendations in radiology reports.

Characteristics and quality of clinical practice guidelines for depression in adults: a scoping review

BACKGROUND

Clinical Practice Guidelines (CPGs) should follow an adequate methodology using an evidence-based approach in order to provide reliable recommendations. However, little is known regarding the quality of CPGs for Depression, which precludes its adequate use by stakeholders and mental health professionals. Thus, the aim of this study was to conduct a scoping review to describe the characteristics and quality of CPGs for Depression in adults.

METHODS

We searched CPGs for Depression in adults in eighteen databases. We included those that were published in English or Spanish between January 2014 and May 2018 and were based on systematic reviews of the evidence. Two independent authors extracted the characteristics, type and number of recommendations, and quality (using the Appraisal of Guidelines for Research and Evaluation-II [AGREE-II]) of each included CPG.

RESULTS

We included eleven CPGs, of which 9/11 did not include the participation of patients in the development of the CPG, 4/11 CPGs had a score ≥ 70% in the overall evaluation of AGREE-II, and 3/11 CPGs had a score ≥ 70% in its third domain (rigor of development). In addition, only 5/11 CPGs shared their search strategy, while only 4/11 listed the selected studies they used to reach recommendations, and 7/11 CPGs did not clearly state which methodology they used to translate evidence into a recommendation.

CONCLUSIONS

Most of evaluated CPGs did not take into account the patient's viewpoints, achieved a low score in the rigor of development domain, and did not clearly state the process used to reach the recommendations. Stakeholders, CPCGs developers, and CPGs users should take this into account when choosing CPGs, and interpreting and putting into practice their issued recommendations.

Using a 10-step framework to support the implementation of an evidence-based clinical pathways programme

BACKGROUND

Integration of evidence into practice is suboptimal. Clinical pathways, defined as multidisciplinary care plans, are a method for translating evidence into local settings and have been shown to improve the value of patient care.

OBJECTIVE

To describe the development of a clinical pathways programme across a large academic healthcare system.

METHODS

We use a 10-step framework (grounded in the Knowledge-to-Action framework and ADAPTE Collaboration methodology for guideline adaptation) to support pathway development and dissemination, including facilitating clinical owner and stakeholder engagement, developing pathway prototypes based on rapid reviews of the existing literature, developing tools for dissemination and impact assessment. We use a cloud-based technology platform (Dorsata, Washington, DC) to assist with development and dissemination across our geographically distributed care settings and providers. Content is viewable through desktop and mobile applications. We measured programme adoption and penetration by examining number of pathways developed as well as mobile application use and pathway views.

RESULTS

From 1 February 2016 to 30 April 2018, a total of 202 pathways were disseminated. The three most common clinical domains represented were oncology (46.5%, n=94), pulmonary/critical care (8.9%, n=18) and cardiovascular medicine (7.4%, n=15). Users opting to register for a personal account totalled 1279; the three largest groups were physicians (45.1%, n=504), advanced practice providers (19.5%, n=245) and nurses (19.1%, n=240). Pathway views reached an average of 2150 monthly views during the last 3 months of the period. The majority of pathways reference at least one evidence-based source (93.6%, n=180).

CONCLUSIONS

A healthcare system can successfully use a framework and technology platform to support the development and dissemination of pathways across a multisite institution.

Diagnostic test guidelines based on high-quality evidence had greater rates of adherence: a meta-epidemiological study

OBJECTIVES

To determine the association between the quality of guidelines for diagnostic tests (both the quality and reporting and the quality of the evidence underpinning recommendations) and nonadherence.

STUDY DESIGN AND SETTING

We conducted a meta-epidemiological study. We previously published a systematic review that quantified the percentage of test use that was nonadherent with guidelines. For the present study, we assessed these guidelines using the Appraisal of Guidelines for Research & Evaluation (AGREE) II tool. We then assessed the quality of evidence underpinning recommendations within these guidelines using Grading of Recommendations Assessment, Development, and Evaluation (GRADE). Linear models were then constructed to determine the association between guideline nonadherence and (1) AGREE II score and (2) GRADE score.

RESULTS

There was no significant association between AGREE II score and nonadherent testing (P = 0.09). There was a significant association between GRADE score and nonadherence: recommendations based on low-quality and very low-quality evidence had 38% (P < 0.01) and 24% (P = 0.02) more nonadherent testing, compared with recommendations based on high-quality evidence.

CONCLUSION

Diagnostic test guideline recommendations based on high-quality evidence are adhered to more frequently.

An appraisal of the trustworthiness of practice guidelines for depression and anxiety in children and youth

OBJECTIVE

Little is known about the trustworthiness of clinical practice guidelines (PGs) relevant to child and youth depression or anxiety. To address this gap, we used systematic review methods to identify all available relevant PGs, quality appraise them, and make recommendations regarding which PGs are trustworthy and should be used by clinicians.

METHODS

Prespecified inclusion criteria identified eligible PGs. Two independent trained reviewers applied the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Using three AGREE II domain scores (stakeholder involvement, rigor of development [clinical validity/trustworthiness], and editorial independence), PG quality was designated as (1) minimum (≥50%) and (2) high (≥70%).

RESULTS

Of 25 eligible PGs, five met minimum quality criteria (depression, n = 4; anxiety, n = 1); three out of five met high-quality criteria (depression, n = 2; anxiety, n = 1). Among the five minimum quality PGs, developers included government (n = 2), independent expert groups (n = 2), and other (n = 1). No PGs developed by specialty societies achieved minimum or high-quality ratings; eight of 25 PGs were up-to-date.

CONCLUSIONS

Trustworthy PGs are available to support clinical decisions about depression and anxiety in children and youth, but are few in number. Many existing PGs (up to 80%) may not be clinically valid. Clinicians who implement the high-quality PGs identified here can increase the number of children and youth who receive effective interventions for depression and anxiety, minimize harm, and avoid wasted resources. Clinicians, service planners, youth, and their families should encourage PG developers to increase the pool of high-quality PGs using internationally recognized PG development standards.

An evaluation of the objective quality and perceived usefulness of maternity clinical practice guidelines at a tertiary maternity unit

BACKGROUND

Compliance with maternity clinical practice guidelines developed by National Women's Health has been found to be low at audit.

OBJECTIVE

To explore the reasons for poor compliance with maternity guidelines by evaluating the quality of a sample of National Women's Health guidelines using a validated instrument and assessing local guideline users' perceptions of and attitudes toward guidelines.

DESIGN

Five independent reviewers evaluated the quality of 10 purposively selected guidelines for adherence to the Appraisal of Guidelines Research & Evaluation (AGREE) II instrument standards. A self-administered questionnaire for staff was undertaken regarding views of and barriers to guideline use.

RESULTS

None of the guidelines attained a score over 50% for the following domains: stakeholder involvement, rigour of development, applicability, editorial independence. The highest scoring domain was clarity of presentation (mean 69%). All guidelines scored the minimum possible for editorial independence. Survey respondents had positive attitudes toward guidelines, believed that their use could improve quality of care within the service, and felt that encouragement from senior staff members and peers would encourage their use. Accessibility was the most commonly cited of many barriers identified.

CONCLUSION

The National Women's Health guidelines evaluated in this study cannot be considered to be high quality, and could be improved by reporting on methodology of the development process. Although poor guideline development may contribute to failure of the local maternity guidelines, it appears that accessibility is a major barrier to their use and implementation.

Development of a 'ready-to-use' tool that includes preventability, for the assessment of adverse drug events in oncology

Background Adverse drug events (ADEs) occur frequently in oncology and justify continuous assessment and monitoring. There are several methods for detecting them, but the trigger tool method seems the most appropriate. Although a generic tool exists, its use for ADEs in oncology has not been convincing. The development of a focused version is therefore necessary. Objective To provide an oncology-focused trigger tool that evaluates the prevalence, harm, and preventability in a standardised method for pragmatic use in ADE surveillance. Setting Hospitals with cancer care in France. Method The tool has been constructed in two steps: (1) constitution of an oncology-centred list of ADEs; 30 pharmacists/practitioners in cancer care from nine hospitals selected a list of ADEs using a method of agreement adapted from the RAND/UCLA Appropriateness Method; and (2) construction of three standardised dimensions for the characterisation of each ADE (including causality, severity, and preventability). Main outcome measure The main outcome measure was validation of the tool, including preventability criteria. Results The tool is composed of a final list of 15 ADEs. For each ADE, a 'reviewer form' has been designed and validated by the panel. It comprises (1) the trigger(s), (2) flowcharts to guide the reviewer, (3) criteria for grading harm, and (4) a standardised assessment of preventability with 6-14 closed sentences for each ADE in terms of therapeutic management and/or prevention of side-effects. Conclusion A complete 'ready-to-use' tool for ADE monitoring in oncology has been developed that allows the assessment of three standardised dimensions.

Overtesting and undertesting in primary care: a systematic review and meta-analysis

BACKGROUND

Health systems are currently subject to unprecedented financial strains. Inappropriate test use wastes finite health resources (overuse) and delays diagnoses and treatment (underuse). As most patient care is provided in primary care, it represents an ideal setting to mitigate waste.

OBJECTIVE

To identify overuse and underuse of diagnostic tests in primary care.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES AND ELIGIBILITY CRITERIA

We searched MEDLINE and Embase from January 1999 to October 2017 for studies that measured the inappropriateness of any diagnostic test (measured against a national or international guideline) ordered for adult patients in primary care.

RESULTS

We included 357 171 patients from 63 studies in 15 countries. We extracted 103 measures of inappropriateness (41 underuse and 62 overuse) from included studies for 47 different diagnostic tests.The overall rate of inappropriate diagnostic test ordering varied substantially (0.2%-100%)%).17 tests were underused >50% of the time. Of these, echocardiography (n=4 measures) was consistently underused (between 54% and 89%, n=4). There was large variation in the rate of inappropriate underuse of pulmonary function tests (38%-78%, n=8).Eleven tests were inappropriately overused >50% of the time. Echocardiography was consistently overused (77%-92%), whereas inappropriate overuse of urinary cultures, upper endoscopy and colonoscopy varied widely, from 36% to 77% (n=3), 10%-54% (n=10) and 8%-52% (n=2), respectively.

CONCLUSIONS

There is marked variation in the appropriate use of diagnostic tests in primary care. Specifically, the use of echocardiography (both underuse and overuse) is consistently poor. There is substantial variation in the rate of inappropriate underuse of pulmonary function tests and the overuse of upper endoscopy, urinary cultures and colonoscopy.

PROSPERO REGISTRATION NUMBER

CRD42016048832.

Towards high-quality, useful practice guidelines for child and youth mental health disorders: protocol for a systematic review and consensus exercise

INTRODUCTION

The quality of clinical practice guidelines (PGs) has not been evaluated in child and youth mental health (CYMH). To address this gap, we will: (1) conduct a systematic review (SR) to answer the question 'among eligible PGs relevant to the prevention or treatment of CYMH conditions, which PGs meet criteria for minimum and high quality?'; (2) apply nominal group methods to create recommendations for how CYMH PG quality, completeness and usefulness can be strengthened.

METHODS AND ANALYSIS

SR: Potentially eligible PGs will be identified in 12 databases using a reproducible search strategy developed by a research librarian. Trained raters will: (1) apply prespecified criteria to identify eligible PGs relevant to depression, anxiety, suicidality, bipolar disorder, behaviour disorder (attention-deficit hyperactivity disorder, oppositional defiant disorder, conduct disorder) and substance use disorder; (2) extract descriptive data and (3) assess PG quality using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. Scores on three AGREE II domains (rigour of development, stakeholder involvement, editorial independence) will designate PGs as minimum (≥50%) or high quality (≥70%). Nominal group: Four CYMH PG knowledge user groups (clinicians, mental health service planners, youth and adult family members) will participate in structured exercises derived using nominal group methods to generate recommendations to improve PG quality, completeness and usefulness.

ETHICS AND DISSEMINATION

Ethics approval is not required. Study products will be disseminated as follows. A cross-platform website will house eligible CYMH PGs and their quality ratings. Twitter and Facebook tools will promote it to a wide variety of PG users. Data from Google Analytics, Twitonomy and Altmetrics will inform usage evaluation. Complementary educational workshops will be conducted for CYMH professionals. Print materials and journal articles will be produced.

PROSPERO REGISTRATION NUMBER

CRD42017060738.