1
|
Rizvi F, Rizvi A, Chorath K, Suresh NV, Ng J, Harris J, Lakshmipathy D, Xavier-Barrette L, Rajasekaran K. AGREE II Evaluation of Clinical Practice Guidelines on Generalized Cancer Pain Management. Pain Manag Nurs 2025; 26:163-170. [PMID: 39419671 DOI: 10.1016/j.pmn.2024.09.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 09/01/2024] [Accepted: 09/09/2024] [Indexed: 10/19/2024]
Abstract
PURPOSE While several clinical practice guidelines (CPGs) exist to guide clinical decision-making in patients with generalized cancer pain, to date there has been no comprehensive review of their quality. Our aim was to address this deficiency via the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. DESIGN Preferred Reporting Items for Systematic Reviews and Meta-Analyses guideline-based systematic literature search followed by AGREE II appraisal of identified CPGs. METHODS Embase, MEDLINE via PubMed, and Scopus were searched from inception to March 3, 2021, for relevant CPGs. Four authors (FR, AR, JN, JH) independently performed assessments and evaluations of the selected CPGs using the AGREE II instrument. Scaled domain percentage scores were calculated with 60% as the satisfactory quality threshold. Intraclass correlation coefficients (ICCs) were also calculated to assess interrater reliability. RESULTS Twelve guidelines were selected for inclusion. Two guidelines were classified high quality, three guidelines as average quality, and seven as low quality. Domains of clarity of presentation (82.41% ± 18.20%) and scope and purpose (56.48% ± 30.59%) received the highest mean scores, while domains of applicability (44.53% ± 26.61%) and stakeholder involvement (36.81% ± 21.24%) received the lowest. ICCs showed high consistency between reviewers (range 0.85-0.98). CONCLUSIONS Most CPGs for generalized cancer pain are of low quality. Future guidelines can be improved by better-defining scope and purpose, stakeholder involvement, rigor of development, applicability, and editorial independence during development. CLINICAL IMPLICATIONS We hope these critiques improve the quality of published guidelines to promote an improved quality of care and method to measure quality outcomes.
Collapse
Affiliation(s)
- Fatima Rizvi
- Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA
| | - Anza Rizvi
- Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA
| | - Kevin Chorath
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA
| | - Neeraj V Suresh
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA
| | - Jinggang Ng
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA
| | - Jacob Harris
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA
| | - Deepak Lakshmipathy
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA
| | | | - Karthik Rajasekaran
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA; Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA.
| |
Collapse
|
2
|
Chessell C, Erin B, Dempsey M, Williams D, Richardson D. Evaluation of current clinical guidelines for the management of sexually transmissible enteric infections using the AGREE II toolkit. Sex Transm Infect 2025:sextrans-2025-056497. [PMID: 40139774 DOI: 10.1136/sextrans-2025-056497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2025] [Accepted: 03/16/2025] [Indexed: 03/29/2025] Open
Abstract
BACKGROUND Clinical guidelines for sexually transmissible enteric infections can provide a framework for testing, management, antimicrobial stewardship and public health control. This review aimed to evaluate the currently available clinical guidelines and to highlight any areas for improvement. METHOD A comprehensive online search for clinical guidelines was performed and reported using Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines, followed by evaluation using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) tool by three independent reviewers. An AGREE II domain score of >60% is the threshold for sufficient quality, and each guideline was rated high, average or low based on the domain percentages (five domains scoring >60%=high, 3-4 domains scoring >60%=average and ≤2 domains scoring>60%=low). Two authors developed a bespoke quality framework for sexually transmissible enteric infection guidelines and this was used to evaluate each guideline. RESULTS Six clinical guidelines were identified from the UK (British Association for Sexual Health and HIV (UK-BASHH)), USA (Centers for Disease Control and Prevention (USA-CDC)), Europe (International Union against Sexually Transmitted Infections (Europe-IUSTI)), Canada-government, Brazil-government and Australia (Australasia Society for HIV, Viral Hepatitis, and Sexual Health Medicine (Australia-ASHM)). The overall AGREE II score was 56% (IQR 43-67) (domain 1 (scope and purpose) 67% (IQR=42-67), domain 2 (stakeholder involvement) 46% (IQR 34-62), domain 3 (rigour of development) 42% (IQR 22-49), domain 4 (clarity of presentation) 80% (IQR 57-89), domain 5 (applicability) 23% (IQR 11-30) and domain 6 (editorial independence) 67% (IQR 56-84)). The median global scores (out of 7) and rating (low, medium and high) were UK-BASHH (5/7, high), USA-CDC (5/7, average), Europe-IUSTI (4/7, average), Canada government (4/7, low), Brazil government (3/7, low) and Australia-ASHM (1/7, low). All six guidelines recommended testing using molecular platforms: UK-BASHH, USA-CDC and Europe-IUSTI recommended offering sexual health interventions and STI testing; the UK-BASHH and Australia-ASHM did not recommend empirical antimicrobials, and the Europe-IUSTI and Brazil government guidelines made specific antimicrobial recommendations, including macrolides, quinolones and cephalosporins. CONCLUSION Future clinical guidelines for sexually transmissible enteric infections require consistency and to improve their applicability, rigour of development, stakeholder involvement and recommendations for sexual health interventions, sexually transmitted infection testing, partner notification, handwashing and food handlers' advice and antimicrobial treatment.
Collapse
Affiliation(s)
- Callum Chessell
- East Sussex Healthcare NHS Trust, Eastbourne, England, UK
- University Hospitals Sussex NHS Foundation Trust, Brighton, UK
| | - Ben Erin
- Brighton and Sussex Medical School, Brighton, UK
| | | | | | - Daniel Richardson
- University Hospitals Sussex NHS Foundation Trust, Brighton, UK
- Brighton and Sussex Medical School, Brighton, UK
| |
Collapse
|
3
|
Kim SH, Kwak MY. Update on Medical Management of Acute Peripheral Facial Palsy. J Audiol Otol 2025; 29:1-7. [PMID: 39916394 PMCID: PMC11824525 DOI: 10.7874/jao.2024.00731] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2024] [Revised: 01/16/2025] [Accepted: 01/20/2025] [Indexed: 02/16/2025] Open
Abstract
Acute facial nerve palsy, particularly Bell's palsy, is a common neurological disorder with an annual incidence of 20-30 cases per 100,000 individuals. It is characterized by sudden or gradual facial muscle palsy and is caused by viral reactivation, inflammation, or ischemia of the facial nerve. Prognosis varies widely, depending on the severity of nerve damage and timeliness of the intervention. Steroid therapy remains the cornerstone of Bell's palsy treatment because it reduces inflammation and facilitates recovery. Early administration, preferably within 72 hours of symptom onset, considerably improves outcomes. However, the efficacy of combination therapy remains controversial. Current guidelines recommend oral steroids as the primary treatment for Bell's palsy and suggest the selective use of antiviral agents in severe cases or when viral involvement is strongly suspected. For severe facial palsy, such as Ramsay Hunt syndrome or varicella-zoster virus-induced cases, combination therapy may improve outcomes and reduce sequelae; however, high-quality evidence is limited. Steroid therapy is the main treatment of Bell's palsy and antiviral therapy can be added in severe cases to improve prognosis. Additional research is required to develop standardized guidelines, concerning the use of antiviral therapies in conjunction with steroids.
Collapse
Affiliation(s)
- Sang Hoon Kim
- Department of Otorhinolaryngology, Head and Neck Surgery, School of Medicine, Kyung Hee University, Seoul, Korea
| | - Min Young Kwak
- Department of Otorhinolaryngology-Head and Neck Surgery, Dongtan Sacred Heart Hospital, Hallym University College of Medicine, Hwaseong, Korea
| |
Collapse
|
4
|
Shi H, Fan Y, Zhang Y, Li X, Shu Y, Deng X, Zhang Y, Zheng Y, Yang J. Intelligent bell facial paralysis assessment: a facial recognition model using improved SSD network. Sci Rep 2024; 14:12763. [PMID: 38834661 PMCID: PMC11150464 DOI: 10.1038/s41598-024-63478-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 05/29/2024] [Indexed: 06/06/2024] Open
Abstract
With the continuous progress of technology, the subject of life science plays an increasingly important role, among which the application of artificial intelligence in the medical field has attracted more and more attention. Bell facial palsy, a neurological ailment characterized by facial muscle weakness or paralysis, exerts a profound impact on patients' facial expressions and masticatory abilities, thereby inflicting considerable distress upon their overall quality of life and mental well-being. In this study, we designed a facial attribute recognition model specifically for individuals with Bell's facial palsy. The model utilizes an enhanced SSD network and scientific computing to perform a graded assessment of the patients' condition. By replacing the VGG network with a more efficient backbone, we improved the model's accuracy and significantly reduced its computational burden. The results show that the improved SSD network has an average precision of 87.9% in the classification of light, middle and severe facial palsy, and effectively performs the classification of patients with facial palsy, where scientific calculations also increase the precision of the classification. This is also one of the most significant contributions of this article, which provides intelligent means and objective data for future research on intelligent diagnosis and treatment as well as progressive rehabilitation.
Collapse
Affiliation(s)
- Haiping Shi
- The First Affiliated Hospital of Anhui University of Chinese Medicine, Hefei, Anhui, China
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Yinqiu Fan
- The First Affiliated Hospital of Anhui University of Chinese Medicine, Hefei, Anhui, China
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Yu Zhang
- The First Affiliated Hospital of Anhui University of Chinese Medicine, Hefei, Anhui, China
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Xiaowei Li
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Yuling Shu
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Xinyuan Deng
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Yating Zhang
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Yunzi Zheng
- Anhui University of Chinese Medicine, Hefei, Anhui, China
| | - Jun Yang
- The First Affiliated Hospital of Anhui University of Chinese Medicine, Hefei, Anhui, China.
- Anhui University of Chinese Medicine, Hefei, Anhui, China.
| |
Collapse
|
5
|
Cross JG, May BR, Mai PQM, Anderson E, Welsh C, Chandran S, Chorath KT, Herr S, Gonzalez D. A systematic review and evaluation of post-stroke depression clinical practice guidelines. J Stroke Cerebrovasc Dis 2023; 32:107292. [PMID: 37572601 DOI: 10.1016/j.jstrokecerebrovasdis.2023.107292] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 07/06/2023] [Accepted: 08/01/2023] [Indexed: 08/14/2023] Open
Abstract
OBJECTIVE Post-stroke depression is a depressive mood disorder that follows a cerebrovascular accident and is a burden on stroke patients. Its management is included in clinical practice guidelines focused on stroke, and the recommended treatment is selective serotonin reuptake inhibitors in conjunction with psychotherapy. Clinical practice guidelines are recommendations used to standardize best medical practice, but there is no current evaluation of guidelines containing post stroke depression recommendations. Thus, the objective is to appraise the selected guidelines manner of development and quality. MATERIALS AND METHODS A systematic literature review across three databases and a manual google search was performed to collect guidelines that included recommendations on the management of post-stroke depression. 1236 guidelines were screened, and 27 were considered for inclusion. Considered guidelines were manually reviewed by the authors, and ultimately, 7 met inclusion criteria. The appraisal of guidelines for research and evaluation was used to evaluate these guidelines' recommendations around post-stroke depression. RESULTS Three guidelines met the threshold considered "High", with all of them having five or more quality domains eclipse the cutoff score of 70%. Across all guidelines, the highest scoring domains were "Scope and Purpose", "Clarity of Presentation", and "Editorial Independence" with scores of 76.98%, 73.81%, and 91.36% respectively. The lowest scoring domains were "Applicability", "Rigor of Development", and "Stakeholder Involvement" with respective scores of 58.73%, 54.02%, and 43.90%. CONCLUSIONS The domains "Applicability", "Rigor of Development," and "Stakeholder Involvement" were the lowest scoring domains. These specific domains represent areas in which future guidelines could be more developed.
Collapse
Affiliation(s)
| | - Brandon R May
- Department of Neurology, Barrow Neurological Institute, Phoenix, Arizona, USA
| | - Peter Q M Mai
- Department of Neurology, Barrow Neurological Institute, Phoenix, Arizona, USA
| | - Elizabeth Anderson
- Department of Neurology, Barrow Neurological Institute, Phoenix, Arizona, USA
| | - Connor Welsh
- Department of Neurology, Barrow Neurological Institute, Phoenix, Arizona, USA
| | | | - Kevin T Chorath
- Department of Radiology, University of Washington, Seattle, Washington, USA
| | - Shelby Herr
- Creighton University School of Medicine, Phoenix, Arizona, USA
| | - Daniel Gonzalez
- Department of Neurovascular & Stroke Neurology, Barrow Neurological Institute, Phoenix, Arizona, USA.
| |
Collapse
|
6
|
Ou JY, Liu JJ, Xu J, Li JY, Liu Y, Liu YZ, Lu LM, Pan HF, Wang L. Quality appraisal of clinical practice guidelines for motor neuron diseases or related disorders using the AGREE II instrument. Front Neurol 2023; 14:1180218. [PMID: 37528849 PMCID: PMC10388716 DOI: 10.3389/fneur.2023.1180218] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 06/30/2023] [Indexed: 08/03/2023] Open
Abstract
Objectives This study aimed to systematically assess the quality of CPGs for motor neuron diseases (MNDs) or related disorders and identify the gaps that limit evidence-based practice. Methods Four scientific databases and six guideline repositories were searched for eligible CPGs. Three researchers assessed the eligible CPGs using the Appraisal of Guidelines Research and Evaluation II instrument. The distribution of the level of evidence and strength of recommendation of these CPGs were determined. The univariate regression analysis was used to explore the characteristic factors affecting the quality of CPGs. Results Fifteen CPGs met the eligibility criteria: 10 were for MND and 5 were for spinal muscular atrophy. The mean overall rating score was 44.5%, and only 3 of 15 CPGs were of high quality. The domains that achieved low mean scores were applicability (24.4%), rigor of development (39.9%), and stakeholder involvement (40.3%). Most recommendations were based on low-quality evidence and had a weak strength. The CPGs that were updated, meant for adults, and evidence based, and used a CPG quality tool and a grading system were associated with higher scores in certain specific domains and overall rating. Conclusion The overall quality of CPGs for MNDs or related disorders was poor and recommendations were largely based on low-quality evidence. Many areas still need improvement to develop high-quality CPGs, and the use of CPG quality tools should be emphasized. A great deal of research on MNDs or related disorders is still needed to fill the large evidence gap.
Collapse
Affiliation(s)
- Jia-Yin Ou
- South China Research Center for Acupuncture and Moxibustion, Medical College of Acu-Moxi and Rehabilitation, Guangzhou University of Chinese Medicine, Guangzhou, China
- Science and Technology Innovation Center, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Jun-Jun Liu
- The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Jing Xu
- South China Research Center for Acupuncture and Moxibustion, Medical College of Acu-Moxi and Rehabilitation, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Jia-Yu Li
- Science and Technology Innovation Center, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yang Liu
- The Second School of Clinical Medicine, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - You-Zhang Liu
- The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Li-Ming Lu
- South China Research Center for Acupuncture and Moxibustion, Medical College of Acu-Moxi and Rehabilitation, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Hua-Feng Pan
- Science and Technology Innovation Center, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Lin Wang
- South China Research Center for Acupuncture and Moxibustion, Medical College of Acu-Moxi and Rehabilitation, Guangzhou University of Chinese Medicine, Guangzhou, China
| |
Collapse
|
7
|
Clinical practice guidelines for the management of recurrent head and neck cancer: a systematic review and quality appraisal. Eur Arch Otorhinolaryngol 2023; 280:297-305. [PMID: 35960350 DOI: 10.1007/s00405-022-07519-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Accepted: 06/18/2022] [Indexed: 01/07/2023]
Abstract
PURPOSE Recurrent head and neck cancer (HNC) has a significant global disease burden and its treatment is complex. Multiple clinical practice guidelines (CPGs) have been developed to improve management of these patient populations; however, no study has systematically reviewed the quality and rigor in development of these guidelines. Here, we identify and systematically appraise existing recommendations for the management of recurrent HNC and assess their clinical applicability, methodologic rigor, and transparency of development. METHODS A systematic search of the PubMed, Embase, and Scopus databases was conducted for recurrent HNC CPGs. Each guideline was scored independently by four reviewers trained in the Appraisal of Guidelines for Research and Evaluation, 2nd edition (AGREE II) methodology. Salient recommendations from the selected guidelines were summarized. RESULTS Our literature search yielded 1799 articles; after iterative title/abstract and full text screening, five remaining guidelines met inclusion criteria. CPGs received the lowest scores in 'Applicability' and 'Rigor of development,' with scores of 12.9% and 22.3%, respectively. Overall quality of available guidelines for management of recurrent HNC is poor, with an average overall scaled domain score of 40.9% (± 11.0), and with four guidelines (80.0%) receiving an overall quality rating of 'low'. CONCLUSION We found significant variability in quality and overall lack of methodologic rigor among available guidelines for the management of recurrent HNC. Future groups developing recommendations for this purpose should implement the AGREE II framework to improve quality and standardization of their guidelines.
Collapse
|
8
|
Assessment of clinical guidelines for medication-related osteonecrosis of the jaw: current status and future directions. Oral Surg Oral Med Oral Pathol Oral Radiol 2022; 134:717-724. [PMID: 36241597 DOI: 10.1016/j.oooo.2022.06.014] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 06/26/2022] [Accepted: 06/27/2022] [Indexed: 12/13/2022]
Abstract
OBJECTIVE To evaluate the current quality and utility of clinical practice guidelines (CPGs) issued for the diagnosis, prevention, and treatment of medication-related osteonecrosis of the jaw (MRONJ). STUDY DESIGN We performed a systematic literature search of guidelines for MRONJ diagnosis, staging, prevention, or management. An appraisal of guidelines was completed using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Scaled domain scores were calculated for each domain. Key recommendations were abstracted from guidelines distinguished as "high" quality. RESULTS Six CPGs were identified from systematic review. Four of 6 (66.7%) guidelines were published within the last 2 years. Each guideline discussed management of antiresorptive and antiangiogenic therapy-associated osteonecrosis of the jaw. The highest-scoring domain was domain 1: "Scope and purpose," with an average score of 85.0% (range: 76.4%-100.0%). The lowest domain score was in domain 5: "Applicability," with an average score of 41.7% (range: 22.9%-92.7%). Only 2 guidelines (33.3%) met the quality threshold of > 60% in 5 or more AGREE II domains, distinguishing them as "high"-quality guidelines. The average kappa statistic calculated across domains was 0.77, suggesting substantial interrater correlation in the CPG appraisal process. CONCLUSIONS Despite the increasing recognition of MRONJ as a debilitating consequence of antiresorptive and antiangiogenic therapy, clinical guideline recommendations may be lacking in overall quality and clinical utility.
Collapse
|
9
|
Javed S, Kang WD, Black C, Chorath K, Johal J, Huh BK. Clinical practice guidelines for the management of patients with chronic regional pain syndrome: a systematic appraisal using the AGREE II instrument. Pain Manag 2022; 12:951-960. [PMID: 36193759 DOI: 10.2217/pmt-2022-0046] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Aim: Chronic regional pain syndrome (CRPS) is a debilitating, painful condition of limbs that often arises after an injury and is associated with significant morbidity. Materials & methods: The Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument, used to assess the quality of clinical practice guidelines (CPGs), was used to evaluate seven CRPS management guideline. Results: Out of the seven CPGs evaluated using the AGREE II instrument, only one from Royal College of Physicians was found to have high-quality consensus guidelines for diagnosis and management of CRPS. Conclusion: Future CPGs should be backed by systematic literature searches, focus on guidelines clinical translation into clinical practice and applicability to the desired patient population.
Collapse
Affiliation(s)
- Saba Javed
- Department of Pain Medicine, MD Anderson Cancer Center Houston, TX, USA
| | | | | | | | | | - Billy K Huh
- Department of Pain Medicine, MD Anderson Cancer Center Houston, TX, USA
| |
Collapse
|
10
|
De Ravin E, Suresh N, Romeo D, Lu J, Shah M, Karakousis G, Moreira A, Rajasekaran K. Clinical Practice Guidelines on Sentinel Lymph Node Biopsy for Melanoma: A Systematic Review and Quality Appraisal Using the AGREE II Instrument. Ann Surg Oncol 2022; 29:8364-8372. [PMID: 36121581 DOI: 10.1245/s10434-022-12525-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 08/29/2022] [Indexed: 11/18/2022]
Abstract
Sentinel lymph node biopsy (SLNB) is a minimally invasive surgical procedure that is standard of care for the evaluation of clinically negative regional lymph nodes in patients with cutaneous melanoma. As the presence of metastases dictates patient prognosis and determines the need for further regional disease control or adjuvant therapy, SLNB is invaluable to clinical decision-making in patients presenting with melanoma. However, the indications for SLNB, specifically among patients with thin (<1 mm) or thick (>4 mm) melanomas, remain unclear. A number of clinical practice guidelines (CPGs) have been developed outlining recommendations for the role of lymph node biopsy in the management of melanoma. However, to date, their quality has not been critically appraised. Our objective was to systematically evaluate all available CPGs on this topic using the validated Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. Four total guidelines met the inclusion criteria and underwent appraisal. Only one CPG achieved a "high" quality rating, indicating scores of >60% in at least five of the six AGREE II domains. Across all CPGs, the lowest scoring domains were "Applicability" and "Stakeholder involvement," which had average scores of 41.2% and 48.3%, respectively. Based on the AGREE II instrument, the quality of existing CPGs for the indications of SLNB for melanoma is low. Future guidelines should be pilot tested to evaluate barriers to application and should utilize multidisciplinary guideline development teams that include patients and key stakeholders in addition to clinical experts from all relevant disciplines.
Collapse
Affiliation(s)
- Emma De Ravin
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA.,Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - Neeraj Suresh
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA
| | - Dominic Romeo
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA, USA
| | - Joseph Lu
- Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, PA, USA
| | - Mitali Shah
- Drexel University College of Medicine, Drexel University, Philadelphia, PA, USA
| | - Giorgos Karakousis
- Department of Surgical Oncology, University of Pennsylvania, Philadelphia, PA, USA
| | - Alvaro Moreira
- Department of Pediatrics, University of Texas Health-San Antonio, San Antonio, TX, USA
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology-Head and Neck Surgery, University of Pennsylvania, Philadelphia, PA, USA. .,Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
11
|
Suresh NV, De Ravin E, Barrette LX, Prasad A, Romeo D, Ng J, Moreira A, Farwell DG, Rajasekaran K. Quality appraisal of clinical practice guidelines for the use of radiofrequency ablation in the treatment of thyroid nodules and cancer. Am J Otolaryngol 2022; 43:103508. [PMID: 35623244 DOI: 10.1016/j.amjoto.2022.103508] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Accepted: 05/14/2022] [Indexed: 11/24/2022]
Abstract
INTRODUCTION Radiofrequency ablation (RFA) has gained significant recent global interest in the treatment of benign thyroid nodules and thyroid cancer. It is a relatively new, minimally invasive, thermal ablation technique that is an alternative to surgery. Several clinical practice guidelines (CPGs), consensus statements, and recommendations currently exist for the use of RFA in the treatment of benign thyroid nodules and thyroid cancers. These documents have considerable variability amongst them, and to date, their quality and methodologic rigor have not been appraised. OBJECTIVE To identify and perform a quality appraisal of clinical practice guidelines for RFA in the treatment of benign thyroid nodules and thyroid cancer using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. METHODS A comprehensive literature search was performed in MEDLINE (via PubMed), EMBASE, and SCOPUS databases from inception to November 1, 2021. Four reviewers independently evaluated each guideline using the AGREE II instrument. Scaled domain scores were generated and the threshold used for satisfactory quality was >60%. Additionally, intraclass correlation coefficients (ICCs) were calculated to determine level of agreement between reviewers. RESULTS Seven guidelines were selected for final evaluation based on inclusion/exclusion criteria. Two guidelines were classified "high" quality, one "average" quality, and the rest "low" quality. The "Clarity and Presentation" (65.68 ± 26.1) and "Editorial Independence" (61.32 ± 25.8) domains received the highest mean scores, while the "Applicability" (32.14 ± 22.8) and "Rigor of Development" (45.02 ± 29.8) domains received the lowest mean scores. ICC statistical analysis showed high magnitude of agreement between reviewers with a range of (0.722-0.944). CONCLUSION Reflecting upon our quality appraisal, it is evident that the quality and methodologic rigor of RFA guidelines can be improved upon in the future. Our findings also elucidate the existing variability/discrepancies amongst guidelines in the indications and use of RFA.
Collapse
|
12
|
Barrette LX, Connolly J, Romeo D, Ng J, Moreira AG, Rajasekaran K. Quality appraisal of clinical practice guidelines for temporomandibular joint disorders using the AGREE II instrument. Oral Surg Oral Med Oral Pathol Oral Radiol 2022; 133:402-411. [PMID: 35165058 DOI: 10.1016/j.oooo.2021.10.021] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 10/07/2021] [Accepted: 10/25/2021] [Indexed: 01/16/2023]
Abstract
OBJECTIVE We sought to systematically assess the quality of all clinical practice guidelines (CPGs) describing diagnosis and management of temporomandibular joint disorders (TMDs) using the Appraisal of Guidelines for Research and Evaluation instrument. STUDY DESIGN CPGs detailing all aspects of diagnosis and management (both conservative and nonconservative) for TMDs were reviewed. RESULTS Thirteen guidelines met inclusion criteria. The highest-scoring domain across guidelines was clarity of presentation (68.3%); the lowest-scoring domain was editorial independence (31.9%). The highest-scoring guideline described traditional Korean medicine approaches to the management of TMDs, earning a mean score of 79.2% across the six quality domains. Only three CPGs met a quality threshold of >60% in at least five domains, qualifying as 'high' per the Appraisal of Guidelines for Research and Evaluation criteria: these guidelines were the Korean medicine guidelines, Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) guidelines for diagnostic classification of TMDs, and the Japanese Society for the Temporomandibular Joint guidelines. An average intraclass correlation coefficient of 0.79 was calculated across all domains, denoting very strong agreement between independent reviewers. CONCLUSION We identified a significant lack of quality in multiple areas of CPG development for the diagnosis and therapeutic management of TMDs, suggesting a need for new comprehensive and rigorously developed guidelines addressing TMDs.
Collapse
Affiliation(s)
| | - John Connolly
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Dominic Romeo
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Jinggang Ng
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Alvaro G Moreira
- Department of Pediatrics, University of Texas Health Science Center, San Antonio, TX, USA
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA; Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
13
|
Clinical Practice Guidelines in the Management of Breakthrough Cancer Pain: A Systematic Review using the Appraisal of Guidelines for Research and Evaluation (AGREE II) Instrument. Pain Manag Nurs 2022; 23:411-417. [PMID: 35305935 DOI: 10.1016/j.pmn.2022.02.010] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Revised: 02/11/2022] [Accepted: 02/12/2022] [Indexed: 11/20/2022]
Abstract
BACKGROUND Several clinical practice guidelines (CPGs), consensus statements, and recommendations currently exist for the diagnosis and management of breakthrough cancer pain (BTcP). These documents have considerable variability amongst them, and to date, their quality and methodologic rigor have not been appraised. AIM We aim to identify and perform a quality appraisal of CPGs for the diagnosis and management of BTcP using the Appraisal of Guidelines for Research and Evaluation (AGREE II) tool. METHODS A comprehensive literature search was performed in MEDLINE (via PubMed), EMBASE, and SCOPUS databases up until January 1, 2021. Four reviewers independently evaluated each guideline using the AGREE II instrument. Scaled domain scores were generated and the threshold used for satisfactory quality was >60%. Additionally, intraclass correlation coefficients (ICC) were calculated to determine level of agreement between reviewers. RESULTS Eleven guidelines were selected for final evaluation based on inclusion/exclusion criteria. Only one guideline was classified of "average" quality while the rest were classified as "low" quality. The "Editorial Independence" (70.46 ± 35.7) and "Scope and Purpose" (64.78 ± 12.5) domains received the highest mean scores, while the "Applicability" (32.58 ± 13.5) and "Rigor of Development" (35.04 ± 9.0) domains received the lowest mean scores. ICC statistical analysis showed high magnitude of agreement between reviewers with a range of (0.790-0.988). CONCLUSIONS Reflecting upon our quality appraisal, it is evident that the quality and methodologic rigor of BTcP guidelines can be improved upon in the future. Our findings also elucidate the existing variability/discrepancies among guidelines in diagnostic criteria and management of BTcP.
Collapse
|
14
|
Harris J, Chorath K, Balar E, Xu K, Naik A, Moreira A, Rajasekaran K. Clinical Practice Guidelines on Pediatric Gastroesophageal Reflux Disease: A Systematic Quality Appraisal of International Guidelines. Pediatr Gastroenterol Hepatol Nutr 2022; 25:109-120. [PMID: 35360381 PMCID: PMC8958056 DOI: 10.5223/pghn.2022.25.2.109] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/03/2021] [Revised: 10/28/2021] [Accepted: 02/06/2022] [Indexed: 12/18/2022] Open
Abstract
PURPOSE While regurgitation is a common and often benign phenomenon in infants and younger children, it can also be a presenting symptom of gastroesophageal reflux disease (GERD). If untreated, GERD can lead to dangerous or lifelong complications. Clinical practice guidelines (CPGs) have been published to inform clinical diagnosis and management of pediatric GERD, but to date there has been no comprehensive review of guideline quality or methodological rigor. METHODS A systematic literature search was performed, and a total of eight CPGs pertaining to pediatric GERD were identified. These CPGs were evaluated using the Appraisal of Guidelines for Research and Evaluation instrument. RESULTS Three CPGs were found to be "high" quality, with 5 of 6 domains scoring >60%, one "average" quality, with 4 of 6 domains meeting that threshold, and the remaining four "low" quality. CONCLUSION Areas of strength among the CPGs included "Scope and Purpose" and "Clarity and Presentation," as they tended to be well-written and easily understood. Areas in need of improvement were "Stakeholder Involvement," "Rigor of Development," and "Applicability," suggesting these CPGs may not be appropriate for all patients or providers. This analysis found that while strong CPGs pertaining to the diagnosis and treatment of pediatric GERD exist, many published guidelines lack methodological rigor and broad applicability.
Collapse
Affiliation(s)
- Jacob Harris
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Kevin Chorath
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Eesha Balar
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Katherine Xu
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Anusha Naik
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Alvaro Moreira
- Department of Pediatrics, University of Texas Health-San Antonio, San Antonio, TX, USA
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA.,Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
15
|
Facial Paralysis Detection in Infrared Thermal Images Using Asymmetry Analysis of Temperature and Texture Features. Diagnostics (Basel) 2021; 11:diagnostics11122309. [PMID: 34943544 PMCID: PMC8699857 DOI: 10.3390/diagnostics11122309] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/02/2021] [Accepted: 12/05/2021] [Indexed: 01/08/2023] Open
Abstract
Facial temperature distribution in healthy people shows contralateral symmetry, which is generally disrupted by facial paralysis. This study aims to develop a quantitative thermal asymmetry analysis method for early diagnosis of facial paralysis in infrared thermal images. First, to improve the reliability of thermal image analysis, the facial regions of interest (ROIs) were segmented using corner and edge detection. A new temperature feature was then defined using the maximum and minimum temperature, and it was combined with the texture feature to represent temperature distribution of facial ROIs. Finally, Minkowski distance was used to measure feature symmetry of bilateral ROIs. The feature symmetry vectors were input into support vector machine to evaluate the degree of facial thermal symmetry. The results showed that there were significant differences in thermal symmetry between patients with facial paralysis and healthy people. The accuracy of the proposed method for early diagnosis of facial paralysis was 0.933, and the area under the ROC curve was 0.947. In conclusion, temperature and texture features can effectively quantify thermal asymmetry caused by facial paralysis, and the application of machine learning in early detection of facial paralysis in thermal images is feasible.
Collapse
|
16
|
Barrette LX, Xu K, Suresh N, Harris J, Chorath KT, Moreira AG, Rajasekaran K. A systematic quality appraisal of clinical practice guidelines for Ménière's disease using the AGREE II instrument. Eur Arch Otorhinolaryngol 2021; 279:3439-3447. [PMID: 34657983 DOI: 10.1007/s00405-021-07099-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 09/16/2021] [Indexed: 01/17/2023]
Abstract
PURPOSE To systematically appraise clinical practice guidelines for the diagnosis and treatment of Ménière's disease using the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument. MATERIALS AND METHODS A systematic literature search was performed to identify guidelines pertaining to the diagnosis and treatment of Ménière's disease. Data were abstracted from guidelines that met inclusion criteria and appraised by four independent reviewers in the six domains of quality defined by the AGREE II. Domain scores reflecting quality in each domain were calculated. Intraclass correlation coefficients (ICC) were calculated across domains to qualify interrater reliability. RESULTS Six guidelines were found to meet inclusion criteria after a systematic literature search. Of the six clinical practice guidelines appraised using the AGREE II, the American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) guideline received the highest average score, with a mean of 90.7% spanning six quality domains. The guideline with the lowest average score across all domains was the European Position Statement on diagnosis and treatment of Ménière's disease, receiving an average score across domains of 34.6%. Overall quality scores of clinical practice guidelines for Ménière's disease had a standard deviation of 21.3%. Two guidelines met the quality threshold of > 60% in at least five domains, qualifying as 'high': AAO-HNS and National Institute for Health and Care Excellence. Average ICC across all six domains was 0.87, suggesting near total agreement between reviewers. CONCLUSION Ménière's disease remains a challenging entity to diagnose and treat; few existing clinical guidelines meet the standards of quality established by the AGREE II appraisal instrument.
Collapse
Affiliation(s)
| | - Katherine Xu
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Neeraj Suresh
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Jacob Harris
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Kevin T Chorath
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA
| | - Alvaro G Moreira
- Department of Pediatrics, University of Texas Health Science Center-San Antonio, San Antonio, TX, USA
| | - Karthik Rajasekaran
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, PA, USA.
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
17
|
Clinical Practice Guidelines for the Management of Patients With Cleft Lip and Palate: A Systematic Quality Appraisal Using the Appraisal of Guidelines for Research and Evaluation II Instrument. J Craniofac Surg 2021; 33:449-452. [PMID: 34545056 DOI: 10.1097/scs.0000000000008155] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
Abstract
ABSTRACT Patients with cleft lip and/or palate require complex and longitudinal care by a multidisciplinary cleft team. Unfortunately, delivery of cleft care is often fragmented, and care practices can vary significantly. Multiple clinical practice guidelines (CPGs) have been proposed to provide a standardized framework for cleft care delivery. As CPGs have gained popularity, there has been increasing demand to maintain the quality of existing guidelines. A comprehensive search of EMBASE, MEDLINE via PubMed, Scopus, Cochrane and grey literature sources published from January 1, 1990 to December 31, 2020 was conducted to identify CPGs for the care of cleft patients. The Appraisal of Guidelines for Research and Evaluation, 2nd edition II tool was used to assess the quality of selected CPGs. Intraclass coefficients were calculated to assess agreement among appraisers. Eleven guidelines were identified for study inclusion. One guideline was classified as "high" quality by Appraisal of Guidelines for Research and Evaluation II criteria, and the remaining guidelines were classified as "average" or "low" quality. The "Clarity of Presentation" domain achieved the highest mean score (76.9% ± 11.7%) across CPGs, whereas the "Rigor of Development" domain scored the lowest (35.6% ± 21.2%). Intraclass coefficients analysis reflected very good inter-rater reliability across all domains (0.853-0.987). These findings highlight significant variability in the quality of existing CPGs for the global management of patients with cleft lip and/or palate. The "Rigor of Development" domain reflects the greatest opportunity for improvement. Given these findings, future guidelines may prioritize incorporating a systematic review of existing evidence into recommendations.
Collapse
|