SAGES peritoneal dialysis access guideline update 2023

BACKGROUND

Minimally invasive surgery has been used for both de novo insertion and salvage of peritoneal dialysis (PD) catheters. Advanced laparoscopic, basic laparoscopic, open, and image-guided techniques have evolved as the most popular techniques. The aim of this guideline was to develop evidence-based guidelines that support surgeons, patients, and other physicians in decisions on minimally invasive peritoneal dialysis access and the salvage of malfunctioning catheters in both adults and children.

METHODS

A guidelines committee panel of the Society of American Gastrointestinal and Endoscopic Surgeons reviewed the literature since the prior guideline was published in 2014 and developed seven key questions in adults and four in children. After a systematic review of the literature, by the panel, evidence-based recommendations were formulated using the Grading of Recommendations Assessment, Development and Evaluation approach. Recommendations for future research were also proposed.

RESULTS

After systematic review, data extraction, and evidence to decision meetings, the panel agreed on twelve recommendations for the peri-operative performance of laparoscopic peritoneal dialysis access surgery and management of catheter dysfunction.

CONCLUSIONS

In the adult population, conditional recommendations were made in favor of: staged hernia repair followed by PD catheter insertion over simultaneous and traditional start over urgent start of PD when medically possible. Furthermore, the panel suggested advanced laparoscopic insertion techniques rather than basic laparoscopic techniques or open insertion. Conditional recommendations were made for either advanced laparoscopic or image-guided percutaneous insertion and for either nonoperative or operative salvage. A recommendation could not be made regarding concomitant clean-contaminated surgery in adults. In the pediatric population, conditional recommendations were made for either traditional or urgent start of PD, concomitant clean or clean-contaminated surgery and PD catheter placement rather than staged, and advanced laparoscopic placement rather than basic or open insertion.

SAGES/AHPBA guidelines for the use of microwave and radiofrequency liver ablation for the surgical treatment of hepatocellular carcinoma or colorectal liver metastases less than 5 cm

BACKGROUND

Primary hepatocellular carcinoma (HCC) and colorectal liver metastases (CRLM) represent the liver's two most common malignant neoplasms. Liver-directed therapies such as ablation have become part of multidisciplinary therapies despite a paucity of data. Therefore, an expert panel was convened to develop evidence-based recommendations regarding the use of microwave ablation (MWA) and radiofrequency ablation (RFA) for HCC or CRLM less than 5 cm in diameter in patients ineligible for other therapies.

METHODS

A systematic review was conducted for six key questions (KQ) regarding MWA or RFA for solitary liver tumors in patients deemed poor candidates for first-line therapy. Subject experts used the GRADE methodology to formulate evidence-based recommendations and future research recommendations.

RESULTS

The panel addressed six KQs pertaining to MWA vs. RFA outcomes and laparoscopic vs. percutaneous MWA. The available evidence was poor quality and individual studies included both HCC and CRLM. Therefore, the six KQs were condensed into two, recognizing that these were two disparate tumor groups and this grouping was somewhat arbitrary. With this significant limitation, the panel suggested that in appropriately selected patients, either MWA or RFA can be safe and feasible. However, this recommendation must be implemented cautiously when simultaneously considering patients with two disparate tumor biologies. The limited data suggested that laparoscopic MWA of anatomically more difficult tumors has a compensatory higher morbidity profile compared to percutaneous MWA, while achieving similar overall 1-year survival. Thus, either approach can be appropriate depending on patient-specific factors (very low certainty of evidence).

CONCLUSION

Given the weak evidence, these guidelines provide modest guidance regarding liver ablative therapies for HCC and CRLM. Liver ablation is just one component of a multimodal approach and its use is currently limited to a highly selected population. The quality of the existing data is very low and therefore limits the strength of the guidelines.

GRADE concept 6: a novel application of external indirect evidence into GRADE ratings of evidence certainty in network meta-analysis

OBJECTIVES

We describe how consideration of external evidence may play an important role in judging certainty in the process of establishing the certainty of the evidence. Our example is a network meta-analysis (NMA) addressing treatment for Ebola virus disease, which informed a World Health Organization guideline.

STUDY DESIGN AND SETTING

Through Grading of Recommendations Assessment, Development, and Evaluations (GRADE) project group iterative online, in-person and email discussions, we developed this GRADE concept and obtained approval from the GRADE working group. Using the null as a threshold, we rated our certainty for network estimates in mortality, including consideration of evidence external to the NMA (i.e., did not meet eligibility criteria) and formal logical construction.

RESULTS

Based on the existing GRADE guidance, we rated the network estimate for one indirect comparison as low certainty. The formal logical construction that lead us reevaluate the certainty of the evidence is as follows: if A is superior to B, and B is not inferior to C, then A must be superior to C. After considering the logic and the external indirect evidence, we concluded at least moderate certainty for the comparison.

CONCLUSION

Systematic review authors and guideline developers should apply the fundamental logical construction for indirect comparisons and consider compelling external evidence in NMA certainty ratings.

SAGES/AHPBA guidelines for the use of minimally invasive surgery for the surgical treatment of colorectal liver metastases (CRLM)

BACKGROUND

Colorectal liver metastases (CRLM) occur in roughly half of patients with colorectal cancer. Minimally invasive surgery (MIS) has become an increasingly acceptable and utilized technique for resection in these patients, but there is a lack of specific guidelines on the use of MIS hepatectomy in this setting. A multidisciplinary expert panel was convened to develop evidence-based recommendations regarding the decision between MIS and open techniques for the resection of CRLM.

METHODS

Systematic review was conducted for two key questions (KQ) regarding the use of MIS versus open surgery for the resection of isolated liver metastases from colon and rectal cancer. Evidence-based recommendations were formulated using the GRADE methodology by subject experts. Additionally, the panel developed recommendations for future research.

RESULTS

The panel addressed two KQs, which pertained to staged or simultaneous resection of resectable colon or rectal metastases. The panel made conditional recommendations for the use of MIS hepatectomy for both staged and simultaneous resection when deemed safe, feasible, and oncologically effective by the surgeon based on the individual patient characteristics. These recommendations were based on low and very low certainty of evidence.

CONCLUSIONS

These evidence-based recommendations should provide guidance regarding surgical decision-making in the treatment of CRLM and highlight the importance of individual considerations of each case. Pursuing the identified research needs may help further refine the evidence and improve future versions of guidelines for the use of MIS techniques in the treatment of CRLM.

Multi-society consensus conference and guideline on the treatment of gastroesophageal reflux disease (GERD)

BACKGROUND

Gastroesophageal reflux disease (GERD) is one of the most common diseases in North America and globally. The aim of this guideline is to provide evidence-based recommendations regarding the most utilized and available endoscopic and surgical treatments for GERD.

METHODS

Systematic literature reviews were conducted for 4 key questions regarding the surgical and endoscopic treatments for GERD in adults: preoperative evaluation, endoscopic vs surgical or medical treatment, complete vs partial fundoplication, and treatment for obesity (body mass index [BMI] ≥ 35 kg/m²) and concomitant GERD. Evidence-based recommendations were formulated using the GRADE methodology by subject experts. Recommendations for future research were also proposed.

RESULTS

The consensus provided 13 recommendations. Through the development of these evidence-based recommendations, an algorithm was proposed for aid in the treatment of GERD. Patients with typical symptoms should undergo upper endoscopy, manometry, and pH-testing; additional testing may be required for patients with atypical or extra-esophageal symptoms. Patients with normal or abnormal findings on manometry should consider undergoing partial fundoplication. Magnetic sphincter augmentation or fundoplication are appropriate surgical procedures for adults with GERD. For patients who wish to avoid surgery, the Stretta procedure and transoral incisionless fundoplication (TIF 2.0) were found to have better outcomes than proton pump inhibitors alone. Patients with concomitant obesity were recommended to undergo either gastric bypass or fundoplication, although patients with severe comorbid disease or BMI > 50 should undergo Roux-en-Y gastric bypass for the additional benefits that follow weight loss.

CONCLUSION

Using the recommendations an algorithm was developed by this panel, so that physicians may better counsel their patients with GERD. There are certain patient factors that have been excluded from included studies/trials, and so these recommendations should not replace surgeon-patient decision making. Engaging in the identified research areas may improve future care for GERD patients.

Surgical approach to microwave and radiofrequency liver ablation for hepatocellular carcinoma and colorectal liver metastases less than 5 cm: a systematic review and meta-analysis

BACKGROUND

Primary hepatocellular carcinoma (HCC) and colorectal liver metastases (CRLM) represent the two most common malignant neoplasms of the liver. The objective of this study was to assess outcomes of surgical approaches to liver ablation comparing laparoscopic versus percutaneous microwave ablation (MWA), and MWA versus radiofrequency ablation (RFA) in patients with HCC or CRLM lesions smaller than 5 cm.

METHODS

A systematic review was conducted across seven databases, including PubMed, Embase, and Cochrane, to identify all comparative studies between 1937 and 2021. Two independent reviewers screened for eligibility, extracted data for selected studies, and assessed study bias using the modified Newcastle Ottawa Scale. Random effects meta-analyses were subsequently performed on all available comparative data.

RESULTS

From 1066 records screened, 11 studies were deemed relevant to the study and warranted inclusion. Eight of the 11 studies were at high or uncertain risk for bias. Our meta-analyses of two studies revealed that laparoscopic MW ablation had significantly higher complication rates compared to a percutaneous approach (risk ratio = 4.66; 95% confidence interval = [1.23, 17.22]), but otherwise similar incomplete ablation rates, local recurrence, and oncologic outcomes. The remaining nine studies demonstrated similar efficacy of MWA and RFA, as measured by incomplete ablation, complication rates, local/regional recurrence, and oncologic outcomes, for both HCC and CRLM lesions less than 5 cm (p > 0.05 for all outcomes). There was no statistical subgroup interaction in the analysis of tumors < 3 cm.

CONCLUSION

The available comparative evidence regarding both laparoscopic versus percutaneous MWA and MWA versus RFA is limited, evident by the few studies that suffer from high/uncertain risk of bias. Additional high-quality randomized trials or statistically matched cohort studies with sufficient granularity of patient variables, institutional experience, and physician specialty/training will be useful in informing clinical decision making for the ablative treatment of HCC or CRLM.

Case studies to explore the optimal use of randomized and nonrandomized studies in evidence syntheses that use GRADE

OBJECTIVES

Randomized controlled trials (RCTs) are the preferred source of evidence for the relative effect of healthcare interventions summarized in knowledge syntheses. Nonrandomized studies of interventions (NRSI) may provide replacement, sequential, or complementary evidence to RCTs. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach can provide different options for properly using RCTs and NRSI integrated in health syntheses. In this article, we discuss different implications on the certainty of evidence when authors consider the use of NRSI and RCTs in systematic reviews using GRADE. Although this is a GRADE-related article, it is not an official GRADE guidance or concept article.

STUDY DESIGN AND SETTING

We present case studies used during GRADE working group meetings for discussion of the effects of using NRSI and RCTs on GRADE domains and on the certainty of evidence. Several concepts were discussed through iterative feedback with experts in GRADE methods and Cochrane authors. We compared suggested solutions for possible scenarios that can be met in evidence syntheses informing decisions and future guidance.

RESULTS

Different scenarios for the use of RCTs and NRSI in evidence syntheses are presented, focusing on how different GRADE ratings between RCTs and NRSI affect the overall assessment of the evidence and possible health recommendations.

CONCLUSIONS

Considering differences and similarities grounded in the GRADE approach between NRSI and RCTs may help complement one another and maximize the value of knowledge syntheses and health recommendations.

Minimally invasive versus open hepatectomy for the resection of colorectal liver metastases: a systematic review and meta-analysis

BACKGROUND

While surgical resection has a demonstrated utility for patients with colorectal liver metastases (CRLM), it is unclear whether minimally invasive surgery (MIS) or an open approach should be used. This review sought to assess the efficacy and safety of MIS versus open hepatectomy for isolated, resectable CRLM when performed separately from (Key Question (KQ) 1) or simultaneously with (KQ2) the resection of the primary tumor.

METHODS

PubMed, Embase, Google Scholar, Cochrane CENTRAL, International Clinical Trials Registry Platform (ICTRP), and ClinicalTrials.gov databases were searched to identify both randomized controlled trials (RCTs) and non-randomized comparative studies published during January 2000-September 2020. Two independent reviewers screened literature for eligibility, extracted data from included studies, and assessed internal validity using the Cochrane Risk of Bias 2.0 Tool and the Newcastle-Ottawa Scale. A random-effects meta-analysis was performed using risk ratios (RR) and mean differences (MD).

RESULTS

From 2304 publications, 35 studies were included for meta-analysis. For staged resections, three RCTs and 20 observational studies were included. Data from RCTs indicated MIS having similar disease-free survival (DFS) at 1-year (RR 1.03, 95%CI 0.70-1.50), overall survival (OS) at 5-years (RR 1.04, 95%CI 0.84-1.28), fewer complications of Clavien-Dindo Grade III (RR 0.62, 95%CI 0.38-1.00), and shorter hospital length of stay (LOS) (MD -6.6 days, 95%CI -10.2, -3.0). For simultaneous resections, 12 observational studies were included. There was no evidence of a difference between MIS and the open group for DFS-1-year, OS-5-year, complications, R0 resections, blood transfusions, along with lower blood loss (MD -177.35 mL, 95%CI -273.17, -81.53) and shorter LOS (MD -3.0 days, 95%CI -3.82, -2.17).

CONCLUSIONS

Current evidence regarding the optimal approach for CRLM resection demonstrates similar oncologic outcomes between MIS and open techniques, however MIS hepatectomy had a shorter LOS, lower blood loss and complication rate, for both staged and simultaneous resections.

Biological plausibility in environmental health systematic reviews: a GRADE concept paper

BACKGROUND

"Biological plausibility" is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely-used approaches for assessing the certainty of evidence (CoE) which underpins the findings of a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) CoE Framework. Whether the omission of biological plausibility is a potential limitation of the GRADE CoE Framework is a topic that is regularly discussed, especially in the context of environmental health systematic reviews.

OBJECTIVES

We analyse how the concept of "biological plausibility", as applied in the context of assessing certainty of the evidence that supports the findings of a systematic review, is accommodated under the processes of systematic review and the existing GRADE domains.

RESULTS AND DISCUSSION

We argue that "biological plausibility" is a concept which primarily comes into play when direct evidence about the effects of an exposure on a population of concern (usually humans) is absent, at high risk of bias, is inconsistent, or limited in other ways. In such circumstances, researchers look toward evidence from other study designs in order to draw conclusions. In this respect, we can consider experimental animal and in vitro evidence as "surrogates" for the target populations, exposures, comparators and outcomes of actual interest. Through discussion of 10 examples of experimental surrogates, we propose that the concept of biological plausibility consists of two principal aspects: a "generalisability aspect" and a "mechanistic aspect". The "generalisability aspect" concerns the validity of inferences from experimental models to human scenarios, and asks the same question as does the assessment of external validity or indirectness in systematic reviews. The "mechanistic aspect" concerns certainty in knowledge of biological mechanisms and would inform judgements of indirectness under GRADE, and thus the overall CoE. While both aspects are accommodated under the indirectness domain of the GRADE CoE Framework, further research is needed to determine how to use knowledge of biological mechanisms in the assessment of indirectness of the evidence in systematic reviews.

SAGES 2022 guidelines regarding the use of laparoscopy in the era of COVID-19

BACKGROUND

SARS-CoV-2 has changed global healthcare since the pandemic began in 2020. The safety of minimally invasive surgery (MIS) utilizing insufflation from the standpoint of safety to the operating room personnel is currently being explored. The aims of this guideline are to examine the existing evidence to provide guidance regarding MIS for the patient with, or suspecting of having, the SARS-CoV-2 as well as the healthcare team involved.

METHODS

Systematic literature reviews were conducted for 2 key questions (KQ) regarding the safety of MIS in the setting of COVID-19 pandemic. Reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis criteria. Evidence-based recommendations were formulated using a narrative synthesis of the literature by subject experts. Recommendations for future research were also proposed.

RESULTS

In KQ1, a total of 1361 articles were reviewed, with 2 articles meeting inclusion. In KQ2, a total of 977 articles were reviewed, with 4 articles met inclusions criteria, of which 2 studies reported on the SARS-CoV2 virus specifically. Despite many publications in the field, very little well-controlled and unbiased data exist to inform the recommendations. Of that which is available, it shows that both laparoscopic and open operations in Covid-positive patients had similar rates of OR staff positivity rates; however, patients who underwent laparoscopic procedures had a lower perioperative mortality than open procedures. Also, SARS-CoV-2 particles have been detected in the surgical plume at laparoscopy.

CONCLUSION

With demonstrated equivalence of operating room staff exposure, and noninferiority of laparoscopic access with respect to mortality, either laparoscopic or open approaches to abdominal operations may be used in patients with SARS-CoV-2. Measures should be employed for all laparoscopic or open cases to prevent exposure of operating room staff to the surgical plume, as virus can be present in this plume.

Guidelines for the performance of minimally invasive splenectomy

BACKGROUND

Minimally invasive splenectomy (MIS) is increasingly favored for the treatment of benign and malignant diseases of the spleen over open access approaches. While many studies cite the superiority of MIS in terms of decreased morbidity and length of stay over a traditional open approach, the comparative effectiveness of specific technical and peri-operative approaches to MIS is unclear.

OBJECTIVE

To develop evidence-based guidelines that support clinicians, patients, and others in decisions on the peri-operative performance of MIS.

METHODS

A guidelines committee panel of the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) including methodologists used the Grading of Recommendations Assessment, Development and Evaluation approach to grade the certainty of evidence and formulate recommendations.

RESULTS

Informed by a systematic review of the evidence, the panel agreed on eight recommendations for the peri-operative performance of MIS for adults and children in elective situations addressing six key questions.

CONCLUSIONS

Conditional recommendations were made in favor of lateral positioning for non-hematologic disease, intra-operative platelet administration for patients with idiopathic thrombocytopenic purpura instead of preoperative administration, and the use of mechanical devices to control the splenic hilum. Further, a conditional recommendation was made against routine intra-operative drain placement.

SAGES guidelines for the surgical treatment of gastroesophageal reflux (GERD)

BACKGROUND

Gastroesophageal Reflux Disease (GERD) is an extremely common condition with several medical and surgical treatment options. A multidisciplinary expert panel was convened to develop evidence-based recommendations to support clinicians, patients, and others in decisions regarding the treatment of GERD with an emphasis on evaluating different surgical techniques.

METHODS

Literature reviews were conducted for 4 key questions regarding the surgical treatment of GERD in both adults and children: surgical vs. medical treatment, robotic vs. laparoscopic fundoplication, partial vs. complete fundoplication, and division vs. preservation of short gastric vessels in adults or maximal versus minimal dissection in pediatric patients. Evidence-based recommendations were formulated using the GRADE methodology by subject experts. Recommendations for future research were also proposed.

RESULTS

The panel provided seven recommendations for adults and children with GERD. All recommendations were conditional due to very low, low, or moderate certainty of evidence. The panel conditionally recommended surgical treatment over medical management for adults with chronic or chronic refractory GERD. There was insufficient evidence for the panel to make a recommendation regarding surgical versus medical treatment in children. The panel suggested that once the decision to pursue surgical therapy is made, adults and children with GERD may be treated with either a robotic or a laparoscopic approach, and either partial or complete fundoplication based on surgeon-patient shared decision-making and patient values. In adults, the panel suggested either division or non-division of the short gastric vessels is appropriate, and that children should undergo minimal dissection during fundoplication.

CONCLUSIONS

These recommendations should provide guidance with regard to surgical decision-making in the treatment of GERD and highlight the importance of shared decision-making and patient values to optimize patient outcomes. Pursuing the identified research needs may improve future versions of guidelines for the treatment of GERD.

Customized guidance/training improved the psychometric properties of methodologically rigorous risk of bias instruments for non-randomized studies

OBJECTIVES

To evaluate the impact of guidance and training on the inter-rater reliability (IRR), inter-consensus reliability (ICR) and evaluator burden of the Risk of Bias (RoB) in Non-randomized Studies (NRS) of Interventions (ROBINS-I) tool, and the RoB instrument for NRS of Exposures (ROB-NRSE).

STUDY DESIGN AND SETTING

In a before-and-after study, seven reviewers appraised the RoB using ROBINS-I (n = 44) and ROB-NRSE (n = 44), before and after guidance and training. We used Gwet's AC₁ statistic to calculate IRR and ICR.

RESULTS

After guidance and training, the IRR and ICR of the overall bias domain of ROBINS-I and ROB-NRSE improved significantly; with many individual domains showing either a significant (IRR and ICR of ROB-NRSE; ICR of ROBINS-I), or nonsignificant improvement (IRR of ROBINS-I). Evaluator burden significantly decreased after guidance and training for ROBINS-I, whereas for ROB-NRSE there was a slight nonsignificant increase.

CONCLUSION

Overall, there was benefit for guidance and training for both tools. We highly recommend guidance and training to reviewers prior to RoB assessments and that future research investigate aspects of guidance and training that are most effective.

SAGES guidelines for the use of peroral endoscopic myotomy (POEM) for the treatment of achalasia

BACKGROUND

Peroral endoscopic myotomy (POEM) is increasingly used as primary treatment for esophageal achalasia, in place of the options such as Heller myotomy (HM) and pneumatic dilatation (PD) OBJECTIVE: These evidence-based guidelines from the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) intend to support clinicians, patients and others in decisions about the use of POEM for treatment of achalasia.

RESULTS

The panel agreed on 4 recommendations for adults and children with achalasia.

CONCLUSIONS

Strong recommendation for the use of POEM over PD was issued unless the concern of continued postoperative PPI use remains a key decision-making concern to the patient. Conditional recommendations included the option of using either POEM or HM with fundoplication to treat achalasia, and favored POEM over HM for achalasia subtype III.

Giant Cell Tumor of Triquetrum: A Case Report with Literature Review

Background  Giant cell tumor (GCT) of bone is a benign, aggressive tumor of bone and occurs commonly around the knee and distal radius. GCT of bone rarely occurs in hand. In hand, metacarpals are the most common site and there have been only a few case reports of GCT of the carpal bone. In hand, these tumors are very aggressive and these have a high tendency to recur after intralesional curettage. No long-term study is available for choosing an appropriate method of treatment for these tumors in hand. Case Description  Herein, we report a case of GCT of the bone involving triquetrum which was managed by excision of triquetrum and scaphoid bone. The reconstruction of the wrist was done through limited carpal fusion, by doing three corner fusion of the wrist. At 2 years after surgery, the patient was asymptomatic and radiographs revealed fusion of lunocapitate and lunohamate joints with no evidence of recurrence. Literature review  Current literature regarding GCT of triquetrum includes case reports that are reviewed in this report. Clinical Relevance  This case illustrates the successful treatment of GCT of triquetrum, which is a rare tumor. Three-corner fusion is a reliable and reproducible procedure that has been used for other arthritic conditions. The use of three corner fusion procedure can be extended to GCT of carpal bones. It has been a motion-preserving alternative to proximal row carpectomy.

GRADE guidelines: 21 part 1. Study design, risk of bias, and indirectness in rating the certainty across a body of evidence for test accuracy

OBJECTIVES

This article provides updated GRADE guidance about how authors of systematic reviews and health technology assessments and guideline developers can assess the results and the certainty of evidence (also known as quality of the evidence or confidence in the estimates) of a body of evidence addressing test accuracy (TA).

STUDY DESIGN AND SETTING

We present an overview of the GRADE approach and guidance for rating certainty in TA in clinical and public health and review the presentation of results of a body of evidence regarding tests. Part 1 of the two parts in this 21st guidance article about how to apply GRADE focuses on understanding study design issues in test accuracy, provide an overview of the domains, and describe risk of bias and indirectness specifically.

RESULTS

Supplemented by practical examples, we describe how raters of the evidence using GRADE can evaluate study designs focusing on tests and how they apply the GRADE domains risk of bias and indirectness to a body of evidence of TA studies.

CONCLUSION

Rating the certainty of a body of evidence using GRADE in Cochrane and other reviews and World Health Organization and other guidelines dealing with in TA studies helped refining our approach. The resulting guidance will help applying GRADE successfully for questions and recommendations focusing on tests.

Inter-rater reliability and validity of risk of bias instrument for non-randomized studies of exposures: a study protocol

BACKGROUND

A new tool, "risk of bias (ROB) instrument for non-randomized studies of exposures (ROB-NRSE)," was recently developed. It is important to establish consistency in its application and interpretation across review teams. In addition, it is important to understand if specialized training and guidance will improve the reliability in the results of the assessments. Therefore, the objective of this cross-sectional study is to establish the inter-rater reliability (IRR), inter-consensus reliability (ICR), and concurrent validity of the new ROB-NRSE tool. Furthermore, as this is a relatively new tool, it is important to understand the barriers to using this tool (e.g., time to conduct assessments and reach consensus-evaluator burden).

METHODS

Reviewers from four participating centers will apprise the ROB of a sample of NRSE publications using ROB-NRSE tool in two stages. For IRR and ICR, two pairs of reviewers will assess the ROB for each NRSE publication. In the first stage, reviewers will assess the ROB without any formal guidance. In the second stage, reviewers will be provided customized training and guidance. At each stage, each pair of reviewers will resolve conflicts and arrive at a consensus. To calculate the IRR and ICR, we will use Gwet's AC₁ statistic. For concurrent validity, reviewers will appraise a sample of NRSE publications using both the Newcastle-Ottawa Scale (NOS) and ROB-NRSE tool. We will analyze the concordance between the two tools for similar domains and for the overall judgments using Kendall's tau coefficient. To measure evaluator burden, we will assess the time taken to apply ROB-NRSE tool (without and with guidance), and the NOS. To assess the impact of customized training and guidance on the evaluator burden, we will use the generalized linear models. We will use Microsoft Excel and SAS 9.4, to manage and analyze study data, respectively.

DISCUSSION

The quality of evidence from systematic reviews that include NRSE depends partly on the study-level ROB assessments. The findings of this study will contribute to an improved understanding of ROB-NRSE and how best to use it.

Symphytum officinale augments osteogenesis in human bone marrow-derived mesenchymal stem cells in vitro as they differentiate into osteoblasts

ETHNOPHARMACOLOGICAL RELEVANCE

Mesenchymal stem cells (MSCs) are multipotent stem cells possessing regenerative potential. Symphytum officinale (SO) is a medicinal plant and in homoeopathic literature, believed to accelerate bone healing.

AIM OF THE STUDY

This study aimed to determine if homoeopathic doses of SO could augment osteogenesis in MSCs as they differentiate into osteoblasts in vitro.

MATERIALS AND METHODS

Bone marrow samples were obtained from patients who underwent bone grafting procedures (n = 15). MSCs were isolated, expanded and characterized by flow cytometry (CD90, CD105). Cytotoxicity of SO was evaluated by MTT assay. Osteogenic differentiation was induced in MSCs with β-glycerophosphate, ascorbic acid and dexamethasone over 2 weeks. Different homoeopathic doses of SO (MT, 3C, 6C, 12C and 30C) were added to the basic differentiation medium (BDM) and efficiency of MSCs differentiating into osteoblasts were measured by evaluating expression of Osteocalcin using flow cytometry, and alkaline phosphatase activity using ELISA. Gene expression analyses for osteoblast markers (Runx-2, Osteopontin and Osteocalcin) were evaluated in differentiated osteoblasts using qPCR.

RESULTS

Flow cytometry (CD90, CD105) detected MSCs isolated from bone marrow (93-98%). MTT assay showed that the selected doses of SO did not induce any cytotoxicity in MSCs (24 hours). The efficiency of osteogenic differentiation (2 weeks) for different doses of Symphytum officinale was determined by flow cytometry (n = 10) for osteoblast marker, Osteocalcin, and most doses of Symphytum officinale enhanced osteogenesis. Interestingly, gene expression analysis for Runx-2 (n = 10), Osteopontin (n = 10), Osteocalcin (n = 10) and alkaline phosphatase activity (n = 8) also showed increased osteogenesis with the addition of Symphytum officinale to BDM, specially mother tincture.

CONCLUSIONS

Our findings suggest that homoeopathic dose (specially mother tincture) of Symphytum officinale has the potential to enhance osteogenesis.

Inter-rater reliability and concurrent validity of ROBINS-I: protocol for a cross-sectional study

BACKGROUND

The Cochrane Bias Methods Group recently developed the "Risk of Bias (ROB) in Non-randomized Studies of Interventions" (ROBINS-I) tool to assess ROB for non-randomized studies of interventions (NRSI). It is important to establish consistency in its application and interpretation across review teams. In addition, it is important to understand if specialized training and guidance will improve the reliability of the results of the assessments. Therefore, the objective of this cross-sectional study is to establish the inter-rater reliability (IRR), inter-consensus reliability (ICR), and concurrent validity of ROBINS-I. Furthermore, as this is a relatively new tool, it is important to understand the barriers to using this tool (e.g., time to conduct assessments and reach consensus-evaluator burden).

METHODS

Reviewers from four participating centers will appraise the ROB of a sample of NRSI publications using the ROBINS-I tool in two stages. For IRR and ICR, two pairs of reviewers will assess the ROB for each NRSI publication. In the first stage, reviewers will assess the ROB without any formal guidance. In the second stage, reviewers will be provided customized training and guidance. At each stage, each pair of reviewers will resolve conflicts and arrive at a consensus. To calculate the IRR and ICR, we will use Gwet's AC₁ statistic. For concurrent validity, reviewers will appraise a sample of NRSI publications using both the New-castle Ottawa Scale (NOS) and ROBINS-I. We will analyze the concordance between the two tools for similar domains and for the overall judgments using Kendall's tau coefficient. To measure the evaluator burden, we will assess the time taken to apply the ROBINS-I (without and with guidance), and the NOS. To assess the impact of customized training and guidance on the evaluator burden, we will use the generalized linear models. We will use Microsoft Excel and SAS 9.4 to manage and analyze study data, respectively.

DISCUSSION

The quality of evidence from systematic reviews that include NRS depends partly on the study-level ROB assessments. The findings of this study will contribute to an improved understanding of the ROBINS-I tool and how best to use it.

Neurological and psychiatric adverse effects of long-term methylphenidate treatment in ADHD: A map of the current evidence

Methylphenidate (MPH), the most common medication for children with Attention Deficit/Hyperactivity Disorder (ADHD) in many countries, is often prescribed for long periods of time. Any long-term psychotropic treatment in childhood raises concerns about possible adverse neurological and psychiatric outcomes. We aimed to map current evidence regarding neurological and psychiatric outcomes, adverse or beneficial, of long-term MPH (> 1 year) treatment in ADHD. We coded studies using a "traffic light" system: Green: safe/favours MPH; Amber: warrants caution; Red: not safe/not well-tolerated. Un-categorisable study findings were coded as "Unclear". Although some evidence suggests an elevated risk of psychosis and tics, case reports describe remission on discontinuation. Several studies suggest that long-term MPH may reduce depression and suicide in ADHD. Evidence suggests caution in specific groups including pre-school children, those with tics, and adolescents at risk for substance misuse. We identified a need for more studies that make use of large longitudinal databases, focus on specific neuropsychiatric outcomes, and compare outcomes from long-term MPH treatment with outcomes following shorter or no pharmacological intervention.

The incidence and prevalence of delirium across palliative care settings: A systematic review

BACKGROUND

Delirium is a common and distressing neurocognitive condition that frequently affects patients in palliative care settings and is often underdiagnosed.

AIM

Expanding on a 2013 review, this systematic review examines the incidence and prevalence of delirium across all palliative care settings.

DESIGN

This systematic review and meta-analyses were prospectively registered with PROSPERO and included a risk of bias assessment.

DATA SOURCES

Five electronic databases were examined for primary research studies published between 1980 and 2018. Studies on adult, non-intensive care and non-postoperative populations, either receiving or eligible to receive palliative care, underwent dual reviewer screening and data extraction. Studies using standardized delirium diagnostic criteria or valid assessment tools were included.

RESULTS

Following initial screening of 2596 records, and full-text screening of 153 papers, 42 studies were included. Patient populations diagnosed with predominantly cancer (n = 34) and mixed diagnoses (n = 8) were represented. Delirium point prevalence estimates were 4%-12% in the community, 9%-57% across hospital palliative care consultative services, and 6%-74% in inpatient palliative care units. The prevalence of delirium prior to death across all palliative care settings (n = 8) was 42%-88%. Pooled point prevalence on admission to inpatient palliative care units was 35% (confidence interval = 0.29-0.40, n = 14). Only one study had an overall low risk of bias. Varying delirium screening and diagnostic practices were used.

CONCLUSION

Delirium is prevalent across all palliative care settings, with one-third of patients delirious at the time of admission to inpatient palliative care. Study heterogeneity limits meta-analyses and highlights the future need for rigorous studies.

A Scoping Review to Map Empirical Evidence Regarding Key Domains and Questions in the Clinical Pathway of Delirium in Palliative Care

CONTEXT

Based on the clinical care pathway of delirium in palliative care (PC), a published analytic framework (AF) formulated research questions in key domains and recommended a scoping review to identify evidence gaps.

OBJECTIVES

To produce a literature map for key domains of the published AF: screening, prognosis and diagnosis, management, and the health-related outcomes.

METHODS

A standard scoping review framework was used by an interdisciplinary study team of nurse- and physician-delirium researchers, an information specialist, and review methodologists to conduct the review. Knowledge user engagement provided context in refining 19 AF questions. A peer-reviewed search strategy identified citations in Medline, PsycINFO, Embase, and CINAHL databases between 1980 and 2018. Two reviewers independently screened records for inclusion using explicit study eligibility criteria for the population, design, delirium diagnosis, and investigational intent.

RESULTS

Of 104 studies reporting empirical data and meeting eligibility criteria, most were conducted in patients with cancer (73.1%) and in inpatient PC units (52%). The most frequent study design was a one or more group, nonrandomized trial or cohort (67.3%). Evidence gaps were identified: delirium risk prediction; comparative effectiveness and harms of prevention, variability in delirium management across PC settings, advanced directive and substitute decision-maker input, and transition of care location; and estimating delirium reversibility. Future rigorous primary studies are required to address these gaps and preliminary concerns regarding the quality of extant literature.

CONCLUSION

Substantial evidence gaps exist, providing opportunities for future research regarding the assessment, prognosis, and management of delirium in PC settings.

Predicting Outcomes From Radical Radiotherapy for Non-small Cell Lung Cancer: A Systematic Review of the Existing Literature

Radical radiotherapy (RT) is a potentially curative treatment in non-small cell lung cancer (NSCLC) and is delivered in conventional 2-Gy fractions, hypofractionated and ablative stereotactic courses. No reliable, predictive biomarkers for the clinical events of local control, appearance of distant metastases and development of toxicity have been introduced in routine clinical practice. Such a test would enable the Radiotherapist to tailor the clinical management of individual patients, considering their pre-treatment characteristics, in order reduce the risk of recurrence or toxicity e.g., dose modification, accelerated fractionation, hypofractionation, or concurrent systemic therapy. The aim of this review was to map the published literature relating to investigations of the potential predictive value of patient or treatment characteristics in radical RT for NSCLC. These investigations should remain a research focus for disease control given the upward trends in lung cancer incidence, and for the avoidance of toxicity, given the survivorship afforded to the cohort of patients that do well with radical RT, or with the increasing range of systemic agents following metastatic relapse. The conclusion of the presented analysis is that there are no published, effective and validated predictive tools for estimation of risk of local/distant recurrence or toxicity after radical RT for NSCLC. The authors have identified an important space for future research in the field of lung cancer radiotherapy.

GRADE equity guidelines 3: considering health equity in GRADE guideline development: rating the certainty of synthesized evidence

Objectives

The aim of this paper is to describe a conceptual framework for how to consider health equity in the Grading Recommendations Assessment and Development Evidence (GRADE) guideline development process.

Study Design and Setting

Consensus-based guidance developed by the GRADE working group members and other methodologists.

Results

We developed consensus-based guidance to help address health equity when rating the certainty of synthesized evidence (i.e., quality of evidence). When health inequity is determined to be a concern by stakeholders, we propose five methods for explicitly assessing health equity: (1) include health equity as an outcome; (2) consider patient-important outcomes relevant to health equity; (3) assess differences in the relative effect size of the treatment; (4) assess differences in baseline risk and the differing impacts on absolute effects; and (5) assess indirectness of evidence to disadvantaged populations and/or settings.

Conclusion

The most important priority for research on health inequity and guidelines is to identify and document examples where health equity has been considered explicitly in guidelines. Although there is a weak scientific evidence base for assessing health equity, this should not discourage the explicit consideration of how guidelines and recommendations affect the most vulnerable members of society.

Methods for Developing Evidence Reviews in Short Periods of Time: A Scoping Review

INTRODUCTION

Rapid reviews (RR), using abbreviated systematic review (SR) methods, are becoming more popular among decision-makers. This World Health Organization commissioned study sought to summarize RR methods, identify differences, and highlight potential biases between RR and SR.

METHODS

Review of RR methods (Key Question 1 [KQ1]), meta-epidemiologic studies comparing reliability/ validity of RR and SR methods (KQ2), and their potential associated biases (KQ3). We searched Medline, EMBASE, Cochrane Library, grey literature, and checked reference lists, used personal contacts, and crowdsourcing (e.g. email listservs). Selection and data extraction was conducted by one reviewer (KQ1) or two reviewers independently (KQ2-3).

RESULTS

Across all KQs, we identified 42,743 citations through the literature searches. KQ1: RR methods from 29 organizations were reviewed. There was no consensus on which aspects of the SR process to abbreviate. KQ2: Studies comparing the conclusions of RR and SR (n = 9) found them to be generally similar. Where major differences were identified, it was attributed to the inclusion of evidence from different sources (e.g. searching different databases or including different study designs). KQ3: Potential biases introduced into the review process were well-identified although not necessarily supported by empirical evidence, and focused mainly on selective outcome reporting and publication biases.

CONCLUSION

RR approaches are context and organization specific. Existing comparative evidence has found similar conclusions derived from RR and SR, but there is a lack of evidence comparing the potential of bias in both evidence synthesis approaches. Further research and decision aids are needed to help decision makers and reviewers balance the benefits of providing timely evidence with the potential for biased findings.

Comparative efficacy and safety of insulin analogs in hospitalized adults

PURPOSE

The comparative efficacy, safety, and cost-effectiveness of rapid and long-acting insulin analogs compared with regular or neutral protamine Hagedorn nonanalog insulins or with oral antidiabetic agents in hospitalized adults were evaluated.

METHODS

A literature search was conducted to identify studies that compared the effects of rapid-acting, long-acting, or mixed insulin analogs with short- or intermediate-acting insulin or any other oral antidiabetic medication.

RESULTS

Twenty-three primary studies were included in the review. Rapid-acting analogs and basal-bolus analog regimens were found to reduce the duration of hospital stay by approximately one day compared with regular insulin and basal-bolus nonanalog regimens. One large cohort study found an adjusted 48% relative risk reduction in mortality with rapid-acting analogs versus regular insulin in a heterogeneous hospitalized hyperglycemic population. A randomized controlled trial found a significant reduction in postoperative complications with basal-bolus analogs compared with basal-bolus nonanalog insulin. When compared with regular sliding-scale insulin (SSI), fixed-dose insulin glargine with or without insulin glulisine was found to reduce the blood glucose concentration in patients with type 2 diabetes and reduce postoperative complications in surgical patients with diabetes. The quality of evidence was primarily very low or low for most outcomes.

CONCLUSION

A systematic literature review revealed a very low or low quality of evidence, suggesting that, compared with nonanalog regimens, rapid-acting insulin analogs reduce the duration of hospital stay and mortality rates and that basal- bolus analog regimens may reduce the duration of hospital stay and postoperative complications. There is also a low quality of evidence to suggest that a fixed-dose analog regimen of insulin glargine with or without insulin glulisine is more effective than regular SSI for reducing blood glucose concentrations and postoperative complications.

Considerations from the risk of bias perspective for updating Cochrane reviews

Authors of Cochrane reviews are expected to update their reviews every 2 years. The updating process helps to ensure that reviews are current and include recent evidence. However, the updating process is time-consuming for authors, particularly when Cochrane methods evolve and authors are required to revisit some of the originally included studies.The Cochrane Collaboration's 'Risk of bias' tool is a mandatory component of Cochrane reviews, providing an assessment of the potential biases of included studies. The tool has been modified most recently in 2011, and the expectation is that new versions will continue to be produced and utilised in all Cochrane reviews. In this commentary we discuss, in the context of updating scenarios that are likely to be encountered, the potential options systematic review authors may have recourse to when the Cochrane Collaboration's 'Risk of bias' tool has been modified between the original review and its update. We recommend that authors who are updating reviews should revise their original assessments of included studies using the most recent version of the risk of bias tool. Despite the increased workload, use of the most recent version of the tool facilitates consistency of methods and reporting both across and within reviews, and ensures currency to the methodological rigour.

Mitral Valve Clip for Treatment of Mitral Regurgitation: An Evidence-Based Analysis

BACKGROUND

Many of the 500,000 North American patients with chronic mitral regurgitation may be poor candidates for mitral valve surgery.

OBJECTIVE

The objective of this study was to investigate the comparative effectiveness, harms, and cost-effectiveness of percutaneous mitral valve repair using mitral valve clips in candidates at prohibitive risk for surgery.

DATA SOURCES

We searched articles in MEDLINE, Embase, and the Cochrane Library published from 1994 to February 2014 for evidence of effectiveness and harms; for economic literature we also searched NHS EED and Tufts CEA registry. Grey literature was also searched.

REVIEW METHODS

Primary studies were sought from existing systematic reviews that had employed reliable search and screening methods. Newer studies were sought by searching the period subsequent to the last search date of the review. Two reviewers screened records and assessed study validity. We used the Cochrane risk of bias tool for randomized, generic assessment for non-randomized studies, and the Phillips checklist for economic studies.

RESULTS

Ten studies including 1 randomized trial were included. The majority of the direct comparative evidence compared the mitral valve clip repair with surgery in patients not particularly at prohibitive surgical risk. Irrespective of degenerative or functional chronic mitral regurgitation etiology, evidence of effectiveness and harms is inconclusive and of very low quality. Very-low-quality evidence indicates that percutaneous mitral valve clip repair may provide a survival advantage, at least during the first 1 to 2 years, particularly in medically managed chronic functional mitral regurgitation. Because of limitations in the design of studies, the cost-effectiveness of mitral valve clips in patients at prohibitive risk for surgery also could not be established.

LIMITATIONS

Because of serious concerns of risk of bias, indirectness, and imprecision, evidence is of very low quality.

CONCLUSIONS

No meaningful conclusions can be drawn about the comparative effectiveness, harms, and cost-effectiveness of mitral valve clips in the population with chronic mitral regurgitation who are at prohibitive risk for surgery.

Grading the strength of a body of evidence when assessing health care interventions: an EPC update

OBJECTIVES

To revise 2010 guidance on grading the strength of evidence (SOE) of the effectiveness of drugs, devices, and other preventive and therapeutic interventions in systematic reviews produced by the Evidence-based Practice Center (EPC) program, established by the US Agency for Healthcare Research and Quality (AHRQ).

STUDY DESIGN AND SETTING

A cross-EPC working group reviewed authoritative systems for grading SOE [primarily the approach from the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group] and conducted extensive discussions with GRADE and other experts.

RESULTS

Updated guidance continues to be conceptually similar to GRADE. Reviewers are to evaluate SOE separately for each major treatment comparison for each major outcome. We added reporting bias as a required domain and retained study limitations (risk of bias), consistency, directness, and precision (and three optional domains). Additional guidance covers scoring consistency, precision, and reporting bias, grading bodies of evidence with randomized controlled trials and observational studies, evaluating single study bodies of evidence, using studies with high risk of bias, and presenting findings with greater clarity and transparency. SOE is graded high, moderate, low, or insufficient, reflecting reviewers' confidence in the findings for a specific treatment comparison and outcome.

CONCLUSION

No single approach for grading SOE suits all reviews, but a more consistent and transparent approach to reporting summary information will make reviews more useful to the broad range of audiences that AHRQ's work aims to reach. EPC working groups will consider ongoing challenges and modify guidance as needed, on issues such as combining trials and observational studies in bodies of evidence, weighting domains, and combining qualitative and quantitative syntheses.

Do sugar-sweetened beverages cause adverse health outcomes in adults? A systematic review protocol

BACKGROUND

Chronic diseases, such as cardiovascular disease and type 2 diabetes, impose significant burden to public health. Most chronic diseases are associated with underlying preventable risk factors, such as elevated blood pressure, blood glucose, and lipids, physical inactivity, excessive sedentary behaviours, overweight and obesity, and tobacco usage. Sugar-sweetened beverages are known to be significant sources of additional caloric intake, and given recent attention to their contribution in the development of chronic diseases, a systematic review is warranted. We will assess whether the consumption of sugar-sweetened beverages in adults is associated with adverse health outcomes and what the potential moderating factors are.

METHODS/DESIGN

Of interest are studies addressing sugar-sweetened beverage consumption, taking a broad perspective. Both direct consumption studies as well as those evaluating interventions that influence consumption (e.g. school policy, educational) will be relevant. Non-specific or multi-faceted behavioural, educational, or policy interventions may also be included subject to the level of evidence that exists for the other interventions/exposures. Comparisons of interest and endpoints of interest are pre-specified. We will include randomized controlled trials, controlled clinical trials, interrupted time series studies, controlled before-after studies, prospective and retrospective comparative cohort studies, case-control studies, and nested case-control designs. The MEDLINE, Embase, The Cochrane Library, CINAHL, ERIC, and PsycINFO databases and grey literature sources will be searched. The processes for selecting studies, abstracting data, and resolving conflicts are described. We will assess risk of bias using design-specific tools. To determine sets of confounding variables that should be adjusted for, we have developed causal directed acyclic graphs and will use those to inform our risk of bias assessments. Meta-analysis will be conducted where appropriate; parameters for exploring statistical heterogeneity and effect modifiers are pre-specified. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach will be used for determining the quality of evidence for outcomes.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42014009638.

Do sugar-sweetened beverages cause adverse health outcomes in children? A systematic review protocol

BACKGROUND

Cardiovascular disease and type 2 diabetes are examples of chronic diseases that impose significant morbidity and mortality in the general population worldwide. Most chronic diseases are associated with underlying preventable risk factors, such as elevated blood pressure, high blood glucose or glucose intolerance, high lipid levels, physical inactivity, excessive sedentary behaviours, and overweight/obesity. The occurrence of intermediate outcomes during childhood increases the risk of disease in adulthood. Sugar-sweetened beverages are known to be significant sources of additional caloric intake, and given recent attention to their contribution in the development of chronic diseases, a systematic review is warranted. We will assess whether the consumption of sugar-sweetened beverages in children is associated with adverse health outcomes and what the potential moderating factors are.

METHODS/DESIGN

Of interest are studies addressing sugar-sweetened beverage consumption, taking a broad perspective. Both direct consumption studies as well as those evaluating interventions that influence consumption (e.g. school policy, educational) will be relevant. Non-specific or multi-faceted behavioural, educational, or policy interventions may also be included subject to the level of evidence that exists for the other interventions/exposures. Comparisons of interest and endpoints of interest are pre-specified. We will include randomized controlled trials, controlled clinical trials, interrupted time series studies, controlled before-after studies, prospective and retrospective comparative cohort studies, case-control studies, and nested case-control designs. The MEDLINE®, Embase, The Cochrane Library, CINAHL, ERIC, and PsycINFO® databases and grey literature sources will be searched. The processes for selecting studies, abstracting data, and resolving conflicts are described. We will assess risk of bias using design-specific tools. To determine sets of confounding variables that should be adjusted for, we have developed causal directed acyclic graphs and will use those to inform our risk of bias assessments. Meta-analysis will be conducted where appropriate; parameters for exploring statistical heterogeneity and effect modifiers are pre-specified. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach will be used to determine the quality of evidence for outcomes.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42014009641.

The refinement of topics for systematic reviews: lessons and recommendations from the Effective Health Care Program

OBJECTIVES

The Agency for Healthcare Research and Quality (AHRQ) Effective Health Care Program conducts systematic reviews of health-care topics nominated by stakeholders. Topics undergo refinement to ensure relevant questions of appropriate scope and useful reviews. Input from key informants, experts, and a literature scan informs changes in the nominated topic. AHRQ convened a work group to assess approaches and develop recommendations for topic refinement.

STUDY DESIGN AND SETTING

Work group members experienced in topic refinement generated a list of questions and guiding principles relevant to the refinement process. They discussed each issue and reached agreement on recommendations.

RESULTS

Topics should address important health-care questions or dilemmas, consider stakeholder priorities and values, reflect the state of the science, and be consistent with systematic review research methods. Guiding principles of topic refinement are fidelity to the nomination, relevance, research feasibility, responsiveness to stakeholder inputs, reduced investigator bias, transparency, and suitable scope. Suggestions for stakeholder engagement, synthesis of input, and reporting are discussed. Refinement decisions require judgment and balancing guiding principles. Variability in topics precludes a prescriptive approach.

CONCLUSION

Accurate, rigorous, and useful systematic reviews require well-refined topics. These guiding principles and methodological recommendations may help investigators refine topics for reviews.

A surveillance system to assess the need for updating systematic reviews

BACKGROUND

Systematic reviews (SRs) can become outdated as new evidence emerges over time. Organizations that produce SRs need a surveillance method to determine when reviews are likely to require updating. This report describes the development and initial results of a surveillance system to assess SRs produced by the Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) Program.

METHODS

Twenty-four SRs were assessed using existing methods that incorporate limited literature searches, expert opinion, and quantitative methods for the presence of signals triggering the need for updating. The system was designed to begin surveillance six months after the release of the original review, and then ceforth every six months for any review not classified as being a high priority for updating. The outcome of each round of surveillance was a classification of the SR as being low, medium or high priority for updating.

RESULTS

Twenty-four SRs underwent surveillance at least once, and ten underwent surveillance a second time during the 18 months of the program. Two SRs were classified as high, five as medium, and 17 as low priority for updating. The time lapse between the searches conducted for the original reports and the updated searches (search time lapse - STL) ranged from 11 months to 62 months: The STL for the high priority reports were 29 months and 54 months; those for medium priority reports ranged from 19 to 62 months; and those for low priority reports ranged from 11 to 33 months. Neither the STL nor the number of new relevant articles was perfectly associated with a signal for updating. Challenges of implementing the surveillance system included determining what constituted the actual conclusions of an SR that required assessing; and sometimes poor response rates of experts.

CONCLUSION

In this system of regular surveillance of 24 systematic reviews on a variety of clinical interventions produced by a leading organization, about 70% of reviews were determined to have a low priority for updating. Evidence suggests that the time period for surveillance is yearly rather than the six months used in this project.

A comparative assessment of three formulations of botulinum toxin A for facial rhytides: a systematic review and meta-analyses

BACKGROUND

Botulinum toxin A is a commonly used biological medication in the field of facial plastic surgery. Currently, there are three distinct formulations of botulinum toxin A, each with their purported benefits and advantages. However, there is considerable confusion as to the relative efficacy and side-effects associated with each formulation. Therefore, the purpose of this paper is to systematically assess published studies and perform a meta-analysis to determine if there is a significant advantage of any of the individual formulations.

METHODS/DESIGN

A systematic literature search was performed for all relevant English language randomized controlled trials using Embase, Cumulative Index to Nursing and Allied Health Literature (CINAHL), MEDLINE, World Health Organization (WHO) International Clinical Trials Registry Platform, European Union (EU) Clinical Trials Register, Cochrane Library databases of clinical trials, and ClinicalTrials.gov. Inclusion criteria included any randomized controlled trial (RCT) that assessed the use of botulinum toxin for cosmetic purposes. The included articles were also analyzed for bias using the Cochrane Collaboration's tool for assessing the risk of bias in RCTs.

DISCUSSION

The results of this review will provide clinicians with an unbiased, high level of evidence of the comparative efficacy of individual preparations of botulinum toxin A.

Application of WHONET in the Antimicrobial Resistance Surveillance of Uropathogens: A First User Experience from Nepal

INTRODUCTION

WHONET is a freely downloadable, Windows-based database software which is used for the management and analysis of microbiology data, with a special focus on the analysis of antimicrobial susceptibility test results. Urinary Tract Infections (UTI) are a common medical problem and they are responsible for notable morbidity among young and sexually active women.

OBJECTIVES

The major objective of this study was the utilization and application of the WHONET program for the Antimicrobial Resistance (AMR) surveillance of uropathogens.

METHODS

A total of 3209 urine samples were collected from patients who visited Manipal Teaching Hospital with a clinical suspicion of UTI, during December 2010 to July 2011. The isolation and characterization of the isolates were done by conventional methods. Antimicrobial Susceptibility Testing (AST) was performed by Kirby Bauer's disc diffusion method. The data entry and analysis were done by using the WHONET 5.6 software.

RESULTS

Out of the 3209 specimens, 497 bacterial isolates were obtained and they were subjected to AST. Escherichia coli (66.2%) was the commonest bacterial isolate, followed by Enterococcus species (9.3%), Staphylococcus aureus (5.0%), and Klebsiella pneumoniae (4.2%). Among the gram-negative enteric bacilli, a high prevalence of resistance was observed against ampicillin and ciprofloxacin. The gram negative nonfermenters exhibited a high degree of resistance to ceftazidime. Staphylococcus species. showed a moderately high resistance to co-trimoxazole. One isolate was Vancomycin Resistant Enterococci (VRE).

CONCLUSION

This study, a first of its kind which was done in Nepal, was carried out by using the WHONET software to monitor, analyze and share the antimicrobial susceptibility data at various levels. This study was also aimed at building a surveillance network in Nepal, with the National Public Health Laboratory, Nepal, acting as a nodal centre. This would help in the formulation of antibiotic policies and in identifying hospital and community outbreaks at the nodal centre, as well as in sharing information with the clinicians at the local level.

Reconstruction with fibular autograft and silicone implant arthroplasty after resection of giant-cell tumour of the proximal phalanx: a case report with 18-month follow-up

Primary giant-cell tumour of phalanx is a rare entity. Only few cases are described in the literature. Giant-cell tumour of hand is reported to have high local recurrence rate. Curettage and bone grafting have been performed by few authors with limited success. Most of the cases have been treated with ray amputation. We report this case as the first reported case in the literature that has been treated with fibular autograft and silicone implant arthroplasty for giant-cell tumour of the proximal phalanx.

Two methods provide similar signals for the need to update systematic reviews

OBJECTIVE

Apply and compare two methods that identify signals for the need to update systematic reviews, using three Evidence-based Practice Center reports on omega-3 fatty acids as test cases.

STUDY DESIGN AND SETTING

We applied the RAND method, which uses domain (subject matter) expert guidance, and a modified Ottawa method, which uses quantitative and qualitative signals. For both methods, we conducted focused electronic literature searches of recent studies using the key terms from the original reports. We assessed the agreement between the methods and qualitatively assessed the merits of each system.

RESULTS

Agreement between the two methods was "substantial" or better (kappa>0.62) in three of the four systematic reviews. Overall agreement between the methods was "substantial" (kappa=0.64, 95% confidence interval [CI] 0.45-0.83).

CONCLUSION

The RAND and modified Ottawa methods appear to provide similar signals for the possible need to update systematic reviews in this pilot study. Future evaluation with a broader range of clinical topics and eventual comparisons between signals to update reports and the results of full evidence review updates will be needed. We propose a hybrid approach combining the best features of both methods, which should allow efficient review and assessment of the need to update.

Interactions of commonly used dietary supplements with cardiovascular drugs: a systematic review

BACKGROUND

The objective of this systematic review was to examine the benefits, harms and pharmacokinetic interactions arising from the co-administration of commonly used dietary supplements with cardiovascular drugs. Many patients on cardiovascular drugs take dietary supplements for presumed benefits and may be at risk for adverse supplement-drug interactions.

METHODS

The Allied and Complementary Medicine Database, the Cochrane Library, EMBASE, International Bibliographic Information on Dietary Supplements and MEDLINE were searched from the inception of the review to October 2011. Grey literature was also reviewed.Two reviewers independently screened records to identify studies comparing a supplement plus cardiovascular drug(s) with the drug(s) alone. Reviewers extracted data using standardized forms, assessed the study risk of bias, graded the strength of evidence and reported applicability.

RESULTS

Evidence was obtained from 65 randomized clinical trials, 2 controlled clinical trials and 1 observational study. With only a few small studies available per supplement, evidence was insufficient for all predefined gradable clinical efficacy and harms outcomes, such as mortality and serious adverse events. One long-term pragmatic trial showed no benefit from co-administering vitamin E with aspirin on a composite cardiovascular outcome. Evidence for most intermediate outcomes was insufficient or of low strength, suggesting no effect. Incremental benefits were noted for triglyceridemia with omega-3 fatty acid added to statins; and there was an improvement in levels of high-density lipoprotein cholesterol with garlic supplementation when people also consumed nitrates

CONCLUSIONS

Evidence of low-strength indicates benefits of omega-3 fatty acids (plus statin, or calcium channel blockers and antiplatelets) and garlic (plus nitrates or warfarin) on triglycerides and HDL-C, respectively. Safety concerns, however, persist.

Ophthalmia Neonatorum: A Letter to Editor

Neonatal Conjunctivitis, also known as Ophthalmia Neonatorum, is a form of bacterial conjunctivitis contracted by newborn during delivery. It is a rare clinical entity in advanced countries, but relatively common in developing countries. Many bacteria and viruses can cause conjunctivitis in the neonates. Two most feared causes are Neisseria gonorrhoeae and Chlamydia trachomatis acquired from birth canal during delivery. We present a case of gonococcal Ophthalmia Neonatorum in a 20 days young neonate from mid-western (Myagdi), Nepal.DOI: http://dx.doi.org/10.3126/ajms.v2i3.5237Asian Journal of Medical Sciences 2 (2011) 72-78 

Effectiveness of terbutaline pump for the prevention of preterm birth. A systematic review and meta-analysis

BACKGROUND

Subcutaneous terbutaline (SQ terbutaline) infusion by pump is used in pregnant women as a prolonged (beyond 48-72 h) maintenance tocolytic following acute treatment of preterm contractions. The effectiveness and safety of this maintenance tocolysis have not been clearly established. We aimed to systematically evaluate the effectiveness and safety of subcutaneous (SQ) terbutaline infusion by pump for maintenance tocolysis.

METHODOLOGY/PRINCIPAL FINDINGS

MEDLINE, EMBASE, CINAHL, the Cochrane Library, the Centre for Reviews and Dissemination databases, post-marketing surveillance data and grey literature were searched up to April 2011 for relevant experimental and observational studies. Two randomized trials, one nonrandomized trial, and 11 observational studies met inclusion criteria. Non-comparative studies were considered only for pump-related harms. We excluded case-reports but sought FDA summaries of post-marketing surveillance data. Non-English records without an English abstract were excluded. Evidence of low strength from observational studies with risk of bias favored SQ terbutaline pump for the outcomes of delivery at <32 and <37 weeks, mean days of pregnancy prolongation, and neonatal death. Observational studies of medium to high risk of bias also demonstrated benefit for other surrogate outcomes, such as birthweight and neonatal intensive care unit (NICU) admission. Several cases of maternal deaths and maternal cardiovascular events have been reported in patients receiving terbutaline tocolysis.

CONCLUSIONS/SIGNIFICANCE

Although evidence suggests that pump therapy may be beneficial as maintenance tocolysis, our confidence in its validity and reproducibility is low, suggesting that its use should be limited to the research setting. Concerns regarding safety of therapy persist.

Pre-analytic and analytic sources of variations in thiopurine methyltransferase activity measurement in patients prescribed thiopurine-based drugs: A systematic review

OBJECTIVES

Low thiopurine S-methyltransferase (TPMT) enzyme activity is associated with increased thiopurine drug toxicity, particularly myelotoxicity. Pre-analytic and analytic variables for TPMT genotype and phenotype (enzyme activity) testing were reviewed.

DESIGN AND METHODS

A systematic literature review was performed, and diagnostic laboratories were surveyed.

RESULTS

Thirty-five studies reported relevant data for pre-analytic variables (patient age, gender, race, hematocrit, co-morbidity, co-administered drugs and specimen stability) and thirty-three for analytic variables (accuracy, reproducibility). TPMT is stable in blood when stored for up to 7 days at room temperature, and 3 months at -30°C. Pre-analytic patient variables do not affect TPMT activity. Fifteen drugs studied to date exerted no clinically significant effects in vivo. Enzymatic assay is the preferred technique. Radiochemical and HPLC techniques had intra- and inter-assay coefficients of variation (CVs) below 10%.

CONCLUSION

TPMT is a stable enzyme, and its assay is not affected by age, gender, race or co-morbidity.

Assessment of thiopurine S-methyltransferase activity in patients prescribed thiopurines: a systematic review

BACKGROUND

The evidence for testing thiopurine S-methyltransferase (TPMT) enzymatic activity or genotype before starting therapy with thiopurine-based drugs is unclear.

PURPOSE

To examine the sensitivity and specificity of TPMT genotyping for TPMT enzymatic activity, reducing harm from thiopurine by pretesting, and the association of thiopurine toxicity with TPMT status in adults and children with chronic inflammatory diseases.

DATA SOURCES

MEDLINE, EMBASE, the Cochrane Library, and Ovid HealthSTAR (from inception to December 2010) and BIOSIS and Genetics Abstracts (to May 2009).

STUDY SELECTION

Two reviewers screened records and identified relevant studies in English.

DATA EXTRACTION

Data on patient characteristics, outcomes, and risk for bias were extracted by one reviewer and independently identified by another.

DATA SYNTHESIS

54 observational studies and 1 randomized, controlled trial were included. Insufficient evidence addressed the effectiveness of pretesting. Genotyping sensitivity to identify patients with low and intermediate TPMT enzymatic activity ranged from 70.33% to 86.15% (lower-bound 95% CI, 54.52% to 70.88%; upper-bound CI, 78.50% to 96.33%). Sparse data precluded estimation of genotype sensitivity to identify patients with low to absent enzymatic activity. Genotyping specificity approached 100%. Compared with noncarriers, heterozygous and homozygous genotypes were both associated with leukopenia (odds ratios, 4.29 [CI, 2.67 to 6.89] and 20.84 [CI, 3.42 to 126.89], respectively). Compared with intermediate or normal activity, low TPMT enzymatic activity was significantly associated with myelotoxicity and leukopenia.

LIMITATION

Available evidence was not rigorous and was underpowered to detect a difference in outcomes.

CONCLUSION

Insufficient evidence addresses the effectiveness of TPMT pretesting in patients with chronic inflammatory diseases. Estimates of the sensitivity of genotyping are imprecise. Evidence confirms the known associations of leukopenia or myelotoxicity with reduced TPMT activity or variant genotype.

PRIMARY FUNDING SOURCE

Agency for Healthcare Research and Quality.

Assessment of thiopurine methyltransferase activity in patients prescribed azathioprine or other thiopurine-based drugs

OBJECTIVES

To examine whether pretreatment determination of thiopurine methyltransferase (TPMT) enzymatic activity (phenotyping) or TPMT genotype, to guide thiopurine therapy in chronic autoimmune disease patients, reduces treatment harms. Other objectives included assessing: preanalytic, analytic, and postanalytic requirements for TPMT testing; diagnostic accuracy of TPMT genotyping versus phenotyping; association of thiopurine toxicity with TPMT genotypic or phenotypic status; and costs of testing, care, and treating drug-associated complications.

DATA SOURCES

MEDLINE®, EMBASE®, and Healthstar were searched from inception to May 2010; the Cochrane Library® to October 2009; and BIOSIS®, Genetics Abstracts, and EconLit™ to May 2009, for English language records.

REVIEW METHODS

A reviewer screened records, and a second reviewer verified exclusions and subsequent selection of relevant studies. Studies in patients with leukemia and organ transplant were excluded. Additionally, laboratories that provide TPMT analytical services were surveyed to assess means of TPMT testing in practice. Where possible, risk of bias was assessed using standard criteria. Meta-analyses estimated diagnostic sensitivity, and specificity; and odds ratios of associations.

RESULTS

1790 titles or abstracts, and 538 full text records were screened. 114 observational studies and one RCT were included. Majority of studies were rated fair quality, except for diagnostic studies with 37 percent of studies rated poor. In general, there were few patients who were homozygous (or compound heterozygous) for TPMT variant alleles in the included studies limiting applicability. There is insufficient evidence examining effectiveness of pretesting in terms of reduction in clinical adverse events. Sufficient preanalytical data were available regarding preferred specimen collection, stability and storage conditions for TPMT testing. There was no clinically significant effect of age, gender, various coadministered drugs, or most morbidities (with the exception of renal failure and dialysis). TPMT phenotyping methods had coefficients of variation generally below 10 percent. TPMT genotyping reproducibility is generally between 95-100 percent. The sensitivity of genotyping to identify patients with low or intermediate TPMT enzymatic activity is imprecise, ranging from 70.70 to 82.10 percent (95 percent CI, lower bound range 37.90 to 54.00 percent; upper bound range 84.60 to 96.90 percent). Sensitivity of homozygous TPMT genotype to correctly identify patients with low to absent enzymatic activity was 87.10 percent (95 percent CI 44.30 to 98.30 percent). Genotyping specificity approached 100 percent. Leukopenia was significantly associated with low and intermediate enzymatic activity (low activity OR 80.00, 95 percent CI 11.5 to 559; and intermediate activity OR 2.96, 95 percent CI 1.18 to 7.42), and homozygous and heterozygous TPMT variant allele genotype (OR 18.60, 95 percent CI 4.12 to 83.60; and 4.62, 95 percent CI 2.34 to 9.16, respectively). In general, TPMT phenotyping costs less than genotyping, although estimates across studies are quite heterogeneous.

CONCLUSIONS

There is insufficient direct evidence regarding the effectiveness of pretesting of TPMT status in patients with chronic autoimmune diseases. Indirect evidence confirms strong association of leukopenia with lower levels of TPMT activity and carrier genotype already established in the literature.

Development quality criteria to evaluate nontherapeutic studies of incidence, prevalence, or risk factors of chronic diseases: pilot study of new checklists

OBJECTIVE

To develop two checklists for the quality of observational studies of incidence or risk factors of diseases.

STUDY DESIGN AND SETTING

Initial development of the checklists was based on a systematic literature review. The checklists were refined after pilot trials of validity and reliability were conducted by seven experts, who tested the checklists on 10 articles.

RESULTS

The checklist for studies of incidence or prevalence of chronic disease had six criteria for external validity and five for internal validity. The checklist for risk factor studies had six criteria for external validity, 13 criteria for internal validity, and two aspects of causality. A Microsoft Access database produced automated standardized reports about external and internal validities. Pilot testing demonstrated face and content validities and discrimination of reporting vs. methodological qualities. Interrater agreement was poor. The experts suggested future reliability testing of the checklists in systematic reviews with preplanned protocols, a priori consensus about research-specific quality criteria, and training of the reviewers.

CONCLUSION

We propose transparent and standardized quality assessment criteria of observational studies using the developed checklists. Future testing of the checklists in systematic reviews is necessary to develop reliable tools that can be used with confidence.

Development quality criteria to evaluate nontherapeutic studies of incidence, prevalence, or risk factors of chronic diseases: pilot study of new checklists

OBJECTIVE

To develop two checklists for the quality of observational studies of incidence or risk factors of diseases.

STUDY DESIGN AND SETTING

Initial development of the checklists was based on a systematic literature review. The checklists were refined after pilot trials of validity and reliability were conducted by seven experts, who tested the checklists on 10 articles.

RESULTS

The checklist for studies of incidence or prevalence of chronic disease had six criteria for external validity and five for internal validity. The checklist for risk factor studies had six criteria for external validity, 13 criteria for internal validity, and two aspects of causality. A Microsoft Access database produced automated standardized reports about external and internal validities. Pilot testing demonstrated face and content validities and discrimination of reporting vs. methodological qualities. Interrater agreement was poor. The experts suggested future reliability testing of the checklists in systematic reviews with preplanned protocols, a priori consensus about research-specific quality criteria, and training of the reviewers.

CONCLUSION

We propose transparent and standardized quality assessment criteria of observational studies using the developed checklists. Future testing of the checklists in systematic reviews is necessary to develop reliable tools that can be used with confidence.