Conduct and reporting of multivariate network meta-analyses: a scoping review

OBJECTIVES

Combining multivariate and network meta-analysis methods simultaneously in a multivariate network meta-analysis (MVNMA) provides the methodological framework to analyze the largest amount of evidence relevant to decision-makers (i.e., from indirect evidence and correlated outcomes). The objectives of this scoping review were to summarize the characteristics of MVNMAs published in the health sciences literature and map the methodological guidance available for MVNMA.

STUDY DESIGN AND SETTING

We searched MEDLINE, Embase, and the Cumulative Index to Nursing and Allied Health Literature from inception to 28 August 2023, along with citations of included studies, for quantitative evidence syntheses that applied MVNMA and articles addressing MVNMA methods. Pairs of reviewers independently screened potentially eligible studies. Collected data included bibliographic, methodological, and analytical characteristics of included studies. We reported results as total numbers, frequencies, and percentages for categorical variables and medians and interquartile ranges for continuous variables that were not normally distributed.

RESULTS

After screening 1,075 titles and abstracts, and 112 full texts, we included 38 unique studies, of which, 10 were quantitative evidence syntheses that applied MVNMA and 28 were articles addressing MVNMA methods. Among the 10 MVNMAs, the first was published in 2013, four used studies identified from already published systematic reviews, and eight addressed pharmacological interventions, which were the most common interventions. They evaluated interventions for metastatic melanoma, colorectal cancer, prostate cancer, oral hygiene, disruptive behavior disorders, rheumatoid arthritis, narcolepsy, type 2 diabetes, and overactive bladder syndrome. Five MVNMAs analyzed two outcomes simultaneously, and four MVNMAs analyzed three outcomes simultaneously. Among the articles addressing MVNMA methods, the first was published in 2007 and the majority provided methodological frameworks for conducting MVNMAs (26/28, 93%). One study proposed criteria to standardize reporting of MVNMAs and two proposed items relevant to the quality assessment of MVNMAs. Study authors used data from 18 different illnesses to provide illustrative examples within their methodological guidance.

CONCLUSIONS

The application of MVNMA in the health sciences literature is uncommon. Many methodological frameworks are published; however, standardization and specific criteria to guide reporting and quality assessment are lacking. This overview of the current landscape may help inform future conduct of MVNMAs and research on MVNMA methods.

Use of tocilizumab and sarilumab alone or in combination with corticosteroids for covid-19: systematic review and network meta-analysis

Objective

To compare the effects of interleukin 6 receptor blockers, tocilizumab and sarilumab, with or without corticosteroids, on mortality in patients with covid-19.

Design

Systematic review and network meta-analysis.

Data sources

World Health Organization covid-19 database, a comprehensive multilingual source of global covid-19 literature, and two prospective meta-analyses (up to 9 June 2021).

Review methods

Trials in which people with suspected, probable, or confirmed covid-19 were randomised to interleukin 6 receptor blockers (with or without corticosteroids), corticosteroids, placebo, or standard care. The analysis used a bayesian framework and assessed the certainty of evidence using the GRADE approach. Results from the fixed effect meta-analysis were used for the primary analysis.

Results

Of 45 eligible trials (20 650 patients) identified, 36 (19 350 patients) could be included in the network meta-analysis. Of 36 trials, 27 were at high risk of bias, primarily due to lack of blinding. Tocilizumab, in combination with corticosteroids, suggested a reduction in the risk of death compared with corticosteroids alone (odds ratio 0.79, 95% credible interval 0.70 to 0.88; 35 fewer deaths per 1000 people, 95% credible interval 52 fewer to 18 fewer per 1000; moderate certainty of evidence), as did sarilumab in combination with corticosteroids, compared with corticosteroids alone (0.73, 0.58 to 0.92; 43 fewer per 1000, 73 fewer to 12 fewer; low certainty). Tocilizumab and sarilumab, each in combination with corticosteroids, appeared to have similar effects on mortality when compared with each other (1.07, 0.86 to 1.34; eight more per 1000, 20 fewer to 35 more; low certainty). The effects of tocilizumab (1.12, 0.91 to 1.38; 20 more per 1000, 16 fewer to 59 more; low certainty) and sarilumab (1.07, 0.81 to 1.40; 11 more per 1000, 38 fewer to 55 more; low certainty), when used alone, suggested an increase in the risk of death.

Conclusion

These findings suggest that in patients with severe or critical covid-19, tocilizumab, in combination with corticosteroids, probably reduces mortality, and that sarilumab, in combination with corticosteroids, might also reduce mortality. Tocilizumab and sarilumab, in combination with corticosteroids, could have similar effectiveness. Tocilizumab and sarilumab, when used alone, might not be beneficial.

Antibiotics for uncomplicated skin abscesses: systematic review and network meta-analysis

OBJECTIVE

To assess the impact of adjunctive antibiotic therapy on uncomplicated skin abscesses.

DESIGN

Systematic review and network meta-analysis.

DATA SOURCES

Medline, Embase, the Cochrane Central Register of Controlled Trials and ClinicalTrials.gov.

STUDY SELECTION

A BMJ Rapid Recommendation panel provided input on design, important outcomes and the interpretation of the results. Eligible randomised controlled trials (RCTs) included a comparison of antibiotics against no antibiotics or a comparison of different antibiotics in patients with uncomplicated skin abscesses, and reported outcomes prespecified by the linked guideline panel.

REVIEW METHODS

Reviewers independently screened abstracts and full texts for eligibility, assessed risk of bias and extracted data. We performed random-effects meta-analyses that compared antibiotics with no antibiotics, along with a limited number of prespecified subgroup hypotheses. We also performed network meta-analysis with a Bayesian framework to compare effects of different antibiotics. Quality of evidence was assessed with The Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach.

RESULTS

Fourteen RCTs including 4198 patients proved eligible. Compared with no antibiotics, antibiotics probably lower the risk of treatment failure (OR 0.58, 95% CI 0.37 to 0.90; low quality), recurrence within 1 month (OR 0.48, 95% CI 0.30 to 0.77; moderate quality), hospitalisation (OR 0.55, 95% CI 0.32 to 0.94; moderate quality) and late recurrence (OR 0.64, 95% CI 0.48 to 0.85; moderate quality). However, relative to no use, antibiotics probably increase the risk of gastrointestinal side effects (trimethoprim and sulfamethoxazole (TMP-SMX): OR 1.28, 95% CI 1.04 to 1.58; moderate quality; clindamycin: OR 2.29, 95% CI 1.35 to 3.88; high quality) and diarrhoea (clindamycin: OR 2.71, 95% CI 1.50 to 4.89; high quality). Cephalosporins did not reduce the risk of treatment failure compared with placebo (moderate quality).

CONCLUSIONS

In patients with uncomplicated skin abscesses, moderate-to-high quality evidence suggests TMP-SMX or clindamycin confer a modest benefit for several important outcomes, but this is offset by a similar risk of adverse effects. Clindamycin has a substantially higher risk of diarrhoea than TMP-SMX. Cephalosporins are probably not effective.

A critical appraisal of chronic kidney disease mineral and bone disorders clinical practice guidelines using the AGREE II instrument

BACKGROUND

Patients with chronic kidney disease mineral and bone disorders (CKD-MBD) suffer high rates of morbidity and mortality, in particular related to bone and cardiovascular outcomes. The management of CKD-MBD remains challenging. The objective of this systematic survey is to critically appraise clinical practice guidelines (CPGs) addressing CKD-MBD.

METHODS/DESIGN

Data sources included MEDLINE, EMBASE, the National Guideline Clearinghouse, Guideline International Network and Turning Research into Practice up to May 2016. Teams of two reviewers, independently and in duplicate, screened titles and abstracts and potentially eligible full text reports to determine eligibility and subsequently appraised the guidelines using the Advancing Guideline Development, Reporting and Evaluation in Health Care instrument II (AGREE).

RESULTS

Sixteen CPGs published from 2003 to 2015 addressing the diagnosis and management of CKD-MBD in adult patients (11 English, two Spanish, one Italian, one Portuguese and one Slovak) proved eligible. The National Institute for Health and Care Excellence guideline performed best with respect to AGREE II criteria; only three other CPGs warranted high scores on all domains. All other guidelines received scores of under 60% on one or more domains. Major discrepancies in recommendations were not, however, present, and we found no association between quality of CPGs which was not associated with resulting recommendations.

CONCLUSIONS

Most guidelines assessing CKD-MBD suffer from serious shortcomings using AGREE criteria although limitations with respect to AGREE criteria do not necessarily lead to inappropriate recommendations.

Comparative Effectiveness of Phosphate Binders in Patients with Chronic Kidney Disease: A Systematic Review and Network Meta-Analysis

BACKGROUND

Chronic kidney disease-mineral and bone disorder (CKD-MBD) has been linked to poor health outcomes, including diminished quality and length of life. This condition is characterized by high phosphate levels and requires phosphate-lowering agents-phosphate binders. The objective of this systematic review is to compare the effects of available phosphate binders on patient-important outcomes in patients with CKD-MBD.

METHODS

Data sources included MEDLINE and EMBASE Trials from 1996 to February 2016. We also searched the Cochrane Register of Controlled Trials up to April 2016. Teams of two reviewers, independently and in duplicate, screened titles and abstracts and potentially eligible full text reports to determine eligibility, and subsequently abstracted data and assessed risk of bias in eligible randomized controlled trials (RCTs). Eligible trials enrolled patients with CKD-MBD, randomized them to receive calcium (delivered as calcium acetate, calcium citrate or calcium carbonate), non-calcium-based phosphate binders (NCBPB) (sevelamer hydrochloride, sevelamer carbonate, lanthanum carbonate, sucroferric oxyhydroxide and ferric citrate), phosphorus restricted diet, placebo or no treatment, and reported effects on all-cause mortality, cardiovascular mortality or hospitalization at ≥4 weeks follow-up. We performed network meta-analyses (NMA) for all cause-mortality for individual agents (seven-node analysis) and conventional meta-analysis of calcium vs. NCBPBs for all-cause mortality, cardiovascular mortality and hospitalization. In the NMAs, we calculated the effect estimates for direct, indirect and network meta-analysis estimates; for both NMA and conventional meta-analysis, we pooled treatment effects as risk ratios (RR) and calculated 95% confidence intervals (CIs) using random effect models. We used the GRADE (Grading of Recommendations, Assessment, Development and Evaluation) approach to rate the quality of evidence for each paired comparison.

RESULTS

Our search yielded 1190 citations, of which 71 RCTs were retrieved for full review and 15 proved eligible. With 13 eligible studies from a prior review, we included 28 studies with 8335 participants; 25 trials provided data for our quantitative synthesis. Results suggest higher mortality with calcium than either sevelamer (NMA RR, 1.89 [95% CI, 1.02 to 3.50], moderate quality evidence) or NCBPBs (conventional meta-analysis RR, 1.76 [95% CI, 1.21 to 2.56, moderate quality evidence). Conventional meta-analysis suggested no difference in cardiovascular mortality between calcium and NCBPBs (RR, 2.54 [95% CI, 0.67 to 9.62 low quality evidence). Our results suggest higher hospitalization, although non-significant, with calcium than NCBPBs (RR, 1.293 [95% CI, 0.94 to 1.74, moderate quality evidence).

DISCUSSION/CONCLUSIONS

Use of calcium results in higher mortality than either sevelamer in particular and NCBPBs in general (moderate quality evidence). Our results raise questions about whether administration of calcium as an intervention for CKD- MBD remains ethical. Further research is needed to explore the effects of different types of phosphate binders, including novel agents such as iron, on quality and quantity of life.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD-42016032945.