1
|
Granholm A, Munch MW, Meier N, Sjövall F, Helleberg M, Hertz FB, Kaas-Hansen BS, Thorsen-Meyer HC, Andersen LW, Rasmussen BS, Andersen JS, Albertsen TL, Kjær MBN, Jensen AKG, Lange T, Perner A, Møller MH. Empirical meropenem versus piperacillin/tazobactam for adult patients with sepsis (EMPRESS) trial: Protocol. Acta Anaesthesiol Scand 2024. [PMID: 38769040 DOI: 10.1111/aas.14441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Accepted: 04/30/2024] [Indexed: 05/22/2024]
Abstract
BACKGROUND Piperacillin/tazobactam may be associated with less favourable outcomes than carbapenems in patients with severe bacterial infections, but the certainty of evidence is low. METHODS The Empirical Meropenem versus Piperacillin/Tazobactam for Adult Patients with Sepsis (EMPRESS) trial is an investigator-initiated, international, parallel-group, randomised, open-label, adaptive clinical trial with an integrated feasibility phase. We will randomise adult, critically ill patients with sepsis to empirical treatment with meropenem or piperacillin/tazobactam for up to 30 days. The primary outcome is 30-day all-cause mortality. The secondary outcomes are serious adverse reactions within 30 days; isolation precautions due to resistant bacteria within 30 days; days alive without life support and days alive and out of hospital within 30 and 90 days; 90- and 180-day all-cause mortality and 180-day health-related quality of life. EMPRESS will use Bayesian statistical models with weak to somewhat sceptical neutral priors. Adaptive analyses will be conducted after follow-up of the primary outcome for the first 400 participants concludes and after every 300 subsequent participants, with adaptive stopping for superiority/inferiority and practical equivalence (absolute risk difference <2.5%-points) and response-adaptive randomisation. The expected sample sizes in scenarios with no, small or large differences are 5189, 5859 and 2570 participants, with maximum 14,000 participants and ≥99% probability of conclusiveness across all scenarios. CONCLUSIONS EMPRESS will compare the effects of empirical meropenem against piperacillin/tazobactam in adult, critically ill patients with sepsis. Due to the pragmatic, adaptive design with high probability of conclusiveness, the trial results are expected to directly inform clinical practice.
Collapse
Affiliation(s)
- Anders Granholm
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
| | - Marie Warrer Munch
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
| | - Nick Meier
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
| | - Fredrik Sjövall
- Department of Intensive and Perioperative Care, Skåne University Hospital, Malmö, Sweden
- Department of Clinical Sciences, Lund University, Lund, Sweden
| | - Marie Helleberg
- Department of Clinical Medicine, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark
- Department of Infectious Diseases, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Centre of Excellence for Health, Immunity and Infections, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
| | - Frederik Boëtius Hertz
- Department of Clinical Microbiology, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Department of Immunology & Microbiology, University of Copenhagen, Copenhagen, Denmark
| | - Benjamin Skov Kaas-Hansen
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
- Section of Biostatistics, Department of Public Health, University of Copenhagen, Copenhagen, Denmark
| | - Hans-Christian Thorsen-Meyer
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
| | - Lars Wiuff Andersen
- Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
- Department of Anesthesiology and Intensive Care, Aarhus University Hospital, Aarhus, Denmark
- Prehospital Emergency Medical Services, Aarhus, Denmark
| | - Bodil Steen Rasmussen
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
- Department of Anaesthesia and Intensive Care, Aalborg University Hospital, Aalborg, Denmark
- Department of Clinical Medicine, Aalborg University, Aalborg, Denmark
| | - Jakob Steen Andersen
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
| | | | - Maj-Brit Nørregaard Kjær
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
| | - Aksel Karl Georg Jensen
- Section of Biostatistics, Department of Public Health, University of Copenhagen, Copenhagen, Denmark
| | - Theis Lange
- Section of Biostatistics, Department of Public Health, University of Copenhagen, Copenhagen, Denmark
| | - Anders Perner
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
- Department of Clinical Medicine, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Morten Hylander Møller
- Department of Intensive Care, Copenhagen University Hospital-Rigshospitalet, Copenhagen, Denmark
- Collaboration for Research in Intensive Care (CRIC), Copenhagen, Denmark
- Department of Clinical Medicine, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
2
|
Mickenautsch S, Rupf S, Yengopal V. Application of the Composite Quality Score (CQS-2B) versus Cochrane's Risk of Bias tool (Version 2) in systematic reviews of clinical trials - an exploratory study. Front Med (Lausanne) 2024; 11:1307815. [PMID: 38756938 PMCID: PMC11096475 DOI: 10.3389/fmed.2024.1307815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Accepted: 04/22/2024] [Indexed: 05/18/2024] Open
Abstract
Objectives To explore whether systematic review conclusions generated from Cochrane's second version of its Risk of Bias tool (RoB 2) for trial appraisal differ when the Composite Quality Score, Version 2.B (CQS-2B) is used instead and to develop a testable hypothesis based on these findings. Methods PubMed was searched for one single systematic review. From the review's accepted trials, data concerning effect estimates and overall bias risk according to the RoB 2 tool were extracted. All trial reports were appraised again using the CQS-2B. Datasets were stratified according to overall bias risk (RoB 2) or corroboration (C-) level (CQS-2B). The effect estimates from trials with 'low bias risk' (RoB 2) and with highest C-level (CQS-2B) were pooled separately. These pooled effect estimates were statistically and all clinical conclusions qualitatively compared. Results The pooled effect estimates for trials with 'low bias risk' (RoB 2) were -0.07, 95% CI: -0.10 to -0.04 (I2 = 0.0%) and for the highest C-levels (CQS-2B) 0.08, 95% CI: -0.12 to -0.04 (I2 = 57.0%). The difference was statistically not significant (p = 0.70). Contrary to the RoB 2 tool, no clinical conclusions in line with the CQS-2B were made, because the effect estimates were judged to be erroneously overestimated, due to high risk of bias. Conclusion A testable hypothesis was generated suggesting that trial appraisal using the CQS-2B may provide more conservative conclusions based on similar data than with the RoB 2 tool.
Collapse
Affiliation(s)
- Steffen Mickenautsch
- Review Centre for Health Science Research, Johannesburg, South Africa
- Department of Community Dentistry, School of Oral Health Sciences, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa
- Faculty of Dentistry, University of the Western Cape, Cape Town, South Africa
| | - Stefan Rupf
- Synoptic Dentistry, Saarland University, Homburg, Germany
| | - Veerasamy Yengopal
- Faculty of Dentistry, University of the Western Cape, Cape Town, South Africa
| |
Collapse
|
3
|
Liu J, Dong Y, Chen J, Jin Y, Qiu Y, Huang L. Corticosteroid in non-COVID-19 induced community-acquired pneumonia, a meta-analysis. Heart Lung 2024; 65:59-71. [PMID: 38432039 DOI: 10.1016/j.hrtlng.2024.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 02/07/2024] [Accepted: 02/24/2024] [Indexed: 03/05/2024]
Abstract
BACKGROUND Corticosteroid treatment in non-COVID-19 induced Community-acquired pneumonia (CAP) remains inconclusive. OBJECTIVES We aimed to assess the role of corticosteroid treatment in CAP. METHODS We conducted a comprehensive search of online databases, including PubMed, Embase, and Cochrane, to identify articles published from January 1, 2000, to May 5, 2023. Double-blind RCTs were selected. Two authors screened studies and extracted data. The evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation approach. RESULTS We analyzed data from 12 RCTs, involving 2446 patients. Corticosteroids therapy may reduce short-term mortality in patients with severe CAP (sCAP) and shorten the hospital length of stay in patients with CAP. Furthermore, corticosteroids treatment can decrease the risk of requiring mechanical ventilation, developing septic shock and multiple organ dysfunction syndrome (MODS). There were no significant differences between the corticosteroid and control groups concerning gastrointestinal bleeding and nosocomial infection. The use of corticosteroids could increase the risk of hyperglycemia. CONCLUSION Corticosteroid treatment for sCAP has the potential to provide benefits in reducing short-term mortality, but this conclusion necessitates more evidence. Besides, we found no evidence that strongly prevents us from using corticosteroids in patients with sCAP or those at risk of progressing to sCAP.
Collapse
Affiliation(s)
- Jian Liu
- Department of Critical Care Medicine, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, Zhejiang, China.
| | - Yongquan Dong
- Department of Respiratory Disease, YinZhou Second Hospital, Ningbo, Zhejiang, China
| | - Jia Chen
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, Zhejiang, China
| | - Yuqing Jin
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou, Zhejiang, China
| | - Yunqing Qiu
- Zhejiang Provincial Key Laboratory for Drug Clinical Research and Evaluation, Department of Clinical Pharmacy, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, Zhejiang, China
| | - Lingtong Huang
- Department of Critical Care Medicine, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, Zhejiang, China.
| |
Collapse
|
4
|
Sweeney DA, Lobo SM, Póvoa P, Kalil AC. Choosing immunomodulating therapies for the treatment of COVID-19: recommendations based on placebo-controlled trial evidence. Clin Microbiol Infect 2024; 30:611-618. [PMID: 38182048 DOI: 10.1016/j.cmi.2023.12.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 12/24/2023] [Accepted: 12/31/2023] [Indexed: 01/07/2024]
Abstract
BACKGROUND Immunomodulatory therapy has been extensively studied in randomized clinical trials for the treatment of patients hospitalized for COVID-19 with inconsistent findings. Guideline committees, reviewing the same clinical trial data, have generated different recommendations for immunomodulatory therapy. OBJECTIVES We hypothesize that trial design differences, specifically whether the study utilized an open-label or placebo-controlled design, accounted for the inconsistent mortality effects reported in clinical trials of immunomodulator therapies for COVID-19. SOURCES We reviewed COVID-19 treatment guidelines (World Health Organization [WHO], Infectious Diseases Society of America [IDSA] and The National Institutes of Health [NIH]) and identified the meta-analyses associated with glucocorticoids, IL-6 inhibitors, JAK kinase inhibitors, and complement C5a inhibitors that were available to the guideline authors at the time recommendations were either made or updated. CONTENT We identified a meta-analysis for each of the immunomodulator classes that are included in current COVID-19 treatment guidelines: glucocorticoids [WHO Rapid Evidence Appraisal for COVID-19 Therapies (REACT) Working Group; Shankar-Hari M, Vale CL, Godolphin PJ, Fisher D, Higgins JPT, et al. Association between administration of IL-6 antagonists and mortality among patients hospitalized for COVID-19: A meta-analysis. JAMA. 2021;326:499-518] (cited 419), IL-6 antagonists [WHO Rapid Evidence Appraisal for COVID-19 Therapies (REACT) Working Group; Shankar-Hari M, Vale CL, Godolphin PJ, Fisher D, Higgins JPT, et al. Association between administration of IL-6 antagonists and mortality among patients hospitalized for COVID-19: A meta-analysis. JAMA. 2021;326:499-518] (cited 419), JAK inhibitors [Kramer A, Prinz C, Fichtner F, Fischer AL, Thieme V, Grundeis F, et al. Janus kinase inhibitors for the treatment of COVID-19. Cochrane Database Syst Rev. 2022;6:CD015209] (cited 34), and complement C5a inhibitors [Tsai CL, Lai CC, Chen CY, Lee HS. The efficacy and safety of complement C5a inhibitors for patients with severe COVID-19: A systematic review and meta-analysis. Expert Rev Anti Infect Ther. 2023;21:77-86] (cited 1). Using the same randomized clinical trials, we evaluated the four meta-analyses accounting for trial design: placebo-controlled or open-label. Glucocorticoids (Risk Ratio [RR] 0.91 [95% CI, 0.49-1.69]), IL-6 inhibitors sarilumab (RR 1.17 [95% CI, 0.96-01.43]), and tocilizumab (RR 0.95 [95% CI, 0.76-1.19]) did not reduce mortality in placebo-controlled trials, whereas baricitinib did confer a large survival benefit (RR 0.65 [95% CI, 0.52-0.81]). The complement C5a inhibitor, vilobelimab, also reduced mortality in a single placebo-controlled trial (RR 0.76 [95% CI, 0.57-1.0]). IMPLICATIONS Placebo-controlled trial evidence indicates that baricitinib should be the first choice immunomodulator for patients hospitalized for COVID-19 who require any form of oxygen support-low- or high-flow oxygen, non-invasive or invasive ventilation. Vilobelimab warrants study in a large placebo-controlled trial. Treatment guidelines for future pandemics should prioritize the results of placebo-controlled trials.
Collapse
Affiliation(s)
- Daniel A Sweeney
- Division of Pulmonary, Critical Care and Sleep Medicine, Department of Internal Medicine, University of California, San Diego, La Jolla, CA, USA.
| | - Suzana M Lobo
- Faculdade de Medicina, Hospital de Base de São José do Rio Preto (FAMERP), São José do Rio Preto-SP, Brazil
| | - Pedro Póvoa
- NOVA Medical School, New University of Lisbon, Lisbon, Portugal; Center for Clinical Epidemiology and Research Unit of Clinical Epidemiology, OUH Odense University Hospital, Odense, Denmark; Department of Critical Care Medicine, Hospital de São Francisco Xavier, CHLO, Lisbon, Portugal
| | - Andre C Kalil
- Division of Infectious Diseases, Department of Internal Medicine, University of Nebraska Medical Center Omaha, NE, USA
| |
Collapse
|
5
|
Wang BH, Lin YL, Gao YY, Song JL, Qin L, Li LQ, Liu WQ, Zhong CCW, Jiang MY, Mao C, Yang XB, Chung VCH, Wu IXY. Trial characteristics and treatment effect estimates in randomized controlled trials of Chinese herbal medicine: A meta-epidemiological study. JOURNAL OF INTEGRATIVE MEDICINE 2024; 22:223-234. [PMID: 38714484 DOI: 10.1016/j.joim.2024.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 03/26/2024] [Indexed: 05/10/2024]
Abstract
BACKGROUND Previously published meta-epidemiological studies focused on Western medicine have identified some trial characteristics that impact the treatment effect of randomized controlled trials (RCTs). Nevertheless, it remains unclear if similar associations exist in RCTs on Chinese herbal medicine (CHM). Further, Chinese medicine-related characteristics have not been explored yet. OBJECTIVE To investigate trial characteristics related to treatment effect estimates on CHM RCTs. SEARCH STRATEGY This meta-epidemiological study searched 5 databases for systematic reviews on CHM treatment published between January 2011 and July 2021. INCLUSION CRITERIA An eligible systematic review should only include RCTs of CHM and conduct at least one meta-analysis. DATA EXTRACTION AND ANALYSIS Two reviewers independently conducted data extraction on general characteristics of systematic reviews, meta-analyses and included RCTs. They also assessed the risk of bias of RCTs using the Cochrane risk of bias tool. A two-step approach was used for data analyses. The ratio of odds ratios (ROR) and difference in standardized mean differences (dSMD) with 95% confidence interval (CI) were applied to present the difference in effect estimates for binary and continuous outcomes, respectively. RESULTS Ninety-one systematic reviews, comprising 1338 RCTs were identified. For binary outcomes, RCTs incorporated with syndrome differentiation (ROR: 1.23; 95 % CI: [1.07, 1.39]), adopting Chinese medicine formula (ROR: 1.19; 95% CI: [1.03, 1.34]), with low risk of bias on incomplete outcome data (ROR: 1.29; 95% CI: [1.06, 1.52]) and selective outcome reporting (ROR: 1.12; 95% CI: [1.01, 1.24]), as well as a trial size ≥ 100 (ROR: 1.23; 95% CI: [1.04, 1.42]) preferred to show larger effect estimates. As for continuous outcomes, RCTs with Chinese medicine diagnostic criteria (dSMD: 0.23; 95% CI: [0.06, 0.41]), judged as high/unclear risk of bias on allocation concealment (dSMD: -0.70; 95% CI: [-0.99, -0.42]), with low risk of bias on incomplete outcome data (dSMD: 0.30; 95% CI: [0.18, 0.43]), conducted at a single center (dSMD: -0.33; 95% CI: [-0.61, -0.05]), not using intention-to-treat analysis (dSMD: -0.75; 95% CI: [-1.43, -0.07]), and without funding support (dSMD: -0.22; 95% CI: [-0.41, -0.02]) tended to show larger effect estimates. CONCLUSION This study provides empirical evidence for the development of a specific critical appraisal tool for risk of bias assessments on CHM RCTs. Please cite this article as: Wang BH, Lin YL, Gao YY, Song JL, Qin L, Li LQ, Liu WQ, Zhong CCW, Jiang MY, Mao C, Yang XB, Chung VCH, Wu IXY. Trial characteristics and treatment effect estimates in randomized controlled trials of Chinese herbal medicine: A meta-epidemiological study. J Integr Med. 2024; 22(3): 223-234.
Collapse
Affiliation(s)
- Betty H Wang
- Jockey Club School of Public Health and Primary Care, the Chinese University of Hong Kong, 999077, Hong Kong, China
| | - Ya-Li Lin
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China
| | - Yin-Yan Gao
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China
| | - Jin-Lu Song
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China
| | - Lang Qin
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China
| | - Ling-Qi Li
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China
| | - Wen-Qi Liu
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China
| | - Claire C W Zhong
- Jockey Club School of Public Health and Primary Care, the Chinese University of Hong Kong, 999077, Hong Kong, China
| | - Mary Y Jiang
- School of Chinese Medicine, the Chinese University of Hong Kong, 999077, Hong Kong, China
| | - Chen Mao
- School of Public Health, Southern Medical University, Guangzhou 510080, Guangdong Province, China
| | - Xiao-Bo Yang
- State Key Laboratory of Dampness Syndrome of Chinese Medicine, the Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou 510120, Guangdong Province, China; Chinese Medicine Syndrome Research Team, the Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou 510120, Guangdong Province, China; Guangdong Provincial Key Laboratory of Clinical Research on Traditional Chinese Medicine Syndrome, Guangzhou 510120, Guangdong Province, China
| | - Vincent C H Chung
- Jockey Club School of Public Health and Primary Care, the Chinese University of Hong Kong, 999077, Hong Kong, China; School of Chinese Medicine, the Chinese University of Hong Kong, 999077, Hong Kong, China
| | - Irene X Y Wu
- Xiangya School of Public Health, Central South University, Changsha 410006, Hunan Province, China; Hunan Provincial Key Laboratory of Clinical Epidemiology, Central South University, Changsha 410006, Hunan Province, China.
| |
Collapse
|
6
|
Higgins KM, Levin G, Busch R. Considerations for open-label randomized clinical trials: Design, conduct, and analysis. Clin Trials 2024:17407745241244788. [PMID: 38618711 DOI: 10.1177/17407745241244788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/16/2024]
Abstract
Randomization and blinding are regarded as the most important tools to help reduce bias in clinical trial designs. Randomization is used to help guarantee that treatment arms differ systematically only by treatment assignment at baseline, and blinding is used to ensure that differences in endpoint evaluation and clinical decision-making during the trial arise only from the treatment received and not, for example, the expectation or desires of the people involved. However, given that there are times when it is not feasible or ethical to conduct fully blinded trials, we discuss what can be done to improve a trial, including conducting the trial as if it were a fully blinded trial and maintaining confidentiality of ongoing study results. In this article, we review how best to design, conduct, and analyze open-label trials to ensure the highest level of study integrity and the reliability of the study conclusions.
Collapse
Affiliation(s)
- Karen M Higgins
- Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Gregory Levin
- Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| | - Robert Busch
- Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, USA
| |
Collapse
|
7
|
Long Y, Zhang N, Wang X, Tang R, Guo Q, Huang J, Du L. The impact of blinding on estimated treatment effects in randomized clinical trials on acupuncture: A meta-epidemiological study. J Evid Based Med 2024; 17:54-64. [PMID: 38465845 DOI: 10.1111/jebm.12589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 02/25/2024] [Indexed: 03/12/2024]
Abstract
OBJECTIVE To evaluate the sole impact of blinding patients and outcome assessors in acupuncture randomized controlled trials (RCTs) on treatment effects while considering the type of outcome measures. METHODS We searched databases for the meta-analyses on acupuncture with both blinded and non-blinded RCTs. Mixed-effects meta-regression models estimated the average ratio of odds ratios (ROR) and differences in standardized mean differences (dSMD) for non-blinded RCTs versus blinded mixed-effects meta-regression model. RESULTS The study included 96 meta-analyses (1012 trials). The average ROR for lack of patient blinding was 1.08 (95% confidence intervals 0.79-1.49) in 18 meta-analyses with binary patient-reported outcomes. The average ROR for lack of outcome assessor blinding was 0.98 (0.77-1.24) in 43 meta-analyses with binary subjective outcomes. The average dSMD was -0.38 (-0.96 to 0.20) in 10 meta-analyses with continuous patient-reported outcomes. The average dSMD was -0.13 (-0.45 to 0.18) in 25 meta-analyses with continuous subjective outcomes. The results of the subgroup analysis were consistent with the primary analysis findings. CONCLUSIONS Blinding of participants and outcome assessors does not significantly influence acupuncture treatment efficacy. It underscores the practical difficulties of blinding in acupuncture RCTs and the necessity to distinguish between trials with and without successful blinding to understand treatment expectations' effects. Enhancing blinding procedures' quality and assessment in future research is crucial for improving RCTs' internal validity and reliability.
Collapse
Affiliation(s)
- Youlin Long
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
| | - Na Zhang
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
| | - Xinyao Wang
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
| | - Ruixian Tang
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
| | - Qiong Guo
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
| | - Jin Huang
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
- Med-X Centre for Manufacturing, West China Hospital, Sichuan University, Chengdu, China
| | - Liang Du
- Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu, China
- Medical Device Regulatory Research and Evaluation Centre, West China Hospital, Sichuan University, Chengdu, China
- Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu, China
| |
Collapse
|
8
|
Wang Y, Parpia S, Couban R, Wang Q, Armijo-Olivo S, Bassler D, Briel M, Brignardello-Petersen R, Gluud LL, Keitz SA, Letelier LM, Ravaud P, Schulz KF, Siemieniuk RAC, Zeraatkar D, Guyatt GH. Compelling evidence from meta-epidemiological studies demonstrates overestimation of effects in randomized trials that fail to optimize randomization and blind patients and outcome assessors. J Clin Epidemiol 2024; 165:111211. [PMID: 37939743 DOI: 10.1016/j.jclinepi.2023.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Revised: 10/29/2023] [Accepted: 11/01/2023] [Indexed: 11/10/2023]
Abstract
OBJECTIVES To investigate the impact of potential risk of bias elements on effect estimates in randomized trials. STUDY DESIGN AND SETTING We conducted a systematic survey of meta-epidemiological studies examining the influence of potential risk of bias elements on effect estimates in randomized trials. We included only meta-epidemiological studies that either preserved the clustering of trials within meta-analyses (compared effect estimates between trials with and without the potential risk of bias element within each meta-analysis, then combined across meta-analyses; between-trial comparisons), or preserved the clustering of substudies within trials (compared effect estimates between substudies with and without the element, then combined across trials; within-trial comparisons). Separately for studies based on between- and within-trial comparisons, we extracted ratios of odds ratios (RORs) from each study and combined them using a random-effects model. We made overall inferences and assessed certainty of evidence based on Grading of Recommendations, Assessment, development, and Evaluation and Instrument to assess the Credibility of Effect Modification Analyses. RESULTS Forty-one meta-epidemiological studies (34 of between-, 7 of within-trial comparisons) proved eligible. Inadequate random sequence generation (ROR 0.94, 95% confidence interval [CI] 0.90-0.97) and allocation concealment (ROR 0.92, 95% CI 0.88-0.97) probably lead to effect overestimation (moderate certainty). Lack of patients blinding probably overestimates effects for patient-reported outcomes (ROR 0.36, 95% CI 0.28-0.48; moderate certainty). Lack of blinding of outcome assessors results in effect overestimation for subjective outcomes (ROR 0.69, 95% CI 0.51-0.93; high certainty). The impact of patients or outcome assessors blinding on other outcomes, and the impact of blinding of health-care providers, data collectors, or data analysts, remain uncertain. Trials stopped early for benefit probably overestimate effects (moderate certainty). Trials with imbalanced cointerventions may overestimate effects, while trials with missing outcome data may underestimate effects (low certainty). Influence of baseline imbalance, compliance, selective reporting, and intention-to-treat analysis remain uncertain. CONCLUSION Failure to ensure random sequence generation or adequate allocation concealment probably results in modest overestimates of effects. Lack of patients blinding probably leads to substantial overestimates of effects for patient-reported outcomes. Lack of blinding of outcome assessors results in substantial effect overestimation for subjective outcomes. For other elements, though evidence for consistent systematic overestimate of effect remains limited, failure to implement these safeguards may still introduce important bias.
Collapse
Affiliation(s)
- Ying Wang
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada.
| | - Sameer Parpia
- Department of Oncology, McMaster University, Hamilton, Ontario, Canada
| | - Rachel Couban
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
| | - Qi Wang
- School of Public Health, Capital Medical University, Beijing, China
| | - Susan Armijo-Olivo
- University of Applied Sciences, Faculty of Business and Social Sciences, Osnabrück, Germany; Department of Physical Therapy, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton Canada
| | - Dirk Bassler
- Department of Neonatology, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - Matthias Briel
- Department of Clinical Research, Meta-Research Centre Basel, University Hospital Basel, Basel, Switzerland
| | | | - Lise Lotte Gluud
- Gastro Unit, Copenhagen University Hospital Hvidovre, Copenhagen, Denmark
| | - Sheri A Keitz
- Department of Medicine, Lahey Hospital & Medical Center, Burlington, MA, USA
| | - Luz M Letelier
- Department of Internal Medicine, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Philippe Ravaud
- Epidemiology and Statistics Sorbonne Paris Cité Research Center (CRESS), INSERM, Université Paris Descartes, Paris, France
| | - Kenneth F Schulz
- School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Reed A C Siemieniuk
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Dena Zeraatkar
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Gordon H Guyatt
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
9
|
Zeraatkar D, Pitre T, Diaz-Martinez JP, Chu D, Rochwerg B, Lamontagne F, Kum E, Qasim A, Bartoszko JJ, Brignardello-Peterson R. Impact of Allocation Concealment and Blinding in Trials Addressing Treatments for COVID-19: A Methods Study. Am J Epidemiol 2023; 192:1678-1687. [PMID: 37254775 PMCID: PMC10558187 DOI: 10.1093/aje/kwad131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 03/19/2023] [Accepted: 05/26/2023] [Indexed: 06/01/2023] Open
Abstract
We aimed to assess the impact of allocation concealment and blinding on the results of coronavirus disease 2019 (COVID-19) trials, using the World Health Organization COVID-19 database (to February 2022). We identified 488 randomized trials comparing drug therapeutics with placebo or standard care in patients with COVID-19. We performed random-effects meta-regressions comparing the results of trials with and without allocation concealment and blinding of health-care providers and patients. We found that, compared with trials with allocation concealment, trials without allocation concealment may estimate treatments to be more beneficial for mortality, mechanical ventilation, hospital admission, duration of hospitalization, and duration of mechanical ventilation, but results were imprecise. We did not find compelling evidence that, compared with trials with blinding, trials without blinding produce consistently different results for mortality, mechanical ventilation, and duration of hospitalization. We found that trials without blinding may estimate treatments to be more beneficial for hospitalizations and duration of mechanical ventilation. We did not find compelling evidence that COVID-19 trials in which health-care providers and patients are blinded produce different results from trials without blinding, but trials without allocation concealment estimate treatments to be more beneficial compared with trials with allocation concealment. Our study suggests that lack of blinding may not always bias results but that evidence users should remain skeptical of trials without allocation concealment.
Collapse
Affiliation(s)
- Dena Zeraatkar
- Correspondence to Dena Zeraatkar, Department of Anesthesia, McMaster University, 1280 Main Street West, Hamilton, ON L8S 4L8 Canada (e-mail )
| | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Pitre T, Zeraatkar D, Kachkovski GV, Leung G, Shligold E, Dowhanik S, Angriman F, Ferreyro BL, Scales DC, Rochwerg B. Noninvasive Oxygenation Strategies in Adult Patients With Acute Hypoxemic Respiratory Failure: A Systematic Review and Network Meta-Analysis. Chest 2023; 164:913-928. [PMID: 37085046 DOI: 10.1016/j.chest.2023.04.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 03/27/2023] [Accepted: 04/10/2023] [Indexed: 04/23/2023] Open
Abstract
BACKGROUND Several recently published randomized controlled trials have evaluated various noninvasive oxygenation strategies for the treatment of acute hypoxemic respiratory failure. RESEARCH QUESTION Which available noninvasive oxygen strategies are effective for acute hypoxic respiratory failure? STUDY DESIGN AND METHODS A systematic review of Medline, Embase, Cochrane CENTRAL, CINAHL, Web of Science, MedRxiv, and Research Square was conducted from inception to October 1, 2022. A random effects frequentist network meta-analysis was performed, and the results are presented using absolute risk difference per 1,000 patients. The Grading of Recommendations, Assessment, Development and Evaluation framework was used to rate the certainty of the evidence. Mortality, invasive mechanical ventilation, duration of hospitalization and ICU stay, ventilator-free days, and level of comfort are reported. RESULTS Thirty-six trials (7,046 patients) were included. It was found that helmet CPAP probably reduces mortality compared with standard oxygen therapy (SOT) (231 fewer deaths per 1,000; 95% CI, 126-273 fewer) (moderate certainty). A high-flow nasal cannula (HFNC) probably reduces the need for invasive mechanical ventilation (103.5 fewer events per 1,000; 95% CI, 40.5-157.5 fewer) (moderate certainty). All noninvasive oxygenation strategies may reduce the duration of hospitalization as compared with SOT (low certainty). Helmet bilevel ventilation (4.84 days fewer; 95% CI, 2.33-7.36 days fewer) and helmet CPAP (1.74 days fewer; 95% CI, 4.49 fewer-1.01 more) may reduce the duration of ICU stay as compared with SOT (both low certainty). SOT may be more comfortable than face mask noninvasive ventilation and no different in comfort compared with an HFNC (both low certainty). INTERPRETATION A helmet interface for noninvasive ventilation probably reduces mortality and the risk of mechanical ventilation, as well as the duration of hospital and ICU stay. An HFNC probably reduces the risk of invasive mechanical ventilation and may be as comfortable as SOT. Further research is necessary to understand the role of these interfaces in acute hypoxemic respiratory failure.
Collapse
Affiliation(s)
- Tyler Pitre
- Department of Medicine, McMaster University, Hamilton, ON, Canada.
| | - Dena Zeraatkar
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Department of Anesthesiology, McMaster University, Hamilton, ON, Canada
| | - George V Kachkovski
- Faculty of Health Sciences, Michael G. DeGroote School of Medicine, Hamilton, ON, Canada
| | - Gareth Leung
- Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Erica Shligold
- Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Sebastian Dowhanik
- Faculty of Health Sciences, Michael G. DeGroote School of Medicine, Hamilton, ON, Canada
| | - Federico Angriman
- Department of Critical Care Medicine, Sunnybrook Health Sciences Centre, Toronto, ON, Canada; Interdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, ON, Canada; Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health. University of Toronto, Toronto, ON, Canada
| | - Bruno L Ferreyro
- Interdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, ON, Canada; Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health. University of Toronto, Toronto, ON, Canada; Department of Medicine, Sinai Health System and University Health Network, Toronto, ON, Canada
| | - Damon C Scales
- Department of Critical Care Medicine, Sunnybrook Health Sciences Centre, Toronto, ON, Canada; Interdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, ON, Canada
| | - Bram Rochwerg
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada; Division of Critical Care, Department of Medicine, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
11
|
Meilandt C, Fink Vallentin M, Blumensaadt Winther K, Bach A, Dissing TH, Christensen S, Juhl Terkelsen C, Lass Klitgaard T, Mikkelsen S, Folke F, Granfeldt A, Andersen LW. Intravenous vs. intraosseous vascular access during out-of-hospital cardiac arrest - protocol for a randomised clinical trial. Resusc Plus 2023; 15:100428. [PMID: 37502742 PMCID: PMC10368931 DOI: 10.1016/j.resplu.2023.100428] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 06/27/2023] [Indexed: 07/29/2023] Open
Abstract
Objective During cardiac arrest, current guidelines recommend attempting intravenous access first and to consider intraosseous access if intravenous access is unsuccessful or impossible. However, these recommendations are only based on very low-certainty evidence. Therefore, the "Intravenous vs Intraosseous Vascular Access During Out-of-Hospital Cardiac Arrest" (IVIO) trial aims to determine whether there is a difference in patient outcomes depending on the type of vascular access attempted during out-of-hospital cardiac arrest. This current article describes the clinical IVIO trial. Methods The IVIO trial is an investigator-initiated, randomised trial of intravenous vs. intraosseous vascular access during adult non-traumatic out-of-hospital cardiac arrest in Denmark. The intervention will consist of minimum two attempts (if unsuccessful on the first attempt) to successfully establish intravenous or intraosseous vascular access during cardiac arrest. The intraosseous group will be further randomised to the humeral or tibial site. The primary outcome is sustained return of spontaneous circulation and key secondary outcomes include survival and survival with a favourable neurological outcome at 30 days. A total of 1,470 patients will be included. Results The trial started in March 2022 and the last patient is anticipated to be included in the spring of 2024. The primary results will be reported after 90-day follow-up and are anticipated in mid-2024. Conclusion The current article describes the design of the Danish IVIO trial. The findings of this trial will help inform future guidelines for selecting the optimal vascular access route during out-of-hospital cardiac arrest.
Collapse
Affiliation(s)
- Carsten Meilandt
- Prehospital Emergency Medical Services, Central Denmark Region, Denmark
| | | | | | - Allan Bach
- Prehospital Emergency Medical Services, Central Denmark Region, Denmark
| | - Thomas H. Dissing
- Prehospital Emergency Medical Services, Central Denmark Region, Denmark
- Department of Anesthesiology and Intensive Care, Aarhus University Hospital, Denmark
| | - Steffen Christensen
- Department of Anesthesiology and Intensive Care, Aarhus University Hospital, Denmark
- Department of Clinical Medicine, Aarhus University, Denmark
| | | | | | - Søren Mikkelsen
- The Prehospital Research Unit, Region of Southern Denmark, Denmark
| | - Fredrik Folke
- Copenhagen Emergency Medical Services, Capital Region of Denmark, Denmark
- Department of Cardiology, Herlev Gentofte University Hospital, Denmark
- Department of Clinical Medicine, University of Copenhagen, Denmark
| | - Asger Granfeldt
- Department of Anesthesiology and Intensive Care, Aarhus University Hospital, Denmark
- Department of Clinical Medicine, Aarhus University, Denmark
| | - Lars W. Andersen
- Prehospital Emergency Medical Services, Central Denmark Region, Denmark
- Department of Anesthesiology and Intensive Care, Aarhus University Hospital, Denmark
- Department of Clinical Medicine, Aarhus University, Denmark
- Department of Anesthesiology and Intensive Care, Viborg Regional Hospital, Viborg, Denmark
| |
Collapse
|
12
|
Koppens HJ, Onland W, Visser DH, Denswil NP, van Kaam AH, Lutterman CA. Heart Rate Characteristics Monitoring for Late-Onset Sepsis in Preterm Infants: A Systematic Review. Neonatology 2023; 120:548-557. [PMID: 37379804 PMCID: PMC10614451 DOI: 10.1159/000531118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 05/03/2023] [Indexed: 06/30/2023]
Abstract
BACKGROUND Early diagnosis of late-onset sepsis (LOS) and necrotizing enterocolitis (NEC) by monitoring heart rate characteristics (HRC) of preterm infants might reduce the risk of death and morbidities. We aimed to systematically assess the effects of HRC monitoring on death, LOS, and NEC. METHODS A systematic search was performed in MEDLINE, Embase, Cochrane Library, and Web of Science. RESULTS Fifteen papers were included in this review. Three of these papers reported results from the only identified randomized controlled trial (RCT). This RCT showed that HRC monitoring resulted in a small but significant reduction in mortality (absolute risk reduction 2.1% [95% confidence interval 0.01-4.14]) without any differences in neurodevelopmental impairment. The risk of bias was rated high due to performance and detection bias and failure to correct for multiple testing. Most diagnostic cohort studies showed high discriminating accuracy in predicting LOS but lacked sufficient quality and generalizability. No studies for the detection of NEC were identified. CONCLUSION Supported by multiple observational cohort studies, the RCT identified in this systematic review showed that HRC monitoring as an early warning system for LOS might reduce the risk of death in preterm infants. However, methodological weaknesses and limited generalizability do not justify implementation of HRC in clinical care. A large international RCT is warranted.
Collapse
Affiliation(s)
- Hugo J. Koppens
- Department of Neonatology, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Reproduction and Development, Amsterdam, The Netherlands
| | - Wes Onland
- Department of Neonatology, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Reproduction and Development, Amsterdam, The Netherlands
| | - Douwe H. Visser
- Department of Neonatology, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Reproduction and Development, Amsterdam, The Netherlands
| | - Nerissa P. Denswil
- Amsterdam UMC Location University of Amsterdam, Medical Library, Amsterdam, The Netherlands
| | - Anton H. van Kaam
- Department of Neonatology, Emma Children’s Hospital, Amsterdam UMC location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Reproduction and Development, Amsterdam, The Netherlands
| | | |
Collapse
|
13
|
Yang Y, Han Y, Zou G, Sui Y, Jin J, Liu L. Reporting quality of randomized controlled trials evaluating non-vitamin K oral anticoagulants in atrial fibrillation: a systematic review. BMC Cardiovasc Disord 2023; 23:229. [PMID: 37138211 PMCID: PMC10155658 DOI: 10.1186/s12872-023-03258-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 04/24/2023] [Indexed: 05/05/2023] Open
Abstract
BACKGROUND Randomized controlled trials (RCTs) are subject to bias if they lack methodological quality. Furthermore, optimal and transparent reporting of RCT findings aids their critical appraisal and interpretation. This study aimed to comprehensively evaluate the report quality of RCTs of non-vitamin K oral anticoagulants (NOACs) for the treatment of atrial fibrillation (AF) and to analyze the factors influencing the quality. METHODS By searching PubMed, Embase, Web of Science, and Cochrane Library databases RCTs published from inception to 2022 evaluating the efficacy of NOACs on AF were collected. By using the 2010 Consolidated Standards for Reporting Tests (CONSORT) statement, the overall quality of each report was assessed. RESULTS Sixty-two RCTs were retrieved in this study. The median of overall quality score in 2010 was 14 (range: 8.5-20). The extent of compliance with the Consolidated Standards of Reporting Trials reporting guideline differed substantially across items: 9 items were reported adequately (more than 90%), and 3 were reported adequately in less than 10% of trials. Multivariate linear regression analysis showed that the higher reporting scores were associated with higher journal impact factor (P = 0.01), international collaboration (P < 0.01), and Sources of trial funding (P = 0.02). CONCLUSIONS Although a large number of randomized controlled trials of NOACs for the treatment of AF were published after the CONSORT statement in 2010, the overall quality is still not satisfactory, thus weakening their potential utility and may mislead clinical decisions. This survey provides the first hint for researchers conducting trials of NOACs for AF to improve the quality of reports and to actively apply the CONSORT statement.
Collapse
Affiliation(s)
- YueGuang Yang
- Heilongjiang University of Chinese Medicine, Harbin, P. R. China
| | - YuBo Han
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, P.R. China
| | - GuoLiang Zou
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, P.R. China
| | - YanBo Sui
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, P.R. China
| | - Juan Jin
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, P.R. China
| | - Li Liu
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, P.R. China.
| |
Collapse
|
14
|
Mickenautsch S, Rupf S, Miletić I, Yengopal V. Extension of the Composite Quality Score (CQS) as an appraisal tool for prospective, controlled clinical therapy trials-A systematic review of meta-epidemiological evidence. PLoS One 2022; 17:e0279645. [PMID: 36584067 PMCID: PMC9803107 DOI: 10.1371/journal.pone.0279645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 12/12/2022] [Indexed: 12/31/2022] Open
Abstract
AIM To conduct a survey of current meta-epidemiological studies to identify additional trial design characteristics that may be associated with significant over- or underestimation of the treatment effect and to use such identified characteristics as a basis for the formulation of new CQS appraisal criteria. MATERIALS AND METHODS We retrieved eligible studies from two systematic reviews on this topic (latest search May 2015) and searched the databases PubMed and Embase for further studies from June 2015 -March 2022. All data were extracted by one author and verified by another. Sufficiently homogeneous estimates from single studies were pooled using random-effects meta-analysis. Trial design characteristics associated with statistically significant estimates from single datasets (which could not be pooled) and meta-analyses were used as a basis to formulate new or amend existing CQS criteria. RESULTS A total of 38 meta-epidemiological studies were identified. From these, seven trial design characteristics associated with statistically significant over- or underestimation of the true therapeutic effect were found. CONCLUSION One new criterion concerning double-blinding was added to the CQS, and the original criteria for concealing the random allocation sequence and for minimum sample size were amended.
Collapse
Affiliation(s)
- Steffen Mickenautsch
- Faculty of Dentistry, University of the Western Cape, Tygerberg, Cape Town, South Africa
- Department of Community Dentistry, School of Oral Health Sciences, Faculty of Health Sciences, University of the Witwatersrand, Parktown, Johannesburg, South Africa
- Review Center for Health Science Research, Bedfordview, Johannesburg, South Africa
- * E-mail:
| | - Stefan Rupf
- Chair of Synoptic Dentistry, Saarland University, Homburg, Germany
| | - Ivana Miletić
- Department of Endodontics and Restorative Dentistry, School of Dental Medicine, University of Zagreb, Zagreb, Croatia
| | - Veerasamy Yengopal
- Faculty of Dentistry, University of the Western Cape, Tygerberg, Cape Town, South Africa
| |
Collapse
|
15
|
Lee TC, Murthy S, Del Corpo O, Senécal J, Butler-Laporte G, Sohani ZN, Brophy JM, McDonald EG. Remdesivir for the treatment of COVID-19: a systematic review and meta-analysis. Clin Microbiol Infect 2022; 28:1203-1210. [PMID: 35598856 PMCID: PMC9117160 DOI: 10.1016/j.cmi.2022.04.018] [Citation(s) in RCA: 40] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 04/19/2022] [Accepted: 04/20/2022] [Indexed: 01/26/2023]
Abstract
BACKGROUND The benefits of remdesivir in the treatment of hospitalized patients with COVID-19 remain debated with the National Institutes of Health and the World Health Organization providing contradictory recommendations for and against use. OBJECTIVES To evaluate the role of remdesivir for hospitalized inpatients as a function of oxygen requirements. DATA SOURCES Beginning with our prior systematic review, we searched MEDLINE using PubMed from 15 January 2021 through 5 May 2022. STUDY ELIGIBILITY CRITERIA Randomised controlled trials; all languages. PARTICIPANTS All hospitalized adults with COVID-19. INTERVENTIONS Remdesivir, in comparison to either placebo, or standard of care. ASSESSMENT OF RISK OF BIAS We used the ROB-2 criteria. METHODS OF DATA SYNTHESIS The primary outcome was mortality, stratified by oxygen use (none, supplemental oxygen without mechanical ventilation, and mechanical ventilation). We conducted a frequentist random effects meta-analysis on the risk ratio scale and, to contextualize the probabilistic benefits, we also performed a Bayesian random effects meta-analysis on the risk difference scale. A ≥1% absolute risk reduction was considered clinically important. RESULTS We identified eight randomized trials, totaling 10 751 participants. The risk ratio for mortality comparing remdesivir vs. control was 0.77 (95% CI, 0.5-1.19) in the patients who did not require supplemental oxygen; 0.89 (95% CI, 0.79-0.99) for nonventilated patients requiring oxygen; and 1.08 (95% CI, 0.88-1.31) in the setting of mechanical ventilation. Using neutral priors, the probabilities that remdesivir reduces mortality were 76.8%, 93.8%, and 14.7%, respectively. The probability that remdesivir reduced mortality by ≥ 1% was 77.4% for nonventilated patients requiring oxygen. CONCLUSIONS Based on this meta-analysis, there is a high probability that remdesivir reduces mortality for nonventilated patients with COVID-19 requiring supplemental oxygen therapy. Treatment guidelines should be re-evaluated.
Collapse
Affiliation(s)
- Todd C. Lee
- Division of Infectious Diseases, Department of Medicine, McGill University, Montréal, Canada,Clinical Practice Assessment Unit, Department of Medicine, McGill University, Montréal, Canada,Department of Epidemiology, Occupational Health, and Biostatistics, McGill University, Montréal, Canada,Corresponding author. Todd C. Lee, Royal Victoria Hospital, 1001 Decarie Blvd, Room E5.1820, Montréal H4A3J1, QC. Canada
| | - Srinivas Murthy
- Department of Pediatrics, University of British Columbia, Vancouver, Canada
| | - Olivier Del Corpo
- Faculty of Medicine and Health Sciences, McGill University, Montréal, Canada
| | - Julien Senécal
- Faculty of Medicine and Health Sciences, McGill University, Montréal, Canada
| | - Guillaume Butler-Laporte
- Department of Epidemiology, Occupational Health, and Biostatistics, McGill University, Montréal, Canada
| | - Zahra N. Sohani
- Division of Infectious Diseases, Department of Medicine, McGill University, Montréal, Canada
| | - James M. Brophy
- Department of Epidemiology, Occupational Health, and Biostatistics, McGill University, Montréal, Canada,Division of Cardiology, Department of Medicine, McGill University, Montréal, Canada
| | - Emily G. McDonald
- Clinical Practice Assessment Unit, Department of Medicine, McGill University, Montréal, Canada,Division of General Internal Medicine, Department of Medicine, McGill University, Montréal, Canada
| |
Collapse
|
16
|
Agarwal A, Basmaji J, Fernando SM, Ge FZ, Xiao Y, Faisal H, Honarmand K, Hylands M, Lau V, Lewis K, Couban R, Lamontagne F, Adhikari NKJ. Parenteral Vitamin C in Patients with Severe Infection: A Systematic Review. NEJM EVIDENCE 2022; 1:EVIDoa2200105. [PMID: 38319815 DOI: 10.1056/evidoa2200105] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
BACKGROUND: Inflammation and oxidative damage caused by severe infections may be attenuated by vitamin C. METHODS: We conducted a systematic review of randomized controlled trials (RCTs) of parenteral vitamin C as combined therapy or monotherapy versus no parenteral vitamin C administered to adults hospitalized with severe infection. The primary outcome was mortality. We performed random-effects meta-analyses and assessed certainty in effect estimates. RESULTS: Of 1547 citations, 41 RCTs (n = 4915 patients) were eligible for inclusion. Low-certainty evidence suggested that vitamin C may reduce in-hospital mortality (21 RCTs, 2762 patients; risk ratio, 0.88 [95% confidence interval (CI), 0.73 to 1.06]), 30-day mortality (24 RCTs, 3436 patients; risk ratio, 0.83 [95% CI, 0.71 to 0.98]), and early mortality (before hospital discharge or 30 days; 34 RCTs, 4366 patients; risk ratio, 0.80 [95% CI, 0.68 to 0.93]). Effects were attenuated in sensitivity analyses limited to published blinded trials at low risk-of-bias (in-hospital mortality: risk ratio, 1.07 [95% CI, 0.92 to 1.24], moderate certainty; 30-day mortality: risk ratio, 0.88 [95% CI, 0.71 to 1.10], low certainty; and early mortality: risk ratio, 0.88 [95% CI, 0.73 to 1.06], low certainty). For 90-day mortality, all trials had low risk-of-bias; moderate-certainty evidence suggested harm (five RCTs, 1722 patients; risk ratio, 1.07 [95% CI, 0.94 to 1.21]). Moderate-certainty evidence suggested an increased risk of hypoglycemia (risk ratio, 1.20 [95% CI, 0.69 to 2.08]). Effects on other secondary outcomes were mixed and informed by low-certainty evidence. No credible subgroup effects were observed for mortality related to cointerventions (monotherapy vs. combined therapy), dose, or type of infection (Covid-19 vs. other). CONCLUSIONS: Overall, evidence from RCTs does not establish a survival benefit for vitamin C in patients with severe infection. (PROSPERO number, CRD42020209187.)
Collapse
Affiliation(s)
- Arnav Agarwal
- Department of Critical Care Medicine, Sunnybrook Health Sciences Centre, Toronto
- Department of Medicine, Université de Sherbrooke, Sherbrooke, Canada
| | - John Basmaji
- Division of Critical Care, Department of Medicine, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada
| | - Shannon M Fernando
- Division of Critical Care, Department of Medicine, University of Ottawa, Ottawa
- Department of Emergency Medicine, University of Ottawa, Ottawa
| | - Fang Zhou Ge
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Yingqi Xiao
- Department of Nursing, West China School of Nursing, West China Hospital, Sichuan University, Chengdu, Sichuan, China
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Haseeb Faisal
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Kimia Honarmand
- Division of Critical Care, Department of Medicine, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada
| | - Mathieu Hylands
- Department of Critical Care Medicine, Sunnybrook Health Sciences Centre, Toronto
| | - Vincent Lau
- Department of Critical Care, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | - Kimberley Lewis
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Rachel Couban
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - François Lamontagne
- Department of Medicine, Université de Sherbrooke, Sherbrooke, Canada
- Centre de recherche du CHU de Sherbrooke, Sherbrooke, Canada
| | - Neill K J Adhikari
- Department of Critical Care Medicine, Sunnybrook Health Sciences Centre, Toronto
- Interdepartmental Division of Critical Care Medicine, Institute for Health Policy, Management, and Evaluation, University of Toronto, Toronto
| |
Collapse
|
17
|
Shein SL, Yehya N. Trials and Tribulations in Bronchiolitis. J Pediatr 2022; 244:8-10. [PMID: 35240136 DOI: 10.1016/j.jpeds.2022.02.053] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Accepted: 02/24/2022] [Indexed: 11/28/2022]
Affiliation(s)
- Steven L Shein
- Division of Pediatric Critical Care Medicine, Department of Pediatrics, University Hospitals Rainbow Babies & Children's Hospital, Cleveland, Ohio
| | - Nadir Yehya
- Division of Pediatric Critical Care, Department of Anesthesiology and Critical Care, Children's Hospital of Philadelphia and University of Pennsylvania, Philadelphia, Pennsylvania.
| |
Collapse
|
18
|
|
19
|
Seeing Interventions in a Favorable Light: The Consequences of Unblinded Trials. Crit Care Med 2021; 49:1842-1844. [PMID: 34529618 DOI: 10.1097/ccm.0000000000005109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|