1
|
Murad MH, Verbeek J, Schwingshackl L, Filippini T, Vinceti M, Akl EA, Morgan RL, Mustafa RA, Zeraatkar D, Senerth E, Street R, Lin L, Falck-Ytter Y, Guyatt G, Schünemann HJ. GRADE GUIDANCE 38: Updated guidance for rating up certainty of evidence due to a dose-response gradient. J Clin Epidemiol 2023; 164:45-53. [PMID: 37777140 DOI: 10.1016/j.jclinepi.2023.09.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 09/18/2023] [Accepted: 09/24/2023] [Indexed: 10/02/2023]
Abstract
INTRODUCTION This updated guidance from the Grading of Recommendations Assessment, Development, and Evaluation addresses rating up certainty of evidence due to a dose-response gradient (DRG) observed in synthesis of intervention and exposure studies. STUDY DESIGN AND SETTING This guidance was developed using iterative discussions and consensus in multiple meetings and was presented to attendees of the Grading of Recommendations Assessment, Development, and Evaluation Working Group meeting for feedback in November 2022 and for final approval in May 2023. RESULTS The guidance consists of two steps. The first is to determine whether the DRG is credible. We describe five items for assessing credibility: a) is DRG identified using a proper analytical approach; b) is confounding the cause of the DRG; c) is there serious concern about ecological bias; d) is the DRG consistent across studies; and e) is there indirect evidence supporting the DRG. The first two of these items are the most critical. If the DRG was judged to be credible, then the second step is to apply the DRG domain and consider rating up, but only by one level due to the concern about residual confounding. CONCLUSION Systematic review authors should only rate up certainty in evidence when a DRG is deemed credible.
Collapse
Affiliation(s)
- M Hassan Murad
- Mayo Clinic Evidence-Based Practice Center, Rochester, MN, USA; Evidence Foundation, Cleveland Heights, OH, USA.
| | - Jos Verbeek
- Department of Public and Occupational Health, Academic Medical Centers Amsterdam, University of Amsterdam, Amsterdam, the Netherlands
| | - Lukas Schwingshackl
- Institute for Evidence in Medicine, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Tommaso Filippini
- Department of Biomedical, Metabolic and Neural Sciences, Environmental, Genetic and Nutritional Epidemiology Research Center, University of Modena and Reggio Emilia, Modena, Italy; School of Public Health, University of California Berkeley, Berkeley, CA, USA
| | - Marco Vinceti
- Department of Biomedical, Metabolic and Neural Sciences, Environmental, Genetic and Nutritional Epidemiology Research Center, University of Modena and Reggio Emilia, Modena, Italy; Department of Epidemiology, Boston University School of Public Health, MA, USA
| | - Elie A Akl
- Clinical Research Institute, American University of Beirut, Beirut, Lebanon; Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Rebecca L Morgan
- Evidence Foundation, Cleveland Heights, OH, USA; School of Medicine, Case Western Reserve University, Cleveland, OH, USA
| | - Reem A Mustafa
- Evidence Foundation, Cleveland Heights, OH, USA; Outcomes and Implementation Research Unit, Department of Internal Medicine, University of Kansas Medical Center, Kansas City, KS, USA
| | - Dena Zeraatkar
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
| | | | - Renee Street
- South African Medical Research Council, Environment & Health Research Unit, South Africa
| | - Lifeng Lin
- Department of Statistics, University of Arizona Medical Center-South Campus, Tucson, Arizona, USA
| | - Yngve Falck-Ytter
- Evidence Foundation, Cleveland Heights, OH, USA; School of Medicine, Case Western Reserve University, Cleveland, OH, USA; VA Northeast Ohio Health Care System, Cleveland, OH, USA
| | - Gordon Guyatt
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Holger J Schünemann
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Biomedical Sciences, Humanitas University, Milano, Italy
| |
Collapse
|
2
|
Michel S, Atmakuri A, von Ehrenstein OS. Prenatal exposure to ambient air pollutants and congenital heart defects: An umbrella review. ENVIRONMENT INTERNATIONAL 2023; 178:108076. [PMID: 37454629 DOI: 10.1016/j.envint.2023.108076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 06/26/2023] [Accepted: 06/29/2023] [Indexed: 07/18/2023]
Abstract
BACKGROUND Prenatal exposure to ambient air pollutants has been linked to congenital heart defects (CHD), but findings of existing systematic reviews have been mixed. OBJECTIVE To assess the epidemiological evidence on associations between prenatal exposure to ambient air pollutants and CHD subtypes, based on a systematic overview of reviews ("umbrella review"). METHODS We conducted a systematic search for reviews assessing associations between prenatal exposure to criteria air pollutants and CHD. The risk of bias was evaluated using the Risk of Bias in Systematic Reviews (ROBIS) tool. The certainty of the systematic review findings was graded using the Navigation Guide methodology. RESULTS We identified eleven systematic reviews, including eight with meta-analyses, assessing in total 35 primary studies of prenatal exposure to criteria air pollutants and various CHD subtypes. The certainty of the findings of four meta-analyses indicating an increased risk for coarctation of the aorta associated with nitrogen dioxide exposure was rated as moderate. The certainty of findings indicating positive, inverse, or null associations for other pollutant-subtype combinations was rated as very low to low, based on low precision and high statistical heterogeneity of summary odds ratios (SOR), substantial inconsistencies between review findings, and methodological limitations of the systematic reviews. DISCUSSION The inconsistent findings and high statistical heterogeneity of many SOR of the included systematic reviews may partly be traced to differences in methodological approaches, and the risk of bias across included reviews (e.g., inclusion criteria, systematic search strategies, synthesis methods) and primary studies (e.g., exposure assessment, diagnostic criteria). Adherence to appropriate systematic review guidelines for environmental health research, as well as rigorous evaluation of risk of bias in primary studies, are essential for future risk assessments and policy-making. Still, our findings suggest that prenatal exposure to ambient air pollutants may increase risks for at least some CHD subtypes.
Collapse
Affiliation(s)
- Sophie Michel
- Department of Epidemiology, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, USA.
| | - Aishwarya Atmakuri
- Department of Molecular, Cell, and Developmental Biology, University of California, Los Angeles, Los Angeles, California, USA
| | - Ondine S von Ehrenstein
- Department of Epidemiology, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, USA; Department of Community Health Sciences, Fielding School of Public Health, University of California, Los Angeles, Los Angeles, California, USA
| |
Collapse
|