1
|
Petersen JM, Kahrs JC, Adrien N, Wood ME, Olshan AF, Smith LH, Howley MM, Ailes EC, Romitti PA, Herring AH, Parker SE, Shaw GM, Politis MD. Bias analyses to investigate the impact of differential participation: Application to a birth defects case-control study. Paediatr Perinat Epidemiol 2024; 38:535-543. [PMID: 38102868 PMCID: PMC11301528 DOI: 10.1111/ppe.13026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 11/17/2023] [Accepted: 11/24/2023] [Indexed: 12/17/2023]
Abstract
BACKGROUND Certain associations observed in the National Birth Defects Prevention Study (NBDPS) contrasted with other research or were from areas with mixed findings, including no decrease in odds of spina bifida with periconceptional folic acid supplementation, moderately increased cleft palate odds with ondansetron use and reduced hypospadias odds with maternal smoking. OBJECTIVES To investigate the plausibility and extent of differential participation to produce effect estimates observed in NBDPS. METHODS We searched the literature for factors related to these exposures and participation and conducted deterministic quantitative bias analyses. We estimated case-control participation and expected exposure prevalence based on internal and external reports, respectively. For the folic acid-spina bifida and ondansetron-cleft palate analyses, we hypothesized the true odds ratio (OR) based on prior studies and quantified the degree of exposure over- (or under-) representation to produce the crude OR (cOR) in NBDPS. For the smoking-hypospadias analysis, we estimated the extent of selection bias needed to nullify the association as well as the maximum potential harmful OR. RESULTS Under our assumptions (participation, exposure prevalence, true OR), there was overrepresentation of folic acid use and underrepresentation of ondansetron use and smoking among participants. Folic acid-exposed spina bifida cases would need to have been ≥1.2× more likely to participate than exposed controls to yield the observed null cOR. Ondansetron-exposed cleft palate cases would need to have been 1.6× more likely to participate than exposed controls if the true OR is null. Smoking-exposed hypospadias cases would need to have been ≥1.2 times less likely to participate than exposed controls for the association to falsely appear protective (upper bound of selection bias adjusted smoking-hypospadias OR = 2.02). CONCLUSIONS Differential participation could partly explain certain associations observed in NBDPS, but questions remain about why. Potential impacts of other systematic errors (e.g. exposure misclassification) could be informed by additional research.
Collapse
Affiliation(s)
- Julie M. Petersen
- Division for Surveillance, Research, and Promotion of Perinatal Health, Massachusetts Department of Public Health, Boston, Massachusetts, USA
| | - Jacob C. Kahrs
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Nedghie Adrien
- Division for Surveillance, Research, and Promotion of Perinatal Health, Massachusetts Department of Public Health, Boston, Massachusetts, USA
- Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Mollie E. Wood
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Andrew F. Olshan
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Louisa H. Smith
- Department of Health Sciences, Bouvé College of Health Sciences, Northeastern University, Boston, Massachusetts, USA
- Roux Institute, Northeastern University, Portland, Maine, USA
| | - Meredith M. Howley
- Birth Defects Registry, New York State Department of Health, Albany, New York, USA
| | - Elizabeth C. Ailes
- National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Paul A. Romitti
- Department of Epidemiology, College of Public Health, University of Iowa, Iowa City, Iowa, USA
| | - Amy H. Herring
- Department of Statistical Science, Duke University, Durham, North Carolina, USA
| | - Samantha E. Parker
- Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Gary M. Shaw
- Division of Neonatology, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, USA
| | - Maria D. Politis
- Arkansas Center for Birth Defects Research and Prevention, Fay W. Boozman College of Public Health, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | | |
Collapse
|
2
|
Howards PP, Johnson CY. A selection of challenges in addressing selection bias. Paediatr Perinat Epidemiol 2024. [PMID: 38949320 DOI: 10.1111/ppe.13102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Accepted: 06/09/2024] [Indexed: 07/02/2024]
Affiliation(s)
| | - Candice Y Johnson
- Department of Family Medicine and Community Health, Duke University, Durham, North Carolina, USA
| |
Collapse
|
3
|
Akbaş KE, Hark BD. Evaluation of quantitative bias analysis in epidemiological research: A systematic review from 2010 to mid-2023. J Eval Clin Pract 2024. [PMID: 39031561 DOI: 10.1111/jep.14065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 05/17/2024] [Accepted: 06/03/2024] [Indexed: 07/22/2024]
Abstract
OBJECTIVE We aimed to demonstrate the use of quantitative bias analysis (QBA), which reveals the effects of systematic error, including confounding, misclassification and selection bias, on study results in epidemiological studies published in the period from 2010 to mid-23. METHOD The articles identified through a keyword search using Pubmed and Scopus were included in the study. The articles obtained from this search were eliminated according to the exclusion criteria, and the articles in which QBA analysis was applied were included in the detailed evaluation. RESULTS It can be said that the application of QBA analysis has gradually increased over the 13-year period. Accordingly, the number of articles in which simple is used as a method in QBA analysis is 9 (9.89%), the number of articles in which the multidimensional approach is used is 10 (10.99%), the number of articles in which the probabilistic approach is used is 60 (65.93%) and the number of articles in which the method is not specified is 12 (13.19%). The number of articles with misclassification bias model is 44 (48.35%), the number of articles with uncontrolled confounder(s) bias model is 32 (35.16%), the number of articles with selection bias model is 7 (7.69%) and the number of articles using more than one bias model is 8 (8.79%). Of the 49 (53.85%) articles in which the bias parameter source was specified, 19 (38.78%) used internal validation, 26 (53.06%) used external validation and 4 (8.16%) used educated guess, data constraints and hypothetical data. Probabilistic approach was used as a bias method in 60 (65.93%) of the articles, and mostly beta (8 [13.33%)], normal (9 [15.00%]) and uniform (8 [13.33%]) distributions were selected. CONCLUSION The application of QBA is rare in the literature but is increasing over time. Future researchers should include detailed analyzes such as QBA analysis to obtain inferences with higher evidence value, taking into account systematic errors.
Collapse
Affiliation(s)
- Kübra Elif Akbaş
- Department of Biostatistics and Medical Informatics, Faculty of Medicine, Fırat University, Elazig, Turkey
| | - Betül Dağoğlu Hark
- Department of Biostatistics and Medical Informatics, Faculty of Medicine, Fırat University, Elazig, Turkey
| |
Collapse
|