1
|
Manke-Reimers F, Brugger V, Bärnighausen T, Kohler S. When, why and how are estimated effects transported between populations? A scoping review of studies applying transportability methods. Eur J Epidemiol 2025:10.1007/s10654-025-01217-w. [PMID: 40249515 DOI: 10.1007/s10654-025-01217-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 03/01/2025] [Indexed: 04/19/2025]
Abstract
Transportability methods can improve the external validity of estimated effects by accounting for effect heterogeneity due to differently distributed covariates between populations. This scoping review aims to provide an overview of when, why and how transportability methods have been applied. We systematically searched MEDLINE (Ovid), Embase, Web of Science, EconLit and Google Scholar for studies published between 2010 and December 18, 2024. Studies using transportability methods in a numerical application for at least partly non-overlapping source and target populations were included. We identified 3432 unique studies and included 64 studies applying transportability methods. Over two thirds of the included studies (44/64) introduced new methods. Less than one third of the included studies (20/64) were pure applications of transportability methods. Most applied studies (17/20) transported effect estimates from randomized controlled trials. Effects were transported to target populations with either complete (9/20) or no (9/20) treatment and outcome data or both (2/20). The most frequent aims of applied studies were to transport estimated effects to new populations (10/20) and to assess effect heterogeneity explainable by measured covariates (8/20). How transportability methods were applied varied widely between studies, for instance in the covariate selection approach and sensitivity analysis. Methodological studies with a transportability application presented new transportability estimators for randomized data (5/44), specific transportability applications (e.g., meta-analysis, mediation analysis; 21/44) and other methodological aspects (e.g., covariate selection, missing data handling; 18/44). Transportability methods are a useful tool for knowledge transfer between populations. More applications of transportability methods and guidance for their use are desirable.
Collapse
Affiliation(s)
- Fabian Manke-Reimers
- Center for Preventive Medicine and Digital Health, Medical Faculty Mannheim, Heidelberg University, Röntgenstraße 7, 68167, Mannheim, Germany.
| | - Vincent Brugger
- Center for Preventive Medicine and Digital Health, Medical Faculty Mannheim, Heidelberg University, Röntgenstraße 7, 68167, Mannheim, Germany
| | - Till Bärnighausen
- Heidelberg Institute of Global Health, Medical Faculty and University Hospital, Heidelberg University, Heidelberg, Germany
- Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Africa Health Research Institute, Durban, South Africa
| | - Stefan Kohler
- Heidelberg Institute of Global Health, Medical Faculty and University Hospital, Heidelberg University, Heidelberg, Germany
- Institute of Social Medicine, Epidemiology and Health Economics, Charité- Universitatsmedizin Berlin, Corporate Member of Freie Universitat Berlin and Humboldt-Universitat zu Berlin, Berlin, Germany
| |
Collapse
|
2
|
Vuong Q, Metcalfe RK, Ling A, Ackerman B, Inoue K, Park JJ. Systematic review of applied transportability and generalizability analyses: A landscape analysis. Ann Epidemiol 2025; 104:61-70. [PMID: 40064249 DOI: 10.1016/j.annepidem.2025.03.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2024] [Revised: 02/27/2025] [Accepted: 03/01/2025] [Indexed: 03/14/2025]
Abstract
Transportability and generalizability analysis are novel causal inference methods that quantitatively assess external validity. Currently, it is unclear how these analyses are applied in practice. To characterize applications and methods, we conducted a landscape analysis of applied transportability and generalizability analyses using a systematic literature search of PubMed, CINAHL and Embase supplemented with hand-searches. We identified 68 publications describing transportability and generalizability analyses conducted with 83 unique source-target dataset pairs and reporting 99 distinct analyses. The majority of source and target datasets were collected in the US (n = 63/83, 75.9 %; and n = 59/83, 71.1 %, respectively). These methods were most often applied to transport RCT findings to observational studies (n = 38/83; 45.8 %), or to another RCT (n = 20/83; 24.1 %). Several studies used transportability analysis outside the standard application, for example to identify effect modifiers or calibrate measurements within an RCT. Methods that used weights and individual-level patient data were most common (n = 56/99, 56.5 %; n = 80/83, 96.4 %, respectively). Reporting quality varied across studies. Transportability analysis has a wide range of applications including supporting decision-making by improving evidence relevance and improving trial design by identifying contextual effect modifiers and calibrating outcome measurements. Efforts are needed to standardize analysis and reporting of these methods to improve transparency and uptake.
Collapse
Affiliation(s)
- Quang Vuong
- Core Clinical Sciences, 509-2525 Willow Street, Vancouver, BC V5Z 3N8, Canada
| | - Rebecca K Metcalfe
- Core Clinical Sciences, 509-2525 Willow Street, Vancouver, BC V5Z 3N8, Canada; Centre for Advancing Health Outcomes, 570-1081 Burrard Street, St. Paul's Hospital, Vancouver, BC V6Z 1Y6, Canada
| | - Albee Ling
- Quantitative Sciences Unit, Stanford University School of Medicine, California, USA
| | - Benjamin Ackerman
- Janssen Research and Development, LLC, A Johnson and Johnson Company, 920 US Highway 202, Raritan, NJ 08869, USA
| | - Kosuke Inoue
- Department of Social Epidemiology, Graduate School of Medicine, Kyoto University, Sakyo Ward, Kyoto 606-8501, Japan
| | - Jay Jh Park
- Core Clinical Sciences, 509-2525 Willow Street, Vancouver, BC V5Z 3N8, Canada; Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, ON L8S 4L8, Canada.
| |
Collapse
|
3
|
Oyelese Y. Randomized controlled trials: not always the "gold standard" for evidence in obstetrics and gynecology. Am J Obstet Gynecol 2024; 230:417-425. [PMID: 37838101 DOI: 10.1016/j.ajog.2023.10.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 09/20/2023] [Accepted: 10/07/2023] [Indexed: 10/16/2023]
Abstract
Randomized controlled trials are considered the "gold standard" for therapeutic interventions, and it is not uncommon for sweeping changes in medical practice to follow positive results from such trials. However, randomized controlled trials are not without their limitations. Physicians frequently view randomized controlled trials as infallible, whereas they tend to dismiss evidence derived from sources other than randomized controlled trials as less credible or reliable. In several situations in obstetrics and gynecology, there are no randomized controlled trials to help guide the clinician. In these circumstances, it is important to evaluate the entire body of evidence including observational studies, rather than dismiss interventions altogether simply because no randomized controlled trials exist. Randomized controlled trials and observational studies should be viewed as complementary rather than at odds with each other. Some reversals in widely adopted clinical practice have recently been implemented following subsequent studies that contradicted the outcomes of major randomized controlled trials. The most notable of these was the withdrawal from the market of 17-hydroxyprogesterone caproate for preterm birth prevention. Such reversals could potentially have been averted if the inherent limitations of randomized controlled trials were carefully considered before implementing these universal practice changes. This Clinical Opinion underscores the limitations of an exclusive reliance on randomized controlled trials while disregarding other evidence in determining how best to care for patients. Solutions are proposed that advocate that clinicians adopt a more balanced perspective that considers the entirety of the available medical evidence and the individual patient characteristics, needs, and wishes.
Collapse
Affiliation(s)
- Yinka Oyelese
- Division of Maternal-Fetal Medicine, Department of Obstetrics and Gynecology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA; Maternal Fetal Care Center, Boston Children's Hospital, Harvard Medical School, Boston, MA.
| |
Collapse
|
4
|
Räikkönen K, Gissler M, Kajantie E, Tapiainen T. Antenatal corticosteroid treatment and infectious diseases in children: a nationwide observational study. THE LANCET REGIONAL HEALTH. EUROPE 2023; 35:100750. [PMID: 37860637 PMCID: PMC10583166 DOI: 10.1016/j.lanepe.2023.100750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 09/21/2023] [Accepted: 09/26/2023] [Indexed: 10/21/2023]
Abstract
Background Antenatal Corticosteroid Treatment (ACT) improves the outcome of preterm infants, but may influence immune system development and risk of immune-related diseases. We investigated whether ACT is associated with infectious diseases in children born at term (≥37 gestational weeks), and very-to-moderate (<34 gestational weeks), and late (34-36 completed gestational weeks) preterm. Methods All singleton live births in Finland between 01/01/2006 and 31/12/2021, were followed-up until 31/12/2021. Exposure was maternal ACT. Primary outcomes were numbers of inpatient treatment days, episodes, and specialized care outpatient visits with any infectious disease diagnoses between ages 0 and 4 years. We considered mother- and child-related covariates, and conducted term-born co-sibling comparisons. Findings Data comprised 855,234 children. Of the 20,858 (2.4%) treatment-exposed children, 5981 (28.2%) were very-to-moderate preterm-born, 5809 (27.9%) late preterm-born, and 9069 (43.5%) term-born. Of the 271,767 term-born co-sibling pairs, 5010 (1.8%) were treatment-exposure-discordant, and 266,522 (98.1%) nonexposure-concordant. Among the term- and late preterm-born, treatment-exposed children had more inpatient treatment days than nonexposed children (term: 0.87 vs. 0.56 day/y, adjusted mean difference [aMD] 0.19, 95% CI 0.17-0.28; late preterm: 1.35 vs. 1.00 days/y, aMD 0.31,0.13-0.31), more inpatient treatment episodes (term: 0.43 vs. 0.33 episodes/y, aMD 0.06, 0.06-0.11; late preterm: 0.55 vs. 0.48 episodes/y, aMD 0.12, 0.06-0.18), and specialized care treatment visits (term: 1.46 vs. 0.95 visits/y, aMD 0.38; 0.34-0.43; late preterm: 1.63 vs. 1.28 visits/y, aMD 0.22, 0.12-0.32). Treatment-exposed and nonexposed very-to-moderate preterm-born children were similar in these outcomes, though they had less inpatient treatment days and episodes at 3-4 years. Differences remained in term-born co-sibling comparisons. Interpretation These findings reinforce previous suggestions for careful consideration of risks and benefits of ACT. Funding Academy of Finland, HiLIFE Fellows-Programme.
Collapse
Affiliation(s)
- Katri Räikkönen
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Department of Obstetrics and Gynecology, Helsinki University Hospital, University of Helsinki, Helsinki, Finland
| | - Mika Gissler
- Department of Knowledge Brokers, THL Finnish Institute for Health and Welfare, Helsinki, Finland
- Research Centre for Child Psychiatry, University of Turku, Turku, Finland
- Department of Molecular Medicine and Surgery, Karolinska Institutet and Academic Primary Health Care Centre, Region Stockholm, Stockholm, Sweden
| | - Eero Kajantie
- Research Unit of Clinical Medicine, University of Oulu, Oulu, Finland
- Department of Public Health Solutions, THL Finnish Institute for Health and Welfare, Helsinki and Oulu, Finland
- Department of Clinical and Molecular Medicine, Norwegian University of Science and Technology, Trondheim, Norway
- Children's Hospital, Helsinki University Hospital, University of Helsinki, Helsinki, Finland
| | - Terhi Tapiainen
- Research Unit of Clinical Medicine, University of Oulu, Oulu, Finland
- Department of Pediatrics and Adolescent Medicine, Medical Research Center, Oulu University Hospital, Oulu, Finland
| |
Collapse
|
5
|
Liauw J, Foggin H, Socha P, Crane J, Joseph KS, Burrows J, Lacaze-Masmonteil T, Jain V, Boutin A, Hutcheon J. Technical Update No. 439: Antenatal Corticosteroids at Late Preterm Gestation. JOURNAL OF OBSTETRICS AND GYNAECOLOGY CANADA 2023; 45:445-457.e2. [PMID: 36572248 DOI: 10.1016/j.jogc.2022.12.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
OBJECTIVE To update recommendations for administration of antenatal corticosteroids in the late preterm period. TARGET POPULATION Pregnant individuals at risk of preterm birth from 340 to 366 weeks gestation. OPTIONS Administration or non-administration of a single course of antenatal corticosteroids at 340 to 366 weeks gestation. OUTCOMES Neonatal morbidity (respiratory distress, hypoglycemia), long-term neurodevelopment, and other long-term outcomes (growth, cardiac/metabolic, respiratory). BENEFITS, HARMS, AND COSTS Administration of antenatal corticosteroids from 340 to 366 weeks gestation decreases the risk of neonatal respiratory distress but increases the risk of neonatal hypoglycemia. The long-term impacts of antenatal corticosteroid administration from 340 to 366 weeks gestation are uncertain. EVIDENCE For evidence on the neonatal effects of antenatal corticosteroid administration at late preterm gestation, we summarized evidence from the 2020 Cochrane review of antenatal corticosteroids and combined this with evidence from published randomized trials identified by searching Ovid MEDLINE from January 1, 2020, to May 11, 2022. Given the absence of direct evidence on the impact of late preterm antenatal corticosteroid administration on neurodevelopmental outcomes, we summarized evidence on the impact of antenatal corticosteroids across gestational ages on neurodevelopmental outcomes using the following sources: (1) the 2020 Cochrane review; and (2) evidence obtained by searching Ovid MEDLINE, Embase, and Cochrane Central Register of Controlled Trials (CENTRAL) databases from inception to January 5, 2022. We did not apply date or language restrictions. Given the absence of direct evidence on the impact of late preterm antenatal corticosteroid administration on other long-term outcomes, we summarized evidence on the impact of antenatal corticosteroids across gestational ages on other long-term outcomes by combining findings from the 2020 Cochrane review with evidence obtained by searching Ovid MEDLINE for observational studies related to long-term cardiometabolic, respiratory, and growth effects of antenatal corticosteroids from inception to October 22, 2021. We reviewed reference lists of included studies and relevant systematic reviews for additional references. See Appendix A for search terms and summaries. VALIDATION METHODS The authors rated the quality of evidence and strength of recommendations using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. See online Appendix B (Tables B1 for definitions and B2 for interpretations of strong and conditional [weak] recommendations). INTENDED AUDIENCE Maternity care providers, including midwives, family physicians, and obstetricians. SUMMARY STATEMENTS RECOMMENDATIONS.
Collapse
|
6
|
Kajantie E. Point: Antenatal corticosteroid treatment in the late preterm period-Are the benefits worth the potential risks? Paediatr Perinat Epidemiol 2023; 37:12-14. [PMID: 36173009 PMCID: PMC10087592 DOI: 10.1111/ppe.12927] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Accepted: 09/11/2022] [Indexed: 02/01/2023]
Affiliation(s)
- Eero Kajantie
- Population Health Unit, Finnish Institute for Health and Welfare, Helsinki and Oulu, Finland.,Clinical Medicine Research Unit, MRC Oulu, University of Oulu and Oulu University Hospital, Oulu, Finland.,Department of Clinical and Molecular Medicine, Norwegian University of Science and Technology, Trondheim, Norway.,Children's Hospital, Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| |
Collapse
|
7
|
Hutcheon JA, Liauw J. Counterpoint: The value of benchmarking in observational studies of the longer term safety of antenatal corticosteroids. Paediatr Perinat Epidemiol 2023; 37:15-18. [PMID: 36482791 PMCID: PMC10107235 DOI: 10.1111/ppe.12937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 10/17/2022] [Accepted: 10/30/2022] [Indexed: 12/13/2022]
Affiliation(s)
- Jennifer A Hutcheon
- Department of Obstetrics and Gynaecology, University of British Columbia, British Columbia, Vancouver, Canada
| | - Jessica Liauw
- Department of Obstetrics and Gynaecology, University of British Columbia, British Columbia, Vancouver, Canada
| |
Collapse
|
8
|
Caniglia EC, Hinkle SN. Point: Benchmarking can supplement transportability to answer critical questions about the effectiveness of antenatal corticosteroid administration. Paediatr Perinat Epidemiol 2023; 37:9-11. [PMID: 35988915 DOI: 10.1111/ppe.12923] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 08/08/2022] [Indexed: 02/01/2023]
Affiliation(s)
- Ellen C Caniglia
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - Stefanie N Hinkle
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| |
Collapse
|
9
|
Mise à jour technique no 439 : Corticothérapie prénatale en période de prématurité tardive. JOURNAL OF OBSTETRICS AND GYNAECOLOGY CANADA 2022; 45:458-472.e2. [PMID: 36572247 DOI: 10.1016/j.jogc.2022.12.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|