1
|
Baldwin FD, Khalaf RKS, Kolamunnage-Dona R, Jorgensen AL. Methodologies for the Emulation of Biomarker-Guided Trials Using Observational Data: A Systematic Review. J Pers Med 2025; 15:195. [PMID: 40423066 DOI: 10.3390/jpm15050195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2025] [Revised: 04/25/2025] [Accepted: 05/01/2025] [Indexed: 05/28/2025] Open
Abstract
Background: Target trial emulation involves the application of design principles from randomised controlled trials (RCTs) to observational data, and is particularly useful in situations where an RCT would be unfeasible. Biomarker-guided trials, which incorporate biomarkers within their design to either guide treatment and/or determine eligibility, are often unfeasible in practice due to sample size requirements or ethical concerns. Here, we undertake a systematic review of methodologies used in target trial emulations, comparing treatment effectiveness, critically appraising them, and considering their applicability to the emulation of biomarker-guided trials. Methods: A comprehensive search strategy was developed to identify studies reporting on methods for target trial emulation comparing the effectiveness of treatments using observational data, and applied to the following bibliographic databases: PubMed, Scopus, Web of Science, and Ovid MEDLINE. A narrative description of methods identified in the review was undertaken alongside a critique of their relative strengths and limitations. Results: We identified a total of 59 papers: 47 emulating a target trial ('application' studies), and 12 detailing methods to emulate a target trial ('methods' studies). A total of 25 papers were identified as emulating a biomarker-guided trial (42%). While all papers reported methods to adjust for baseline confounding, 40% of application papers did not specify methods to adjust for time-varying confounding. Conclusions: This systematic review has identified a range of methods used to control for baseline, time-varying, and residual/unmeasured confounding within target trial emulation and provides a guide for researchers interested in emulation of biomarker-guided trials.
Collapse
Affiliation(s)
- Faye D Baldwin
- Department of Health Data Science, University of Liverpool, Liverpool L69 3GL, UK
| | - Rukun K S Khalaf
- Department of Public Health, Policy and Systems, University of Liverpool, Liverpool L69 3GL, UK
| | | | - Andrea L Jorgensen
- Department of Health Data Science, University of Liverpool, Liverpool L69 3GL, UK
| |
Collapse
|
2
|
Zuo H, Yu L, Campbell SM, Yamamoto SS, Yuan Y. The implementation of target trial emulation for causal inference: a scoping review. J Clin Epidemiol 2023; 162:29-37. [PMID: 37562726 DOI: 10.1016/j.jclinepi.2023.08.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 07/25/2023] [Accepted: 08/02/2023] [Indexed: 08/12/2023]
Abstract
OBJECTIVES We aim to investigate the implementation of Target Trial Emulation (TTE) for causal inference, involving research topics, frequently used strategies, and issues indicating the need for future improvements. STUDY DESIGN AND SETTING We performed a scoping review by following the Joanna Briggs Institute (JBI) guidance and Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist. A health research-focused librarian searched multiple medical databases, and two independent reviewers completed screening and extraction within covidence review management software. RESULTS Our search resulted in 1,240 papers, of which 96 papers were eligible for data extraction. Results show a significant increase in the use of TTE in 2018 and 2021. The study topics varied and focused primarily on cancer, cardiovascular and cerebrovascular diseases, and infectious diseases. However, not all papers specified well all three critical components for generating robust causal evidence: time-zero, random assignment simulation, and comparison strategy. Some common issues were observed from retrieved papers, and key limitations include residual confounding, limited generalizability, and a lack of reporting guidance that need to be improved. CONCLUSION Uneven adherence to the TTE framework exists, and future improvements are needed to progress applications using causal inference with observational data.
Collapse
Affiliation(s)
- Hanxiao Zuo
- School of Public Health, University of Alberta, Edmonton, Alberta T6G 1C9, Canada.
| | - Lin Yu
- School of Public Health, University of Alberta, Edmonton, Alberta T6G 1C9, Canada
| | - Sandra M Campbell
- John W. Scott Health Sciences Library, University of Alberta, Edmonton, Alberta T6G 2R7, Canada
| | - Shelby S Yamamoto
- School of Public Health, University of Alberta, Edmonton, Alberta T6G 1C9, Canada
| | - Yan Yuan
- School of Public Health, University of Alberta, Edmonton, Alberta T6G 1C9, Canada
| |
Collapse
|
3
|
Hansford HJ, Cashin AG, Jones MD, Swanson SA, Islam N, Douglas SRG, Rizzo RRN, Devonshire JJ, Williams SA, Dahabreh IJ, Dickerman BA, Egger M, Garcia-Albeniz X, Golub RM, Lodi S, Moreno-Betancur M, Pearson SA, Schneeweiss S, Sterne JAC, Sharp MK, Stuart EA, Hernán MA, Lee H, McAuley JH. Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review. JAMA Netw Open 2023; 6:e2336023. [PMID: 37755828 PMCID: PMC10534275 DOI: 10.1001/jamanetworkopen.2023.36023] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 08/22/2023] [Indexed: 09/28/2023] Open
Abstract
Importance Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.
Collapse
Affiliation(s)
- Harrison J. Hansford
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Aidan G. Cashin
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Matthew D. Jones
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sonja A. Swanson
- Department of Epidemiology, University of Pittsburgh, Pittsburgh, Pennsylvania
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Nazrul Islam
- Oxford Population Health, Big Data Institute, University of Oxford, Oxford, United Kingdom
- Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Susan R. G. Douglas
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
| | - Rodrigo R. N. Rizzo
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Jack J. Devonshire
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sam A. Williams
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Issa J. Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Barbra A. Dickerman
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Matthias Egger
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Centre for Infectious Disease Epidemiology and Research, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Xabier Garcia-Albeniz
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- RTI Health Solutions, Barcelona, Spain
| | - Robert M. Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Sara Lodi
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts
| | - Margarita Moreno-Betancur
- Clinical Epidemiology & Biostatistics Unit, Murdoch Children’s Research Institute, Royal Children’s Hospital, Parkville, Victoria, Australia
- Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Sallie-Anne Pearson
- School of Population Health, Faculty of Medicine and Health, UNSW Sydney, New South Wales, Australia
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology, Department of Medicine, Brigham & Women’s Hospital, Harvard Medical School, Boston, Massachusetts
| | - Jonathan A. C. Sterne
- Department of Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
- Health Data Research UK South-West, Bristol, United Kingdom
| | - Melissa K. Sharp
- Department of Public Health and Epidemiology, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Elizabeth A. Stuart
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Miguel A. Hernán
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Hopin Lee
- University of Exeter Medical School, Exeter, United Kingdom
| | - James H. McAuley
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| |
Collapse
|