1
|
Walker LE, Pirmohamed M. The status of drug evaluation in older adults in the United Kingdom: Bridging the representation gap. J Am Geriatr Soc 2024. [PMID: 38393834 DOI: 10.1111/jgs.18817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 01/22/2024] [Accepted: 01/29/2024] [Indexed: 02/25/2024]
Abstract
Older adults are persistently underrepresented in clinical drug trials worldwide, despite increasing multiple long-term conditions and significant prescribing in this demographic. We discuss systemic challenges such as the exclusion of people with comorbid conditions and the lack of assessment for comorbidities as modifiers of treatment effects and highlight the rising trend of polypharmacy, especially among the oldest age groups, which is linked to a significant percentage of unplanned hospitalizations and medication errors. The consequences of these trends prompted the United Kingdom National Overprescribing review, culminating in a set of recommendations for drug development tailored to older adults. Building on this, two critical reports released in April 2023 by the International Longevity Centre (ILC) and the Nuffield Council on Bioethics (NCOB) are discussed. These reports emphasize the importance of diversity and inclusion in clinical trials, advocating for ethical frameworks and methodologies that cater to the complex needs of older adults. The development of inclusive criteria, innovative statistical methodologies, and the integration of patient-reported outcomes are needed to address the persistent barriers to older adult participation in research, suggesting that pragmatic trials, exemplified by the UK's RECOVERY trial during the COVID-19 pandemic, could pave the way for more inclusive research practices.
Collapse
Affiliation(s)
- Lauren E Walker
- The Wolfson Centre for Personalised Medicine, University of Liverpool, Liverpool, UK
- Liverpool University Hospitals NHS Foundation Trust, Liverpool, UK
| | - Munir Pirmohamed
- The Wolfson Centre for Personalised Medicine, University of Liverpool, Liverpool, UK
- Liverpool University Hospitals NHS Foundation Trust, Liverpool, UK
| |
Collapse
|
2
|
Kurki S, Halla-Aho V, Haussmann M, Lähdesmäki H, Leinonen JV, Koskinen M. A comparative study of clinical trial and real-world data in patients with diabetic kidney disease. Sci Rep 2024; 14:1731. [PMID: 38243002 PMCID: PMC10798981 DOI: 10.1038/s41598-024-51938-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 01/11/2024] [Indexed: 01/21/2024] Open
Abstract
A growing body of research is focusing on real-world data (RWD) to supplement or replace randomized controlled trials (RCTs). However, due to the disparities in data generation mechanisms, differences are likely and necessitate scrutiny to validate the merging of these datasets. We compared the characteristics of RCT data from 5734 diabetic kidney disease patients with corresponding RWD from electronic health records (EHRs) of 23,523 patients. Demographics, diagnoses, medications, laboratory measurements, and vital signs were analyzed using visualization, statistical comparison, and cluster analysis. RCT and RWD sets exhibited significant differences in prevalence, longitudinality, completeness, and sampling density. The cluster analysis revealed distinct patient subgroups within both RCT and RWD sets, as well as clusters containing patients from both sets. We stress the importance of validation to verify the feasibility of combining RCT and RWD, for instance, in building an external control arm. Our results highlight general differences between RCT and RWD sets, which should be considered during the planning stages of an RCT-RWD study. If they are, RWD has the potential to enrich RCT data by providing first-hand baseline data, filling in missing data or by subgrouping or matching individuals, which calls for advanced methods to mitigate the differences between datasets.
Collapse
Affiliation(s)
- Samu Kurki
- Bayer Oy, Tuulikuja 2, 02100, Espoo, Finland.
| | | | - Manuel Haussmann
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Harri Lähdesmäki
- Department of Computer Science, Aalto University, Espoo, Finland
| | | | | |
Collapse
|
3
|
Hansford HJ, Cashin AG, Jones MD, Swanson SA, Islam N, Douglas SRG, Rizzo RRN, Devonshire JJ, Williams SA, Dahabreh IJ, Dickerman BA, Egger M, Garcia-Albeniz X, Golub RM, Lodi S, Moreno-Betancur M, Pearson SA, Schneeweiss S, Sterne JAC, Sharp MK, Stuart EA, Hernán MA, Lee H, McAuley JH. Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review. JAMA Netw Open 2023; 6:e2336023. [PMID: 37755828 PMCID: PMC10534275 DOI: 10.1001/jamanetworkopen.2023.36023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 08/22/2023] [Indexed: 09/28/2023] Open
Abstract
Importance Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.
Collapse
Affiliation(s)
- Harrison J. Hansford
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Aidan G. Cashin
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Matthew D. Jones
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sonja A. Swanson
- Department of Epidemiology, University of Pittsburgh, Pittsburgh, Pennsylvania
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Nazrul Islam
- Oxford Population Health, Big Data Institute, University of Oxford, Oxford, United Kingdom
- Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Susan R. G. Douglas
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
| | - Rodrigo R. N. Rizzo
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Jack J. Devonshire
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sam A. Williams
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Issa J. Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Barbra A. Dickerman
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Matthias Egger
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Centre for Infectious Disease Epidemiology and Research, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Xabier Garcia-Albeniz
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- RTI Health Solutions, Barcelona, Spain
| | - Robert M. Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Sara Lodi
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts
| | - Margarita Moreno-Betancur
- Clinical Epidemiology & Biostatistics Unit, Murdoch Children’s Research Institute, Royal Children’s Hospital, Parkville, Victoria, Australia
- Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Sallie-Anne Pearson
- School of Population Health, Faculty of Medicine and Health, UNSW Sydney, New South Wales, Australia
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology, Department of Medicine, Brigham & Women’s Hospital, Harvard Medical School, Boston, Massachusetts
| | - Jonathan A. C. Sterne
- Department of Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
- Health Data Research UK South-West, Bristol, United Kingdom
| | - Melissa K. Sharp
- Department of Public Health and Epidemiology, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Elizabeth A. Stuart
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Miguel A. Hernán
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Hopin Lee
- University of Exeter Medical School, Exeter, United Kingdom
| | - James H. McAuley
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| |
Collapse
|
4
|
Scola G, Chis Ster A, Bean D, Pareek N, Emsley R, Landau S. Implementation of the trial emulation approach in medical research: a scoping review. BMC Med Res Methodol 2023; 23:186. [PMID: 37587484 PMCID: PMC10428565 DOI: 10.1186/s12874-023-02000-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 07/25/2023] [Indexed: 08/18/2023] Open
Abstract
BACKGROUND When conducting randomised controlled trials is impractical, an alternative is to carry out an observational study. However, making valid causal inferences from observational data is challenging because of the risk of several statistical biases. In 2016 Hernán and Robins put forward the 'target trial framework' as a guide to best design and analyse observational studies whilst preventing the most common biases. This framework consists of (1) clearly defining a causal question about an intervention, (2) specifying the protocol of the hypothetical trial, and (3) explaining how the observational data will be used to emulate it. METHODS The aim of this scoping review was to identify and review all explicit attempts of trial emulation studies across all medical fields. Embase, Medline and Web of Science were searched for trial emulation studies published in English from database inception to February 25, 2021. The following information was extracted from studies that were deemed eligible for review: the subject area, the type of observational data that they leveraged, and the statistical methods they used to address the following biases: (A) confounding bias, (B) immortal time bias, and (C) selection bias. RESULTS The search resulted in 617 studies, 38 of which we deemed eligible for review. Of those 38 studies, most focused on cardiology, infectious diseases or oncology and the majority used electronic health records/electronic medical records data and cohort studies data. Different statistical methods were used to address confounding at baseline and selection bias, predominantly conditioning on the confounders (N = 18/49, 37%) and inverse probability of censoring weighting (N = 7/20, 35%) respectively. Different approaches were used to address immortal time bias, assigning individuals to treatment strategies at start of follow-up based on their data available at that specific time (N = 21, 55%), using the sequential trial emulations approach (N = 11, 29%) or the cloning approach (N = 6, 16%). CONCLUSION Different methods can be leveraged to address (A) confounding bias, (B) immortal time bias, and (C) selection bias. When working with observational data, and if possible, the 'target trial' framework should be used as it provides a structured conceptual approach to observational research.
Collapse
Affiliation(s)
- Giulio Scola
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK.
| | - Anca Chis Ster
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Daniel Bean
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
- Health Data Research UK London, Institute of Health Informatics, University College London, London, UK
| | - Nilesh Pareek
- King's College Hospital NHS Foundation Trust, London, UK
- School of Cardiovascular and Metabolic Medicine & Sciences, BHF Centre of Excellence, King's College London, London, UK
| | - Richard Emsley
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Sabine Landau
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| |
Collapse
|
5
|
Betts M, Fahrbach K, Neupane B, Slim M, Sormani MP, Cutter G, Debray TPA, Rock M. Handling related publications reporting real-world evidence in network meta-analysis: a case study in multiple sclerosis. J Comp Eff Res 2023; 12:e220132. [PMID: 37515491 PMCID: PMC10508334 DOI: 10.57264/cer-2022-0132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 07/04/2023] [Indexed: 07/31/2023] Open
Abstract
Aim: The presence of two or more publications that report on overlapping patient cohorts poses a challenge for quantitatively synthesizing real-world evidence (RWE) studies. Thus, we evaluated eight approaches for handling such related publications in network meta-analyses (NMA) of RWE studies. Methods: Bayesian NMAs were conducted to estimate the annualized relapse rate (ARR) of disease-modifying therapies in multiple sclerosis. The NMA explored the impact of hierarchically selecting one pivotal study from related publications versus including all of them while adjusting for correlations. Results: When selecting one pivotal study from related publications, the ARR ratios were mostly similar regardless of the pivotal study selected. When including all related publications, there were shifts in the point estimates and the statistical significance. Conclusion: An a priori hierarchy should guide the selection among related publications in NMAs of RWE. Sensitivity analyses modifying the hierarchy should be considered for networks with few or small studies.
Collapse
Affiliation(s)
| | | | | | | | | | - Gary Cutter
- University of Alabama at Birmingham, School of Public Health, Birmingham, AL, USA
| | - Thomas PA Debray
- Unversity Medical Center Utrecht, Utrecht, The Netherlands
- Smart Data Analysis & Statistics B.V., Utrecht, The Netherlands
| | | |
Collapse
|
6
|
Shi X, Pan Z, Miao W. Data Integration in Causal Inference. WILEY INTERDISCIPLINARY REVIEWS. COMPUTATIONAL STATISTICS 2023; 15:e1581. [PMID: 36713955 PMCID: PMC9880960 DOI: 10.1002/wics.1581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 02/24/2022] [Accepted: 03/01/2022] [Indexed: 04/12/2023]
Abstract
Integrating data from multiple heterogeneous sources has become increasingly popular to achieve a large sample size and diverse study population. This paper reviews development in causal inference methods that combines multiple datasets collected by potentially different designs from potentially heterogeneous populations. We summarize recent advances on combining randomized clinical trial with external information from observational studies or historical controls, combining samples when no single sample has all relevant variables with application to two-sample Mendelian randomization, distributed data setting under privacy concerns for comparative effectiveness and safety research using real-world data, Bayesian causal inference, and causal discovery methods.
Collapse
Affiliation(s)
- Xu Shi
- Department of BiostatisticsUniversity of MichiganAnn ArborMichiganUSA
| | - Ziyang Pan
- Department of BiostatisticsUniversity of MichiganAnn ArborMichiganUSA
| | - Wang Miao
- Department of Probability and StatisticsPeking UniversityBeijingChina
| |
Collapse
|
7
|
Bakker E, Plueschke K, Jonker CJ, Kurz X, Starokozhko V, Mol PGM. Contribution of Real-World Evidence in European Medicines Agency's Regulatory Decision Making. Clin Pharmacol Ther 2023; 113:135-151. [PMID: 36254408 PMCID: PMC10099093 DOI: 10.1002/cpt.2766] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Accepted: 10/10/2022] [Indexed: 12/31/2022]
Abstract
Real-world data/evidence (RWD/RWE) may provide insightful information on medicines' clinical effects to guide regulatory decisions. While its contribution has been recognized for safety monitoring and disease epidemiology across medicines' life cycles, using RWD/RWE to demonstrate efficacy requires further evaluation. This study aimed to (i) characterize RWD/RWE presented by applicants to support claims on medicines' efficacy within initial marketing authorization applications (MAAs) and extension of indication applications (EoIs), and (ii) analyze the contribution of RWD/RWE to regulatory decisions on medicines' benefit-risk profile. RWD/RWE was included to support efficacy in 32 MAAs and 14 EoIs submitted 2018-2019. Of these, RWD/RWE was part of the preauthorization package of 16 MAAs and 10 EoIs, and was (i) considered supporting the regulatory decision in 10 applications (five MAAs, five EoIs), (ii) considered not supporting the regulatory decision in 11 (seven MAAs, four EoIs), and (iii) not addressed at all in the evaluation of 5 applications (four MAAs, one EoI). Common limitations of submitted RWD/RWE included missing data, lack of representativeness of populations, small sample size, absence of an adequate or prespecified analysis plan, and risk of several types of bias. The suitability of RWD/RWE in a given application still requires a case-by-case analysis considering its purpose of use, implying reflection on the data source, together with its assets and limitations, study objectives and designs, and the overall data package issued. Early interactions and continuous dialogues with regulators and relevant stakeholders is key to optimize fit-for-purpose RWE generation, enabling its broader use in medicines development.
Collapse
Affiliation(s)
- Elisabeth Bakker
- Department of Clinical Pharmacy and Pharmacology, University Medical Centre Groningen, University of Groningen, Groningen, The Netherlands
| | - Kelly Plueschke
- Data Analytics and Methods Task Force, European Medicines Agency, Amsterdam, The Netherlands
| | - Carla J Jonker
- Data Analytics and Methods Task Force, European Medicines Agency, Amsterdam, The Netherlands.,Dutch Medicines Evaluation Board (MEB), Utrecht, The Netherlands
| | - Xavier Kurz
- Data Analytics and Methods Task Force, European Medicines Agency, Amsterdam, The Netherlands
| | - Viktoriia Starokozhko
- Department of Clinical Pharmacy and Pharmacology, University Medical Centre Groningen, University of Groningen, Groningen, The Netherlands.,Dutch Medicines Evaluation Board (MEB), Utrecht, The Netherlands
| | - Peter G M Mol
- Department of Clinical Pharmacy and Pharmacology, University Medical Centre Groningen, University of Groningen, Groningen, The Netherlands.,Dutch Medicines Evaluation Board (MEB), Utrecht, The Netherlands.,Scientific Advice Working Party of the European Medicines Agency, Amsterdam, The Netherlands
| |
Collapse
|
8
|
Carrigan G, Bradbury BD, Brookhart MA, Capra WB, Chia V, Rothman KJ, Sarsour K, Taylor MD, Brown JS. External Comparator Groups Derived from Real-world Data Used in Support of Regulatory Decision Making: Use Cases and Challenges. CURR EPIDEMIOL REP 2022. [DOI: 10.1007/s40471-022-00305-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Abstract
Real-world data (RWD) from electronic health records (EHRs) and administrative claims databases are used increasingly to generate real-world evidence (RWE). RWE is used to support clinical evidence packages for medicines that inform decision-makers. In this review of current issues in the use of RWD-derived external comparator groups to support regulatory filings, we assess a series of topics that generally apply across many disease indications. However, most of the examples and illustrations focus on the oncology clinical research setting. The topics include an overview of current uses of RWD in drug development, a discussion of regulatory filings using RWD-derived external comparators, a brief overview of guidance documents and white papers pertaining to external comparators, a summary of some limitations and methodological issues in the use of external comparator groups and finally, a look at the future of this area and recommendations.
Collapse
|
9
|
Abstract
Randomized controlled trials (RCTs) are the gold standard design to establish the efficacy of new drugs and to support regulatory decision making. However, a marked increase in the submission of single-arm trials (SATs) has been observed in recent years, especially in the field of oncology due to the trend towards precision medicine contributing to the rise of new therapeutic interventions for rare diseases. SATs lack results for control patients, and information from external sources can be compiled to provide context for better interpretability of study results. External comparator arm (ECA) studies are defined as a clinical trial (most commonly a SAT) and an ECA of a comparable cohort of patients-commonly derived from real-world settings including registries, natural history studies, or medical records of routine care. This publication aims to provide a methodological overview, to sketch emergent best practice recommendations and to identify future methodological research topics. Specifically, existing scientific and regulatory guidance for ECA studies is reviewed and appropriate causal inference methods are discussed. Further topics include sample size considerations, use of estimands, handling of different data sources regarding differential baseline covariate definitions, differential endpoint measurements and timings. In addition, unique features of ECA studies are highlighted, specifically the opportunity to address bias caused by unmeasured ECA covariates, which are available in the SAT.
Collapse
|
10
|
Azoulay L. Rationale, Strengths, and Limitations of Real-World Evidence in Oncology: A Canadian Review and Perspective. Oncologist 2022; 27:e731-e738. [PMID: 35762676 PMCID: PMC9438907 DOI: 10.1093/oncolo/oyac114] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 04/26/2022] [Indexed: 11/14/2022] Open
Abstract
Randomized controlled trials (RCTs) continue to be the basis for essential evidence regarding the efficacy of interventions such as cancer therapies. Limitations associated with RCT designs, including selective study populations, strict treatment regimens, and being time-limited, mean they do not provide complete information about an intervention’s safety or the applicability of the trial’s results to a wider range of patients seen in real-world clinical practice. For example, recent data from Alberta showed that almost 40% of patients in the province’s cancer registry would be trial-ineligible per common exclusion criteria. Real-world evidence (RWE) offers an opportunity to complement the RCT evidence base with this kind of information about safety and about use in wider patient populations. It is also increasingly recognized for being able to provide information about an intervention’s effectiveness and is considered by regulators as an important component of the evidence base in drug approvals. Here, we examine the limitations of RCTs in oncology research, review the different types of RWE available in this area, and discuss the strengths and limitations of RWE for complementing RCT oncology data.
Collapse
Affiliation(s)
- Laurent Azoulay
- Centre for Clinical Epidemiology, Lady Davis Institute, Jewish General Hospital, Montréal, Québec, Canada.,Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Montréal, Québec, Canada.,Gerald Bronfman Department of Oncology, McGill University, Montréal, Québec, Canada
| |
Collapse
|
11
|
Yap TA, Jacobs I, Baumfeld Andre E, Lee LJ, Beaupre D, Azoulay L. Application of Real-World Data to External Control Groups in Oncology Clinical Trial Drug Development. Front Oncol 2022; 11:695936. [PMID: 35070951 PMCID: PMC8771908 DOI: 10.3389/fonc.2021.695936] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Accepted: 12/10/2021] [Indexed: 11/13/2022] Open
Abstract
Randomized controlled trials (RCTs) that assess overall survival are considered the "gold standard" when evaluating the efficacy and safety of a new oncology intervention. However, single-arm trials that use surrogate endpoints (e.g., objective response rate or duration of response) to evaluate clinical benefit have become the basis for accelerated or breakthrough regulatory approval of precision oncology drugs for cases where the target and research populations are relatively small. Interpretation of efficacy in single-arm trials can be challenging because such studies lack a standard-of-care comparator arm. Although an external control group can be based on data from other clinical trials, using an external control group based on data collected outside of a trial may not only offer an alternative to both RCTs and uncontrolled single-arm trials, but it may also help improve decision-making by study sponsors or regulatory authorities. Hence, leveraging real-world data (RWD) to construct external control arms in clinical trials that investigate the efficacy and safety of drug interventions in oncology has become a topic of interest. Herein, we review the benefits and challenges associated with the use of RWD to construct external control groups, and the relevance of RWD to early oncology drug development.
Collapse
Affiliation(s)
- Timothy A. Yap
- Department of Investigational Cancer Therapeutics (Phase I Program), Division of Cancer Medicine, the University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Ira Jacobs
- Pfizer Inc., New York, NY, United States
| | | | | | | | - Laurent Azoulay
- Centre for Clinical Epidemiology Lady Davis Institute, Jewish General Hospital, Montreal, QC, Canada
- Department of Epidemiology, Biostatistics, and Occupational Health and Gerald Bronfman Department of Oncology, McGill University, Montreal, QC, Canada
| |
Collapse
|
12
|
Dagenais S, Russo L, Madsen A, Webster J, Becnel L. Use of Real-World Evidence to Drive Drug Development Strategy and Inform Clinical Trial Design. Clin Pharmacol Ther 2022; 111:77-89. [PMID: 34839524 PMCID: PMC9299990 DOI: 10.1002/cpt.2480] [Citation(s) in RCA: 36] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Accepted: 10/30/2021] [Indexed: 12/28/2022]
Abstract
Interest in real-world data (RWD) and real-world evidence (RWE) to expedite and enrich the development of new biopharmaceutical products has proliferated in recent years, spurred by the 21st Century Cures Act in the United States and similar policy efforts in other countries, willingness by regulators to consider RWE in their decisions, demands from third-party payers, and growing concerns about the limitations of traditional clinical trials. Although much of the recent literature on RWE has focused on potential regulatory uses (e.g., product approvals in oncology or rare diseases based on single-arm trials with external control arms), this article reviews how biopharmaceutical companies can leverage RWE to inform internal decisions made throughout the product development process. Specifically, this article will review use of RWD to guide pipeline and portfolio strategy; use of novel sources of RWD to inform product development, use of RWD to inform clinical development, use of advanced analytics to harness "big" RWD, and considerations when using RWD to inform internal decisions. Topics discussed will include the use of molecular, clinicogenomic, medical imaging, radiomic, and patient-derived xenograft data to augment traditional sources of RWE, the use of RWD to inform clinical trial eligibility criteria, enrich trial population based on predicted response, select endpoints, estimate sample size, understand disease progression, and enhance diversity of participants, the growing use of data tokenization and advanced analytical techniques based on artificial intelligence in RWE, as well as the importance of data quality and methodological transparency in RWE.
Collapse
Affiliation(s)
| | - Leo Russo
- Global Medical Epidemiology, Worldwide Medical and SafetyPfizer IncCollegevillePennsylvaniaUSA
| | - Ann Madsen
- Global Medical Epidemiology, Worldwide Medical and SafetyPfizer IncNew YorkNew YorkUSA
| | - Jen Webster
- Real World EvidencePfizer IncNew YorkNew YorkUSA
| | | |
Collapse
|
13
|
Rahman R, Ventz S, McDunn J, Louv B, Reyes-Rivera I, Polley MYC, Merchant F, Abrey LE, Allen JE, Aguilar LK, Aguilar-Cordova E, Arons D, Tanner K, Bagley S, Khasraw M, Cloughesy T, Wen PY, Alexander BM, Trippa L. Leveraging external data in the design and analysis of clinical trials in neuro-oncology. Lancet Oncol 2021; 22:e456-e465. [PMID: 34592195 PMCID: PMC8893120 DOI: 10.1016/s1470-2045(21)00488-5] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 08/11/2021] [Accepted: 08/12/2021] [Indexed: 01/20/2023]
Abstract
Integration of external control data, with patient-level information, in clinical trials has the potential to accelerate the development of new treatments in neuro-oncology by contextualising single-arm studies and improving decision making (eg, early stopping decisions). Based on a series of presentations at the 2020 Clinical Trials Think Tank hosted by the Society of Neuro-Oncology, we provide an overview on the use of external control data representative of the standard of care in the design and analysis of clinical trials. High-quality patient-level records, rigorous methods, and validation analyses are necessary to effectively leverage external data. We review study designs, statistical methods, risks, and potential distortions in using external data from completed trials and real-world data, as well as data sources, data sharing models, ongoing work, and applications in glioblastoma.
Collapse
Affiliation(s)
- Rifaquat Rahman
- Department of Radiation Oncology, Dana-Farber/Brigham and Women's Cancer Center, Harvard Medical School, Boston, MA, USA.
| | - Steffen Ventz
- Department of Data Sciences, Dana-Farber Cancer Institute, Harvard T H Chan School of Public Health, Boston, MA, USA
| | - Jon McDunn
- Project Data Sphere, Morrisville, NC, USA
| | - Bill Louv
- Project Data Sphere, Morrisville, NC, USA
| | | | - Mei-Yin C Polley
- Department of Public Health Sciences, University of Chicago, Chicago, IL, USA
| | | | | | | | | | | | - David Arons
- National Brain Tumor Society, Newton, MA, USA
| | - Kirk Tanner
- National Brain Tumor Society, Newton, MA, USA
| | - Stephen Bagley
- Division of Hematology and Oncology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Mustafa Khasraw
- Department of Neurosurgery, Preston Robert Tisch Brain Tumor Center, Duke University Medical Center, Durham, NC, USA
| | - Timothy Cloughesy
- Department of Neurology, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Patrick Y Wen
- Center for Neuro-Oncology, Dana-Farber Cancer Institute, Harvard T H Chan School of Public Health, Boston, MA, USA
| | - Brian M Alexander
- Department of Radiation Oncology, Dana-Farber/Brigham and Women's Cancer Center, Harvard Medical School, Boston, MA, USA; Foundation Medicine, Cambridge, MA, USA
| | - Lorenzo Trippa
- Department of Data Sciences, Dana-Farber Cancer Institute, Harvard T H Chan School of Public Health, Boston, MA, USA
| |
Collapse
|
14
|
Honig PK. Real-World Evidence and the Regulation of Medicines. Clin Pharmacol Ther 2021; 109:1169-1172. [PMID: 33870489 DOI: 10.1002/cpt.2230] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Accepted: 03/05/2021] [Indexed: 12/11/2022]
|