1
|
Levy NS, Arena PJ, Jemielita T, Mt-Isa S, McElwee S, Lenis D, Campbell UB, Jaksa A, Hair GM. Use of transportability methods for real-world evidence generation: a review of current applications. J Comp Eff Res 2024; 13:e240064. [PMID: 39364567 PMCID: PMC11542082 DOI: 10.57264/cer-2024-0064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Accepted: 09/06/2024] [Indexed: 10/05/2024] Open
Abstract
Aim: To evaluate how transportability methods are currently used for real-world evidence (RWE) generation to inform good practices and support adoption and acceptance of these methods in the RWE context. Methods: We conducted a targeted literature review to identify studies that transported an effect estimate of the clinical effectiveness or safety of a biomedical exposure to a target real-world population. Records were identified from PubMed-indexed articles published any time before 25 July 2023 (inclusive). Two reviewers screened abstracts/titles and reviewed the full text of candidate studies to identify the final set of articles. Data on the therapeutic area, exposure(s), outcome(s), original and target populations and details of the transportability analysis (e.g., analytic method used, estimate transported, stated assumptions) were abstracted from each article. Results: Of 458 unique records identified, six were retained in the final review. Articles were published during 2021-2023, focused on the US/Canada context, and covered a range of therapeutic areas. Four studies transported an RCT effect estimate, while two transported effect estimates derived from real-world data. Almost all articles used weighting methods to transport estimates. Two studies discussed all transportability assumptions, and one evaluated the likelihood of meeting all assumptions and the impact of potential violations. Conclusion: The use of transportability methods for RWE generation is an emerging and promising area of research to address evidence gaps in settings with limited data and infrastructure. More transparent and rigorous reporting of methods, assumptions and limitations may increase the use and acceptability of transportability for producing robust evidence on treatment effectiveness and safety.
Collapse
Affiliation(s)
- Natalie S Levy
- Scientific Research & Strategy, Aetion, Inc., New York, NY 10001, USA
| | - Patrick J Arena
- Scientific Research & Strategy, Aetion, Inc., Boston, MA 02109, USA
| | - Thomas Jemielita
- Biostatistics & Research Decision Sciences (BARDS), Merck Research Laboratories, Merck & Co., Inc., Rahway, NJ 07065, USA
| | - Shahrul Mt-Isa
- Biostatistics & Research Decision Sciences (BARDS), MSD Innovation & Development Hub GmbH, Merck Sharp & Dohme, Zürich, 8058, Switzerland
| | - Shane McElwee
- Science & Delivery, Aetion, Inc., New York, NY10001, USA
| | - David Lenis
- Scientific Research & Strategy, Aetion, Inc., New York, NY 10001, USA
| | - Ulka B Campbell
- Scientific Research & Strategy, Aetion, Inc., New York, NY 10001, USA
- Department of Epidemiology, Columbia University Mailman School of Public Health, New York, NY 10032, USA
| | - Ashley Jaksa
- Scientific Research & Strategy, Aetion, Inc., Boston, MA 02109, USA
| | - Gleicy M Hair
- Center for Observational & Real-World Evidence (CORE), Merck Research Laboratories, Merck & Co., Inc., Rahway, NJ 07065, USA
| |
Collapse
|
2
|
Lun R, Zitikyte G, Yogendrakumar V, Bereznyakova O, Dewar B, Dowlatshahi D, Fahed R, Shamy M. Network meta-analysis can inform the ethical evaluation of trials that randomise away from standard of care: The case of symptomatic carotid stenosis. J Eval Clin Pract 2024; 30:376-384. [PMID: 38059277 DOI: 10.1111/jep.13951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 09/27/2023] [Accepted: 10/19/2023] [Indexed: 12/08/2023]
Abstract
OBJECTIVE Little guidance exists on the conduct of randomised clinical trials (RCT) that seek to randomise patients away from standard of care. We sought to test the technique of network meta-analysis (NMA) to ascertain best available evidence for the purposes of informing the ethical evaluation of RCTs under these circumstances. We used the example of RCTs for patients with symptomatic, moderate to severe carotid stenosis that seek to compare surgical intervention plus medical therapy (standard of care) versus medical therapy (less than standard of care). STUDY DESIGN AND SETTING Network meta-analysis of RCTs of adults with symptomatic carotid artery stenosis of 50%-99% who were treated with carotid endarterectomy (CEA), carotid artery stenting (CAS), or medical therapy (MT). The primary outcome was any stroke or death until end of follow-up, and secondary outcome was 30-day risk of ipsilateral stroke/death. RESULTS We analysed eight studies, with 7187 subjects with symptomatic moderate/severe stenosis (50%-99%). CEA was more efficacious than MT (HR = 0.82, 95% credible intervals [95% CrI] = 0.73-0.92) and CAS (HR 0.73, 95% CrI = 0.62-0.85) for the prevention of any stroke/death. At 30 days, the odds of experiencing an ipsilateral stroke/death were significantly lower in the CEA group compared to both MT (OR = 0.58, 95% CrI = 0.47-0.72) and CAS (OR = 0.68, 95% CrI = 0.55-0.83). CONCLUSION Our results support the feasibility of using NMA to assess best available evidence to inform the ethical evaluation of RCTs seeking to randomise patients away from standard of care. Our results suggest that a strong argument is required to ethically justify the conduct of RCTs that seek to randomise patients away from standard of care in the setting of symptomatic moderate to severe carotid stenosis.
Collapse
Affiliation(s)
- Ronda Lun
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- Department of Medicine, Division of Neurology, The Ottawa Hospital, Ottawa, Canada
| | - Gabriele Zitikyte
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Vignan Yogendrakumar
- Department of Medicine, Division of Neurology, The Ottawa Hospital, Ottawa, Canada
- Department of Medicine and Neurology, The Royal Melbourne Hospital, Parkville, Australia
| | - Olena Bereznyakova
- Department of Neurosciences, Centre Hospitalier de l'Universite de Montreal, Montreal, Canada
| | - Brian Dewar
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- Department of Medicine, Division of Neurology, The Ottawa Hospital, Ottawa, Canada
| | - Dar Dowlatshahi
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- Department of Medicine, Division of Neurology, The Ottawa Hospital, Ottawa, Canada
| | - Robert Fahed
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- Department of Medicine, Division of Neurology, The Ottawa Hospital, Ottawa, Canada
| | - Michel Shamy
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- Department of Medicine, Division of Neurology, The Ottawa Hospital, Ottawa, Canada
| |
Collapse
|
3
|
Memon R, Asif M, Pitman A, Chaudhry N, Husain N, Edwards SJL. Is equipoise a useful concept to justify randomised controlled trials in the cultural context of Pakistan? A survey of clinicians in relation to a trial of talking therapy for young people who self-harm. Trials 2023; 24:506. [PMID: 37553645 PMCID: PMC10408059 DOI: 10.1186/s13063-023-07397-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Accepted: 05/19/2023] [Indexed: 08/10/2023] Open
Abstract
BACKGROUND Clinical equipoise, also defined as the uncertainty principle, is considered essential when recruiting subjects to a clinical trial. However, equipoise is threatened when clinicians are influenced by their own preferences. Little research has investigated equipoise in the context of trial recruitment. METHODS This cross-sectional survey sought clinicians' views (operationalised as 11 statements relating to treatments offered in a trial of a psychological intervention for young people) about equipoise and individual treatment preferences in the context of moral justification for recruiting young people at risk of self-harm or suicide to a randomised controlled trial (RCT) to evaluate the Youth Culturally Adapted Manual Assisted Psychological Intervention (Y-CMAP) in Pakistan. We compared the views of clinicians involved in Y-CMAP RCT recruitment to those of a sample of clinicians not involved in trial recruitment but treating similar patients, comparing their sociodemographic characteristics and the proportions of those in each group agreeing with each statement. RESULTS There was a response rate of 96% (75/78). Findings showed that, during trial recruitment and before the RCT results were known, the majority of all responding clinicians (73.3%) considered Y-CMAP to be an effective treatment for young people at risk of self-harm or suicide. Although there was an acknowledgement of individual preferences for the intervention, there was near consensus (90%) on the need to conduct an RCT for reaching an evidence-based decision. However, there were no significant differences in the proportion of recruiting clinicians reporting a treatment preference for Y-CMAP than non-recruiting clinicians (31 (88.6%) versus 36 (90%), p = 0.566). A significantly higher proportion of non-recruiting clinicians (87.5%) as compared to (48.5%) in the trial (p = 0.000) stated that there may be other treatments that may be equally good for the patients, seemingly undermining a preference for the intervention. Those reporting a treatment preference also acknowledged that there was nothing on which this preference was based, however confident they felt about them, thus accepting clinical equipoise as ethical justification for conducting the RCT. There was a significant group difference in views that treatment overall is better as a result of young patients' participation in the Y-CMAP trial (p = 0.015) (i.e. more clinicians not involved in the trial agreed with this statement). Similarly, more clinicians not involved in the trial agreed on the perceived availability of other treatment options that were good for young people at risk of self-harm (p < 0.05). CONCLUSIONS The paper highlights that clinicians in Pakistan accept the notion of clinical equipoise as an ethical justification for patient participation in RCTs. The need for conducting RCTs to generate evidence base and to reduce bias was considered important by the clinical community.
Collapse
Affiliation(s)
| | - Muqaddas Asif
- Pakistan Institute of Living and Learning (PILL), Karachi, Pakistan
| | - Alexandra Pitman
- University College London (UCL), London, UK
- Camden and Islington NHS Foundation Trust, London, UK
| | - Nasim Chaudhry
- Pakistan Institute of Living and Learning (PILL), Karachi, Pakistan
| | | | | |
Collapse
|
4
|
Dewar B, Chevrier S, De Meulemeester J, Fedyk M, Rodriguez R, Kitto S, Saginur R, Shamy M. What do we talk about when we talk about "equipoise"? Stakeholder interviews assessing the use of equipoise in clinical research ethics. Trials 2023; 24:203. [PMID: 36934250 PMCID: PMC10024829 DOI: 10.1186/s13063-023-07221-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Accepted: 03/06/2023] [Indexed: 03/19/2023] Open
Abstract
INTRODUCTION Equipoise, generally defined as uncertainty about the relative effects of the treatments being compared in a trial, is frequently referenced as an ethical standard for the conduct of randomized clinical trials. However, it seems to be defined in several different ways and may be used differently by different individuals. We explored how clinical researchers, chairs of research ethics boards, and philosophers of science define and reason with this term. METHODS We completed semi-structured interviews about clinical trial ethics with 15 clinical researchers, 15 research ethics board chairs, and 15 philosophers of science/bioethicists. Each participant was asked a standardized set of 10 questions, 4 of which were specifically about equipoise. All interviews were conducted telephonically and transcribed. Responses were grouped and analysed via a modified grounded theory method. RESULTS Forty-three respondents defined equipoise in 7 logically distinct ways, and 2 respondents could not explicitly define it. The most common definition, offered by 14 respondents (31%), defined "equipoise" as a disagreement at the level of a community of physicians. There was significant variability in definitions offered between and within groups. When asked how they would "operationalize" equipoise - i.e. check or test for its presence - respondents provided 7 alternatives, the most common being in relation to a literature review (15/45, 33%). The vast majority of respondents (35/45, 78%) felt the concept was helpful, though many acknowledged that the lack of a clear definition or operationalization was problematic. CONCLUSION There is significant variation in definitions of equipoise offered by respondents, suggesting that parties within groups and between groups may be referring to different concepts when they reference "equipoise". This non-uniformity may impact fairness and transparency and opens the door to potential ethical problems in the evaluation of clinical trials - for instance, a patient may understand equipoise very differently than the researchers enrolling her in a trial, which could cause her agreement to participate to be based upon false premises.
Collapse
Affiliation(s)
- Brian Dewar
- Ottawa Hospital Research Institute, Ottawa, Canada
| | | | | | - Mark Fedyk
- University of California, Davis, Davis, USA
| | | | - Simon Kitto
- Department of Innovation in Medical Education, University of Ottawa, Ottawa, Canada
| | | | - Michel Shamy
- Ottawa Hospital Research Institute, Ottawa, Canada.
- Department of Medicine, University of Ottawa, Ottawa, Canada.
| |
Collapse
|
5
|
Andreasen J, Nørgaard B, Draborg E, Juhl CB, Yost J, Brunnhuber K, Robinson KA, Lund H. Justification of research using systematic reviews continues to be inconsistent in clinical health science-A systematic review and meta-analysis of meta-research studies. PLoS One 2022; 17:e0276955. [PMID: 36315526 PMCID: PMC9621455 DOI: 10.1371/journal.pone.0276955] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Accepted: 10/18/2022] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Redundancy is an unethical, unscientific, and costly challenge in clinical health research. There is a high risk of redundancy when existing evidence is not used to justify the research question when a new study is initiated. Therefore, the aim of this study was to synthesize meta-research studies evaluating if and how authors of clinical health research studies use systematic reviews when initiating a new study. METHODS Seven electronic bibliographic databases were searched (final search June 2021). Meta-research studies assessing the use of systematic reviews when justifying new clinical health studies were included. Screening and data extraction were performed by two reviewers independently. The primary outcome was defined as the percentage of original studies within the included meta-research studies using systematic reviews of previous studies to justify a new study. Results were synthesized narratively and quantitatively using a random-effects meta-analysis. The protocol has been registered in Open Science Framework (https://osf.io/nw7ch/). RESULTS Twenty-one meta-research studies were included, representing 3,621 original studies or protocols. Nineteen of the 21 studies were included in the meta-analysis. The included studies represented different disciplines and exhibited wide variability both in how the use of previous systematic reviews was assessed, and in how this was reported. The use of systematic reviews to justify new studies varied from 16% to 87%. The mean percentage of original studies using systematic reviews to justify their study was 42% (95% CI: 36% to 48%). CONCLUSION Justification of new studies in clinical health research using systematic reviews is highly variable, and fewer than half of new clinical studies in health science were justified using a systematic review. Research redundancy is a challenge for clinical health researchers, as well as for funders, ethics committees, and journals.
Collapse
Affiliation(s)
- Jane Andreasen
- Department of Physiotherapy and Occupational Therapy, Aalborg University Hospital, Denmark and Public Health and Epidemiology Group, Department of Health, Science and Technology, Aalborg University, Aalborg, Denmark
- * E-mail:
| | - Birgitte Nørgaard
- Department of Public Health, University of Southern Denmark Odense, Denmark
| | - Eva Draborg
- Department of Public Health, University of Southern Denmark Odense, Denmark
| | - Carsten Bogh Juhl
- Department of Sports Science and Clinical Biomechanics, University of Southern Denmark and Department of Physiotherapy and Occupational Therapy, Copenhagen University Hospital, Herlev and Gentofte, Herlev, Denmark
| | - Jennifer Yost
- M. Louise Fitzpatrick College of Nursing, Villanova University, Villanova, PA, United States of America
| | | | - Karen A. Robinson
- Johns Hopkins University School of Medicine, Baltimore, MD, United States of America
| | - Hans Lund
- Department of Evidence-Based Practice, Western Norway University of Applied Sciences, Bergen, Norway
| |
Collapse
|
6
|
Nørgaard B, Briel M, Chrysostomou S, Ristic Medic D, Buttigieg SC, Kiisk E, Puljak L, Bala M, Pericic TP, Lesniak W, Zając J, Lund H, Pieper D. A systematic review of meta-research studies finds substantial methodological heterogeneity in citation analyses to monitor evidence-based research. J Clin Epidemiol 2022; 150:126-141. [PMID: 35793778 DOI: 10.1016/j.jclinepi.2022.06.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 06/21/2022] [Accepted: 06/29/2022] [Indexed: 10/17/2022]
Abstract
OBJECTIVES This systematic review aimed to identify the characteristics and application of citation analyses in evaluating the justification, design, and placement of the research results of clinical health studies in the context of earlier similar studies. STUDY DESIGN AND SETTING We searched MEDLINE (Ovid), Embase (Ovid), and the Cochrane Methodology Register for meta-research studies. We included meta-research studies assessing whether researchers used earlier similar studies and/or systematic reviews of such studies to inform the justification or design of a new study, whether researchers used systematic reviews to inform the interpretation of new results, and meta-research studies assessing whether redundant studies were published within a specific area. The results are presented as a narrative synthesis. RESULTS A total of 27 studies were included. How authors of citation analyses define their outcomes appears rather arbitrary, as does how the reference of a landmark review or adherence to reporting guidelines was expected to contribute to the initiation, justification, design, or contextualization of relevant clinical trials. CONCLUSION Continued and improved efforts to promote evidence-based research are needed, including clearly defined and justified outcomes in meta-research studies to monitor the implementation of an evidence-based approach.
Collapse
Affiliation(s)
| | - Matthias Briel
- Basel Institute for Clinical Epidemiology and Biostatistics (CEB), Department of Clinical Research, University Hospital, Basel, Switzerland; Department of Health Research Methodology, Evidence, and Impact, McMaster University, Hamilton, Canada
| | | | - Danijela Ristic Medic
- Department for Nutritional Biochemistry and Dietology, Centre of Research Excellence in Nutrition and Metabolism, Institute for Medical Research, National Institute of the Republic of Serbia, University of Belgrade, Belgrade, Serbia
| | - Sandra C Buttigieg
- Malta Department of Health Systems Management and Leadership, Faculty of Health Sciences, Msida, University of Malta, Malta
| | - Ele Kiisk
- Institute of Family Medicine and Public Health, University of Tartu, Tartu, Estoni
| | - Livia Puljak
- Center for Evidence-Based Medicine and Healthcare, Catholic University of Croatia, Zagreb, Croatia
| | - Malgorzata Bala
- Department of Hygiene and Dietetics, Chair of Epidemiology and Preventive Medicine, Jagiellonian University Medical College, Kraków, Poland
| | - Tina Poklepovic Pericic
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| | - Wiktoria Lesniak
- EBM Unit, Institute of Cardiology, Jagiellonian University Medical College, Kraków, Poland
| | - Joanna Zając
- Department of Hygiene and Dietetics, Chair of Epidemiology and Preventive Medicine, Jagiellonian University Medical College, Kraków, Poland
| | - Hans Lund
- Centre for Evidence-Based Practice, Western Norway University of Applied Sciences, Bergen, Norway
| | - Dawid Pieper
- Faculty of Health Sciences Brandenburg (FGW), Brandenburg Medical School Theodor Fontane (MHB), Rüdersdorf, Germany; Centre for Health Services Research, Brandenburg Medical School Theodor Fontane (MHB), Rüdersdorf, Germany
| |
Collapse
|
7
|
Fedyk M, Dewar B, Jurkovic L, Chevrier S, Kitto S, Rodriguez R, Saginur R, Dowlatshahi D, Fahed R, Shamy M. How are randomized clinical trials ethically justified? A systematic scoping review and thematic analysis of reasons that ethically justify randomized clinical trials. J Clin Epidemiol 2022; 147:160-167. [PMID: 35413418 DOI: 10.1016/j.jclinepi.2022.04.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 12/21/2021] [Accepted: 04/05/2022] [Indexed: 10/18/2022]
Abstract
OBJECTIVES We set out to identify and count the types of reasons that are used in contemporary scholarship about the ethical permissibility of randomized trials, with the goal of developing a finer grained taxonomy of reasons than what is currently used by most participants in this literature. Because of its central role in justifying normative conclusions about randomized clinical trials (RCTs), we paid particular attention to both uses of the keyword "equipoise" and to the different concepts associated with it. METHODS We conducted a scoping review to identify articles that included arguments that were likely to express reasons justifying RCTs. Text excerpts that expressed reasoning about the ethical permissibility of RCTs were extracted from relevant papers, and our data were generated by coding these excerpts using a mixed-methods protocol that fused elements of a grounded analysis and thematic coding. In our study, each theme corresponded to a specific type of reason that was contentful and stable when applied to our corpus of text extracts. RESULTS Our search, screening, and text extraction process yielded 1,335 unique text excerpts, which then formed the basis of our coding. Although we found that 16 themes were sufficient to saturate this corpus, slightly less than 100% of our excerpts were covered by just 10 themes. We also tracked uses of 16 keywords in the text excerpts to explore whether there was any relationship between the keywords and our themes and found that keywords frequently did not cooccur with the presence of our themes. CONCLUSIONS Our data and analysis support the conclusion that there is significant diversity in the types of reasons offered to justify RCTs; 10 themes effectively captured all the text excerpts we analyzed, and these themes cannot be reduced to the occurrence of relevant keywords. This result highlights how individuals and organizations may use different reasons to consider randomized trials to be justified and even when they use similar language the concepts they are referencing may not be consistent.
Collapse
Affiliation(s)
- Mark Fedyk
- School of Medicine, University of California, Davis, Davis, CA, USA
| | - Brian Dewar
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Lucas Jurkovic
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | | | - Simon Kitto
- Department of Innovation in Medical Education, University of Ottawa, Ottawa, Ontario, Canada
| | | | | | - Dar Dowlatshahi
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada; Ottawa Hospital and Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Robert Fahed
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada; Ottawa Hospital and Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Michel Shamy
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada; Ottawa Hospital and Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada.
| |
Collapse
|
8
|
Kubota Y, Narukawa M. Randomized Controlled Trial Data for New Drug Application for Rare Diseases in Japan. Ther Innov Regul Sci 2022; 56:659-666. [PMID: 35478399 DOI: 10.1007/s43441-022-00404-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 04/07/2022] [Indexed: 11/26/2022]
Abstract
BACKGROUND High-quality evidence is often not obtained in the clinical trials of rare diseases because these trials tend to be smaller in size and non-controlled. We investigated the potential factors associated with the need for randomized controlled trials (RCTs) in the clinical data package for new drug applications for rare diseases in Japan. METHODS This study focused on 130 drugs with orphan drug designation approved in Japan between April 2004 and March 2020. RESULTS Multivariable regression analysis showed that the prevalence (odds ratio [OR] 3.21, 95% confidence interval [CI] 1.18-8.6) and the type of primary endpoint (OR 6.66, 95% CI 2.41-18.37) were associated with the need for RCTs in the clinical data package in Japan. CONCLUSIONS Our findings highlight the importance of adequate understanding of the target disease in new drug development for rare diseases.
Collapse
Affiliation(s)
- Yosuke Kubota
- Department of Clinical Medicine (Pharmaceutical Medicine), Graduate School of Pharmaceutical Sciences, Kitasato University, 5-9-1 Shirokane, Minato-ku, Tokyo, 108-8641, Japan.
- Development, Astellas Pharma Inc., Tokyo, 103-0023, Japan.
| | | |
Collapse
|
9
|
Faris H, Dewar B, Dowlatshahi D, Ramji A, Kenney C, Page S, Buck B, Hill MD, Coutts SB, Almekhlafi M, Sajobi T, Singh N, Sehgal A, Swartz RH, Menon BK, Shamy M. Ethical Justification for Deferral of Consent in the AcT Trial for Acute Ischemic Stroke. Stroke 2022; 53:2420-2423. [DOI: 10.1161/strokeaha.122.038760] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The AcT trial (Alteplase Compared to Tenecteplase) compares alteplase or tenecteplase for patients with acute ischemic stroke. All eligible patients are enrolled by deferral of consent. Although the use of deferral of consent in the AcT trial meets the requirements of Canadian policy, we sought to provide a more explicit and rigorous approach to the justification of deferral of consent organized around 3 questions. Ultimately, the approach we outline here could become the foundation for a general justification for deferral of consent.
Collapse
Affiliation(s)
- Hannah Faris
- Department of Medicine, University of Ottawa and The Ottawa Hospital, Ontario, Canada (H.F., D.D., M.S.)
- Ottawa Hospital Research Institute, Ontario, Canada (H.F., B.D., D.D., M.S.)
| | - Brian Dewar
- Ottawa Hospital Research Institute, Ontario, Canada (H.F., B.D., D.D., M.S.)
| | - Dar Dowlatshahi
- Department of Medicine, University of Ottawa and The Ottawa Hospital, Ontario, Canada (H.F., D.D., M.S.)
- Ottawa Hospital Research Institute, Ontario, Canada (H.F., B.D., D.D., M.S.)
| | | | - Carol Kenney
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Stacey Page
- Calgary Conjoint Health Research Ethics Board, Alberta, Canada (S.P.)
| | - Brian Buck
- University of Alberta and University Hospital, Edmonton, Canada (B.B.)
| | - Michael D. Hill
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Shelagh B. Coutts
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Mohammed Almekhlafi
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Tolulope Sajobi
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Nishita Singh
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Arshia Sehgal
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Richard H. Swartz
- University of Toronto and Sunnybrook Hospital, Ontario, Canada (R.H.S.)
| | - Bijoy K. Menon
- Calgary Stroke Program, University of Calgary and Foothills Hospital, Alberta, Canada (C.K., M.D.H., S.B.C., M.A., T.S., N.S., A.S., B.K.M.)
| | - Michel Shamy
- Department of Medicine, University of Ottawa and The Ottawa Hospital, Ontario, Canada (H.F., D.D., M.S.)
- Ottawa Hospital Research Institute, Ontario, Canada (H.F., B.D., D.D., M.S.)
| |
Collapse
|
10
|
Yogendrakumar V, Dewar B, McGuinty M, Dowlatshahi D, Dyason C, Kwok ES, Ramsay T, Lund H, Shamy M. Many trials of hydroxychloroquine for SARS-CoV-2 were redundant and potentially unethical: an analysis of the NIH clinical trials registry. J Clin Epidemiol 2022; 143:73-80. [PMID: 34780978 PMCID: PMC8590481 DOI: 10.1016/j.jclinepi.2021.11.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 10/29/2021] [Accepted: 11/06/2021] [Indexed: 11/21/2022]
Abstract
OBJECTIVE We sought to map the landscape of trials investigating hydroxychloroquine (HCQ) for SARS-CoV-2 in order to draw conclusions about how clinical trials have been conducted in the pandemic environment and offer potential regulatory recommendations. STUDY DESIGN AND SETTING We identified and captured data related to registered studies using HCQ to treat SARS-CoV-2 registered with the publicly available National Institutes of Health (NIH) Clinical Trials Registry between February and November 2020. RESULTS Between February and November 2020, 206 studies investigating HCQ in SARS-CoV-2 were registered with the NIH Clinical Trials Registry. As of November 2020, 135 studies were listed as ongoing, 22 have been completed, and 46 are either suspended or have been terminated. Reasons for suspension or termination included difficulties with patient recruitment (n = 9), emerging evidence showing a lack of benefit of HCQ (n = 7), and recommendations by regulatory boards to discontinue (n = 10). CONCLUSION Many clinical trials of HCQ were launched in the first months of the pandemic, and a significant proportion of them remained active as of November 2020. The medical community appears to have responded very quickly to political interest in HCQ, while responding much more slowly to the evolving medical evidence of its lack of efficacy.
Collapse
Affiliation(s)
- Vignan Yogendrakumar
- Department of Medicine, The Ottawa Hospital, University of Ottawa, Ontario, Canada; Ottawa Hospital Research Institute, University of Ottawa, Ontario, Canada
| | - Brian Dewar
- Ottawa Hospital Research Institute, University of Ottawa, Ontario, Canada.
| | - Michaeline McGuinty
- Department of Medicine, The Ottawa Hospital, University of Ottawa, Ontario, Canada; Ottawa Hospital Research Institute, University of Ottawa, Ontario, Canada
| | - Dar Dowlatshahi
- Department of Medicine, The Ottawa Hospital, University of Ottawa, Ontario, Canada; Ottawa Hospital Research Institute, University of Ottawa, Ontario, Canada
| | - Claire Dyason
- Department of Medicine, The Ottawa Hospital, University of Ottawa, Ontario, Canada
| | - Edmond Sh Kwok
- Department of Emergency Medicine, The Ottawa Hospital, Ontario, Canada
| | - Tim Ramsay
- Ottawa Hospital Research Institute, University of Ottawa, Ontario, Canada; Ottawa Methods Center, University of Ottawa, Ontario, Canada
| | - Hans Lund
- Section of Evidence-Based Practice, Western Norway University of Applied Sciences, Bergen, Norway
| | - Michel Shamy
- Department of Medicine, The Ottawa Hospital, University of Ottawa, Ontario, Canada; Ottawa Hospital Research Institute, University of Ottawa, Ontario, Canada
| |
Collapse
|
11
|
Nørgaard B, Draborg E, Andreasen J, Juhl CB, Yost J, Brunnhuber K, Robinson KA, Lund H. Systematic Reviews are Rarely Used to Inform Study Design - a Systematic Review and Meta-analysis. J Clin Epidemiol 2022; 145:1-13. [PMID: 35045317 DOI: 10.1016/j.jclinepi.2022.01.007] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/28/2021] [Accepted: 01/13/2022] [Indexed: 12/30/2022]
Abstract
OBJECTIVE Our aim was to identify and synthesize the results from meta-research studies to determine whether and how authors of original studies in clinical health research use systematic reviews when designing new studies. STUDY DESIGN AND SETTING For this systematic review, we searched MEDLINE (OVID), Embase (OVID) and the Cochrane Methodology Register. We included meta-research studies and primary outcome was the percentage of original studies using systematic reviews to design their study. Risk of bias was assessed using an ad hoc created list of ten items. The results are presented both as a narrative synthesis and a meta-analysis. RESULTS Sixteen studies were included. The use of a systematic review to inform the design of new clinical studies varied between 0% and 73%, with a mean percentage of 17%. The number of components of the design in which information from previous systematic reviews was used varied from three to eleven. CONCLUSION Clinical health research is characterized by variability regarding the extent to which systematic reviews are used to guide the design. An evidence-based research (EBR) approach towards research design when new clinical health studies are designed is necessary to decrease potential research redundancy and increase end-user value.
Collapse
Affiliation(s)
- Birgitte Nørgaard
- Department of Public Health, University of Southern Denmark, Odense, Denmark.
| | - Eva Draborg
- Department of Public Health, University of Southern Denmark, Odense, Denmark
| | - Jane Andreasen
- Department of Physiotherapy and Occupational Therapy, Aalborg University Hospital, Denmark and Public Health and Epidemiology Group, Department of Health, Science and Technology, Aalborg University, Aalborg, Denmark
| | - Carsten Bogh Juhl
- Department of Sports Science and Clinical Biomechanics, University of Southern Denmark and Department of Physiotherapy and Occupational Therapy, University of Copenhagen Herlev and Gentofte, Denmark
| | - Jennifer Yost
- M. Louise Fitzpatrick College of Nursing, Villanova University, Philadelphia, Pennsylvania, USA
| | | | | | - Hans Lund
- Department of Evidence-Based Practice, Western Norway University of Applied Sciences, Bergen, Norway
| |
Collapse
|
12
|
Patel K, Cobourne MT, Pandis N, Seehra J. Are orthodontic randomised controlled trials justified with a citation of an appropriate systematic review? Prog Orthod 2021; 22:48. [PMID: 34918200 PMCID: PMC8677858 DOI: 10.1186/s40510-021-00395-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Accepted: 12/06/2021] [Indexed: 01/06/2023] Open
Abstract
Background A systematic review of the evidence should be undertaken to support the justification for undertaking a clinical trial. The aim of this study was to examine whether reports of orthodontic Randomised Clinical Trials (RCTs) cite prior systematic reviews (SR) to explain the rationale or justification of the trial. Study characteristics that predicated the citation of SR in the RCT report were also explored. Material and methods Orthodontic RCTs published between 1st January 2010 to 31st December 2020 in seven orthodontic journals were identified. All titles and abstracts were screened independently by two authors. Descriptive statistics and associations were assessed for the study characteristics. Logistic regression was used to identify predicators of SR inclusion in the trial report. Results 301 RCTs fulfilling the eligibility criteria were assessed. 220 SRs were available of which 74.5% (N = 164) were cited, and 24.5% (N = 56) were not included but were available in the literature within 12 months of trial commencement. When a SR was not included in the introduction or no SR was available within 12 months of trial commencement, interventional studies were commonly cited. The continent of the corresponding author predicated the possibility of inclusion of a SR in the introduction (OR 0.36; 95% CI 0.18–0.71; p = 0.003). Conclusions A quarter of orthodontic RCTs (24.5%) included in this study did not cite a SR in the introduction section to justify the rationale of the trial when a relevant SR was available. To reduce research waste and optimal usage of resources, researchers should identify or conduct a systematic review of the evidence to support the rationale and justification of the trial.
Collapse
Affiliation(s)
- Kishan Patel
- Department of Orthodontics, Faculty of Dentistry, Oral and Craniofacial Sciences, King's College London, Kings College Hospital NHS Foundation Trust, Denmark Hill, London, SE5 9RS, UK
| | - Martyn T Cobourne
- Centre for Craniofacial Development and Regeneration, Faculty of Dentistry, Oral and Craniofacial Sciences, King's College London, Guy's Hospital, Guy's and St Thomas NHS Foundation Trust, London, SE1 9RT, UK
| | - Nikolaos Pandis
- Department of Orthodontics and Dentofacial Orthopedics, Dental School/Medical Faculty, University of Bern, Bern, Switzerland
| | - Jadbinder Seehra
- Centre for Craniofacial Development and Regeneration, Faculty of Dentistry, Oral and Craniofacial Sciences, King's College London, Guy's Hospital, Guy's and St Thomas NHS Foundation Trust, London, SE1 9RT, UK.
| |
Collapse
|
13
|
Gray R, Water A, MacKay B. How prospective trial registration can prevent selective outcome reporting and salami slicing? Women Birth 2021; 35:105-107. [PMID: 34344635 DOI: 10.1016/j.wombi.2021.07.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2021] [Revised: 07/25/2021] [Accepted: 07/25/2021] [Indexed: 10/20/2022]
Abstract
BACKGROUND Pre-registration of a clinical trial before the first participant is recruited can help to prevent selective outcome reporting and salami-slicing that can distort the evidence base for an intervention and result in people being offered care or treatment that is not effective. Rates of clinical trial registration in nursing and midwifery are low. AIM To use a hypothetical example from midwifery practice to illustrate how selective outcome reporting and salami-slicing can distort the evidence base. FINDINGS A trial of immersion in water during labour and birth is used to consider issues in outcome selection and how researchers may be drawn to switch primary outcomes or report different outcomes across multiple papers. DISCUSSION In nursing and midwifery science, selective outcome and salami reporting are seemingly common. Prospective trial registration is intended to prevent these practices, enhancing the quality and integrity of the work. CONCLUSION Clinical trials are a robust form of primary research evidence and directly impact clinical practice. Researchers must ensure their trials are correctly registered and editors need to reconcile submitted papers and registration entries as part of the review process.
Collapse
Affiliation(s)
| | - Amanda Water
- Australian Catholic University, Melbourne, Australia
| | | |
Collapse
|
14
|
Webster CJ, George KL, Woollett GR. Comparability of Biologics: Global Principles, Evidentiary Consistency and Unrealized Reliance. BioDrugs 2021; 35:379-387. [PMID: 34143406 PMCID: PMC8295099 DOI: 10.1007/s40259-021-00488-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/27/2021] [Indexed: 12/31/2022]
Abstract
The principles of comparability assessments have been accepted globally as offering sensitive and reliable tools with which to evaluate potential changes to biologics that may arise either through processing changes or through the creation of a copy (biosimilar) by a different sponsor. The comparability approach has evolved through systematic advances in four areas: clear and convergent guidelines for evaluation of potential changes to biologics; risk-based systems of weighting analytical data; progressive improvements in analytical methods; and advanced understanding of post-translational modifications. Routine regulatory expectations for clinical equivalence data are being reevaluated, as they seldom contribute to the assessment of similarity. Similarly, we show that requirements to compare biosimilars and locally sourced versions of their reference products are of questionable scientific value and represent a double standard by comparison with the invariable acceptance of the clinical profiles of novel biologics without reference to their sources. The consistent application of evidentiary standards for comparability to all biologics offers an opportunity for regulators to curtail their own assessments of new biosimilars and instead to recognize comparability assessments made in another jurisdiction (reliance), thereby gaining important efficiencies in the regulatory review of biosimilars and improving the competitiveness of the biosimilars market. Such consistency can also enhance the confidence of all stakeholders, especially patients and their providers, in all biologics.
Collapse
|
15
|
Seehra J, Liu C, Pandis N. Citation of prior systematic reviews in reports of randomized controlled trials published in dental speciality journals. J Dent 2021; 109:103658. [PMID: 33836249 DOI: 10.1016/j.jdent.2021.103658] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 03/27/2021] [Accepted: 04/02/2021] [Indexed: 11/18/2022] Open
Abstract
OBJECTIVES To assess the extent to which reports of dental Randomised Clinical Trials (RCTs) cite prior systematic reviews (SR) to explain the rationale or justification of the trial. Study characteristics that predicated the citation of SR in the RCT report were explored. METHODS An electronic database search was undertaken to identify dental RCTs published between 1st January 2014 and 31st December 2019. All titles and abstracts were screened independently by two authors. Descriptive statistics and associations were calculated for the study characteristics. Logistic regression was used to identify predicators of SR inclusion in the trial report. RESULTS 682 RCTs were analysed. 312 SRs were available of which 62.5 % were cited and 37.5 % were not included but were available in the literature within 12 months of trial commencement. An association between inclusion of SR and trial registration (P = 0.046) was detected. For the inclusion of a SR, authors based in Asia or other had lower odds than those based in Europe (OR: 0.53; 95 % CI:0.34,0.82; p = 0.005). Every unit increase in journal impact factor increased the odds of SR inclusion (OR: 1.23; 95 %: 1.06, 1.43; p = 0.006). CONCLUSIONS A relatively high proportion of dental RCTs (37.5 %) did not cite a SR in the introduction section to justify the rationale of the trial when a relevant SR was available. Trials conducted by a corresponding author based in Europe and published in journals with an increasing impact factor were also more likely to cite a SR. CLINICAL SIGNIFICANCE Further progress is required to minimise research waste and ensure resources are channelled towards clinically useful trials which have an appropriate rationale and justification.
Collapse
Affiliation(s)
- Jadbinder Seehra
- Department of Orthodontics, Faculty of Dentistry, Oral and Craniofacial Sciences, King's College London, United Kingdom.
| | - Catherine Liu
- Department of Oral and Maxillofacial Surgery, Queen's Hospital, Barking, Romford, United Kingdom
| | - Nikolaos Pandis
- Department of Orthodontics and Dentofacial Orthopedics, Dental School/Medical Faculty, University of Bern, Switzerland
| |
Collapse
|
16
|
Abstract
BACKGROUND Conditional power of network meta-analysis (NMA) can support the planning of randomized controlled trials (RCTs) assessing medical interventions. Conditional power is the probability that updating existing inconclusive evidence in NMA with additional trial(s) will result in conclusive evidence, given assumptions regarding trial design, anticipated effect sizes, or event probabilities. METHODS The present work aimed to estimate conditional power for potential future trials on antidepressant treatments. Existing evidence was based on a published network of 502 RCTs conducted between 1979-2018 assessing acute antidepressant treatment in major depressive disorder (MDD). Primary outcomes were efficacy in terms of the symptom change on the Hamilton Depression Scale (HAMD) and tolerability in terms of the dropout rate due to adverse events. The network compares 21 antidepressants consisting of 231 relative treatment comparisons, 164 (efficacy) and 127 (tolerability) of which are currently assumed to have inconclusive evidence. RESULTS Required sample sizes to achieve new conclusive evidence with at least 80% conditional power were estimated to range between N = 894 - 4190 (efficacy) and N = 521 - 1246 (tolerability). Otherwise, sample sizes ranging between N = 49 - 485 (efficacy) and N = 40 - 320 (tolerability) may require stopping for futility based on a boundary at 20% conditional power. Optimizing trial designs by considering multiple trials that contribute both direct and indirect evidence, anticipating alternative effect sizes or alternative event probabilities, may increase conditional power but required sample sizes remain high. Antidepressants having the greatest conditional power associated with smallest required sample sizes were identified as those on which current evidence is low, i.e., clomipramine, levomilnacipran, milnacipran, nefazodone, and vilazodone, with respect to both outcomes. CONCLUSIONS The present results suggest that conditional power to achieve new conclusive evidence in ongoing or future trials on antidepressant treatments is low. Limiting the use of the presented conditional power analysis are primarily due to the estimated large sample sizes which would be required in future trials as well as due to the well-known small effect sizes in antidepressant treatments. These findings may inform researchers and decision-makers regarding the clinical relevance and justification of research in ongoing or future antidepressant RCTs in MDD.
Collapse
Affiliation(s)
- Lisa Holper
- University Hospital of Psychiatry, University of Zurich, Zurich, Switzerland.
| |
Collapse
|
17
|
Dewar B, Shamy M. Reader Response: AAN Position Statement: Ethical Issues in Clinical Research in Neurology. Neurology 2021; 96:408. [PMID: 38124242 DOI: 10.1212/wnl.0000000000011474] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
|
18
|
Taschner NP, Orsi C. Science based public policies: Lessons from Covid19 on the use of randomized trials. Genet Mol Biol 2021; 44:e20200273. [PMID: 33543746 PMCID: PMC7876434 DOI: 10.1590/1678-4685-gmb-2020-0273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Accepted: 12/04/2020] [Indexed: 11/22/2022] Open
Abstract
The current SARS-CoV-2 pandemic gave rise to a spirit of methodological anarchy in some fronts of biomedical research, embraced by some under the excuses of urgency and time restraints. This movement, however, comes at the same time when social sciences begin to recognize the value and soundness of the clinical research rationale - the need for randomization, of fair comparisons between intervention groups, the humility of acknowledging ignorance and accepting uncertainty, these last two imperatives usually subsumed under the principle of “equipoise”.
Collapse
Affiliation(s)
- Natalia Pasternak Taschner
- Instituto Questão de Ciência, São Paulo, SP, Brazil.,Universidade de São Paulo, Instituto de Ciências Biomédicas, SP, Brazil
| | - Carlos Orsi
- Instituto Questão de Ciência, São Paulo, SP, Brazil
| |
Collapse
|
19
|
Kostis JB. Clinical trials may be unethical in certain instances. Int J Cardiol Hypertens 2020; 7:100057. [PMID: 33447778 PMCID: PMC7803080 DOI: 10.1016/j.ijchy.2020.100057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 10/05/2020] [Accepted: 10/09/2020] [Indexed: 12/05/2022] Open
Abstract
After review of the literature, I conclude that clinical trials may be unethical.
Collapse
|
20
|
Kim D, Hasford J. Redundant trials can be prevented, if the EU clinical trial regulation is applied duly. BMC Med Ethics 2020; 21:107. [PMID: 33115456 PMCID: PMC7592564 DOI: 10.1186/s12910-020-00536-9] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Accepted: 09/15/2020] [Indexed: 12/19/2022] Open
Abstract
The problem of wasteful clinical trials has been debated relentlessly in the medical community. To a significant extent, it is attributed to redundant trials - studies that are carried out to address questions, which can be answered satisfactorily on the basis of existing knowledge and accessible evidence from prior research. This article presents the first evaluation of the potential of the EU Clinical Trials Regulation 536/2014, which entered into force in 2014 but is expected to become applicable at the end of 2021, to prevent such trials. Having reviewed provisions related to the trial authorisation, we propose how certain regulatory requirements for the assessment of trial applications can and should be interpreted and applied by national research ethics committees and other relevant authorities in order to avoid redundant trials and, most importantly, preclude the unnecessary recruitment of trial participants and their unjustified exposure to health risks.
Collapse
Affiliation(s)
- Daria Kim
- Research Fellow, Max Planck Institute for Innovation and Competition, Marstallplatz 1, 81545 Munich, Germany
| | - Joerg Hasford
- Ludwig-Maximilians-University of Munich, The Institute for Medical Information Processing, Biometry, and Epidemiology, and Chairman of the Permanent Working Party of Research Ethics Committees in Germany, Scharnitzerstaße 7, 82166 Gräfelfing, Germany
| |
Collapse
|
21
|
Lund H, Juhl CB, Nørgaard B, Draborg E, Henriksen M, Andreasen J, Christensen R, Nasser M, Ciliska D, Clarke M, Tugwell P, Martin J, Blaine C, Brunnhuber K, Robinson KA. Evidence-Based Research Series-Paper 2 : Using an Evidence-Based Research approach before a new study is conducted to ensure value. J Clin Epidemiol 2020; 129:158-166. [PMID: 32987159 DOI: 10.1016/j.jclinepi.2020.07.019] [Citation(s) in RCA: 40] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 07/20/2020] [Indexed: 12/13/2022]
Abstract
BACKGROUND AND OBJECTIVES There is considerable actual and potential waste in research. The aim of this article is to describe how using an evidence-based research approach before conducting a study helps to ensure that the new study truly adds value. STUDY DESIGN AND SETTING Evidence-based research is the use of prior research in a systematic and transparent way to inform a new study so that it is answering questions that matter in a valid, efficient, and accessible manner. In this second article of the evidence-based research series, we describe how to apply an evidence-based research approach before starting a new study. RESULTS Before a new study is performed, researchers need to provide a solid justification for it using the available scientific knowledge as well as the perspectives of end users. The key method for both is to conduct a systematic review of earlier relevant studies. CONCLUSION Describing the ideal process illuminates the challenges and opportunities offered through the suggested evidence-based research approach. A systematic and transparent approach is needed to provide justification for and to optimally design a relevant and necessary new study.
Collapse
Affiliation(s)
- Hans Lund
- Section for Evidence-based Practice, Western Norway University of Applied Sciences, Bergen, Norway.
| | - Carsten B Juhl
- Department of Sport Science and Clinical Biomechanics, University of Southern Denmark, Odense, Denmark; Department of Physiotherapy and Occupational Therapy, University Hospital of Copenhagen, Herlev & Gentofte, Denmark
| | - Birgitte Nørgaard
- Department of Public Health, University of Southern Denmark, Odense, Denmark
| | - Eva Draborg
- Department of Public Health, University of Southern Denmark, Odense, Denmark
| | - Marius Henriksen
- The Parker Institute, Bispebjerg and Frederiksberg Hospital, University of Copenhagen, Copenhagen, Denmark
| | - Jane Andreasen
- Department of Health, Science and Technology, Public Health and Epidemiology Group, Aalborg University, Alborg, Denmark; Department of Physical and Occupational Therapy, Aalborg University Hospital, Aalborg, Denmark
| | - Robin Christensen
- Musculoskeletal Statistics Unit, The Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen, Denmark; Department of Clinical Research, Research Unit of Rheumatology, University of Southern Denmark, Odense University Hospital, Denmark
| | - Mona Nasser
- Peninsula Dental School, Plymouth University, Plymouth, England, UK
| | - Donna Ciliska
- Section for Evidence-based Practice, Western Norway University of Applied Sciences, Bergen, Norway; School of Nursing, McMaster University, Hamilton, Canada
| | - Mike Clarke
- Northern Ireland Methodology Hub, Queen's University Belfast, Northern Ireland
| | - Peter Tugwell
- Department of Medicine, University of Ottawa, Ottawa, Canada
| | - Janet Martin
- MEDICI Centre, Schulich School of Medicine & Dentistry, Western University, London, Ontario, Canada; Departments of Anesthesia & Biostatistics and Epidemiology & Biostatistics, Western University, London, Canada
| | | | - Klara Brunnhuber
- Digital Content Services, Data Platform Operations, Elsevier, London UK
| | | |
Collapse
|
22
|
Turner JH. Ethics of Pharma Clinical Trials in the Era of Precision Oncology. Cancer Biother Radiopharm 2020; 36:1-9. [PMID: 32935997 DOI: 10.1089/cbr.2020.4129] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Pharmaceutical industry clinical trials are ethically problematic: human research subjects are being used as a means to the end of demonstrating statistically significant efficacy of novel anticancer agents to achieve regulatory registration and marketing approval. Randomized controlled trial design is inequitable since control arm patients are denied access to the postulated best treatment. Most pharma studies do not provide clinically meaningful benefit of increased overall survival and enhanced quality of life (QOL) to cohorts and are not reliably generalizable to real-world patients. Precision oncology now enables prospective identification of patients expressing a specific cancer biomarker to determine their particular eligibility for evaluation of efficiency of molecular-targeted treatments. A patient-centered approach, collecting prospective real-world data in large populations, could provide real-world evidence of cost-effective, sustained clinical benefits of survival and QOL, while preserving the ethical beneficent compact between patient and doctor.
Collapse
Affiliation(s)
- J Harvey Turner
- Department of Nuclear Medicine, Fiona Stanley Fremantle Hospitals Group, The University of Western Australia, Murdoch, Australia
| |
Collapse
|
23
|
The use of systematic reviews to justify phase III ophthalmology trials: an analysis. Eye (Lond) 2020; 34:2041-2047. [PMID: 31965083 DOI: 10.1038/s41433-020-0771-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Revised: 10/23/2019] [Accepted: 01/05/2020] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND/OBJECTIVE Given the drastic increase in publication output in recent years, minimizing research waste should be a top priority. There are established areas of concern regarding research waste within ophthalmology along with a lack of systematic review usage to inform trial design in other areas of medicine. Given these concerns, the aim of this study is to evaluate the use of systematic reviews as justification for conducting randomized controlled trials (RCT) in top ophthalmology and optometry journals. METHODS We searched PubMed on December 5, 2018 for RCTs published in one of the top five Google Scholar h-5 index journals within Ophthalmology and Optometry. We used a pilot-tested Google Form and searched each RCT for systematic reviews. Each systematic review was then given the designation of "verbatim", "inferred", or "not used as justification for conducting the RCT" based on the context the systematic review was used. RESULTS Our analysis yielded 152 included phase III RCTs. We found 22.4% (34 of 152) of phase III ophthalmology clinical trials cited a systematic review as justification for conducting the trial. A total of 102 systematic reviews were cited in the 152 RCTs. Fifty-seven of the one hundred fifty-two (37.5%) RCTs cited a systematic review somewhere in the manuscript. CONCLUSION Less than one-quarter of phase III RCTs cited systematic reviews as justification for conducting the RCT. We believe placing a higher priority on justifying RCTs with systematic reviews would go a long way to minimizing research waste within ophthalmology.
Collapse
|
24
|
Abstract
The current development paradigm for biosimilars required by regulators in highly regulated jurisdictions is derived from the development of novel drugs and is unnecessarily burdensome and inefficient. It requires the accumulation of data from analytical, nonclinical (including in vivo studies in some jurisdictions), and clinical studies (including powered efficacy studies in most cases); this paradigm is known as 'totality of evidence' (ToE) and does not admit a conclusion of biosimilarity from analytical data alone. The record of biosimilar approvals in these jurisdictions shows that no biosimilar candidate that has been found highly similar to its reference in analytical and pharmacokinetic studies has failed to be approved. We propose a new paradigm ('confirmation of sufficient likeness', CSL) that emphasizes the demonstration of analytical resemblance between the biosimilar candidate and its reference, and permits the conclusion of biosimilarity upon this basis. CSL does not entail bridging studies between reference products, in vivo nonclinical studies, or powered efficacy studies and is, therefore, substantially more efficient than ToE while maintaining equivalent scientific rigor. Such efficiency will contribute to the attractiveness as well as the sustainability of biosimilars as a therapeutic modality.
Collapse
Affiliation(s)
| | | | - Gillian R Woollett
- FDA Policy, Avalere Health LLC, 1350 Connecticut Ave NW, Suite 900, Washington, 20036, USA.
| |
Collapse
|
25
|
Goodwin VA, Hill JJ, Fullam JA, Finning K, Pentecost C, Richards DA. Intervention development and treatment success in UK health technology assessment funded trials of physical rehabilitation: a mixed methods analysis. BMJ Open 2019; 9:e026289. [PMID: 31467046 PMCID: PMC6720467 DOI: 10.1136/bmjopen-2018-026289] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
OBJECTIVES Physical rehabilitation is a complex process, and trials of rehabilitation interventions are increasing in number but often report null results. This study aimed to establish treatment success rates in physical rehabilitation trials funded by the National Institute of Health Research Health Technology Assessment (NIHR HTA) programme and examine any relationship between treatment success and the quality of intervention development work undertaken. DESIGN This is a mixed methods study. SETTING This study was conducted in the UK. METHODS The NIHR HTA portfolio was searched for all completed definitive randomised controlled trials of physical rehabilitation interventions from inception to July 2016. Treatment success was categorised according to criteria developed by Djulbegovic and colleagues. Detailed textual data regarding any intervention development work were extracted from trial reports and supporting publications and informed the development of quality ratings. Mixed methods integrative analysis was undertaken to explore the relationship between quantitative and qualitative data using joint displays. RESULTS Fifteen trials were included in the review. Five reported a definitive finding, four of which were in favour of the 'new' intervention. Eight trials reported a true negative (no difference) outcome. Integrative analysis indicated those with lower quality intervention development work were less likely to report treatment success. CONCLUSIONS Despite much effort and funding, most physical rehabilitation trials report equivocal findings. Greater focus on high quality intervention development may reduce the likelihood of a null result in the definitive trial, alongside high quality trial methods and conduct.
Collapse
Affiliation(s)
- Victoria A Goodwin
- Institute of Health Research, University of Exeter Medical School, Exeter, UK
| | - Jacqueline J Hill
- Institute of Health Research, University of Exeter Medical School, Exeter, UK
| | - James A Fullam
- Institute of Health Research, University of Exeter Medical School, Exeter, UK
| | - Katie Finning
- Institute of Health Research, University of Exeter Medical School, Exeter, UK
| | - Claire Pentecost
- Institute of Health Research, University of Exeter Medical School, Exeter, UK
| | - David A Richards
- Institute of Health Research, University of Exeter Medical School, Exeter, UK
| |
Collapse
|
26
|
Shamy M, Fedyk M. Why the ethical justification of randomized clinical trials is a scientific question. J Clin Epidemiol 2018; 97:126-132. [DOI: 10.1016/j.jclinepi.2017.12.026] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Revised: 12/01/2017] [Accepted: 12/27/2017] [Indexed: 10/18/2022]
|
27
|
Molloy GJ, Noone C, Caldwell D, Welton NJ, Newell J. Network meta-analysis in health psychology and behavioural medicine: a primer. Health Psychol Rev 2018; 12:254-270. [DOI: 10.1080/17437199.2018.1457449] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Affiliation(s)
- G. J. Molloy
- School of Psychology, National University of Ireland, Galway, Ireland
| | - C. Noone
- School of Psychology, National University of Ireland, Galway, Ireland
| | - D. Caldwell
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - N. J. Welton
- School of Social and Community Medicine, University of Bristol, Bristol, UK
| | - J. Newell
- School of Mathematics, Statistics & Applied Mathematics, National University of Ireland, Galway, Ireland
| |
Collapse
|
28
|
Olsen M, Sharp MK, Bossuyt PM. From the theoretical to the practical: how to evaluate the ethical and scientific justifications of randomized clinical trials. J Clin Epidemiol 2018; 99:170-171. [PMID: 29596973 DOI: 10.1016/j.jclinepi.2018.03.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Accepted: 03/20/2018] [Indexed: 11/27/2022]
Affiliation(s)
- Maria Olsen
- Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands; INSERM, U1153 Epidemiology and Biostatistics Sorbonne Paris Cité Research Center (CRESS), Methods of Therapeutic Evaluation of Chronic Diseases Team (METHODS), Paris F-75014 France; Paris Descartes University, Sorbonne Paris Cité, France
| | - Melissa K Sharp
- INSERM, U1153 Epidemiology and Biostatistics Sorbonne Paris Cité Research Center (CRESS), Methods of Therapeutic Evaluation of Chronic Diseases Team (METHODS), Paris F-75014 France; Paris Descartes University, Sorbonne Paris Cité, France; Department of Psychology, Faculty of Humanities and Social Sciences, University of Split, Poljicka cesta 35, Split 2100, Croatia.
| | - Patrick M Bossuyt
- Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|