1
|
Pellen C, Munung NS, Armond AC, Kulp D, Mansmann U, Siebert M, Naudet F. Data management and sharing. J Clin Epidemiol 2025; 180:111680. [PMID: 39842522 DOI: 10.1016/j.jclinepi.2025.111680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2024] [Revised: 01/14/2025] [Accepted: 01/14/2025] [Indexed: 01/24/2025]
Abstract
Guided by the FAIR principles (Findable, Accessible, Interoperable, Reusable), responsible data sharing requires well-organized, high-quality datasets. However, researchers often struggle with implementing Data Management and Sharing Plans due to lack of knowledge on how to do this, time constraints, and legal, technical, and financial challenges, particularly concerning data ownership and privacy. While patients support data sharing, researchers and funders may hesitate, fearing the loss of intellectual property or competitive advantage. Although some journals and institutions encourage or mandate data sharing, further progress is needed. Additionally, global solutions are vital to ensure equitable participation from low- and middle-income countries. Ultimately, responsible data sharing requires strategic planning, cultural shifts in research, and coordinated efforts from all stakeholders to become standard practice in biomedical research.
Collapse
Affiliation(s)
- Claude Pellen
- University Rennes, CHU Rennes, Inserm, EHESP, Irset (Institut de recherche en santé, environnement et travail) - UMR_S 1085, Centre d'investigation clinique de Rennes (CIC1414), Rennes, France.
| | - Nchangwi Syntia Munung
- Division of Human Genetics, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
| | - Anna Catharina Armond
- Metaresearch and Open Science Program, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| | - Daniel Kulp
- American Urological Association, Linthicum, MD 21090, USA
| | - Ulrich Mansmann
- Institute for Medical Information Processing, Biometry and Epidemiology, Medical Faculty, LMU Munich, Marchioninistr. 15, 81377, Munich, Germany
| | - Maximilian Siebert
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA; Harvard-MIT Center for Regulatory Science, Harvard Medical School, Boston, MA, USA
| | - Florian Naudet
- University Rennes, CHU Rennes, Inserm, EHESP, Irset (Institut de recherche en santé, environnement et travail) - UMR_S 1085, Centre d'investigation clinique de Rennes (CIC1414), Rennes, France; Institut Universitaire de France (IUF), Paris, France
| |
Collapse
|
2
|
Verweij S, Weemers J, Jonker C, Pasmooij AMG. Learning from European regulator-initiated studies for regulatory decision making. Drug Discov Today 2025; 30:104256. [PMID: 39626797 DOI: 10.1016/j.drudis.2024.104256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Revised: 11/09/2024] [Accepted: 11/27/2024] [Indexed: 12/06/2024]
Abstract
Drug developers have displayed a growing interest in using real-word evidence (RWE) in the pre-marketing phase. Together with initiatives like DARWIN EU®, this interest encourages regulators to initiate their own observational clinical studies, which could be included in regulatory decision making. The Regulatory Science Network Netherlands (RSNN) organised an expert meeting in 2022 to discuss scenarios and learnings related to these regulator-initiated studies, of which the main points (e.g., transparency, independency and stakeholder interaction) have been published previously. In this review, the authors add their own views, underlining the importance of reproducibility and stakeholder interaction. Stakeholders should collaborate to embrace regulator-initiated studies in a timely and transparent manner to realise an optimal European framework for generating RWE to be included in the regulatory decision-making process.
Collapse
Affiliation(s)
- Stefan Verweij
- Dutch Medicines Evaluation Board, Utrecht, the Netherlands; Unit of PharmacoTherapy, Epidemiology and Economics, Groningen Research Institute of Pharmacy, Groningen University, Groningen, the Netherlands.
| | - Just Weemers
- Janssen Biologics BV, Leiden, the Netherlands; Regulatory Science Network Netherlands, Utrecht, the Netherlands
| | - Carla Jonker
- Dutch Medicines Evaluation Board, Utrecht, the Netherlands
| | - Anna Maria Gerdina Pasmooij
- Dutch Medicines Evaluation Board, Utrecht, the Netherlands; Regulatory Science Network Netherlands, Utrecht, the Netherlands
| |
Collapse
|
3
|
Dal-Ré R, Bekker LG, Jha V, Le Louarn A, Naudet F. Navigating US participant data sharing requirements: implications for international clinical trials. BMJ 2024; 386:e079701. [PMID: 39242115 DOI: 10.1136/bmj-2024-079701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/09/2024]
Affiliation(s)
- Rafael Dal-Ré
- Epidemiology Unit, Health Research Institute-Fundación Jiménez Díaz University Hospital, Universidad Autónoma de Madrid, Madrid, Spain
| | - Linda-Gail Bekker
- Desmond Tutu HIV Centre, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, South Africa
| | - Vivekanand Jha
- George Institute for Global Health, UNSW, New Delhi, India
- Prasanna School of Public Health, Manipal Academy of Higher Education, Manipal, India
- School of Public Health, Imperial College, London, UK
| | - Anne Le Louarn
- GCS Comité National de Coordination de la Recherche (CNCR), Paris, France
| | - Florian Naudet
- University of Rennes, CHU Rennes, Inserm, EHESP, Irset (Institut de recherche en santé, environnement et travail) -UMR-S 1085, Centre d'investigation clinique de Rennes (CIC1414), Rennes, France
- University Institute of France, Paris, France
| |
Collapse
|
4
|
Olivier T, Haslam A, Prasad V. Health-related quality of life in trials with high rates of early censoring: Caution advised. Eur J Cancer 2024; 205:114105. [PMID: 38718724 DOI: 10.1016/j.ejca.2024.114105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 04/28/2024] [Accepted: 05/01/2024] [Indexed: 06/09/2024]
Abstract
Health-related quality-of-life (HRQoL) data are central to capturing the quality of patients' life, while endpoints like overall survival (OS) focus on the quantity of life. When analyzing HRQoL data gathered from patients in a randomized trial, a key consideration is the completion rate - indicating the proportion of patients remaining in the trial and with completed questionnaires. When completion rates are disproportionately low in one treatment arm, one likely explanation is that patients who did not complete questionnaires suffered more from toxicities, negatively impacting their HRQoL. This is likely the case when low completion rates occur in the more toxic arm within a randomized trial. If the HRQoL analysis is run as a complete-case analysis - only considering patients without missing data - a decrement in HRQoL can be missed. Conversely, when completion rates are high, the HRQoL data are thought to be more reliable, and informative censoring is less likely. We describe why this reasoning can be inadequate. In trials where high and imbalanced rates of early censoring affect progression-free survival or OS endpoints, the completion rates only apply to the fraction of patients remaining in the trial. In those, HRQoL results should be considered with caution, and reasons for censoring in the primary time-to-event analyses should be explored before making definite conclusions about HRQoL. This is even more relevant in trials with non-inferiority design, where a benefit in HRQoL could be used as a justification to modify practice.
Collapse
Affiliation(s)
- Timothée Olivier
- Oncology Service, Geneva University Hospital, 4 Gabrielle-Perret-Gentil Street, 1205 Geneva, Switzerland.
| | - Alyson Haslam
- Department of Epidemiology and Biostatistics, University of California San Francisco, 550 16th St, 2nd Fl, San Francisco, CA 94158, USA
| | - Vinay Prasad
- Department of Epidemiology and Biostatistics, University of California San Francisco, 550 16th St, 2nd Fl, San Francisco, CA 94158, USA
| |
Collapse
|
5
|
Dulitzki C, Crane SM, Hardwicke TE, Ioannidis JPA. Expanding the data Ark: an attempt to make the data from highly cited social science papers publicly available. ROYAL SOCIETY OPEN SCIENCE 2024; 11:240016. [PMID: 39076822 PMCID: PMC11285638 DOI: 10.1098/rsos.240016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 04/19/2024] [Indexed: 07/31/2024]
Abstract
Access to scientific data can enable independent reuse and verification; however, most data are not available and become increasingly irrecoverable over time. This study aimed to retrieve and preserve important datasets from 160 of the most highly-cited social science articles published between 2008-2013 and 2015-2018. We asked authors if they would share data in a public repository-the Data Ark-or provide reasons if data could not be shared. Of the 160 articles, data for 117 (73%, 95% CI [67%-80%]) were not available and data for 7 (4%, 95% CI [0%-12%]) were available with restrictions. Data for 36 (22%, 95% CI [16%-30%]) articles were available in unrestricted form: 29 of these datasets were already available and 7 datasets were made available in the Data Ark. Most authors did not respond to our data requests and a minority shared reasons for not sharing, such as legal or ethical constraints. These findings highlight an unresolved need to preserve important scientific datasets and increase their accessibility to the scientific community.
Collapse
Affiliation(s)
- Coby Dulitzki
- Department of Biology, Stanford University, Stanford, CA, USA
| | - Steven Michael Crane
- Stanford Prevention Research Center, Stanford School of Medicine, Stanford, CA, USA
| | - Tom E. Hardwicke
- School of Psychological Sciences, University of Melbourne, Melbourne, Australia
| | - John P. A. Ioannidis
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
- Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, Stanford University, Stanford, CA, USA
- Stanford Prevention Research Center, Stanford School of Medicine, Stanford, CA, USA
| |
Collapse
|
6
|
Siebert M, Ioannidis JPA. Lifting of Embargoes to Data Sharing in Clinical Trials Published in Top Medical Journals. JAMA 2024; 331:354-355. [PMID: 38153703 PMCID: PMC10807254 DOI: 10.1001/jama.2023.25394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 11/17/2023] [Indexed: 12/29/2023]
Abstract
This study assesses data sharing status and lifting of embargoes in randomized clinical trials from top medical journals 3 to 5 years after publication.
Collapse
Affiliation(s)
- Maximilian Siebert
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California
| | - John P. A. Ioannidis
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California
| |
Collapse
|
7
|
Anthony N, Tisseaux A, Naudet F. Published registered reports are rare, limited to one journal group, and inadequate for randomized controlled trials in the clinical field. J Clin Epidemiol 2023; 160:61-70. [PMID: 37245701 DOI: 10.1016/j.jclinepi.2023.05.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 05/16/2023] [Accepted: 05/22/2023] [Indexed: 05/30/2023]
Abstract
OBJECTIVE Registered reports (RR) are a publication format implying a peer-review of the protocol before the start of the study, followed by an in-principle acceptance (IPA) by the journal before the study starts. We aimed to describe randomized controlled trials (RCTs) in the clinical field published as RR. STUDY DESIGN AND SETTING This cross-sectional study included RR results for RCTs, identified on PubMed/Medline and on a list compiled by the Center for Open Science. It explored the proportion of reports that received IPA (and/or published a protocol before inclusion of the first patient) and changes in the primary outcome. RESULTS A total of 93 RCTs publications identified as RR were included. All but one were published in the same journal group. The date of the IPA was never documented. For most of these reports (79/93, 84.9%), a protocol was published after the date of inclusion of the first patient. A change in the primary outcome was noted in 40/93 (44%) of them. Thirteen of the 40 (33%) mentioned this change. CONCLUSIONS RCTs in the clinical field identified as RR were rare, originated from a single journal group, and did not comply with the basic features of this format.
Collapse
Affiliation(s)
- Norah Anthony
- National Institute of Health and Medical Research (INSERM), CIC 1410 Saint Pierre, Reunion Island.
| | - Antoine Tisseaux
- National Institute of Health and Medical Research (INSERM), CIC 1410 Saint Pierre, Reunion Island
| | - Florian Naudet
- Univ Rennes, CHU Rennes, Inserm, Irset (Institut de recherche en santé, environnement et travail) - UMR_S 1085, CIC 1414 [(Centre d'Investigation Clinique de Rennes)], F-35000 Rennes, France; Institut Universitaire de France (IUF), Paris, France
| |
Collapse
|
8
|
Siebert M, Naudet F, Ioannidis JPA. Peer review before trial conduct could increase research value and reduce waste. J Clin Epidemiol 2023; 160:141-146. [PMID: 37286150 DOI: 10.1016/j.jclinepi.2023.05.024] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 05/24/2023] [Accepted: 05/30/2023] [Indexed: 06/09/2023]
Affiliation(s)
- Maximilian Siebert
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA.
| | - Florian Naudet
- Univ Rennes, CHU Rennes, Inserm, Centre d'investigation clinique de Rennes (CIC1414), service de pharmacologie clinique, Institut de recherche en santé, environnement et travail (Irset), UMR S 1085, EHESP, Rennes 35000, France; Institut Universitaire de France, Paris, France
| | - John P A Ioannidis
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA; Departments of Medicine, of Epidemiology, of Biomedical Data Science, and of Statistics, Stanford University, Stanford, CA 94305, USA
| |
Collapse
|
9
|
Olivier T, Haslam A, Prasad V. Omission of Critical Information From Clinical Trial Reports-What to Do About Uninterpretable Results. JAMA Oncol 2023; 9:459-460. [PMID: 36821106 DOI: 10.1001/jamaoncol.2022.7182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023]
Abstract
This Viewpoint identifies incomplete and missing data in 3 clinical trials to highlight the need for improved data reporting and to propose possible solutions.
Collapse
Affiliation(s)
- Timothée Olivier
- Department of Oncology, Geneva University Hospital, Geneva, Switzerland.,Department of Epidemiology and Biostatistics, University of California, San Francisco
| | - Alyson Haslam
- Department of Epidemiology and Biostatistics, University of California, San Francisco
| | - Vinay Prasad
- Department of Epidemiology and Biostatistics, University of California, San Francisco
| |
Collapse
|
10
|
Implementing clinical trial data sharing requires training a new generation of biomedical researchers. Nat Med 2023; 29:298-301. [PMID: 36732626 DOI: 10.1038/s41591-022-02080-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
|
11
|
Barros JM, Widmer LA, Baillie M, Wandel S. Rethinking clinical study data: why we should respect analysis results as data. Sci Data 2022; 9:686. [PMID: 36357430 PMCID: PMC9649650 DOI: 10.1038/s41597-022-01789-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 10/18/2022] [Indexed: 11/12/2022] Open
Abstract
The development and approval of new treatments generates large volumes of results, such as summaries of efficacy and safety. However, it is commonly overlooked that analyzing clinical study data also produces data in the form of results. For example, descriptive statistics and model predictions are data. Although integrating and putting findings into context is a cornerstone of scientific work, analysis results are often neglected as a data source. Results end up stored as "data products" such as PDF documents that are not machine readable or amenable to future analyses. We propose a solution to "calculate once, use many times" by combining analysis results standards with a common data model. This analysis results data model re-frames the target of analyses from static representations of the results (e.g., tables and figures) to a data model with applications in various contexts, including knowledge discovery. Further, we provide a working proof of concept detailing how to approach standardization and construct a schema to store and query analysis results.
Collapse
Affiliation(s)
- Joana M Barros
- Analytics, Novartis Pharma AG, Basel, Switzerland.
- Department of Biometry, Idorsia Pharmaceuticals, Allschwil, Switzerland.
| | | | - Mark Baillie
- Analytics, Novartis Pharma AG, Basel, Switzerland.
| | - Simon Wandel
- Analytics, Novartis Pharma AG, Basel, Switzerland
| |
Collapse
|
12
|
DeVito NJ, Morton C, Cashin AG, Richards GC, Lee H. Sharing study materials in health and medical research. BMJ Evid Based Med 2022:bmjebm-2022-111987. [PMID: 36162960 DOI: 10.1136/bmjebm-2022-111987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 09/03/2022] [Indexed: 11/04/2022]
Abstract
Making study materials available allows for a more comprehensive understanding of the scientific literature. Sharing can take many forms and include a wide variety of outputs including code and data. Biomedical research can benefit from increased transparency but faces unique challenges for sharing, for instance, confidentiality concerns around participants' medical data. Both general and specialised repositories exist to aid in sharing most study materials. Sharing may also require skills and resources to ensure that it is done safely and effectively. Educating researchers on how to best share their materials, and properly rewarding these practices, requires action from a variety of stakeholders including journals, funders and research institutions.
Collapse
Affiliation(s)
- Nicholas J DeVito
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, UK
| | - Caroline Morton
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, UK
| | - Aidan Gregory Cashin
- School of Health Sciences, University of New South Wales, Sydney, New South Wales, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Randwick, New South Wales, Australia
| | - Georgia C Richards
- Centre for Evidence Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, UK
| | - Hopin Lee
- Centre for Statistics in Medicine & Rehabilitation Research in Oxford, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences (NDORMS), University of Oxford, Oxford, Oxfordshire, UK
- School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia
| |
Collapse
|