1
|
Hopewell S, Chan AW, Collins GS, Hróbjartsson A, Moher D, Schulz KF, Tunn R, Aggarwal R, Berkwits M, Berlin JA, Bhandari N, Butcher NJ, Campbell MK, Chidebe RCW, Elbourne D, Farmer A, Fergusson DA, Golub RM, Goodman SN, Hoffmann TC, Ioannidis JPA, Kahan BC, Knowles RL, Lamb SE, Lewis S, Loder E, Offringa M, Ravaud P, Richards DP, Rockhold FW, Schriger DL, Siegfried NL, Staniszewska S, Taylor RS, Thabane L, Torgerson D, Vohra S, White IR, Boutron I. CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials. BMJ 2025; 389:e081124. [PMID: 40228832 PMCID: PMC11995452 DOI: 10.1136/bmj-2024-081124] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/21/2025] [Indexed: 04/16/2025]
Affiliation(s)
- Sally Hopewell
- Oxford Clinical Trials Research Unit, Centre for Statistics in Medicine, University of Oxford, Oxford OX3 7LD, UK
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, ON, Canada
| | - Gary S Collins
- UK EQUATOR Centre, Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Asbjørn Hróbjartsson
- Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Open Patient data Explorative Network, Odense University Hospital, Odense, Denmark
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Programme, Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Kenneth F Schulz
- Department of Obstetrics and Gynecology, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Ruth Tunn
- Oxford Clinical Trials Research Unit, Centre for Statistics in Medicine, University of Oxford, Oxford OX3 7LD, UK
| | - Rakesh Aggarwal
- Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India
| | - Michael Berkwits
- Office of Science Dissemination, Centers for Disease Control and Prevention, Atlanta, GA, USA
| | - Jesse A Berlin
- Department of Biostatistics and Epidemiology, School of Public Health, Center for Pharmacoepidemiology and Treatment Science, Rutgers University, New Brunswick, NJ, USA
- JAMA Network Open, Chicago, IL, USA
| | - Nita Bhandari
- Centre for Health Research and Development, Society for Applied Studies, New Delhi, India
| | - Nancy J Butcher
- Child Health Evaluation Services, The Hospital for Sick Children Research Institute, Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Marion K Campbell
- Aberdeen Centre for Evaluation, University of Aberdeen, Aberdeen, UK
| | - Runcie C W Chidebe
- Project PINK BLUE - Health & Psychological Trust Centre, Utako, Abuja, Nigeria
- Department of Sociology and Gerontology, Miami University, OH, USA
| | - Diana Elbourne
- Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK
| | - Andrew Farmer
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | | | - Robert M Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Steven N Goodman
- Department of Epidemiology and Population Health, Stanford University, Palo Alto, CA, USA
| | - Tammy C Hoffmann
- Institute for Evidence-Based Healthcare, Faculty of Health Sciences and Medicine, Bond University, University Drive, Robina, QLD, Australia
| | - John P A Ioannidis
- Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
| | - Brennan C Kahan
- MRC Clinical Trials Unit at University College London, London, UK
| | - Rachel L Knowles
- University College London, UCL Great Ormond Street Institute of Child Health, London, UK
| | - Sarah E Lamb
- NIHR Exeter Biomedical Research Centre, Faculty of Health and Life Sciences, University of Exeter, Exeter, UK
| | - Steff Lewis
- Edinburgh Clinical Trials Unit, Usher Institute-University of Edinburgh, Edinburgh BioQuarter, Edinburgh, UK
| | - Elizabeth Loder
- The BMJ, BMA House, London, UK
- Harvard Medical School, Boston, MA, USA
| | - Martin Offringa
- Child Health Evaluation Services, The Hospital for Sick Children Research Institute, Toronto, ON, Canada
| | - Philippe Ravaud
- Université Paris Cité, Inserm, INRAE, Centre de Recherche Epidémiologie et Statistiques, Université Paris Cité, Paris, France
| | | | - Frank W Rockhold
- Duke Clinical Research Institute, Duke University Medical Center, Durham, NC, USA
| | - David L Schriger
- Department of Emergency Medicine, University of California, Los Angeles, CA, USA
| | | | - Sophie Staniszewska
- Warwick Research in Nursing, Warwick Medical School, University of Warwick, Coventry, UK
| | - Rod S Taylor
- MRC/CSO Social and Public Health Sciences Unit & Robertson Centre for Biostatistics, Institute of Health and Wellbeing, University of Glasgow, Glasgow, UK
| | - Lehana Thabane
- Department of Health Research Methods Evidence and Impact, McMaster University, Hamilton, ON, Canada
- St Joseph's Healthcare Hamilton, Hamilton, ON, Canada
| | - David Torgerson
- York Trials Unit, Department of Health Sciences, University of York, York, UK
| | - Sunita Vohra
- Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Ian R White
- MRC Clinical Trials Unit at University College London, London, UK
| | - Isabelle Boutron
- Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAE, Centre for Research in Epidemiology and Statistics (CRESS), Paris, France
- Centre d'Epidémiologie Clinique, Hôpital Hôtel Dieu, AP-HP, Paris, France
| |
Collapse
|
2
|
Kahrass H, Schnarr A, Faggion CM, Mertz M. Ethics domains in full health technology assessment reports: an attempt to begin mapping the field. Int J Technol Assess Health Care 2025; 41:e22. [PMID: 40197516 PMCID: PMC12019511 DOI: 10.1017/s026646232400480x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 10/11/2024] [Accepted: 11/04/2024] [Indexed: 04/10/2025]
Abstract
INTRODUCTION Health technology assessment (HTA) reports are written for healthcare decision makers, particularly in relation to reimbursement/pricing, and are intended to assess clinical effectiveness, safety, and cost. Four additional domains are further considered in what is called a "full HTA": ethical, legal, social, and organizational aspects. The ethical aspects have long been the subject of debate regarding how they should be processed. It would be important if the following questions could be answered: Who publishes full HTA reports and how? Which methods are used in the ethics domain? What kind of results do they produce? However, such a "mapping of the field" turns out to be difficult. Despite the existence of international HTA registers, we were not able to compile a comprehensive sample of full HTA reports. Therefore, the aim of our study was rather to explore a) substantially: Which information can be expected to be (easily) found, which can only be obtained with considerable effort, and which remain (for the time being) in the dark? And b) methodologically: Is it possible to do meaningful meta-research in this field? METHODS AND RESULTS In the attempt to explore the possibilities of meta-research, we were able to track down and analyze thirty-nine full HTA reports from six countries. CONCLUSIONS While not representative of the whole field, this analysis shows the possibilities and challenges to meta-research, but nonetheless also provides some substantial insight into the characteristics of such reports, with a particular focus on the methods used to process ethical aspects.
Collapse
Affiliation(s)
- Hannes Kahrass
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hannover, Germany
| | - Antje Schnarr
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hannover, Germany
| | - Clovis Mariano Faggion
- Department of Periodontology and Operative Dentistry, University Hospital Münster, Münster, Germany
| | - Marcel Mertz
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hannover, Germany
| |
Collapse
|
3
|
Franzen DL, Salholz-Hillel M, Müller-Ohlraun S, Strech D. Improving research transparency with individualized report cards: A feasibility study in clinical trials at a large university medical center. BMC Med Res Methodol 2025; 25:37. [PMID: 39948475 PMCID: PMC11823227 DOI: 10.1186/s12874-025-02482-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 01/21/2025] [Indexed: 02/17/2025] Open
Abstract
BACKGROUND Research transparency is crucial for ensuring the relevance, integrity, and reliability of scientific findings. However, previous work indicates room for improvement across transparency practices. The primary objective of this study was to develop an extensible tool to provide individualized feedback and guidance for improved transparency across phases of a study. Our secondary objective was to assess the feasibility of implementing this tool to improve transparency in clinical trials. METHODS We developed study-level "report cards" that combine tailored feedback and guidance to investigators across several transparency practices, including prospective registration, availability of summary results, and open access publication. The report cards were generated through an automated pipeline for scalability. We also developed an infosheet to summarize relevant laws, guidelines, and resources relating to transparency. To assess the feasibility of using these tools to improve transparency, we conducted a single-arm intervention study at Berlin's university medical center, the Charité - Universitätsmedizin Berlin. Investigators (n = 92) of 155 clinical trials were sent individualized report cards and the infosheet, and surveyed to assess their perceived usefulness. We also evaluated included trials for improvements in transparency following the intervention. RESULTS Survey responses indicated general appreciation for the report cards and infosheet, with a majority of participants finding them helpful to build awareness of the transparency of their trial and transparency requirements. However, improvement on transparency practices was minimal and largely limited to linking publications in registries. Investigators also commented on various challenges associated with implementing transparency, including a lack of clarity around best practices and institutional hurdles. CONCLUSIONS This study demonstrates the potential of developing and using tools, such as report cards, to provide individualized feedback at scale to investigators on the transparency of their study. While these tools were positively received by investigators, the limited improvement in transparency practices suggests that awareness alone is likely not sufficient to drive improvement. Future research and implementation efforts may adapt the tools to further practices or research areas, and explore integrated approaches that combine the report cards with incentives and institutional support to effectively strengthen transparency in research.
Collapse
Affiliation(s)
- Delwen L Franzen
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany.
| | - Maia Salholz-Hillel
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany.
| | - Stephanie Müller-Ohlraun
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany
| | - Daniel Strech
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany
| |
Collapse
|
4
|
Nilsonne G, Wieschowski S, DeVito NJ, Salholz-Hillel M, Ahnström L, Bruckner T, Klas K, Suljic T, Yerunkar S, Olsson N, Cruz C, Strzebonska K, Småbrekke L, Wasylewski MT, Bengtsson J, Ringsten M, Schuster A, Krawczyk T, Paraskevas T, Raittio E, Herczeg L, Hesselberg JO, Karlsson S, Borana R, Bruschettini M, Mulinari S, Lizárraga K, Siebert M, Hildebrand N, Ramakrishnan S, Janiaud P, Zavalis E, Franzen D, Boesen K, Hemkens LG, Naudet F, Possmark S, Willén RM, Ioannidis JPA, Strech D, Axfors C. Results reporting for clinical trials led by medical universities and university hospitals in the nordic countries was often missing or delayed. J Clin Epidemiol 2025; 181:111710. [PMID: 39900256 DOI: 10.1016/j.jclinepi.2025.111710] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Revised: 12/16/2024] [Accepted: 01/29/2025] [Indexed: 02/05/2025]
Abstract
OBJECTIVES To systematically evaluate timely reporting of clinical trial results at medical universities and university hospitals in the Nordic countries. STUDY DESIGN AND SETTING In this cross-sectional study, we included trials (regardless of intervention) registered in the European Union (EU) Clinical Trials Registry and/or ClinicalTrials.gov, completed 2016-2019 and led by a university with medical faculty or university hospital in Denmark, Finland, Iceland, Norway, or Sweden. We identified summary results posted at the trial registries and conducted systematic manual searches for results publications (eg, journal articles, preprints). We present proportions with 95% confidence intervals (CI) and medians with interquartile range (IQR). PROTOCOL https://osf.io/wua3r. RESULTS Among 2112 included clinical trials, 1650 (78.1%, 95% CI 76.3%-79.8%) reported any results during our follow-up; 1097 (51.9%, 95% CI 49.8%-54.1%) reported any results within 2 years of the global completion date; and 48 (2.3%, 95% CI 1.7%-3.0%) posted summary results in the registry within 1 year. The median time from global completion date to results reporting was 690 days (IQR 1103). 856/1681 (50.9%) of ClinicalTrials.gov registrations were prospective. Denmark contributed approximately half of all trials. Reporting performance varied widely between institutions. CONCLUSION Missing and delayed results reporting of academically led clinical trials are a pervasive problem in the Nordic countries. We relied on trial registry information, which can be incomplete. Institutions, funders, and policymakers need to support trial teams, ensure regulation adherence, and secure trial reporting before results are permanently lost. PLAIN LANGUAGE SUMMARY Reporting of results from clinical trials is necessary for evidence-based clinical decision-making. We followed up reporting of clinical trials in the Nordic countries sponsored by medical universities and university hospitals. Of 2112 studies completed 2016-2019 in two major trials registries, about half reported results in any form within 24 months, and more than one in five did not report results at all. These results show that there is a need for improvement in the reporting of Nordic clinical trials.
Collapse
Affiliation(s)
- Gustav Nilsonne
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Department of Psychology, Stockholm University, Stockholm, Sweden; QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany.
| | - Susanne Wieschowski
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Nicholas J DeVito
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, Oxfordshire, UK
| | - Maia Salholz-Hillel
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Love Ahnström
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Till Bruckner
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; UiT The Arctic University of Norway, Tromsø, Norway; TranspariMED, Stockholm, Sweden
| | - Katarzyna Klas
- Research Ethics in Medicine Study Group (REMEDY), Jagiellonian University Medical College, Krakow, Poland
| | - Tarik Suljic
- Faculty of Medicine, University of Sarajevo, Sarajevo, Bosnia and Herzegovina
| | - Samruddhi Yerunkar
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Natasha Olsson
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | | | - Karolina Strzebonska
- Research Ethics in Medicine Study Group (REMEDY), Jagiellonian University Medical College, Krakow, Poland
| | - Lars Småbrekke
- Faculty of Health Sciences, Department of Pharmacy, UiT The Arctic University of Norway, Tromsø, Norway
| | - Mateusz T Wasylewski
- Research Ethics in Medicine Study Group (REMEDY), Jagiellonian University Medical College, Krakow, Poland
| | - Johan Bengtsson
- Department of Medical Sciences, Uppsala University, Uppsala, Sweden
| | - Martin Ringsten
- Cochrane Sweden, Department of Research and Education, Skåne University Hospital, Lund University, Lund, Sweden
| | - Aminul Schuster
- School of Life Sciences, University of Westminster, London, UK
| | - Tomasz Krawczyk
- Research Ethics in Medicine Study Group (REMEDY), Jagiellonian University Medical College, Krakow, Poland
| | | | - Eero Raittio
- Department of Dentistry and Oral Health, Aarhus University, Aarhus, Denmark; Institute of Dentistry, University of Eastern Finland, Kuopio, Finland
| | | | | | - Sofia Karlsson
- Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, Stockholm, Sweden
| | | | - Matteo Bruschettini
- Division of Paediatrics, Department of Clinical Sciences Lund, Lund University, Skåne University Hospital, Lund, Sweden; Cochrane Sweden, Department of Research and Education, Skåne University Hospital, Lund University, Lund, Sweden
| | - Shai Mulinari
- Department of Sociology, Lund University, Lund, Sweden
| | - Karely Lizárraga
- University Center of Health Sciences (Centro universitario de ciencias de la salud, CUCS), University of Guadalajara, Guadalajara, Mexico
| | - Maximilian Siebert
- Meta-research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
| | - Nicole Hildebrand
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Shreya Ramakrishnan
- Academy of Scientific and Innovative Research, Ghaziabad, India; Indian Institute of Public Health, Hyderabad, India
| | - Perrine Janiaud
- Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland; Department of Clinical Research, University Hospital Basel, and University of Basel, Basel, Switzerland
| | - Emmanuel Zavalis
- Department of Learning Informatics Management and Ethics, Karolinska Institutet, Stockholm, Sweden; Meta-research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA
| | - Delwen Franzen
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Kim Boesen
- Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and, University of Basel, Basel, Switzerland
| | - Lars G Hemkens
- Department of Clinical Research, University Hospital Basel, and University of Basel, Basel, Switzerland; Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
| | - Florian Naudet
- University Rennes, CHU Rennes, Inserm, Centre d'investigation clinique de Rennes (CIC1414), service de pharmacologie clinique, Institut de recherche en santé, environnement et travail (Irset), UMR S 1085, EHESP, Rennes 35000, France; Institut Universitaire de France, Paris, France
| | - Sofie Possmark
- Compliance & Data Office, Karolinska Institutet, Stockholm, Sweden
| | - Rebecca M Willén
- Department of Criminology and Police Work, Linnaeus University, Växjö, Sweden; Institute for Globally Distributed Open Research and Education (IGDORE), Gothenburg, Sweden
| | - John P A Ioannidis
- Meta-research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA; Department of Medicine, Stanford University, Stanford, CA, USA
| | - Daniel Strech
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Cathrine Axfors
- Meta-research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA; Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland; Department of Epidemiology and Population Health, Stanford University, Stanford, California, USA; Department of Biomedical Data Science, Stanford University, Stanford, CA, USA; Department of Statistics, Stanford University, Stanford, California, USA; Department for Women's and Children's Health, Uppsala University, Uppsala, Sweden
| |
Collapse
|
5
|
DeVito NJ, Morley J, Goldacre B. Barriers and best practices to improving clinical trials transparency at UK public research institutions: A qualitative interview study. Health Policy 2024; 142:104991. [PMID: 38417375 DOI: 10.1016/j.healthpol.2024.104991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 12/22/2023] [Accepted: 01/08/2024] [Indexed: 03/01/2024]
Abstract
OBJECTIVES Since 2017, the UK government has made concerted efforts to ensure the dissemination of clinical trials conducted at public research institutions. This study aims to understand how stakeholders within these institutions responded to these pressures and modified internal policies and processes while identifying best practices and barriers to improved transparency practice. METHODS Research governance and trial management staff from UK public research institutions (i.e., Universities and NHS Trusts) in England, Scotland and Wales participated in semi-structured interviews. Interviews were analysed using thematic analysis, aided by the framework method. RESULTS Between November 2020 and July 2021, 14 individual participants were recruited from 11 different institutions. They worked in research governance, administration, and management. Almost universally, new policies and procedures have been established to ensure investigators are aware of, and supported in, fulfilling their transparency commitments, however challenges remain. Trials of medicinal products, as the most closely regulated research, consequently received the most attention. National professional networks aid in sharing knowledge and best practice within this community. CONCLUSIONS Investment in the institutional governance of transparency is essential to achieving optimal transparency practices. Universities and hospitals share responsibility for ensuring research is performed and reported to regulatory standards. Facing political pressure, public research institutions in the UK have made efforts to improve their transparency practice which can provide key insights for similar efforts elsewhere.
Collapse
Affiliation(s)
- Nicholas J DeVito
- Nuffield Department of Primary Care Health Science, University of Oxford, Oxford, United Kingdom.
| | - Jessica Morley
- Nuffield Department of Primary Care Health Science, University of Oxford, Oxford, United Kingdom
| | - Ben Goldacre
- Nuffield Department of Primary Care Health Science, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
6
|
DeVito NJ, Morley J, Smith JA, Drysdale H, Goldacre B, Heneghan C. Availability of results of clinical trials registered on EU Clinical Trials Register: cross sectional audit study. BMJ MEDICINE 2024; 3:e000738. [PMID: 38274035 PMCID: PMC10806997 DOI: 10.1136/bmjmed-2023-000738] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 11/30/2023] [Indexed: 01/27/2024]
Abstract
Objective To identify the availability of results for trials registered on the European Union Clinical Trials Register (EUCTR) compared with other dissemination routes to understand its value as a results repository. Design Cross sectional audit study. Setting EUCTR protocols and results sections, data extracted 1-3 December 2020. Population Random sample of 500 trials registered on EUCTR with a completion date of more than two years from the beginning of searches (ie, 1 December 2018). Main outcome measures Proportion of trials with results across the examined dissemination routes (EUCTR, ClinicalTrials.gov, ISRCTN registry, and journal publications), and for each dissemination route individually. Prespecified secondary outcomes were number and proportion of unique results, and the timing of results, for each dissemination route. Results In the sample of 500 trials, availability of results on EUCTR (53.2%, 95% confidence interval 48.8% to 57.6%) was similar to the peer reviewed literature (58.6%, 54.3% to 62.9%) and exceeded the proportion of results available on other registries with matched records. Among the 383 trials with any results, 55 (14.4%, 10.9% to 17.9%) were only available on EUCTR. Also, after the launch of the EUCTR results database, median time to results was fastest on EUCTR (1142 days, 95% confidence interval 812 to 1492), comparable with journal publications (1226 days, 1074 to 1551), and exceeding ClinicalTrials.gov (3321 days, 1653 to undefined). For 117 trials (23.4%, 19.7% to 27.1%), however, results were published elsewhere but not submitted to the EUCTR registry, and no results were located in any dissemination route for 117 trials (23.4%, 19.7% to 27.1). Conclusions EUCTR should be considered in results searches for systematic reviews and can help researchers and the public to access the results of clinical trials, unavailable elsewhere, in a timely way. Reporting requirements, such as the EU's, can help in avoiding research waste by ensuring results are reported. The registry's true value, however, is unrealised because of inadequate compliance with EU guidelines, and problems with data quality that complicate the routine use of the registry. As the EU transitions to a new registry, continuing to emphasise the importance of EUCTR and the provision of timely and complete data is critical. For the future, EUCTR will still hold important information from the past two decades of clinical research in Europe. With increased efforts from sponsors and regulators, the registry can continue to grow as a source of results of clinical trials, many of which might be unavailable from other dissemination routes.
Collapse
Affiliation(s)
- Nicholas J DeVito
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Jessica Morley
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - James Andrew Smith
- Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford Medical Sciences Division, Oxford, UK
| | - Henry Drysdale
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Ben Goldacre
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Carl Heneghan
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
7
|
Salholz-Hillel M, Pugh-Jones M, Hildebrand N, Schult TA, Schwietering J, Grabitz P, Carlisle BG, Goldacre B, Strech D, DeVito NJ. Dissemination of Registered COVID-19 Clinical Trials (DIRECCT): a cross-sectional study. BMC Med 2023; 21:475. [PMID: 38031096 PMCID: PMC10687901 DOI: 10.1186/s12916-023-03161-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 11/07/2023] [Indexed: 12/01/2023] Open
Abstract
BACKGROUND The results of clinical trials should be completely and rapidly reported during public health emergencies such as COVID-19. This study aimed to examine when, and where, the results of COVID-19 clinical trials were disseminated throughout the first 18 months of the pandemic. METHODS Clinical trials for COVID-19 treatment or prevention were identified from the WHO ICTRP database. All interventional trials with a registered completion date ≤ 30 June 2021 were included. Trial results, published as preprints, journal articles, or registry results, were located using automated and manual techniques across PubMed, Google Scholar, Google, EuropePMC, CORD-19, the Cochrane COVID-19 Study Register, and clinical trial registries. Our main analysis reports the rate of dissemination overall and per route, and the time from registered completion to results using Kaplan-Meier methods, with additional subgroup and sensitivity analyses reported. RESULTS Overall, 1643 trials with completion dates ranging from 46 to 561 days prior to the start of results searches were included. The cumulative probability of reporting was 12.5% at 3 months from completion, 21.6% at 6 months, and 32.8% at 12 months. Trial results were most commonly disseminated in journals (n = 278 trials, 69.2%); preprints were available for 194 trials (48.3%), 86 (44.3%) of which converted to a full journal article. Trials completed earlier in the pandemic were reported more rapidly than those later in the pandemic, and those involving ivermectin were more rapidly reported than other common interventions. Results were robust to various sensitivity analyses except when considering only trials in a "completed" status on the registry, which substantially increased reporting rates. Poor trial registry data on completion status and dates limits the precision of estimates. CONCLUSIONS COVID-19 trials saw marginal increases in reporting rates compared to standard practice; most registered trials failed to meet even the 12-month non-pandemic standard. Preprints were common, complementing journal publication; however, registries were underutilized for rapid reporting. Maintaining registry data enables accurate representation of clinical research; failing to do so undermines these registries' use for public accountability and analysis. Addressing rapid reporting and registry data quality must be emphasized at global, national, and institutional levels.
Collapse
Affiliation(s)
- Maia Salholz-Hillel
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Molly Pugh-Jones
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Nicole Hildebrand
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Tjada A Schult
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Johannes Schwietering
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Peter Grabitz
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Benjamin Gregory Carlisle
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Ben Goldacre
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Daniel Strech
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charite Universitätsmedizin Berlin, Berlin, Germany
| | - Nicholas J DeVito
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK.
| |
Collapse
|
8
|
Thiele C, Hirschfeld G. An observational study on the adherence to study registrations in German interventional and observational studies from various fields. PeerJ 2023; 11:e16015. [PMID: 37780396 PMCID: PMC10538302 DOI: 10.7717/peerj.16015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 08/10/2023] [Indexed: 10/03/2023] Open
Abstract
Background The registration of studies, especially in the case of clinical trials, is required by the declaration of Helsinki and the policies of various scientific journals. However, numerous analyses have found considerable discrepancies between published articles and accompanying trial registrations. The aim of this study is to assess such discrepancies for a sample of studies with recruiting locations in Germany. Additionally, the association between the adherence to registrations and possible involvement of Coordinating Centers for Clinical Studies (KKS) as well as Universities of Excellence was tested. Methods For a sample of 376 interventional or observational study registrations, we found 115 published articles. Subsequently, we searched for discrepancies in the study design, the key inclusion criteria, the interventions, the blinding, and a primary and a secondary outcome. Results We found discrepancies in 26% of all studies, most frequently in the secondary outcomes, where 16.5% of the secondary outcomes per study that were registered in most detail had discrepancies. When running regression models for adherence discrepancies, the only variable that had a statistically significant association with better adherence was registration on ClinicalTrials.gov. The association of potential involvement of a KKS with adherence ratings was positive, too, but statistically insignificant. Conclusions In summary, the amount of discrepancies between registrations and published articles remains elevated.
Collapse
Affiliation(s)
- Christian Thiele
- University of Applied Sciences and Arts Bielefeld, Bielefeld, Germany
| | - Gerrit Hirschfeld
- University of Applied Sciences and Arts Bielefeld, Bielefeld, Germany
| |
Collapse
|
9
|
Haslberger M, Gestrich S, Strech D. Reporting of retrospective registration in clinical trial publications: a cross-sectional study of German trials. BMJ Open 2023; 13:e069553. [PMID: 37072362 PMCID: PMC10124266 DOI: 10.1136/bmjopen-2022-069553] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/20/2023] Open
Abstract
OBJECTIVE Prospective registration has been widely implemented and accepted as a best practice in clinical research, but retrospective registration is still commonly found. We assessed to what extent retrospective registration is reported transparently in journal publications and investigated factors associated with transparent reporting. DESIGN We used a dataset of trials registered in ClinicalTrials.gov or Deutsches Register Klinischer Studien, with a German University Medical Center as the lead centre, completed in 2009-2017, and with a corresponding peer-reviewed results publication. We extracted all registration statements from results publications of retrospectively registered trials and assessed whether they mention or justify the retrospective registration. We analysed associations of retrospective registration and reporting thereof with registration number reporting, International Committee of Medical Journal Editors (ICMJE) membership/-following and industry sponsorship using χ2 or Fisher exact test. RESULTS In the dataset of 1927 trials with a corresponding results publication, 956 (53.7%) were retrospectively registered. Of those, 2.2% (21) explicitly report the retrospective registration in the abstract and 3.5% (33) in the full text. In 2.1% (20) of publications, authors provide an explanation for the retrospective registration in the full text. Registration numbers were significantly underreported in abstracts of retrospectively registered trials compared with prospectively registered trials. Publications in ICMJE member journals did not have statistically significantly higher rates of both prospective registration and disclosure of retrospective registration, and publications in journals claiming to follow ICMJE recommendations showed statistically significantly lower rates compared with non-ICMJE-following journals. Industry sponsorship of trials was significantly associated with higher rates of prospective registration, but not with transparent registration reporting. CONCLUSIONS Contrary to ICMJE guidance, retrospective registration is disclosed and explained only in a small number of retrospectively registered studies. Disclosure of the retrospective nature of the registration would require a brief statement in the manuscript and could be easily implemented by journals.
Collapse
Affiliation(s)
- Martin Haslberger
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité, Berlin, Germany
| | - Stefanie Gestrich
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité, Berlin, Germany
| | - Daniel Strech
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité, Berlin, Germany
| |
Collapse
|
10
|
Leveraging Open Tools to Realize the Potential of Self-Archiving: A Cohort Study in Clinical Trials. PUBLICATIONS 2023. [DOI: 10.3390/publications11010004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023] Open
Abstract
While open access (OA) is growing, many publications remain behind a paywall. This limits the impact of research and entrenches global inequalities by restricting access to knowledge to those that can afford it. Many journal policies allow researchers to make a version of their publication openly accessible through self-archiving in a repository, sometimes after an embargo period (green OA). Unpaywall and Shareyourpaper are open tools that help users find OA articles and support authors to legally self-archive their papers, respectively. This study leveraged these tools to assess the potential of green OA to increase discoverability in a cohort of clinical trial results publications from German university medical centers. Of the 1897 publications in this cohort, 46% (n = 871/1897, 95% confidence interval (CI) 44% to 48%) were neither openly accessible via a journal or a repository. Of these, 85% (n = 736/871, 95% CI 82% to 87%) had a permission to self-archive the accepted or published version in an institutional repository. Thus, most of the closed-access clinical trial results in this cohort could be made openly accessible in a repository, in line with World Health Organization (WHO) recommendations. In addition to providing further evidence of the unrealized potential of green OA, this study demonstrates the use of open tools to obtain actionable information on self-archiving at scale and empowers efforts to increase science discoverability.
Collapse
|
11
|
Schwietering J, Langhof H, Strech D. Empirical studies on how ethical recommendations are translated into practice: a cross-section study on scope and study objectives. BMC Med Ethics 2023; 24:2. [PMID: 36631789 PMCID: PMC9835353 DOI: 10.1186/s12910-022-00873-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Accepted: 12/07/2022] [Indexed: 01/13/2023] Open
Abstract
BACKGROUND Empirical research can become relevant for bioethics in at least two ways. First, by informing the development or refinement of ethical recommendations. Second, by evaluating how ethical recommendations are translated into practice. This study aims to investigate the scope and objectives of empirical studies evaluating how ethical recommendations are translated into practice. METHODS A sample of the latest 400 publications from four bioethics journals was created and screened. All publications were included if they met one of the following three criteria: (1) evaluative empirical research, (2) non-evaluative empirical research and (3) borderline cases. For all publications categorized as evaluative empirical research we analyzed which objects (norms and recommendations) had been evaluated. RESULTS 234 studies were included of which 54% (n = 126) were categorized as non-evaluative empirical studies, 36% (n = 84) as evaluative empirical studies, and 10% (n = 24) as borderline cases. The object of evaluation were aspirational norms in 5 of the 84 included evaluative empirical studies, more specific norms in 14 (16%) studies and concrete best practices in 65 (77%) studies. The specific best practices can be grouped under five broader categories: ethical procedures, ethical institutions, clinical or research practices, educational programs, and legal regulations. CONCLUSIONS This mapping study shows that empirical evaluative studies can be found at all stages in the translational process from theory to best practices. Our study suggests two intertwined dimensions for structuring the field of evaluative/translational empirical studies in bioethics: First, three broader categories of evaluation objects and second five categories for types of best practices. TRIAL REGISTRATION The methodology used was described in a study protocol that was registered publicly on the Open Science Framework ( https://osf.io/r6h4y/ ).
Collapse
Affiliation(s)
- Johannes Schwietering
- grid.484013.a0000 0004 6879 971XQUEST Center for Responsible Research, Berlin Institute of Health (BIH) at Charité – Universitätsmedizin Berlin, 10178 Berlin, Germany
| | - Holger Langhof
- grid.484013.a0000 0004 6879 971XQUEST Center for Responsible Research, Berlin Institute of Health (BIH) at Charité – Universitätsmedizin Berlin, 10178 Berlin, Germany
| | - Daniel Strech
- grid.484013.a0000 0004 6879 971XQUEST Center for Responsible Research, Berlin Institute of Health (BIH) at Charité – Universitätsmedizin Berlin, 10178 Berlin, Germany
| |
Collapse
|
12
|
Strech D. [Transparency in clinical research: What contribution does the new EU Regulation 536/2014 make?]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2023; 66:52-59. [PMID: 36512076 PMCID: PMC9832089 DOI: 10.1007/s00103-022-03631-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Accepted: 11/18/2022] [Indexed: 12/15/2022]
Abstract
Clinical studies can be more or less transparent in four areas: (a) study registration, (b) results reporting, (c) data/code sharing, and (d) study-related documents. This discussion paper explains the extent to which the EU Regulation 536/2014 (Clinical Trials Regulation - CTR) has already positively impacted the area of results reporting in interventional drug trials and how it can improve the availability of study-related documents for independent research in the future.As this positive trend exists only for the area of results reporting and for the subset of interventional drug trials addressed by the CTR so far, a problematic two-class transparency seems to be developing that distinguishes between clinical studies addressed by the CTR and the other clinical studies. Independently of the CTR, academic institutions, funders, and ethics committees should therefore address all four abovementioned areas of transparency in all clinical studies. Monitoring the implementation of transparency in clinical studies would be an important first step in order to specify the need for action. An innovation in the context of transparency of clinical trials could also arise from the fact that the new EU Portal Clinical Trials Information System (CTIS) according to the CTR makes study-related informed consent documents, study protocols, and the investigator's brochures more transparent. This would for the first time open up the opportunity of independent research and quality assurance on issues of informed consent and harm-benefit assessment in clinical research.
Collapse
Affiliation(s)
- Daniel Strech
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Anna-Louisa-Karsch-Str. 2, 10178, Berlin, Deutschland.
| |
Collapse
|
13
|
Jansen MS, Dekkers OM, Groenwold RHH, Siegerink B. Publication rates in small German trials remained low five years after trial completion. Contemp Clin Trials 2022; 121:106899. [PMID: 36038002 DOI: 10.1016/j.cct.2022.106899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 08/23/2022] [Accepted: 08/23/2022] [Indexed: 01/27/2023]
Abstract
OBJECTIVE To investigate publication rates in small trials and to explore which factors are associated with publication rates in small trials, including sample size, the type and number of primary and secondary outcomes. STUDY DESIGN AND SETTING We studied a subgroup of 'small' trials from a pre-existing dataset (IntoValue), containing German trials completed between 2009 and 2017. Small trials were defined as phase II-III, III and IV trials with 150 or fewer participants. We performed an updated publication search and collected additional data from online trial records. RESULTS Out of 499 trials, 325 (65%) trials published their results in a journal article or dissertation. Median time-to-publication was 3.41 years (95% CI: 3.04-4.10). Planned sample size was not associated with publication rates, but the difference between planned and achieved sample size was (per 10% unsuccessfully recruited participants, HR = 0.95, 95% CI: 0.91-1.00). Phase III vs. II-III trials, studied intervention (device vs. other) and clearly vs. unclearly defined primary outcomes predicted a higher likelihood of earlier publication. CONCLUSION About 35% of small trials in Germany remain unpublished, even after an extensive follow-up period of over 9 years. Publication rates are low and were associated with sample size, trial phase and type of intervention.
Collapse
Affiliation(s)
- M S Jansen
- Department of Clinical Epidemiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| | - O M Dekkers
- Department of Clinical Epidemiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands; Department of Endocrinology and Metabolic Disorders, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| | - R H H Groenwold
- Department of Clinical Epidemiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands; Department of Biomedical Data Sciences, Leiden University Medical Center (LUMC), Leiden, the Netherlands
| | - B Siegerink
- Department of Clinical Epidemiology, Leiden University Medical Center (LUMC), Leiden, the Netherlands; Directorate of Research Policy, Leiden University Medical Center (LUMC), Leiden University, Leiden, the Netherlands.
| |
Collapse
|
14
|
Bruckner T, Wieschowski S, Heider M, Deutsch S, Drude N, Tölch U, Bleich A, Tolba R, Strech D. Measurement challenges and causes of incomplete results reporting of biomedical animal studies: Results from an interview study. PLoS One 2022; 17:e0271976. [PMID: 35960759 PMCID: PMC9374215 DOI: 10.1371/journal.pone.0271976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 07/11/2022] [Indexed: 11/30/2022] Open
Abstract
Background Existing evidence indicates that a significant amount of biomedical research involving animals remains unpublished. At the same time, we lack standards for measuring the extent of results reporting in animal research. Publication rates may vary significantly depending on the level of measurement such as an entire animal study, individual experiments within a study, or the number of animals used. Methods Drawing on semi-structured interviews with 18 experts and qualitative content analysis, we investigated challenges and opportunities for the measurement of incomplete reporting of biomedical animal research with specific reference to the German situation. We further investigate causes of incomplete reporting. Results The in-depth expert interviews revealed several reasons for why incomplete reporting in animal research is difficult to measure at all levels under the current circumstances. While precise quantification based on regulatory approval documentation is feasible at the level of entire studies, measuring incomplete reporting at the more individual experiment and animal levels presents formidable challenges. Expert-interviews further identified six drivers of incomplete reporting of results in animal research. Four of these are well documented in other fields of research: a lack of incentives to report non-positive results, pressures to ‘deliver’ positive results, perceptions that some data do not add value, and commercial pressures. The fifth driver, reputational concerns, appears to be far more salient in animal research than in human clinical trials. The final driver, socio-political pressures, may be unique to the field. Discussion Stakeholders in animal research should collaborate to develop a clear conceptualisation of complete reporting in animal research, facilitate valid measurements of the phenomenon, and develop incentives and rewards to overcome the causes for incomplete reporting.
Collapse
Affiliation(s)
- Till Bruckner
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité –Universitätsmedizin, Berlin, Germany
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hannover, Germany
| | - Susanne Wieschowski
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité –Universitätsmedizin, Berlin, Germany
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hannover, Germany
| | - Miriam Heider
- Institute for Laboratory Animal Science, Hannover Medical School, Hannover, Germany
| | - Susanne Deutsch
- Institute for Laboratory Animal Science, RWTH Aachen University, Faculty of Medicine, Aachen, Germany
| | - Natascha Drude
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité –Universitätsmedizin, Berlin, Germany
| | - Ulf Tölch
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité –Universitätsmedizin, Berlin, Germany
| | - André Bleich
- Institute for Laboratory Animal Science, Hannover Medical School, Hannover, Germany
| | - René Tolba
- Institute for Laboratory Animal Science, RWTH Aachen University, Faculty of Medicine, Aachen, Germany
| | - Daniel Strech
- QUEST Center for Responsible Research, Berlin Institute of Health at Charité –Universitätsmedizin, Berlin, Germany
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School, Hannover, Germany
- * E-mail:
| |
Collapse
|
15
|
Bruckner T, Rodgers F, Styrmisdóttir L, Keestra S. Adoption of World Health Organization Best Practices in Clinical Trial Transparency Among European Medical Research Funder Policies. JAMA Netw Open 2022; 5:e2222378. [PMID: 35913742 PMCID: PMC9344358 DOI: 10.1001/jamanetworkopen.2022.22378] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 06/01/2022] [Indexed: 11/14/2022] Open
Abstract
Importance Research funders can reduce research waste and publication bias by requiring their grantees to register and report clinical trials. Objective To determine the extent to which 21 major European research funders' efforts to reduce research waste and publication bias in clinical trials meet World Health Organization (WHO) best practice benchmarks and to investigate areas for improvement. Design, Setting, and Participants This cross-sectional study was based on 2 to 3 independent assessments of each funder's publicly available documentation and validation of results with funders during 2021. Included funders were the 21 largest nonmultilateral public and philanthropic medical research funders in Europe, with a combined budget of more than US $22 billion. Exposures Scoring of funders using an 11-item assessment tool based on WHO best practice benchmarks, grouped into 4 broad categories: trial registries, academic publication, monitoring, and sanctions. Funder references to reporting standards were captured. Main Outcomes and Measures The primary outcome was funder adoption or nonadoption of 11 policy and monitoring measures to reduce research waste and publication bias as set out by WHO best practices. The secondary outcomes were whether and how funder policies referred to reporting standards. Outcomes were preregistered after a pilot phase that used the same outcome measures. Results Among 21 of the largest nonmultilateral public and philanthropic funders in Europe, some best practices were more widely adopted than others, with 14 funders (66.7%) mandating prospective trial registration and 6 funders (28.6%) requiring that trial results be made public on trial registries within 12 months of trial completion. Less than half of funders actively monitored whether trials were registered (9 funders [42.9%]) or whether results were made public (8 funders [38.1%]). Funders implemented a mean of 4 of 11 best practices in clinical trial transparency (36.4%) set out by WHO. The extent to which funders adopted WHO best practice items varied widely, ranging from 0 practices for the French Centre National de la Recherche Scientifique and the ministries of health of Germany and Italy to 10 practices (90.9%) for the UK National Institute of Health Research. Overall, 9 funders referred to reporting standards in their policies. Conclusions and Relevance This study found that many European medical research funder policy and monitoring measures fell short of WHO best practices. These findings suggest that funders worldwide may need to identify and address gaps in policies and processes.
Collapse
Affiliation(s)
- Till Bruckner
- Berlin Institute of Health at Charité–Universitätsmedizin Berlin, QUEST Center, Berlin, Germany
- TranspariMED, Bristol, United Kingdom
| | - Florence Rodgers
- Royal Cornwall Hospitals National Health Service Trust, Truro, United Kingdom
| | | | - Sarai Keestra
- Department for Epidemiology and Data Science, Amsterdam University Medical Centers, University of Amsterdam, the Netherlands
| |
Collapse
|
16
|
Salholz-Hillel M, Strech D, Carlisle BG. Results publications are inadequately linked to trial registrations: An automated pipeline and evaluation of German university medical centers. Clin Trials 2022; 19:337-346. [PMID: 35362331 PMCID: PMC9203676 DOI: 10.1177/17407745221087456] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
BACKGROUND/AIMS Informed clinical guidance and health policy relies on clinicians, policymakers, and guideline developers finding comprehensive clinical evidence and linking registrations and publications of the same clinical trial. To support the finding and linking of trial evidence, the World Health Organization, the International Committee of Medical Journal Editors, and the Consolidated Standards of Reporting Trials ask researchers to provide the trial registration number in their publication and a reference to the publication in the registration. This practice costs researchers minimal effort and makes evidence synthesis more thorough and efficient. Nevertheless, trial evidence appears inadequately linked, and the extent of trial links in Germany remains unquantified. This cross-sectional study aims to evaluate links between registrations and publications across clinical trials conducted by German university medical centers and registered in ClinicalTrials.gov or the German Clinical Trials Registry. Secondary aims are to develop an automated pipeline that can be applied to other cohorts of trial registrations and publications, and to provide stakeholders, from trialists to registries, with guidance to improve trial links. METHODS We used automated strategies to download and extract data from trial registries, PubMed, and results publications for a cohort of registered, published trials conducted across German university medical centers and completed between 2009 and 2017. We implemented regular expressions to detect and classify publication identifiers in registrations, and trial registration numbers in publication metadata, abstracts, and full-texts. RESULTS In breach of long-standing guidelines, 75% (1,418) of trials failed to reference trial registration numbers in both the abstract and full-text of the journal article in which the results were published. Furthermore, 50% (946) of trial registrations did not contain links to their results publications. Seventeen percent (327) of trials had no links, so that associating registration and publication required manual searching and screening. Overall, trials in ClinicalTrials.gov were better linked than those in the German Clinical Trials Registry; PubMed and registry infrastructures appear to drive this difference. Trial registration numbers were more likely to be transferred to PubMed metadata from abstracts for ClinicalTrials.gov trials than for German Clinical Trials Registry trials. Most (78%, 662/849) ClinicalTrials.gov registrations with a publication link were automatically indexed from PubMed metadata, which is not possible in the German Clinical Trials Registry. CONCLUSIONS German university medical centers have not comprehensively linked trial registrations and publications, despite established recommendations. This shortcoming threatens the quality of evidence synthesis and medical practice, and burdens researchers with manually searching and linking trial data. Researchers could easily improve this by copy-and-pasting references between their trial registrations and publications. Other stakeholders could build on this practice, for example, PubMed could capture additional trial registration numbers using automated strategies (like those developed in this study), and the German Clinical Trials Registry could automatically index publications from PubMed.
Collapse
Affiliation(s)
- Maia Salholz-Hillel
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charité—Universitätsmedizin Berlin, Berlin, Germany
| | - Daniel Strech
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charité—Universitätsmedizin Berlin, Berlin, Germany
| | - Benjamin Gregory Carlisle
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charité—Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
17
|
Thiele C, Hirschfeld G. Registration quality and availability of publications for clinical trials in Germany and the influence of structural factors. PLoS One 2022; 17:e0267883. [PMID: 35533182 PMCID: PMC9084529 DOI: 10.1371/journal.pone.0267883] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Accepted: 04/18/2022] [Indexed: 11/18/2022] Open
Abstract
INTRODUCTION Analyses of clinical trial registries (CTRs) offer insights into methodological problems of published research studies, e.g., non-publication and outcome-switching. Here, we use CTRs as a tool to evaluate clinical studies conducted in Germany and test how their registration quality is associated with time and structural factors: Coordinating Centers for Clinical Trials (KKS) and Universities of Excellence. METHODS We searched ClinicalTrials.gov, the DRKS, and the ICTRP for clinical trials recruiting participants in Germany. As a measure for the methodological quality, we assessed the proportion of trials that were pre-registered. In addition, the registration quality and availability of publications relating to the trials were manually assessed for a sample (n = 639). Also, the influence of the structural factors was tested using regression models. RESULTS We identified 35,912 trials that were conducted in Germany. 59% of trials were pre-registered. Surprisingly, Universities of Excellence had lower pre-registration rates. The influence of KKS was unclear and also difficult to test. Interventional trials were more likely to be pre-registered. Registration quality improved over time and was higher in interventional trials. As of early 2021, 49% of trials that started until the end of 2015 have published scientific articles. 187 of 502 studies on ClinicalTrials.gov for which we found published articles did not reference any in the registry entry. DISCUSSION The structural predictors did not show consistent relationships with the various outcome variables. However, the finding that the study type and time were related to better registration quality suggests that regulatory regimes may have an impact. Limitations of this non-pre-registered study were that no modifications to registry entries were tracked and the coarse measure of KKS involvement.
Collapse
Affiliation(s)
- Christian Thiele
- University of Applied Sciences Bielefeld, Faculty of Business, CareTech OWL – Center for Health, Welfare and Technology, Bielefeld, Germany
| | - Gerrit Hirschfeld
- University of Applied Sciences Bielefeld, Faculty of Business, CareTech OWL – Center for Health, Welfare and Technology, Bielefeld, Germany
| |
Collapse
|