1
|
Nouwens SPH, Marceta SM, Bui M, van Dijk DMAH, Groothuis-Oudshoorn CGM, Veldwijk J, van Til JA, de Bekker-Grob EW. The Evolving Landscape of Discrete Choice Experiments in Health Economics: A Systematic Review. PHARMACOECONOMICS 2025:10.1007/s40273-025-01495-y. [PMID: 40397369 DOI: 10.1007/s40273-025-01495-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/30/2025] [Indexed: 05/22/2025]
Abstract
INTRODUCTION Stakeholder preference evaluations are increasingly emphasized in healthcare policy and health technology assessment. Discrete choice experiments (DCEs) are the most common method for quantifying preferences among patients, the public, and healthcare professionals. While prior reviews (1990-2017) have examined DCE trends, no comprehensive synthesis exists for studies published since 2018. This updated review (2018-2023) provides critical insights into evolving methodologies and global trends in health-related DCEs. METHODS A systematic search (2018-2023) of Medline, Embase, and Web of Science identified relevant studies. Studies were screened for inclusion and data were extracted, including details on DCE design and analysis. To enable trend comparisons, the search strategy and extraction items aligned with previous reviews. RESULTS Of 2663 identified papers, 1279 met the inclusion criteria, reflecting a significant rise in published DCEs over time. DCEs were conducted globally, with a remarkable increase in publications from Asia and Africa compared with previous reviews. Experimental designs and econometric models have advanced, continuing prior trends. Notably, most recent DCEs were administered online. DISCUSSION The rapid growth of DCE applications underscores their importance in health research. While the methodology is advancing rapidly, it is crucial that researchers provide full transparency in reporting their methods, particularly in detailing experimental designs and validity tests, which are too often overlooked. Key recommendations include improving reporting of experimental designs, applying validity tests, following good practices for presenting benefit-risk attributes, and adopting open science practices. Ensuring methodological rigor will maximize the impact and reproducibility of DCE research in health economics.
Collapse
Affiliation(s)
- Sven Petrus Henricus Nouwens
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, P.O. Box 1738, 3000 DR, Rotterdam, The Netherlands.
- Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands.
- Erasmus Centre for Health Economics Rotterdam, Erasmus University, Rotterdam, The Netherlands.
| | - Stella Maria Marceta
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, P.O. Box 1738, 3000 DR, Rotterdam, The Netherlands
- Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands
- Erasmus Centre for Health Economics Rotterdam, Erasmus University, Rotterdam, The Netherlands
| | - Michael Bui
- Department of Health Technology and Services Research, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| | - Daisy Maria Alberta Hendrika van Dijk
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, P.O. Box 1738, 3000 DR, Rotterdam, The Netherlands
- Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands
- Erasmus Centre for Health Economics Rotterdam, Erasmus University, Rotterdam, The Netherlands
| | | | - Jorien Veldwijk
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, P.O. Box 1738, 3000 DR, Rotterdam, The Netherlands
- Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands
- Erasmus Centre for Health Economics Rotterdam, Erasmus University, Rotterdam, The Netherlands
| | - Janine Astrid van Til
- Department of Health Technology and Services Research, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| | - Esther Wilhelmina de Bekker-Grob
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, P.O. Box 1738, 3000 DR, Rotterdam, The Netherlands
- Erasmus Choice Modelling Centre, Erasmus University Rotterdam, Rotterdam, The Netherlands
- Erasmus Centre for Health Economics Rotterdam, Erasmus University, Rotterdam, The Netherlands
| |
Collapse
|
2
|
Visentin L, Munaron L, Ruffinatti FA. Structuring data analysis projects in the Open Science era with Kerblam! F1000Res 2025; 14:88. [PMID: 40047014 PMCID: PMC11880754 DOI: 10.12688/f1000research.157325.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/25/2025] [Indexed: 04/07/2025] Open
Abstract
Background Structuring data analysis projects, that is, defining the layout of files and folders needed to analyze data using existing tools and novel code, largely follows personal preferences. Open Science calls for more accessible, transparent and understandable research. We believe that Open Science principles can be applied to the way data analysis projects are structured. Methods We examine the structure of several data analysis project templates by analyzing project template repositories present in GitHub. Through visualization of the resulting consensus structure, we draw observations regarding how the ecosystem of project structures is shaped, and what salient characteristics it has. Results Project templates show little overlap, but many distinct practices can be highlighted. We take them into account with the wider Open Science philosophy to draw a few fundamental Design Principles to guide researchers when designing a project space. We present Kerblam!, a project management tool that can work with such a project structure to expedite data handling, execute workflow managers, and share the resulting workflow and analysis outputs with others. Conclusions We hope that, by following these principles and using Kerblam!, the landscape of data analysis projects can become more transparent, understandable, and ultimately useful to the wider community.
Collapse
Affiliation(s)
- Luca Visentin
- Department of Life Sciences and Systems Biology, University of Turin, Turin, 10136, Italy
| | - Luca Munaron
- Department of Life Sciences and Systems Biology, University of Turin, Turin, 10136, Italy
| | | |
Collapse
|
3
|
Bertram MG, Ågerstrand M, Thoré ES, Allen J, Balshine S, Brand JA, Brooks BW, Dang Z, Duquesne S, Ford AT, Hoffmann F, Hollert H, Jacob S, Kloas W, Klüver N, Lazorchak J, Ledesma M, Maack G, Macartney EL, Martin JM, Melvin SD, Michelangeli M, Mohr S, Padilla S, Pyle G, Saaristo M, Sahm R, Smit E, Steevens JA, van den Berg S, Vossen LE, Wlodkowic D, Wong BB, Ziegler M, Brodin T. EthoCRED: a framework to guide reporting and evaluation of the relevance and reliability of behavioural ecotoxicity studies. Biol Rev Camb Philos Soc 2025; 100:556-585. [PMID: 39394884 PMCID: PMC11885694 DOI: 10.1111/brv.13154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 09/25/2024] [Accepted: 10/01/2024] [Indexed: 10/14/2024]
Abstract
Behavioural analysis has been attracting significant attention as a broad indicator of sub-lethal toxicity and has secured a place as an important subdiscipline in ecotoxicology. Among the most notable characteristics of behavioural research, compared to other established approaches in sub-lethal ecotoxicology (e.g. reproductive and developmental bioassays), are the wide range of study designs being used and the diversity of endpoints considered. At the same time, environmental hazard and risk assessment, which underpins regulatory decisions to protect the environment from potentially harmful chemicals, often recommends that ecotoxicological data be produced following accepted and validated test guidelines. These guidelines typically do not address behavioural changes, meaning that these, often sensitive, effects are not represented in hazard and risk assessments. Here, we propose a new tool, the EthoCRED evaluation method, for assessing the relevance and reliability of behavioural ecotoxicity data, which considers the unique requirements and challenges encountered in this field. This method and accompanying reporting recommendations are designed to serve as an extension of the "Criteria for Reporting and Evaluating Ecotoxicity Data (CRED)" project. As such, EthoCRED can both accommodate the wide array of experimental design approaches seen in behavioural ecotoxicology, and could be readily implemented into regulatory frameworks as deemed appropriate by policy makers of different jurisdictions to allow better integration of knowledge gained from behavioural testing into environmental protection. Furthermore, through our reporting recommendations, we aim to improve the reporting of behavioural studies in the peer-reviewed literature, and thereby increase their usefulness to inform chemical regulation.
Collapse
Affiliation(s)
- Michael G. Bertram
- Department of Wildlife, Fish, and Environmental StudiesSwedish University of Agricultural SciencesSkogsmarksgränd 17Umeå907 36Sweden
- Department of ZoologyStockholm UniversitySvante Arrhenius väg 18bStockholm114 18Sweden
- School of Biological SciencesMonash University25 Rainforest WalkMelbourne3800Australia
| | - Marlene Ågerstrand
- Department of Environmental ScienceStockholm UniversitySvante Arrhenius väg 8cStockholm114 18Sweden
| | - Eli S.J. Thoré
- Department of Wildlife, Fish, and Environmental StudiesSwedish University of Agricultural SciencesSkogsmarksgränd 17Umeå907 36Sweden
- Laboratory of Adaptive Biodynamics, Research Unit of Environmental and Evolutionary Biology, Institute of Life, Earth, and EnvironmentUniversity of NamurRue de Bruxelles 61Namur5000Belgium
- TRANSfarm, Science, Engineering, and Technology GroupKU LeuvenBijzondereweg 12Bierbeek3360Belgium
| | - Joel Allen
- Center for Environmental Measurement and Modeling, Office of Research and DevelopmentU.S. EPA26 Martin Luther King Drive WestCincinnati45268OhioUSA
| | - Sigal Balshine
- Department of Psychology, Neuroscience, & BehaviourMcMaster University1280 Main Street WestHamiltonL8S 4K1OntarioCanada
| | - Jack A. Brand
- Department of Wildlife, Fish, and Environmental StudiesSwedish University of Agricultural SciencesSkogsmarksgränd 17Umeå907 36Sweden
- Institute of ZoologyZoological Society of LondonOuter Circle, Regent's ParkLondonNW1, 4RYUK
| | - Bryan W. Brooks
- Department of Environmental ScienceBaylor UniversityOne Bear Place #97266Waco76798‐7266TexasUSA
| | - ZhiChao Dang
- National Institute for Public Health and the Environment (RIVM)Antonie van Leeuwenhoeklaan 9Bilthoven3721 MAthe Netherlands
| | - Sabine Duquesne
- German Environment Agency (UBA)Wörlitzer Platz 1Dessau‐Roßlau06844Germany
| | - Alex T. Ford
- Institute of Marine Sciences, School of Biological SciencesUniversity of PortsmouthFerry RoadPortsmouthPO4 9LYUK
| | - Frauke Hoffmann
- Department of Chemical and Product SafetyThe German Federal Institute for Risk Assessment (BfR)Max‐Dohrn‐Straße 8–10Berlin10589Germany
| | - Henner Hollert
- Goethe University FrankfurtMax‐von‐Laue‐Straße 13Frankfurt am Main60438Germany
| | - Stefanie Jacob
- German Environment Agency (UBA)Wörlitzer Platz 1Dessau‐Roßlau06844Germany
| | - Werner Kloas
- Leibniz‐Institute of Freshwater Ecology and Inland FisheriesMüggelseedamm 310Berlin12587Germany
| | - Nils Klüver
- Helmholtz Centre for Environmental Research (UFZ)Permoserstraße 15Leipzig04318Germany
| | - Jim Lazorchak
- Center for Environmental Measurement and Modeling, Office of Research and DevelopmentU.S. EPA26 Martin Luther King Drive WestCincinnati45268OhioUSA
| | - Mariana Ledesma
- Swedish Chemicals Agency (KemI)Löfströms allé 5Stockholm172 66Sweden
| | - Gerd Maack
- German Environment Agency (UBA)Wörlitzer Platz 1Dessau‐Roßlau06844Germany
| | - Erin L. Macartney
- Department of ZoologyStockholm UniversitySvante Arrhenius väg 18bStockholm114 18Sweden
- Evolution & Ecology Research Centre, School of Biological, Earth & Environmental SciencesUniversity of New South Wales, Biological Sciences North (D26)Sydney2052Australia
- Charles Perkins Centre, School of Life and Environmental SciencesThe University of SydneyJohn Hopkins DriveSydney2006Australia
| | - Jake M. Martin
- Department of Wildlife, Fish, and Environmental StudiesSwedish University of Agricultural SciencesSkogsmarksgränd 17Umeå907 36Sweden
- Department of ZoologyStockholm UniversitySvante Arrhenius väg 18bStockholm114 18Sweden
- School of Life and Environmental SciencesDeakin University75 Pigdons RoadWaurn Ponds3216Australia
| | - Steven D. Melvin
- Australian Rivers Institute, School of Environment and ScienceGriffith UniversityEdmund Rice DriveSouthport4215Australia
| | - Marcus Michelangeli
- Department of Wildlife, Fish, and Environmental StudiesSwedish University of Agricultural SciencesSkogsmarksgränd 17Umeå907 36Sweden
- School of Environment and ScienceGriffith University170 Kessels RoadNathan4111Australia
| | - Silvia Mohr
- German Environment Agency (UBA)Wörlitzer Platz 1Dessau‐Roßlau06844Germany
| | - Stephanie Padilla
- Center for Computational Toxicology and ExposureOffice of Research and DevelopmentU.S. EPA, 109 T.W. Alexander DriveDurham27711North CarolinaUSA
| | - Gregory Pyle
- Department of Biological SciencesUniversity of Lethbridge4401 University DriveLethbridgeT1K 3M4AlbertaCanada
| | - Minna Saaristo
- Environment Protection Authority Victoria, EPA Science2 Terrace WayMacleod3085Australia
| | - René Sahm
- German Environment Agency (UBA)Wörlitzer Platz 1Dessau‐Roßlau06844Germany
- Department of Freshwater Ecology in Landscape PlanningUniversity of KasselGottschalkstraße 24Kassel34127Germany
| | - Els Smit
- National Institute for Public Health and the Environment (RIVM)Antonie van Leeuwenhoeklaan 9Bilthoven3721 MAthe Netherlands
| | - Jeffery A. Steevens
- Columbia Environmental Research CenterU.S. Geological Survey (USGS)4200 New Haven RoadColumbia65201MissouriUSA
| | - Sanne van den Berg
- Wageningen University and ResearchP.O. Box 47Wageningen6700 AAthe Netherlands
| | - Laura E. Vossen
- Department of Anatomy, Physiology, and BiochemistrySwedish University of Agricultural SciencesUlls väg 26Uppsala756 51Sweden
| | - Donald Wlodkowic
- The Neurotox Lab, School of ScienceRMIT University289 McKimmies RoadMelbourne3083Australia
| | - Bob B.M. Wong
- School of Biological SciencesMonash University25 Rainforest WalkMelbourne3800Australia
| | - Michael Ziegler
- Eurofins Aquatic Ecotoxicology GmbHEutinger Strasse 24Niefern‐Öschelbronn75223Germany
- Animal Physiological EcologyUniversity of TübingenAuf der Morgenstelle 5Tübingen72076Germany
| | - Tomas Brodin
- Department of Wildlife, Fish, and Environmental StudiesSwedish University of Agricultural SciencesSkogsmarksgränd 17Umeå907 36Sweden
| |
Collapse
|
4
|
Forero DA, Glatt SJ, Oermann MH. Reviewing manuscripts for scientific journals: recommendations for early career scientists. BMC Res Notes 2025; 18:17. [PMID: 39819633 PMCID: PMC11740453 DOI: 10.1186/s13104-024-07060-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2024] [Accepted: 12/19/2024] [Indexed: 01/19/2025] Open
Abstract
Publication of articles in international scientific journals has been one of the main strategies for the communication of scientific findings and ideas. Prepublication peer review is a fundamental aspect of the publishing process in indexed scientific journals and, associated with the large growth in journals and articles, there has been a recent challenge in having adequate peer reviewers for international journals. In this article, we provide a short overview of the publishing process, give recommendations to early career researchers about writing peer reviews of adequate quality, and discuss some possibilities for the future.
Collapse
Affiliation(s)
- Diego A Forero
- School of Heath and Sport Sciences, Fundación Universitaria del Área Andina, Bogotá, Colombia.
| | - Stephen J Glatt
- Department of Psychiatry and Behavioral Sciences, SUNY Upstate Medical University, Syracuse, NY, United States of America
| | - Marilyn H Oermann
- Duke University School of Nursing, Durham, NC, United States of America
| |
Collapse
|
5
|
Scorza LC, Zieliński T, Kalita I, Lepore A, El Karoui M, Millar AJ. Daily life in the Open Biologist's second job, as a Data Curator. Wellcome Open Res 2024; 9:523. [PMID: 39360219 PMCID: PMC11445645 DOI: 10.12688/wellcomeopenres.22899.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/03/2024] [Indexed: 10/04/2024] Open
Abstract
Background Data reusability is the driving force of the research data life cycle. However, implementing strategies to generate reusable data from the data creation to the sharing stages is still a significant challenge. Even when datasets supporting a study are publicly shared, the outputs are often incomplete and/or not reusable. The FAIR (Findable, Accessible, Interoperable, Reusable) principles were published as a general guidance to promote data reusability in research, but the practical implementation of FAIR principles in research groups is still falling behind. In biology, the lack of standard practices for a large diversity of data types, data storage and preservation issues, and the lack of familiarity among researchers are some of the main impeding factors to achieve FAIR data. Past literature describes biological curation from the perspective of data resources that aggregate data, often from publications. Methods Our team works alongside data-generating, experimental researchers so our perspective aligns with publication authors rather than aggregators. We detail the processes for organizing datasets for publication, showcasing practical examples from data curation to data sharing. We also recommend strategies, tools and web resources to maximize data reusability, while maintaining research productivity. Conclusion We propose a simple approach to address research data management challenges for experimentalists, designed to promote FAIR data sharing. This strategy not only simplifies data management, but also enhances data visibility, recognition and impact, ultimately benefiting the entire scientific community.
Collapse
Affiliation(s)
- Livia C.T. Scorza
- Centre for Engineering Biology and School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3BF, UK
| | - Tomasz Zieliński
- Centre for Engineering Biology and School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3BF, UK
| | - Irina Kalita
- Centre for Engineering Biology and School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3BF, UK
- Institute of Cell Biology, School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3JD, UK
- Center for Synthetic Microbiology (SYNMIKRO), Max Planck Institute for Terrestrial Microbiology, Marburg, Germany
| | - Alessia Lepore
- Centre for Engineering Biology and School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3BF, UK
- Institute of Cell Biology, School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3JD, UK
- Laboratory for Optics and Biosciences, École Polytechnique, Institut Polytechnique de Paris, Palaiseau, Île-de-France, France
| | - Meriem El Karoui
- Centre for Engineering Biology and School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3BF, UK
- Institute of Cell Biology, School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3JD, UK
- Laboratoire de Biologie et Pharmacologie Appliquée (LBPA), - ENS Paris-Saclay CNRS UMR 8113, Paris, Gif-sur-Yvette, France
| | - Andrew J. Millar
- Centre for Engineering Biology and School of Biological Sciences, University of Edinburgh, Edinburgh, Scotland, EH9 3BF, UK
| |
Collapse
|
6
|
Graña M, Badiola-Zabala G, Cano-Escalera G. Comment on Uzun Ozsahin et al. COVID-19 Prediction Using Black-Box Based Pearson Correlation Approach. Diagnostics 2023, 13, 1264. Diagnostics (Basel) 2024; 14:2528. [PMID: 39594194 PMCID: PMC11592728 DOI: 10.3390/diagnostics14222528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 10/28/2024] [Indexed: 11/28/2024] Open
Abstract
The declaration of the COVID-19 pandemic by the World Health Organization (WHO) in March 2020 has triggered the publication of thousands of papers covering a plethora of aspects of the pandemic, from epidemiology models [...].
Collapse
|
7
|
Ge K, Nguyen P, Arnaout R. lucie: An Improved Python Package for Loading Datasets from the UCI Machine Learning Repository. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.10.18.618994. [PMID: 39484461 PMCID: PMC11526970 DOI: 10.1101/2024.10.18.618994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/03/2024]
Abstract
The University of California-Irvine (UCI) Machine Learning (ML) Repository (UCIMLR) is consistently cited as one of the most popular dataset repositories, hosting hundreds of high-impact datasets. However, a significant portion, including 28.4% of the top 250, cannot be imported via the ucimlrepo package that is provided and recommended by the UCIMLR website. Instead, they are hosted as .zip files, containing nonstandard formats that are difficult to import without additional ad hoc processing. To address this issue, here we present lucie-load University California Irvine examples-a utility that automatically determines the data format and imports many of these previously non-importable datasets, while preserving as much of a tabular data structure as possible. lucie was designed using the top 100 most popular datasets and benchmarked on the next 130, where it resulted in a success rate of 95.4% vs. 73.1% for ucimlrepo. lucie is available as a Python package on PyPI with 98% code coverage.
Collapse
Affiliation(s)
- Kenneth Ge
- Department of Pathology at Beth Israel Deaconess Medical Center (BIDMC), and is a student at Carnegie Mellon University
| | - Phuc Nguyen
- Department of Pathology at BIDMC, Boston, MA 02215
| | - Ramy Arnaout
- Department of Pathology and the Division of Clinical Informatics, Department of Medicine, BIDMC and with Harvard Medical School, Boston, MA 02215
| |
Collapse
|
8
|
Wu NC, Alton L, Bovo RP, Carey N, Currie SE, Lighton JRB, McKechnie AE, Pottier P, Rossi G, White CR, Levesque DL. Reporting guidelines for terrestrial respirometry: Building openness, transparency of metabolic rate and evaporative water loss data. Comp Biochem Physiol A Mol Integr Physiol 2024; 296:111688. [PMID: 38944270 DOI: 10.1016/j.cbpa.2024.111688] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Revised: 06/24/2024] [Accepted: 06/25/2024] [Indexed: 07/01/2024]
Abstract
Respirometry is an important tool for understanding whole-animal energy and water balance in relation to the environment. Consequently, the growing number of studies using respirometry over the last decade warrants reliable reporting and data sharing for effective dissemination and research synthesis. We provide a checklist guideline on five key sections to facilitate the transparency, reproducibility, and replicability of respirometry studies: 1) materials, set up, plumbing, 2) subject conditions/maintenance, 3) measurement conditions, 4) data processing, and 5) data reporting and statistics, each with explanations and example studies. Transparency in reporting and data availability has benefits on multiple fronts. Authors can use this checklist to design and report on their study, and reviewers and editors can use the checklist to assess the reporting quality of the manuscripts they review. Improved standards for reporting will enhance the value of primary studies and will greatly facilitate the ability to carry out higher quality research syntheses to address ecological and evolutionary theories.
Collapse
Affiliation(s)
- Nicholas C Wu
- Hawkesbury Institute for the Environment, Western Sydney University, New South Wales 2753, Australia.
| | - Lesley Alton
- Centre for Geometric Biology, School of Biological Sciences, Monash University, Melbourne, VIC 3800, Australia. https://twitter.com/lesley_alton
| | - Rafael P Bovo
- Department of Evolution, Ecology, and Organismal Biology, University of California Riverside, Riverside, CA, United States. https://twitter.com/bovo_rp
| | - Nicholas Carey
- Marine Directorate for the Scottish Government, Aberdeen, United Kingdom
| | - Shannon E Currie
- Institute for Cell and Systems Biology, University of Hamburg, Martin-Luther-King Plz 3, 20146 Hamburg, Germany; School of Biosciences, University of Melbourne, Victoria, Australia. https://twitter.com/batsinthbelfry
| | - John R B Lighton
- Sable Systems International, North Las Vegas, NV, United States. https://twitter.com/SableSys
| | - Andrew E McKechnie
- South African Research Chair in Conservation Physiology, South African National Biodiversity Institute, South Africa; DSI-NRF Centre of Excellence at the FitzPatrick Institute, Department of Zoology and Entomology, University of Pretoria, South Africa
| | - Patrice Pottier
- Evolution & Ecology Research Centre, School of Biological, Earth and Environmental Sciences, The University of New South Wales, Sydney, New South Wales, Australia; Division of Ecology and Evolution, Research School of Biology, The Australian National University, Canberra, Australian Capital Territory, Australia. https://twitter.com/PatriceEcoEvo
| | - Giulia Rossi
- Department of Biology, McMaster University, Hamilton, Ontario, Canada. https://twitter.com/giuliasrossi
| | - Craig R White
- Centre for Geometric Biology, School of Biological Sciences, Monash University, Melbourne, VIC 3800, Australia
| | - Danielle L Levesque
- School of Biology and Ecology, University of Maine, Orono, ME, United States. https://twitter.com/dl_levesque
| |
Collapse
|
9
|
Boja ES, Guidry Auvil JM. Shooting the moon: the National Cancer Institute's implementation framework for data sharing policies. Nat Med 2024; 30:2117-2120. [PMID: 38783140 DOI: 10.1038/s41591-024-02950-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/25/2024]
Affiliation(s)
- Emily S Boja
- Office of Data Sharing, Center for Biomedical Informatics and Information Technology, National Cancer Institute, National Institutes of Health, Rockville, MD, USA
| | - Jaime M Guidry Auvil
- Office of Data Sharing, Center for Biomedical Informatics and Information Technology, National Cancer Institute, National Institutes of Health, Rockville, MD, USA.
| |
Collapse
|
10
|
Lagisz M, Rutkowska J, Aich U, Ross RM, Santana MS, Wang J, Trubanová N, Page MJ, Pua AAY, Yang Y, Amin B, Martinig AR, Barnett A, Surendran A, Zhang J, Borg DN, Elisee J, Wrightson JG, Nakagawa S. "Best Paper" awards lack transparency, inclusivity, and support for Open Science. PLoS Biol 2024; 22:e3002715. [PMID: 39042591 PMCID: PMC11265724 DOI: 10.1371/journal.pbio.3002715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Accepted: 06/18/2024] [Indexed: 07/25/2024] Open
Abstract
Awards can propel academic careers. They also reflect the culture and values of the scientific community. But do awards incentivize greater transparency, inclusivity, and openness in science? Our cross-disciplinary survey of 222 awards for the "best" journal articles across all 27 SCImago subject areas revealed that journals and learned societies administering such awards generally publish little detail on their procedures and criteria. Award descriptions were brief, rarely including contact details or information on the nominations pool. Nominations of underrepresented groups were not explicitly encouraged, and concepts that align with Open Science were almost absent from the assessment criteria. At the same time, 10% of awards, especially the recently established ones, tended to use article-level impact metrics. USA-affiliated researchers dominated the winner's pool (48%), while researchers from the Global South were uncommon (11%). Sixty-one percent of individual winners were men. Overall, Best Paper awards miss the global calls for greater transparency and equitable access to academic recognition. We provide concrete and implementable recommendations for scientific awards to improve the scientific recognition system and incentives for better scientific practice.
Collapse
Affiliation(s)
- Malgorzata Lagisz
- Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, Australia
- Theoretical Sciences Visiting Program, Okinawa Institute of Science and Technology Graduate University, Onna, Japan
| | - Joanna Rutkowska
- Institute of Environmental Sciences, Faculty of Biology, Jagiellonian University, Cracow, Poland
| | - Upama Aich
- School of Biological Sciences, Monash University, Clayton, Australia
| | - Robert M. Ross
- Department of Philosophy, Macquarie University, Sydney, Australia
| | - Manuela S. Santana
- Centre for Marine Studies, Federal University of Paraná, Pontal Do Paraná, PR, Brazil
| | - Joshua Wang
- School of Clinical Sciences, Queensland University of Technology, Brisbane, Australia
- Mandarin Training Centre, National Taiwan Normal University, Taipei, Taiwan
| | - Nina Trubanová
- School of Biology and Environmental Science, University College Dublin, Dublin, Ireland
| | - Matthew J. Page
- Methods in Evidence Synthesis Unit, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Andrew Adrian Yu Pua
- School of Business, Economics, and Information Systems, University of Passau, Passau, Germany
| | - Yefeng Yang
- Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, Australia
| | - Bawan Amin
- Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, the Netherlands
| | - April Robin Martinig
- Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, Australia
| | - Adrian Barnett
- School of Public Health and Social Work, Queensland University of Technology, Brisbane, Australia
| | - Aswathi Surendran
- School of Psychology, University of Galway, University Road, Galway, Ireland
| | - Ju Zhang
- Department of Infectious Diseases and Public Health, Jockey Club College of Veterinary Medicine and Life Sciences, City University of Hong Kong, Hong Kong SAR, China
| | - David N. Borg
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Brisbane, Australia
| | - Jafsia Elisee
- African Higher Institute of Open Science and Hardware, Yaoundé, Cameroon
| | | | - Shinichi Nakagawa
- Evolution & Ecology Research Centre and School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, Australia
- Theoretical Sciences Visiting Program, Okinawa Institute of Science and Technology Graduate University, Onna, Japan
- Department of Biological Sciences, University of Alberta, Biological Sciences Building, Edmonton, Canada
| |
Collapse
|
11
|
Koivisto E, Mäntylä E. Are Open Science instructions targeted to ecologists and evolutionary biologists sufficient? A literature review of guidelines and journal data policies. Ecol Evol 2024; 14:e11698. [PMID: 38994214 PMCID: PMC11237169 DOI: 10.1002/ece3.11698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 06/02/2024] [Accepted: 06/24/2024] [Indexed: 07/13/2024] Open
Abstract
Open science (OS) awareness and skills are increasingly becoming an essential part of everyday scientific work as e.g., many journals require authors to share data. However, following an OS workflow can seem challenging at first. Thus, instructions by journals and other guidelines are important. But how comprehensive are they in the field of ecology and evolutionary biology (Ecol Evol)? To find this out, we reviewed 20 published OS guideline articles aimed for ecologists or evolutionary biologists, together with the data policies of 17 Ecol Evol journals to chart the current landscape of OS guidelines in the field, find potential gaps, identify field-specific barriers for OS and discuss solutions to overcome these challenges. We found that many of the guideline articles covered similar topics, despite being written for a narrow field or specific target audience. Likewise, many of the guideline articles mentioned similar obstacles that could hinder or postpone a transition to open data sharing. Thus, there could be a need for a more widely known, general OS guideline for Ecol Evol. Following the same guideline could also enhance the uniformity of the OS practices carried on in the field. However, some topics, like long-term experiments and physical samples, were mentioned surprisingly seldom, although they are typical issues in Ecol Evol. Of the journals, 15 out of 17 expected or at least encouraged data sharing either for all articles or under specific conditions, e.g. for registered reports and 10 of those required data sharing at the submission phase. The coverage of journal data policies varied greatly between journals, from practically non-existing to very extensive. As journals can contribute greatly by leading the way and making open data useful, we recommend that the publishers and journals would invest in clear and comprehensive data policies and instructions for authors.
Collapse
Affiliation(s)
- Elina Koivisto
- Section of Ecology, Department of Biology University of Turku Turku Finland
- Present address: Federation of Finnish Learned Societies (TSV) Helsinki Finland
| | - Elina Mäntylä
- Section of Ecology, Department of Biology University of Turku Turku Finland
| |
Collapse
|
12
|
Gilmour KM, Daley MA, Egginton S, Kelber A, McHenry MJ, Patek SN, Sane SP, Schulte PM, Terblanche JS, Wright PA, Franklin CE. Through the looking glass: attempting to predict future opportunities and challenges in experimental biology. J Exp Biol 2023; 226:jeb246921. [PMID: 38059428 DOI: 10.1242/jeb.246921] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/08/2023]
Abstract
To celebrate its centenary year, Journal of Experimental Biology (JEB) commissioned a collection of articles examining the past, present and future of experimental biology. This Commentary closes the collection by considering the important research opportunities and challenges that await us in the future. We expect that researchers will harness the power of technological advances, such as '-omics' and gene editing, to probe resistance and resilience to environmental change as well as other organismal responses. The capacity to handle large data sets will allow high-resolution data to be collected for individual animals and to understand population, species and community responses. The availability of large data sets will also place greater emphasis on approaches such as modeling and simulations. Finally, the increasing sophistication of biologgers will allow more comprehensive data to be collected for individual animals in the wild. Collectively, these approaches will provide an unprecedented understanding of 'how animals work' as well as keys to safeguarding animals at a time when anthropogenic activities are degrading the natural environment.
Collapse
Affiliation(s)
| | - Monica A Daley
- Department of Ecology and Evolutionary Biology, University of California, Irvine, Irvine, CA 92697, USA
| | - Stuart Egginton
- School of Biomedical Sciences, University of Leeds, Leeds LS2 9JT, UK
| | - Almut Kelber
- Department of Biology, Lund University, 22362 Lund, Sweden
| | - Matthew J McHenry
- Department of Ecology and Evolutionary Biology, University of California, Irvine, Irvine, CA 92697, USA
| | - Sheila N Patek
- Biology Department, Duke University, Durham, NC 27708, USA
| | - Sanjay P Sane
- National Centre for Biological Sciences, Tata Institute of Fundamental Research, GKVK Campus, Bellary Road, Bangalore, Karnataka 560065, India
| | - Patricia M Schulte
- Department of Zoology, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| | - John S Terblanche
- Center for Invasion Biology, Department of Conservation Ecology & Entomology, Stellenbosch University, Stellenbosch 7602, South Africa
| | - Patricia A Wright
- Department of Integrative Biology, University of Guelph, Guelph, ON N1G 2W1, Canada
| | - Craig E Franklin
- School of the Environment, The University of Queensland, St. Lucia, Brisbane 4072, Australia
| |
Collapse
|