1
|
Rosengaard LO, Andersen MZ, Rosenberg J, Fonnes S. Five aspects of research waste in biomedicine: A scoping review. J Evid Based Med 2024. [PMID: 38798014 DOI: 10.1111/jebm.12616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 05/12/2024] [Indexed: 05/29/2024]
Abstract
BACKGROUND The number of published journal articles has grown exponentially during the last 30 years, which may have led to some wasteful research. However, the terminology associated with research waste remains unclear. To address this, we aimed to identify, define, and categorize the aspects of research waste in published biomedical reports. METHODS In this scoping review, we systematically searched for biomedical literature reports from 1993 to 2023 in two databases, focusing on those addressing and defining research waste. Through data charting, we analyzed and categorized the aspects of research waste. RESULTS Based on 4285 initial records in the searches, a total of 832 reports were included in the analysis. The included reports were primarily narrative reviews (26%) and original reports (21%). We categorized research waste into five aspects: methodological, invisible, negligible, underreported, and structural (MINUS) research waste. More than half of the reports (56%) covered methodological research waste concerning flaws in study design, study conduct, or analysis. Invisible research waste covered nonpublication, discontinuation, and lack of data-sharing. Negligible research waste primarily concerned unnecessary repetition, for example, stemming from the absence of preceding a trial with a systematic review of the literature. Underreported research waste mainly included poor reporting, resulting in a lack of transparency. Structural research waste comprised inadequate management, collaboration, prioritization, implementation, and dissemination. CONCLUSION MINUS encapsulates the five main aspects of research waste. Recognizing these aspects of research waste is important for addressing and preventing further research waste and thereby ensuring efficient resource allocation and scientific integrity.
Collapse
Affiliation(s)
- Louise Olsbro Rosengaard
- Center for Perioperative Optimization, Department of Surgery, Copenhagen University Hospital-Herlev and Gentofte, Herlev, Denmark
| | - Mikkel Zola Andersen
- Center for Perioperative Optimization, Department of Surgery, Copenhagen University Hospital-Herlev and Gentofte, Herlev, Denmark
| | - Jacob Rosenberg
- Center for Perioperative Optimization, Department of Surgery, Copenhagen University Hospital-Herlev and Gentofte, Herlev, Denmark
| | - Siv Fonnes
- Center for Perioperative Optimization, Department of Surgery, Copenhagen University Hospital-Herlev and Gentofte, Herlev, Denmark
| |
Collapse
|
2
|
Colling R, Indave I, Del Aguilla J, Cierco Jimenez R, Campbell F, Chechlinska M, Kowalewska M, Holdenrieder S, Trulson I, Worf K, Pollán M, Plans-Beriso E, Pérez-Gómez B, Craciun O, García-Ovejero E, Michalek IM, Maslova K, Rymkiewicz G, Didkowska J, Tan PH, Diyana Bte Md Nasir N, Myles N, Giesen C, Goldman-Lévy G, Lokuhetty D, Cree IA. Moving Forward on Tumor Pathology Research Reporting: A Guide for Pathologists From the World Health Organization Classification of Tumors Living Evidence Gap Map by Tumour Type Group. Mod Pathol 2024; 37:100515. [PMID: 38763419 DOI: 10.1016/j.modpat.2024.100515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 04/30/2024] [Accepted: 05/04/2024] [Indexed: 05/21/2024]
Abstract
Evidence-based medicine (EBM) can be an unfamiliar territory for those working in tumor pathology research, and there is a great deal of uncertainty about how to undertake an EBM approach to planning and reporting histopathology-based studies. In this article, reviewed and endorsed by the Word Health Organization International Agency for Research on Cancer's International Collaboration for Cancer Classification and Research, we aim to help pathologists and researchers understand the basics of planning an evidence-based tumor pathology research study, as well as our recommendations on how to report the findings from these. We introduce some basic EBM concepts, a framework for research questions, and thoughts on study design and emphasize the concept of reporting standards. There are many study-specific reporting guidelines available, and we provide an overview of these. However, existing reporting guidelines perhaps do not always fit tumor pathology research papers, and hence, here, we collate the key reporting data set together into one generic checklist that we think will simplify the task for pathologists. The article aims to complement our recent hierarchy of evidence for tumor pathology and glossary of evidence (study) types in tumor pathology. Together, these articles should help any researcher get to grips with the basics of EBM for planning and publishing research in tumor pathology, as well as encourage an improved standard of the reports available to us all in the literature.
Collapse
Affiliation(s)
- Richard Colling
- Nuffield Department of Surgical Sciences, University of Oxford, Level 4, John Radcliffe Hospital, Oxford, UK; Department of Cellular Pathology, Oxford University Hospitals NHS FT, Oxford, UK.
| | - Iciar Indave
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Javier Del Aguilla
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Ramon Cierco Jimenez
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Fiona Campbell
- Population Health Sciences, Newcastle University, Newcastle Upon Tyne, UK
| | - Magdalena Chechlinska
- Department of Cancer Biology, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Magdalena Kowalewska
- Department of Molecular and Translational Oncology, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Stefan Holdenrieder
- Institute of Laboratory Medicine, German Heart Centre Munich, Munich, Germany
| | - Inga Trulson
- Institute of Laboratory Medicine, German Heart Centre Munich, Munich, Germany
| | - Karolina Worf
- Institute of Laboratory Medicine, German Heart Centre Munich, Munich, Germany
| | - Marina Pollán
- National Center for Epidemiology. Instituto de Salud Carlos III, Madrid, Spain; Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), Madrid, Spain
| | - Elena Plans-Beriso
- National Center for Epidemiology. Instituto de Salud Carlos III, Madrid, Spain
| | - Beatriz Pérez-Gómez
- National Center for Epidemiology. Instituto de Salud Carlos III, Madrid, Spain; Consortium for Biomedical Research in Epidemiology and Public Health (CIBERESP), Madrid, Spain
| | - Oana Craciun
- National Center for Epidemiology. Instituto de Salud Carlos III, Madrid, Spain
| | | | - Irmina Maria Michalek
- Department of Cancer Pathomorphology, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Kateryna Maslova
- Department of Cancer Biology, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Grzegorz Rymkiewicz
- Department of Cancer Pathomorphology, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | - Joanna Didkowska
- Polish National Cancer Registry, Department of Epidemiology and Cancer Prevention, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland
| | | | | | - Nickolas Myles
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Christine Giesen
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Gabrielle Goldman-Lévy
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Dilani Lokuhetty
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| | - Ian A Cree
- International Agency for Research on Cancer (IARC), World Health Organization, Lyon, France
| |
Collapse
|
3
|
Dubin JA, Hameed D, Baksh N, Bains SS, Mont MA, Nace J, Delanois RE, Golladay G. Impact of Reporting Bias, Conflict of Interest, and Funding Sources on Quality of Orthopaedic Research. J Arthroplasty 2024; 39:1348-1352. [PMID: 37972663 DOI: 10.1016/j.arth.2023.11.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 11/06/2023] [Accepted: 11/10/2023] [Indexed: 11/19/2023] Open
Abstract
BACKGROUND Influence of factors like reporting outcomes, conflicts of interest, and funding sources on study outcomes, particularly positive outcomes in orthopedics, remains underexplored. As transparency of partnerships in orthopaedic surgery through conflicts of interest statements has increased over the years, there has been a lack of focus on the value of these partnerships in influencing study outcomes. We aimed to investigate the associations between reporting outcomes, conflicts of interest, and sources of funding on study outcomes. METHODS We reviewed articles published in 1 year in The Journal of Bone and Joint Surgery, The American Journal of Sports Medicine, and The Journal of Arthroplasty. The abstracts were examined for appropriate inclusion, while the authors' names, academic degrees, funding disclosures, and departmental and institutional affiliations were redacted. There were a total of 1,351 publications reviewed from January 1, 2021 to December 31, 2021. RESULTS A significant association was found between positive outcomes and reported conflicts of interest (75% versus 25%, P < .001). Likewise, conflicts of interest showed significant association with industry-sponsored studies (88% versus 12%, P < .001) and evidence level > II (72% versus 28%, P < .001). Industry-sponsored research accounted for the highest percentage of studies involving a conflict of interest (88%) and level I studies (12%). CONCLUSIONS Conflicts of interest are significantly associated with positive outcomes in orthopaedics. Sponsored studies were more inclined to have conflicts of interest and accounted for the majority of level I studies.
Collapse
Affiliation(s)
- Jeremy A Dubin
- Rubin Institute for Advanced Orthopedics Sinai Hospital of Baltimore, Baltimore, Maryland
| | - Daniel Hameed
- Rubin Institute for Advanced Orthopedics Sinai Hospital of Baltimore, Baltimore, Maryland
| | - Nayeem Baksh
- Department of Orthopaedic Surgery and Rehabilitation Medicine, Downstate Medical Center, State University of New York (SUNY), Brooklyn, New York
| | - Sandeep S Bains
- Rubin Institute for Advanced Orthopedics Sinai Hospital of Baltimore, Baltimore, Maryland
| | - Michael A Mont
- Rubin Institute for Advanced Orthopedics Sinai Hospital of Baltimore, Baltimore, Maryland
| | - James Nace
- Rubin Institute for Advanced Orthopedics Sinai Hospital of Baltimore, Baltimore, Maryland
| | - Ronald E Delanois
- Rubin Institute for Advanced Orthopedics Sinai Hospital of Baltimore, Baltimore, Maryland
| | - Gregory Golladay
- Department of Orthopaedic Surgery and Rehabilitation Medicine, Downstate Medical Center, State University of New York (SUNY), Brooklyn, New York; Department of Orthopaedic Surgery, Virginia Commonwealth University Health, Richmond, Virginia
| |
Collapse
|
4
|
Mascarenhas E, Miguel LS, Oliveira MD, Fernandes RM. Economic evaluations of medical devices in paediatrics: a systematic review and a quality appraisal of the literature. COST EFFECTIVENESS AND RESOURCE ALLOCATION 2024; 22:33. [PMID: 38678250 PMCID: PMC11056067 DOI: 10.1186/s12962-024-00537-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 03/21/2024] [Indexed: 04/29/2024] Open
Abstract
BACKGROUND Although economic evaluations (EEs) have been increasingly applied to medical devices, little discussion has been conducted on how the different health realities of specific populations may impact the application of methods and the ensuing results. This is particularly relevant for pediatric populations, as most EEs on devices are conducted in adults, with specific aspects related to the uniqueness of child health often being overlooked. This study provides a review of the published EEs on devices used in paediatrics, assessing the quality of reporting, and summarising methodological challenges. METHODS A systematic literature search was performed to identify peer-reviewed publications on the economic value of devices used in paediatrics in the form of full EEs (comparing both costs and consequences of two or more devices). After the removal of duplicates, article titles and abstracts were screened. The remaining full-text articles were retrieved and assessed for inclusion. In-vitro diagnostic devices were not considered in this review. Study descriptive and methodological characteristics were extracted using a structured template. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 checklist was used to assess the quality of reporting. A narrative synthesis of the results was conducted followed by a critical discussion on the main challenges found in the literature. RESULTS 39 full EEs were eligible for review. Most studies were conducted in high-income countries (67%) and focused on high-risk therapeutic devices (72%). Studies comprised 25 cost-utility analyses, 13 cost-effectiveness analyses and 1 cost-benefit analysis. Most of the studies considered a lifetime horizon (41%) and a health system perspective (36%). Compliance with the CHEERS 2022 items varied among the studies. CONCLUSIONS Despite the scant body of evidence on EEs focusing on devices in paediatrics results highlight the need to improve the quality of reporting and advance methods that can explicitly incorporate the multiple impacts related to the use of devices with distinct characteristics, as well as consider specific child health realities. The design of innovative participatory approaches and instruments for measuring outcomes meaningful to children and their families should be sought in future research.
Collapse
Affiliation(s)
- Edgar Mascarenhas
- Centro de Estudos de Gestão do Instituto Superior Técnico (CEG-IST), Instituto Superior Técnico, Universidade de Lisboa, Avenida Rovisco Pais, 1049-001, Lisboa, Portugal.
| | - Luís Silva Miguel
- Centro de Estudos de Medicina Baseada na Evidência, Faculdade de Medicina, Universidade de Lisboa, Lisboa, Portugal
| | - Mónica D Oliveira
- Centro de Estudos de Gestão do Instituto Superior Técnico (CEG-IST), Instituto Superior Técnico, Universidade de Lisboa, Avenida Rovisco Pais, 1049-001, Lisboa, Portugal
- iBB- Institute for Bioengineering and Biosciences and i4HB- Associate Laboratory Institute for Health and Bioeconomy, Instituto Superior Técnico, Universidade de Lisboa, Lisboa, Portugal
| | - Ricardo M Fernandes
- Laboratório de Farmacologia e Terapêutica, Instituto de Medicina Molecular, Faculdade de Medicina, Universidade de Lisboa, Lisboa, Portugal
- Departmento de Pediatria, Hospital Santa Maria, Centro Hospitalar Universitário Lisboa Norte, Lisboa, Portugal
| |
Collapse
|
5
|
de Oliveira MN, Vidigal MTC, Vieira W, Lins-Candeiro CL, Oliveira LM, Nascimento GG, da Silva GR, Paranhos LR. Assessment of color changes and adverse effects of over-the-counter bleaching protocols: a systematic review and network meta-analysis. Clin Oral Investig 2024; 28:189. [PMID: 38430338 DOI: 10.1007/s00784-024-05595-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Accepted: 02/28/2024] [Indexed: 03/03/2024]
Abstract
OBJECTIVES To assess color change efficacy and the adverse effects of varied over-the-counter (OTC) bleaching protocols. METHODOLOGY The study included randomized clinical trials evaluating color changes from OTC bleaching agents. Nine databases were searched, including the partial capture of the grey literature. The RoB2 tool analyzed the individual risk of bias in the studies. Frequentist network meta-analyses compared treatments through common comparators (∆Eab* and ∆SGU color changes, and tooth sensitivity), integrating direct and indirect estimates and using the mean and risk differences as effect measures with respective 95% confidence intervals. The GRADE approach assessed the certainty of the evidence. RESULTS Overall, 37 remaining studies constituted the qualitative analysis, and ten composed the meta-analyses. The total sample included 1,932 individuals. ∆Eab* was significantly higher in groups 6% hydrogen peroxide (HP) strips (≥ 14 h). ∆SGU was significantly higher in groups at-home 10% carbamide peroxide (CP) (≥ 14 h), followed by 6% HP strips (≥ 14 h) and 3% HP strips (≥ 14 h). At-home 10% CP (7-13 h) and placebo showed lower risks of tooth sensitivity without significant differences between these treatments. CONCLUSION Considering the low level of evidence, OTC products presented satisfactory short-term effects on tooth bleaching compared to the placebo, with little to no impact on dentin hypersensitivity and gingival irritation. CLINICAL RELEVANCE OTC products are proving to be practical alternatives for tooth whitening. However, patients should be advised about the possible risks of carrying out such procedures without professional supervision.
Collapse
Affiliation(s)
- Murilo Navarro de Oliveira
- School of Dentistry, University Center-UNIFAE, São João da Boa Vista, SP, Brazil
- Postgraduate Program in Dentistry, School of Dentistry, Federal University of Uberlândia, Uberlândia, MG, Brazil
| | - Maria Tereza Campos Vidigal
- Postgraduate Program in Dentistry, School of Dentistry, Federal University of Uberlândia, Uberlândia, MG, Brazil
| | - Walbert Vieira
- Division of Endodontics, Department of Restorative Dentistry, School of Dentistry, State University of Campinas, Piracicaba, SP, Brazil
| | - Caio Luiz Lins-Candeiro
- Postgraduate Program in Dentistry, School of Dentistry, Federal University of Uberlândia, Uberlândia, MG, Brazil
| | - Leandro Machado Oliveira
- Department of Stomatology, Postgraduate Program in Dentistry, Federal University of Santa Maria, Santa Maria, RS, Brazil
| | - Gustavo G Nascimento
- Duke-NUS Medical School, Oral Health Academic Programme, Singapore, Singapore
- Dental Research Institute Singapore, National Dental Centre Singapore, Singapore, Singapore
| | - Gisele Rodrigues da Silva
- Department of Operative Dentistry and Dental Materials, School of Dentistry, Federal University of Uberlândia, Uberlândia, MG, Brazil
| | - Luiz Renato Paranhos
- Department of Preventive and Community Dentistry, School of Dentistry, Federal University of Uberlândia, Uberlândia, MG, Brazil.
| |
Collapse
|
6
|
Lloyd KE, Chambers CD. Registered Reports: benefits and challenges of implementing in medicine. Br J Gen Pract 2024; 74:58-59. [PMID: 38272700 PMCID: PMC10824340 DOI: 10.3399/bjgp24x736185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2024] Open
Affiliation(s)
- Kelly E Lloyd
- Leeds Institute of Health Sciences, University of Leeds, Leeds.
| | | |
Collapse
|
7
|
Al Masri A, Schiffner U, Mourad MS, Schmoeckel J, Joseph P, Splieth CH. The impact of bias of underlying literature in guidelines on its recommendations: assessment of the German fluoride guideline. Eur Arch Paediatr Dent 2024; 25:65-73. [PMID: 38007707 PMCID: PMC10942900 DOI: 10.1007/s40368-023-00854-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Accepted: 10/20/2023] [Indexed: 11/28/2023]
Abstract
PURPOSE The significance of the underlying literature in clinical guidelines can be weakened by the risk of bias, which could negatively affect the recommendations. Especially in controversial matters, such as fluoride use for caries prevention in children, biased results may be not reliable and lead to incorrect conclusions. This study was performed to detect bias in underlying literature of the German guideline for caries prevention using fluoride in children, where no consensus was reached between paediatricians and paediatric dentists. METHODS Three tools used for risk of bias assessments of different study designs were RoB 2 for RCTs, ROBINS-I for non-randomized studies, and ROBIS for systematic reviews. For each study cited in the guideline two independent risk of bias assessments were performed. Disagreements were resolved by consensus. RESULTS Out of 58 papers, 48.3% (n = 28) showed high risk of bias, with the majority in sections regarding fluoride tablets, fluoridated toothpaste, and paediatricians' recommendations. 9 out of 20 recommendations and statements were based on studies with high risk of bias, all of which were in these three controversial sections. 13 out of 29 RCTs showed high risk of bias (44.8%), as all 13 non-randomized trials did, while only 2 of 16 (12.5%) systematic reviews had high risk of bias. CONCLUSION Considering risk of bias of cited studies in clinical guidelines may result in substantial changes in its recommendations and aid in reaching consensus. Efforts should be made to assess risk of bias of underlying literature in future clinical guidelines.
Collapse
Affiliation(s)
- A Al Masri
- Department of Preventive and Pediatric Dentistry, Greifswald University Dental Clinics, Walther-Rathenau-Straße 42a, 17475, Greifswald, Germany.
| | - U Schiffner
- Department for Periodontology, Preventive and Restorative Dentistry, Center for Dental and Oral Medicine, University Medical Center Hamburg-Eppendorf (UKE), Martinistraße 52, 20246, Hamburg, Germany
| | - M S Mourad
- Department of Preventive and Pediatric Dentistry, Greifswald University Dental Clinics, Walther-Rathenau-Straße 42a, 17475, Greifswald, Germany
- Department of Orthodontics, Greifswald University Dental Clinics, Walther-Rathenau-Straße 42a, 17475, Greifswald, Germany
| | - J Schmoeckel
- Department of Preventive and Pediatric Dentistry, Greifswald University Dental Clinics, Walther-Rathenau-Straße 42a, 17475, Greifswald, Germany
| | - P Joseph
- Department of Preventive and Pediatric Dentistry, Greifswald University Dental Clinics, Walther-Rathenau-Straße 42a, 17475, Greifswald, Germany
| | - C H Splieth
- Department of Preventive and Pediatric Dentistry, Greifswald University Dental Clinics, Walther-Rathenau-Straße 42a, 17475, Greifswald, Germany
| |
Collapse
|
8
|
Ostermann T, Burkart J, De Jaegere S, Raak C, Simoens S. Overview and quality assessment of health economic evaluations for homeopathic therapy: an updated systematic review. Expert Rev Pharmacoecon Outcomes Res 2024; 24:117-142. [PMID: 37795998 DOI: 10.1080/14737167.2023.2266136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 09/28/2023] [Indexed: 10/06/2023]
Abstract
INTRODUCTION Likewise other medical interventions, economic evaluations of homeopathy contribute to the evidence base of therapeutic concepts and are needed for socioeconomic decision-making. A 2013 review was updated and extended to gain a current overview. METHODS A systematic literature search of the terms 'cost' and 'homeopathy' from January 2012 to July 2022 was performed in electronic databases. Two independent reviewers checked records, extracted data, and assessed study quality using the Consensus on Health Economic Criteria (CHEC) list. RESULTS Six studies were added to 15 from the previous review. Synthesizing both health outcomes and costs showed homeopathic treatment being at least equally effective for less or similar costs than control in 14 of 21 studies. Three found improved outcomes at higher costs, two of which showed cost-effectiveness for homeopathy by incremental analysis. One found similar results and three similar outcomes at higher costs for homeopathy. CHEC values ranged between two and 16, with studies before 2009 having lower values (Mean ± SD: 6.7 ± 3.4) than newer studies (9.4 ± 4.3). CONCLUSION Although results of the CHEC assessment show a positive chronological development, the favorable cost-effectiveness of homeopathic treatments seen in a small number of high-quality studies is undercut by too many examples of methodologically poor research.
Collapse
Affiliation(s)
- Thomas Ostermann
- Department of Psychology and Psychotherapy, Witten/Herdecke University, Witten, Germany
| | - Julia Burkart
- Medical Scientific Services/Medical Affairs, Deutsche Homöopathie-Union DHU-Arzneimittel GmbH & Co. KG, Karlsruhe, Germany
| | - Sabine De Jaegere
- Medical Scientific Services/Medical Affairs, Deutsche Homöopathie-Union DHU-Arzneimittel GmbH & Co. KG, Karlsruhe, Germany
| | - Christa Raak
- Institute of Integrative Medicine, Witten/Herdecke University, Herdecke, Germany
| | - Steven Simoens
- Department of Pharmaceutical and Pharmacological Sciences, KU Leuven, Leuven, Belgium
| |
Collapse
|
9
|
Ott DE. Limitations in Medical Research: Recognition, Influence, and Warning. JSLS 2024; 28:e2023.00049. [PMID: 38405216 PMCID: PMC10882193 DOI: 10.4293/jsls.2023.00049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2024] Open
Abstract
Background As the number of limitations increases in a medical research article, their consequences multiply and the validity of findings decreases. How often do limitations occur in a medical article? What are the implications of limitation interaction? How often are the conclusions hedged in their explanation? Objective To identify the number, type, and frequency of limitations and words used to describe conclusion(s) in medical research articles. Methods Search, analysis, and evaluation of open access research articles from 2021 and 2022 from the Journal of the Society of Laparoscopic and Robotic Surgery and 2022 Surgical Endoscopy for type(s) of limitation(s) admitted to by author(s) and the number of times they occurred. Limitations not admitted to were found, obvious, and not claimed. An automated text analysis was performed for hedging words in conclusion statements. A limitation index score is proposed to gauge the validity of statements and conclusions as the number of limitations increases. Results A total of 298 articles were reviewed and analyzed, finding 1,764 limitations. Four articles had no limitations. The average was between 3.7% and 6.9% per article. Hedging, weasel words and words of estimative probability description was found in 95.6% of the conclusions. Conclusions Limitations and their number matter. The greater the number of limitations and ramifications of their effects, the more outcomes and conclusions are affected. Wording ambiguity using hedging or weasel words shows that limitations affect the uncertainty of claims. The limitation index scoring method shows the diminished validity of finding(s) and conclusion(s).
Collapse
|
10
|
Kazdin AE. Drawing causal inferences from randomized controlled trials in psychotherapy research. Psychother Res 2023; 33:991-1003. [PMID: 36226476 DOI: 10.1080/10503307.2022.2130112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 09/20/2022] [Indexed: 10/17/2022] Open
Abstract
OBJECTIVE Randomized control trials (RCTs) have played a critical role in psychotherapy research. This article discusses RCTs in the context of the criteria for drawing causal inferences in psychotherapy and intervention research more generally. The article also highlights underused variations of RCTs and how they not only establish causal relations but also address critical questions that can improve our intervention portfolio and patient care. CONCLUSION Random assignment is discussed in terms of what it can and cannot do in relation to drawing conclusions about the effects of interventions. Finally, RCTs are examined in the context of multiple questions that can guide therapy research, improve patient care, and develop treatments that reach people in need of psychological services.
Collapse
Affiliation(s)
- Alan E Kazdin
- Department of Psychology, Yale University, New Haven, CT, USA
| |
Collapse
|
11
|
Nelinson D, Ko L, Bass BG. Reading Between the Lines: Navigating Nuance in Medical Literature to Optimize Clinical Decision-Making and Health Care Outcomes. ADVANCES IN MEDICAL EDUCATION AND PRACTICE 2023; 14:1167-1176. [PMID: 37877132 PMCID: PMC10591664 DOI: 10.2147/amep.s427663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 10/12/2023] [Indexed: 10/26/2023]
Abstract
Research-based articles published in medical journals are key to communicating the results of clinical trials, systematic reviews, and meta-analyses. But there are challenges inherent in the communication process. While clinicians rely on the information they read in medical journals to help guide clinical decision-making, most are overwhelmed by the amount of information being published and many receive only limited training on how to critically assess what they read. This can result in suboptimal clinical decision-making, leading to inefficient use of health care resources, avoidance of interventions that may be indicated and useful, or use of interventions that do more harm than good. A literature search of PubMed® was conducted to answer the question, what are the challenges affecting the interpretation of clinical trial results reported in the medical literature that may adversely affect clinical decision making and patient outcomes and how can those challenges be overcome? Results of this review indicate it remains challenging for readers to fully appreciate the nuances that affect the accuracy, utility, and applicability of reported data, and opportunities exist for future continuing professional development interventions to address this challenge by giving health care professionals the knowledge and skills to critically evaluate and interpret literature-based information. The objective of this article is to assist new and aspiring clinicians as well as experienced practitioners in critically assessing the medical literature so they can be informed about the latest medical advances in their areas of specialty and interest and confidently and appropriately integrate this knowledge into clinical practice. This article aspires to be a tool for residency and fellowship program directors, clerkship faculty, mentors, and other HCPs engaged in clinical education.
Collapse
Affiliation(s)
- Donald Nelinson
- Director, US Diabetes/Transplant/Digital Health Publication Lead, General Medicines US Medical, Sanofi, Bridgewater, NJ, USA
| | - Lois Ko
- Post-Doctoral Fellow, US Diabetes, General Medicines, US Medical, Sanofi, Bridgewater, NJ, USA
| | - Brian G Bass
- President, Bass Global, Inc, Fort Myers, FL, USA
| |
Collapse
|
12
|
Inocêncio GSG, Meneses-Santos D, Costa MDMDA, Vieira WA, de Almeida VL, Rodrigues RPCB, Rode SDM, Paranhos LR. Efficacy, safety, and potential industry bias in using deoxycholic acid for submental fat reduction ‒ A systematic review and meta-analysis of randomized clinical trials. Clinics (Sao Paulo) 2023; 78:100220. [PMID: 37806137 PMCID: PMC10570630 DOI: 10.1016/j.clinsp.2023.100220] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 04/30/2023] [Accepted: 05/12/2023] [Indexed: 10/10/2023] Open
Abstract
Lipolytic substance injections to reduce localized fat have been extensively used because it is a low-invasive method. This review aimed to evaluate the efficacy and safety of deoxycholic acid in submental fat reduction compared to a placebo and investigate the potential industry sponsorship bias in the results of randomized clinical trials on this topic. Ten electronic databases were extensively searched for randomized clinical trials without restriction on language and year of publication. Two reviewers extracted the data and assessed the individual risk of bias in the studies with the RoB 2.0 tool. The industry sponsorship bias was evaluated according to citations in the articles regarding industry funding/sponsorship throughout the texts. Fixed and random effects meta-analyses were performed, and the results were reported in Risk Ratio (RR) at a 95% Confidence Interval (95% CI). The initial search provided 5756 results, of which only five were included. Only two studies had a low risk of bias. All studies showed a potential industry bias. The meta-analysis showed that patients treated with deoxycholic acid had significant positive results for all efficacy outcomes and a higher risk of fibrosis, pain, erythema, numbness, swelling, edema, pruritus, nodules, headache, and paresthesia. The low to moderate certainty of evidence found allows concluding that deoxycholic acid is effective in submental fat reduction, causing well-tolerated adverse effects. However, all eligible studies showed a potential industry bias.
Collapse
Affiliation(s)
| | - Daniela Meneses-Santos
- Division of Morphology, Centro de Ciências da Saúde e Biológicas, Universidade Federal de Sergipe, SE, Brazil
| | | | - Walbert A Vieira
- Department of Restorative Dentistry, Endodontics Division, Faculdade de Odontologia de Piracicaba, Universidade Estadual de Campinas (UNICAMP), Piracicaba, SP, Brazil
| | - Vinicius Lima de Almeida
- Postgraduate Program in Dentistry, Faculdade de Odontologia, Universidade Federal de Uberlândia, Uberlândia, MG, Brazil
| | | | - Sigmar de Mello Rode
- Department of Dental Materials and Prothesis, Instituto de Ciência e Tecnologia, Universidade Estadual Paulista Júlio de Mesquita Filho, São José dos Campos, SP, Brazil
| | - Luiz Renato Paranhos
- Division of Preventive and Community Dentistry, Faculdade de Odontologia, Universidade Federal de Uberlândia, Uberlândia, MG, Brazil.
| |
Collapse
|
13
|
Bradley SH, Munafò M. Humility is vital in science, even for The BMJ. BMJ 2023; 382:p1617. [PMID: 37460134 DOI: 10.1136/bmj.p1617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/20/2023]
|
14
|
Ozieranski P, Martinon L, Jachiet PA, Mulinari S. Tip of the Iceberg? Country- and Company-Level Analysis of Drug Company Payments for Research and Development in Europe. Int J Health Policy Manag 2022; 11:2842-2859. [PMID: 35297231 PMCID: PMC10105170 DOI: 10.34172/ijhpm.2022.6575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 02/21/2022] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Creating new therapies often involves drug companies paying healthcare professionals and institutions for research and development (R&D) activities, including clinical trials. However, industry sponsorship can create conflicts of interest (COIs). We analysed approaches to drug company R&D payment disclosure in European countries and the distribution of R&D payments at the country and company level. METHODS Using documentary sources and a stakeholder survey we identified country- regulatory approaches to R&D payment disclosure. We reviewed company-level descriptions of disclosure practices in the United Kingdom, a country with a major role in Europe's R&D. We obtained country-level R&D payment data from industry trade groups and public authorities and company-level data from eurosfordocs.eu, a publicly available payments database. We conducted content analysis and descriptive statistical analysis. RESULTS In 32 of 37 studied countries, all R&D payments were reported without named recipients, following a self-regulatory approach developed by the industry. The methodological descriptions from 125 companies operating in the United Kingdom suggest that within the self-regulatory approach companies had much leeway in deciding what activities and payments were considered as R&D. In five countries, legislation mandated the disclosure of R&D payment recipients, but only in two were payments practically identifiable and analysable. In 17 countries with available data, R&D constituted 19%-82% of all payments reported, with self-regulation associated with higher shares. Available company-level data from three countries with self-regulation suggests that R&D payments were concentrated by big funders, and some companies reported all, or nearly all, payments as R&D. CONCLUSION The lack of full disclosure of R&D payments in countries with industry self-regulation leaves considerable sums of money unaccounted for and potentially many COIs undetected. Disclosure mandated by legislation exists in few countries and rarely enhances transparency practically. We recommend a unified European approach to R&D payment disclosure, including clear definitions and a centralised database.
Collapse
Affiliation(s)
- Piotr Ozieranski
- Department of Social and Policy Sciences, University of Bath, Bath, UK
| | | | | | - Shai Mulinari
- Department of Sociology, Lund University, Lund, Sweden
| |
Collapse
|
15
|
Bradley SH, Lloyd KE, Mellor D, Gill PJ, Richards GC. Lessons learned from advocacy to promote Registered Reports. Br J Gen Pract 2022; 72:564-565. [PMID: 36424163 PMCID: PMC9710836 DOI: 10.3399/bjgp22x721241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Affiliation(s)
| | | | - David Mellor
- Director of Policy, Center for Open Science, Charlottesville, US
| | - Peter J Gill
- Department of Paediatrics, University of Toronto, Toronto, Canada
| | | |
Collapse
|
16
|
Gardener AD, Hick EJ, Jacklin C, Tan G, Cashin AG, Lee H, Nunan D, Toomey EC, Richards GC. Open science and conflict of interest policies of medical and health sciences journals before and during the COVID-19 pandemic: A repeat cross-sectional study. JRSM Open 2022; 13:20542704221132139. [PMID: 36407750 PMCID: PMC9666860 DOI: 10.1177/20542704221132139] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Objectives To audit the transparent and open science standards of health and medical
sciences journal policies and explore the impact of the COVID-19
pandemic. Design Repeat cross-sectional study. Setting 19 journals listed in Google Scholar's Top Publications for health and
medical sciences. Participants Blood, Cell, Circulation, European Heart Journal, Gastroenterology, Journal
of Clinical Oncology, Journal of the American College of Cardiology, Nature
Genetics, Nature Medicine, Nature Neuroscience, Neuron, PLoS ONE,
Proceedings of the National Academy of Sciences, Science Translational
Medicine, The British Medical Journal, The Journal of the American Medical
Association, The Lancet, The Lancet Oncology, and The New England Journal of
Medicine. Main outcome measures We used the Transparency and Openness Promotion (TOP) guideline and the
International Committee of Medical Journal Editors (ICMJE) requirements for
disclosing conflicts of interest (COIs) to evaluate journals standards. Results TOP scores slightly improved during the COVID-19 pandemic, from a median of 5
(IQR: 2–12.5) out of a possible 24 points in February 2020 to 7 (IQR: 4–12)
in May 2021, but overall, scores were very low at both time points. Journal
policies scored highest for their adherence to data transparency and scored
lowest for preregistration of study protocols and analysis plans and the
submission of replication studies. Most journals fulfilled all ICMJE
provisions for reporting COIs before (84%; n = 16) and during (95%;
n = 18) the COVID-19 pandemic. Conclusions The COVID-19 pandemic has highlighted the importance of practising open
science. However, requirements for open science practices in audited
policies were overall low, which may impede progress in health and medical
research. As key stakeholders in disseminating research, journals should
promote a research culture of greater transparency and more robust open
science practices.
Collapse
Affiliation(s)
- Antoni D. Gardener
- Isle of Wight NHS Trust, St Mary's Hospital, Parkhurst Road, Newport, Isle of Wight, PO30 5TG, UK
| | - Ellen J. Hick
- Dartford and Gravesham NHS Trust, Darent Valley Hospital, Darenth Wood Road, Dartford, DA2 8DA, UK
| | - Chloe Jacklin
- Nuffield Department of Orthopaedics Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, OX3 7HE, UK
| | - Gifford Tan
- National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074
| | - Aidan G. Cashin
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, 2031, Australia
- School of Health Sciences, University of New South Wales, Sydney, 2052, Australia
| | - Hopin Lee
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, OX3 7HE, UK
| | - David Nunan
- Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford, Radcliffe Observatory Quarter, Woodstock Road, Oxford, OX2 6GG, UK
| | - Elaine C. Toomey
- School of Allied Health, University of Limerick, Ireland
- Health Research Institute, University of Limerick, Ireland
| | - Georgia C. Richards
- Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford, Radcliffe Observatory Quarter, Woodstock Road, Oxford, OX2 6GG, UK
| |
Collapse
|
17
|
Anderson R, Streck S, Hughes G, Suterfield B, Kee M, Wise A, Hillman C, Ottwell R, Hartwell M, Vassar M. Evaluating reporting of patient-reported outcomes in peptic ulcer disease: a meta-epidemiological study of randomized controlled trials. Expert Rev Pharmacoecon Outcomes Res 2022; 22:1253-1260. [PMID: 36073013 DOI: 10.1080/14737167.2022.2122955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
OBJECTIVES Peptic ulcer disease (PUD) can significantly affect quality of life (QoL). These QoL outcomes are often patient-reported, and their inclusion in clinical trials supplements efficacy outcomes to provide the patients' perspective. This study aimed to assess existing literature for completeness of PRO reporting across randomized controlled trials (RCTs) evaluating PUD. METHODS This was a meta-epidemiological, cross-sectional study which assessed completeness of reporting among RCTs addressing management of PUD. We conducted a comprehensive literature search using MEDLINE, Embase, and the Cochrane Register of Controlled Trials to identify RCTs with a PRO as a primary or secondary outcome. These RCTs were assessed for completion of reporting according to the PRO adaptation of Consolidated Standards of Reporting Trials checklist. RCTs were also assessed for Risk of Bias (RoB) using the Cochrane RoB 2.0 tool. RESULTS Masked, duplicate screening of 829 results from our search yielded a final sample of 35 RCTs. The average completeness of reporting was 32.9% according to the CONSORT-PRO adaptation. Twenty-one (of 35; 60%) of the RCTs were assessed as having 'high' risk of bias and nine (of 35; 25.71%) were assessed as having 'some concerns' for risk of bias. Bivariate regression found completeness of reporting to be positively associated with increased PRO follow-up duration, larger sample size, and studies which report conflicts of interest. CONCLUSION RCTs examining the treatment and prevention of PUD with PROs as an outcome measure have deficient reporting and 'high' risk of bias according to the CONSORT-PRO and Cochrane RoB guidelines.
Collapse
Affiliation(s)
- Reece Anderson
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Sam Streck
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Griffin Hughes
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Bethany Suterfield
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, United States
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
18
|
Kazdin AE. Expanding the scope, reach, and impact of evidence-based psychological treatments. J Behav Ther Exp Psychiatry 2022; 76:101744. [PMID: 35738691 DOI: 10.1016/j.jbtep.2022.101744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 03/18/2022] [Accepted: 04/09/2022] [Indexed: 10/18/2022]
Abstract
The development and evaluation of evidence-based treatments (EBTs) for mental disorders represent an enormous advance with continued progress designed to understand the techniques and increase their use in clinical practice. This article suggests ways of expanding research along several fronts including the extension of the types of randomized controlled trials that are conducted, the use of more diverse samples to encompass different cultures and countries, the expansion of assessments to better reflect client functioning in everyday life, consideration of the impact of treatments for mental disorders on physical health, the careful evaluation of exceptional responders, the use of mixed-methods research, and the development of versions of EBTs that can be scaled. EBTs have been studied in well-controlled settings and extended to clinical settings, albeit less often. The least attention has been accorded their evaluation on a large scale to reach a greater portion of people in need of services but who do not receive any treatment.
Collapse
Affiliation(s)
- Alan E Kazdin
- Department of Psychology, Yale University, 2 Hillhouse Avenue, New Haven, CT, 06520-8205, USA.
| |
Collapse
|
19
|
Stoll M, Hubenschmid L, Koch C, Lieb K, Egloff B. Physicians' attitudes towards disclosure of payments from pharmaceutical companies in a nationwide voluntary transparency database: a cross-sectional survey. BMJ Open 2022; 12:e055963. [PMID: 35750457 PMCID: PMC9234799 DOI: 10.1136/bmjopen-2021-055963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
OBJECTIVES To investigate German physicians' attitudes towards and experiences with voluntary disclosure of payments by pharmaceutical companies in a public database and their impact on future decisions for or against disclosure. DESIGN A national cross-sectional survey conducted in 2018 among physicians who voluntarily disclosed at least one payment in the German transparency regulation. SETTING Retrospective paper-pencil questionnaire about attitudes towards and experiences with voluntary payment disclosures in the first (2015) and second (2016) years of the German transparency regulation. PARTICIPANTS German physicians who disclosed either in the first year only, the second year only, or in both years of the transparency regulation. PRIMARY OUTCOMES (1) The probability to disclose in 2016, predicted by physicians' experience of reactions from others in 2015, descriptive norms and attitudes towards transparency; (2) Frequency and (3) Content of reactions from others in 2015 compared with 2016. RESULTS Data of 234 respondents were analysed (n=42, 45 and 147 physicians who disclosed in 2015, 2016 or both years, respectively). The probability to disclose in 2016 was not predicted by perceived reactions, norms or attitudes towards transparency (p>0.01). Most participants reported not to have received any reactions by patients (190/234, 81%), colleagues (128/234, 55%) or the private environment (153/234, 65%). Neither frequency nor content of reactions differed between the first and second years (scale 1-5; frequency: Mdn2015,2016 = 1.33 vs 1.00, rb=-0.17, p>0.01; content: Mdn2015,2016 = 3.00 vs 3.00, rb=0.19, p>0.01). However, media reporting, fear of reputational damage and a feeling of being defamed were mentioned as reasons for non-disclosure. CONCLUSIONS While confirmatory analyses did not provide significant results, descriptive analyses showed that participants who voluntarily disclose payments mainly do not experience any reactions towards their disclosures but report fears about losing their reputation due to disclosures.
Collapse
Affiliation(s)
- Marlene Stoll
- Department of Psychiatry and Psychotherapy, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany
| | | | - Cora Koch
- Department of Neurology and Neurophysiology, Medical Center-University of Freiburg, Freiburg, Germany
| | - Klaus Lieb
- Department of Psychiatry and Psychotherapy, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany
| | - Boris Egloff
- Department of Psychology, Johannes Gutenberg University Mainz, Mainz, Germany
| |
Collapse
|
20
|
|
21
|
Gill PJ, O'Neill B, Richards GC. Developing future leaders in evidence-based medicine: the inaugural David Sackett Fellowship. BMJ Evid Based Med 2022; 27:131-132. [PMID: 35568386 DOI: 10.1136/bmjebm-2022-111996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 05/03/2022] [Indexed: 11/04/2022]
Affiliation(s)
- Peter J Gill
- Department of Pediatrics, The Hospital for Sick Children, Toronto, Ontario, Canada
- Child Health Evaluative Sciences, SickKids Research Institute, Toronto, Ontario, Canada
- Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - Braden O'Neill
- Department of Family and Community Medicine, St Michael's Hospital, Toronto, Ontario, Canada
| | - Georgia C Richards
- Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
- Global Centre on Healthcare and Urbanisation, Kellogg College, University of Oxford, Oxford, UK
| |
Collapse
|
22
|
Bradley SH, DeVito NJ, Lloyd KE, Logullo P, Butler JE. Improving medical research in the United Kingdom. BMC Res Notes 2022; 15:165. [PMID: 35562775 PMCID: PMC9100293 DOI: 10.1186/s13104-022-06050-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 04/24/2022] [Indexed: 11/13/2022] Open
Abstract
Poor quality medical research causes serious harms by misleading healthcare professionals and policymakers, decreasing trust in science and medicine, and wasting public funds. Here we outline underlying problems including insufficient transparency, dysfunctional incentives, and reporting biases. We make the following recommendations to address these problems: Journals and funders should ensure authors fulfil their obligation to share detailed study protocols, analytical code, and (as far as possible) research data. Funders and journals should incentivise uptake of registered reports and establish funding pathways which integrate evaluation of funding proposals with initial peer review of registered reports. A mandatory national register of interests for all those who are involved in medical research in the UK should be established, with an expectation that individuals maintain the accuracy of their declarations and regularly update them. Funders and institutions should stop using metrics such as citations and journal's impact factor to assess research and researchers and instead evaluate based on quality, reproducibility, and societal value. Employers and non-academic training programmes for health professionals (clinicians hired for patient care, not to do research) should not select based on number of research publications. Promotions based on publication should be restricted to those hired to do research.
Collapse
Affiliation(s)
- Stephen H. Bradley
- Leeds Institute of Health Sciences, University of Leeds, Worsley Building, Leeds, LS2 9JT UK
| | - Nicholas J. DeVito
- The DataLab and Centre for Evidence Based Medicine, Nuffield Department of Primary Care Health Sciences, New Radcliffe House, 2nd floor, Radcliffe Observatory Quarter,Woodstock Road, Oxford, OX2 6GG UK
| | - Kelly E. Lloyd
- Leeds Institute of Health Sciences, University of Leeds, Worsley Building, Leeds, LS2 9JT UK
| | - Patricia Logullo
- UK EQUATOR Centre, Centre for Statistics in Medicine, NDORMS, University of Oxford, Windmill Road, Oxford, OX3 7LD UK
| | - Jessica E. Butler
- Centre for Health Data Science, University of Aberdeen, Aberdeen, AB25 2ZD UK
| |
Collapse
|
23
|
Affiliation(s)
| | - Kelly E Lloyd
- Leeds Institute of Health Sciences, University of Leeds, Leeds, UK
| | - Nicholas J DeVito
- DataLab and Centre for Evidence Based Medicine, University of Oxford, Oxford, UK
| |
Collapse
|
24
|
Van Calster B, Wynants L, Riley RD, van Smeden M, Collins GS. Methodology over metrics: current scientific standards are a disservice to patients and society. J Clin Epidemiol 2021; 138:219-226. [PMID: 34077797 PMCID: PMC8795888 DOI: 10.1016/j.jclinepi.2021.05.018] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 05/23/2021] [Accepted: 05/25/2021] [Indexed: 01/08/2023]
Abstract
Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society.
Collapse
Affiliation(s)
- Ben Van Calster
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium; Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, Netherlands; EPI-Centre, KU Leuven, Leuven, Belgium.
| | - Laure Wynants
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium; EPI-Centre, KU Leuven, Leuven, Belgium; Department of Epidemiology, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
| | - Richard D Riley
- Centre for Prognosis Research, School of Medicine, Keele University, Keele, UK
| | - Maarten van Smeden
- Julius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Gary S Collins
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Musculoskeletal Sciences, University of Oxford, Oxford, UK; NIHR Oxford Biomedical Research Centre, John Radcliffe Hospital, Oxford, UK; UK EQUATOR Centre, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
25
|
Šimić J, Marušić M, Gelo M, Šaravanja N, Mišak A, Marušić A. Long‐term outcomes of 2‐day training on planning and writing research on publication output of medical professionals: 11‐year cohort study. LEARNED PUBLISHING 2021. [DOI: 10.1002/leap.1418] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Josip Šimić
- School of Health Sciences University of Mostar Mostar Bosnia and Herzegovina
| | | | - Marijana Gelo
- Croatian Medical Journal, School of Medicine University of Zagreb Zagreb Croatia
| | - Nikolina Šaravanja
- Faculty of Humanities and Social Sciences University of Mostar Mostar Bosnia and Herzegovina
| | | | - Ana Marušić
- Department of Research in Biomedicine and Health University of Split School of Medicine Split Croatia
| |
Collapse
|
26
|
Sangare M, Berthe A, Dolo H, Diabaté AF, Konipo FDN, Soumaoro L, Doumbia SS, Coulibaly ME, Diarra L, Sanogo Y, Atsou KM, Diallo AA, Coulibaly SY, Keita M, Doumbia S, Coulibaly YI. Evaluation of mass drug administration for schistosomiasis and soil-transmitted helminths in school-aged children in Bankass, Mali. Int J Infect Dis 2021; 112:196-201. [PMID: 34481965 DOI: 10.1016/j.ijid.2021.08.063] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Revised: 08/20/2021] [Accepted: 08/26/2021] [Indexed: 12/01/2022] Open
Abstract
BACKGROUND In 2004, Mali implemented mass drug administration (MDA) aimed at controlling schistosomiasis and soil-transmitted helminths. Despite several rounds of MDA, the health district of Bankass reported low coverage (64.8%) for praziquantel and albendazole in 2017, meaning that this district was still facing challenges in accomplishing the targeted 75% coverage. This study aimed to explore the barriers and gaps that hindered MDA implementation in Bankass. METHODS A cross-sectional study was performed. Questionnaires were administrated to all school-aged children in randomly selected villages. Technical directors of community health centers and community drug distributors in the selected villages were included in the interviews. RESULTS A total of 2128 children and 52 health workers were interviewed. Coverage rates were 93.51% (1990/2128) for praziquantel and 95.25% (2027/2128) for albendazole. Among the untreated children, 31.63% (31/98) reported being unaware of the campaign and 26.53% (26/98) were unable to reach the distribution points. Most of the health workers suggested increasing incentives. CONCLUSION The data showed satisfactory coverage >90%, in contrast with lower rates initially reported by the district health information system. These results raise concerns about the reliability of programmatic data and highlight the importance of population-based surveys for the evaluation of control interventions.
Collapse
Affiliation(s)
- Moussa Sangare
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali.
| | - Adama Berthe
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Housseini Dolo
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Abdoul Fatao Diabaté
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Fatoumata Dite Nènè Konipo
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Lamine Soumaoro
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Salif Seriba Doumbia
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Michel Emmanuel Coulibaly
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Lamine Diarra
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Yacouba Sanogo
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Kueshivi Midodji Atsou
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Abdallah Amadou Diallo
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Siaka Yamoussa Coulibaly
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | | | - Seydou Doumbia
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali
| | - Yaya Ibrahim Coulibaly
- International Center for Excellence in Research Mali (ICER-Mali), University of Sciences, Techniques, and Technologies of Bamako (USTTB), Bamako, Mali; Dermatology Hospital of Bamako, Bamako, Mali
| |
Collapse
|
27
|
Singh V, Reddy K, Singh R. Medical research and publication: Concerns and way forward. J ANAT SOC INDIA 2021. [DOI: 10.4103/jasi.jasi_199_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
|
28
|
|