1
|
Armond ACV, Cobey KD, Moher D. Research Integrity definitions and challenges. J Clin Epidemiol 2024; 171:111367. [PMID: 38642717 DOI: 10.1016/j.jclinepi.2024.111367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 04/10/2024] [Accepted: 04/14/2024] [Indexed: 04/22/2024]
Abstract
Research integrity is guided by a set of principles to ensure research reliability and rigor. It serves as a pillar to uphold society's trust in science and foster scientific progress. However, over the past 2 decades, a surge in research integrity concerns, including fraudulent research, reproducibility challenges, and questionable practices, has raised critical questions about the reliability of scientific outputs, particularly in biomedical research. In the biomedical sciences, any breaches in research integrity could potentially lead to a domino effect impacting patient care, medical interventions, and the broader implementation of healthcare policies. Addressing these breaches requires measures such as rigorous research methods, transparent reporting, and changing the research culture. Institutional support through clear guidelines, robust training, and mentorship is crucial to fostering a culture of research integrity. However, structural and institutional factors, including research incentives and recognition systems, play an important role in research behavior. Therefore, promoting research integrity demands a collective effort from all stakeholders to maintain public trust in the scientific community and ensure the reliability of science. Here we discuss some definitions and principles, the implications for biomedical sciences, and propose actionable steps to foster research integrity.
Collapse
Affiliation(s)
- Anna Catharina V Armond
- Metaresearch and Open Science Program, University of Ottawa Heart Institute, Ottawa, Canada.
| | - Kelly D Cobey
- Metaresearch and Open Science Program, University of Ottawa Heart Institute, Ottawa, Canada; School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - David Moher
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada; Centre for Journalology, Ottawa Hospital Research Institute, Ottawa, Canada
| |
Collapse
|
2
|
Schenkel M. Health emergencies, science contrarianism and populism: A scoping review. Soc Sci Med 2024; 346:116691. [PMID: 38430871 DOI: 10.1016/j.socscimed.2024.116691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 01/10/2024] [Accepted: 02/12/2024] [Indexed: 03/05/2024]
Abstract
Populism has emerged as a central explanation employed by both media outlets and scholars for the mishandling of the COVID-19 crisis. Nonetheless, the relationship between public health and populism extends before and beyond the pandemic. This paper offers a comprehensive overview of existing evidence and theoretical conceptualisations on the intersection of populism, health emergencies, and contrarian scientific positions, drawing from a diverse range of disciplines. I conducted a scoping review of 283 original studies, analysing their analytical framework, geographic focuses, and methodological approaches. Employing quantitative text analysis, I summarised the research field into 18 common topics, organised into five coherent categories: citizen's perspective, political elites, political communication, pandemic consequences, and non-COVID-related issues. While the scholarly interest in this area has surged since the onset of the pandemic, it has predominantly concentrated on specific cases, such as Brazil and the US, often conflating different policy types. The evidence summary elucidates that populism assumes varying roles within distinct contexts, and there is no linear relationship between political populism and specific approaches to health crises and science. I further compare definitions of populism within the context of health and scientific positions. I propose that future research should employ a policy typology for health emergency responses, assessing political positions based on policy arenas. This paper contributes to the understanding of the complex interplay between political populism, contrarian scientific perspectives, and public health.
Collapse
Affiliation(s)
- Marina Schenkel
- Trinity College Dublin, Department of Political Science, 3 College Green, Dublin, 2 - D02 XH97, Ireland.
| |
Collapse
|
3
|
Chaix E, Mongin D, Gabay C, Iudici M. Reporting and Representativeness of Race, Ethnicity, and Socioeconomic Status in Systemic Sclerosis Randomized Trials: An Observational Study. Arthritis Care Res (Hoboken) 2023; 75:1698-1705. [PMID: 36358027 DOI: 10.1002/acr.25059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 10/07/2022] [Accepted: 11/08/2022] [Indexed: 11/13/2022]
Abstract
OBJECTIVE To assess how and to what extent socioeconomic status and ethnicity/race of participants are reported in randomized controlled trials (RCTs) on systemic sclerosis (SSc), and to estimate the representativeness of different ethnic/racial groups in SSc RCTs. METHODS We searched all published RCTs on SSc indexed in PubMed. We retrieved information on main features of RCTs published from 2000 onward and recorded for each study whether race/ethnicity was reported; how ethnicity/race was defined and assigned; and the number of patients included for each racial/ethnic group. Multivariable logistic regression was used to identify factors associated with race/ethnicity reporting. Proportion of races/ethnicities included in US-based RCTs on SSc was examined and compared with US demographic data. RESULTS We included 106 studies, mostly conducted in Europe (42%) or North America (25%), published after 2010 (74%), and enrolling a total of 6,693 patients. About one-third of studies provided information about race/ethnicity, with no improved reporting over time. Only 2 papers reported patient's socioeconomic status. Study location (US or intercontinental) was the only significant factor associated with a better reporting of race/ethnicity in multivariable analysis. In studies where race/ethnicity was reported, White patients were mostly represented (79%), followed by Asian (7%), and African American (6%). In the sensitivity analysis limited to studies from the US, underrepresentation of African American patients was observed in the 2000-2010 time period, but not later. CONCLUSION Documentation of race/ethnicity and socioeconomic status is poor in RCTs on SSc. More effort should be made to document race/ethnicity and socioeconomic status and to promote diversity in SSc RCTs.
Collapse
Affiliation(s)
- Edouard Chaix
- Geneva University Hospitals and University of Geneva, Geneva, Switzerland
| | - Denis Mongin
- Geneva University Hospitals and University of Geneva, Geneva, Switzerland
| | - Cem Gabay
- Geneva University Hospitals and University of Geneva, Geneva, Switzerland
| | - Michele Iudici
- Geneva University Hospitals and University of Geneva, Geneva, Switzerland
| |
Collapse
|
4
|
Farah L, Davaze-Schneider J, Martin T, Nguyen P, Borget I, Martelli N. Are current clinical studies on artificial intelligence-based medical devices comprehensive enough to support a full health technology assessment? A systematic review. Artif Intell Med 2023; 140:102547. [PMID: 37210155 DOI: 10.1016/j.artmed.2023.102547] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 03/28/2023] [Accepted: 04/04/2023] [Indexed: 05/22/2023]
Abstract
INTRODUCTION Artificial Intelligence-based Medical Devices (AI-based MDs) are experiencing exponential growth in healthcare. This study aimed to investigate whether current studies assessing AI contain the information required for health technology assessment (HTA) by HTA bodies. METHODS We conducted a systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology to extract articles published between 2016 and 2021 related to the assessment of AI-based MDs. Data extraction focused on study characteristics, technology, algorithms, comparators, and results. AI quality assessment and HTA scores were calculated to evaluate whether the items present in the included studies were concordant with the HTA requirements. We performed a linear regression for the HTA and AI scores with the explanatory variables of the impact factor, publication date, and medical specialty. We conducted a univariate analysis of the HTA score and a multivariate analysis of the AI score with an alpha risk of 5 %. RESULTS Of 5578 retrieved records, 56 were included. The mean AI quality assessment score was 67 %; 32 % of articles had an AI quality score ≥ 70 %, 50 % had a score between 50 % and 70 %, and 18 % had a score under 50 %. The highest quality scores were observed for the study design (82 %) and optimisation (69 %) categories, whereas the scores were lowest in the clinical practice category (23 %). The mean HTA score was 52 % for all seven domains. 100 % of the studies assessed clinical effectiveness, whereas only 9 % evaluated safety, and 20 % evaluated economic issues. There was a statistically significant relationship between the impact factor and the HTA and AI scores (both p = 0.046). DISCUSSION Clinical studies on AI-based MDs have limitations and often lack adapted, robust, and complete evidence. High-quality datasets are also required because the output data can only be trusted if the inputs are reliable. The existing assessment frameworks are not specifically designed to assess AI-based MDs. From the perspective of regulatory authorities, we suggest that these frameworks should be adapted to assess the interpretability, explainability, cybersecurity, and safety of ongoing updates. From the perspective of HTA agencies, we highlight that transparency, professional and patient acceptance, ethical issues, and organizational changes are required for the implementation of these devices. Economic assessments of AI should rely on a robust methodology (business impact or health economic models) to provide decision-makers with more reliable evidence. CONCLUSION Currently, AI studies are insufficient to cover HTA prerequisites. HTA processes also need to be adapted because they do not consider the important specificities of AI-based MDs. Specific HTA workflows and accurate assessment tools should be designed to standardise evaluations, generate reliable evidence, and create confidence.
Collapse
Affiliation(s)
- Line Farah
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Innovation Center for Medical Devices, Foch Hospital, 40 Rue Worth, 92150 Suresnes, France.
| | - Julie Davaze-Schneider
- Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Tess Martin
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Pierre Nguyen
- Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| | - Isabelle Borget
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Department of Biostatistics and Epidemiology, Gustave Roussy, University Paris-Saclay, 94805 Villejuif, France; Oncostat U1018, Inserm, University Paris-Saclay, Équipe Labellisée Ligue Contre le Cancer, Villejuif, France
| | - Nicolas Martelli
- Groupe de Recherche et d'accueil en Droit et Economie de la Santé (GRADES) Department, University Paris-Saclay, Orsay, France; Pharmacy Department, Georges Pompidou European Hospital, AP-HP, 20 Rue Leblanc, 75015 Paris, France
| |
Collapse
|
5
|
Wiffen P. EJHP's impact factor moves on up. Eur J Hosp Pharm 2022; 29:241. [PMID: 35998939 PMCID: PMC9660556 DOI: 10.1136/ejhpharm-2022-003498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
|
6
|
Innocenti T, Feller D, Giagio S, Salvioli S, Minnucci S, Brindisino F, Cosentino C, Piano L, Chiarotto A, Ostelo R. Adherence to the PRISMA statement and its association with risk of bias in systematic reviews published in rehabilitation journals: A meta-research study. Braz J Phys Ther 2022; 26:100450. [PMID: 36270163 PMCID: PMC9583447 DOI: 10.1016/j.bjpt.2022.100450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 09/02/2022] [Accepted: 10/03/2022] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Systematic reviews (SRs) and meta-analyses are essential resources for the clinicians. They allow to evaluate the strengths and the weaknesses of the evidence to support clinical decision-making if they are adequately reported. Little is known in the rehabilitation field about the completeness of reporting of SRs and its relationship with the risk of bias (ROB). OBJECTIVES Primary: 1) To evaluate the completeness of reporting of systematic reviews (SRs) published in rehabilitation journals by evaluating their adherence to the PRISMA 2009 checklist, 2) To investigate the relationship between ROB and completeness of reporting. Secondary: To study the association between completeness of reporting and journals and study characteristics. METHODS A random sample of 200 SRs published between 2011 and 2020 in 68 rehabilitation journals was indexed under the "rehabilitation" category in the InCites database. Two independent reviewers evaluated adherence to the PRISMA checklist and assessed ROB using the ROBIS tool. Overall adherence and adherence to each PRISMA item and section were calculated. Regression analyses investigated the association between completeness of reporting, ROB, and other characteristics (impact factor, publication options, publication year, and study protocol registration). RESULTS The mean overall PRISMA adherence across the 200 studies considered was 61.4%. Regression analyses show that having a high overall ROB is a significant predictor of lower adherence (B=-7.1%; 95%CI -12.1, -2.0). Studies published in fourth quartile journals displayed a lower overall adherence (B= -7.2%; 95%CI -13.2, -1.3) than those published in first quartile journals; the overall adherence increased (B= 11.9%; 95%CI 5.9, 18.0) if the SR protocol was registered. No association between adherence, publication options, and publication year was found. CONCLUSION Reporting completeness in rehabilitation SRs is suboptimal and is associated with ROB, impact factor, and study registration. Authors of SRs should improve adherence to the PRISMA guideline, and journal editors should implement strategies to optimize the completeness of reporting.
Collapse
Affiliation(s)
- Tiziano Innocenti
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, the Netherlands; GIMBE Foundation, Bologna, Italy.
| | - Daniel Feller
- Provincial Agency for Health of the Autonomous Province of Trento, Trento, Italy
| | - Silvia Giagio
- Division of Occupational Medicine, IRCCS Azienda Ospedaliero-Universitaria di Bologna, Bologna, Italy; Department of Biomedical and Neuromotor Sciences (DIBINEM), Alma Mater Studiorum, University of Bologna, Bologna, Italy
| | - Stefano Salvioli
- GIMBE Foundation, Bologna, Italy; Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genoa, Genoa, Italy
| | - Silvia Minnucci
- Department of Clinical Science and Translational Medicine, University of Rome Tor Vergata, Rome, Italy
| | - Fabrizio Brindisino
- Department of Clinical Science and Translational Medicine, University of Rome Tor Vergata, Rome, Italy; Department of Medicine and Health Science "Vincenzo Tiberio", University of Molise, Campobasso, Italy
| | - Carola Cosentino
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genoa, Genoa, Italy
| | - Leonardo Piano
- Unit of Rehabilitation and Functional Recovery, Fondazione dei Santi Lorenzo e Teobaldo, Rodello, Italy
| | - Alessandro Chiarotto
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, the Netherlands; Department of General Practice, Erasmus MC, University Medical Center, Rotterdam, the Netherlands
| | - Raymond Ostelo
- Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam Movement Sciences, the Netherlands; Department of Epidemiology and Data Science, Amsterdam UMC, Location VUmc, Amsterdam Movement Sciences research institute, the Netherlands
| |
Collapse
|
7
|
Talley NJ. The impact of the
MJA
continues its rise. Med J Aust 2022; 217:187-188. [DOI: 10.5694/mja2.51660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 07/04/2022] [Indexed: 11/17/2022]
|
8
|
Sadoyu S, Tanni KA, Punrum N, Paengtrai S, Kategaew W, Promchit N, Lai NM, Thakkinstian A, Ngorsuraches S, Bangpan M, Veettil S, Chaiyakunapruk N. Methodological approaches for assessing certainty of the evidence in umbrella reviews: A scoping review. PLoS One 2022; 17:e0269009. [PMID: 35675337 PMCID: PMC9176806 DOI: 10.1371/journal.pone.0269009] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 05/12/2022] [Indexed: 01/04/2023] Open
Abstract
INTRODUCTION The number of umbrella reviews (URs) that compiled systematic reviews and meta-analysis (SR-MAs) has increased dramatically over recent years. No formal guidance for assessing the certainty of evidence in URs of meta-analyses exists nowadays. URs of non-interventional studies help establish evidence linking exposure to certain health outcomes in a population. This study aims to identify and describe the methodological approaches for assessing the certainty of the evidence in published URs of non-interventions. METHODS We searched from 3 databases including PubMed, Embase, and The Cochrane Library from May 2010 to September 2021. We included URs that included SR-MAs of studies with non-interventions. Two independent reviewers screened and extracted data. We compared URs characteristics stratified by publication year, journal ranking, journal impact factor using Chi-square test. RESULTS Ninety-nine URs have been included. Most were SR-MAs of observational studies evaluating association of non-modifiable risk factors with some outcomes. Only half (56.6%) of the included URs assessed the certainty of the evidence. The most frequently used criteria is credibility assessment (80.4%), followed by GRADE approach (14.3%). URs published in journals with higher journal impact factor assessed certainty of evidence than URs published in lower impact group (77.1 versus 37.2% respectively, p < 0.05). However, criteria for credibility assessment used in four of the seven URs that were published in top ranking journals were slightly varied. CONCLUSIONS Half of URs of MAs of non-interventional studies have assessed the certainty of the evidence, in which criteria for credibility assessment was the commonly used method. Guidance and standards are required to ensure the methodological rigor and consistency of certainty of evidence assessment for URs.
Collapse
Affiliation(s)
| | - Kaniz Afroz Tanni
- Department of Health Outcomes Research and Policy, Harrison College of Pharmacy, Auburn University, Auburn, Alabama, United States of America
| | | | | | - Warittakorn Kategaew
- Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, Utah, United States of America
| | | | - Nai Ming Lai
- School of Medicine, Taylor’s University, Subang Jaya, Malaysia
- School of Pharmacy, Monash University Malaysia, Bandar Sunway, Malaysia
| | - Ammarin Thakkinstian
- Department of Clinical Epidemiology and Biostatistics, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
- Mahidol University Health Technology Assessment Graduate Program, Bangkok, Thailand
| | - Surachat Ngorsuraches
- Department of Health Outcomes Research and Policy, Harrison College of Pharmacy, Auburn University, Auburn, Alabama, United States of America
| | - Mukdarut Bangpan
- The Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre), Social Research Institute, University College London, London, United Kingdom
| | - Sajesh Veettil
- Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, Utah, United States of America
| | - Nathorn Chaiyakunapruk
- Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, Utah, United States of America
- IDEAS Center, Veterans Affairs Salt Lake City Healthcare System, Salt Lake City, Utah, United States of America
| |
Collapse
|
9
|
Yeh JT, Shulruf B, Lee HC, Huang PH, Kuo WH, Hwang TC, Chen CH. Faculty appointment and promotion in Taiwan's medical schools, a systematic analysis. BMC MEDICAL EDUCATION 2022; 22:356. [PMID: 35538519 PMCID: PMC9088140 DOI: 10.1186/s12909-022-03435-2] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Accepted: 05/05/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND A rigorous faculty appointment and promotion (FAP) system is vital for the success of any academic institution. However, studies examining the FAP system in Asian universities are lacking. We surveyed the FAP policies of Taiwan's medical schools and identified an overreliance on the CJA score (manuscript Category, Journal quality, and Author order). The potential shortcomings of this metric and recommendations for refinement were discussed. METHODS We obtained the FAP documents from all 12 medical schools in Taiwan, and analyzed their use of traditional versus non-traditional criteria for FAP according to a published methodology. The influence of the journal impact factor (JIF) on the FAP process was quantified by comparing its relative weight between papers with two extreme JIFs. To better understand the research impact and international standing of each school, we utilized the public bibliographic database to rank universities by the number of papers, and the proportions of papers within the top 10% or 50% citation. RESULTS Compared with other countries, Taiwan's medical schools focus more on the quantifiable quality of the research, mostly using a "CJA" score that integrates the category, JIF or ranking, and authorship of a paper, with the JIF being the most influential factor. The CJA score for an article with a JIF of 20 can be up to three times the threshold for promotion to Assistant Professor. The emphasis on JIF is based on a presumed correlation between JIF and citation counts. However, our analysis shows that Taiwan's medical schools have lower-than-average citation counts despite a competitive rank in the number of publications. CONCLUSIONS The JIF plays an unrivaled role in determining the outcome of FAP in Taiwan's medical schools, mostly via the CJA system. The questionable effectiveness of the current system in elevating the international standing of Taiwan's higher-education institutions calls for a re-examination of the FAP system. We recommend a reduction in the relative importance of CJA score in the FAP system, adopting more rigorous metrics such as the h-index for evaluating research quality, and supporting more research aimed at improving the FAP system.
Collapse
Affiliation(s)
- Jiunn-Tyng Yeh
- Department of Medicine, Yang Ming Campus, National Yang Ming Chiao Tung University College of Medicine, 155 Li-Long St., Sec. 2, Shih-Pai, Taipei, 112, Taiwan R.O.C
| | - Boaz Shulruf
- Office of Medical Education, University of New South Wales, Sydney, Australia
| | - Hsin-Chen Lee
- Institute of Pharmacology, National Yang Ming Chiao Tung University College of Medicine, Taipei, Taiwan
| | - Pin-Hsiang Huang
- Office of Medical Education, University of New South Wales, Sydney, Australia
- Department of Medicine, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Wen-Hua Kuo
- Institute of Science, Technology and Society, National Yang Ming Chiao Tung University, Taipei, Taiwan
- Institute of Public Health, National Yang Ming Chiao Tung University College of Medicine, Taipei, Taiwan
| | - Tyzh-Chang Hwang
- Institute of Pharmacology, National Yang Ming Chiao Tung University College of Medicine, Taipei, Taiwan
| | - Chen-Huan Chen
- Department of Medicine, Yang Ming Campus, National Yang Ming Chiao Tung University College of Medicine, 155 Li-Long St., Sec. 2, Shih-Pai, Taipei, 112, Taiwan R.O.C..
- Department of Medical Education, Taipei Veterans General Hospital, Taipei, Taiwan.
| |
Collapse
|
10
|
The impact of radiomics for human papillomavirus status prediction in oropharyngeal cancer: systematic review and radiomics quality score assessment. Neuroradiology 2022; 64:1639-1647. [PMID: 35459957 PMCID: PMC9271107 DOI: 10.1007/s00234-022-02959-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 04/07/2022] [Indexed: 11/19/2022]
Abstract
Purpose
Human papillomavirus (HPV) status assessment is crucial for decision making in oropharyngeal cancer patients. In last years, several articles have been published investigating the possible role of radiomics in distinguishing HPV-positive from HPV-negative neoplasms. Aim of this review was to perform a systematic quality assessment of radiomic studies published on this topic. Methods Radiomics studies on HPV status prediction in oropharyngeal cancer patients were selected. The Radiomic Quality Score (RQS) was assessed by three readers to evaluate their methodological quality. In addition, possible correlations between RQS% and journal type, year of publication, impact factor, and journal rank were investigated. Results After the literature search, 19 articles were selected whose RQS median was 33% (range 0–42%). Overall, 16/19 studies included a well-documented imaging protocol, 13/19 demonstrated phenotypic differences, and all were compared with the current gold standard. No study included a public protocol, phantom study, or imaging at multiple time points. More than half (13/19) included feature selection and only 2 were comprehensive of non-radiomic features. Mean RQS was significantly higher in clinical journals. Conclusion Radiomics has been proposed for oropharyngeal cancer HPV status assessment, with promising results. However, these are supported by low methodological quality investigations. Further studies with higher methodological quality, appropriate standardization, and greater attention to validation are necessary prior to clinical adoption. Supplementary Information The online version contains supplementary material available at 10.1007/s00234-022-02959-0.
Collapse
|
11
|
Renesme L, Pierro M, Cobey KD, Mital R, Nangle K, Shorr R, Lalu MM, Thébaud B. Definition and Characteristics of Mesenchymal Stromal Cells in Preclinical and Clinical Studies: A Scoping Review. Stem Cells Transl Med 2022; 11:44-54. [PMID: 35641170 PMCID: PMC8895491 DOI: 10.1093/stcltm/szab009] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Accepted: 10/05/2021] [Indexed: 11/12/2022] Open
Abstract
Mesenchymal stromal cells (MSCs) are widely used in preclinical and clinical research. Despite minimal criteria to define MSCs provided by the International Society for Cell and Gene Therapy (ISCT), concerns have been raised about inconsistent descriptions of cell products used. To address the question "How are MSCs currently defined and characterized?" we conducted a scoping review on original MSC preclinical and clinical studies published over a 3-month period. Selected studies identified from a systematic search of MEDLINE and Embase were categorized as follows: Clinical, Animal, Biology, or Biomaterial studies. Data were extracted from a randomly selected subsample of studies. We extracted information, including epidemiological characteristics of studies, study design, ISCT criteria, and MSC characterization and culture condition. A total of 1053 articles were included and among them, 318 articles were analyzed. Overall, 18% of the articles explicitly referred to the ISCT minimal criteria for MSC. MSC characteristics and culture conditions were inconstantly reported (eg, viability assay reported in only 18% of the articles). Only 20% of documents reported at least 1 functional assay. Clinical studies showed inconsistent completeness in reporting relevant information on the MSC characterization and cell manufacturing processes. These results suggest that further development and implementation of a consensus definition of MSCs and reporting guidelines are needed to enhance rigor, reproducibility, and transparency in MSC research.
Collapse
Affiliation(s)
- Laurent Renesme
- Regenerative Medicine Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Maria Pierro
- Neonatal and Paediatric Intensive Care Unit, M. Bufalini Hospital, AUSL Romagna, Cesena, Italy
| | - Kelly D Cobey
- Centre for Journalology, Clinical Epidemiology Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
- School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Rhea Mital
- Regenerative Medicine Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
- Neonatology, Department of Pediatrics, Children’s Hospital of Eastern Ontario (CHEO) and CHEO Research Institute, Ottawa, ON, Canada
| | - Kennedy Nangle
- Regenerative Medicine Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Risa Shorr
- Centre for Journalology, Clinical Epidemiology Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | - Manoj M Lalu
- Regenerative Medicine Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
- Centre for Journalology, Clinical Epidemiology Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
- Department of Anesthesiology and Pain Medicine, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
- Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| | - Bernard Thébaud
- Regenerative Medicine Program, The Ottawa Hospital Research Institute, Ottawa, ON, Canada
- Neonatology, Department of Pediatrics, Children’s Hospital of Eastern Ontario (CHEO) and CHEO Research Institute, Ottawa, ON, Canada
- Department of Cellular and Molecular Medicine, University of Ottawa, Ottawa, ON, Canada
| |
Collapse
|
12
|
The completeness of reporting is suboptimal in randomized controlled trials published in rehabilitation journals, with trials with low risk of bias displaying better reporting: a meta-research study. Arch Phys Med Rehabil 2022; 103:1839-1847. [DOI: 10.1016/j.apmr.2022.01.156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 01/22/2022] [Accepted: 01/25/2022] [Indexed: 11/21/2022]
|
13
|
Characteristics and Research Techniques Associated with the Journal Impact Factor and Other Key Metrics in Pharmacology Journals. COMPUTATION 2021. [DOI: 10.3390/computation9110116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In the present age, there is intense pressure on researchers to publish their research in ‘high-impact factor’ journals. It would be interesting to understand the trend of research publications in the field of pharmacology by exploring the characteristics of research articles, including research techniques, in relation to the journal’s key bibliometrics, particularly journal impact factor (JIF), the seemingly most mentioned metric. This study aimed to determine the characteristics and research techniques in relation to research articles in pharmacology journals with higher or lower JIF values. A cross-sectional study was conducted on primary research journals under the ‘Pharmacology and Pharmacy’ category. Analysis of 768 original research articles across 32 journals (with an average JIF of 2.565 ± 0.887) demonstrated that research studies involving molecular techniques, in vivo experiments on animals, and bioinformatics and computational modeling were significantly associated with a higher JIF value of the journal in which such contributions were published. Our analysis suggests that research studies involving such techniques/approaches are more likely to be published in higher-ranked pharmacology journals.
Collapse
|
14
|
Van Calster B, Wynants L, Riley RD, van Smeden M, Collins GS. Methodology over metrics: current scientific standards are a disservice to patients and society. J Clin Epidemiol 2021; 138:219-226. [PMID: 34077797 PMCID: PMC8795888 DOI: 10.1016/j.jclinepi.2021.05.018] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 05/23/2021] [Accepted: 05/25/2021] [Indexed: 01/08/2023]
Abstract
Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society.
Collapse
Affiliation(s)
- Ben Van Calster
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium; Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, Netherlands; EPI-Centre, KU Leuven, Leuven, Belgium.
| | - Laure Wynants
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium; EPI-Centre, KU Leuven, Leuven, Belgium; Department of Epidemiology, CAPHRI Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
| | - Richard D Riley
- Centre for Prognosis Research, School of Medicine, Keele University, Keele, UK
| | - Maarten van Smeden
- Julius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Gary S Collins
- Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Musculoskeletal Sciences, University of Oxford, Oxford, UK; NIHR Oxford Biomedical Research Centre, John Radcliffe Hospital, Oxford, UK; UK EQUATOR Centre, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford, UK
| |
Collapse
|
15
|
Riley S, Swanson BT, Sawyer SF, Brismée JM, Staysniak G. Should low-quality evidence dominate high-level evidence? A systematic review and meta-analysis of systematic reviews of musculoskeletal physical therapy interventions. J Man Manip Ther 2020; 29:203-215. [PMID: 33200689 DOI: 10.1080/10669817.2020.1839728] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
OBJECTIVES To determine the: 1) quality of articles cited in systematic reviews (SRs); 2) methodological quality of the SRs; and 3) impact of quality on level 1A evidence. METHODS SRs related to musculoskeletal physical therapy interventions were identified. The methodological quality of the SRs and articles cited by the SRs were assessed by two blinded reviewers. Data analysis was performed by a third blinded researcher. Additional comparisons were made based on the Journal Impact Factor, spin, financial bias, and conflict of interest. RESULTS Twenty-four SRs were identified; 21/24 SRs had 'critically low' quality on the AMSTAR 2. Thirty-four percent of included studies were 'low quality,' and 58% of SRs included studies that had unreported external validity. One-half of the SRs represented 'spin,' and one-third of the SRs generated conclusions based on low-quality clinical trials. DISCUSSION The 'critically low' SRs methodological quality was exacerbated by low-quality research inclusion. Most SRs failed to follow best practices, including prospective registration and integration of professional librarians in the search process. Based on the high proportion of SRs that include low-quality trials and overall low methodological quality, further discussion regarding practice recommendations on level vs. quality of evidence is warranted. LEVEL OF EVIDENCE 1a.
Collapse
Affiliation(s)
- Sean Riley
- Physical Therapy Program, Sacred Heart University, Fairfield, CT, USA
| | - Brian T Swanson
- Department of Rehabilitation Sciences, University of Hartford, West Hartford, CT, USA
| | - Steven F Sawyer
- Department of Rehabilitation Sciences and Center for Rehabilitation Research, Texas Tech University Health Sciences Center, Lubbock, TX, USA
| | - Jean-Michel Brismée
- Department of Rehabilitation Sciences and Center for Rehabilitation Research, Texas Tech University Health Sciences Center, Lubbock, TX, USA
| | | |
Collapse
|
16
|
Martínez Ramos D, Tresserra F, Piñero A, Lluch A. Revista de Senología y Patología Mamaria. Nueva década, nuevos retos y declaración de intenciones. REVISTA DE SENOLOGÍA Y PATOLOGÍA MAMARIA 2020. [PMCID: PMC7148992 DOI: 10.1016/j.senol.2020.03.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|