An Analysis of Medical Laboratory Technology Journals' Instructions for Authors

Post-publication research integrity concerns in randomized clinical trials: A scoping review of the literature

BACKGROUND

Post-publication handling of integrity concerns in randomized clinical trials (RCTs) is a contentious matter.

OBJECTIVES

We undertook a scoping systematic review to map the literature regarding post-publication integrity issues in RCTs.

SEARCH STRATEGY AND SELECTION CRITERIA

Following prospective registration (https://osf.io/pgxd8) we initially searched PubMed and Scopus but subsequently extended it to include the Cochrane Library, and Google Scholar databases without language, article type or publication time restriction until November 2022. Reviewers independently selected published articles covering any aspect of post-publication research integrity concerns in RCTs.

DATA COLLECTION AND ANALYSIS

The study findings grouped within domains relating to issues concerning post-publication integrity were extracted in duplicate, verified by a third reviewer, and then tabulated.

MAIN RESULTS

The initial search captured 3159 citations, of which 89 studies were included in the review. Cross-sectional studies constituted the majority of included studies (n = 34, 38.2%), followed by systematic reviews (n = 10, 11.2%), methodology reviews/studies (n = 9, 10.1%) and other types of descriptive studies (n = 8, 9.0%). A total of 21 articles (23.6%) covered the domain on general issues, 25 (28.1%) in the journal's instructions and policies domain, eight (9.0%) in the editorial and peer review domain, one (1.1%) in the correspondence and complaints (post-publication peer review) domain, 12 (13.5%) in the investigation for concerns domain, six (6.7%) in the post-investigation decisions and sanctions domain, none in the critical appraisal guidance domain, five (5.6%) in the integrity assessment in systematic reviews domain, and 26 (29.2%) in the recommendations for future research domain. A total of 12 of the selected articles (13.5%) covered two (n = 9) or three (n = 3) different domains.

CONCLUSIONS

Various research integrity domains and issues covering post-publication aspects of RCT integrity were captured and gaps were identified, mostly related with the necessary implications for all stakeholders to improve research transparency. There is an urgent need for a multistakeholder consensus towards creating specific statements for addressing post-publication integrity concerns in RCTs.

Reporting in Experimental Philosophy: Current Standards and Recommendations for Future Practice

Recent replication crises in psychology and other fields have led to intense reflection about the validity of common research practices. Much of this reflection has focussed on reporting standards, and how they may be related to the questionable research practices that could underlie a high proportion of irreproducible findings in the published record. As a developing field, it is particularly important for Experimental Philosophy to avoid some of the pitfalls that have beset other disciplines. To this end, here we provide a detailed, comprehensive assessment of current reporting practices in Experimental Philosophy. We focus on the quality of statistical reporting and the disclosure of information about study methodology. We assess all the articles using quantitative methods (n = 134) that were published over the years 2013–2016 in 29 leading philosophy journals. We find that null hypothesis significance testing is the prevalent statistical practice in Experimental Philosophy, although relying solely on this approach has been criticised in the psychological literature. To augment this approach, various additional measures have become commonplace in other fields, but we find that Experimental Philosophy has adopted these only partially: 53% of the papers report an effect size, 28% confidence intervals, 1% examined prospective statistical power and 5% report observed statistical power. Importantly, we find no direct relation between an article’s reporting quality and its impact (numbers of citations). We conclude with recommendations for authors, reviewers and editors in Experimental Philosophy, to facilitate making research statistically-transparent and reproducible.

Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017

To gain insight into changes of scholarly journals' recommendations, we conducted a systematic review of studies that analysed journals' Instructions to Authors (ItAs). We summarised results of 153 studies, and meta-analysed how often ItAs addressed: 1) authorship, 2) conflicts of interest, 3) data sharing, 4) ethics approval, 5) funding disclosure, and 6) International Committee of Medical Journal Editors' Uniform Requirements for Manuscripts. For each topic we found large between-study heterogeneity. Here, we show six factors that explained most of that heterogeneity: 1) time (addressing of topics generally increased over time), 2) country (large differences found between countries), 3) database indexation (large differences found between databases), 4) impact factor (topics were more often addressed in highest than in lowest impact factor journals), 5) discipline (topics were more often addressed in Health Sciences than in other disciplines), and 6) sub-discipline (topics were more often addressed in general than in sub-disciplinary journals).

Guidance Provided to Authors on Citing and Formatting References in Nursing Journals

Reference citations should be accurate, complete, and presented in a consistent format. This study analyzed information provided to authors on preparing citations and references for manuscripts submitted to nursing journals (n = 209). Half of the journals used the American Psychological Association reference style. Slightly more than half provided examples of how to cite articles and books; there were fewer examples of citing websites and online journals. Suggestions on improving accuracy of references are discussed.

Quality of Author Guidelines in Nursing Journals

Purpose

The aims of this study were to (a) describe the information provided in author guidelines in nursing journals, (b) assess the completeness of this information, and (c) identify the extent and types of reporting guidelines used in nursing journals.

Design

Content analysis of author guidelines for 245 nursing journals included in the Directory of Nursing Journals maintained at the International Academy of Nursing Editors website.

Methods

Using Research Electronic Data Capture, data on 19 criteria for completeness were extracted from published author guidelines. Additional details about journal requirements, such as allowed length of manuscripts and format for the abstract, were also recorded. Reliability was established by simultaneous review of 25 journals (10%) by the research assistant and a senior member of the research team.

Findings

Author guidelines were easily accessible at journal websites or through links to download the information. A majority (73.5%) had completeness scores of 75% or higher; six journals had guidelines that were 100% complete. Half of the journals used the American Psychological Association reference style, and 26.3% used the American Medical Association style. Less than one fourth had stated requirements to use reporting guidelines such as Consolidated Standards of Reporting Trials (CONSORT) and Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA).

Conclusions

Author guidelines for nursing journals are generally complete and informative. Although specific reporting guidelines such as CONSORT and PRISMA improve the accuracy and completeness of manuscripts on various types of studies, most nursing journals do not indicate use of these for manuscript preparation. Editors who want to improve their author guidelines should use the 19 criteria for completeness as a gauge for updating and revision.

Clinical Relevance

Nurses rely on the published literature to inform their practice and ensure that it is based on evidence. Guidelines for publishing in the scholarly literature assist clinicians and scholars to ensure that published articles are complete, current, concise, and accurate.

A plea for minimally biased naturalistic philosophy

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies.

New Issues for New Methods: Ethical and Editorial Challenges for an Experimental Philosophy

This paper examines a constellation of ethical and editorial issues that have arisen since philosophers started to conduct, submit and publish empirical research. These issues encompass concerns over responsible authorship, fair treatment of human subjects, ethicality of experimental procedures, availability of data, unselective reporting and publishability of research findings. This study aims to assess whether the philosophical community has as yet successfully addressed such issues. To do so, the instructions for authors, submission process and published research papers of 29 main journals in philosophy have been considered and analyzed. In light of the evidence reported here, it is argued that the philosophical community has as yet failed to properly tackle such issues. The paper also delivers some recommendations for authors, reviewers and editors in the field.

The Journal Impact Factor: Moving Toward an Alternative and Combined Scientometric Approach

The Journal Impact Factor (JIF) is a single citation metric, which is widely employed for ranking journals and choosing target journals, but is also misused as the proxy of the quality of individual articles and academic achievements of authors. This article analyzes Scopus-based publication activity on the JIF and overviews some of the numerous misuses of the JIF, global initiatives to overcome the 'obsession' with impact factors, and emerging strategies to revise the concept of the scholarly impact. The growing number of articles on the JIF, most of which are in English, reflects interest of experts in journal editing and scientometrics toward its uses, misuses, and options to overcome related problems. Solely displaying values of the JIFs on the journal websites is criticized by experts as these average metrics do not reflect skewness of citation distribution of individual articles. Emerging strategies suggest to complement the JIFs with citation plots and alternative metrics, reflecting uses of individual articles in terms of downloads and distribution of related information through social media and networking platforms. It is also proposed to revise the original formula of the JIF calculation and embrace the concept of the impact and importance of individual articles. The latter is largely dependent on ethical soundness of the journal instructions, proper editing and structuring of articles, efforts to promote related information through social media, and endorsements of professional societies.