Increasing use of EQUATOR guidelines in the European Annals of Otorhinolaryngology, Head and Neck Diseases between 2020 and 2022: A SWiM review

OBJECTIVES

To evaluate the use of EQUATOR guidelines in scientific articles published in the European Annals of Otorhinolaryngology, Head and Neck Diseases between 2020 and 2022. The aim was also to translate the most widely used guidelines into French, in order to promote their dissemination and use in otorhinolaryngology and head and neck surgery.

METHOD

The SWiM guidelines were used. Articles published in the European Annals of Otorhinolaryngology, Head and Neck Diseases between January 1, 2020 and December 31, 2022 were retrieved from the PubMed bibliographic database. Editorials, Letters to the Editor and "What is your diagnosis" articles that did not meet any EQUATOR guidelines were excluded from the analysis.

RESULTS

Of the 149 eligible published articles, 21.5% (n=32/149) mentioned use of such a guideline. Guideline use by the European Annals of Otorhinolaryngology, Head and Neck Diseases author community progressed from 0% in 2020 to 8% in 2021 and 63% in 2022.

CONCLUSION

The analysis carried out in this article and the availability of the French version of the seven EQUATOR guidelines most widely used in the European Annals of Otorhinolaryngology Head & Neck Diseases could stimulate application and compliance by authors who submit their work to the journal of the French and international French-speaking societies of otorhinolaryngology.

Evaluation of the impact of large language learning models on articles submitted to Orthopaedics & Traumatology: Surgery & Research (OTSR): A significant increase in the use of artificial intelligence in 2023

INTRODUCTION

There has been an unprecedented rise is the use of artificial intelligence (AI) amongst medical fields. Recently, a dialogue agent called ChatGPT (Generative Pre-trained Transformer) has grown in popularity through its use of large language models (LLM) to clearly and precisely generate text on demand. However, the impact of AI on the creation of scientific articles is remains unknown. A retrospective study was carried out with the aim of answering the following questions: identify the presence of text generated by LLM before and after the increased usage of ChatGPT in articles submitted in OTSR; determine if the type of article, the year of submission, and the country of origin, influenced the proportion of text generated, at least in part by AI.

MATERIAL AND METHODS

A total of 390 English articles were submitted to OTSR in January, February and March 2022 (n=204) and over the same months of 2023 (n=186) were analyzed. All articles were analyzed using the ZeroGPT tool, which provides an assumed rate of AI use expressed as a percentage. A comparison of the average rate of AI use was carried out between the articles submitted in 2022 and 2023. This comparison was repeated keeping only the articles with the highest percentage of suspected AI use (greater than 10 and 20%). A secondary analysis was carried out to identify risk factors for AI use.

RESULTS

The average percentage of suspected LLM use in the entire cohort was 11%±6, with 160 articles (41.0%) having a suspected AI rate greater than 10% and 61 (15.6%) with an assumed AI rate greater than 20%. A comparison between articles submitted in 2022 and 2023 revealed a significant increase in the use of these tools after the launch of ChatGPT 3.5 (9.4% in 2022 and 12.6% in 2023 [p=0.004]). The number of articles with suspected AI rates of greater than 10 and 20% were significantly higher in 2023: >10%: 71 articles (34.8%) versus 89 articles (47.8%) (p=0.008) and >20%: 21 articles (10.3%) versus 40 articles (21.5%) (p=0.002). A risk factor analysis for LLLM use, demonstrated that authors of Asian geographic origin, and the submission year 2023 were associated with a higher rate of suspected AI use. An AI rate >20% was associated to Asian geographical origin with an odds ratio of 1.79 (95% CI: 1.03-3.11) (p=0.029), while the year of submission being 2023 had an odds ratio of 1.7 (95% CI: 1.1-2.5) (p=0.02).

CONCLUSION

This study highlights a significant increase in the use of LLM in the writing of articles submitted to the OTSR journal after the launch of ChatGPT 3.5. The increasing use of these models raises questions about originality and plagiarism in scientific research. AI offers creative opportunities but also raises ethical and methodological challenges.

LEVEL OF EVIDENCE

III; case control study.

Using an explicit query and a topic model for scientific article recommendation

The search for relevant scientific articles is a crucial step in any research project. However, the vast number of articles published and available online in digital databases (Google Scholar, Semantic Scholar, etc.) can make this task tedious and negatively impact a researcher's productivity. This article proposes a new method of recommending scientific articles that takes advantage of content-based filtering. The challenge is to target relevant information that meets a researcher's needs, regardless of their research domain. Our recommendation method is based on semantic exploration using latent factors. Our goal is to achieve an optimal topic model that will serve as the basis for the recommendation process. Our experiences confirm our performance expectations, showing relevance and objectivity in the results.

The role of an open artificial intelligence platform in modern neurosurgical education: a preliminary study

The use of artificial intelligence in neurosurgical education has been growing in recent times. ChatGPT, a free and easily accessible language model, has been gaining popularity as an alternative education method. It is necessary to explore the potential of this program in neurosurgery education and to evaluate its reliability. This study aimed to show the reliability of ChatGPT by asking various questions to the chat engine, how it can contribute to neurosurgery education by preparing case reports or questions, and its contributions when writing academic articles. The results of the study showed that while ChatGPT provided intriguing and interesting responses, it should not be considered a dependable source of information. The absence of citations for scientific queries raises doubts about the credibility of the answers provided. Therefore, it is not advisable to solely rely on ChatGPT as an educational resource. With further updates and more specific prompts, it may be possible to improve its accuracy. In conclusion, while ChatGPT has potential as an educational tool, its reliability needs to be further evaluated and improved before it can be widely adopted in neurosurgical education.

Keys for successful publication in Eur Ann Otorhinolaryngol Head Neck Dis: A STROBE analysis of peer reviews of articles submitted in 2020-2021

OBJECTIVE

To evaluate reviewing and editorial decision for articles submitted to the European Annals of Otorhinolaryngology Head & Neck Diseases.

MATERIALS AND METHODS

A retrospective analysis was made of reviewers' comments on 1,133 scientific articles (700 original articles, 96 literature reviews, and 337 case reports), originating from 69 countries, consecutively submitted on-line between January 1st, 2020 and December 31st, 2021. The main objective was to document the acceptance rate and decision time. Accessory objectives were to synthesize the main comments and to screen for correlations between acceptance and the main characteristics of first authors, articles and reviewers' comments.

RESULTS

In total, 4.1% of submitted articles were accepted. Median decision time differed significantly (P<0.0001), at 1 month in case of refusal and 4 months in case of acceptance. Reviewers mentioned failure to adhere to the journal's authors' guide, to use the appropriate EQUATOR guidelines and to adopt the recommended P<0.005 significance threshold in 94.8%, 54.2%, and 39.9% of cases, respectively. On multivariate analysis, 3 variables significantly impacted acceptance, which increased from 1.3% to 44.6% (P<0.0001) when an appropriate EQUATOR guideline was used and from 0.3% to 57.4% (P<0.0001) when the significance threshold was set at P<0.005, and decreased from 10.5% to 1.1% (P=0.0001) when the article did not originate from a French-speaking country (member of the Francophonie organization).

CONCLUSION

Adhesion to modern scientific medical writing rules increased acceptance rates for articles in the European Annals of Otorhinolaryngology Head & Neck Diseases. Teaching modern scientific medical writing needs to be enhanced in otorhinolaryngology.