Wikipedia as a gateway to biomedical research: The relative distribution and use of citations in the English Wikipedia

Wikipedia as a tool for contemporary history of science: A case study on CRISPR

Rapid developments and methodological divides hinder the study of how scientific knowledge accumulates, consolidates and transfers to the public sphere. Our work proposes using Wikipedia, the online encyclopedia, as a historiographical source for contemporary science. We chose the high-profile field of gene editing as our test case, performing a historical analysis of the English-language Wikipedia articles on CRISPR. Using a mixed-method approach, we qualitatively and quantitatively analyzed the CRISPR article's text, sections and references, alongside 50 affiliated articles. These, we found, documented the CRISPR field's maturation from a fundamental scientific discovery to a biotechnological revolution with vast social and cultural implications. We developed automated tools to support such research and demonstrated its applicability to two other scientific fields-coronavirus and circadian clocks. Our method utilizes Wikipedia as a digital and free archive, showing it can document the incremental growth of knowledge and the manner scientific research accumulates and translates into public discourse. Using Wikipedia in this manner compliments and overcomes some issues with contemporary histories and can also augment existing bibliometric research.

Evaluative altmetrics: is there evidence for its application to research evaluation?

Introduction

Altmetrics have been demonstrated as a promising tool for analyzing scientific communication on social media. Nevertheless, its application for research evaluation remains underdeveloped, despite the advancement of research in the study of diverse scientific interactions.

Methods

This paper develops a method for applying altmetrics in the evaluation of researchers, focusing on a case study of the Environment/Ecology ESI field publications by researchers at the University of Granada. We considered Twitter as a mirror of social attention, news outlets as media, and Wikipedia as educational, exploring mentions from these three sources and the associated actors in their respective media, contextualizing them using various metrics.

Results

Our analysis evaluated different dimensions such as the type of audience, local attention, engagement generated around the mention, and the profile of the actor. Our methodology effectively provided dashboards that gave a comprehensive view of the different instances of social attention at the author level.

Discussion

The use of altmetrics for research evaluation presents significant potential, as shown by our case study. While this is a novel method, our results suggest that altmetrics could provide valuable insights into the social attention that researchers garner. This can be an important tool for research evaluation, expanding our understanding beyond traditional metrics.

Wikipedia citations: A comprehensive data set of citations with identifiers extracted from English Wikipedia

Wikipedia’s content is based on reliable and published sources. To this date, relatively little is known about what sources Wikipedia relies on, in part because extracting citations and identifying cited sources is challenging. To close this gap, we release Wikipedia Citations, a comprehensive data set of citations extracted from Wikipedia. We extracted29.3 million citations from 6.1 million English Wikipedia articles as of May 2020, and classified as being books, journal articles, or Web content. We were thus able to extract 4.0 million citations to scholarly publications with known identifiers—including DOI, PMC, PMID, and ISBN—and further equip an extra 261 thousand citations with DOIs from Crossref. As a result, we find that 6.7% of Wikipedia articles cite at least one journal article with an associated DOI, and that Wikipedia cites just 2% of all articles with a DOI currently indexed in the Web of Science. We release our code to allow the community to extend upon our work and update the data set in the future.

Integrating Wikipedia editing into health professions education: a curricular inventory and review of the literature

INTRODUCTION

Wikipedia is an online encyclopedia read by millions seeking medical information. To provide health professions students with skills to critically assess, edit, and improve Wikipedia's medical content, a skillset aligned with evidence-based medicine (EBM), Wikipedia courses have been integrated into health professions schools' curriculum. This literature review and curricular inventory of Wikipedia educational initiatives provides an overview of current approaches and identifies directions for future initiatives and research.

METHODS

Five databases were searched for articles describing educational interventions to train health professional students to edit Wikipedia. Course dashboards, maintained by Wiki Education (Wiki Edu), were searched for curricular materials. From these sources, key details were extracted and synthesized, including student and instructor type, course content, educational methods, and student outcomes.

RESULTS

Six articles and 27 dashboards reported courses offered between 2015 and 2019. Courses were predominantly offered to medical and nursing students. Instructors delivered content via videos, live lectures, and online interactive modules. Course content included logistics of Wikipedia editing, EBM skills, and health literacy. All courses included assignments requiring students to edit Wikipedia independently or in groups. Limited details on assessment of student learning were available.

DISCUSSION

A small but growing number of schools are training health professions education students to improve Wikipedia's medical content. Course details are available on Wiki Edu dashboards and, to a lesser extent, in peer-reviewed publications. While more needs to be done in conducting and sharing assessment of student learning, integrating Wikipedia into health professions education has potential to facilitate learning of EBM and communication skills, improve Wikipedia's online content, and engage students with an autonomous environment while learning. Future considerations should include a thorough assessment of student learning and practices, a final review of student edits to ensure they follow Wikipedia's guidelines and are written in clear language, and improved sharing of teaching resources by instructors.

COVID-19 research in Wikipedia

Wikipedia is one of the main sources of free knowledge on the Web. During the first few months of the pandemic, over 5,200 new Wikipedia pages on COVID-19 were created, accumulating over 400 million page views by mid-June 2020. 1 At the same time, an unprecedented amount of scientific articles on COVID-19 and the ongoing pandemic have been published online. Wikipedia’s content is based on reliable sources, such as scientific literature. Given its public function, it is crucial for Wikipedia to rely on representative and reliable scientific results, especially in a time of crisis. We assess the coverage of COVID-19-related research in Wikipedia via citations to a corpus of over 160,000 articles. We find that Wikipedia editors are integrating new research at a fast pace, and have cited close to 2% of the COVID-19 literature under consideration. While doing so, they are able to provide a representative coverage of COVID-19-related research. We show that all the main topics discussed in this literature are proportionally represented from Wikipedia, after accounting for article-level effects. We further use regression analyses to model citations from Wikipedia and show that Wikipedia editors on average rely on literature that is highly cited, widely shared on social media, and peer-reviewed.

Web Browsing Habits of Healthcare Professions Students in Gross Anatomy Laboratory

Personal computer use for educational purposes by the healthcare professions students has become ubiquitous. Although the effect of computer-based dissection instructions has been studied, there is a paucity of information regarding student browsing habits of information available on the Internet. Although current students have favorable attitudes toward accessing anatomical information online, web browsing habits have not yet been investigated specifically in the dissection laboratory setting. The purpose of this study was to describe the browsing habits of the healthcare professions students in the gross anatomy setting using a retrospective analysis. Files containing web browser history were retrieved from desktop computers in the gross anatomy laboratory and custom code was written to parse them into comma separated value files. Each web address was categorized and descriptive statistics was calculated. Browser history for 24 computers was analyzed from June 2013 to January 2015. During this period, students accumulated 100,857 webpage visits. Most often, students performed a Google search for anatomy (22.0% of all visits) and non-anatomy related (20.6% of all visits) information. Students also used the web browser to access various entertainment (16.4% of all visits) and productivity related services (15.9% of all visits). This analysis revealed a large volume of webpage visits by the healthcare professions students in the gross anatomy laboratory. A wide diversity of anatomy and non-anatomy related webpages were visited. Future analyses could be directed at examination of when in relation to class time students accessed the information, how browsing habits change over time, and what anatomical structures were most commonly searched for.

Reader engagement with medical content on Wikipedia

Articles on Wikipedia about health and medicine are maintained by WikiProject Medicine (WPM), and are widely used by health professionals, students and others. We have compared these articles, and reader engagement with them, to other articles on Wikipedia. We found that WPM articles are longer, possess a greater density of external links, and are visited more often than other articles on Wikipedia. Readers of WPM articles are more likely to hover over and view footnotes than other readers, but are less likely to visit the hyperlinked sources in these footnotes. Our findings suggest that WPM readers appear to use links to external sources to verify and authorize Wikipedia content, rather than to examine the sources themselves.

Situating Wikipedia as a health information resource in various contexts: A scoping review

BACKGROUND

Wikipedia's health content is the most frequently visited resource for health information on the internet. While the literature provides strong evidence for its high usage, a comprehensive literature review of Wikipedia's role within the health context has not yet been reported.

OBJECTIVE

To conduct a comprehensive review of peer-reviewed, published literature to learn what the existing body of literature says about Wikipedia as a health information resource and what publication trends exist, if any.

METHODS

A comprehensive literature search in OVID Medline, OVID Embase, CINAHL, LISTA, Wilson's Web, AMED, and Web of Science was performed. Through a two-stage screening process, records were excluded if: Wikipedia was not a major or exclusive focus of the article; Wikipedia was not discussed within the context of a health or medical topic; the article was not available in English, the article was irretrievable, or; the article was a letter, commentary, editorial, or popular media article.

RESULTS

89 articles and conference proceedings were selected for inclusion in the review. Four categories of literature emerged: 1) studies that situate Wikipedia as a health information resource; 2) investigations into the quality of Wikipedia, 3) explorations of the utility of Wikipedia in education, and 4) studies that demonstrate the utility of Wikipedia in research.

CONCLUSION

The literature positions Wikipedia as a prominent health information resource in various contexts for the public, patients, students, and practitioners seeking health information online. Wikipedia's health content is accessed frequently, and its pages regularly rank highly in Google search results. While Wikipedia itself is well into its second decade, the academic discourse around Wikipedia within the context of health is still young and the academic literature is limited when attempts are made to understand Wikipedia as a health information resource. Possibilities for future research will be discussed.

Wikipedia: A Medical Student Educational Project to Edit Wikipedia in Preparation for Practicing Evidence-Based Pain Medicine

OBJECTIVE

Wikipedia is commonly used to acquire information about various medical conditions such as chronic pain. Ideally, better online pain management content could reduce the burden of opioid use disorders. Our goal was to improve the quality of the content available on Wikipedia to make it more accurate and applicable to medical students and the general public while training medical students to practice evidence-based medicine and critically assess their sources of information.

METHODS

An elective class in Neuroscience, Pain, and Opioids composed of 10 medical students met biweekly to discuss landmark and practice-changing research articles in the fields of acute pain, chronic pain, and opioid management. The professor chose Wikipedia articles relevant to this course. Three independent viewers analyzed the quality of citations, anecdotal medical content, and content value for both patients and medical professionals. As part of their coursework, students then edited the Wikipedia articles.

RESULTS

Although some of the Wikipedia pain topic content (6.7% ± 2.0) was anecdotal, financially biased, or inconsistent with Western Medical Practice content, overall articles included primarily high-quality citations (85.6% ± 3.1). On a 0-5 Likert scale, students felt content would be moderately helpful for both medical students/professionals (3.4 ± 0.2) and laypersons (3.5 ± 0.2). Editing and adding citations was feasible, but novel material was often reverted.

CONCLUSION

A significant amount of pain medicine content was relevant and amenable to student editing. Therefore, future use of this tactic could provide a unique opportunity to integrate evidence-based medicine into the medical curriculum and have a direct impact on the widely available medical information. Future refinement in the editorial process may also further improve online information.

Improving the Quality of Consumer Health Information on Wikipedia: Case Series

Background

Wikipedia is one of the most consulted health resources in the world. Since the public is using health information from Wikipedia to make health care decisions, improving the quality of that health information is in the public interest. The open editable content design of Wikipedia and quality control processes in place provide an opportunity to add high-value, evidence-based information and take an active role in improving the health care information infrastructure.

Objective

The aim of this project was to enhance Wikipedia health pages using high-quality, current research findings and track the persistence of those edits and number of page views after the changes to assess the reach of this initiative.

Methods

We conducted Wikipedia Editathons with 3 different cohorts of Physical Therapy (PT) students to add high-quality health information to existing Wikipedia pages. Students synthesized best evidence information and updated and/or corrected existing Wikipedia entries on specific health pages. To evaluate the impact of these contributions, we examined two factors: (1) response to our contributions from the Wikipedia editing community, including number and type of subsequent edits as well as persistence of the student contributions and (2) number of page views by the public from the time of the page edits.

Results

A total of 98 PT students in 3 different cohorts engaged in Editathons, editing 24 health pages. Of the 24 edits, 22 persisted at the end of the observation period (from time of entry to May 31, 2018) and received nearly 8 million page views. Each health page had an average of 354,724 page views.

Conclusions

The Wikipedia Editathon is an effective way to continuously enhance the quality of health information available on Wikipedia. It is also an excellent way of bridging health technology with best-evidence medical facts and disseminating accurate, useful information to the public.