1
|
Tarchi L, Buonocore TM, Selvi G, Ricca V, Castellini G. Online content on eating disorders: a natural language processing study. JOURNAL OF COMMUNICATION IN HEALTHCARE 2024; 17:275-284. [PMID: 39041376 DOI: 10.1080/17538068.2024.2379160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/24/2024]
Abstract
BACKGROUND Online content can inform the personal risk of developing an eating disorder, and it can influence the time and motivation to seek treatment. Patients routinely seek information online, and access to information is crucial for both prevention and treatment. The primary aim of the current study was to quantify the readability scores of online content on eating disorders using natural language processing algorithms, across two languages: English and Italian. METHODS Unique terms related to single diagnoses were searched using Google®. The content available on Wikipedia was also assessed. Readability was defined according to the Flesch Readability Ease (FRE) and the Rate Readability Index (RIX). The scientific support of retrieved content and the authoritativeness of sources were measured through standardized variables. RESULTS In Italian, online content was more likely published by private psychotherapy institutes or by websites that promote diet-advice or weight-loss. In both languages, the most readable content was on Anorexia Nervosa (RIX 4.18, FRE-en 59.6, FRE-it 41.69), Bulimia Nervosa (RIX 3.99, FRE-en 66.27, FRE-it 39.66) or Binge Eating (RIX 4.01, FRE-en 68.10, FRE-it 38.62). English sources consistently had more references than Italian pages (range 35-182, vs 1-163, respectively). and had a higher percentage of citations available in the target language. The content of these references was mainly reflective of peer-reviewed or clinical manuals. CONCLUSION Attention should be given to developing online content for Muscle Dysmorphia and Orthorexia Nervosa, as well as improving the overall readability of online content on eating disorders, especially for languages other than English.
Collapse
Affiliation(s)
- Livio Tarchi
- Psychiatry Unit, Department of Health Sciences, University of Florence, Florence, Italy
| | - Tommaso Mario Buonocore
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Giulia Selvi
- Psychiatry Unit, Department of Health Sciences, University of Florence, Florence, Italy
| | - Valdo Ricca
- Psychiatry Unit, Department of Health Sciences, University of Florence, Florence, Italy
| | - Giovanni Castellini
- Psychiatry Unit, Department of Health Sciences, University of Florence, Florence, Italy
| |
Collapse
|
2
|
Simons A, Kircheis W, Schmidt M, Potthast M, Stein B. Who are the "Heroes of CRISPR"? Public science communication on Wikipedia and the challenge of micro-notability. PUBLIC UNDERSTANDING OF SCIENCE (BRISTOL, ENGLAND) 2024; 33:918-934. [PMID: 38419208 PMCID: PMC11504141 DOI: 10.1177/09636625241229923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/02/2024]
Abstract
Wikipedia's influence in shaping public perceptions of science underscores the significance of scientists being recognized on the platform, as it can impact their careers. Although Wikipedia offers guidelines for determining when a scientist qualifies for their own article, it currently lacks guidance regarding whether a scientist should be acknowledged in articles related to the innovation processes to which they have contributed. To explore how Wikipedia addresses this issue of scientific "micro-notability," we introduce a digital method called Name Edit Analysis, enabling us to quantitatively and qualitatively trace mentions of scientists within Wikipedia's articles. We study two CRISPR-related Wikipedia articles and find dynamic negotiations of micro-notability as well as a surprising tension between Wikipedia's principle of safeguarding against self-promotion and the scholarly norm of "due credit." To reconcile this tension, we propose that Wikipedians and scientists collaborate to establish specific micro-notability guidelines that acknowledge scientific contributions while preventing excessive self-promotion.
Collapse
Affiliation(s)
| | | | - Marion Schmidt
- German Centre for Higher Education Research and Science Studies (DZHW), Germany
| | | | | |
Collapse
|
3
|
Morata TC, Zucki F, Arrigo AJ, Cruz PC, Gong W, Matos HGCD, Montilha AAP, Peschanski JA, Cardoso MJ, Lacerda ABM, Berberian AP, Araujo ES, Luders D, Duarte JL, Jacob RTDS, Chadha S, Mietchen D, Rasberry L, Alvarenga KDF, Jacob LCB. Strategies for crowdsourcing hearing health information: a comparative study of educational programs and volunteer-based campaigns on Wikimedia. BMC Public Health 2024; 24:2646. [PMID: 39343916 PMCID: PMC11441143 DOI: 10.1186/s12889-024-20105-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 09/16/2024] [Indexed: 10/01/2024] Open
Abstract
BACKGROUND Several health institutions developed strategies to improve health content on Wikimedia platforms given their unparalleled reach. The objective of this study was to compare an online volunteer-based Wikimedia outreach campaign with university course Wikipedia assignments (both focused on improving hearing health content in Wikimedia's public digital knowledge archives), in terms of the reach of the contributions and the extent of the participants' input. A secondary objective was to examine the feasibility and the implementation of the different strategies. METHODS The research team partnered for the (1) coordination of improvements in hearing and healthcare content through educational programs using Wikimedia platforms, (2) participation in the global campaign Wiki4WorldHearingDay2023 and (3) evaluation of the proposed strategies. Metrics used in the comparison of the two strategies included the number of articles edited, number of views of the edited articles (as reach) and the extent of edits, captured as the number of words. The feasibility evaluation included assessing recruitment success and the implementation of the proposed plan among faculty, students from various university programs, and volunteers representing different constituencies. RESULTS The effort increased the availability of quality plain language information on hearing conditions and hearing care. Both strategies demonstrated to be feasible by their success in recruiting participants who contributed to the effort and by measurable outputs as edits. The contribution of content to Wikimedia platforms as part of education activities provided a more robust result. Wiki4WorldHearingDay2023 145 participants (78 from educational programs) contributed 167,000 words, 258 + references and 140 images to 322 Wikipedia articles (283 existing and 39 new ones), which were viewed 16.5 million times. Contributions occurred in six languages. Edits in Portuguese, mainly by those involved in educational programs, led the number of articles (226 or 70.2%) that were expanded or created during the 5-month tracking period. CONCLUSIONS The elements that contributed to the success of the studied strategies include an impact topic, coordination with educational programs, international multidisciplinary collaborations, the dissemination of the initiative in several platforms, connection with a robust local Wikimedia affiliate, and the use of a technical infrastructure that provides metrics and coordination mechanisms.
Collapse
Affiliation(s)
- Thais C Morata
- National Institute for Occupational Safety and Health, Cincinnati, OH, United States.
| | - Fernanda Zucki
- Universidade Federal de Santa Catarina, Florianópolis, Brazil
| | | | | | - Wei Gong
- National Institute for Occupational Safety and Health, Cincinnati, OH, United States
| | | | | | | | | | | | | | | | | | | | | | | | | | - Lane Rasberry
- University of Virginia, Charlottesville, United States
| | | | | |
Collapse
|
4
|
de Oliveira Collet G, de Morais Ferreira F, Ceron DF, de Lourdes Calvo Fracasso M, Santin GC. Influence of digital health literacy on online health-related behaviors influenced by internet advertising. BMC Public Health 2024; 24:1949. [PMID: 39033160 PMCID: PMC11265096 DOI: 10.1186/s12889-024-19506-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 07/16/2024] [Indexed: 07/23/2024] Open
Abstract
BACKGROUND The frequency of health-related information seeking on the internet and social media platforms has increased remarkably. Thus, the ability to understand and select accurate health-related information online, known as EHealth literacy, is crucial for the population. Therefore, this study aimed to evaluate how eHealth literacy influences the critical analysis of oral health-related information obtained from the Internet and its influence on oral health-related behaviors. METHODS: A cross-sectional online study was conducted with 418 Brazilian adults who responded to the eHEALS questionnaire, with questions regarding the influence of online information on oral health decisions. Socioeconomic and demographic characteristics were also collected. RESULTS The mean eHEALS score was 27.85 (± 8.13), with a range spanning from 8 to 40 points. Participants with higher eHEALS scores reported using social media platforms to seek for dentists and to acque information about symptoms, diagnoses, and treatments. Furthermore, this group tended not to disregard professional health recommendations based on Internet information and abstained from utilizing products promoted by digital influencers. In multivariate models, increased eHEALS scores were associated with reduced consumption of products endorsed by digital influencers. CONCLUSIONS The findings from this study suggest that individuals with higher scores on the eHealth literacy questionnaire often conduct research on their health status and seek for health care providers on the Internet. Moreover, these individuals were less likely to be influenced by digital influencers.
Collapse
Affiliation(s)
- Giulia de Oliveira Collet
- Department of Dentistry, State University of Maringá, Avenida Mandacarú, 1550, Maringá, PR, 87080-000, Brazil
| | - Fernanda de Morais Ferreira
- Department of Child and Adolescent Oral Health, Federal University of Minas Gerais, Avenida Presidente Antônio Carlos, 6627, Belo Horizonte, MG, 31270-901, Brazil
| | - Daniela Fernandes Ceron
- Department of Dentistry, State University of Maringá, Avenida Mandacarú, 1550, Maringá, PR, 87080-000, Brazil
| | | | - Gabriela Cristina Santin
- Department of Dentistry, State University of Maringá, Avenida Mandacarú, 1550, Maringá, PR, 87080-000, Brazil.
| |
Collapse
|
5
|
Subramanian T, Araghi K, Amen TB, Kaidi A, Sosa B, Shahi P, Qureshi S, Iyer S. Chat Generative Pretraining Transformer Answers Patient-focused Questions in Cervical Spine Surgery. Clin Spine Surg 2024; 37:E278-E281. [PMID: 38531823 DOI: 10.1097/bsd.0000000000001600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 11/29/2023] [Indexed: 03/28/2024]
Abstract
STUDY DESIGN Review of Chat Generative Pretraining Transformer (ChatGPT) outputs to select patient-focused questions. OBJECTIVE We aimed to examine the quality of ChatGPT responses to cervical spine questions. BACKGROUND Artificial intelligence and its utilization to improve patient experience across medicine is seeing remarkable growth. One such usage is patient education. For the first time on a large scale, patients can ask targeted questions and receive similarly targeted answers. Although patients may use these resources to assist in decision-making, there still exists little data regarding their accuracy, especially within orthopedic surgery and more specifically spine surgery. METHODS We compiled 9 frequently asked questions cervical spine surgeons receive in the clinic to test ChatGPT's version 3.5 ability to answer a nuanced topic. Responses were reviewed by 2 independent reviewers on a Likert Scale for the accuracy of information presented (0-5 points), appropriateness in giving a specific answer (0-3 points), and readability for a layperson (0-2 points). Readability was assessed through the Flesh-Kincaid grade level analysis for the original prompt and for a second prompt asking for rephrasing at the sixth-grade reading level. RESULTS On average, ChatGPT's responses scored a 7.1/10. Accuracy was rated on average a 4.1/5. Appropriateness was 1.8/3. Readability was a 1.2/2. Readability was determined to be at the 13.5 grade level originally and at the 11.2 grade level after prompting. CONCLUSIONS ChatGPT has the capacity to be a powerful means for patients to gain important and specific information regarding their pathologies and surgical options. These responses are limited in their accuracy, and we, in addition, noted readability is not optimal for the average patient. Despite these limitations in ChatGPT's capability to answer these nuanced questions, the technology is impressive, and surgeons should be aware patients will likely increasingly rely on it.
Collapse
Affiliation(s)
- Tejas Subramanian
- Department of Orthopedic Surgery, Hospital for Special Surgery
- Weill Cornell Medicine, New York, NY
| | - Kasra Araghi
- Department of Orthopedic Surgery, Hospital for Special Surgery
| | - Troy B Amen
- Department of Orthopedic Surgery, Hospital for Special Surgery
| | - Austin Kaidi
- Department of Orthopedic Surgery, Hospital for Special Surgery
| | | | - Pratyush Shahi
- Department of Orthopedic Surgery, Hospital for Special Surgery
| | - Sheeraz Qureshi
- Department of Orthopedic Surgery, Hospital for Special Surgery
- Weill Cornell Medicine, New York, NY
| | - Sravisht Iyer
- Department of Orthopedic Surgery, Hospital for Special Surgery
- Weill Cornell Medicine, New York, NY
| |
Collapse
|
6
|
Gondode P, Duggal S, Garg N, Sethupathy S, Asai O, Lohakare P. Comparing patient education tools for chronic pain medications: Artificial intelligence chatbot versus traditional patient information leaflets. Indian J Anaesth 2024; 68:631-636. [PMID: 39081915 PMCID: PMC11285886 DOI: 10.4103/ija.ija_204_24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Revised: 05/03/2024] [Accepted: 05/05/2024] [Indexed: 08/02/2024] Open
Abstract
Background and Aims Artificial intelligence (AI) chatbots like Conversational Generative Pre-trained Transformer (ChatGPT) have recently created much buzz, especially regarding patient education. Such informed patients understand and adhere to the management and get involved in shared decision making. The accuracy and understandability of the generated educational material are prime concerns. Thus, we compared ChatGPT with traditional patient information leaflets (PILs) about chronic pain medications. Methods Patients' frequently asked questions were generated from PILs available on the official websites of the British Pain Society (BPS) and the Faculty of Pain Medicine. Eight blinded annexures were prepared for evaluation, consisting of traditional PILs from the BPS and AI-generated patient information materials structured similar to PILs by ChatGPT. The authors performed a comparative analysis to assess materials' readability, emotional tone, accuracy, actionability, and understandability. Readability was measured using Flesch Reading Ease (FRE), Gunning Fog Index (GFI), and Flesch-Kincaid Grade Level (FKGL). Sentiment analysis determined emotional tone. An expert panel evaluated accuracy and completeness. Actionability and understandability were assessed with the Patient Education Materials Assessment Tool. Results Traditional PILs generally exhibited higher readability (P values < 0.05), with [mean (standard deviation)] FRE [62.25 (1.6) versus 48 (3.7)], GFI [11.85 (0.9) versus 13.65 (0.7)], and FKGL [8.33 (0.5) versus 10.23 (0.5)] but varied emotional tones, often negative, compared to more positive sentiments in ChatGPT-generated texts. Accuracy and completeness did not significantly differ between the two. Actionability and understandability scores were comparable. Conclusion While AI chatbots offer efficient information delivery, ensuring accuracy and readability, patient-centeredness remains crucial. It is imperative to balance innovation with evidence-based practice.
Collapse
Affiliation(s)
- Prakash Gondode
- Department of Anesthesiology Pain Medicine and Critical Care, All India Institute of Medical Sciences (AIIMS) New Delhi, India
| | - Sakshi Duggal
- Department of Anesthesiology Pain Medicine and Critical Care, All India Institute of Medical Sciences (AIIMS) New Delhi, India
| | - Neha Garg
- Department of Anesthesiology Pain Medicine and Critical Care, All India Institute of Medical Sciences (AIIMS) New Delhi, India
| | - Surrender Sethupathy
- Department of Anesthesiology Pain Medicine and Critical Care, All India Institute of Medical Sciences (AIIMS) New Delhi, India
| | - Omshubham Asai
- Department of Anesthesiology, All India Institute of Medical Sciences, Nagpur, Maharashtra, India
| | - Pooja Lohakare
- Department of Microbiology, Mahatma Gandhi Institute of Medical Sciences, Wardha, Maharashtra, India
| |
Collapse
|
7
|
Amen TB, Torabian KA, Subramanian T, Yang BW, Liimakka A, Fufa D. Quality of ChatGPT Responses to Frequently Asked Questions in Carpal Tunnel Release Surgery. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2024; 12:e5822. [PMID: 38756958 PMCID: PMC11098167 DOI: 10.1097/gox.0000000000005822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Accepted: 03/22/2024] [Indexed: 05/18/2024]
Abstract
Background Although demonstrating remarkable promise in other fields, the impact of artificial intelligence (including ChatGPT in hand surgery and medical practice) remains largely undetermined. In this study, we asked ChatGPT frequently asked patient-focused questions surgeons may receive in clinic from patients who have carpel tunnel syndrome (CTS) and evaluated the quality of its output. Methods Using ChatGPT, we asked 10 frequently asked questions that hand surgeons may receive in the clinic before carpel tunnel release (CTR) surgery. Included questions were generated from the authors' own experiences regarding conservative and operative treatment of CTS. Results Responses from the following 10 questions were included: (1) What is CTS and what are its signs and symptoms? (2) What are the nonsurgical options for CTS? (3) Should I get surgery for CTS? (4) What is a CTR and how is it preformed? (5) What are the differences between open and endoscopic CTR? (6) What are the risks associated with CTR and how frequently do they occur? (7) Does CTR cure CTS? (8) How much improvement in my symptoms can I expect after CTR? (9) How long is the recovery after CTR? (10) Can CTS recur after surgery? Conclusions Overall, the chatbot provided accurate and comprehensive information in response to most common and nuanced questions regarding CTS and CTR surgery, all in a way that would be easily understood by many patients. Importantly, the chatbot did not provide patient-specific advice and consistently advocated for consultation with a healthcare provider.
Collapse
Affiliation(s)
- Troy B. Amen
- From Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, N.Y
| | | | - Tejas Subramanian
- From Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, N.Y
| | - Brian W. Yang
- From Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, N.Y
| | | | - Duretti Fufa
- From Department of Orthopaedic Surgery, Hospital for Special Surgery, New York, N.Y
| |
Collapse
|
8
|
Huo B, Calabrese E, Sylla P, Kumar S, Ignacio RC, Oviedo R, Hassan I, Slater BJ, Kaiser A, Walsh DS, Vosburg W. The performance of artificial intelligence large language model-linked chatbots in surgical decision-making for gastroesophageal reflux disease. Surg Endosc 2024; 38:2320-2330. [PMID: 38630178 DOI: 10.1007/s00464-024-10807-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Accepted: 03/21/2024] [Indexed: 07/11/2024]
Abstract
BACKGROUND Large language model (LLM)-linked chatbots may be an efficient source of clinical recommendations for healthcare providers and patients. This study evaluated the performance of LLM-linked chatbots in providing recommendations for the surgical management of gastroesophageal reflux disease (GERD). METHODS Nine patient cases were created based on key questions addressed by the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) guidelines for the surgical treatment of GERD. ChatGPT-3.5, ChatGPT-4, Copilot, Google Bard, and Perplexity AI were queried on November 16th, 2023, for recommendations regarding the surgical management of GERD. Accurate chatbot performance was defined as the number of responses aligning with SAGES guideline recommendations. Outcomes were reported with counts and percentages. RESULTS Surgeons were given accurate recommendations for the surgical management of GERD in an adult patient for 5/7 (71.4%) KQs by ChatGPT-4, 3/7 (42.9%) KQs by Copilot, 6/7 (85.7%) KQs by Google Bard, and 3/7 (42.9%) KQs by Perplexity according to the SAGES guidelines. Patients were given accurate recommendations for 3/5 (60.0%) KQs by ChatGPT-4, 2/5 (40.0%) KQs by Copilot, 4/5 (80.0%) KQs by Google Bard, and 1/5 (20.0%) KQs by Perplexity, respectively. In a pediatric patient, surgeons were given accurate recommendations for 2/3 (66.7%) KQs by ChatGPT-4, 3/3 (100.0%) KQs by Copilot, 3/3 (100.0%) KQs by Google Bard, and 2/3 (66.7%) KQs by Perplexity. Patients were given appropriate guidance for 2/2 (100.0%) KQs by ChatGPT-4, 2/2 (100.0%) KQs by Copilot, 1/2 (50.0%) KQs by Google Bard, and 1/2 (50.0%) KQs by Perplexity. CONCLUSIONS Gastrointestinal surgeons, gastroenterologists, and patients should recognize both the promise and pitfalls of LLM's when utilized for advice on surgical management of GERD. Additional training of LLM's using evidence-based health information is needed.
Collapse
Affiliation(s)
- Bright Huo
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Elisa Calabrese
- University of California South California, East Bay, Oakland, CA, USA
| | - Patricia Sylla
- Division of Colon and Rectal Surgery, Department of Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Sunjay Kumar
- Department of General Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA
| | - Romeo C Ignacio
- Division of Pediatric Surgery/Department of Surgery, San Diego School of Medicine, University of California, California, CA, USA
| | - Rodolfo Oviedo
- Nacogdoches Center for Metabolic and Weight Loss Surgery, Nacogdoches, TX, USA
- University of Houston Tilman J. Fertitta Family College of Medicine, Houston, TX, USA
- Sam Houston State University College of Osteopathic Medicine, Conroe, TX, USA
| | | | | | - Andreas Kaiser
- Division of Colorectal Surgery, Department of Surgery, City of Hope National Medical Center, Duarte, CA, USA
| | - Danielle S Walsh
- Department of Surgery, University of Kentucky, Lexington, KY, USA
| | - Wesley Vosburg
- Department of Surgery, Harvard Medical School, Mount Auburn Hospital, Cambridge, MA, USA.
| |
Collapse
|
9
|
Huo B, Calabrese E, Sylla P, Kumar S, Ignacio RC, Oviedo R, Hassan I, Slater BJ, Kaiser A, Walsh DS, Vosburg W. The performance of artificial intelligence large language model-linked chatbots in surgical decision-making for gastroesophageal reflux disease. Surg Endosc 2024; 38:2320-2330. [PMID: 38630178 DOI: 10.1007/s00464-024-10807-w] [citation(s)] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Accepted: 03/21/2024] [Indexed: 08/16/2024]
Abstract
BACKGROUND Large language model (LLM)-linked chatbots may be an efficient source of clinical recommendations for healthcare providers and patients. This study evaluated the performance of LLM-linked chatbots in providing recommendations for the surgical management of gastroesophageal reflux disease (GERD). METHODS Nine patient cases were created based on key questions addressed by the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) guidelines for the surgical treatment of GERD. ChatGPT-3.5, ChatGPT-4, Copilot, Google Bard, and Perplexity AI were queried on November 16th, 2023, for recommendations regarding the surgical management of GERD. Accurate chatbot performance was defined as the number of responses aligning with SAGES guideline recommendations. Outcomes were reported with counts and percentages. RESULTS Surgeons were given accurate recommendations for the surgical management of GERD in an adult patient for 5/7 (71.4%) KQs by ChatGPT-4, 3/7 (42.9%) KQs by Copilot, 6/7 (85.7%) KQs by Google Bard, and 3/7 (42.9%) KQs by Perplexity according to the SAGES guidelines. Patients were given accurate recommendations for 3/5 (60.0%) KQs by ChatGPT-4, 2/5 (40.0%) KQs by Copilot, 4/5 (80.0%) KQs by Google Bard, and 1/5 (20.0%) KQs by Perplexity, respectively. In a pediatric patient, surgeons were given accurate recommendations for 2/3 (66.7%) KQs by ChatGPT-4, 3/3 (100.0%) KQs by Copilot, 3/3 (100.0%) KQs by Google Bard, and 2/3 (66.7%) KQs by Perplexity. Patients were given appropriate guidance for 2/2 (100.0%) KQs by ChatGPT-4, 2/2 (100.0%) KQs by Copilot, 1/2 (50.0%) KQs by Google Bard, and 1/2 (50.0%) KQs by Perplexity. CONCLUSIONS Gastrointestinal surgeons, gastroenterologists, and patients should recognize both the promise and pitfalls of LLM's when utilized for advice on surgical management of GERD. Additional training of LLM's using evidence-based health information is needed.
Collapse
Affiliation(s)
- Bright Huo
- Division of General Surgery, Department of Surgery, McMaster University, Hamilton, ON, Canada
| | - Elisa Calabrese
- University of California South California, East Bay, Oakland, CA, USA
| | - Patricia Sylla
- Division of Colon and Rectal Surgery, Department of Surgery, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Sunjay Kumar
- Department of General Surgery, Thomas Jefferson University Hospital, Philadelphia, PA, USA
| | - Romeo C Ignacio
- Division of Pediatric Surgery/Department of Surgery, San Diego School of Medicine, University of California, California, CA, USA
| | - Rodolfo Oviedo
- Nacogdoches Center for Metabolic and Weight Loss Surgery, Nacogdoches, TX, USA
- University of Houston Tilman J. Fertitta Family College of Medicine, Houston, TX, USA
- Sam Houston State University College of Osteopathic Medicine, Conroe, TX, USA
| | | | | | - Andreas Kaiser
- Division of Colorectal Surgery, Department of Surgery, City of Hope National Medical Center, Duarte, CA, USA
| | - Danielle S Walsh
- Department of Surgery, University of Kentucky, Lexington, KY, USA
| | - Wesley Vosburg
- Department of Surgery, Harvard Medical School, Mount Auburn Hospital, Cambridge, MA, USA.
| |
Collapse
|
10
|
Smith D, McKinnell J, Young J. Citations in Wikipedia for understanding research reach. J Med Libr Assoc 2024; 112:88-94. [PMID: 39119167 PMCID: PMC11305477 DOI: 10.5195/jmla.2024.1730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/10/2024] Open
Abstract
Objective Wikipedia is the most frequently accessed online health information resource and is well positioned as a valuable tool for public health communication and knowledge translation. The authors aimed to explore their institution's health and medical research reach by analyzing its presence in Wikipedia articles. Methods In October 2022, a comprehensive database search was constructed in PubMed to retrieve clinical evidence syntheses published by at least one author affiliated with McMaster University from 2017 to 2022, inclusive. Altmetric Explorer was queried using PubMed Identifiers and article titles to access metadata and Wikipedia citation data. 3,582 health evidence syntheses from at least one McMaster University affiliated author were analyzed. Results Six percent (n=219) of health evidence syntheses from the authors' institution were cited 568 times in 524 unique Wikipedia articles across 28 different language editions. 45% of citations appeared in English Wikipedia, suggesting a broad global reach for the institutions' research outputs. When adjusted for open access publications, 8% of McMaster University's health evidence syntheses appear in Wikipedia. Conclusion Altmetric Explorer is a valuable tool for exploring the reach of an institution's research outputs. Isolating Altmetric data to focus on Wikipedia citations has value for any institution wishing to gain more insight into the global, community-level reach of its contributions to the latest health and medical evidence.
Collapse
Affiliation(s)
| | - Jennifer McKinnell
- , Director, Health Sciences Library, McMaster University, Hamilton, ON, Canada
| | - Jack Young
- , McMaster University, Hamilton, ON, Canada
| |
Collapse
|
11
|
Arslan A, Turk M. Wikipedia as an academic service-learning tool in science and technology: higher education case from Siberia. J Community Genet 2024; 15:147-161. [PMID: 38127180 PMCID: PMC11031511 DOI: 10.1007/s12687-023-00692-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 12/01/2023] [Indexed: 12/23/2023] Open
Abstract
Wikipedia, the open crowdsourced encyclopedia that anyone can edit, ranks among the top ten most-visited websites globally. Its integration into university curriculum as an innovative educational tool is a slowly growing trend; however, many higher education institutions have yet to fully grasp its potential. In response, a specific optional module for Wikipedia editing, designed for the selected undergraduate science courses at the School of Advanced Studies, Russia, was implemented as an optional extra credit service-learning activity, a teaching methodology combining meaningful service to the community with curriculum-based learning. Students who chose to participate and those who preferred not to participate in the activity were invited to participate in a research project to explore their perspectives and experiences. In total, five sessions of focus group discussions were conducted with participants (12 females and 2 males) in one set and non-participants (5 females and 4 males) in another to identify students' perspectives on themes such as their interest in science, reasons for their choices, and their expectations before the activity while post-experience focus group discussions were used to identify the perspectives of participant students on themes, encompassing contribution of the service-learning activity, acquisition of new skills, and the development of prosocial behaviors. Students' opinions on integrating social responsibility topics into the curriculum were also explored. The results extracted from these focus group discussions, analyzed through consensual coding, revealed factors promoting student participation, like interest in the subject, novelty of the activity, and grade improvement opportunities, as well as factors deterring participation, such as concerns about academic benefits, workload, and time constraints. Furthermore, the results demonstrated that Wikipedia editing serves as a novel teaching methodology, promoting student learning and development in digital literacy and information literacy, which are among the twenty-first-century skills. Interestingly, at the same time, not all students could address the value of contributing to open, crowdsourced knowledge for public service or interpret this activity as an academic service-learning. These suggest that Wikipedia editing is an innovative teaching approach, fostering students' learning and development while also indicating its potential to enhance students' understanding of responsible citizenship and public service in the digital age.
Collapse
Affiliation(s)
- Ayla Arslan
- Department of Molecular Biology and Genetics, Faculty of Engineering and Natural Sciences, Uskudar University, Istanbul, Türkiye.
- School of Advanced Studies, University of Tyumen, Tyumen, Russia.
| | - Marko Turk
- School of Advanced Studies, University of Tyumen, Tyumen, Russia
- PAR University of Applied Sciences, Rijeka, Croatia
| |
Collapse
|
12
|
Smith D. Leveraging Wikipedia in undergraduate health sciences education: a key tool for information literacy and knowledge translation. JOURNAL OF THE CANADIAN HEALTH LIBRARIES ASSOCIATION 2023; 44:79-84. [PMID: 38737529 PMCID: PMC11081111 DOI: 10.29173/jchla29688] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2024] Open
Abstract
Background Academic institutions and libraries are familiar with Wikipedia. There is growing momentum in higher education for using Wikipedia as a learning tool in various contexts. These include, but are not limited to, the use of Wikipedia-based assignments to teach information literacy, science communication, evidence-based practice, and more. Although there is growing acceptance of Wikipedia's value in the classroom, there are limited exemplars available for how it is applied in undergraduate health sciences education. Description This program description describes a librarian instructed course in the Bachelor of Health Sciences Program at McMaster University in which students dedicate one academic term to learning about Wikipedia content production and making contributions to a health-related Wikipedia article of their choice. Outcomes In the five iterations of this course that have been offered, undergraduate health sciences students have made significant contributions to 25 health-related articles in Wikipedia. They have added more than 120,000 words and over 2,000 references to high-quality literature. In class, conversations emerged about the meaningfulness of the editing Wikipedia, information literacy, and knowledge translation.
Collapse
Affiliation(s)
- Denise Smith
- Librarian III, Health Sciences Library, McMaster University, Hamilton, ON
| |
Collapse
|
13
|
Subramanian T, Shahi P, Araghi K, Mayaan O, Amen TB, Iyer S, Qureshi S. Using Artificial Intelligence to Answer Common Patient-Focused Questions in Minimally Invasive Spine Surgery. J Bone Joint Surg Am 2023; 105:1649-1653. [PMID: 37247341 DOI: 10.2106/jbjs.23.00043] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Affiliation(s)
- Tejas Subramanian
- Hospital for Special Surgery, New York, NY
- Weill Cornell Medicine, New York, NY
| | | | | | - Omri Mayaan
- Hospital for Special Surgery, New York, NY
- Weill Cornell Medicine, New York, NY
| | | | | | | |
Collapse
|
14
|
Kumar N, Chen K, Shi Y, Altice FL. Online platforms' framing around vaping. Drug Test Anal 2023; 15:1297-1302. [PMID: 36445242 DOI: 10.1002/dta.3417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Revised: 11/15/2022] [Accepted: 11/22/2022] [Indexed: 12/02/2022]
Abstract
In this paper, we provide a descriptive overview of how vaping is framed differently between various online platforms (Wikipedia, Quora, Medium, Reddit, Stack Exchange, wikiHow, Facebook, and online news media). We provide an overview of >1 million posts and news articles about vaping to study the differences in framing between online platforms. Findings indicate an inconsistent framing around vaping across platforms. Stakeholders may utilize our findings to intervene around the framing of vaping and may design communications campaigns that improve the way society sees vaping, possibly aiding smoking cessation and reducing youth vaping.
Collapse
Affiliation(s)
- Navin Kumar
- Yale School of Medicine, Yale University, New Haven, Connecticut, USA
| | - Keyu Chen
- Yale School of Medicine, Yale University, New Haven, Connecticut, USA
- Internal Medicine, Yale School of Medicine, Yale University, New Haven, Connecticut, USA
| | - Yiwen Shi
- Internal Medicine, Yale School of Medicine, Yale University, New Haven, Connecticut, USA
- Internal Medicine, Yale University, New Haven, Connecticut, USA
| | | |
Collapse
|
15
|
Benjakob O, Guley O, Sevin JM, Blondel L, Augustoni A, Collet M, Jouveshomme L, Amit R, Linder A, Aviram R. Wikipedia as a tool for contemporary history of science: A case study on CRISPR. PLoS One 2023; 18:e0290827. [PMID: 37703244 PMCID: PMC10499201 DOI: 10.1371/journal.pone.0290827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 08/16/2023] [Indexed: 09/15/2023] Open
Abstract
Rapid developments and methodological divides hinder the study of how scientific knowledge accumulates, consolidates and transfers to the public sphere. Our work proposes using Wikipedia, the online encyclopedia, as a historiographical source for contemporary science. We chose the high-profile field of gene editing as our test case, performing a historical analysis of the English-language Wikipedia articles on CRISPR. Using a mixed-method approach, we qualitatively and quantitatively analyzed the CRISPR article's text, sections and references, alongside 50 affiliated articles. These, we found, documented the CRISPR field's maturation from a fundamental scientific discovery to a biotechnological revolution with vast social and cultural implications. We developed automated tools to support such research and demonstrated its applicability to two other scientific fields-coronavirus and circadian clocks. Our method utilizes Wikipedia as a digital and free archive, showing it can document the incremental growth of knowledge and the manner scientific research accumulates and translates into public discourse. Using Wikipedia in this manner compliments and overcomes some issues with contemporary histories and can also augment existing bibliometric research.
Collapse
Affiliation(s)
- Omer Benjakob
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Olha Guley
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Jean-Marc Sevin
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Leo Blondel
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Ariane Augustoni
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Matthieu Collet
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Louise Jouveshomme
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Roy Amit
- Bezalel Academy of Arts and Design, Jerusalem, Israel
| | - Ariel Linder
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| | - Rona Aviram
- System Engineering and Evolution Dynamics, Inserm, Université Paris Cité, Paris, France
- Learning Planet Institute, Paris, France
| |
Collapse
|
16
|
Alibudbud R. Wikipedia page views for health research: a review. Front Big Data 2023; 6:1199060. [PMID: 37469441 PMCID: PMC10353851 DOI: 10.3389/fdata.2023.1199060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 06/22/2023] [Indexed: 07/21/2023] Open
Abstract
Wikipedia is an open-source online encyclopedia and one of the most-read sources of online health information. Likewise, Wikipedia page views have also been analyzed to inform public health services and policies. The present review analyzed 29 studies utilizing Wikipedia page views for health research. Most reviewed studies were published in recent years and emanated from high-income countries. Together with Wikipedia page views, most studies also used data from other internet sources, such as Google, Twitter, YouTube, and Reddit. The reviewed studies also explored various non-communicable diseases, infectious diseases, and health interventions to describe changes in the utilization of online health information from Wikipedia, to examine the effect of public events on public interest and information usage about health-related Wikipedia pages, to estimate and predict the incidence and prevalence of diseases, to predict data from other internet data sources, to evaluate the effectiveness of health education activities, and to explore the evolution of a health topic. Given some of the limitations in replicating some of the reviewed studies, future research can specify the specific Wikipedia page or pages analyzed, the language of the Wikipedia pages examined, dates of data collection, dates explored, type of data, and whether page views were limited to Internet users and whether web crawlers and redirects to the Wikipedia page were included. Future research can also explore public interest in other commonly read health topics available in Wikipedia, develop Wikipedia-based models that can be used to predict disease incidence and improve Wikipedia-based health education activities.
Collapse
|
17
|
Azer SA, Alsharafi AA. Can pharmacy students use Wikipedia as a learning resource? Critical assessment of articles on chemotherapeutic drugs. ADVANCES IN PHYSIOLOGY EDUCATION 2023; 47:333-345. [PMID: 36951631 DOI: 10.1152/advan.00212.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Revised: 02/17/2023] [Accepted: 03/11/2023] [Indexed: 06/18/2023]
Abstract
Pharmacy students tend to use Wikipedia as a quick resource of knowledge. This study aimed to evaluate the accuracy of content and readability level of Wikipedia articles on chemotherapeutics, using quality and readability tools. Using the British National Formulary (BNF-2018) and ClinicalTrials.gov, we identified 188 chemotherapeutic drugs. We randomly selected 100 drugs with an Excel randomization program. The English Wikipedia was searched for the selected 100 drugs, and prints of the identified articles were obtained. Readability was calculated with an online instrument (http://www.readabilityformulas.com/). Articles were independently scored by two researchers using the modified DISCERN tool for content assessment. The modified DISCERN scores had a median value of 24 [interquartile range (IQR) = 7.5]. Two articles (2%) had good quality (DISCERN score 36-40), thirty-eight (38%) were moderate (DISCERN 26-35), and sixty (60%) were poor in score (DISCERN ≤25). The articles covered drug indications and most side effects. However, the majority lacked information on the routes of administration, contraindications, pharmacokinetics, and mechanisms of action. We found a correlation between DISCERN scores and number of edits (P value = 0.00033, R2 = 0.1238). The number of references varied from 2 to 150 (median= 17, IQR = 17). Several problems were identified in the lists of references and citations. Most articles lacked tables and figures. The readability of the articles was 14.35 ± 3.13, consistent with the readability level of university students. In conclusion, the Wikipedia articles on chemotherapeutic drugs were not written for professional pharmacy students. Although they matched the expected readability level of university students, most were incomplete and lacked essential information.NEW & NOTEWORTHY Pharmacy students use Wikipedia as a quick resource of knowledge. However, Wikipedia articles are not written for professional pharmacy students. The study shows that although Wikipedia articles on chemotherapeutic drugs matched the expected readability level of university students, most needed to be completed and lacked essential information.
Collapse
Affiliation(s)
- Samy A Azer
- Department of Medical Education, College of Medicine, King Saud University, Riyadh, Saudi Arabia
| | - Aya A Alsharafi
- College of Pharmacy, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|
18
|
Montilha AAP, Morata TC, Flor DÁ, Machado MAAM, Menegon FA, Zucki F. The Promotion of Hearing Health through Wikipedia Campaigns: Article Quality and Reach Assessment. Healthcare (Basel) 2023; 11:healthcare11111572. [PMID: 37297712 DOI: 10.3390/healthcare11111572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 05/24/2023] [Accepted: 05/25/2023] [Indexed: 06/12/2023] Open
Abstract
This case study examined the feasibility, reach, and potential impact of using Wikipedia as a tool for hearing health promotion. Activities involved editing existing Portuguese-language Wikipedia hearing health articles, as well as translating English-language hearing health articles to Portuguese during the Wiki4WorldHearingDay2019 and Wiki4YearOfSound2020 online campaigns. The Wikipedia efforts that took place in Brazil were carried out by 10 volunteer undergraduate students in Speech-Language Pathology and Audiology at the Federal University of Santa Catarina, in Brazil. Among new and existing Wikipedia articles, the group edited 37 articles, which attracted more than 220,000 views during the set tracking period. Students were responsible for 60% of the Portuguese-language edits during the Wiki4WorldHearingDay2019 campaign and more than 90% of the Portuguese-language edits during the first half of the Wiki4YearOfSound2020 campaign. Moreover, the quality indexes for pages either created or edited were improved in all situations by registering an increase rate ranging from 33% to 100%. Wikipedia-centered activities expanded the availability of quality scientific content, written in plain language, to the public. Students worked together in order to select topics, assess existing information, validate it, create new content, and share information-steps that contributed to the mission of health promotion and knowledge dissemination for the benefit of society.
Collapse
Affiliation(s)
| | - Thais Catalani Morata
- Noise and Bioacoustics Team, National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, Cincinnati, OH 45226, USA
| | - Daiana Ávila Flor
- Department of Speech-Language Pathology and Audiology, Federal University of Santa Catarina, Florianopolis 88040-370, SC, Brazil
| | | | - Fabrício Augusto Menegon
- Department of Public Health, Federal University of Santa Catarina, Florianopolis 88040-370, SC, Brazil
| | - Fernanda Zucki
- Department of Speech-Language Pathology and Audiology, Federal University of Santa Catarina, Florianopolis 88040-370, SC, Brazil
| |
Collapse
|
19
|
Martin PC, Maggio LA, Murray H, Willinsky JM. Enculturating a Community of Action: Health Professions Educators' Perspectives on Teaching With Wikipedia. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:394-400. [PMID: 35921150 DOI: 10.1097/acm.0000000000004897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
PURPOSE Health professions educators are increasingly called on to engage learners in more meaningful instruction. Many have used Wikipedia to offer an applied approach to engage learners, particularly learning related to evidence-based medicine (EBM). However, little is known about the benefits and challenges of using Wikipedia as a pedagogic tool from the collective experience of educators who have sought to improve their instructional practice with it. This study aims to synthesize the perspectives of health professions education (HPE) instructors on the incorporation of Wikipedia editing into their HPE courses. METHOD Applying a constructivist approach, the authors conducted semistructured interviews from July to December 2020, with 17 participating HPE instructors who had substantively integrated Wikipedia into their curriculum at 13 institutions. Participants were interviewed about their experiences of integrating Wikipedia editing into their courses. Thematic analysis was conducted on resulting transcripts. RESULTS The authors observed 2 broad themes among participants' expressed benefits of teaching with Wikipedia. First, Wikipedia provides a meaningful instructional alternative that also helps society and develops learners' information literacy and EBM skills. Second, Wikipedia supports learners' careers and professional identity formation. Identified challenges included high effort and time, restrictive Wikipedia sourcing guidelines, and difficult interactions with stakeholders. CONCLUSIONS Findings build on known benefits, such as providing a real-world collaborative project that contextualizes students' learning experiences. They also echo known challenges, such as the resource-intensive nature of teaching with Wikipedia. The findings of this study reveal the potential of Wikipedia to enculturate HPE students within a situated learning context. They also present implications for HPE programs that are considering implementing Wikipedia and faculty development needed to help instructors harness crowd-sourced information tools' pedagogic opportunities as well as anticipate their challenges.
Collapse
Affiliation(s)
- Paolo C Martin
- P.C. Martin is assistant professor of health professions education, Department of Medicine, Center for Health Professions Education, Uniformed Services University of the Health Sciences, Bethesda, Maryland; ORCID: http://orcid.org/0000-0002-7720-5667
| | - Lauren A Maggio
- L.A. Maggio is professor of medicine and health professions education, Department of Medicine, Center for Health Professions Education, Uniformed Services University of the Health Sciences, Bethesda, Maryland; ORCID: http://orcid.org/0000-0002-2997-6133
| | - Heather Murray
- H. Murray is professor of emergency medicine, Department of Emergency Medicine, and professor, Department of Public Health Sciences, Queen's University School of Medicine, Kingston, Ontario, Canada; ORCID: http://orcid.org/0000-0002-8448-2566
| | - John M Willinsky
- J.M. Willinsky is professor of education, Stanford University Graduate School of Education, Stanford, California; ORCID: http://orcid.org/0000-0001-6192-8687
| |
Collapse
|
20
|
Johnson AM, Brimhall AS, Johnson ET, Hodgson J, Didericksen K, Pye J, Harmon GJC, Sewell KB. A systematic review of the effectiveness of patient education through patient portals. JAMIA Open 2023; 6:ooac085. [PMID: 36686972 PMCID: PMC9847535 DOI: 10.1093/jamiaopen/ooac085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Revised: 09/01/2022] [Accepted: 10/18/2022] [Indexed: 01/19/2023] Open
Abstract
Objective The objective of this study was to systematically review all literature studying the effect of patient education on patient engagement through patient portals. Introduction Patient portals provide patients access to health records, lab results, medication refills, educational materials, secure messaging, appointment scheduling, and telehealth visits, allowing patients to take a more active role in their health care decisions and management. A debate remains around whether these additional aids actually improve patient engagement and increase their ability to manage their own health conditions. This systematic review looks specifically at the effect of educational materials included in patient portals. Materials and Methods In accordance with PRISMA guidelines, the literature search was mapped across 5 databases (PubMed, CINAHL, Scopus, PsychINFO, Embase), and implemented on June 2, 2020. Results Fifty-two studies were included in the review. Forty-six (88.5%) reported rates of patient utilization of educational resources in the patient portal. Thirty (57.9%) shared patients' perceptions of the usefulness of the education materials. Twenty-one (40.4%) reported changes in health outcomes following educational interventions through the patient portal. This review found that efforts are indeed being made to raise awareness of educational resources in patient portals, that patients are increasingly utilizing these resources, that patients are finding them useful, and that they are improving health outcomes. Conclusion It seems that patient portals are becoming a powerful tool for patient education and engagement, and show promise as a means of achieving the quadruple aim of healthcare. Moving forward, research should establish more uniform methods of measurement in order to strengthen the literature surrounding the effectiveness of patient education through patient portals.
Collapse
Affiliation(s)
- Adam M Johnson
- Corresponding Author: Adam M. Johnson, MS, Department of Human Development & Family Science, East Carolina University, Greenville, North Carolina, USA;
| | - Andrew S Brimhall
- Department of Human Development & Family Science, East Carolina University, Greenville, North Carolina, USA
| | - Erica T Johnson
- Department of Human Development & Family Science, East Carolina University, Greenville, North Carolina, USA
| | - Jennifer Hodgson
- Department of Human Development & Family Science, East Carolina University, Greenville, North Carolina, USA
| | - Katharine Didericksen
- Department of Human Development & Family Science, East Carolina University, Greenville, North Carolina, USA
| | - Joseph Pye
- Department of Family Medicine, ECU Health, Greenville, North Carolina, USA
| | - G J Corey Harmon
- Laupus Library, East Carolina University, Greenville, North Carolina, USA
| | - Kerry B Sewell
- Laupus Library, East Carolina University, Greenville, North Carolina, USA
| |
Collapse
|
21
|
Cobbs LV, Al-Hindi H, Fathy C, Mahmoudzadeh R, Uhler T, Xu D. Accuracy and Utility of Internet Image Search as a Learning Tool for Retinal Pathology. JOURNAL OF ACADEMIC OPHTHALMOLOGY (2017) 2023; 15:e93-e98. [PMID: 38737161 PMCID: PMC10804767 DOI: 10.1055/s-0043-1768025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Accepted: 03/01/2023] [Indexed: 05/14/2024]
Abstract
Purpose Ophthalmology residency training heavily relies on visual and pattern recognition-based learning. In parallel with traditional reference texts, online internet search via Google Image Search (GIS) is commonly used and offers an accessible fund of reference images for ophthalmology trainees seeking rapid exposure to images of retinal pathology. However, the accuracy and quality of this tool within this context is unknown. We aim to evaluate the accuracy and quality of GIS images of selected retinal pathologies. Methods A cross-sectional study was performed of GIS of 15 common and 15 rare retinal diseases drawn from the American Academy of Ophthalmology residency textbook series. A total of 300 evaluable image results were assessed for accuracy of images and image source accountability in consultation with a vitreoretinal surgeon. Results A total of 377 images were reviewed with 77 excluded prior to final analysis. A total of 288 (96%) search results accurately portrayed the retinal disease being searched, whereas 12 (4%) were of an erroneous diagnosis. More images of common retinal diseases were from patient education Web sites than were images of rare diseases ( p < 0.01). Significantly more images of rare retinal diseases were found in peer-reviewed sources ( p = 0.01). Conclusions GIS search results yielded a modest level of accuracy for the purposes of ophthalmic education. Despite the ease and rapidity of accessing multimodal retinal imaging examples, this tool may best be suited as a supplementary resource for learning among residents due to limited accuracy, lack of sufficient supporting information, and the source Web site's focus on patient education.
Collapse
Affiliation(s)
- Lucy V. Cobbs
- Retina Service, Wills Eye Hospital, Mid Atlantic Retina, Thomas Jefferson University, Philadelphia, Pennsylvania
- Department of Ophthalmology, Wills Eye Hospital, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - Hytham Al-Hindi
- College of Medicine, University of Arkansas for Medical Sciences, Little Rock, Arkansas
| | - Cherie Fathy
- Retina Service, Wills Eye Hospital, Mid Atlantic Retina, Thomas Jefferson University, Philadelphia, Pennsylvania
- Department of Ophthalmology, Wills Eye Hospital, Thomas Jefferson University, Philadelphia, Pennsylvania
- Cornea Service, Wilmer Eye Institute, Johns Hopkins University, Baltimore, Maryland
| | - Raziyeh Mahmoudzadeh
- Retina Service, Wills Eye Hospital, Mid Atlantic Retina, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - Tara Uhler
- Department of Ophthalmology, Wills Eye Hospital, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - David Xu
- Retina Service, Wills Eye Hospital, Mid Atlantic Retina, Thomas Jefferson University, Philadelphia, Pennsylvania
- Department of Ophthalmology, Wills Eye Hospital, Thomas Jefferson University, Philadelphia, Pennsylvania
| |
Collapse
|
22
|
Ciechanowski K, Banasik-Jemielniak N, Jemielniak D. What's hot and what's not in lay psychology: Wikipedia's most-viewed articles. CURRENT PSYCHOLOGY 2022; 43:1-13. [PMID: 36248218 PMCID: PMC9553632 DOI: 10.1007/s12144-022-03826-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/26/2022] [Indexed: 11/25/2022]
Abstract
We studied views of articles about psychology on 10 language editions of Wikipedia from July 1, 2015, to January 6, 2021. We were most interested in what psychology topics Wikipedia users wanted to read, and how the frequency of views changed during the COVID-19 pandemic and lockdowns. Our results show that the topics of interest to people seeking psychological knowledge changed during the pandemic. In addition, the interests differ noticeably among the languages. We made two important observations. The first was that during the pandemic, people in most countries looked for new ways to manage their stress without resorting to external help. This is understandable, given the increased stress of lockdown and the limited amount of professional help available. We also found that academic topics, typically covered in university classes, experienced a substantial drop in traffic, which could be indicative of issues with remote teaching. Supplementary Information The online version contains supplementary material available at 10.1007/s12144-022-03826-0.
Collapse
Affiliation(s)
- Kaśmir Ciechanowski
- MINDS (Management in Networked and Digital Societies) Department, Kozminski University, Warsaw, Poland
| | | | - Dariusz Jemielniak
- MINDS (Management in Networked and Digital Societies) Department, Kozminski University, Warsaw, Poland
| |
Collapse
|
23
|
Epstein HAB. Health Information on Wikipedia: Can You Trust It? JOURNAL OF CONSUMER HEALTH ON THE INTERNET 2022. [DOI: 10.1080/15398285.2022.2069391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
24
|
Döring N, Lehmann S, Schumann-Doermer C. [Contraception in the German-language Wikipedia: a content and quality analysis]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2022; 65:706-717. [PMID: 35471607 PMCID: PMC9132820 DOI: 10.1007/s00103-022-03537-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Accepted: 04/14/2022] [Indexed: 11/29/2022]
Abstract
BACKGROUND Adolescents and adults today often obtain information about contraception from the Internet, especially from the online encyclopedia Wikipedia. This is because Google searches usually return Wikipedia entries as top hits. RESEARCH AIM Against this background, the aim of the current study is to systematically analyze for the first time the content and quality of Wikipedia articles on contraceptive methods. Five central quality dimensions are examined: the degree of correctness (research question RQ1), completeness (RQ2), neutrality (RQ3), comprehensibility (RQ4), and currency (RQ5) of the contraceptive information - and on this basis the overall quality of the articles (RQ6). MATERIALS AND METHODS A sample of all German-language Wikipedia articles on all contraceptive methods was formed (N = 25). These articles were analyzed by three independent, trained coders using a codebook that was developed based on the current state of the research and tested for reliability. Data analysis was performed using SPSS. The study is preregistered and all data, materials, and analysis scripts are publicly available. RESULTS The 25 Wikipedia articles on contraceptive methods were found to vary widely in content quality. While they showed good quality on average in terms of correctness (RQ1) and neutrality (RQ3), they scored mediocre in terms of completeness (RQ2), comprehensibility (RQ4), and currency (RQ5), resulting in moderate overall quality (RQ6). DISCUSSION More research as well as practice measures are needed to further assess and improve the quality of contraceptive information on Wikipedia and in other social media in a more targeted way.
Collapse
Affiliation(s)
- Nicola Döring
- Institut für Medien und Kommunikationswissenschaft (IfMK), Technische Universität Ilmenau, Ehrenbergstraße 29, 98693, Ilmenau, Deutschland.
| | - Stephan Lehmann
- Institut für Medien und Kommunikationswissenschaft (IfMK), Technische Universität Ilmenau, Ehrenbergstraße 29, 98693, Ilmenau, Deutschland
| | - Claudia Schumann-Doermer
- Deutsche Gesellschaft für psychosomatische Frauenheilkunde und Geburtshilfe (DGPFG), Dresden, Deutschland
| |
Collapse
|
25
|
Gordejeva J, Zowalla R, Pobiruchin M, Wiesner M. Readability of English, German, and Russian Disease-related Wikipedia pages: Automated Computational Analysis (Preprint). J Med Internet Res 2022; 24:e36835. [PMID: 35576562 PMCID: PMC9152717 DOI: 10.2196/36835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 04/12/2022] [Accepted: 04/14/2022] [Indexed: 11/13/2022] Open
Affiliation(s)
| | - Richard Zowalla
- Department of Medical Informatics, Heilbronn University, Heilbronn, Germany
- Consumer Health Informatics SIG, German Association for Medical Informatics, Biometry & Epidemiology (GMDS e. V.), Cologne, Germany
- Center for Machine Learning, Heilbronn University, Heilbronn, Germany
| | - Monika Pobiruchin
- Consumer Health Informatics SIG, German Association for Medical Informatics, Biometry & Epidemiology (GMDS e. V.), Cologne, Germany
- GECKO Institute for Medicine, Informatics & Economics, Heilbronn University, Heilbronn, Germany
| | - Martin Wiesner
- Department of Medical Informatics, Heilbronn University, Heilbronn, Germany
- Consumer Health Informatics SIG, German Association for Medical Informatics, Biometry & Epidemiology (GMDS e. V.), Cologne, Germany
| |
Collapse
|
26
|
Benjakob O, Aviram R, Sobel JA. Citation needed? Wikipedia bibliometrics during the first wave of the COVID-19 pandemic. Gigascience 2022; 11:giab095. [PMID: 35022700 PMCID: PMC8756189 DOI: 10.1093/gigascience/giab095] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 09/15/2021] [Accepted: 12/10/2021] [Indexed: 01/03/2023] Open
Abstract
BACKGROUND With the COVID-19 pandemic's outbreak, millions flocked to Wikipedia for updated information. Amid growing concerns regarding an "infodemic," ensuring the quality of information is a crucial vector of public health. Investigating whether and how Wikipedia remained up to date and in line with science is key to formulating strategies to counter misinformation. Using citation analyses, we asked which sources informed Wikipedia's COVID-19-related articles before and during the pandemic's first wave (January-May 2020). RESULTS We found that coronavirus-related articles referenced trusted media outlets and high-quality academic sources. Regarding academic sources, Wikipedia was found to be highly selective in terms of what science was cited. Moreover, despite a surge in COVID-19 preprints, Wikipedia had a clear preference for open-access studies published in respected journals and made little use of preprints. Building a timeline of English-language COVID-19 articles from 2001-2020 revealed a nuanced trade-off between quality and timeliness. It further showed how pre-existing articles on key topics related to the virus created a framework for integrating new knowledge. Supported by a rigid sourcing policy, this "scientific infrastructure" facilitated contextualization and regulated the influx of new information. Last, we constructed a network of DOI-Wikipedia articles, which showed the landscape of pandemic-related knowledge on Wikipedia and how academic citations create a web of shared knowledge supporting topics like COVID-19 drug development. CONCLUSIONS Understanding how scientific research interacts with the digital knowledge-sphere during the pandemic provides insight into how Wikipedia can facilitate access to science. It also reveals how, aided by what we term its "citizen encyclopedists," it successfully fended off COVID-19 disinformation and how this unique model may be deployed in other contexts.
Collapse
Affiliation(s)
- Omer Benjakob
- Center for Research and Interdisciplinarity (CRI), Université de Paris, INSERM U1284, 8 bis Rue Charles V, 75004 Paris, France
- The Cohn Institute for the History and Philosophy of Science and Ideas, Humanities Faculty, Tel Aviv University, Ramat Aviv, Tel Aviv 6997801, Israel
| | - Rona Aviram
- Center for Research and Interdisciplinarity (CRI), Université de Paris, INSERM U1284, 8 bis Rue Charles V, 75004 Paris, France
- Department of Biomolecular Sciences, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Jonathan Aryeh Sobel
- Department of Biomolecular Sciences, Weizmann Institute of Science, Rehovot 76100, Israel
- Department of Biomedical Engineering, Julius Silver Building, Technion-IIT, Technion City, Haifa 32000, Israel
| |
Collapse
|
27
|
Huang Y, Sundar SS. Do We Trust the Crowd? Effects of Crowdsourcing on Perceived Credibility of Online Health Information. HEALTH COMMUNICATION 2022; 37:93-102. [PMID: 32962437 DOI: 10.1080/10410236.2020.1824662] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Crowdsourcing websites such as Wikipedia have become go-to places for health information. To what extent do we trust such health content that is generated by other Internet users? Will it make a difference if such entries are curated by medical professionals? Does the affordance of crowdsourcing make users feel like they themselves could be contributors, and does that influence their credibility judgments? We explored these questions with a 2 (Crowdsourcing: absence vs. presence) × 2 (Professional source: absence vs. presence) × 2 (Message: sunscreen vs. milk) between-subjects experiment (N = 189). Two indirect paths for crowdsourcing effects were found. The crowd-as-source path suggests that crowdsourcing negatively affects content credibility through decreased source trustworthiness and information completeness. In contrast, the self-as-source path indicates that crowdsourcing elevates source trustworthiness via heightened interactivity and sense of control. Although the additional professional source raises perceived gatekeeping on the site, it does not have substantial influence on credibility judgments. Theoretical and practical implications of the findings are discussed.
Collapse
Affiliation(s)
- Yan Huang
- Jack J. Valenti School of Communication, University of Houston
| | - S Shyam Sundar
- James P. Jimirro Professor of Media Effects, & Co-Director, Media Effects Research Laboratory, Donald P. Bellisario College of Communications, Penn State University, USA
| |
Collapse
|
28
|
Bérubé C, Kovacs ZF, Fleisch E, Kowatsch T. Reliability of Commercial Voice Assistants' Responses to Health-Related Questions in Noncommunicable Disease Management: Factorial Experiment Assessing Response Rate and Source of Information. J Med Internet Res 2021; 23:e32161. [PMID: 34932003 PMCID: PMC8726026 DOI: 10.2196/32161] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 11/19/2021] [Accepted: 11/20/2021] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Noncommunicable diseases (NCDs) constitute a burden on public health. These are best controlled through self-management practices, such as self-information. Fostering patients' access to health-related information through efficient and accessible channels, such as commercial voice assistants (VAs), may support the patients' ability to make health-related decisions and manage their chronic conditions. OBJECTIVE This study aims to evaluate the reliability of the most common VAs (ie, Amazon Alexa, Apple Siri, and Google Assistant) in responding to questions about management of the main NCD. METHODS We generated health-related questions based on frequently asked questions from health organization, government, medical nonprofit, and other recognized health-related websites about conditions associated with Alzheimer's disease (AD), lung cancer (LCA), chronic obstructive pulmonary disease, diabetes mellitus (DM), cardiovascular disease, chronic kidney disease (CKD), and cerebrovascular accident (CVA). We then validated them with practicing medical specialists, selecting the 10 most frequent ones. Given the low average frequency of the AD-related questions, we excluded such questions. This resulted in a pool of 60 questions. We submitted the selected questions to VAs in a 3×3×6 fractional factorial design experiment with 3 developers (ie, Amazon, Apple, and Google), 3 modalities (ie, voice only, voice and display, display only), and 6 diseases. We assessed the rate of error-free voice responses and classified the web sources based on previous research (ie, expert, commercial, crowdsourced, or not stated). RESULTS Google showed the highest total response rate, followed by Amazon and Apple. Moreover, although Amazon and Apple showed a comparable response rate in both voice-and-display and voice-only modalities, Google showed a slightly higher response rate in voice only. The same pattern was observed for the rate of expert sources. When considering the response and expert source rate across diseases, we observed that although Google remained comparable, with a slight advantage for LCA and CKD, both Amazon and Apple showed the highest response rate for LCA. However, both Google and Apple showed most often expert sources for CVA, while Amazon did so for DM. CONCLUSIONS Google showed the highest response rate and the highest rate of expert sources, leading to the conclusion that Google Assistant would be the most reliable tool in responding to questions about NCD management. However, the rate of expert sources differed across diseases. We urge health organizations to collaborate with Google, Amazon, and Apple to allow their VAs to consistently provide reliable answers to health-related questions on NCD management across the different diseases.
Collapse
Affiliation(s)
- Caterina Bérubé
- Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Zsolt Ferenc Kovacs
- Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Elgar Fleisch
- Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland.,Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore, Singapore.,Centre for Digital Health Interventions, Institute of Technology Management, University of St. Gallen, St. Gallen, Switzerland
| | - Tobias Kowatsch
- Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland.,Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore, Singapore.,Centre for Digital Health Interventions, Institute of Technology Management, University of St. Gallen, St. Gallen, Switzerland
| |
Collapse
|
29
|
Banasik-Jemielniak N, Jemielniak D, Pędzich W. Intercessory Rote Prayer, Life Longevity and the Mortality of Roman Catholic Bishops: An Exploratory Study. JOURNAL OF RELIGION AND HEALTH 2021; 60:3871-3885. [PMID: 33721174 PMCID: PMC8542532 DOI: 10.1007/s10943-021-01214-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 02/17/2021] [Indexed: 06/12/2023]
Abstract
Based on a computational analysis of a large dataset, this study explores if there is a significant longevity effect of intercessory prayer for a named individual's well-being, if he receives a very high number of prayers per annum for an extended period. We relied on an observational cohort study, based on data from 1988 to 2018, including 857 Roman Catholic bishops, 500 Catholic priests, and 3038 male academics from six countries. We measured the covariance of the mean length of life, controlled for nationality. It was found that there is a main effect for occupation F(2, 4391) = 4.07, p = 0.017, ηp2 = 0.002, with pairwise comparisons indicating significant differences between the mean life duration of bishops (M = 30,489) and of priests (M = 29,894), but none between the academic teachers (M = 30,147) and either of the other groups. A comparison analysis between bishops from the largest and the smallest dioceses showed no significant difference t(67.31) = 1.61, p = 0.11. The first analysis proved that bishops live longer than priests, but due to a marginal effect size this result should be treated with caution. No difference was found between the mean length of life of bishops from the largest and the smallest dioceses.
Collapse
Affiliation(s)
| | - Dariusz Jemielniak
- Management in Networked and Digital Societies (MINDS) Department, Kozminski University, Warsaw, Poland.
| | - Wojciech Pędzich
- Management in Networked and Digital Societies (MINDS) Department, Kozminski University, Warsaw, Poland
| |
Collapse
|
30
|
Mendes TB, Dawson J, Evenstein Sigalov S, Kleiman N, Hird K, Terenius O, Das D, Geres N, Azzam A. Wikipedia in Health Professional Schools: from an Opponent to an Ally. MEDICAL SCIENCE EDUCATOR 2021; 31:2209-2216. [PMID: 34608425 PMCID: PMC8480752 DOI: 10.1007/s40670-021-01408-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 09/19/2021] [Indexed: 06/13/2023]
Abstract
As an online encyclopedia, Wikipedia is the world's largest reference Web site, with 1.7 billion visits per month. Given how easy it is to access and read, students use Wikipedia globally, despite most faculty members' admonitions. Since 2013, health professional schools worldwide have incorporated Wiki-editing into their formal curricula. These courses impact students by (1) strengthening their ability to evaluate evidence-based content and (2) multiplying their contributions to society through improvements to Wikipedia articles accessed by millions. We showcase several models of incorporating Wikipedia-editing assignments into health professions education worldwide. These successful initiatives can be replicated everywhere.
Collapse
Affiliation(s)
| | - Jennifer Dawson
- Children’s Hospital of Eastern Ontario Research Institute, Ottawa, ON Canada
| | | | - Nancy Kleiman
- College of Pharmacy, University of Manitoba, Winnipeg, Canada
| | - Kathryn Hird
- Notre Dame University School of Medicine, Sydney, Australia
| | | | - Diptanshu Das
- International League Against Epilepsy Wikipedia Project, Medica Superspecialty Hospital, Kolkata, India
| | - Nour Geres
- South Cliff Dental Group, Eastbourne, UK
| | - Amin Azzam
- San Francisco School of Medicine, University of California, San Francisco, USA
| |
Collapse
|
31
|
Aguilar-Morales K, Aguirre-Suarez G, Bowles B, Lee A, Lansingh VC. Wikipedia, friend or foe regarding information on diabetic retinopathy? A content analysis in the world's leading 19 languages. PLoS One 2021; 16:e0258246. [PMID: 34710114 PMCID: PMC8553146 DOI: 10.1371/journal.pone.0258246] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 09/23/2021] [Indexed: 01/12/2023] Open
Abstract
Objective To compare the completeness and quality of information about diabetic retinopathy on Wikipedia in the world’s leading spoken languages in 2020. Design and methods An observational, descriptive, cross-sectional study. The information on diabetic retinopathy obtained from the free encyclopedia Wikipedia® was assessed in languages with one hundred million or more total speakers. The term "diabetic retinopathy" was accessed in the corresponding Wikipedia entry in English, while the "more languages" function gives access to other languages. The information on the sites was collected by three ophthalmologist observers. A database was created with the most important subtopics for the education of patients with diabetic retinopathy in any of its classifications, based on a 25-question survey. The results were stratified on a scale from 0 to 4. A confirming correlation was found in the statistical analysis among the observers. Results No language achieved the label “excellent”; 2 languages were rated as “fair “; 4 languages qualified as “substandard”; and 7 languages were scored as “poor.” No information could be found in five languages. Conclusions As would be expected, the quality of content is variable across different languages. However, if anyone can edit Wikipedia, health professionals can do so as well to improve the quality and quantity of information for patients.
Collapse
Affiliation(s)
- Kouatzin Aguilar-Morales
- Instituto Mexicano de Oftalmología IAP, Colinas de Cimatario, Centro Sur, Santiago de Querétaro, Mexico
| | - Gustavo Aguirre-Suarez
- Instituto Mexicano de Oftalmología IAP, Colinas de Cimatario, Centro Sur, Santiago de Querétaro, Mexico
| | - Brigham Bowles
- Instituto Nacional de Neurología y Neurocirugía, La Fama, Ciudad de México, Mexico
- Universidad Westhill, Santa Fe Cuajimalpa, Ciudad de México, Mexico
| | - Angel Lee
- Instituto Nacional de Neurología y Neurocirugía, La Fama, Ciudad de México, Mexico
- Comisión Coordinadora de Institutos Nacionales de Salud, Arenal Tepepan, Ciudad de México, Mexico
- * E-mail: (VCL); (AL)
| | - Van Charles Lansingh
- Instituto Mexicano de Oftalmología IAP, Colinas de Cimatario, Centro Sur, Santiago de Querétaro, Mexico
- Help Me See Inc, New York, New York, United States of America
- * E-mail: (VCL); (AL)
| |
Collapse
|
32
|
Nievas-Soriano BJ, Castro-Luna GM, García-Duarte S, González-López MDC, Parrón-Carreño T. Profile of the Users and the Most Visited Topics of a Pediatric eHealth Website. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph182111248. [PMID: 34769765 PMCID: PMC8583341 DOI: 10.3390/ijerph182111248] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 10/03/2021] [Revised: 10/23/2021] [Accepted: 10/25/2021] [Indexed: 12/31/2022]
Abstract
Parents need information about their children's health, and the Internet has become an essential repository for this information. However, there is almost no information about which topics are the most searched, consulted, or shared, or about the main characteristics of pediatric website users. The main aim of this research was to describe the profile of the users of a pediatric website, which topics they searched for, which topics were the most consulted, and which were the most shared. Users' demographic data were analyzed regarding their use of the Internet to search for information about health. A pediatric website for parents was analyzed. A 26-item questionnaire collected demographical features of the users of the website. Descriptive and analytical analyses were performed. Most participants used general search engines for their health searches, and the most searched keywords were prurigo, barking cough, and laryngitis. The most visited topics were unexplained fever, snots, and laryngitis. The most shared were snots, lipotomy, and dizziness. The users were mainly women (67.8%), with an average age of 38.8 years, and one or two children (89%) with a mean age of 4.6 years. The users who mainly used the Internet for health purposes were women of younger age, and with a higher educational level.
Collapse
Affiliation(s)
- Bruno José Nievas-Soriano
- Department of Nursing, Physiotherapy and Medicine, University of Almeria, 04120 Almería, Spain; (B.J.N.-S.); (T.P.-C.)
| | - Gracia María Castro-Luna
- Department of Nursing, Physiotherapy and Medicine, University of Almeria, 04120 Almería, Spain; (B.J.N.-S.); (T.P.-C.)
- Correspondence:
| | - Sonia García-Duarte
- Obstetrics and Gynecology Unit, Hospital Torrecárdenas, 04009 Almería, Spain;
| | | | - Tesifón Parrón-Carreño
- Department of Nursing, Physiotherapy and Medicine, University of Almeria, 04120 Almería, Spain; (B.J.N.-S.); (T.P.-C.)
| |
Collapse
|
33
|
Byron MJ, Hughes JR. Wikipedia and Nicotine and Tobacco: Meeting People Where They Are. Nicotine Tob Res 2021; 23:1977-1979. [PMID: 33955471 DOI: 10.1093/ntr/ntab087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Accepted: 04/28/2021] [Indexed: 11/14/2022]
Affiliation(s)
- M Justin Byron
- Department of Family Medicine, School of Medicine, University of North Carolina, Chapel Hill, NC
- Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC
- Lineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, NC
| | - John R Hughes
- Departments of Psychiatry and Psychological Science, University of Vermont, Burlington, VT
| |
Collapse
|
34
|
Ceballos DM, Herrick RF, Carreón T, Nguyen VT, Chu MT, Sadowski JP, Blumenthal H, Morata TC. Expanding Reach of Occupational Health Knowledge: Contributing Subject-Matter Expertise to Wikipedia as a Class Assignment. INQUIRY: The Journal of Health Care Organization, Provision, and Financing 2021; 58:469580211035735. [PMID: 34595964 PMCID: PMC8489755 DOI: 10.1177/00469580211035735] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The National Institute for Occupational Safety and Health (NIOSH) and several university programs have collaborated on a large effort to expand and improve occupational safety and health content in Wikipedia using a platform developed by Wiki Education. This article describes the initiative, student contributions, and evaluations of this effort by instructors from two universities between 2016 and 2020. The Wiki Education platform allowed instructors to set timelines and track students’ progress throughout the semester while students accessed training to best expand health content in Wikipedia. Students chose topics in occupational health based on their interests and by a set of topics deemed as a priority by the “WikiProject Occupational Safety and Health.” Students’ contributions were peer-reviewed by instructors, NIOSH Wikipedians-in-Residence, and traditional Wikipedians. Students presented their projects in class at the end of the semester. Students from both schools expanded 55 articles, created 8 new articles, and translated 2 articles to Spanish, adding 1270 references; these articles were viewed over 8 million times by May 2020. Feedback received from the implementation suggested that students learned about science communication and digital literacy—providing valuable content on occupational health while reducing misinformation in the public domain. The process of identifying and addressing gaps in occupational health in Wikipedia requires participation and engagement toward improving access to information that otherwise would be restricted to the scientific literature, often behind a paywall. The Wikipedia assignment proved to be an engaging approach for instruction and information literacy. It helped students improve their science communication skills and digital literacy, tools that are likely to be critical for successful communication of science in their future careers.
Collapse
Affiliation(s)
- Diana M Ceballos
- Department of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Robert F Herrick
- Department of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Tania Carreón
- World Trade Center Health Program, 114426National Institute for Occupational Safety and Health, Cincinnati, OH, USA.,Department of Environmental Health, University of Cincinnati, Cincinnati, OH, USA
| | - Vy T Nguyen
- Department of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - MyDzung T Chu
- Department of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - John P Sadowski
- Office of the Director, 114426National Institute for Occupational Safety and Health, Washington, DC, USA
| | | | - Thais C Morata
- Division of Field Studies and Engineering, 114426National Institute for Occupational Safety and Health, Cincinnati, OH, USA
| |
Collapse
|
35
|
Nguyen C. The accuracy and completeness of drug information in Google snippet blocks. J Med Libr Assoc 2021; 109:613-617. [PMID: 34858091 PMCID: PMC8608169 DOI: 10.5195/jmla.2021.1229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Introduction: Consumers commonly use the Internet for immediate drug information. In 2014, Google introduced the snippet block to programmatically search available websites to answer a question entered into the search engine without the need for the user to enter any websites. This study compared the accuracy and completeness of drug information found in Google snippet blocks to US Food and Drug Administration (FDA) medication guides. Methods: Ten outpatient drugs were selected from the 2018 Clinical Drugstats Database Medical Expenditure Panel Survey. Six questions in the medication guide for each drug were entered into the Google search engine to find the snippet block. The accuracy and completeness of drug information in the Google snippet block were quantified by two different pharmacists using a scoring system of 1 (less than 25% accurate/complete information) to 5 (100% accurate/complete information). Descriptive statistics were used to summarize the scores. Results: For five out of the six questions, the information in the Google snippets had less than 50% accuracy and completeness compared to the medication guides. The average accuracy and completeness scores of the Google snippets were highest for “What are the ingredients of [the drug]?” with scores of 3.38 (51–75%) and 3.00 (51–75%), respectively. The question on “How to take [drug]?” had the lowest score with averages of 1.00 (<25%) for both accuracy and completeness. Conclusion: Google snippets provide inaccurate and incomplete drug information when compared to FDA-approved drug medication guides. This aspect may cause patient harm; therefore, it is imperative for health care and health information professionals to provide reliable drug resources to patients and consumers if written information may be needed.
Collapse
Affiliation(s)
- Cambrey Nguyen
- , Clinical Assistant Professor, Drug Information, Pharmacy Practice, University of Kansas School of Pharmacy, Lawrence, KS
| |
Collapse
|
36
|
Smith DA. Wikipedia: an unexplored resource for understanding consumer health information behaviour in library and information science scholarship. JOURNAL OF DOCUMENTATION 2021. [DOI: 10.1108/jd-03-2021-0049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeTo date, health information behaviour (HIB) models have not been applied to an exploration of Wikipedia as a consumer health information resource. Wikipedia has been situated and is well established as a valuable resource for the general layperson wishing to learn more about their health or the health of a loved one. This paper aims to identify an approach to exploring the role of Wikipedia in consumer health information behaviour (CHIB) that is grounded in a conceptual framework from the library and information science (LIS) discipline.Design/methodology/approachThe author draws on current HIB models and relevant theories from existing LIS literature and applies them to propose a new definition of CHIB. The author uses this definition to frame Wikipedia as an unexplored consumer health information resource in the LIS scholarship and suggests future directions for placing such investigations within a conceptual framework from LIS.FindingsThe paper finds that Longo's expanded conceptual model of health information-seeking behaviour (ECMHISB) could be valuable and useful for the exploration of CHIB in relation to Wikipedia's health and medical content. Due to Wikipedia's online nature, research framed by these models must acknowledge and take under consideration the digital divide phenomenon and various factors that influence an individual's place within it.Research limitations/implicationsThis work builds a foundation upon which future research into the role of Wikipedia's health and medical content in CHIB can be grounded. Using Longo's model, future research might provide insight into who Wikipedia is helping and who it has left behind. LIS scholars, practicing health librarians and perhaps health workers stand to gain a deeper understanding of the potential influence of Wikipedia's health information on its consumers.Originality/valueFor LIS scholars, this paper is novel in the fact that a HIB model has not yet been applied to the study of Wikipedia's health content. This paper provides a foundation for this research.
Collapse
|
37
|
Rasberry L, Mietchen D. Wikipedia for multilingual COVID-19 vaccine education at scale. RESEARCH IDEAS AND OUTCOMES 2021. [DOI: 10.3897/rio.7.e70042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
We present the design of a project to develop Wikipedia content on general vaccine safety and the COVID-19 vaccines, specifically. This proposal describes what a team would need to distribute public health information in Wikipedia in multiple languages in response to a disaster or crisis, and to measure and report the communication impact of the same. Researchers at the School of Data Science at the University of Virginia made this proposal in response to a February 2021 call from a sponsor which was seeking to share public health information to respond globally to vaccine hesitancy related to the COVID-19 vaccines. This proposal was not selected for funding, and now the research team is sharing the proposal here with an open copyright license for anyone to reuse and remix. Most of the text here is from the original proposal, but there are modifications to remove the names of the funder, named partners, and for other details to make this text more reusable. The budget in this proposal has been converted from a dollar amount to equivalent descriptions in terms of labor hours, and the timeline was adapted from absolute to relative months.
Collapse
|
38
|
Mietchen D, Rasberry L, Morata T, Sadowski JP, Novakovich J, Heilman JM. Developing a scalable framework for partnerships between health agencies and the Wikimedia ecosystem. RESEARCH IDEAS AND OUTCOMES 2021; 7:10.3897/rio.7.e68121. [PMID: 39421138 PMCID: PMC11485012 DOI: 10.3897/rio.7.e68121] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2021] [Indexed: 12/31/2022] Open
Abstract
In this era of information overload and misinformation, it is a challenge to rapidly translate evidence-based health information to the public. Wikipedia is a prominent global source of health information with high traffic, multilingual coverage, and acceptable quality control practices. Viewership data following the Ebola crisis and during the COVID-19 pandemic reveals that a significant number of web users located health guidance through Wikipedia and related projects, including its media repository Wikimedia Commons and structured data complement, Wikidata. The basic idea discussed in this paper is to increase and expedite health institutions' global reach to the general public, by developing a specific strategy to maximize the availability of focused content into Wikimedia's public digital knowledge archives. It was conceptualized from the experiences of leading health organizations such as Cochrane, the World Health Organization (WHO) and other United Nations Organizations, Cancer Research UK, National Network of Libraries of Medicine, and Centers for Disease Control and Prevention (CDC)'s National Institute for Occupational Safety and Health (NIOSH). Each has customized strategies to integrate content in Wikipedia and evaluate responses. We propose the development of an interactive guide on the Wikipedia and Wikidata platforms to support health agencies, health professionals and communicators in quickly distributing key messages during crisis situations. The guide aims to cover basic features of Wikipedia, including adding key health messages to Wikipedia articles, citing expert sources to facilitate fact-checking, staging text for translation into multiple languages; automating metrics reporting; sharing non-text media; anticipating offline reuse of Wikipedia content in apps or virtual assistants; structuring data for querying and reuse through Wikidata, and profiling other flagship projects from major health organizations. In the first phase, we propose the development of a curriculum for the guide using information from prior case studies. In the second phase, the guide would be tested on select health-related topics as new case studies. In its third phase, the guide would be finalized and disseminated.
Collapse
Affiliation(s)
- Daniel Mietchen
- University of Virginia, Charlottesville, United States of America
| | - Lane Rasberry
- University of Virginia, Charlottesville, United States of America
| | - Thais Morata
- National Institute for Occupational Safety and Health, Cincinnati, United States of America
- Cochrane Work, Amsterdam, Netherlands
| | - John P Sadowski
- National Institute for Occupational Safety and Health, Washington, United States of America
| | - Jeanette Novakovich
- National Institute for Occupational Safety and Health, Cincinnati, United States of America
| | | |
Collapse
|
39
|
COVID-19 and the social organization of knowledge in Wikipedia: a study of social representations. JOURNAL OF DOCUMENTATION 2021. [DOI: 10.1108/jd-01-2021-0006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
PurposeThe paper aims to present the development of conceptualization of coronavirus disease 2019 (COVID-19) based on associations with other articles on English edition of Wikipedia. The main goal of the paper is to study the social organization of knowledge about COVID-19 within the Wikipedia community of practice.Design/methodology/approachThe methodological approach taken in this study was based on the application of Moscovici's theory of social representations to Wikipedia's knowledge organization system (KOS). Internal links in the Wikipedia article about COVID-19 were considered anchors in its social representations. Each link in the introductory part of the article was considered an indicator of the semantic relationship between COVID-19 and other concepts from Wikipedia's knowledge base. The subject of this study was links extracted from all revisions of the COVID-19 article between February and September 2020. Qualitative and quantitative analyses were performed on these conceptual structures using both synchronic and diachronic approaches.FindingsIt was found that the evolution of anchors in the Wikipedia article on COVID-19 was in line with the mechanism of symbolic coping related to infectious disease. It went through stages of divergence, convergence and normalization. It shows that this mechanism governs the social organization of knowledge related to COVID-19 on Wikipedia.Originality/valueNo studies have been devoted to the image of COVID-19 as presented by the evolution of links in Wikipedia and its implications for knowledge organization (KO).
Collapse
|
40
|
Tejada-Llacsa PJ, Villacorta-Landeo P, Aguilar-Buitrón E, Alarcón GS, Ugarte-Gil MF. Interest on the internet for systemic lupus erythematosus: Analysis of Google Trends in Latin American countries. Lupus 2021; 30:1342-1346. [PMID: 33874814 DOI: 10.1177/09612033211010337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND/OBJECTIVE Information available on the internet about Systemic Lupus Erythematosus (SLE) can influence the doctor-patient relationship. Therefore, the aim of this study was to identify the terms used for SLE on the internet. METHODS We analyzed the data downloaded from Google Trends, considering the term "Lupus" in a six-year web-based research. The frequency of the terms for each Pan-American country was obtained automatically from Google Trends, which reports relative search volumes or RSV (on a scale from 0 to 100) across regions. RESULTS We obtained a total of 67 registered terms in 18 countries. The terms were distributed into five categories. The categories with interest in all countries were "definition" and "symptoms". CONCLUSIONS Google Trends allows us to find useful information about SLE on the internet; once the accuracy of this information is validated, it can be used by patients, health institutions, rheumatologists and other health professionals.
Collapse
Affiliation(s)
- Paul J Tejada-Llacsa
- Servicio de Reumatología, Hospital Nacional Guillermo Almenara Irigoyen, EsSalud, Lima, Perú.,Facultad de Medicina, Universidad Nacional Mayor de San Marcos, Lima, Perú
| | - Pamela Villacorta-Landeo
- Facultad de Medicina, Universidad Nacional Mayor de San Marcos, Lima, Perú.,Asociación para el Desarrollo de la Investigación Estudiantil en Ciencias de la Salud (ADIECS), Lima, Perú
| | - Eder Aguilar-Buitrón
- Facultad de Medicina, Universidad Nacional Mayor de San Marcos, Lima, Perú.,Asociación para el Desarrollo de la Investigación Estudiantil en Ciencias de la Salud (ADIECS), Lima, Perú
| | - Graciela S Alarcón
- School of Medicine, The University of Alabama, Birmingham, AL, USA.,Universidad Peruana Cayetano Heredia, Lima, Perú
| | - Manuel F Ugarte-Gil
- Servicio de Reumatología, Hospital Nacional Guillermo Almenara Irigoyen, EsSalud, Lima, Perú.,Escuela de Medicina Humana, Universidad Científica del Sur, Lima, Perú
| |
Collapse
|
41
|
Singh H, West R, Colavizza G. Wikipedia citations: A comprehensive data set of citations with
identifiers extracted from English Wikipedia. QUANTITATIVE SCIENCE STUDIES 2021. [DOI: 10.1162/qss_a_00105] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
Abstract
Wikipedia’s content is based on reliable and published sources. To this date, relatively little is known about what sources Wikipedia relies on, in part because extracting citations and identifying cited sources is challenging. To close this gap, we release Wikipedia Citations, a comprehensive data set of citations extracted from Wikipedia. We extracted29.3 million citations from 6.1 million English Wikipedia articles as of May 2020, and classified as being books, journal articles, or Web content. We were thus able to extract 4.0 million citations to scholarly publications with known identifiers—including DOI, PMC, PMID, and ISBN—and further equip an extra 261 thousand citations with DOIs from Crossref. As a result, we find that 6.7% of Wikipedia articles cite at least one journal article with an associated DOI, and that Wikipedia cites just 2% of all articles with a DOI currently indexed in the Web of Science. We release our code to allow the community to extend upon our work and update the data set in the future.
Collapse
|
42
|
Gianfredi V, Santangelo OE, Provenzano S. Correlation between flu and Wikipedia's pages visualization. ACTA BIO-MEDICA : ATENEI PARMENSIS 2021; 92:e2021056. [PMID: 33682825 PMCID: PMC7975939 DOI: 10.23750/abm.v92i1.9790] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Download PDF] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Accepted: 12/10/2020] [Indexed: 12/17/2022]
Abstract
Introduction: This study aimed to assess if the frequency of the Italian general public searches for influenza, using the Wikipedia web-page, are aligned with Istituto Superiore di Sanità (ISS) influenza cases. Materials and Methods: The reported cases of flu were selected from October 2015 to May 2019. Wikipedia Trends was used to assess how many times a specific page was read by users; data were extracted as daily data and aggregated on a weekly basis. The following data were extracted: number of weekly views by users from the October 2015 to May 2019 of the pages: Influenza, Febbre and Tosse (Flu, Fever and Cough, in English). Cross-correlation results are obtained as product-moment correlations between the two times series. Results: Regarding the database with weekly data, temporal correlation was observed between the bulletin of ISS and Wikipedia search trends. The strongest correlation was at a lag of 0 for number of cases and Flu (r=0.7571), Fever and Cough (r=0.7501). The strongest correlation was at a lag of -1 for Fever and Cough (r=0.7501). The strongest correlation was at a lag of 1 for number of cases and Flu (r=0.7559), Fever and Cough (r=0.7501). Conclusions: A possible future application for programming and management interventions of Public Health is proposed.
Collapse
|
43
|
Sajjadi NB, Feldman K, Shepard S, Reddy AK, Torgerson T, Hartwell M, Vassar M. Public Interest and Behavior Change in the United States Regarding Colorectal Cancer Following the Death of Chadwick Boseman: Infodemiology Investigation of Internet Search Trends Nationally and in At-Risk Areas. JMIR INFODEMIOLOGY 2021; 1:e29387. [PMID: 37114199 PMCID: PMC10014084 DOI: 10.2196/29387] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/05/2021] [Revised: 06/29/2021] [Accepted: 08/09/2021] [Indexed: 04/29/2023]
Abstract
Background Colorectal cancer (CRC) has the third highest cancer mortality rate in the United States. Enhanced screening has reduced mortality rates; however, certain populations remain at high risk, notably African Americans. Raising awareness among at-risk populations may lead to improved CRC outcomes. The influence of celebrity death and illness is an important driver of public awareness. As such, the death of actor Chadwick Boseman from CRC may have influenced CRC awareness. Objective We sought to assess the influence of Chadwick Boseman's death on public interest in CRC in the United States, evidenced by internet searches, website traffic, and donations to prominent cancer organizations. Methods We used an auto-regressive integrated moving average model to forecast Google searching trends for the topic "Colorectal cancer" in the United States. We performed bivariate and multivariable regressions on state-wise CRC incidence rate and percent Black population. We obtained data from the American Cancer Society (ACS) and the Colon Cancer Foundation (CCF) for information regarding changes in website traffic and donations. Results The expected national relative search volume (RSV) for colorectal cancer was 2.71 (95% CI 1.76-3.66), reflecting a 3590% (95% CI 2632%-5582%) increase compared to the expected values. With multivariable regression, the statewise RSV increased for each percent Black population by 1.09 (SE 0.18, P<.001), with 42% of the variance explained (P<.001). The American Cancer Society reported a 58,000% increase in CRC-related website traffic the weekend following Chadwick Boseman's death compared to the weekend before. The Colon Cancer Foundation reported a 331% increase in donations and a 144% increase in revenue in the month following Boseman's death compared to the month prior. Conclusions Our results suggest that Chadwick Boseman's death was associated with substantial increases in awareness of CRC. Increased awareness of CRC may support earlier detection and better prognoses.
Collapse
Affiliation(s)
- Nicholas B Sajjadi
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| | - Kaylea Feldman
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| | - Samuel Shepard
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| | - Arjun K Reddy
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| | - Trevor Torgerson
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| | - Micah Hartwell
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
- Department of Psychiatry and Behavioral Sciences College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| | - Matt Vassar
- Office of Medical Student Research College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
- Department of Psychiatry and Behavioral Sciences College of Osteopathic Medicine Oklahoma State University Center for Health Sciences Tulsa, OK United States
| |
Collapse
|
44
|
Maggio LA, Willinsky JM, Costello JA, Skinner NA, Martin PC, Dawson JE. Integrating Wikipedia editing into health professions education: a curricular inventory and review of the literature. PERSPECTIVES ON MEDICAL EDUCATION 2020; 9:333-342. [PMID: 33030643 PMCID: PMC7718341 DOI: 10.1007/s40037-020-00620-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 09/12/2020] [Accepted: 09/15/2020] [Indexed: 06/11/2023]
Abstract
INTRODUCTION Wikipedia is an online encyclopedia read by millions seeking medical information. To provide health professions students with skills to critically assess, edit, and improve Wikipedia's medical content, a skillset aligned with evidence-based medicine (EBM), Wikipedia courses have been integrated into health professions schools' curriculum. This literature review and curricular inventory of Wikipedia educational initiatives provides an overview of current approaches and identifies directions for future initiatives and research. METHODS Five databases were searched for articles describing educational interventions to train health professional students to edit Wikipedia. Course dashboards, maintained by Wiki Education (Wiki Edu), were searched for curricular materials. From these sources, key details were extracted and synthesized, including student and instructor type, course content, educational methods, and student outcomes. RESULTS Six articles and 27 dashboards reported courses offered between 2015 and 2019. Courses were predominantly offered to medical and nursing students. Instructors delivered content via videos, live lectures, and online interactive modules. Course content included logistics of Wikipedia editing, EBM skills, and health literacy. All courses included assignments requiring students to edit Wikipedia independently or in groups. Limited details on assessment of student learning were available. DISCUSSION A small but growing number of schools are training health professions education students to improve Wikipedia's medical content. Course details are available on Wiki Edu dashboards and, to a lesser extent, in peer-reviewed publications. While more needs to be done in conducting and sharing assessment of student learning, integrating Wikipedia into health professions education has potential to facilitate learning of EBM and communication skills, improve Wikipedia's online content, and engage students with an autonomous environment while learning. Future considerations should include a thorough assessment of student learning and practices, a final review of student edits to ensure they follow Wikipedia's guidelines and are written in clear language, and improved sharing of teaching resources by instructors.
Collapse
Affiliation(s)
- Lauren A Maggio
- Department of Medicine, Uniformed Services University of the Health Sciences, Bethesda, MD, USA.
| | - John M Willinsky
- Graduate School of Education, Stanford University, Stanford University, Stanford, CA, USA
| | - Joseph A Costello
- Uniformed Services University of the Health Sciences in Bethesda, Bethesda, MD, USA
| | - Nadine A Skinner
- Graduate School of Education, Stanford University, Stanford University, Stanford, CA, USA
| | - Paolo C Martin
- Graduate School of Education, Stanford University, Stanford University, Stanford, CA, USA
| | - Jennifer E Dawson
- CHEO Research Institute, and the Wikipedian in Residence for Cochrane, Ottawa, Ontario, Canada
| |
Collapse
|
45
|
Abstract
Wikipedia is one of the main sources of free knowledge on the Web. During the first few months of the pandemic, over 5,200 new Wikipedia pages on COVID-19 were created, accumulating over 400 million page views by mid-June 2020. 1 At the same time, an unprecedented amount of scientific articles on COVID-19 and the ongoing pandemic have been published online. Wikipedia’s content is based on reliable sources, such as scientific literature. Given its public function, it is crucial for Wikipedia to rely on representative and reliable scientific results, especially in a time of crisis. We assess the coverage of COVID-19-related research in Wikipedia via citations to a corpus of over 160,000 articles. We find that Wikipedia editors are integrating new research at a fast pace, and have cited close to 2% of the COVID-19 literature under consideration. While doing so, they are able to provide a representative coverage of COVID-19-related research. We show that all the main topics discussed in this literature are proportionally represented from Wikipedia, after accounting for article-level effects. We further use regression analyses to model citations from Wikipedia and show that Wikipedia editors on average rely on literature that is highly cited, widely shared on social media, and peer-reviewed.
Collapse
|
46
|
Yu L, Yu S. Developing an automated mechanism to identify medical articles from wikipedia for knowledge extraction. Int J Med Inform 2020; 141:104234. [PMID: 32693245 PMCID: PMC7357526 DOI: 10.1016/j.ijmedinf.2020.104234] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2020] [Revised: 07/01/2020] [Accepted: 07/11/2020] [Indexed: 11/25/2022]
Abstract
Wikipedia contains rich biomedical information that can support medical informatics studies and applications. Identifying the subset of medical articles of Wikipedia has many benefits, such as facilitating medical knowledge extraction, serving as a corpus for language modeling, or simply making the size of data easy to work with. However, due to the extremely low prevalence of medical articles in the entire Wikipedia, articles identified by generic text classifiers would be bloated by irrelevant pages. To control the false discovery rate while maintaining a high recall, we developed a mechanism that leverages the rich page elements and the connected nature of Wikipedia and uses a crawling classification strategy to achieve accurate classification. Structured assertional knowledge in Infoboxes and Wikidata items associated with the identified medical articles were also extracted. This automatic mechanism is aimed to run periodically to update the results and share them with the informatics community.
Collapse
Affiliation(s)
- Lishan Yu
- Department of Mathematical Sciences, Tsinghua University, Beijing, China
| | - Sheng Yu
- Center for Statistical Science, Tsinghua University, Beijing, China; Department of Industrial Engineering, Tsinghua University, Beijing, China; Institute for Data Science, Tsinghua University, Beijing, China.
| |
Collapse
|
47
|
Kagan D, Moran-Gilad J, Fire M. Scientometric trends for coronaviruses and other emerging viral infections. Gigascience 2020; 9:giaa085. [PMID: 32803225 PMCID: PMC7429184 DOI: 10.1093/gigascience/giaa085] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2020] [Revised: 06/02/2020] [Accepted: 07/22/2020] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND COVID-19 is the most rapidly expanding coronavirus outbreak in the past 2 decades. To provide a swift response to a novel outbreak, prior knowledge from similar outbreaks is essential. RESULTS Here, we study the volume of research conducted on previous coronavirus outbreaks, specifically SARS and MERS, relative to other infectious diseases by analyzing >35 million articles from the past 20 years. Our results demonstrate that previous coronavirus outbreaks have been understudied compared with other viruses. We also show that the research volume of emerging infectious diseases is very high after an outbreak and decreases drastically upon the containment of the disease. This can yield inadequate research and limited investment in gaining a full understanding of novel coronavirus management and prevention. CONCLUSIONS Independent of the outcome of the current COVID-19 outbreak, we believe that measures should be taken to encourage sustained research in the field.
Collapse
Affiliation(s)
- Dima Kagan
- Department of Software and Information Systems Engineering, Ben-Gurion University of the Negev, P.O.B 653, 8410501, Beersheba, Israel
| | - Jacob Moran-Gilad
- Department of Health Systems Management, Faculty of Health Sciences, Ben-Gurion University of the Negev, P.O.B 653, 8410501, Beersheba, Israel
| | - Michael Fire
- Department of Software and Information Systems Engineering, Ben-Gurion University of the Negev, P.O.B 653, 8410501, Beersheba, Israel
| |
Collapse
|
48
|
Kantarovich D, Vollbrecht HB, Cruz SA, Castillo H, Lee CS, Kushner J, Leng JX, Morgan VK, Hellman KM. Wikipedia: A Medical Student Educational Project to Edit Wikipedia in Preparation for Practicing Evidence-Based Pain Medicine. JOURNAL OF MEDICAL EDUCATION AND CURRICULAR DEVELOPMENT 2020; 7:2382120520959691. [PMID: 33015367 PMCID: PMC7513391 DOI: 10.1177/2382120520959691] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 08/24/2020] [Indexed: 06/11/2023]
Abstract
OBJECTIVE Wikipedia is commonly used to acquire information about various medical conditions such as chronic pain. Ideally, better online pain management content could reduce the burden of opioid use disorders. Our goal was to improve the quality of the content available on Wikipedia to make it more accurate and applicable to medical students and the general public while training medical students to practice evidence-based medicine and critically assess their sources of information. METHODS An elective class in Neuroscience, Pain, and Opioids composed of 10 medical students met biweekly to discuss landmark and practice-changing research articles in the fields of acute pain, chronic pain, and opioid management. The professor chose Wikipedia articles relevant to this course. Three independent viewers analyzed the quality of citations, anecdotal medical content, and content value for both patients and medical professionals. As part of their coursework, students then edited the Wikipedia articles. RESULTS Although some of the Wikipedia pain topic content (6.7% ± 2.0) was anecdotal, financially biased, or inconsistent with Western Medical Practice content, overall articles included primarily high-quality citations (85.6% ± 3.1). On a 0-5 Likert scale, students felt content would be moderately helpful for both medical students/professionals (3.4 ± 0.2) and laypersons (3.5 ± 0.2). Editing and adding citations was feasible, but novel material was often reverted. CONCLUSION A significant amount of pain medicine content was relevant and amenable to student editing. Therefore, future use of this tactic could provide a unique opportunity to integrate evidence-based medicine into the medical curriculum and have a direct impact on the widely available medical information. Future refinement in the editorial process may also further improve online information.
Collapse
Affiliation(s)
- Diana Kantarovich
- Chicago Medical School, Rosalind
Franklin University, North Chicago, IL, USA
| | | | - Sebastian A Cruz
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
| | - Hector Castillo
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
| | - Cody S Lee
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
| | - Josef Kushner
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
| | - Jim X Leng
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
| | - Vince K Morgan
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
| | - Kevin M Hellman
- University of Chicago Pritzker School of
Medicine, Chicago, IL, USA
- NorthShore University HealthSystem
| |
Collapse
|