1
|
Cerqueira-Silva T, Oliveira JF, Oliveira VDA, Florentino PTV, Sironi A, Penna GO, Ramos PIP, Boaventura VS, Barral-Netto M, Marcilio I. Early warning system using primary health care data in the post-COVID-19 pandemic era: Brazil nationwide case-study. CAD SAUDE PUBLICA 2024; 40:e00010024. [PMID: 39775767 PMCID: PMC11654108 DOI: 10.1590/0102-311xen010024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Revised: 06/10/2024] [Accepted: 07/09/2024] [Indexed: 01/11/2025] Open
Abstract
Syndromic surveillance using primary health care (PHC) data is a valuable tool for early outbreak detection, as demonstrated by the potential to identify COVID-19 outbreaks. However, the potential of such an early warning system in the post-COVID-19 era remains largely unexplored. We analyzed PHC encounter counter of respiratory complaints registered in the database of the Brazilian Unified National Health System from October 2022 to July 2023. We applied EARS (variations C1/C2/C3) and EVI to estimate the weekly thresholds. An alarm was determined when the number of encounters exceeded the week-specific threshold. We used data on hospitalization due to respiratory disease to classify as anomalies the weeks in which the number of cases surpassed predetermined thresholds. We compared EARS and EVI efficacy in anticipating anomalies. A total of 119 anomalies were identified across 116 immediate regions during the study period. The EARS-C2 presented the highest early alarm rate, with 81/119 (68%) early alarms, and C1 the lowest, with 71 (60%) early alarms. The lowest true positivity was the EARS-C1 118/1,354 (8.7%) and the highest was EARS-C3 99/856 (11.6%). Routinely collected PHC data can be successfully used to detect respiratory disease outbreaks in Brazil. Syndromic surveillance enhances timeliness in surveillance strategies, albeit with lower specificity. A combined approach with other strategies is essential to strengthen accuracy, offering a proactive and effective public health response against future outbreaks.
Collapse
Affiliation(s)
| | | | | | | | - Alberto Sironi
- Instituto Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brasil
| | - Gerson O Penna
- Centro de Medicina Tropical, Universidade de Brasília, Brasília, Brasil
| | | | | | | | - Izabel Marcilio
- Instituto Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brasil
| |
Collapse
|
2
|
Giancotti M, Lopreite M, Mauro M, Puliga M. Innovating health prevention models in detecting infectious disease outbreaks through social media data: an umbrella review of the evidence. Front Public Health 2024; 12:1435724. [PMID: 39651472 PMCID: PMC11621043 DOI: 10.3389/fpubh.2024.1435724] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Accepted: 11/05/2024] [Indexed: 12/11/2024] Open
Abstract
Introduction and objective The number of literature reviews examining the use of social media in detecting emerging infectious diseases has recently experienced an unprecedented growth. Yet, a higher-level integration of the evidence is still lacking. This study aimed to synthesize existing systematic literature reviews published on this topic, offering an overview that can help policymakers and public health authorities to select appropriate policies and guidelines. Methods We conducted an umbrella review: a review of systematic reviews published between 2011 and 2023 following the PRISMA statement guidelines. The review protocol was registered in the PROSPERO database (CRD42021254568). As part of the search strategy, three database searches were conducted, specifically in PubMed, Web of Science, and Google Scholar. The quality of the included reviews was determined using A Measurement Tool to Assess Systematic Reviews 2. Results Synthesis included 32 systematic reviews and 3,704 primary studies that investigated how the social media listening could improve the healthcare system's efficiency in terms of a timely response to treat epidemic situations. Most of the included systematic reviews concluded showing positive outcomes when using social media data for infectious disease surveillance. Conclusion Systematic reviews showed the important role of social media in predicting and detecting disease outbreaks, potentially reducing morbidity and mortality through swift public health action. The policy interventions strongly benefit from the continued use of online data in public health surveillance systems because they can help in recognizing important patterns for disease surveillance and significantly improve the disease prediction abilities of the traditional surveillance systems. Systematic Review Registration http://www.crd.york.ac.uk/PROSPERO, identifier [CRD42021254568].
Collapse
Affiliation(s)
- Monica Giancotti
- Department of Law, Economics and Social Sciences, Magna Graecia University, Catanzaro, Italy
| | - Milena Lopreite
- Department of Economics, Statistics and Finance, University of Calabria, Cosenza, Italy
| | - Marianna Mauro
- Department of Clinical and Experimental Medicine, Magna Graecia University, Catanzaro, Italy
| | | |
Collapse
|
3
|
Ravaut M, Zhao R, Phung D, Qin VM, Milovanovic D, Pienkowska A, Bojic I, Car J, Joty S. Targeting COVID-19 and Human Resources for Health News Information Extraction: Algorithm Development and Validation. JMIR AI 2024; 3:e55059. [PMID: 39475833 PMCID: PMC11561429 DOI: 10.2196/55059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 03/17/2024] [Accepted: 07/10/2024] [Indexed: 11/17/2024]
Abstract
BACKGROUND Global pandemics like COVID-19 put a high amount of strain on health care systems and health workers worldwide. These crises generate a vast amount of news information published online across the globe. This extensive corpus of articles has the potential to provide valuable insights into the nature of ongoing events and guide interventions and policies. However, the sheer volume of information is beyond the capacity of human experts to process and analyze effectively. OBJECTIVE The aim of this study was to explore how natural language processing (NLP) can be leveraged to build a system that allows for quick analysis of a high volume of news articles. Along with this, the objective was to create a workflow comprising human-computer symbiosis to derive valuable insights to support health workforce strategic policy dialogue, advocacy, and decision-making. METHODS We conducted a review of open-source news coverage from January 2020 to June 2022 on COVID-19 and its impacts on the health workforce from the World Health Organization (WHO) Epidemic Intelligence from Open Sources (EIOS) by synergizing NLP models, including classification and extractive summarization, and human-generated analyses. Our DeepCovid system was trained on 2.8 million news articles in English from more than 3000 internet sources across hundreds of jurisdictions. RESULTS Rules-based classification with hand-designed rules narrowed the data set to 8508 articles with high relevancy confirmed in the human-led evaluation. DeepCovid's automated information targeting component reached a very strong binary classification performance of 98.98 for the area under the receiver operating characteristic curve (ROC-AUC) and 47.21 for the area under the precision recall curve (PR-AUC). Its information extraction component attained good performance in automatic extractive summarization with a mean Recall-Oriented Understudy for Gisting Evaluation (ROUGE) score of 47.76. DeepCovid's final summaries were used by human experts to write reports on the COVID-19 pandemic. CONCLUSIONS It is feasible to synergize high-performing NLP models and human-generated analyses to benefit open-source health workforce intelligence. The DeepCovid approach can contribute to an agile and timely global view, providing complementary information to scientific literature.
Collapse
Affiliation(s)
| | - Ruochen Zhao
- Nanyang Technological University, Singapore, Singapore
| | - Duy Phung
- Nanyang Technological University, Singapore, Singapore
| | | | | | | | - Iva Bojic
- Nanyang Technological University, Singapore, Singapore
| | - Josip Car
- King's College London, London, United Kingdom
| | - Shafiq Joty
- Nanyang Technological University, Singapore, Singapore
- Salesforce Research, San Francisco, CA, United States
| |
Collapse
|
4
|
Wynn M. Online spaces and the control of communicable diseases: implications for nursing practice. Nurs Stand 2024; 39:39-44. [PMID: 38369909 DOI: 10.7748/ns.2024.e12174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/04/2023] [Indexed: 02/20/2024]
Abstract
The digital revolution has significantly altered healthcare, including communicable disease control, with online spaces emerging as vital tools in preventing, identifying and controlling the spread of diseases. However, healthcare professionals, including nurses, need to find a balance between harnessing the benefits of mass communication and mitigating the potentially harmful effects of online misinformation. This article explores the benefits and challenges of using online spaces such as social media platforms in the control of communicable diseases and discusses the potential use of telehealth in reducing the risk of healthcare-associated infection and antimicrobial resistance. The author also describes a framework that nurses can use to explore potential roles and practice in the context of communicable disease control in online spaces.
Collapse
|
5
|
Deiner MS, Deiner NA, Hristidis V, McLeod SD, Doan T, Lietman TM, Porco TC. Use of Large Language Models to Assess the Likelihood of Epidemics From the Content of Tweets: Infodemiology Study. J Med Internet Res 2024; 26:e49139. [PMID: 38427404 PMCID: PMC10943433 DOI: 10.2196/49139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 12/20/2023] [Accepted: 01/19/2024] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Previous work suggests that Google searches could be useful in identifying conjunctivitis epidemics. Content-based assessment of social media content may provide additional value in serving as early indicators of conjunctivitis and other systemic infectious diseases. OBJECTIVE We investigated whether large language models, specifically GPT-3.5 and GPT-4 (OpenAI), can provide probabilistic assessments of whether social media posts about conjunctivitis could indicate a regional outbreak. METHODS A total of 12,194 conjunctivitis-related tweets were obtained using a targeted Boolean search in multiple languages from India, Guam (United States), Martinique (France), the Philippines, American Samoa (United States), Fiji, Costa Rica, Haiti, and the Bahamas, covering the time frame from January 1, 2012, to March 13, 2023. By providing these tweets via prompts to GPT-3.5 and GPT-4, we obtained probabilistic assessments that were validated by 2 human raters. We then calculated Pearson correlations of these time series with tweet volume and the occurrence of known outbreaks in these 9 locations, with time series bootstrap used to compute CIs. RESULTS Probabilistic assessments derived from GPT-3.5 showed correlations of 0.60 (95% CI 0.47-0.70) and 0.53 (95% CI 0.40-0.65) with the 2 human raters, with higher results for GPT-4. The weekly averages of GPT-3.5 probabilities showed substantial correlations with weekly tweet volume for 44% (4/9) of the countries, with correlations ranging from 0.10 (95% CI 0.0-0.29) to 0.53 (95% CI 0.39-0.89), with larger correlations for GPT-4. More modest correlations were found for correlation with known epidemics, with substantial correlation only in American Samoa (0.40, 95% CI 0.16-0.81). CONCLUSIONS These findings suggest that GPT prompting can efficiently assess the content of social media posts and indicate possible disease outbreaks to a degree of accuracy comparable to that of humans. Furthermore, we found that automated content analysis of tweets is related to tweet volume for conjunctivitis-related posts in some locations and to the occurrence of actual epidemics. Future work may improve the sensitivity and specificity of these methods for disease outbreak detection.
Collapse
Affiliation(s)
- Michael S Deiner
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
| | - Natalie A Deiner
- College of Letters and Science, University of California, Santa Barbara, Santa Barbara, CA, United States
| | - Vagelis Hristidis
- Department of Computer Science and Engineering, University of California, Riverside, Riverside, CA, United States
| | - Stephen D McLeod
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- American Academy of Ophthalmology, San Francisco, CA, United States
| | - Thuy Doan
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
| | - Thomas M Lietman
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
| | - Travis C Porco
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
| |
Collapse
|
6
|
Stefanis C, Giorgi E, Kalentzis K, Tselemponis A, Nena E, Tsigalou C, Kontogiorgis C, Kourkoutas Y, Chatzak E, Dokas I, Constantinidis T, Bezirtzoglou E. Sentiment analysis of epidemiological surveillance reports on COVID-19 in Greece using machine learning models. Front Public Health 2023; 11:1191730. [PMID: 37533519 PMCID: PMC10392838 DOI: 10.3389/fpubh.2023.1191730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 06/30/2023] [Indexed: 08/04/2023] Open
Abstract
The present research deals with sentiment analysis performed with Microsoft Azure Machine Learning Studio to classify Facebook posts on the Greek National Public Health Organization (EODY) from November 2021 to January 2022 during the pandemic. Positive, negative and neutral sentiments were included after processing 300 reviews. This approach involved analyzing the words appearing in the comments and exploring the sentiments related to daily surveillance reports of COVID-19 published on the EODY Facebook page. Moreover, machine learning algorithms were implemented to predict the classification of sentiments. This research assesses the efficiency of a few popular machine learning models, which is one of the initial efforts in Greece in this domain. People have negative sentiments toward COVID surveillance reports. Words with the highest frequency of occurrence include government, vaccinated people, unvaccinated, telephone communication, health measures, virus, COVID-19 rapid/molecular tests, and of course, COVID-19. The experimental results disclose additionally that two classifiers, namely two class Neural Network and two class Bayes Point Machine, achieved high sentiment analysis accuracy and F1 score, particularly 87% and over 35%. A significant limitation of this study may be the need for more comparison with other research attempts that identified the sentiments of the EODY surveillance reports of COVID in Greece. Machine learning models can provide critical information combating public health hazards and enrich communication strategies and proactive actions in public health issues and opinion management during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Christos Stefanis
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| | - Elpida Giorgi
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| | - Konstantinos Kalentzis
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| | - Athanasios Tselemponis
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| | - Evangelia Nena
- Pre-Clinical Education, Laboratory of Social Medicine, Medical School, Democritus University of Thrace, Alexandroupolis, Greece
| | - Christina Tsigalou
- Laboratory of Microbiology, Medical School, Democritus University of Thrace, Alexandroupolis, Greece
| | - Christos Kontogiorgis
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| | - Yiannis Kourkoutas
- Laboratory of Applied Microbiology, Department of Molecular Biology and Genetics, Democritus University of Thrace, Alexandroupolis, Greece
| | - Ekaterini Chatzak
- Laboratory of Pharmacology, Medical School, Democritus University of Thrace, Alexandroupolis, Greece
| | - Ioannis Dokas
- Department of Civil Engineering, Democritus University of Thrace, Komotini, Greece
| | - Theodoros Constantinidis
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| | - Eugenia Bezirtzoglou
- Laboratory of Hygiene and Environmental Protection, Department of Medicine, Democritus University of Thrace, Alexandroupolis, Greece
| |
Collapse
|