1
|
Porto BM, Fogliatto FS. Enhanced forecasting of emergency department patient arrivals using feature engineering approach and machine learning. BMC Med Inform Decis Mak 2024; 24:377. [PMID: 39696224 DOI: 10.1186/s12911-024-02788-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 11/26/2024] [Indexed: 12/20/2024] Open
Abstract
BACKGROUND Emergency department (ED) overcrowding is an important problem in many countries. Accurate predictions of ED patient arrivals can help management to better allocate staff and medical resources. In this study, we investigate the use of calendar and meteorological predictors, as well as feature-engineered variables, to predict daily patient arrivals using datasets from eleven different EDs across three countries. METHODS Six machine learning (ML) algorithms were tested on forecasting horizons of 7 and 45 days. Three of them - Light Gradient Boosting Machine (LightGBM), Support Vector Machine with Radial Basis Function (SVM-RBF), and Neural Network Autoregression (NNAR) - were never before reported for predicting ED patient arrivals. Algorithms' hyperparameters were tuned through a grid-search with cross-validation. Prediction performance was assessed using fivefold cross-validation and four performance metrics. RESULTS The eXtreme Gradient Boosting (XGBoost) was the best-performing model on both prediction horizons, also outperforming results reported in past studies on ED arrival prediction. XGBoost and NNAR achieved the best performance in nine out of the eleven analyzed datasets, with MAPE values ranging from 5.03% to 14.1%. Feature engineering (FE) improved the performance of the ML algorithms. CONCLUSION Accuracy in predicting ED arrivals, achieved through the FE approach, is key for managing human and material resources, as well as reducing patient waiting times and lengths of stay.
Collapse
Affiliation(s)
- Bruno Matos Porto
- Industrial Engineering Department, Federal University of Rio Grande do Sul, Av. Osvaldo Aranha, 99, 5th floor, Porto Alegre, RS, 90020-035, Brazil.
- Industrial Engineering Department, Federal University of Rio Grande do Sul, Av. Osvaldo Aranha, 99, 5th floor, Porto Alegre, 90035-190, Brazil.
| | - Flavio Sanson Fogliatto
- Industrial Engineering Department, Federal University of Rio Grande do Sul, Av. Osvaldo Aranha, 99, 5th floor, Porto Alegre, RS, 90020-035, Brazil
- Industrial Engineering Department, Federal University of Rio Grande do Sul, Av. Osvaldo Aranha, 99, 5th floor, Porto Alegre, 90035-190, Brazil
| |
Collapse
|
2
|
Silva E, Pereira MF, Vieira JT, Ferreira-Coimbra J, Henriques M, Rodrigues NF. Predicting hospital emergency department visits accurately: A systematic review. Int J Health Plann Manage 2023. [PMID: 36898975 DOI: 10.1002/hpm.3629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 09/28/2022] [Accepted: 02/04/2023] [Indexed: 03/12/2023] Open
Abstract
OBJECTIVES The emergency department (ED) is a very important healthcare entrance point, known for its challenging organisation and management due to demand unpredictability. An accurate forecast system of ED visits is crucial to the implementation of better management strategies that optimise resources utilization, reduce costs and improve public confidence. The aim of this review is to investigate the different factors that affect the ED visits forecasting outcomes, in particular the predictive variables and type of models applied. METHODS A systematic search was conducted in PubMed, Web of Science and Scopus. The review methodology followed the PRISMA statement guidelines. RESULTS Seven studies were selected, all exploring predictive models to forecast ED daily visits for general care. MAPE and RMAE were used to measure models' accuracy. All models displayed good accuracy, with errors below 10%. CONCLUSIONS Model selection and accuracy was found to be particularly sensitive to the ED dimension. While ARIMA-based and other linear models have good performance for short-time forecast, some machine learning methods proved to be more stable when forecasting multiple horizons. The inclusion of exogenous variables was found to be advantageous only in bigger EDs.
Collapse
Affiliation(s)
| | | | | | | | - Mariana Henriques
- Centre of Biological Engineering, University of Minho, Braga, Portugal
| | - Nuno F Rodrigues
- INESC TEC, Porto, Portugal.,Algoritmi Research Center, University of Minho, Braga, Portugal.,2Ai - School of Technology, IPCA, Barcelos, Portugal
| |
Collapse
|
3
|
Hosseinzadeh S, Ketabi S, Atighehchian A, Nazari R. Hospital bed capacity management during the COVID-19 outbreak using system dynamics: A case study in Amol public hospitals, Iran. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2022. [DOI: 10.1080/20479700.2022.2149083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
| | - Saeedeh Ketabi
- Department of Management, University of Isfahan, Isfahan, Iran
| | - Arezoo Atighehchian
- Department of Industrial Engineering and Futures Studies, Faculty of Engineering, University of Isfahan, Isfahan, Iran
| | - Roghieh Nazari
- Department of nursing, Amol Faculty of Nursing and Midwifery, Mazandaran University of Medical Sciences, Sari, Iran
| |
Collapse
|
4
|
Mitra A, Jain A, Kishore A, Kumar P. A Comparative Study of Demand Forecasting Models for a Multi-Channel Retail Company: A Novel Hybrid Machine Learning Approach. OPERATIONS RESEARCH FORUM 2022. [PMCID: PMC9514716 DOI: 10.1007/s43069-022-00166-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Demand forecasting has been a major concern of operational strategy to manage the inventory and optimize the customer satisfaction level. The researchers have proposed many conventional and advanced forecasting techniques, but no one leads to complete accuracy. Forecasting is equally important in manufacturing as well as retail companies. In this study, the performances of five regression techniques of machine learning, viz. random forest (RF), extreme gradient boosting (XGBoost), gradient boosting, adaptive boosting (AdaBoost), and artificial neural network (ANN) algorithms, are compared with a proposed hybrid (RF-XGBoost-LR) model for sales forecasting of a retail chain considering the various parameters of forecasting accuracy. The weekly sales data of a US-based retail company is considered in the analysis of the forecasts undertaking the attributes affecting the sale such as the temperature of the region and the size of the store. It is observed that the hybrid RF-XGBoost-LR outperformed the other models measured against various metrics of performance. This study may help the industry decision-maker to understand and improve the methods of forecasting.
Collapse
Affiliation(s)
- Arnab Mitra
- Department of Mechanical Engineering, Delhi Technological University, Delhi, 110042 India
| | - Arnav Jain
- Department of Mechanical Engineering, Delhi Technological University, Delhi, 110042 India
| | - Avinash Kishore
- Department of Mechanical Engineering, Delhi Technological University, Delhi, 110042 India
| | - Pravin Kumar
- Department of Mechanical Engineering, Delhi Technological University, Delhi, 110042 India
| |
Collapse
|
5
|
Predicting Emergency Department Utilization among Older Hong Kong Population in Hot Season: A Machine Learning Approach. INFORMATION 2022. [DOI: 10.3390/info13090410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Previous evidence suggests that temperature is associated with the number of emergency department (ED) visits. A predictive system for ED visits, which takes local temperature into account, is therefore needed. This study aimed to compare the predictive performance of various machine learning methods with traditional statistical methods based on temperature variables and develop a daily ED attendance rate predictive model for Hong Kong. We analyzed ED utilization among Hong Kong older adults in May to September from 2000 to 2016. A total of 103 potential predictors were derived from 1- to 14-day lag of ED attendance rate and meteorological and air quality indicators and 0-day lag of holiday indicator and month and day of week indicators. LASSO regression was used to identify the most predictive temperature variables. Decision tree regressor, support vector machine (SVM) regressor, and random forest regressor were trained on the selected optimal predictor combination. Deep neural network (DNN) and gated recurrent unit (GRU) models were performed on the extended predictor combination for the previous 14-day horizon. Maximum ambient temperature was identified as a better predictor in its own value than as an indicator defined by the cutoff. GRU achieved the best predictive accuracy. Deep learning methods, especially the GRU model, outperformed conventional machine learning methods and traditional statistical methods.
Collapse
|
6
|
Ataman MG, Sarıyer G. Mode of Arrival Aware Models for Forecasting Flow of Patient and Length of Stay in Emergency Departments. EURASIAN JOURNAL OF EMERGENCY MEDICINE 2022. [DOI: 10.4274/eajem.galenos.2021.27676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
|
7
|
Reece K, Avansino J, Brumm M, Martin L, Day TE. Determining future capacity for an Ambulatory Surgical Center with discrete event simulation. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2021. [DOI: 10.1080/20479700.2020.1720940] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Affiliation(s)
- Kayla Reece
- Ambulatory Surgery Center, Seattle Children’s Hospital, Seattle, WA, USA
| | - Jeff Avansino
- Surgical Services, Seattle Children’s Hospital, Seattle, WA, USA
| | - Maria Brumm
- Clinical Analytics, Seattle Children’s Hospital, Seattle, WA, USA
| | - Lynn Martin
- Ambulatory Surgery Center, Seattle Children’s Hospital, Seattle, WA, USA
| | | |
Collapse
|
8
|
Zhang L, Jing D, Lu Q, Shen S. NO 2 exposure increases eczema outpatient visits in Guangzhou, China: an indication for hospital management. BMC Public Health 2021; 21:506. [PMID: 33722221 PMCID: PMC7962398 DOI: 10.1186/s12889-021-10549-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Accepted: 02/26/2021] [Indexed: 12/15/2022] Open
Abstract
Background Ambient nitrogen dioxide (NO2) is a common air pollutant in developing countries and causes skin conditions, but its effect on eczema in subtropical areas is not clear in China. Object To measure the effect of short-term exposure of NO2 on the incidence of eczema and the change of outpatient visits. Methods Data of daily temperature, air pollutants, and outpatient visits from 2013 to 2018 were collected in a row. The generalized additive model (GAM) and Poisson distribution were used to assess the association between short-term exposure of NO2 and the outpatient visits of patients with eczema. The cumulative exposure effect of lag 0–3 days and the displacement effect of NO2 and other pollutants were considered as well. A single pollutant model was used to examine the independent association, and a two-pollutant model was adopted to control the confounding effect. Results The daily outpatient visits of eczema increased from 75.26 to 190.85 from 2013 to 2018 (P < 0.001). The combined influence of NO2 and the related pollutant exerted a stronger influence on the incidence of eczema. The maximum effect of NO2 appeared on the exposed day. (lag 0) and disappeared on day 4 (lag 3). The children and seniors were more vulnerable to NO2 exposure. Conclusion Exposure to NO2 is tightly associated with eczema incidence and outpatient visits. The hospitals should react to the visit fluctuations and adjust physician duty shifts to improve outpatient service efficiency. Supplementary Information The online version contains supplementary material available at 10.1186/s12889-021-10549-7.
Collapse
Affiliation(s)
- Luwen Zhang
- School of Health Services Management, Southern Medical University, Guangzhou, 510515, Guangdong, China
| | - Dian Jing
- Department of Biostatistics, School of Public Health, Southern Medical University, Guangzhou, China
| | - Qiaochu Lu
- School of Health Services Management, Southern Medical University, Guangzhou, 510515, Guangdong, China
| | - Shuqun Shen
- Dermatology Hospital, Southern Medical University, Guangzhou, 510000, China.
| |
Collapse
|
9
|
Jenkins D, Hannan A, Qureshi R, Dsouza LB, Thomas SH. Emergency department operations: Time to initial physician in a demographically partitioned emergency department. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2020. [DOI: 10.1080/20479700.2019.1603277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Dominic Jenkins
- Department of Emergency Medicine, Hamad General Hospital, Hamad Medical Corporation, Doha, Qatar
| | - Ashad Hannan
- Department of Emergency Medicine, Hamad General Hospital, Hamad Medical Corporation, Doha, Qatar
| | - Raheel Qureshi
- Department of Emergency Medicine, Hamad General Hospital, Hamad Medical Corporation, Doha, Qatar
| | - Landric Benjamin Dsouza
- Department of Emergency Medicine, Hamad General Hospital, Hamad Medical Corporation, Doha, Qatar
- Translational Institute, Hamad Medical Corporation, Doha, Qatar
| | - Stephen Hodges Thomas
- Department of Emergency Medicine, Hamad General Hospital, Hamad Medical Corporation, Doha, Qatar
- Translational Institute, Hamad Medical Corporation, Doha, Qatar
- Department of Emergency Medicine, Weill Cornell Medical College in Qatar, Doha, Qatar
- Emergency Medicine Research, University of London, London, UK
| |
Collapse
|
10
|
Khalfaoui I, Hammouche A. Modelling and optimizing health emergency services: A regional study case. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2020. [DOI: 10.1080/20479700.2020.1801163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Affiliation(s)
- Ibtissam Khalfaoui
- Department of industry, Mohammadia School of Engineers, IMOSYS, Mohamed V, Rabat, Morocco
| | - Amar Hammouche
- Department of industry, Mohammadia School of Engineers, IMOSYS, Mohamed V, Rabat, Morocco
| |
Collapse
|
11
|
Apornak A, Raissi S, Keramati A, Khalili-Damghani K. Human resources optimization in hospital emergency using the genetic algorithm approach. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2020. [DOI: 10.1080/20479700.2020.1763236] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Arash Apornak
- Department of Industrial Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran
| | - Sadigh Raissi
- Department of Industrial Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran
| | - Abbas Keramati
- Department of Industrial Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran
- School of Industrial Engineering, Faculty of Engineering, University of Tehran and Information Technology Management Department, Ted Roger School of Management, Ryerson University, Toronto, Canada
| | - Kaveh Khalili-Damghani
- Department of Industrial Engineering, South Tehran Branch, Islamic Azad University, Tehran, Iran
| |
Collapse
|
12
|
Peng J, Chen C, Zhou M, Xie X, Zhou Y, Luo CH. Peak Outpatient and Emergency Department Visit Forecasting for Patients With Chronic Respiratory Diseases Using Machine Learning Methods: Retrospective Cohort Study. JMIR Med Inform 2020; 8:e13075. [PMID: 32224488 PMCID: PMC7154928 DOI: 10.2196/13075] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Revised: 10/22/2019] [Accepted: 02/22/2020] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND The overcrowding of hospital outpatient and emergency departments (OEDs) due to chronic respiratory diseases in certain weather or under certain environmental pollution conditions results in the degradation in quality of medical care, and even limits its availability. OBJECTIVE To help OED managers to schedule medical resource allocation during times of excessive health care demands after short-term fluctuations in air pollution and weather, we employed machine learning (ML) methods to predict the peak OED arrivals of patients with chronic respiratory diseases. METHODS In this paper, we first identified 13,218 visits from patients with chronic respiratory diseases to OEDs in hospitals from January 1, 2016, to December 31, 2017. Then, we divided the data into three datasets: weather-based visits, air quality-based visits, and weather air quality-based visits. Finally, we developed ML methods to predict the peak event (peak demand days) of patients with chronic respiratory diseases (eg, asthma, respiratory infection, and chronic obstructive pulmonary disease) visiting OEDs on the three weather data and environmental pollution datasets in Guangzhou, China. RESULTS The adaptive boosting-based neural networks, tree bag, and random forest achieved the biggest receiver operating characteristic area under the curve, 0.698, 0.714, and 0.809, on the air quality dataset, the weather dataset, and weather air quality dataset, respectively. Overall, random forests reached the best classification prediction performance. CONCLUSIONS The proposed ML methods may act as a useful tool to adapt medical services in advance by predicting the peak of OED arrivals. Further, the developed ML methods are generic enough to cope with similar medical scenarios, provided that the data is available.
Collapse
Affiliation(s)
- Junfeng Peng
- School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
| | - Chuan Chen
- School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
| | - Mi Zhou
- Surgical Intensive Care Unit, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xiaohua Xie
- School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
| | - Yuqi Zhou
- Department of Respiratory and Critical Care Medicine, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Ching-Hsing Luo
- School of Data and Computer Science, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
13
|
Ahmad MU, Zhang A, Mhaskar R. A predictive model for decreasing clinical no-show rates in a primary care setting. INTERNATIONAL JOURNAL OF HEALTHCARE MANAGEMENT 2019. [DOI: 10.1080/20479700.2019.1698864] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- M. Usman Ahmad
- Medical Education, University of South Florida (USF) Morsani College of Medicine (MCOM), Tampa, FL, USA
| | - Angie Zhang
- Medical Education, University of South Florida (USF) Morsani College of Medicine (MCOM), Tampa, FL, USA
| | | |
Collapse
|
14
|
Gul M, Celik E. An exhaustive review and analysis on applications of statistical forecasting in hospital emergency departments. Health Syst (Basingstoke) 2018; 9:263-284. [PMID: 33354320 PMCID: PMC7738299 DOI: 10.1080/20476965.2018.1547348] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2017] [Revised: 11/02/2018] [Accepted: 11/02/2018] [Indexed: 10/27/2022] Open
Abstract
Emergency departments (EDs) provide medical treatment for a broad spectrum of illnesses and injuries to patients who arrive at all hours of the day. The quality and efficient delivery of health care in EDs are associated with a number of factors, such as patient overall length of stay (LOS) and admission, prompt ambulance diversion, quick and accurate triage, nurse and physician assessment, diagnostic and laboratory services, consultations and treatment. One of the most important ways to plan the healthcare delivery efficiently is to make forecasts of ED processes. The aim this study is thus to provide an exhaustive review for ED stakeholders interested in applying forecasting methods to their ED processes. A categorisation, analysis and interpretation of 102 papers is performed for review. This exhaustive review provides an insight for researchers and practitioners about forecasting in EDs in terms of showing current state and potential areas for future attempts.
Collapse
Affiliation(s)
- Muhammet Gul
- Department of Industrial Engineering, Munzur University, Tunceli, Turkey
| | - Erkan Celik
- Department of Industrial Engineering, Munzur University, Tunceli, Turkey
| |
Collapse
|