1
|
A comparative study of supervised machine learning approaches to predict patient triage outcomes in hospital emergency departments. ARRAY 2023. [DOI: 10.1016/j.array.2023.100281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
|
2
|
Fernandes M, Mendes R, Vieira SM, Leite F, Palos C, Johnson A, Finkelstein S, Horng S, Celi LA. Risk of mortality and cardiopulmonary arrest in critical patients presenting to the emergency department using machine learning and natural language processing. PLoS One 2020; 15:e0230876. [PMID: 32240233 PMCID: PMC7117713 DOI: 10.1371/journal.pone.0230876] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2019] [Accepted: 03/10/2020] [Indexed: 12/23/2022] Open
Abstract
Emergency department triage is the first point in time when a patient's acuity level is determined. The time to assign a priority at triage is short and it is vital to accurately stratify patients at this stage, since under-triage can lead to increased morbidity, mortality and costs. Our aim was to present a model that can assist healthcare professionals in triage decision making, namely in the stratification of patients through the risk prediction of a composite critical outcome-mortality and cardiopulmonary arrest. Our study cohort consisted of 235826 adult patients triaged at a Portuguese Emergency Department from 2012 to 2016. Patients were assigned to emergent, very urgent or urgent priorities of the Manchester Triage System (MTS). Demographics, clinical variables routinely collected at triage and the patients' chief complaint were used. Logistic regression, random forests and extreme gradient boosting were developed using all available variables. The term frequency-inverse document frequency (TF-IDF) natural language processing weighting factor was applied to vectorize the chief complaint. Stratified random sampling was used to split the data into train (70%) and test (30%) data sets. Ten-fold cross validation was performed in train to optimize model hyper-parameters. The performance obtained with the best model was compared against the reference model-a regularized logistic regression trained using only triage priorities. Extreme gradient boosting exhibited good calibration properties and yielded areas under the receiver operating characteristic and precision-recall curves of 0.96 (95% CI 0.95-0.97) and 0.31 (95% CI 0.26-0.36), respectively. The predictors ranked with higher importance by this model were the Glasgow coma score, the patients' age, pulse oximetry and arrival mode. Compared to the reference, the extreme gradient boosting model using clinical variables and the chief complaint presented higher recall for patients assigned MTS-3 and can identify those who are at risk of the composite outcome.
Collapse
Affiliation(s)
- Marta Fernandes
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal
- * E-mail:
| | - Rúben Mendes
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal
| | - Susana M. Vieira
- IDMEC, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal
| | | | - Carlos Palos
- Hospital Beatriz Ângelo, Luz Saúde, Lisbon, Portugal
| | - Alistair Johnson
- MIT Critical Data, Laboratory for Computational Physiology, Harvard-MIT Health Sciences & Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| | - Stan Finkelstein
- Institute for Data, Systems and Society, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
| | - Steven Horng
- Department of Emergency Medicine / Division of Clinical Informatics / Center for Healthcare Delivery Science, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America
| | - Leo Anthony Celi
- MIT Critical Data, Laboratory for Computational Physiology, Harvard-MIT Health Sciences & Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
- Division of Pulmonary Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America
| |
Collapse
|
3
|
Fernandes M, Vieira SM, Leite F, Palos C, Finkelstein S, Sousa JM. Clinical Decision Support Systems for Triage in the Emergency Department using Intelligent Systems: a Review. Artif Intell Med 2020; 102:101762. [DOI: 10.1016/j.artmed.2019.101762] [Citation(s) in RCA: 63] [Impact Index Per Article: 12.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2019] [Revised: 08/29/2019] [Accepted: 11/07/2019] [Indexed: 12/23/2022]
|
4
|
A Retrospective Cohort Study of the Effect of Hospitalist-Directed Transfers on Patient Flow. J Gen Intern Med 2019; 34:1968-1970. [PMID: 31161569 PMCID: PMC6816622 DOI: 10.1007/s11606-019-05072-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
5
|
Bernaitis N, Anoopkumar-Dukie S, Bills S, Crilly J. Evaluation of adult stroke presentations at an Emergency Department in Queensland Australia. Int Emerg Nurs 2019; 44:25-29. [PMID: 30922602 DOI: 10.1016/j.ienj.2019.02.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2018] [Revised: 01/13/2019] [Accepted: 02/23/2019] [Indexed: 01/04/2023]
Abstract
BACKGROUND Stroke is a leading cause of mortality and morbidity which places high demands on emergency departments (EDs). Currently there is limited data on stroke presentations to Australian EDs and the time performance management of these presentations. Therefore, the aim of this study was to evaluate stroke presentations at an ED in Queensland, Australia in terms of demographics and time performance measures over a five year period. METHODS Retrospective analysis of ED presentations by patients ≥18 years with a final diagnosis of stroke between 1 July 2010 and 30 June 2015. RESULTS Over the five years there was a 51.4% increase in presentations diagnosed with stroke. The majority of these patients arrived by ambulance (71.0%) and were admitted (94.9%) with death in ED for 1.4% of presentations. From 2010 to 2015 for both haemorrhagic and ischaemic stroke there was a significant decrease in median LOS in ED (435 to 215 min, p < 0.05 and 451 to 238 min, p < 0.001 respectively) and in the proportion of patients in ED greater than four hours (82.4% to 44%, p < 0.05 and 92.4% to 45.8%,p < 0.0001 respectively). CONCLUSION Despite increased presentations of stroke, the ED improved in multiple time performance measures. Improving time-based targets in ED is particularly important for stroke presentations given the time critical nature of stroke management.
Collapse
Affiliation(s)
- Nijole Bernaitis
- School of Pharmacy & Pharmacology, Griffith University, Queensland, Australia; Quality Use of Medicines Network, Griffith University, Queensland, Australia.
| | - Shailendra Anoopkumar-Dukie
- School of Pharmacy & Pharmacology, Griffith University, Queensland, Australia; Quality Use of Medicines Network, Griffith University, Queensland, Australia
| | - Sean Bills
- Department of Emergency Medicine, Gold Coast Health, Queensland, Australia
| | - Julia Crilly
- Quality Use of Medicines Network, Griffith University, Queensland, Australia; Department of Emergency Medicine, Gold Coast Health, Queensland, Australia; School of Nursing and Midwifery, Menzies Health Institute Queensland, Griffith University, Queensland, Australia
| |
Collapse
|
6
|
Lee SY, Ro YS, Shin SD, Song KJ, Hong KJ, Park JH, Kong SY. Recognition of out-of-hospital cardiac arrest during emergency calls and public awareness of cardiopulmonary resuscitation in communities: A multilevel analysis. Resuscitation 2018; 128:106-111. [DOI: 10.1016/j.resuscitation.2018.05.008] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2017] [Revised: 04/30/2018] [Accepted: 05/05/2018] [Indexed: 10/17/2022]
|
7
|
Paek SH, Kim DK, Lee JH, Kwak YH. The Impact of Middle East Respiratory Syndrome Outbreak on Trends in Emergency Department Utilization Patterns. J Korean Med Sci 2017; 32:1576-1580. [PMID: 28875599 PMCID: PMC5592169 DOI: 10.3346/jkms.2017.32.10.1576] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2017] [Accepted: 06/24/2017] [Indexed: 12/14/2022] Open
Abstract
Changes occurred in the patterns of utilization of emergency medical services during the Middle East respiratory syndrome (MERS) outbreak. The purpose of this study was to analyze the patterns of adult and pediatric patients who visited the emergency department (ED) during the outbreak. This retrospective study was conducted by analyzing changes in the patterns of visits among adult and pediatric patients in the ED at one tertiary teaching hospital in Korea. The study was performed from June 1, 2013 to July 31, 2015. The MERS outbreak period was from June 1 to July 31, 2015, and we compared that period to the same periods in 2013 and 2014. We compared and analyzed the patients' characteristics, emergency severity index (ESI) level at the visit, cause of visit, diagnosis, final dispositions, injury/non-injury, length of stay at the ED (EDLOS), and hospitalization rate. A total of 9,107 patients visited the ED during this period. Of these patients, 2,572 (28.2%) were pediatric patients and 6,535 (71.8%) were adult patients. The most common cause of an ED visit was fever (adult patients: 21.6%, pediatric patients: 56.2%). The proportion of non-urgent visits involving an ESI level of 4 or 5 and the EDLOS decreased significantly in pediatric and adult patients in comparison to that during the past two years. This change was significant in pediatric patients. Among adult patients, the rate of injury decreased, whereas it increased among pediatric patients. During the MERS outbreak period, pediatric ED visits due to non-urgent cases decreased significantly and there were more pronounced differences in ED utilization patterns in pediatric patients than in adult patients.
Collapse
Affiliation(s)
- So Hyun Paek
- Department of Emergency Medicine, Seoul National University Hospital, Seoul, Korea
- Department of Emergency Medicine, Kangwon National University, Graduate School of Medicine, Chuncheon, Korea
| | - Do Kyun Kim
- Department of Emergency Medicine, Seoul National University Hospital, Seoul, Korea.
| | - Jin Hee Lee
- Department of Emergency Medicine, Seoul National University Hospital, Seoul, Korea
| | - Young Ho Kwak
- Department of Emergency Medicine, Seoul National University Hospital, Seoul, Korea
| |
Collapse
|
8
|
Burke JA, Greenslade J, Chabrowska J, Greenslade K, Jones S, Montana J, Bell A, O'Connor A. Two Hour Evaluation and Referral Model for Shorter Turnaround Times in the emergency department. Emerg Med Australas 2017; 29:315-323. [PMID: 28455884 DOI: 10.1111/1742-6723.12781] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2016] [Revised: 03/05/2017] [Accepted: 03/15/2017] [Indexed: 12/01/2022]
Abstract
OBJECTIVE The objective of this study was to assess the implementation of a novel ED model of care, which combines clinical streaming, team-based assessment and early senior consultation to reduce length of stay. METHODS A pre-post-intervention study was used to compare ED performance following an extensive clinical redesign programme. Clinical teams and work sequences were reconfigured to promote the role of the staff specialist, with a focus on earlier decisions regarding disposition. Primary outcome measures were ED length of stay and National Emergency Access Target (NEAT) compliance. Secondary outcomes included referral and workup times, wait times by triage category, ambulance offload times, ward discharges and unit transfers within 24 h of admission, representation within 48 h, and Medical Emergency Response Team (MERT) calls within 24 h of admission. RESULTS Two seasonally matched 26 week intervals were compared with adjustment for demographics, triage category and arrival by ambulance. Overall, there was an 18.4% rise in NEAT performance (95% confidence interval (CI): 17.7-19.1) while ED length of stay decreased by a total of 86.8 min (95% CI: 83.6-90.1). Time series analysis did not suggest any preexisting trends to explain these results. The average time to referral decreased by 74.7 min (95% CI: 69.8-79.6) and waiting times decreased across all triage categories. Rates of MERT activation and unplanned representation were unchanged. CONCLUSION A facilitated team leader role for senior doctors can help to reduce length of stay by via early disposition, without significant risks to the patient.
Collapse
Affiliation(s)
- John A Burke
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia
| | - Jaimi Greenslade
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia.,School of Medicine, The University of Queensland, Brisbane, Queensland, Australia
| | - Jadwiga Chabrowska
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia
| | - Katherine Greenslade
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia
| | - Sally Jones
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia
| | - Jacqueline Montana
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia
| | - Anthony Bell
- Department of Emergency Medicine, Royal Brisbane Hospital, Brisbane, Queensland, Australia
| | - Alan O'Connor
- Discipline of Acute Care Medicine, The University of Adelaide, Adelaide, South Australia, Australia.,Department of Emergency Medicine, Riverland General Hospital, Adelaide, South Australia, Australia.,Department of Emergency Medicine, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| |
Collapse
|
9
|
McMullen ME, Pines JM. Assessing severity, immediacy, and ideal setting in ED patients: a pilot study on interrater reliability. Am J Emerg Med 2016; 34:1276-80. [PMID: 27161044 DOI: 10.1016/j.ajem.2016.04.031] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2016] [Revised: 04/15/2016] [Accepted: 04/19/2016] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVES We conducted a pilot study to test the interrater reliability of emergency department (ED) physician assessments of 3 ED visit attributes-severity, immediacy, and ideal setting, with the long-term goal of developing a novel ED categorization system. METHODS Using 2010 National Hospital Ambulatory Care Survey data, we randomly selected 300 ED patient records for review by 6 emergency medicine physicians. Each record was assessed by 2 physicians for severity and immediacy using a 7-point scale; "ideal" setting was chosen among 6 possible settings. κ-Weighted and unweighted-and interclass correlation coefficients were used to test interrater agreement. RESULTS For severity, immediacy, and ideal setting, there was "fair" agreement in assessments with a weighted κ of 0.33 (95% confidence interval [CI], 0.27-0.40), 0.30 (95% CI, 0.23-0.36), and nonweighted κ of 0.28 (95% CI, 0.21-0.34), respectively. When both raters were "very certain" about their assessments, weighted κ increased to 0.42 (95% CI, 0.34-0.51) for severity and 0.35 (95% CI, 0.27-0.44) for immediacy. Interclass correlation coefficients showed similar results. There was agreement on ideal setting for 162 (54%) of 300 scenarios. Scenarios with poor agreement on ideal setting in general involved care for nonspecific symptoms rather than specific diagnoses. CONCLUSIONS Rater agreement among ED physicians when assessing clinical data on specific ED visits was fair for severity and immediacy ratings. Raters agreed on ideal treatment settings half the time. In general, there was greater agreement when a specific diagnosis was found rather than negative workups for symptoms. This demonstrates a validity issue when it comes to developing and using categorization systems for ED visits and assessing setting appropriateness.
Collapse
Affiliation(s)
- Michael E McMullen
- George Washington School of Medicine and Health Sciences, Washington, DC.
| | - Jesse M Pines
- George Washington School of Medicine and Health Sciences, Washington, DC; Office of Clinical Practice Innovation, 2100 Pennsylvania, Washington, DC 20037.
| |
Collapse
|