Predicting Admissions From a Paediatric Emergency Department - Protocol for Developing and Validating a Low-Dimensional Machine Learning Prediction Model

Predicting internalizing symptoms with machine learning: identifying individuals that need care

Objective The current project aims to identify individuals in urgent need of mental health care, using a machine learning algorithm (random forest). Comparison/contrast with conventional regression analyses is discussed. Participants: A total of 2,409 participants were recruited from an anonymous university, including undergraduate and graduate students, faculty, and staff. Methods: Answers to a COVID-19 impact survey, the Patient Health Questionnaire-9 (PHQ-9), and the Generalized Anxiety Disorder-7 (GAD-7) were collected. The total scores of PHQ-9 and GAD-7 were regressed on six composites that were created from the questionnaire items, based on their topics. A random forest was trained and validated. Results: Results indicate that the random forest model was able to make accurate, prospective predictions (R2 = .429 on average) and we review variables that were deemed predictively relevant. Conclusions: Overall, the study suggests that predictive models can be clinically useful in identifying individuals with internalizing symptoms based on daily life disruption experiences.

Development of a low‐dimensional model to predict admissions from triage at a pediatric emergency department

Objectives

This study aims to develop and internally validate a low‐dimensional model to predict outcomes (admission or discharge) using commonly entered data up to the post‐triage process to improve patient flow in the pediatric emergency department (ED). In hospital settings where electronic data are limited, a low‐dimensional model with fewer variables may be easier to implement.

Methods

This prognostic study included ED attendances in 2017 and 2018. The Cross Industry Standard Process for Data Mining methodology was followed. Eligibility criteria was applied to the data set, splitting into 70% train and 30% test. Sampling techniques were compared. Gradient boosting machine (GBM), logistic regression, and naïve Bayes models were created. Variables of importance were obtained from the model with the highest area under the curve (AUC) and used to create a low‐dimensional model.

Results

Eligible attendances totaled 72,229 (15% admission rate). The AUC was 0.853 (95% confidence interval [CI], 0.846–0.859) for GBM, 0.845 (95% CI, 0.838–0.852) for logistic regression and 0.813 (95% CI, 0.806–0.821) for naïve Bayes. Important predictors in the GBM model used to create a low‐dimensional model were presenting complaint, triage category, referral source, registration month, location type (resuscitation/other), distance traveled, admission history, and weekday (AUC 0.835 [95% CI, 0.829‐0.842]).

Conclusions

Admission and discharge probability can be predicted early in a pediatric ED using 8 variables. Future work could analyze the false positives and false negatives to gain an understanding of the implementation of these predictions.