Prophylaxis of Venous Thromboembolism in Geriatric Settings: A Cluster-Randomized Multicomponent Interventional Trial

Doctors Identify Hemorrhage Better during Chart Review when Assisted by Artificial Intelligence

OBJECTIVES

This study evaluated if medical doctors could identify more hemorrhage events during chart review in a clinical setting when assisted by an artificial intelligence (AI) model and medical doctors' perception of using the AI model.

METHODS

To develop the AI model, sentences from 900 electronic health records were labeled as positive or negative for hemorrhage and categorized into one of 12 anatomical locations. The AI model was evaluated on a test cohort consisting of 566 admissions. Using eye-tracking technology, we investigated medical doctors' reading workflow during manual chart review. Moreover, we performed a clinical use study where medical doctors read two admissions with and without AI assistance to evaluate performance when using and perception of using the AI model.

RESULTS

The AI model had a sensitivity of 93.7% and a specificity of 98.1% on the test cohort. In the use studies, we found that medical doctors missed more than 33% of relevant sentences when doing chart review without AI assistance. Hemorrhage events described in paragraphs were more often overlooked compared with bullet-pointed hemorrhage mentions. With AI-assisted chart review, medical doctors identified 48 and 49 percentage points more hemorrhage events than without assistance in two admissions, and they were generally positive toward using the AI model as a supporting tool.

CONCLUSION

Medical doctors identified more hemorrhage events with AI-assisted chart review and they were generally positive toward using the AI model.

Deep learning detects and visualizes bleeding events in electronic health records

BACKGROUND

Bleeding is associated with a significantly increased morbidity and mortality. Bleeding events are often described in the unstructured text of electronic health records, which makes them difficult to identify by manual inspection.

OBJECTIVES

To develop a deep learning model that detects and visualizes bleeding events in electronic health records.

PATIENTS/METHODS

Three hundred electronic health records with International Classification of Diseases, Tenth Revision diagnosis codes for bleeding or leukemia were extracted. Each sentence in the electronic health record was annotated as positive or negative for bleeding. The annotated sentences were used to develop a deep learning model that detects bleeding at sentence and note level.

RESULTS

On a balanced test set of 1178   sentences, the best-performing deep learning model achieved a sensitivity of 0.90, specificity of 0.90, and negative predictive value of 0.90. On a test set consisting of 700 notes, of which 49 were positive for bleeding, the model achieved a note-level sensitivity of 1.00, specificity of 0.52, and negative predictive value of 1.00. By using a sentence-level model on a note level, the model can explain its predictions by visualizing the exact sentence in a note that contains information regarding bleeding. Moreover, we found that the model performed consistently well across different types of bleedings.

CONCLUSIONS

A deep learning model can be used to detect and visualize bleeding events in the free text of electronic health records. The deep learning model can thus facilitate systematic assessment of bleeding risk, and thereby optimize patient care and safety.

Oral anticoagulants: Interventional pharmaceutical study with reminder of good practices, and iatrogenic impact

OBJECTIVES

Study of the impact of geriatricians' training on the improvement of their prescribing practices, and comparison of iatrogenesis between the two classes of oral anticoagulants.

MATERIAL AND METHODS

Before/after and here/there comparison between a trained prescribers group and a control group, before and after the pharmacist intervention, with comparison of the iatrogenesis of two oral anticoagulant classes. Patients in the acute and post-acute geriatric departments treated with a vitamin K antagonist or a direct oral anticoagulant were included. Criteria for Good practice were rated according to a scale of severity: calculation of a score and a percentage of compliance per patient, and then an average of the percentage of compliance (main criterion) within the populations to be compared. The proportion of iatrogenic elements between the two classes was compared. We used statistical tests (significance threshold of 5%).

RESULTS

Vitamin K antagonist: a decreasing trend in the control group (P=0.086) and an increasing trend in the trained group (P=0.183) was observed in prescription compliance before/after training. Direct oral anticoagulants: the compliance before/after decreased in the control group (P=0.005) and increased in the trained group (P=0.024). After training, compliance is higher among the group of trained prescribers for both vitamin K antagonist (P=0.018) and direct oral anticoagulant (P=0.003). The proportion of iatrogenic events in the two oral anticoagulants classes was not significantly different.

CONCLUSIONS

Interest of good practice reminders in the quality of oral anticoagulants prescriptions with no difference in safety of use between the two classes.

[Impact of an intervention on the practice of venous thromboprophylaxis recommendations in a geriatric setting.]

The practice of prevention of venous thromboembolic disease in hospitalized elderly patients does not comply with published recommendations, in 30% of cases. The objective of this study was to evaluate the impact of recalling the recommendations on the venous thromboprophylaxis.