1
|
Beckmann CL, Lodde G, Swoboda J, Livingstone E, Böckmann B. Use of Real-World FHIR Data Combined with Context-Sensitive Decision Modeling to Guide Sentinel Biopsy in Melanoma. J Clin Med 2024; 13:3353. [PMID: 38893064 PMCID: PMC11172530 DOI: 10.3390/jcm13113353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 05/27/2024] [Accepted: 06/03/2024] [Indexed: 06/21/2024] Open
Abstract
Background: To support clinical decision-making at the point of care, the "best next step" based on Standard Operating Procedures (SOPs) and actual accurate patient data must be provided. To do this, textual SOPs have to be transformed into operable clinical algorithms and linked to the data of the patient being treated. For this linkage, we need to know exactly which data are needed by clinicians at a certain decision point and whether these data are available. These data might be identical to the data used within the SOP or might integrate a broader view. To address these concerns, we examined if the data used by the SOP is also complete from the point of view of physicians for contextual decision-making. Methods: We selected a cohort of 67 patients with stage III melanoma who had undergone adjuvant treatment and mainly had an indication for a sentinel biopsy. First, we performed a step-by-step simulation of the patient treatment along our clinical algorithm, which is based on a hospital-specific SOP, to validate the algorithm with the given Fast Healthcare Interoperability Resources (FHIR)-based data of our cohort. Second, we presented three different decision situations within our algorithm to 10 dermatooncologists, focusing on the concrete patient data used at this decision point. The results were conducted, analyzed, and compared with those of the pure algorithmic simulation. Results: The treatment paths of patients with melanoma could be retrospectively simulated along the clinical algorithm using data from the patients' electronic health records. The subsequent evaluation by dermatooncologists showed that the data used at the three decision points had a completeness between 84.6% and 100.0% compared with the data used by the SOP. At one decision point, data on "patient age (at primary diagnosis)" and "date of first diagnosis" were missing. Conclusions: The data needed for our decision points are available in the FHIR-based dataset. Furthermore, the data used at decision points by the SOP and hence the clinical algorithm are nearly complete compared with the data required by physicians in clinical practice. This is an important precondition for further research focusing on presenting decision points within a treatment process integrated with the patient data needed.
Collapse
Affiliation(s)
- Catharina Lena Beckmann
- Department of Computer Science, University of Applied Sciences and Arts Dortmund (FH Dortmund), 44227 Dortmund, Germany
| | - Georg Lodde
- Department of Dermatology, Venereology and Allergology, University Hospital Essen, 45147 Essen, Germany
| | - Jessica Swoboda
- Institute for Artificial Intelligence in Medicine, University Hospital Essen, Girardetstraße 2, 45131 Essen, Germany;
| | - Elisabeth Livingstone
- Department of Dermatology, Venereology and Allergology, University Hospital Essen, 45147 Essen, Germany
| | - Britta Böckmann
- Department of Computer Science, University of Applied Sciences and Arts Dortmund (FH Dortmund), 44227 Dortmund, Germany
- Institute for Artificial Intelligence in Medicine, University Hospital Essen, Girardetstraße 2, 45131 Essen, Germany;
| |
Collapse
|
2
|
Baldini G, Hosch R, Schmidt CS, Borys K, Kroll L, Koitka S, Haubold P, Pelka O, Nensa F, Haubold J. Addressing the Contrast Media Recognition Challenge: A Fully Automated Machine Learning Approach for Predicting Contrast Phases in CT Imaging. Invest Radiol 2024:00004424-990000000-00203. [PMID: 38436405 DOI: 10.1097/rli.0000000000001071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2024]
Abstract
OBJECTIVES Accurately acquiring and assigning different contrast-enhanced phases in computed tomography (CT) is relevant for clinicians and for artificial intelligence orchestration to select the most appropriate series for analysis. However, this information is commonly extracted from the CT metadata, which is often wrong. This study aimed at developing an automatic pipeline for classifying intravenous (IV) contrast phases and additionally for identifying contrast media in the gastrointestinal tract (GIT). MATERIALS AND METHODS This retrospective study used 1200 CT scans collected at the investigating institution between January 4, 2016 and September 12, 2022, and 240 CT scans from multiple centers from The Cancer Imaging Archive for external validation. The open-source segmentation algorithm TotalSegmentator was used to identify regions of interest (pulmonary artery, aorta, stomach, portal/splenic vein, liver, portal vein/hepatic veins, inferior vena cava, duodenum, small bowel, colon, left/right kidney, urinary bladder), and machine learning classifiers were trained with 5-fold cross-validation to classify IV contrast phases (noncontrast, pulmonary arterial, arterial, venous, and urographic) and GIT contrast enhancement. The performance of the ensembles was evaluated using the receiver operating characteristic area under the curve (AUC) and 95% confidence intervals (CIs). RESULTS For the IV phase classification task, the following AUC scores were obtained for the internal test set: 99.59% [95% CI, 99.58-99.63] for the noncontrast phase, 99.50% [95% CI, 99.49-99.52] for the pulmonary-arterial phase, 99.13% [95% CI, 99.10-99.15] for the arterial phase, 99.8% [95% CI, 99.79-99.81] for the venous phase, and 99.7% [95% CI, 99.68-99.7] for the urographic phase. For the external dataset, a mean AUC of 97.33% [95% CI, 97.27-97.35] and 97.38% [95% CI, 97.34-97.41] was achieved for all contrast phases for the first and second annotators, respectively. Contrast media in the GIT could be identified with an AUC of 99.90% [95% CI, 99.89-99.9] in the internal dataset, whereas in the external dataset, an AUC of 99.73% [95% CI, 99.71-99.73] and 99.31% [95% CI, 99.27-99.33] was achieved with the first and second annotator, respectively. CONCLUSIONS The integration of open-source segmentation networks and classifiers effectively classified contrast phases and identified GIT contrast enhancement using anatomical landmarks.
Collapse
Affiliation(s)
- Giulia Baldini
- From the Institute of Interventional and Diagnostic Radiology and Neuroradiology, University Hospital Essen, Essen, Germany (G.B., R.H., K.B., L.K., S.K., F.N., J.H.); Institute for Artificial Intelligence in Medicine, University Hospital Essen, Essen, Germany (G.B., R.H., C.S.S., K.B., L.K., S.K., O.P., F.N., J.H.); Institute for Transfusion Medicine, University Hospital Essen, Essen, Germany (C.S.S.); Department of Diagnostic and Interventional Radiology, Kliniken Essen-Mitte, Essen, Germany (P.H.); and Data Integration Center, Central IT Department, University Hospital Essen, Essen, Germany (O.P., F.N.)
| | | | | | | | | | | | | | | | | | | |
Collapse
|
4
|
Engelke M, Schmidt CS, Baldini G, Parmar V, Hosch R, Borys K, Koitka S, Turki AT, Haubold J, Horn PA, Nensa F. Optimizing platelet transfusion through a personalized deep learning risk assessment system for demand management. Blood 2023; 142:2315-2326. [PMID: 37890142 DOI: 10.1182/blood.2023021172] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 09/29/2023] [Accepted: 10/17/2023] [Indexed: 10/29/2023] Open
Abstract
ABSTRACT Platelet demand management (PDM) is a resource-consuming task for physicians and transfusion managers of large hospitals. Inpatient numbers and institutional standards play significant roles in PDM. However, reliance on these factors alone commonly results in platelet shortages. Using data from multiple sources, we developed, validated, tested, and implemented a patient-specific approach to support PDM that uses a deep learning-based risk score to forecast platelet transfusions for each hospitalized patient in the next 24 hours. The models were developed using retrospective electronic health record data of 34 809 patients treated between 2017 and 2022. Static and time-dependent features included demographics, diagnoses, procedures, blood counts, past transfusions, hematotoxic medications, and hospitalization duration. Using an expanding window approach, we created a training and live-prediction pipeline with a 30-day input and 24-hour forecast. Hyperparameter tuning determined the best validation area under the precision-recall curve (AUC-PR) score for long short-term memory deep learning models, which were then tested on independent data sets from the same hospital. The model tailored for hematology and oncology patients exhibited the best performance (AUC-PR, 0.84; area under the receiver operating characteristic curve [ROC-AUC], 0.98), followed by a multispecialty model covering all other patients (AUC-PR, 0.73). The model specific to cardiothoracic surgery had the lowest performance (AUC-PR, 0.42), likely because of unexpected intrasurgery bleedings. To our knowledge, this is the first deep learning-based platelet transfusion predictor enabling individualized 24-hour risk assessments at high AUC-PR. Implemented as a decision-support system, deep-learning forecasts might improve patient care by detecting platelet demand earlier and preventing critical transfusion shortages.
Collapse
Affiliation(s)
- Merlin Engelke
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - Cynthia Sabrina Schmidt
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute for Transfusion Medicine, University Medicine Essen, Essen, Germany
| | - Giulia Baldini
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - Vicky Parmar
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - René Hosch
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - Katarzyna Borys
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - Sven Koitka
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - Amin T Turki
- Computational Hematology Laboratory, Department of Hematology and Stem Cell Transplantation, West-German Cancer Center, University Medicine Essen, Essen, Germany
- Department of Hematology and Oncology, Marienhospital University Hospital, Ruhr University Bochum, Bochum, Germany
| | - Johannes Haubold
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| | - Peter A Horn
- Institute for Transfusion Medicine, University Medicine Essen, Essen, Germany
| | - Felix Nensa
- Institute for Artificial Intelligence in Medicine, University Medicine Essen, Essen, Germany
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Medicine Essen, Essen, Germany
| |
Collapse
|