Real-world data mining meets clinical practice: Research challenges and perspective

Sequential classification approach for enhancing the assessment of cardiac autonomic neuropathy

Cardiac autonomic neuropathy (CAN) is a progressive condition associated with chronic diseases like diabetes, requiring regular reviews. Current CAN diagnostic methods are often time-consuming and lack precision. This study presents a novel, two-stage classification model designed to improve CAN diagnostic efficiency. Using a dataset of 1335 patient entries, including inflammatory markers and autonomic function tests (CARTs), the model first classifies patients based on six inflammatory markers- Interleukin-6 (IL-6), C-reactive protein (CRP), Interleukin-1 beta (IL-1beta), Interleukin-10 (IL-10), Monocyte Chemoattractant Protein-1 (MCP-1), and Insulin-like growth factor-1 (IGF-1). In this initial stage, the model achieves 0.893 accuracy for 31.46% of cases in the three-class CAN model at a 0.80 threshold. For cases requiring further assessment, the second stage incorporates CARTs, improving overall accuracy to 0.933. Notably, 98.87% of cases are accurately classified using only a subset of CARTs, with just 1.12% needing all five tests. Additionally, we developed a web application that utilizes Shapley plots to visualize and explain the contribution of each marker, facilitating interpretation for clinical use. This two-stage approach underscores the diagnostic relevance of inflammatory markers, providing clinicians with a streamlined, resource-efficient tool for timely CAN diagnosis and intervention.

Mortality prediction after major surgery in a mixed population through machine learning: a multi-objective symbolic regression approach

INTRODUCTION

Understanding 1-year mortality following major surgery offers valuable insights into patient outcomes and the quality of peri-operative care. Few models exist that predict 1-year mortality accurately. This study aimed to develop a predictive model for 1-year mortality in patients undergoing complex non-cardiac surgery using a novel machine-learning technique called multi-objective symbolic regression.

METHODS

A single-institution database of patients undergoing major elective surgery with previous cardiopulmonary exercise testing was divided into three datasets: pre-operative clinical data; cardiorespiratory and physiological data; and combined. A multi-objective symbolic regression model was developed and compared against existing models. Model performance was evaluated using the F1 score. Shapley additive explanations analysis was used to identify the major contributors to model performance.

RESULTS

From 2145 patients in the database, 1190 were included, with 952 in the training dataset and 238 in the test dataset. Median (IQR [range]) age was 71 (61-79 [45-89]) years and 825 (69%) were male. The multi-objective symbolic regression model demonstrated robust consistency with an F1 score of 0.712. Shapley additive explanations analysis indicated that ventilatory equivalents for carbon dioxide, oxygen at peak exercise and BMI influenced model performance most significantly, surpassing surgery type and named comorbidities.

DISCUSSION

This study confirms the feasibility of developing a multi-objective symbolic regression-based model for predicting 1-year postoperative mortality in a mixed non-cardiac surgical population. The model's strong performance underscores the critical role of physiological data, particularly cardiorespiratory fitness, in surgical risk assessment and emphasises the importance of pre-operative optimisation to identify and manage high-risk patients. The multi-objective symbolic regression model demonstrated high sensitivity and a good F1 score, highlighting its potential as an effective tool for peri-operative risk prediction.

Policy instruments for the governance of the social drivers of health data in clinical and research settings: a policy mapping brief

This paper maps policy instrument use for the social drivers of health (SDoH) data governance in clinical and research settings. In the United States, Centers for Medicare and Medicaid Services (CMS) and National Institutes of Health (NIH) advocate for standardized data capture. Yet, challenges persist, including limited adoption of CMS-issued SDoH risk codes and gaps in reporting SDoH in clinical trial literature. The mapping across clinical and research SDoH reporting emerges as a comprehensive solution that requires policy support. Specifically, the findings presented in this paper support future policy development through regulatory instruments, fiscal incentives, and knowledge exchange. Actionable recommendations for the United States and international contexts include convening interdisciplinary taskforces, developing agency guidelines for process evaluation, and establishing ethical principles for SDoH data use.

Using interpretable machine learning to predict bloodstream infection and antimicrobial resistance in patients admitted to ICU: Early alert predictors based on EHR data to guide antimicrobial stewardship

Nosocomial infections and Antimicrobial Resistance (AMR) stand as formidable healthcare challenges on a global scale. To address these issues, various infection control protocols and personalized treatment strategies, guided by laboratory tests, aim to detect bloodstream infections (BSI) and assess the potential for AMR. In this study, we introduce a machine learning (ML) approach based on Multi-Objective Symbolic Regression (MOSR), an evolutionary approach to create ML models in the form of readable mathematical equations in a multi-objective way to overcome the limitation of standard single-objective approaches. This method leverages readily available clinical data collected upon admission to intensive care units, with the goal of predicting the presence of BSI and AMR. We further assess its performance by comparing it to established ML algorithms using both naturally imbalanced real-world data and data that has been balanced through oversampling techniques. Our findings reveal that traditional ML models exhibit subpar performance across all training scenarios. In contrast, MOSR, specifically configured to minimize false negatives by optimizing also for the F1-Score, outperforms other ML algorithms and consistently delivers reliable results, irrespective of the training set balance with F1-Score.22 and.28 higher than any other alternative. This research signifies a promising path forward in enhancing Antimicrobial Stewardship (AMS) strategies. Notably, the MOSR approach can be readily implemented on a large scale, offering a new ML tool to find solutions to these critical healthcare issues affected by limited data availability.

Reproducible and Interpretable Machine Learning-Based Radiomic Analysis for Overall Survival Prediction in Glioblastoma Multiforme

PURPOSE

To develop and validate an MRI-based radiomic model for predicting overall survival (OS) in patients diagnosed with glioblastoma multiforme (GBM), utilizing a retrospective dataset from multiple institutions.

MATERIALS AND METHODS

Pre-treatment MRI images of 289 GBM patients were collected. From each patient's tumor volume, 660 radiomic features (RFs) were extracted and subjected to robustness analysis. The initial prognostic model with minimum RFs was subsequently enhanced by including clinical variables. The final clinical-radiomic model was derived through repeated three-fold cross-validation on the training dataset. Performance evaluation included assessment of concordance index (C-Index), integrated area under curve (iAUC) alongside patient stratification into low and high-risk groups for overall survival (OS).

RESULTS

The final prognostic model, which has the highest level of interpretability, utilized primary gross tumor volume (GTV) and one MRI modality (T2-FLAIR) as a predictor and integrated the age variable with two independent, robust RFs, achieving moderately good discriminatory performance (C-Index [95% confidence interval]: 0.69 [0.62-0.75]) with significant patient stratification (p = 7 × 10-5) on the validation cohort. Furthermore, the trained model exhibited the highest iAUC at 11 months (0.81) in the literature.

CONCLUSION

We identified and validated a clinical-radiomic model for stratification of patients into low and high-risk groups based on OS in patients with GBM using a multicenter retrospective dataset. Future work will focus on the use of deep learning-based features, with recently standardized convolutional filters on OS tasks.

Exploring trends and autonomy levels of adaptive business intelligence in healthcare: A systematic review

OBJECTIVE

In order to comprehensively understand the characteristics of Adaptive Business Intelligence (ABI) in Healthcare, this study is structured to provide insights into the common features and evolving patterns within this domain. Applying the Sheridan's Classification as a framework, we aim to assess the degree of autonomy exhibited by various ABI components. Together, these objectives will contribute to a deeper understanding of ABI implementation and its implications within the Healthcare context.

METHODS

A comprehensive search of academic databases was conducted to identify relevant studies, selecting AIS e-library (AISel), Decision Support Systems Journal (DSSJ), Nature, The Lancet Digital Health (TLDH), PubMed, Expert Systems with Application (ESWA) and npj Digital Medicine as information sources. Studies from 2006 to 2022 were included based on predefined eligibility criteria. PRISMA statements were used to report this study.

RESULTS

The outcomes showed that ABI systems present distinct levels of development, autonomy and practical deployment. The high levels of autonomy were essentially associated with predictive components. However, the possibility of completely autonomous decisions by these systems is totally excluded. Lower levels of autonomy are also observed, particularly in connection with prescriptive components, granting users responsibility in the generation of decisions.

CONCLUSION

The study presented emphasizes the vital connection between desired outcomes and the inherent autonomy of these solutions, highlighting the critical need for additional research on the consequences of ABI systems and their constituent elements. Organizations should deploy these systems in a way consistent with their objectives and values, while also being mindful of potential adverse effects. Providing valuable insights for researchers, practitioners, and policymakers aiming to comprehend the diverse levels of ABI systems implementation, it contributes to well-informed decision-making in this dynamic field.

Synthetic Health Data Can Augment Community Research Efforts to Better Inform the Public During Emerging Pandemics

The COVID-19 pandemic had disproportionate effects on the Veteran population due to the increased prevalence of medical and environmental risk factors. Synthetic electronic health record (EHR) data can help meet the acute need for Veteran population-specific predictive modeling efforts by avoiding the strict barriers to access, currently present within Veteran Health Administration (VHA) datasets. The U.S. Food and Drug Administration (FDA) and the VHA launched the precisionFDA COVID-19 Risk Factor Modeling Challenge to develop COVID-19 diagnostic and prognostic models; identify Veteran population-specific risk factors; and test the usefulness of synthetic data as a substitute for real data. The use of synthetic data boosted challenge participation by providing a dataset that was accessible to all competitors. Models trained on synthetic data showed similar but systematically inflated model performance metrics to those trained on real data. The important risk factors identified in the synthetic data largely overlapped with those identified from the real data, and both sets of risk factors were validated in the literature. Tradeoffs exist between synthetic data generation approaches based on whether a real EHR dataset is required as input. Synthetic data generated directly from real EHR input will more closely align with the characteristics of the relevant cohort. This work shows that synthetic EHR data will have practical value to the Veterans' health research community for the foreseeable future.