Predicting the occurrence of surgical site infections using text mining and machine learning

The best machine learning algorithm for building surgical site infection predictive models: A systematic review and network meta-analysis

BACKGROUND

Many machine learning (ML) algorithms have been used to develop surgical site infection (SSI) prediction models, but little is known about their predicting performance. We conducted a network meta-analysis to compare the performance of different ML algorithms and to explore which one may perform best.

METHODS

MEDLINE, EMBASE, CINAHL, Web of Science, and Cochrane Library were systematically searched from inception to November 25, 2023. We included diagnostic accuracy trials constructing SSI predictive model by ML. Two reviewers selected relevant studies and extracted data. The certainty of the evidence was rated using the QUADAS-2 tool. Performance statistics of the diagnostic analysis and the ranking of the different ML algorithms have been expressed in Relative Diagnostic Odds Ratio (RDOR) and superiority index (SI), respectively, using statistical software STATA and R.

RESULTS

Of 493 articles identified, 10 algorithms from 84 SSI prediction models in 40 articles were included in this review. The results of our study revealed that models based on solely surgical type outperformed models without discrimination of surgical type (RDOR 2.71, 95 % CI: 1.25-5.90, P = 0.01), and mixed-use of structured and textual data-based models outperformed models solely based on structured data (RDOR 8.70, 95 % CI: 3.65-20.75, P < 0.01). Combining the ML algorithms in different databased subgroups separately yields the sorted results: Boosted Classifiers had the best overall prediction for the mixed databased model (SI6.17, 95 % CI: 0.09, 13.00), and Support Vector Machine for the structured (SI 4.70, 95 % CI: 0.11, 13.00).

CONCLUSIONS

ML algorithms developed with structured and textual data provided optimal performance. Boosted Classifiers may be the best algorithm in SSI prediction.

Improving Surgical Site Infection Prediction Using Machine Learning: Addressing Challenges of Highly Imbalanced Data

Background: Surgical site infections (SSIs) lead to higher hospital readmission rates and healthcare costs, representing a significant global healthcare burden. Machine learning (ML) has demonstrated potential in predicting SSIs; however, the challenge of addressing imbalanced class ratios remains. Objectives: The aim of this study is to evaluate and enhance the predictive capabilities of machine learning models for SSIs by assessing the effects of feature selection, resampling techniques, and hyperparameter optimization. Methods: Using routine SSI surveillance data from multiple hospitals in Saudi Arabia, we analyzed a dataset of 64,793 surgical patients, of whom 1632 developed SSI. Seven machine learning algorithms were created and tested: Decision Tree (DT), Gaussian Naive Bayes (GNB), Support Vector Machine (SVM), Logistic Regression (LR), Random Forest (RF), Stochastic Gradient Boosting (SGB), and K-Nearest Neighbors (KNN). We also improved several resampling strategies, such as undersampling and oversampling. Grid search five-fold cross-validation was employed for comprehensive hyperparameter optimization, in conjunction with balanced sampling techniques. Features were selected using a filter method based on their relationships with the target variable. Results: Our findings revealed that RF achieves the highest performance, with an MCC of 0.72. The synthetic minority oversampling technique (SMOTE) is the best-performing resampling technique, consistently enhancing the performance of most machine learning models, except for LR and GNB. LR struggles with class imbalance due to its linear assumptions and bias toward the majority class, while GNB's reliance on feature independence and Gaussian distribution make it unreliable for under-represented minority classes. For computational efficiency, the Instance Hardness Threshold (IHT) offers a viable alternative undersampling technique, though it may compromise performance to some extent. Conclusions: This study underscores the potential of ML models as effective tools for assessing SSI risk, warranting further clinical exploration to improve patient outcomes. By employing advanced ML techniques and robust validation methods, these models demonstrate promising accuracy and reliability in predicting SSI events, even in the face of significant class imbalances. In addition, using MCC in this study ensures a more reliable and robust evaluation of the model's predictive performance, particularly in the presence of an imbalanced dataset, where other metrics may fail to provide an accurate evaluation.

Advancing Patient Safety: The Future of Artificial Intelligence in Mitigating Healthcare-Associated Infections: A Systematic Review

BACKGROUND

Healthcare-associated infections are infections that patients acquire during hospitalization or while receiving healthcare in other facilities. They represent the most frequent negative outcome in healthcare, can be entirely prevented, and pose a burden in terms of financial and human costs. With the development of new AI and ML algorithms, hospitals could develop new and automated surveillance and prevention models for HAIs, leading to improved patient safety. The aim of this review is to systematically retrieve, collect, and summarize all available information on the application and impact of AI in HAI surveillance and/or prevention.

METHODS

We conducted a systematic review of the literature using PubMed and Scopus to find articles related to the implementation of artificial intelligence in the surveillance and/or prevention of HAIs.

RESULTS

We identified a total of 218 articles, of which only 35 were included in the review. Most studies were conducted in the US (n = 10, 28.6%) and China (n = 5; 14.3%) and were published between 2021 and 2023 (26 articles, 74.3%) with an increasing trend over time. Most focused on the development of ML algorithms for the identification/prevention of surgical site infections (n = 18; 51%), followed by HAIs in general (n = 9; 26%), hospital-acquired urinary tract infections (n = 5; 9%), and healthcare-associated pneumonia (n = 3; 9%). Only one study focused on the proper use of personal protective equipment (PPE) and included healthcare workers as the study population. Overall, the trend indicates that several AI/ML models can effectively assist clinicians in everyday decisions, by identifying HAIs early or preventing them through personalized risk factors with good performance. However, only a few studies have reported an actual implementation of these models, which proved highly successful. In one case, manual workload was reduced by nearly 85%, while another study observed a decrease in the local hospital's HAI incidence from 1.31% to 0.58%.

CONCLUSIONS

AI has significant potential to improve the prevention, diagnosis, and management of healthcare-associated infections, offering benefits such as increased accuracy, reduced workloads, and cost savings. Although some AI applications have already been tested and validated, adoption in healthcare is hindered by barriers such as high implementation costs, technological limitations, and resistance from healthcare workers. Overcoming these challenges could allow AI to be more widely and cost-effectively integrated, ultimately improving patient care and infection management.

Modernizing Surgical Quality: A Novel Approach to Improving Detection of Surgical Site Infections in the Veteran Population

Introduction: Surgical site infections (SSIs) are an important quality measure. Identifying SSIs often relies upon a time-intensive manual review of a sample of common surgical cases. In this study, we sought to develop a predictive model for SSI identification using antibiotic pharmacy data extracted from the electronic medical record (EMR). Methods: A retrospective analysis was performed on all surgeries at a Veteran Affair's Medical Center between January 9, 2020 and January 9, 2022. Patients receiving outpatient antibiotics within 30 days of their surgery were identified, and chart review was performed to detect instances of SSI as defined by VA Surgery Quality Improvement Program criteria. Binomial logistic regression was used to select variables to include in the model, which was trained using k-fold cross validation. Results: Of the 8,253 surgeries performed during the study period, patients in 793 (9.6%) cases were prescribed outpatient antibiotics within 30 days of their procedure; SSI was diagnosed in 128 (1.6%) patients. Logistic regression identified time from surgery to antibiotic prescription, ordering location of the prescription, length of prescription, type of antibiotic, and operating service as important variables to include in the model. On testing, the final model demonstrated good predictive value with c-statistic of 0.81 (confidence interval: 0.71-0.90). Hosmer-Lemeshow testing demonstrated good fit of the model with p value of 0.97. Conclusion: We propose a model that uses readily attainable data from the EMR to identify SSI occurrences. In conjunction with local case-by-case reporting, this tool can improve the accuracy and efficiency of SSI identification.

Artificial intelligence in wound care: diagnosis, assessment and treatment of hard-to-heal wounds: a narrative review

OBJECTIVE

The effective assessment of wounds, both acute and hard-to-heal, is an important component in the delivery by wound care practitioners of efficacious wound care for patients. Improved wound diagnosis, optimising wound treatment regimens, and enhanced prevention of wounds aid in providing patients with a better quality of life (QoL). There is significant potential for the use of artificial intelligence (AI) in health-related areas such as wound care. However, AI-based systems remain to be developed to a point where they can be used clinically to deliver high-quality wound care. We have carried out a narrative review of the development and use of AI in the diagnosis, assessment and treatment of hard-to-heal wounds. We retrieved 145 articles from several online databases and other online resources, and 81 of them were included in this narrative review. Our review shows that AI application in wound care offers benefits in the assessment/diagnosis, monitoring and treatment of acute and hard-to-heal wounds. As well as offering patients the potential of improved QoL, AI may also enable better use of healthcare resources.

Machine learning models to detect and predict patient safety events using electronic health records: A systematic review

INTRODUCTION

Identifying patient safety events using electronic health records (EHRs) and automated machine learning-based detection methods can help improve the efficiency and quality of healthcare service provision.

OBJECTIVE

This study aimed to systematically review machine learning-based methods and techniques, as well as their results for patient safety event management using EHRs.

METHODS

We reviewed the studies that focused on machine learning techniques, including automatic prediction and detection of patient safety events and medical errors through EHR analysis to manage patient safety events. The data were collected by searching Scopus, PubMed (Medline), Web of Science, EMBASE, and IEEE Xplore databases.

RESULTS

After screening, 41 papers were reviewed. Support vector machine (SVM), random forest, conditional random field (CRF), and bidirectional long short-term memory with conditional random field (BiLSTM-CRF) algorithms were mostly applied to predict, identify, and classify patient safety events using EHRs; however, they had different performances. BiLSTM-CRF was employed in most of the studies to extract and identify concepts, e.g., adverse drug events (ADEs) and adverse drug reactions (ADRs), as well as relationships between drug and severity, drug and ADEs, drug and ADRs. Recurrent neural networks (RNN) and BiLSTM-CRF had the best results in detecting ADEs compared to other patient safety events. Linear classifiers and Naive Bayes (NB) had the highest performance for ADR detection. Logistic regression had the best results in detecting surgical site infections. According to the findings, the quality of articles has non-significantly improved in recent years, but they had low average scores.

CONCLUSIONS

Machine learning can be useful in automatic detection and prediction of patient safety events. However, most of these algorithms have not yet been externally validated or prospectively tested. Therefore, further studies are required to improve the performance of these automated systems.

Data-Driven Technologies as Enablers for Value Creation in the Prevention of Surgical Site Infections: a Systematic Review

Despite the advances in modern medicine, the use of data-driven technologies (DDTs) to prevent surgical site infections (SSIs) remains a major challenge. Scholars recognise that data management is the next frontier in infection prevention, but many aspects related to the benefits and advantages of using DDTs to mitigate SSI risk factors remain unclear and underexplored in the literature. This study explores how DDTs enable value creation in the prevention of SSIs. This study follows a systematic literature review approach and the PRISMA statement to analyse peer-reviewed articles from seven databases. Fifty-nine articles were included in the review and were analysed through a descriptive and a thematic analysis. The findings suggest a growing interest in DDTs in SSI prevention in the last 5 years, and that machine learning and smartphone applications are widely used in SSI prevention. DDTs are mainly applied to prevent SSIs in clean and clean-contaminated surgeries and often used to manage patient-related data in the postoperative stage. DDTs enable the creation of nine categories of value that are classified in four dimensions: cost/sacrifice, functional/instrumental, experiential/hedonic, and symbolic/expressive. This study offers a unique and systematic overview of the value creation aspects enabled by DDT applications in SSI prevention and suggests that additional research is needed in four areas: value co-creation and product-service systems, DDTs in contaminated and dirty surgeries, data legitimation and explainability, and data-driven interventions.

Supplementary Information

The online version contains supplementary material available at 10.1007/s41666-023-00129-2.

Performance of machine learning algorithms for surgical site infection case detection and prediction: A systematic review and meta-analysis

Background

Medical researchers and clinicians have shown much interest in developing machine learning (ML) algorithms to detect/predict surgical site infections (SSIs). However, little is known about the overall performance of ML algorithms in predicting SSIs and how to improve the algorithm's robustness. We conducted a systematic review and meta-analysis to summarize the performance of ML algorithms in SSIs case detection and prediction and to describe the impact of using unstructured and textual data in the development of ML algorithms.

Methods

MEDLINE, EMBASE, CINAHL, CENTRAL and Web of Science were searched from inception to March 25, 2021. Study characteristics and algorithm development information were extracted. Performance statistics (e.g., sensitivity, area under the receiver operating characteristic curve [AUC]) were pooled using a random effect model. Stratified analysis was applied to different study characteristic levels. Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Diagnostic Test Accuracy Studies (PRISMA-DTA) was followed.

Results

Of 945 articles identified, 108 algorithms from 32 articles were included in this review. The overall pooled estimate of the SSI incidence rate was 3.67%, 95% CI: 3.58-3.76. Mixed-use of structured and textual data-based algorithms (pooled estimates of sensitivity 0.83, 95% CI: 0.78-0.87, specificity 0.92, 95% CI: 0.86-0.95, AUC 0.92, 95% CI: 0.89-0.94) outperformed algorithms solely based on structured data (sensitivity 0.56, 95% CI:0.43-0.69, specificity 0.95, 95% CI:0.91-0.97, AUC = 0.90, 95% CI: 0.87-0.92).

Conclusions

ML algorithms developed with structured and textual data provided optimal performance. External validation of ML algorithms is needed to translate current knowledge into clinical practice.

Using machine learning for the personalised prediction of revision endoscopic sinus surgery

BACKGROUND

Revision endoscopic sinus surgery (ESS) is often considered for chronic rhinosinusitis (CRS) if maximal conservative treatment and baseline ESS prove insufficient. Emerging research outlines the risk factors of revision ESS. However, accurately predicting revision ESS at the individual level remains uncertain. This study aims to examine the prediction accuracy of revision ESS and to identify the effects of risk factors at the individual level.

METHODS

We collected demographic and clinical variables from the electronic health records of 767 surgical CRS patients ≥16 years of age. Revision ESS was performed on 111 (14.5%) patients. The prediction accuracy of revision ESS was examined by training and validating different machine learning models, while the effects of variables were analysed using the Shapley values and partial dependence plots.

RESULTS

The logistic regression, gradient boosting and random forest classifiers performed similarly in predicting revision ESS. Area under the receiving operating characteristic curve (AUROC) values were 0.744, 0.741 and 0.730, respectively, using data collected from the baseline visit until six months after baseline ESS. The length of time during which data were collected improved the prediction performance. For data collection times of 0, 3, 6 and 12 months after baseline ESS, AUROC values for the logistic regression were 0.682, 0.715, 0.744 and 0.784, respectively. The number of visits before or after baseline ESS, the number of days from the baseline visit to the baseline ESS, patient age, CRS with nasal polyps (CRSwNP), asthma, non-steroidal anti-inflammatory drug exacerbated respiratory disease and immunodeficiency or suspicion of it all associated with revision ESS. Patient age and number of visits before baseline ESS carried non-linear effects for predictions.

CONCLUSIONS

Intelligent data analysis identified important predictors of revision ESS at the individual level, such as the frequency of clinical visits, patient age, Type 2 high diseases and immunodeficiency or a suspicion of it.

Machine Learning and Lean Six Sigma to Assess How COVID-19 Has Changed the Patient Management of the Complex Operative Unit of Neurology and Stroke Unit: A Single Center Study

Background: In health, it is important to promote the effectiveness, efficiency and adequacy of the services provided; these concepts become even more important in the era of the COVID-19 pandemic, where efforts to manage the disease have absorbed all hospital resources. The COVID-19 emergency led to a profound restructuring-in a very short time-of the Italian hospital system. Some factors that impose higher costs on hospitals are inappropriate hospitalization and length of stay (LOS). The length of stay (LOS) is a very useful parameter for the management of services within the hospital and is an index evaluated for the management of costs. Methods: This study analyzed how COVID-19 changed the activity of the Complex Operative Unit (COU) of the Neurology and Stroke Unit of the San Giovanni di Dio e Ruggi d'Aragona University Hospital of Salerno (Italy). The methodology used in this study was Lean Six Sigma. Problem solving in Lean Six Sigma is the DMAIC roadmap, characterized by five operational phases. To add even more value to the processing, a single clinical case, represented by stroke patients, was investigated to verify the specific impact of the pandemic. Results: The results obtained show a reduction in LOS for stroke patients and an increase in the value of the diagnosis related group relative weight. Conclusions: This work has shown how, thanks to the implementation of protocols for the management of the COU of the Neurology and Stroke Unit, the work of doctors has improved, and this is evident from the values of the parameters taken into consideration.

Advancements of Artificial Intelligence in Liver-Associated Diseases and Surgery

Background and Objectives: The advancement of artificial intelligence (AI) based technologies in medicine is progressing rapidly, but the majority of its real-world applications has not been implemented. The establishment of an accurate diagnosis with treatment has now transitioned into an artificial intelligence era, which has continued to provide an amplified understanding of liver cancer as a disease and helped to proceed better with the method of procurement. This article focuses on reviewing the AI in liver-associated diseases and surgical procedures, highlighting its development, use, and related counterparts. Materials and Methods: We searched for articles regarding AI in liver-related ailments and surgery, using the keywords (mentioned below) on PubMed, Google Scholar, Scopus, MEDLINE, and Cochrane Library. Choosing only the common studies suggested by these libraries, we segregated the matter based on disease. Finally, we compiled the essence of these articles under the various sub-headings. Results: After thorough review of articles, it was observed that there was a surge in the occurrence of liver-related surgeries, diagnoses, and treatments. Parallelly, advanced computer technologies governed by AI continue to prove their efficacy in the accurate screening, analysis, prediction, treatment, and recuperation of liver-related cases. Conclusions: The continual developments and high-order precision of AI is expanding its roots in all directions of applications. Despite being novel and lacking research, AI has shown its intrinsic worth for procedures in liver surgery while providing enhanced healing opportunities and personalized treatment for liver surgery patients.

Research on Rehabilitation Effect Prediction for Patients with SCI Based on Machine Learning

OBJECTIVE

Due to the complex condition of Spinal Cord Injury (SCI) patients, it is difficult to accurately calculate the Activity of Daily Living (ADL) score of discharged patients. In view of the above problem, this research proposes a prediction model of discharged ADL score based on machine learning, in order to get the rehabilitation effect of patients after rehabilitation training.

METHODS

Firstly, the medical records of 1231 SCI patients were collected, and the corresponding data preprocessing was carried out. Secondly, Pearson Correlation Coefficient method (PCC) was combined with feature selection method based on Random Forest (RF) to screen out six features closely related to discharged ADL score. Then RF and RF optimized by Harris Hawks Optimizer (HHO-RF) were used to predict discharged ADL score of SCI patients. The Mean Absolute Error (MAE), Root Mean Squared Error (RMSE) and Coefficient of determination () were used as evaluation indicators of the model.

RESULTS

The prediction features selected by feature extraction were ADL score on admission, age, injury segment, injury reason, injury position, and injury degree. After 10-fold cross-validation, MAE, RMSE and of RF were 0.0875, 0.1346 and 0.7662. MAE, RMSE and of HHO-RF were 0.0821, 0.1089 and 0.8537. The prediction effect of HHO-RF has been greatly improved.

CONCLUSIONS

In clinical treatment, HHO-RF can accurately predict discharged ADL score and provide a reasonable direction for patients to choose rehabilitation programs.

Clinically relevant features for predicting the severity of surgical site infections

Surgical site infections are hospital-acquired infections resulting in severe risk for patients and significantly increased costs for healthcare providers. In this work, we show how to leverage irregularly sampled preoperative blood tests to predict, on the day of surgery, a future surgical site infection and its severity. Our dataset is extracted from the electronic health records of patients who underwent gastrointestinal surgery and developed either deep, shallow or no infection. We represent the patients using the concentrations of fourteen common blood components collected over the four weeks preceding the surgery partitioned into six time windows. A gradient boosting based classifier trained on our new set of features reports, respectively, an AUROC of 0:991 and 0:937 at predicting a postoperative infection and the severity thereof. Further analyses support the clinical relevance of our approach as the most important features describe the nutritional status and the liver function over the two weeks prior to surgery.

Artificial intelligence in perioperative management of major gastrointestinal surgeries

Artificial intelligence (AI) demonstrated by machines is based on reinforcement learning and revolves around the usage of algorithms. The purpose of this review was to summarize concepts, the scope, applications, and limitations in major gastrointestinal surgery. This is a narrative review of the available literature on the key capabilities of AI to help anesthesiologists, surgeons, and other physicians to understand and critically evaluate ongoing and new AI applications in perioperative management. AI uses available databases called "big data" to formulate an algorithm. Analysis of other data based on these algorithms can help in early diagnosis, accurate risk assessment, intraoperative management, automated drug delivery, predicting anesthesia and surgical complications and postoperative outcomes and can thus lead to effective perioperative management as well as to reduce the cost of treatment. Perioperative physicians, anesthesiologists, and surgeons are well-positioned to help integrate AI into modern surgical practice. We all need to partner and collaborate with data scientists to collect and analyze data across all phases of perioperative care to provide clinical scenarios and context. Careful implementation and use of AI along with real-time human interpretation will revolutionize perioperative care, and is the way forward in future perioperative management of major surgery.