1
|
Pennisi F, Pinto A, Ricciardi GE, Signorelli C, Gianfredi V. Artificial intelligence in antimicrobial stewardship: a systematic review and meta-analysis of predictive performance and diagnostic accuracy. Eur J Clin Microbiol Infect Dis 2025; 44:463-513. [PMID: 39757287 DOI: 10.1007/s10096-024-05027-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2024] [Accepted: 12/19/2024] [Indexed: 01/07/2025]
Abstract
The increasing threat of antimicrobial resistance has prompted a need for more effective antimicrobial stewardship programs (AMS). Artificial intelligence (AI) and machine learning (ML) tools have emerged as potential solutions to enhance decision-making and improve patient outcomes in AMS. This systematic review and meta-analysis aims to evaluate the impact of AI in AMS and to assess its predictive performance and diagnostic accuracy. We conducted a comprehensive literature search across PubMed/MEDLINE, Scopus, EMBASE, and Web of Science to identify studies published up to July 2024. Studies included were observational, cohort, or retrospective, focusing on the application of AI/ML in AMS. The outcomes assessed were the area under the curve (AUC), accuracy, sensitivity, specificity, negative predictive value (NPV), and positive predictive value (PPV). We calculated the mean pooled effect size (ES) and its 95% confidence interval (CI) using a random-effects model. The risk of bias was assessed using the QUADAS-AI tool, and the protocol was registered in PROSPERO. Out of 3,458 retrieved articles, 80 studies met the inclusion criteria. Our meta-analysis demonstrated that ML models exhibited strong predictive performance and diagnostic accuracy, with the following results: AUC [ES: 72.28 (70.42-74.14)], accuracy [ES: 74.97 (73.35-76.58)], sensitivity [ES: 76.89; (71.90-81.89)], specificity [ES: 73.77; (67.87-79.67)], NPV [ES:79.92 (76.54-83.31)], and PPV [ES: 69.41 (60.19-78.63)] across various AMS settings. AI and ML tools offer promising enhancements due to their strong predictive performance. The integration of AI into AMS could lead to more precise antimicrobial prescribing, reduced antimicrobial resistance, and better resource utilization.
Collapse
Affiliation(s)
- Flavia Pennisi
- PhD National Programme in One Health approaches to infectious diseases and life science research, Department of Public Health, Experimental and Forensic Medicine, University of Pavia, 27100, Pavia, Italy
- Faculty of Medicine, University Vita-Salute San Raffaele, Milan, Italy
| | - Antonio Pinto
- Faculty of Medicine, University Vita-Salute San Raffaele, Milan, Italy
| | - Giovanni Emanuele Ricciardi
- PhD National Programme in One Health approaches to infectious diseases and life science research, Department of Public Health, Experimental and Forensic Medicine, University of Pavia, 27100, Pavia, Italy
- Faculty of Medicine, University Vita-Salute San Raffaele, Milan, Italy
| | - Carlo Signorelli
- Faculty of Medicine, University Vita-Salute San Raffaele, Milan, Italy
| | - Vincenza Gianfredi
- Department of Biomedical Sciences for Health, University of Milan, Via Pascal 36, 20133, Milan, Italy.
| |
Collapse
|
2
|
Wang WY, Chiu CF, Tsao SM, Lee YL, Chen YH. Accurate prediction of antimicrobial resistance and genetic marker of Staphylococcus aureus clinical isolates using MALDI-TOF MS and machine learning - across DRIAMS and Taiwan database. Int J Antimicrob Agents 2024; 64:107329. [PMID: 39244164 DOI: 10.1016/j.ijantimicag.2024.107329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 07/22/2024] [Accepted: 08/30/2024] [Indexed: 09/09/2024]
Abstract
BACKGROUND The use of matrix-assisted laser desorption/ionisation-time-of-flight mass spectra (MALDI-TOF MS) with machine learning (ML) has been explored for predicting antimicrobial resistance. This study evaluates the effectiveness of MALDI-TOF MS paired with various ML classifiers and establishes optimal models for predicting antimicrobial resistance and the presence of mecA gene among Staphylococcus aureus. MATERIALS AND METHODS Antimicrobial resistance against tier 1 antibiotics and MALDI-TOF MS of S. aureus were analysed using data from the Database of Resistance against Antimicrobials with MALDI-TOF Mass Spectrometry (DRIAMS) and one medical centre (CS database). Five ML classifiers were used to analyse performance metrics. The Shapley value quantified the predictive contribution of individual features. RESULTS The LightGBM demonstrated superior performance in predicting antimicrobial resistance for most tier 1 antibiotics among oxacillin-resistant S. aureus (ORSA) compared with all S. aureus and oxacillin-susceptible S. aureus (OSSA) in both databases. In DRIAMS, Multilayer Perceptron (MLP) was associated with excellent predictive performance, expressed as accuracy/AUROC/AUPR, for clindamycin (0.74/0.81/0.90), tetracycline (0.86/0.87/0.94), and trimethoprim-sulfamethoxazole (0.95/0.72/0.97). In the CS database, Ada and Light Gradient Boosting Machine (LightGBM) showed excellent performance for erythromycin (0.97/0.92/0.86) and tetracycline (0.68/0.79/0.86). Mass-to-charge ratio (m/z) features of 2411-2414 and 2429-2432 correlated with clindamycin resistance, whereas 5033-5036 was linked to erythromycin resistance in DRIAMS. In the CS database, overlapping features of 2423-2426, 4496-4499, and 3764-3767 simultaneously predicted the presence of mecA and oxacillin resistance. CONCLUSION The predictive performance of antimicrobial resistance against S. aureus using MALDI-TOF MS depends on database characteristics and the ML algorithm selected. Specific and overlapping mass spectra features are excellent predictive markers for mecA and specific antimicrobial resistance.
Collapse
Affiliation(s)
- Wei-Yao Wang
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan; Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung, Taiwan
| | - Chen-Feng Chiu
- Department of Internal Medicine, Feng Yuan Hospital, Ministry of Health and Welfare, Taichung, Taiwan
| | - Shih-Ming Tsao
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan; Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung, Taiwan
| | - Yu-Lin Lee
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan; Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung, Taiwan
| | - Yi-Hsin Chen
- Department of Nephrology, Taichung Tzu Chi Hospital, Taichung, Taiwan; School of Medicine, Tzu Chi University, Hualien, Taiwan; Department of Artificial Intelligence and Data Science, National Chung Hsing University, Taichung, Taiwan.
| |
Collapse
|
3
|
López-Cortés XA, Manríquez-Troncoso JM, Kandalaft-Letelier J, Cuadros-Orellana S. Machine learning and matrix-assisted laser desorption/ionization time-of-flight mass spectra for antimicrobial resistance prediction: A systematic review of recent advancements and future development. J Chromatogr A 2024; 1734:465262. [PMID: 39197363 DOI: 10.1016/j.chroma.2024.465262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 08/06/2024] [Accepted: 08/12/2024] [Indexed: 09/01/2024]
Abstract
BACKGROUND The use of matrix-assisted laser desorption/ionization time-of-flight mass spectra (MALDI-TOF MS) combined with machine learning techniques has recently emerged as a method to address the public health crisis of antimicrobial resistance. This systematic review, conducted following Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines, aims to evaluate the current state of the art in using machine learning for the detection and classification of antimicrobial resistance from MALDI-TOF mass spectrometry data. METHODS A comprehensive review of the literature on machine learning applications for antimicrobial resistance detection was performed using databases such as Web Of Science, Scopus, ScienceDirect, IEEE Xplore, and PubMed. Only original articles in English were included. Studies applying machine learning without using MALDI-TOF mass spectra were excluded. RESULTS Forty studies met the inclusion criteria. Staphylococcus aureus, Klebsiella pneumoniae and Escherichia coli were the most frequently cited bacteria. The antibiotics resistance most studied corresponds to methicillin for S. aureus, cephalosporins for K. pneumoniae, and aminoglycosides for E. coli. Random forest, support vector machine and logistic regression were the most employed algorithms to predict antimicrobial resistance. Additionally, seven studies reported using artificial neural networks. Most studies reported metrics such as accuracy, sensitivity, specificity, and the area under the receiver operating characteristic (AUROC) above 0.80. CONCLUSIONS Our study indicates that random forest, support vector machine, and logistic regression are effective for predicting antimicrobial resistance using MALDI-TOF MS data. Recent studies also highlight the potential of deep learning techniques in this area. We recommend further exploration of deep learning and multi-label supervised learning for comprehensive antibiotic resistance prediction in clinical practice.
Collapse
Affiliation(s)
- Xaviera A López-Cortés
- Department of Computer Sciences and Industries, Universidad Católica del Maule, Talca, 3480112, Chile; Centro de Innovación en Ingeniería Aplicada (CIIA), Universidad Católica del Maule, Talca, 3480112, Chile.
| | - José M Manríquez-Troncoso
- Department of Computer Sciences and Industries, Universidad Católica del Maule, Talca, 3480112, Chile
| | - John Kandalaft-Letelier
- Department of Computer Sciences and Industries, Universidad Católica del Maule, Talca, 3480112, Chile
| | - Sara Cuadros-Orellana
- Centro de Biotecnología de los Recursos Naturales, Universidad Católica del Maule, Talca, 3480112, Chile
| |
Collapse
|
4
|
Ma WH, Chang CC, Lin TS, Chen YC. Distinguishing methicillin-resistant Staphylococcus aureus from methicillin-sensitive strains by combining Fe 3O 4 magnetic nanoparticle-based affinity mass spectrometry with a machine learning strategy. Mikrochim Acta 2024; 191:273. [PMID: 38635063 PMCID: PMC11026280 DOI: 10.1007/s00604-024-06342-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 03/30/2024] [Indexed: 04/19/2024]
Abstract
Pathogenic bacteria, including drug-resistant variants such as methicillin-resistant Staphylococcus aureus (MRSA), can cause severe infections in the human body. Early detection of MRSA is essential for clinical diagnosis and proper treatment, considering the distinct therapeutic strategies for methicillin-sensitive S. aureus (MSSA) and MRSA infections. However, the similarities between MRSA and MSSA properties present a challenge in promptly and accurately distinguishing between them. This work introduces an approach to differentiate MRSA from MSSA utilizing matrix-assisted laser desorption ionization mass spectrometry (MALDI-MS) in conjunction with a neural network-based classification model. Four distinct strains of S. aureus were utilized, comprising three MSSA strains and one MRSA strain. The classification accuracy of our model ranges from ~ 92 to ~ 97% for each strain. We used deep SHapley Additive exPlanations to reveal the unique feature peaks for each bacterial strain. Furthermore, Fe3O4 MNPs were used as affinity probes for sample enrichment to eliminate the overnight culture and reduce the time in sample preparation. The limit of detection of the MNP-based affinity approach toward S. aureus combined with our machine learning strategy was as low as ~ 8 × 103 CFU mL-1. The feasibility of using the current approach for the identification of S. aureus in juice samples was also demonstrated.
Collapse
Affiliation(s)
- Wei-Hsiang Ma
- Department of Applied Chemistry, National Yang Ming Chiao Tung University, Hsinchu, 300, Taiwan
| | - Che-Chia Chang
- Department of Applied Mathematics, National Yang Ming Chiao Tung University, Hsinchu, 300, Taiwan
- Institute of Artificial Intelligence Innovation, National Yang Ming Chiao Tung University, Hsinchu, 300, Taiwan
| | - Te-Sheng Lin
- Department of Applied Mathematics, National Yang Ming Chiao Tung University, Hsinchu, 300, Taiwan.
- National Center for Theoretical Sciences, National Taiwan University, Taipei, 10617, Taiwan.
| | - Yu-Chie Chen
- Department of Applied Chemistry, National Yang Ming Chiao Tung University, Hsinchu, 300, Taiwan.
- International College of Semiconductor Technology, National Yang Ming Chiao Tung University, Hsinchu, 300, Taiwan.
| |
Collapse
|
5
|
Chu HY, Chen LC, Kuo TR, Shih CC, Yougbaré S, Chen YH, Cheng TM. Haptoglobin-Conjugated Gold Nanoclusters as a Nanoantibiotic to Combat Bacteremia. NANOMATERIALS (BASEL, SWITZERLAND) 2022; 12:3596. [PMID: 36296784 PMCID: PMC9611519 DOI: 10.3390/nano12203596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 10/07/2022] [Accepted: 10/09/2022] [Indexed: 06/16/2023]
Abstract
Gold nanoclusters have revealed great potential as nanoantibiotics due to their superior chemical and physical characteristics. In this study, a peptide with 83 amino acids derived from haptoglobin was utilized as a surface ligand to synthesize gold nanoclusters via a facile hydrothermal approach. Characterization of the structural and optical properties demonstrated the successful synthesis of derived haptoglobin-conjugated gold nanoclusters. The spherical derived haptoglobin-conjugated gold nanoclusters exhibited a (111) plane of cubic gold and an ultra-small size of 3.6 ± 0.1 nm. The optical properties such as ultraviolet-visible absorption spectra, X-ray photoelectron spectroscopy spectra, fluorescence spectra, and Fourier transform infrared spectra also validated the successful conjugation between the derived haptoglobin peptide and the gold nanoclusters surface. The antibacterial activity, reactive oxygen species production, and antibacterial mechanisms of derived haptoglobin-conjugated gold nanoclusters were confirmed by culturing the bacterium Escherichia coli with hemoglobin to simulate bacteremia. The surface ligand of the derived haptoglobin peptide of derived haptoglobin-conjugated gold nanoclusters was able to conjugate with hemoglobin to inhibit the growth of Escherichia coli. The derived haptoglobin-conjugated gold nanoclusters with an ultra-small size also induced reactive oxygen species production, which resulted in the death of Escherichia coli. The superior antibacterial activity of derived haptoglobin-conjugated gold nanoclusters can be attributed to the synergistic effect of the surface ligand of the derived haptoglobin peptide and the ultra-small size. Our work demonstrated derived haptoglobin-conjugated gold nanoclusters as a promising nanoantibiotic for combating bacteremia.
Collapse
Affiliation(s)
- Hsiu-Yi Chu
- Graduate Institute for Translational Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei 11031, Taiwan
- Graduate Institute of Biomedical Materials and Tissue Engineering, College of Biomedical Engineering, Taipei Medical University, Taipei 11031, Taiwan
| | - Lung-Ching Chen
- Division of Cardiology, Department of Internal Medicine, Shin Kong Wu Ho-Su Memorial Hospital, Taipei 111045, Taiwan
| | - Tsung-Rong Kuo
- International Ph.D. Program in Biomedical Engineering, College of Biomedical Engineering, Taipei Medical University, Taipei 11031, Taiwan
- Graduate Institute of Nanomedicine and Medical Engineering, College of Biomedical Engineering, Taipei Medical University, Taipei 11031, Taiwan
| | - Chun-Che Shih
- Taipei Heart Institute, Taipei Medical University, Taipei 11031, Taiwan
- Division of Cardiovascular Surgery, Department of Surgery, Wan Fang Hospital, Taipei Medical University, Taipei 11696, Taiwan
- Institute of Clinical Medicine, National Yang Ming Chiao Tung University, Taipei 11230, Taiwan
- Department of Surgery, School of Medicine, College of Medicine, Taipei Medical University, Taipei 11031, Taiwan
| | - Sibidou Yougbaré
- Institut de Recherche en Sciences de La Santé/Direction Régionale du Centre Ouest (IRSS/DRCO), Nanoro BP 218, 11, Burkina Faso
| | - Yu-Han Chen
- Graduate Institute for Translational Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei 11031, Taiwan
| | - Tsai-Mu Cheng
- Graduate Institute for Translational Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei 11031, Taiwan
- Taipei Heart Institute, Taipei Medical University, Taipei 11031, Taiwan
| |
Collapse
|