1
|
Nicora G, Catalano M, Bortolotto C, Achilli MF, Messana G, Lo Tito A, Consonni A, Cutti S, Comotto F, Stella GM, Corsico A, Perlini S, Bellazzi R, Bruno R, Preda L. Bayesian Networks in the Management of Hospital Admissions: A Comparison between Explainable AI and Black Box AI during the Pandemic. J Imaging 2024; 10:117. [PMID: 38786571 PMCID: PMC11122655 DOI: 10.3390/jimaging10050117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 04/24/2024] [Accepted: 05/06/2024] [Indexed: 05/25/2024] Open
Abstract
Artificial Intelligence (AI) and Machine Learning (ML) approaches that could learn from large data sources have been identified as useful tools to support clinicians in their decisional process; AI and ML implementations have had a rapid acceleration during the recent COVID-19 pandemic. However, many ML classifiers are "black box" to the final user, since their underlying reasoning process is often obscure. Additionally, the performance of such models suffers from poor generalization ability in the presence of dataset shifts. Here, we present a comparison between an explainable-by-design ("white box") model (Bayesian Network (BN)) versus a black box model (Random Forest), both studied with the aim of supporting clinicians of Policlinico San Matteo University Hospital in Pavia (Italy) during the triage of COVID-19 patients. Our aim is to evaluate whether the BN predictive performances are comparable with those of a widely used but less explainable ML model such as Random Forest and to test the generalization ability of the ML models across different waves of the pandemic.
Collapse
Affiliation(s)
- Giovanna Nicora
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy; (G.N.); (R.B.)
| | - Michele Catalano
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
| | - Chandra Bortolotto
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
- Radiology Institute, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy
| | - Marina Francesca Achilli
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
| | - Gaia Messana
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
| | - Antonio Lo Tito
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
| | - Alessio Consonni
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
| | - Sara Cutti
- Medical Direction, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy;
| | | | - Giulia Maria Stella
- Department of Internal Medicine and Therapeutics, University of Pavia, 27100 Pavia, Italy; (G.M.S.); (A.C.); (S.P.)
- Unit of Respiratory Diseases, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy
| | - Angelo Corsico
- Department of Internal Medicine and Therapeutics, University of Pavia, 27100 Pavia, Italy; (G.M.S.); (A.C.); (S.P.)
- Unit of Respiratory Diseases, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy
| | - Stefano Perlini
- Department of Internal Medicine and Therapeutics, University of Pavia, 27100 Pavia, Italy; (G.M.S.); (A.C.); (S.P.)
- Department of Emergency, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy; (G.N.); (R.B.)
| | - Raffaele Bruno
- Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy;
- Unit of Infectious Diseases, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy
| | - Lorenzo Preda
- Diagnostic Imaging and Radiotherapy Unit, Department of Clinical, Surgical, Diagnostic and Pediatric Sciences, University of Pavia, 27100 Pavia, Italy; (M.C.); (M.F.A.); (G.M.); (A.L.T.); (A.C.); (L.P.)
- Radiology Institute, Fondazione IRCCS Policlinico San Matteo, 27100 Pavia, Italy
| |
Collapse
|
2
|
Razbek J, Bao L, Zhang Y, Daken M, Cao M. Causal association study of the dynamic development of the metabolic syndrome based on longitudinal data. Sci Rep 2024; 14:5448. [PMID: 38443462 PMCID: PMC10914715 DOI: 10.1038/s41598-024-55693-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 02/27/2024] [Indexed: 03/07/2024] Open
Abstract
The dynamic progression of metabolic syndrome (MetS) includes developmental deterioration and reverse recovery; however, the key factors in this bidirectional progression have not been identified. Our study aimed to use the data obtained from the China Health and Retirement Longitudinal Study (CHARLS) and construct a Bayesian network to explore the causal relationship between influential factor and the development and recovery of MetS. Followed up at 4 years, forward progression of MetS occurred in 1543 and reverse recovery of MetS occurred in 1319 of 5581 subjects. Bayesian Networks showed that hyperuricemia and body mass index (BMI) levels directly influenced progression of MetS, and gender, exercise and age play an indirect role through hyperuricemia and BMI levels; high hemoglobin A1c (HbA1c) and BMI levels directly influenced recovery of MetS, and gender and exercise play an indirect role through BMI levels. Bayesian Network inference found that the rate of progression of MetS in subjects with hyperuricemia increases from 36 to 60%, the rate of progression of MetS in subjects with overweight or obese increases from 36 to 41% and the rate of reverse recovery rate of MetS in subjects with high HbA1c decreased from 33 to 20%. Therefore, attention to individuals at high risk of hyperuricemia, high HbA1c levels, and overweight/obesity should be enhanced, with early detection and following healthy behavioral interventions to prevent, control and delay the progression of MetS and its components.
Collapse
Affiliation(s)
- Jaina Razbek
- Department of Epidemiology and Health Statistics, College of Public Health, Xinjiang Medical University, Urumqi, China
| | - Liangliang Bao
- Department of Postgraduate Management Section, The Fourth Affiliated Hospital of Xinjiang Medical University, Urumqi, China
| | - Yan Zhang
- Department of Epidemiology and Health Statistics, College of Public Health, Xinjiang Medical University, Urumqi, China
| | - Mayisha Daken
- Department of Epidemic Prevention, Karamay Centre for Disease Control and Prevention, Karamay, China
| | - Mingqin Cao
- Department of Epidemiology and Health Statistics, College of Public Health, Xinjiang Medical University, Urumqi, China.
| |
Collapse
|
3
|
Chaieb S, Ben Mrad A, Hnich B. From Personal Observations to Recommendation of Tailored Interventions based on Causal Reasoning: a case study of Falls Prevention in Elderly Patients. Int J Med Inform 2022; 163:104765. [PMID: 35461148 DOI: 10.1016/j.ijmedinf.2022.104765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 03/31/2022] [Accepted: 04/12/2022] [Indexed: 10/18/2022]
Abstract
OBJECTIVE While the challenge of estimating the efficacy of therapies using observational data has received a lot of attention, little work has been done on estimating the treatment effect from interventions. In this paper, we tackle this problem by proposing an early guidance system based on a causal Bayesian network (CBN) for recommending personalized interventions. We are interested in the elderly fall prevention context. The objective is to develop a practical tool to help doctors estimate the effects of each intervention (or compound interventions) on a given patient and then choose the one that best fits each patient's health situation to reduce the risk of falling. METHODS On a real-world elderly information base, we undertake an empirical investigation for the proposed approach, which is based on a 44-node CBN. Then, we describe what is possible to achieve using state-of-the-art machine learning methods, namely Support Virtual Machine (SVM), Decision Tree (DT), and Bayesian Network (BN), and how well these methods can be used in recommending personalized interventions compared to the proposed approach. RESULTS 1174 elderly patients from Lille University Hospital, between January 2005 and December 2018 are included. The results reveal that none of the classifiers is significantly superior to the others, even if BN delivers somewhat better results (41.6%) and DT most often slightly lower performance (31.2%). Results also show that none of these three classifiers performs comparable to the proposed system (89.7%). The interventions recommended by the system are in agreement with the expert's judgment to a satisfactory level. The reaction of the physicians to the proposed system in its first trial version was very favorable. CONCLUSION The study showed the efficacy and utility of the causality-based strategy in recommending tailored interventions to prevent elderly falls compared to automated learning methods that had failed to infer a solid interventional paradigm for precision medicine.
Collapse
Affiliation(s)
- Salma Chaieb
- University of Sousse, ISITCom, 4011 Sousse, Tunisia; University of Sfax, CES Lab, 3038 Sfax, Tunisia.
| | - Ali Ben Mrad
- University of Sfax, ISAAS, 1013 Sfax, Tunisia; University of Sfax, CES Lab, 3038 Sfax, Tunisia
| | - Brahim Hnich
- University of Monastir, FSM, 5000 Monastir, Tunisia; University of Sfax, CES Lab, 3038 Sfax, Tunisia.
| |
Collapse
|