1
|
Zhang H, Zou P, Luo P, Jiang X. Machine Learning for the Early Prediction of Delayed Cerebral Ischemia in Patients With Subarachnoid Hemorrhage: Systematic Review and Meta-Analysis. J Med Internet Res 2025; 27:e54121. [PMID: 39832368 PMCID: PMC11791451 DOI: 10.2196/54121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 10/14/2024] [Accepted: 11/26/2024] [Indexed: 01/22/2025] Open
Abstract
BACKGROUND Delayed cerebral ischemia (DCI) is a primary contributor to death after subarachnoid hemorrhage (SAH), with significant incidence. Therefore, early determination of the risk of DCI is an urgent need. Machine learning (ML) has received much attention in clinical practice. Recently, some studies have attempted to apply ML models for early noninvasive prediction of DCI. However, systematic evidence for its predictive accuracy is still lacking. OBJECTIVE The aim of this study was to synthesize the prediction accuracy of ML models for DCI to provide evidence for the development or updating of intelligent detection tools. METHODS PubMed, Cochrane, Embase, and Web of Science databases were systematically searched up to May 18, 2023. The risk of bias in the included studies was assessed using PROBAST (Prediction Model Risk of Bias Assessment Tool). During the analysis, we discussed the performance of different models in the training and validation sets. RESULTS We finally included 48 studies containing 16,294 patients with SAH and 71 ML models with logistic regression as the main model type. In the training set, the pooled concordance index (C index), sensitivity, and specificity of all the models were 0.786 (95% CI 0.737-0.835), 0.77 (95% CI 0.69-0.84), and 0.83 (95% CI 0.75-0.89), respectively, while those of the logistic regression models were 0.770 (95% CI 0.724-0.817), 0.75 (95% CI 0.67-0.82), and 0.71 (95% CI 0.63-0.78), respectively. In the validation set, the pooled C index, sensitivity, and specificity of all the models were 0.767 (95% CI 0.741-0.793), 0.66 (95% CI 0.53-0.77), and 0.78 (95% CI 0.71-0.84), respectively, while those of the logistic regression models were 0.757 (95% CI 0.715-0.800), 0.59 (95% CI 0.57-0.80), and 0.80 (95% CI 0.71-0.87), respectively. CONCLUSIONS ML models appear to have relatively desirable power for early noninvasive prediction of DCI after SAH. However, enhancing the prediction sensitivity of these models is challenging. Therefore, efficient, noninvasive, or minimally invasive low-cost predictors should be further explored in future studies to improve the prediction accuracy of ML models. TRIAL REGISTRATION PROSPERO (CRD42023438399); https://tinyurl.com/yfuuudde.
Collapse
Affiliation(s)
- Haofuzi Zhang
- Department of Neurosurgery, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Peng Zou
- Department of Neurosurgery, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Peng Luo
- Department of Neurosurgery, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| | - Xiaofan Jiang
- Department of Neurosurgery, Xijing Hospital, Fourth Military Medical University, Xi'an, China
| |
Collapse
|
2
|
Zhang C, Tang W, Cheng L, Yang C, Wang T, Wang J, Miao Z, Zhao X, Fang X, Zhou Y. Early and delayed blood-brain barrier permeability predicts delayed cerebral ischemia and outcomes following aneurysmal subarachnoid hemorrhage. Eur Radiol 2024; 34:5287-5296. [PMID: 38221580 DOI: 10.1007/s00330-023-10571-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 11/27/2023] [Accepted: 12/12/2023] [Indexed: 01/16/2024]
Abstract
OBJECTIVES This study aimed to monitor blood-brain barrier permeability within 24 h and during the delayed cerebral ischemia (DCI) time window (DCITW) spanning 4-14 days after aneurysmal subarachnoid hemorrhage (aSAH) and to investigate its correlation with both DCI occurrence and outcomes at three months. METHODS A total of 128 patients were stratified based on the DCI occurrence and three-month modified Rankin scale scores. Comparison of Ktrans at admission (admission Ktrans) and during DCITW (DCITW Ktrans) was conducted between DCI and non-DCI groups, as well as between groups with good and poor outcomes. Changes in Ktrans were also analyzed. Multivariate logistic regression analysis was performed to identify independent predictors of DCI and poor outcomes. RESULTS Admission Ktrans (0.58 ± 0.18 vs 0.47 ± 0.12, p = 0.002) and DCITW Ktrans (0.54 ± 0.19 vs 0.41 ± 0.14, p < 0.001) were significantly higher in the DCI group compared with the non-DCI group. Although both were higher in the poor outcome group than the good outcome group, the difference was not statistically significant at admission (0.53 ± 0.18 vs 0.49 ± 0.14, p = 0.198). Ktrans in the non-DCI group (0.47 ± 0.12 vs 0.41 ± 0.14, p = 0.004) and good outcome group (0.49 ± 0.14 vs 0.41 ± 0.14, p < 0.001) decreased significantly from the admission to DCITW. Multivariate analysis identified DCITW Ktrans and admission Ktrans as independent predictors of poor outcomes (OR = 1.73, 95%CI: 1.24-2.43, p = 0.001) and DCI (OR = 1.75, 95%CI: 1.25-2.44, p = 0.001), respectively. CONCLUSION Elevated Ktrans at admission is associated with the occurrence of DCI. Continuous monitoring of Ktrans from admission to DCITW can accurately identify reversible and irreversible changes and can predict outcomes at 3 months. CLINICAL RELEVANCE STATEMENT Ktrans measured with CT perfusion is a valuable tool for predicting both delayed cerebral ischemia and three-month outcomes following aneurysmal subarachnoid hemorrhage. Monitoring changes in Ktrans from admission to time window of delayed cerebral ischemia can guide treatment and management decisions for aneurysmal subarachnoid hemorrhage patients. KEY POINTS • Ktrans measured at admission and during the delayed cerebral ischemia time window (4-14 days) holds distinct clinical significance following aneurysmal subarachnoid hemorrhage. • Admission Ktrans serves as a predictor for delayed cerebral ischemia, while continuous assessment of Ktrans from admission to the delayed cerebral ischemia time window can predict three-month outcomes. • Monitoring Ktrans at different stages improves instrumental in enhancing decision-making and treatment planning for patients with aneurysmal subarachnoid hemorrhage.
Collapse
Affiliation(s)
- Chao Zhang
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China
| | - Wenjuan Tang
- Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| | - Liang Cheng
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China
| | - Chen Yang
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China
| | - Ting Wang
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China
| | - Juan Wang
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China
| | - Zhuang Miao
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China
| | - Xintong Zhao
- Department of Neurosurgery, Yijishan Hospital of Wannan Medical College, Wuhu, Anhui, China
| | - Xinggen Fang
- Department of Neurosurgery, Yijishan Hospital of Wannan Medical College, Wuhu, Anhui, China
| | - Yunfeng Zhou
- Department of Radiology, Yijishan Hospital of Wannan Medical College, No.2 Zheshan West Road, Wuhu, 241001, Anhui, China.
| |
Collapse
|
3
|
Chikh K, Tonon D, Triglia T, Lagier D, Buisson A, Alessi MC, Defoort C, Benatia S, Velly LJ, Bruder N, Martin JC. Early Metabolic Disruption and Predictive Biomarkers of Delayed-Cerebral Ischemia in Aneurysmal Subarachnoid Hemorrhage. J Proteome Res 2024; 23:316-328. [PMID: 38148664 DOI: 10.1021/acs.jproteome.3c00575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
Delayed cerebral ischemia (DCI) following aneurysmal subarachnoid hemorrhage (aSAH) is a major cause of complications and death. Here, we set out to identify high-performance predictive biomarkers of DCI and its underlying metabolic disruptions using metabolomics and lipidomics approaches. This single-center prospective observational study enrolled 61 consecutive patients with severe aSAH; among them, 22 experienced a DCI. Nine patients without aSAH were included as validation controls. Blood and cerebrospinal fluid (CSF) were sampled within the first 24 h after admission. We identified a panel of 20 metabolites that, together, showed high predictive performance for DCI. This panel of metabolites included lactate, cotinine, salicylate, 6 phosphatidylcholines, and 4 sphingomyelins. The interplay of the metabolome and the lipidome found between CSF and plasma in our patients underscores that aSAH and its associated DCI complications can extend beyond cerebral implications, with a peripheral dimension as well. As an illustration, early biological disruptions that might explain the subsequent DCI found systemic hypoxia driven mainly by higher blood lactate, arginine, and proline metabolism likely associated with vascular NO and disrupted ceramide/sphingolipid metabolism. We conclude that targeting early peripheral hypoxia preceding DCI could provide an interesting strategy for the prevention of vascular dysfunction.
Collapse
Affiliation(s)
- Karim Chikh
- Service de Biochimie et Biologie Moléculaire, Hôpital Lyon Sud, Hospices Civils de Lyon, Pierre-Bénite 69310, France
- Laboratoire CarMeN, Inserm U1060, INRAE U1397, Université de Lyon, Université Claude-Bernard Lyon1, Pierre-Bénite 69310, France
| | - David Tonon
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
- Service d'Anesthésie et Réanimation, Hôpital de La Timone, Marseille 13005, France
| | - Thibaut Triglia
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
- Service d'Anesthésie et Réanimation, Hôpital de La Timone, Marseille 13005, France
| | - David Lagier
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
- Service d'Anesthésie et Réanimation, Hôpital de La Timone, Marseille 13005, France
| | - Anouk Buisson
- Service de Biochimie et Biologie Moléculaire, Hôpital Lyon Sud, Hospices Civils de Lyon, Pierre-Bénite 69310, France
| | - Marie-Christine Alessi
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
| | - Catherine Defoort
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
| | - Sherazade Benatia
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
| | - Lionel J Velly
- Service d'Anesthésie et Réanimation, INT (Institut de Neurosciences de La Timone), Hôpital de La Timone, Aix Marseille Université, Marseille 13005, France
| | - Nicolas Bruder
- Service d'Anesthésie et Réanimation, Hôpital de La Timone, Marseille 13005, France
| | - Jean-Charles Martin
- Centre Cardiovasculaire et Nutrition (C2VN), INRAE, INSERM, Aix Marseille Université, Marseille 13005, France
| |
Collapse
|
4
|
Yearley AG, Goedmakers CMW, Panahi A, Doucette J, Rana A, Ranganathan K, Smith TR. FDA-approved machine learning algorithms in neuroradiology: A systematic review of the current evidence for approval. Artif Intell Med 2023; 143:102607. [PMID: 37673576 DOI: 10.1016/j.artmed.2023.102607] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 05/30/2023] [Accepted: 06/05/2023] [Indexed: 09/08/2023]
Abstract
Over the past decade, machine learning (ML) and artificial intelligence (AI) have become increasingly prevalent in the medical field. In the United States, the Food and Drug Administration (FDA) is responsible for regulating AI algorithms as "medical devices" to ensure patient safety. However, recent work has shown that the FDA approval process may be deficient. In this study, we evaluate the evidence supporting FDA-approved neuroalgorithms, the subset of machine learning algorithms with applications in the central nervous system (CNS), through a systematic review of the primary literature. Articles covering the 53 FDA-approved algorithms with applications in the CNS published in PubMed, EMBASE, Google Scholar and Scopus between database inception and January 25, 2022 were queried. Initial searches identified 1505 studies, of which 92 articles met the criteria for extraction and inclusion. Studies were identified for 26 of the 53 neuroalgorithms, of which 10 algorithms had only a single peer-reviewed publication. Performance metrics were available for 15 algorithms, external validation studies were available for 24 algorithms, and studies exploring the use of algorithms in clinical practice were available for 7 algorithms. Papers studying the clinical utility of these algorithms focused on three domains: workflow efficiency, cost savings, and clinical outcomes. Our analysis suggests that there is a meaningful gap between the FDA approval of machine learning algorithms and their clinical utilization. There appears to be room for process improvement by implementation of the following recommendations: the provision of compelling evidence that algorithms perform as intended, mandating minimum sample sizes, reporting of a predefined set of performance metrics for all algorithms and clinical application of algorithms prior to widespread use. This work will serve as a baseline for future research into the ideal regulatory framework for AI applications worldwide.
Collapse
Affiliation(s)
- Alexander G Yearley
- Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA; Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA.
| | - Caroline M W Goedmakers
- Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA; Department of Neurosurgery, Leiden University Medical Center, Albinusdreef 2, 2333 ZA Leiden, Netherlands
| | - Armon Panahi
- The George Washington University School of Medicine and Health Sciences, 2300 I St NW, Washington, DC 20052, USA
| | - Joanne Doucette
- Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA; School of Pharmacy, MCPHS University, 179 Longwood Ave, Boston, MA 02115, USA
| | - Aakanksha Rana
- Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA; Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139, USA
| | - Kavitha Ranganathan
- Division of Plastic Surgery, Brigham and Women's Hospital, 75 Francis St, Boston, MA 02115, USA
| | - Timothy R Smith
- Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA; Computational Neuroscience Outcomes Center (CNOC), Department of Neurosurgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA
| |
Collapse
|
5
|
Zeng D, Zeng C, Zeng Z, Li S, Deng Z, Chen S, Bian Z, Ma J. Basis and current state of computed tomography perfusion imaging: a review. Phys Med Biol 2022; 67. [PMID: 35926503 DOI: 10.1088/1361-6560/ac8717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 08/04/2022] [Indexed: 12/30/2022]
Abstract
Computed tomography perfusion (CTP) is a functional imaging that allows for providing capillary-level hemodynamics information of the desired tissue in clinics. In this paper, we aim to offer insight into CTP imaging which covers the basics and current state of CTP imaging, then summarize the technical applications in the CTP imaging as well as the future technological potential. At first, we focus on the fundamentals of CTP imaging including systematically summarized CTP image acquisition and hemodynamic parameter map estimation techniques. A short assessment is presented to outline the clinical applications with CTP imaging, and then a review of radiation dose effect of the CTP imaging on the different applications is presented. We present a categorized methodology review on known and potential solvable challenges of radiation dose reduction in CTP imaging. To evaluate the quality of CTP images, we list various standardized performance metrics. Moreover, we present a review on the determination of infarct and penumbra. Finally, we reveal the popularity and future trend of CTP imaging.
Collapse
Affiliation(s)
- Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Cuidie Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhixiong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sui Li
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhen Deng
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sijin Chen
- Department of Medical Imaging Center, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| |
Collapse
|