1
|
Kuo CH, Liu GT, Lee CE, Wu J, Casimo K, Weaver KE, Lo YC, Chen YY, Huang WC, Ojemann JG. Decoding micro-electrocorticographic signals by using explainable 3D convolutional neural network to predict finger movements. J Neurosci Methods 2024; 411:110251. [PMID: 39151656 DOI: 10.1016/j.jneumeth.2024.110251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 08/05/2024] [Accepted: 08/13/2024] [Indexed: 08/19/2024]
Abstract
BACKGROUND Electroencephalography (EEG) and electrocorticography (ECoG) recordings have been used to decode finger movements by analyzing brain activity. Traditional methods focused on single bandpass power changes for movement decoding, utilizing machine learning models requiring manual feature extraction. NEW METHOD This study introduces a 3D convolutional neural network (3D-CNN) model to decode finger movements using ECoG data. The model employs adaptive, explainable AI (xAI) techniques to interpret the physiological relevance of brain signals. ECoG signals from epilepsy patients during awake craniotomy were processed to extract power spectral density across multiple frequency bands. These data formed a 3D matrix used to train the 3D-CNN to predict finger trajectories. RESULTS The 3D-CNN model showed significant accuracy in predicting finger movements, with root-mean-square error (RMSE) values of 0.26-0.38 for single finger movements and 0.20-0.24 for combined movements. Explainable AI techniques, Grad-CAM and SHAP, identified the high gamma (HG) band as crucial for movement prediction, showing specific cortical regions involved in different finger movements. These findings highlighted the physiological significance of the HG band in motor control. COMPARISON WITH EXISTING METHODS The 3D-CNN model outperformed traditional machine learning approaches by effectively capturing spatial and temporal patterns in ECoG data. The use of xAI techniques provided clearer insights into the model's decision-making process, unlike the "black box" nature of standard deep learning models. CONCLUSIONS The proposed 3D-CNN model, combined with xAI methods, enhances the decoding accuracy of finger movements from ECoG data. This approach offers a more efficient and interpretable solution for brain-computer interface (BCI) applications, emphasizing the HG band's role in motor control.
Collapse
Affiliation(s)
- Chao-Hung Kuo
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Neurological Surgery, University of Washington, Seattle, WA, USA; The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
| | - Guan-Tze Liu
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chi-En Lee
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Jing Wu
- Department of Bioengineering, University of Washington, Seattle, WA, USA; Center for Neurotechnology, University of Washington, Seattle, WA, USA
| | - Kaitlyn Casimo
- Center for Neurotechnology, University of Washington, Seattle, WA, USA
| | - Kurt E Weaver
- Center for Neurotechnology, University of Washington, Seattle, WA, USA; Department of Radiology, and Integrated Brain Imaging Center, University of Washington, Seattle, WA, USA
| | - Yu-Chun Lo
- The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
| | - You-Yin Chen
- Department of Biomedical Engineering, National Yang Ming Chiao Tung University, Taipei, Taiwan; The Ph.D. Program for Neural Regenerative Medicine, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan.
| | - Wen-Cheng Huang
- Department of Neurosurgery, Neurological Institute, Taipei Veterans General Hospital, Taipei, Taiwan; School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Jeffrey G Ojemann
- Department of Neurological Surgery, University of Washington, Seattle, WA, USA; Center for Neurotechnology, University of Washington, Seattle, WA, USA; Departments of Surgery, Seattle Children's Hospital, Seattle, WA, USA
| |
Collapse
|
2
|
Zhao H, Zhang X, Gao Y, Wang L, Xiao L, Liu S, Huang B, Li Z. Diagnostic performance of EfficientNetV2-S method for staging liver fibrosis based on multiparametric MRI. Heliyon 2024; 10:e35115. [PMID: 39165928 PMCID: PMC11334657 DOI: 10.1016/j.heliyon.2024.e35115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 07/19/2024] [Accepted: 07/23/2024] [Indexed: 08/22/2024] Open
Abstract
Problem Previous studies had confirmed that some deep learning models had high diagnostic performance in staging liver fibrosis. However, training efficiency of models predicting liver fibrosis need to be improved to achieve rapid diagnosis and precision medicine. Aim The deep learning framework of EfficientNetV2-S was noted because of its faster training speed and better parameter efficiency compared with other models. Our study sought to develop noninvasive predictive models based on EfficientNetV2-S framework for staging liver fibrosis. Methods Patients with chronic liver disease who underwent multi-parametric abdominal MRI were included in the retrospective study. Data augmentation methods including horizontal flip, vertical flip, perspective transformation and edge enhancement were applied to multi-parametric MR images to solve the data imbalance between different liver fibrosis groups. The EfficientNetV2-S models were used for the prediction of liver fibrosis stages F1-2, F1-3, F3, F4 and F3-4. We evaluated the diagnostic performance of our models in training, validation, and test sets by using receiver operating characteristic curve (ROC) analysis. Results The total training time of EfficientNetV2-S was about 6 h. For differentiating of F1-2 vs F3, the accuracy, sensitivity and specificity of EfficientNetV2-S model were 96.2 %, 96.4 % and 96.0 % in the test set. The AUC in test set was 0.559. The accuracy, sensitivity and specificity were 82.1 %, 74.5 % and 89.6 % in the test set by using EfficientNetV2-S model to differentiate F1-2 vs F3-4, and the AUC in test set were 0.763. For differentiating F1-3 vs F4, the accuracy, sensitivity and specificity of EfficientNetV2-S model were 71.5 %, 73.4 % and 69.5 % in the test set. The AUC was 0.553 in test set. For differentiating F1-2 vs F4, the accuracy, sensitivity and specificity of our model were 84.3 %, 80.2 % and 88.3 % in the test set, and the AUC was 0.715, respectively. For differentiating F3 vs F4, the accuracy, sensitivity and specificity of EfficientNetV2-S model were 92.5 %, 89.1 % and 95.6 % in the test set, and the AUC was 0.696 in the test set. Conclusions The EfficientNetV2-S models based on multi-parametric MRI had the feasibility for staging of liver fibrosis because they showed high training speed and diagnostic performance in our study.
Collapse
Affiliation(s)
- Haichen Zhao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Xiaoya Zhang
- College of Computer Science and Technology of Qingdao University, Qingdao, China
| | - Yuanxiang Gao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Lili Wang
- Department of Pathology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Longyang Xiao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Shunli Liu
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Baoxiang Huang
- College of Computer Science and Technology of Qingdao University, Qingdao, China
| | - Zhiming Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| |
Collapse
|
3
|
Zhang Y, Zheng B, Zeng F, Cheng X, Wu T, Peng Y, Zhang Y, Xie Y, Yi W, Chen W, Wu J, Li L. Potential of digital chest radiography-based deep learning in screening and diagnosing pneumoconiosis: An observational study. Medicine (Baltimore) 2024; 103:e38478. [PMID: 38905434 PMCID: PMC11191863 DOI: 10.1097/md.0000000000038478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 05/16/2024] [Indexed: 06/23/2024] Open
Abstract
The diagnosis of pneumoconiosis is complex and subjective, leading to inevitable variability in readings. This is especially true for inexperienced doctors. To improve accuracy, a computer-assisted diagnosis system is used for more effective pneumoconiosis diagnoses. Three models (Resnet50, Resnet101, and DenseNet) were used for pneumoconiosis classification based on 1250 chest X-ray images. Three experienced and highly qualified physicians read the collected digital radiography images and classified them from category 0 to category III in a double-blinded manner. The results of the 3 physicians in agreement were considered the relative gold standards. Subsequently, 3 models were used to train and test these images and their performance was evaluated using multi-class classification metrics. We used kappa values and accuracy to evaluate the consistency and reliability of the optimal model with clinical typing. The results showed that ResNet101 was the optimal model among the 3 convolutional neural networks. The AUC of ResNet101 was 1.0, 0.9, 0.89, and 0.94 for detecting pneumoconiosis categories 0, I, II, and III, respectively. The micro-average and macro-average mean AUC values were 0.93 and 0.94, respectively. The accuracy and Kappa values of ResNet101 were 0.72 and 0.7111 for quadruple classification and 0.98 and 0.955 for dichotomous classification, respectively, compared with the relative standard classification of the clinic. This study develops a deep learning based model for screening and staging of pneumoconiosis is using chest radiographs. The ResNet101 model performed relatively better in classifying pneumoconiosis than radiologists. The dichotomous classification displayed outstanding performance, thereby indicating the feasibility of deep learning techniques in pneumoconiosis screening.
Collapse
Affiliation(s)
- Yajuan Zhang
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Bowen Zheng
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Fengxia Zeng
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Xiaoke Cheng
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Tianqiong Wu
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Yuli Peng
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Yonliang Zhang
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| | - Yuanlin Xie
- Department of Radiology, San shui District Institute for Disease Control and Prevention, Foshan Guangdong, China
| | - Wei Yi
- Department of Radiology, The Third People’s Hospital of Yunnan Province, Yunnan, China
| | - Weiguo Chen
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Jiefang Wu
- Department of Radiology, Nan fang Hospital, Southern Medical University, Guangzhou, China
| | - Long Li
- Department of Radiology, Guangzhou Twelfth People’s Hospital, Guangzhou, China
| |
Collapse
|
4
|
Wang J, Tang S, Wu J, Xu S, Sun Q, Zhou Z, Xu X, Liu Y, Liu Q, Mao Y, He J, Zhang X, Yin Y. Radiomic Features at Contrast-Enhanced CT Predict Virus-Driven Liver Fibrosis: A Multi-Institutional Study. Clin Transl Gastroenterol 2024:01720094-990000000-00262. [PMID: 38801182 DOI: 10.14309/ctg.0000000000000712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 04/30/2024] [Indexed: 05/29/2024] Open
Abstract
INTRODUCTION Liver fibrosis is a major cause of morbidity and mortality among in patients with chronic hepatitis. Radiomics, particularly of the spleen, may improve diagnostic accuracy and treatment strategies. External validations are necessary to ensure reliability and generalizability. METHODS In this retrospective study, we developed 3 radiomics models using contrast-enhanced computed tomography scans from 167 patients with liver fibrosis (training group) between January 2020 and December 2021. Radiomic features were extracted from arterial venous, portal venous, and equilibrium phase images. Recursive feature selection random forest and the least absolute shrinkage and selection operator logistic regression were used for feature selection and dimensionality reduction. Performance was assessed by area under the curve, C-index, calibration plots, and decision curve analysis. External validation was performed on 114 patients from 2 institutions. RESULTS Twenty-five radiomic features were significantly associated with fibrosis stage, with 80% of the top 10 features originating from portal venous phase spleen images. The radiomics models showed good performance in the validation cohort (C-indices 0.723-0.808) and excellent calibration. Decision curve analysis indicated clinical benefits, with machine learning-based radiomics models (Random Forest score and support vector machine based radiomics score) providing more significant advantages. DISCUSSION Radiomic features offer significant benefits over existing serum indices for staging virus-driven liver fibrosis, underscoring the value of radiomics in enhancing diagnostic accuracy. Specifically, radiomics analysis of the spleen presents additional noninvasive options for assessing fibrosis, highlighting its potential in improving patient management and outcomes.
Collapse
Affiliation(s)
- Jincheng Wang
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
- Graduate School of Medical Science and Engineering, Hokkaido University, Sapporo, Japan
| | - Shengnan Tang
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Jin Wu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Shanshan Xu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
- Department of PET/CT Center, Jiangsu Cancer Hospital, The Affiliated Cancer Hospital of Nanjing Medical University, Jiangsu Institute of Cancer Research, Nanjing, China
| | - Qikai Sun
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Zheyu Zhou
- Department of General Surgery, Nanjing Drum Tower Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Graduate School of Peking Union Medical College, Nanjing, China
| | - Xiaoliang Xu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yang Liu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Qiaoyu Liu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yingfan Mao
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Jian He
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Xudong Zhang
- Department of Hepato-biliary-pancreatic Surgery, The Affiliated Changzhou No. 2 People's Hospital of Nanjing Medical University, Changzhou, China
| | - Yin Yin
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| |
Collapse
|
5
|
Champendal M, Müller H, Prior JO, Dos Reis CS. A scoping review of interpretability and explainability concerning artificial intelligence methods in medical imaging. Eur J Radiol 2023; 169:111159. [PMID: 37976760 DOI: 10.1016/j.ejrad.2023.111159] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 09/26/2023] [Accepted: 10/19/2023] [Indexed: 11/19/2023]
Abstract
PURPOSE To review eXplainable Artificial Intelligence/(XAI) methods available for medical imaging/(MI). METHOD A scoping review was conducted following the Joanna Briggs Institute's methodology. The search was performed on Pubmed, Embase, Cinhal, Web of Science, BioRxiv, MedRxiv, and Google Scholar. Studies published in French and English after 2017 were included. Keyword combinations and descriptors related to explainability, and MI modalities were employed. Two independent reviewers screened abstracts, titles and full text, resolving differences through discussion. RESULTS 228 studies met the criteria. XAI publications are increasing, targeting MRI (n = 73), radiography (n = 47), CT (n = 46). Lung (n = 82) and brain (n = 74) pathologies, Covid-19 (n = 48), Alzheimer's disease (n = 25), brain tumors (n = 15) are the main pathologies explained. Explanations are presented visually (n = 186), numerically (n = 67), rule-based (n = 11), textually (n = 11), and example-based (n = 6). Commonly explained tasks include classification (n = 89), prediction (n = 47), diagnosis (n = 39), detection (n = 29), segmentation (n = 13), and image quality improvement (n = 6). The most frequently provided explanations were local (78.1 %), 5.7 % were global, and 16.2 % combined both local and global approaches. Post-hoc approaches were predominantly employed. The used terminology varied, sometimes indistinctively using explainable (n = 207), interpretable (n = 187), understandable (n = 112), transparent (n = 61), reliable (n = 31), and intelligible (n = 3). CONCLUSION The number of XAI publications in medical imaging is increasing, primarily focusing on applying XAI techniques to MRI, CT, and radiography for classifying and predicting lung and brain pathologies. Visual and numerical output formats are predominantly used. Terminology standardisation remains a challenge, as terms like "explainable" and "interpretable" are sometimes being used indistinctively. Future XAI development should consider user needs and perspectives.
Collapse
Affiliation(s)
- Mélanie Champendal
- School of Health Sciences HESAV, HES-SO, University of Applied Sciences Western Switzerland, Lausanne, CH, Switzerland; Faculty of Biology and Medicine, University of Lausanne, Lausanne, CH, Switzerland.
| | - Henning Müller
- Informatics Institute, University of Applied Sciences Western Switzerland (HES-SO Valais) Sierre, CH, Switzerland; Medical faculty, University of Geneva, CH, Switzerland.
| | - John O Prior
- Faculty of Biology and Medicine, University of Lausanne, Lausanne, CH, Switzerland; Nuclear Medicine and Molecular Imaging Department, Lausanne University Hospital (CHUV), Lausanne, CH, Switzerland.
| | - Cláudia Sá Dos Reis
- School of Health Sciences HESAV, HES-SO, University of Applied Sciences Western Switzerland, Lausanne, CH, Switzerland.
| |
Collapse
|
6
|
Hu N, Yan G, Tang M, Wu Y, Song F, Xia X, Chan LWC, Lei P. CT-based methods for assessment of metabolic dysfunction associated with fatty liver disease. Eur Radiol Exp 2023; 7:72. [PMID: 37985560 PMCID: PMC10661153 DOI: 10.1186/s41747-023-00387-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 09/12/2023] [Indexed: 11/22/2023] Open
Abstract
Metabolic dysfunction-associated fatty liver disease (MAFLD), previously called metabolic nonalcoholic fatty liver disease, is the most prevalent chronic liver disease worldwide. The multi-factorial nature of MAFLD severity is delineated through an intricate composite analysis of the grade of activity in concert with the stage of fibrosis. Despite the preeminence of liver biopsy as the diagnostic and staging reference standard, its invasive nature, pronounced interobserver variability, and potential for deleterious effects (encompassing pain, infection, and even fatality) underscore the need for viable alternatives. We reviewed computed tomography (CT)-based methods for hepatic steatosis quantification (liver-to-spleen ratio; single-energy "quantitative" CT; dual-energy CT; deep learning-based methods; photon-counting CT) and hepatic fibrosis staging (morphology-based CT methods; contrast-enhanced CT biomarkers; dedicated postprocessing methods including liver surface nodularity, liver segmental volume ratio, texture analysis, deep learning methods, and radiomics). For dual-energy and photon-counting CT, the role of virtual non-contrast images and material decomposition is illustrated. For contrast-enhanced CT, normalized iodine concentration and extracellular volume fraction are explained. The applicability and salience of these approaches for clinical diagnosis and quantification of MAFLD are discussed.Relevance statementCT offers a variety of methods for the assessment of metabolic dysfunction-associated fatty liver disease by quantifying steatosis and staging fibrosis.Key points• MAFLD is the most prevalent chronic liver disease worldwide and is rapidly increasing.• Both hardware and software CT advances with high potential for MAFLD assessment have been observed in the last two decades.• Effective estimate of liver steatosis and staging of liver fibrosis can be possible through CT.
Collapse
Affiliation(s)
- Na Hu
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Gang Yan
- Department of Nuclear Medicine, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Maowen Tang
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Yuhui Wu
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Fasong Song
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Xing Xia
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Lawrence Wing-Chi Chan
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China.
| | - Pinggui Lei
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China.
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China.
| |
Collapse
|
7
|
Radiya K, Joakimsen HL, Mikalsen KØ, Aahlin EK, Lindsetmo RO, Mortensen KE. Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review. Eur Radiol 2023; 33:6689-6717. [PMID: 37171491 PMCID: PMC10511359 DOI: 10.1007/s00330-023-09609-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 02/02/2023] [Accepted: 02/06/2023] [Indexed: 05/13/2023]
Abstract
OBJECTIVES Machine learning (ML) for medical imaging is emerging for several organs and image modalities. Our objectives were to provide clinicians with an overview of this field by answering the following questions: (1) How is ML applied in liver computed tomography (CT) imaging? (2) How well do ML systems perform in liver CT imaging? (3) What are the clinical applications of ML in liver CT imaging? METHODS A systematic review was carried out according to the guidelines from the PRISMA-P statement. The search string focused on studies containing content relating to artificial intelligence, liver, and computed tomography. RESULTS One hundred ninety-one studies were included in the study. ML was applied to CT liver imaging by image analysis without clinicians' intervention in majority of studies while in newer studies the fusion of ML method with clinical intervention have been identified. Several were documented to perform very accurately on reliable but small data. Most models identified were deep learning-based, mainly using convolutional neural networks. Potentially many clinical applications of ML to CT liver imaging have been identified through our review including liver and its lesion segmentation and classification, segmentation of vascular structure inside the liver, fibrosis and cirrhosis staging, metastasis prediction, and evaluation of chemotherapy. CONCLUSION Several studies attempted to provide transparent result of the model. To make the model convenient for a clinical application, prospective clinical validation studies are in urgent call. Computer scientists and engineers should seek to cooperate with health professionals to ensure this. KEY POINTS • ML shows great potential for CT liver image tasks such as pixel-wise segmentation and classification of liver and liver lesions, fibrosis staging, metastasis prediction, and retrieval of relevant liver lesions from similar cases of other patients. • Despite presenting the result is not standardized, many studies have attempted to provide transparent results to interpret the machine learning method performance in the literature. • Prospective studies are in urgent call for clinical validation of ML method, preferably carried out by cooperation between clinicians and computer scientists.
Collapse
Affiliation(s)
- Keyur Radiya
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway.
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway.
| | - Henrik Lykke Joakimsen
- Institute of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Centre for Clinical Artificial Intelligence (SPKI), University Hospital of North Norway, Tromso, Norway
| | - Karl Øyvind Mikalsen
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Centre for Clinical Artificial Intelligence (SPKI), University Hospital of North Norway, Tromso, Norway
- UiT Machine Learning Group, Department of Physics and Technology, UiT the Arctic University of Norway, Tromso, Norway
| | - Eirik Kjus Aahlin
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway
| | - Rolv-Ole Lindsetmo
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Head Clinic of Surgery, Oncology and Women Health, University Hospital of North Norway, Tromso, Norway
| | - Kim Erlend Mortensen
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
| |
Collapse
|
8
|
Hetland LE, Kronborg TM, Thing M, Werge MP, Junker AE, Rashu EB, O’Connell MB, Olsen BH, Jensen ASH, Wewer Albrechtsen NJ, Møller S, Hobolth L, Mortensen C, Kimer N, Gluud LL. Suboptimal diagnostic accuracy of ultrasound and CT for compensated cirrhosis: Evidence from prospective cohort studies. Hepatol Commun 2023; 7:e0231. [PMID: 37655978 PMCID: PMC10476792 DOI: 10.1097/hc9.0000000000000231] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 05/30/2023] [Indexed: 09/02/2023] Open
Abstract
INTRODUCTION Abdominal ultrasound (US) and CT are important tools for the initial evaluation of patients with liver disease. Our study aimed to determine the accuracy of these methods for diagnosing cirrhosis. METHODS In all, 377 participants from 4 prospective cohort studies evaluating patients with various liver diseases were included. All patients were included between 2017 and 2022 and had undergone a liver biopsy as well as US and/or CT. Using the histological assessment as the gold standard, we calculated diagnostic accuracy for US and CT. Liver biopsies were evaluated by expert histopathologists and diagnostic scans by experienced radiologists. RESULTS The mean age was 54 ± 14 years and 47% were female. Most patients had NAFLD (58.3%) or alcohol-associated liver disease (25.5%). The liver biopsy showed cirrhosis in 147 patients (39.0%). Eighty-three patients with cirrhosis had Child-Pugh A (56.4% of patients with cirrhosis) and 64 had Child-Pugh B/C (43.6%). Overall, the sensitivity for diagnosing cirrhosis by US was 0.71 (95% CI 0.62-0.79) and for CT 0.74 (95% CI 0.64-0.83). The specificity was high for US (0.94, 95% CI 0.90-0.97) and for CT (0.93, 95% CI 0.83-0.98). When evaluating patients with Child-Pugh A cirrhosis, sensitivity was only 0.62 (95% CI 0.49-0.74) for US and 0.60 (95% CI 0.43-0.75) for CT. For patients with Child-Pugh B/C, sensitivity was 0.83 (95% CI 0.70-0.92) for US and 0.87 (95% CI 0.74-0.95) for CT. When limiting our analysis to NAFLD (20% with cirrhosis), the sensitivity for US was 0.45 (95% CI 0.28-0.64) and specificity was 0.97 (95% CI 0.93-0.99). CONCLUSION US and CT show moderate sensitivity and may potentially overlook compensated cirrhosis underlining the need for additional diagnostic testing.
Collapse
Affiliation(s)
- Liv E. Hetland
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
| | | | - Mira Thing
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
| | - Mikkel P. Werge
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
| | | | - Elias B. Rashu
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
| | | | - Beth H. Olsen
- Department of Radiology, Copenhagen University Hospital, Hvidovre, Denmark
| | - Anne-Sofie H. Jensen
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
- Novo Nordisk Foundation Center for Protein Research, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark
| | - Nicolai J. Wewer Albrechtsen
- Novo Nordisk Foundation Center for Protein Research, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark
- Department of Clinical Biochemistry, Copenhagen University Hospital, Bispebjerg, Denmark
| | - Søren Møller
- Department of Functional and Diagnostic Imaging, Copenhagen University Hospital, Hvidovre, Denmark
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark
| | - Lise Hobolth
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
- Department of Functional and Diagnostic Imaging, Copenhagen University Hospital, Hvidovre, Denmark
| | - Christian Mortensen
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
- Department of Functional and Diagnostic Imaging, Copenhagen University Hospital, Hvidovre, Denmark
| | - Nina Kimer
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
| | - Lise Lotte Gluud
- Gastro Unit, Copenhagen University Hospital, Hvidovre, Denmark
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Denmark
| |
Collapse
|
9
|
Zhao D, Wang W, Tang T, Zhang YY, Yu C. Current progress in artificial intelligence-assisted medical image analysis for chronic kidney disease: A literature review. Comput Struct Biotechnol J 2023; 21:3315-3326. [PMID: 37333860 PMCID: PMC10275698 DOI: 10.1016/j.csbj.2023.05.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 05/28/2023] [Accepted: 05/28/2023] [Indexed: 06/20/2023] Open
Abstract
Chronic kidney disease (CKD) causes irreversible damage to kidney structure and function. Arising from various etiologies, risk factors for CKD include hypertension and diabetes. With a progressively increasing global prevalence, CKD is an important public health problem worldwide. Medical imaging has become an important diagnostic tool for CKD through the non-invasive identification of macroscopic renal structural abnormalities. Artificial intelligence (AI)-assisted medical imaging techniques aid clinicians in the analysis of characteristics that cannot be easily discriminated by the naked eye, providing valuable information for the identification and management of CKD. Recent studies have demonstrated the effectiveness of AI-assisted medical image analysis as a clinical support tool using radiomics- and deep learning-based AI algorithms for improving the early detection, pathological assessment, and prognostic evaluation of various forms of CKD, including autosomal dominant polycystic kidney disease. Herein, we provide an overview of the potential roles of AI-assisted medical image analysis for the diagnosis and management of CKD.
Collapse
Affiliation(s)
- Dan Zhao
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Wei Wang
- Department of Radiology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Tian Tang
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Ying-Ying Zhang
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Chen Yu
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| |
Collapse
|
10
|
Popa SL, Ismaiel A, Abenavoli L, Padureanu AM, Dita MO, Bolchis R, Munteanu MA, Brata VD, Pop C, Bosneag A, Dumitrascu DI, Barsan M, David L. Diagnosis of Liver Fibrosis Using Artificial Intelligence: A Systematic Review. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:medicina59050992. [PMID: 37241224 DOI: 10.3390/medicina59050992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 05/04/2023] [Accepted: 05/19/2023] [Indexed: 05/28/2023]
Abstract
Background and Objectives: The development of liver fibrosis as a consequence of continuous inflammation represents a turning point in the evolution of chronic liver diseases. The recent developments of artificial intelligence (AI) applications show a high potential for improving the accuracy of diagnosis, involving large sets of clinical data. For this reason, the aim of this systematic review is to provide a comprehensive overview of current AI applications and analyze the accuracy of these systems to perform an automated diagnosis of liver fibrosis. Materials and Methods: We searched PubMed, Cochrane Library, EMBASE, and WILEY databases using predefined keywords. Articles were screened for relevant publications about AI applications capable of diagnosing liver fibrosis. Exclusion criteria were animal studies, case reports, abstracts, letters to the editor, conference presentations, pediatric studies, studies written in languages other than English, and editorials. Results: Our search identified a total of 24 articles analyzing the automated imagistic diagnosis of liver fibrosis, out of which six studies analyze liver ultrasound images, seven studies analyze computer tomography images, five studies analyze magnetic resonance images, and six studies analyze liver biopsies. The studies included in our systematic review showed that AI-assisted non-invasive techniques performed as accurately as human experts in detecting and staging liver fibrosis. Nevertheless, the findings of these studies need to be confirmed through clinical trials to be implemented into clinical practice. Conclusions: The current systematic review provides a comprehensive analysis of the performance of AI systems in diagnosing liver fibrosis. Automatic diagnosis, staging, and risk stratification for liver fibrosis is currently possible considering the accuracy of the AI systems, which can overcome the limitations of non-invasive diagnosis methods.
Collapse
Affiliation(s)
- Stefan Lucian Popa
- 2nd Medical Department, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Abdulrahman Ismaiel
- 2nd Medical Department, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Ludovico Abenavoli
- Department of Health Sciences, University "Magna Graecia", 88100 Catanzaro, Italy
| | | | - Miruna Oana Dita
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Roxana Bolchis
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Mihai Alexandru Munteanu
- Department of Medical Disciplines, Faculty of Medicine and Pharmacy, University of Oradea, 410087 Oradea, Romania
| | - Vlad Dumitru Brata
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Cristina Pop
- Department of Pharmacology, Physiology, and Pathophysiology, Faculty of Pharmacy, Iuliu Hatieganu University of Medicine and Pharmacy, 400347 Cluj-Napoca, Romania
| | - Andrei Bosneag
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Dinu Iuliu Dumitrascu
- Department of Anatomy, UMF "Iuliu Hatieganu" Cluj-Napoca, 400000 Cluj-Napoca, Romania
| | - Maria Barsan
- Department of Occupational Health, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Liliana David
- 2nd Medical Department, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| |
Collapse
|
11
|
Yamada A, Kamagata K, Hirata K, Ito R, Nakaura T, Ueda D, Fujita S, Fushimi Y, Fujima N, Matsui Y, Tatsugami F, Nozaki T, Fujioka T, Yanagawa M, Tsuboyama T, Kawamura M, Naganawa S. Clinical applications of artificial intelligence in liver imaging. LA RADIOLOGIA MEDICA 2023:10.1007/s11547-023-01638-1. [PMID: 37165151 DOI: 10.1007/s11547-023-01638-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Accepted: 04/21/2023] [Indexed: 05/12/2023]
Abstract
This review outlines the current status and challenges of the clinical applications of artificial intelligence in liver imaging using computed tomography or magnetic resonance imaging based on a topic analysis of PubMed search results using latent Dirichlet allocation. LDA revealed that "segmentation," "hepatocellular carcinoma and radiomics," "metastasis," "fibrosis," and "reconstruction" were current main topic keywords. Automatic liver segmentation technology using deep learning is beginning to assume new clinical significance as part of whole-body composition analysis. It has also been applied to the screening of large populations and the acquisition of training data for machine learning models and has resulted in the development of imaging biomarkers that have a significant impact on important clinical issues, such as the estimation of liver fibrosis, recurrence, and prognosis of malignant tumors. Deep learning reconstruction is expanding as a new technological clinical application of artificial intelligence and has shown results in reducing contrast and radiation doses. However, there is much missing evidence, such as external validation of machine learning models and the evaluation of the diagnostic performance of specific diseases using deep learning reconstruction, suggesting that the clinical application of these technologies is still in development.
Collapse
Affiliation(s)
- Akira Yamada
- Department of Radiology, Shinshu University School of Medicine, Matsumoto, Nagano, Japan.
| | - Koji Kamagata
- Department of Radiology, Juntendo University Graduate School of Medicine, Bunkyo-Ku, Tokyo, Japan
| | - Kenji Hirata
- Department of Nuclear Medicine, Hokkaido University Hospital, Sapporo, Japan
| | - Rintaro Ito
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Takeshi Nakaura
- Department of Diagnostic Radiology, Kumamoto University Graduate School of Medicine, Chuo-Ku, Kumamoto, Japan
| | - Daiju Ueda
- Department of Diagnostic and Interventional Radiology, Graduate School of Medicine, Osaka Metropolitan University, Abeno-Ku, Osaka, Japan
| | - Shohei Fujita
- Department of Radiology, University of Tokyo, Tokyo, Japan
| | - Yasutaka Fushimi
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, Sakyoku, Kyoto, Japan
| | - Noriyuki Fujima
- Department of Diagnostic and Interventional Radiology, Hokkaido University Hospital, Sapporo, Japan
| | - Yusuke Matsui
- Department of Radiology, Faculty of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Kita-Ku, Okayama, Japan
| | - Fuminari Tatsugami
- Department of Diagnostic Radiology, Hiroshima University, Minami-Ku, Hiroshima City, Hiroshima, Japan
| | - Taiki Nozaki
- Department of Radiology, St. Luke's International Hospital, Tokyo, Japan
| | - Tomoyuki Fujioka
- Department of Diagnostic Radiology, Tokyo Medical and Dental University, Tokyo, Japan
| | - Masahiro Yanagawa
- Department of Radiology, Osaka University Graduate School of Medicine, Suita-City, Osaka, Japan
| | - Takahiro Tsuboyama
- Department of Radiology, Osaka University Graduate School of Medicine, Suita-City, Osaka, Japan
| | - Mariko Kawamura
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| |
Collapse
|
12
|
Elhakim T, Trinh K, Mansur A, Bridge C, Daye D. Role of Machine Learning-Based CT Body Composition in Risk Prediction and Prognostication: Current State and Future Directions. Diagnostics (Basel) 2023; 13:968. [PMID: 36900112 PMCID: PMC10000509 DOI: 10.3390/diagnostics13050968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 02/11/2023] [Accepted: 02/18/2023] [Indexed: 03/08/2023] Open
Abstract
CT body composition analysis has been shown to play an important role in predicting health and has the potential to improve patient outcomes if implemented clinically. Recent advances in artificial intelligence and machine learning have led to high speed and accuracy for extracting body composition metrics from CT scans. These may inform preoperative interventions and guide treatment planning. This review aims to discuss the clinical applications of CT body composition in clinical practice, as it moves towards widespread clinical implementation.
Collapse
Affiliation(s)
- Tarig Elhakim
- Department of Medicine, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, PA 19104, USA
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA
| | - Kelly Trinh
- School of Medicine, Texas Tech University Health Sciences Center, School of Medicine, Lubbock, TX 79430, USA
| | - Arian Mansur
- Harvard Medical School, Harvard University, Boston, MA 02115, USA
| | - Christopher Bridge
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Harvard University, Boston, MA 02115, USA
| | - Dania Daye
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Harvard University, Boston, MA 02115, USA
| |
Collapse
|
13
|
Setting up of a machine learning algorithm for the identification of severe liver fibrosis profile in the general US population cohort. Int J Med Inform 2023; 170:104932. [PMID: 36459836 DOI: 10.1016/j.ijmedinf.2022.104932] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 11/19/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
BACKGROUND The progress of digital transformation in clinical practice opens the door to transforming the current clinical line for liver disease diagnosis from a late-stage diagnosis approach to an early-stage based one. Early diagnosis of liver fibrosis can prevent the progression of the disease and decrease liver-related morbidity and mortality. We developed here a machine learning (ML) algorithm containing standard parameters that can identify liver fibrosis in the general US population. MATERIALS AND METHODS Starting from a public database (National Health and Nutrition Examination Survey, NHANES), representative of the American population with 7265 eligible subjects (control population n = 6828, with Fibroscan values E < 9.7 KPa; target population n = 437 with Fibroscan values E ≥ 9.7 KPa), we set up an SVM algorithm able to discriminate for individuals with liver fibrosis among the general US population. The algorithm set up involved the removal of missing data and a sampling optimization step to managing the data imbalance (only ∼ 5 % of the dataset is the target population). RESULTS For the feature selection, we performed an unbiased analysis, starting from 33 clinical, anthropometric, and biochemical parameters regardless of their previous application as biomarkers of liver diseases. Through PCA analysis, we identified the 26 more significant features and then used them to set up a sampling method on an SVM algorithm. The best sampling technique to manage the data imbalance was found to be oversampling through the SMOTE-NC. For final model validation, we utilized a subset of 300 individuals (150 with liver fibrosis and 150 controls), subtracted from the main dataset prior to sampling. Performances were evaluated on multiple independent runs. CONCLUSIONS We provide proof of concept of an ML clinical decision support tool for liver fibrosis diagnosis in the general US population. Though the presented ML model represents at this stage only a prototype, in the future, it might be implemented and potentially applied to program broad screenings for liver fibrosis.
Collapse
|
14
|
Kotowski K, Kucharski D, Machura B, Adamski S, Gutierrez Becker B, Krason A, Zarudzki L, Tessier J, Nalepa J. Detecting liver cirrhosis in computed tomography scans using clinically-inspired and radiomic features. Comput Biol Med 2023; 152:106378. [PMID: 36512877 DOI: 10.1016/j.compbiomed.2022.106378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 11/21/2022] [Accepted: 11/28/2022] [Indexed: 11/30/2022]
Abstract
Hepatic cirrhosis is an increasing cause of mortality in developed countries-it is the pathological sequela of chronic liver diseases, and the final liver fibrosis stage. Since cirrhosis evolves from the asymptomatic phase, it is of paramount importance to detect it as quickly as possible, because entering the symptomatic phase commonly leads to hospitalization and can be fatal. Understanding the state of the liver based on the abdominal computed tomography (CT) scans is tedious, user-dependent and lacks reproducibility. We tackle these issues and propose an end-to-end and reproducible approach for detecting cirrhosis from CT. It benefits from the introduced clinically-inspired features that reflect the patient's characteristics which are often investigated by experienced radiologists during the screening process. Such features are coupled with the radiomic ones extracted from the liver, and from the suggested region of interest which captures the liver's boundary. The rigorous experiments, performed over two heterogeneous clinical datasets (two cohorts of 241 and 32 patients) revealed that extracting radiomic features from the liver's rectified contour is pivotal to enhance the classification abilities of the supervised learners. Also, capturing clinically-inspired image features significantly improved the performance of such models, and the proposed features were consistently selected as the important ones. Finally, we showed that selecting the most discriminative features leads to the Pareto-optimal models with enhanced feature-level interpretability, as the number of features was dramatically reduced (280×) from thousands to tens.
Collapse
Affiliation(s)
| | | | | | | | - Benjamín Gutierrez Becker
- Roche Pharma Research and Early Development, Informatics, Roche Innovation Center Basel, Basel, Switzerland
| | - Agata Krason
- Roche Pharmaceutical Research and Early Development, Early Clinical Development Oncology, Roche Innovation Center Basel, Basel, Switzerland
| | - Lukasz Zarudzki
- Department of Radiology and Diagnostic Imaging, Maria Skłodowska-Curie National Research Institute of Oncology, Gliwice Branch, Gliwice, Poland
| | - Jean Tessier
- Roche Pharmaceutical Research and Early Development, Early Clinical Development Oncology, Roche Innovation Center Basel, Basel, Switzerland
| | - Jakub Nalepa
- Graylight Imaging, Gliwice, Poland; Department of Algorithmics and Software, Silesian University of Technology, Gliwice, Poland.
| |
Collapse
|
15
|
Xie D, Ying M, Lian J, Li X, Liu F, Yu X, Ni C. Serological indices and ultrasound variables in predicting the staging of hepatitis B liver fibrosis: A comparative study based on random forest algorithm and traditional methods. J Cancer Res Ther 2022; 18:2049-2057. [PMID: 36647969 DOI: 10.4103/jcrt.jcrt_1394_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023]
Abstract
Objective To compare the diagnostic efficacy of serological indices and ultrasound (US) variables in hepatitis B virus (HBV) liver fibrosis staging using random forest algorithm (RFA) and traditional methods. Methods The demographic and serological indices and US variables of patients with HBV liver fibrosis were retrospectively collected and divided into serology group, US group, and serology + US group according to the research content. RFA was used for training and validation. The diagnostic efficacy was compared to logistic regression analysis (LRA) and APRI and FIB-4 indices. Results For the serology group, the diagnostic performance of RFA was significantly higher than that of APRI and FIB-4 indices. The diagnostic accuracy of RFA in the four classifications (S0S1/S2/S3/S4) of the hepatic fibrosis stage was 79.17%. The diagnostic accuracy for significant fibrosis (≥S2), advanced fibrosis (≥S3), and cirrhosis (S4) was 87.99%, 90.69%, and 92.40%, respectively. The area under the curve (AUC) values were 0.945, 0.959, and 0.951, respectively. For the US group, there was no significant difference in diagnostic performance between RFA and LRA. The diagnostic performance of RFA in the serology + US group was significantly better than that of LRA. The diagnostic accuracy of the four classifications (S0S1/S2/S3/S4) of the hepatic fibrosis stage was 77.21%. The diagnostic accuracy for significant fibrosis (≥S2), advanced fibrosis (≥S3), and cirrhosis (S4) was 87.50%, 90.93%, and 93.38%, respectively. The AUC values were 0.948, 0.959, and 0.962, respectively. Conclusion RFA can significantly improve the diagnostic performance of HBV liver fibrosis staging. RFA based on serological indices has a good ability to predict liver fibrosis staging. RFA can help clinicians accurately judge liver fibrosis staging and reduce unnecessary biopsies.
Collapse
Affiliation(s)
- Daolin Xie
- Department of Interventional Radiology, The First Affiliated Hospital of Soochow University, Suzhou; Department of Interventional Ultrasound, Fifth Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Minghua Ying
- Department of Interventional Ultrasound, Fifth Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Jingru Lian
- Department of Interventional Ultrasound, Fifth Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Xin Li
- Department of Interventional Ultrasound, Fifth Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Fangyi Liu
- Department of Interventional Ultrasound, Fifth Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Xiaoling Yu
- Department of Interventional Ultrasound, Fifth Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Caifang Ni
- Department of Interventional Radiology, The First Affiliated Hospital of Soochow University, Suzhou, China
| |
Collapse
|
16
|
Imaging-based deep learning in liver diseases. Chin Med J (Engl) 2022; 135:1325-1327. [PMID: 35837673 PMCID: PMC9433077 DOI: 10.1097/cm9.0000000000002199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023] Open
|
17
|
Wang J, Tang S, Mao Y, Wu J, Xu S, Yue Q, Chen J, He J, Yin Y. Radiomics analysis of contrast-enhanced CT for staging liver fibrosis: an update for image biomarker. Hepatol Int 2022; 16:627-639. [PMID: 35347597 PMCID: PMC9174317 DOI: 10.1007/s12072-022-10326-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 03/03/2022] [Indexed: 02/08/2023]
Abstract
BACKGROUND To establish and validate a radiomics-based model for staging liver fibrosis at contrast-enhanced CT images. MATERIALS AND METHODS This retrospective study developed two radiomics-based models (R-score: radiomics signature; R-fibrosis: integrate radiomic and serum variables) in a training cohort of 332 patients (median age, 59 years; interquartile range, 51-67 years; 256 men) with biopsy-proven liver fibrosis who underwent contrast-enhanced CT between January 2017 and December 2020. Radiomic features were extracted from non-contrast, arterial and portal phase CT images and selected using the least absolute shrinkage and selection operator (LASSO) logistic regression to differentiate stage F3-F4 from stage F0-F2. Optimal cutoffs to diagnose significant fibrosis (stage F2-F4), advanced fibrosis (stage F3-F4) and cirrhosis (stage F4) were determined by receiver operating characteristic curve analysis. Diagnostic performance was evaluated by area under the curve, Obuchowski index, calibrations and decision curve analysis. An internal validation was conducted in 111 randomly assigned patients (median age, 58 years; interquartile range, 49-66 years; 89 men). RESULTS In the validation cohort, R-score and R-fibrosis (Obuchowski index, 0.843 and 0.846, respectively) significantly outperformed aspartate transaminase-to-platelet ratio (APRI) (Obuchowski index, 0.651; p < .001) and fibrosis-4 index (FIB-4) (Obuchowski index, 0.676; p < .001) for staging liver fibrosis. Using the cutoffs, R-fibrosis and R-score had a sensitivity range of 70-87%, specificity range of 71-97%, and accuracy range of 82-86% in diagnosing significant fibrosis, advanced fibrosis and cirrhosis. CONCLUSION Radiomic analysis of contrast-enhanced CT images can reach great diagnostic performance of liver fibrosis.
Collapse
Affiliation(s)
- Jincheng Wang
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University, Nanjing, China
- Preparatory School for Chinese Students To Japan, The Training Center of Ministry of Education for Studying Overseas, Changchun, China
| | - Shengnan Tang
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Yingfan Mao
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Jin Wu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Shanshan Xu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Qi Yue
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University, Nanjing, China
| | - Jun Chen
- Department of Pathology, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Jian He
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China.
| | - Yin Yin
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China.
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University, Nanjing, China.
| |
Collapse
|
18
|
Verma N, Asrani SK. Deep learning and non-invasive assessment of significant fibrosis: does adding more toppings improve the flavor of prediction? Hepatol Int 2022; 16:492-494. [PMID: 35359195 DOI: 10.1007/s12072-022-10329-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 03/04/2022] [Indexed: 11/04/2022]
Affiliation(s)
- Nipun Verma
- Postgraduate Institute of Medical Education and Research, Chandigarh, India
| | - Sumeet K Asrani
- Baylor University Medical Center, 3410 Worth Street, Suite 860, Dallas, TX, 75246, USA.
| |
Collapse
|
19
|
Combining Hepatic and Splenic CT Radiomic Features Improves Radiomic Analysis Performance for Liver Fibrosis Staging. Diagnostics (Basel) 2022; 12:diagnostics12020550. [PMID: 35204639 PMCID: PMC8870954 DOI: 10.3390/diagnostics12020550] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 02/09/2022] [Accepted: 02/17/2022] [Indexed: 02/05/2023] Open
Abstract
Background: The exact focus of computed tomography (CT)-based artificial intelligence techniques when staging liver fibrosis is still not exactly known. This study aimed to determine both the added value of splenic information to hepatic information, and the correlation between important radiomic features and information exploited by deep learning models for liver fibrosis staging by CT-based radiomics. Methods: The study design is retrospective. Radiomic features were extracted from both liver and spleen on portal venous phase CT images of 252 consecutive patients with histologically proven liver fibrosis stages between 2006 and 2018. The radiomics analyses for liver fibrosis staging were done by hepatic and hepatic–splenic features, respectively. The most predictive radiomic features were automatically selected by machine learning models. Results: When using splenic–hepatic features in the CT-based radiomics analysis, the average accuracy rates for significant fibrosis, advanced fibrosis, and cirrhosis were 88%, 82%, and 86%, and area under the receiver operating characteristic curves (AUCs) were 0.92, 0.81, and 0.85. The AUC of hepatic–splenic-based radiomics analysis with the ensemble classifier was 7% larger than that of hepatic-based analysis (p < 0.05). The most important features selected by machine learning models included both hepatic and splenic features, and they were consistent with the location maps indicating the focus of deep learning when predicting liver fibrosis stage. Conclusions: Adding CT-based splenic radiomic features to hepatic radiomic features increases radiomics analysis performance for liver fibrosis staging. The most important features of the radiomics analysis were consistent with the information exploited by deep learning.
Collapse
|