1
|
Usuzaki T, Inamori R, Ishikuro M, Obara T, Takaya E, Homma N, Takase K. Predicting EGFR Status After Radical Nephrectomy or Partial Nephrectomy for Renal Cell Carcinoma on CT Using a Self-attention-based Model: Variable Vision Transformer (vViT). JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:3057-3069. [PMID: 38940889 PMCID: PMC11612086 DOI: 10.1007/s10278-024-01180-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 06/05/2024] [Accepted: 06/17/2024] [Indexed: 06/29/2024]
Abstract
OBJECTIVE To assess the effectiveness of the vViT model for predicting postoperative renal function decline by leveraging clinical data, medical images, and image-derived features; and to identify the most dominant factor influencing this prediction. MATERIALS AND METHODS We developed two models, eGFR10 and eGFR20, to identify patients with a postoperative reduction in eGFR of more than 10 and more than 20, respectively, among renal cell carcinoma patients. The eGFR10 model was trained on 75 patients and tested on 27, while the eGFR20 model was trained on 77 patients and tested on 24. The vViT model inputs included class token, patient characteristics (age, sex, BMI), comorbidities (peripheral vascular disease, diabetes, liver disease), habits (smoking, alcohol), surgical details (ischemia time, blood loss, type and procedure of surgery, approach, operative time), radiomics, and tumor and kidney imaging. We used permutation feature importance to evaluate each sector's contribution. The performance of vViT was compared with CNN models, including VGG16, ResNet50, and DenseNet121, using McNemar and DeLong tests. RESULTS The eGFR10 model achieved an accuracy of 0.741 and an AUC-ROC of 0.692, while the eGFR20 model attained an accuracy of 0.792 and an AUC-ROC of 0.812. The surgical and radiomics sectors were the most influential in both models. The vViT had higher accuracy and AUC-ROC than VGG16 and ResNet50, and higher AUC-ROC than DenseNet121 (p < 0.05). Specifically, the vViT did not have a statistically different AUC-ROC compared to VGG16 (p = 1.0) and ResNet50 (p = 0.7) but had a statistically different AUC-ROC compared to DenseNet121 (p = 0.87) for the eGFR10 model. For the eGFR20 model, the vViT did not have a statistically different AUC-ROC compared to VGG16 (p = 0.72), ResNet50 (p = 0.88), and DenseNet121 (p = 0.64). CONCLUSION The vViT model, a transformer-based approach for multimodal data, shows promise for preoperative CT-based prediction of eGFR status in patients with renal cell carcinoma.
Collapse
Affiliation(s)
- Takuma Usuzaki
- Department of Diagnostic Radiology, Tohoku University Hospital, Sendai, Japan.
- Tohoku University Hospital, 1-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8574, Japan.
| | - Ryusei Inamori
- Department of Clinical Imaging, Graduate School of Medicine, Tohoku University, Sendai, Miyagi, Japan
| | - Mami Ishikuro
- Division of Molecular Epidemiology, Graduate School of Medicine, Tohoku University, Sendai, Miyagi, Japan
| | - Taku Obara
- Division of Molecular Epidemiology, Graduate School of Medicine, Tohoku University, Sendai, Miyagi, Japan
- Division of Molecular Epidemiology, Department of Preventive Medicine and Epidemiology, Tohoku Medical Megabank Organization, Tohoku University, Sendai, Japan
- Department of Pharmaceutical Sciences, Tohoku University Hospital, Sendai, Japan
| | - Eichi Takaya
- AI Lab, Tohoku University Hospital, Sendai, Japan
| | - Noriyasu Homma
- Department of Clinical Imaging, Graduate School of Medicine, Tohoku University, Sendai, Miyagi, Japan
| | - Kei Takase
- Department of Diagnostic Radiology, Tohoku University Hospital, Sendai, Japan
| |
Collapse
|
2
|
Usuzaki T, Inamori R, Shizukuishi T, Morishita Y, Takagi H, Ishikuro M, Obara T, Takase K. Predicting isocitrate dehydrogenase status among adult patients with diffuse glioma using patient characteristics, radiomic features, and magnetic resonance imaging: Multi-modal analysis by variable vision transformer. Magn Reson Imaging 2024; 111:266-276. [PMID: 38815636 DOI: 10.1016/j.mri.2024.05.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Revised: 05/14/2024] [Accepted: 05/22/2024] [Indexed: 06/01/2024]
Abstract
OBJECTIVES To evaluate the performance of the multimodal model, termed variable Vision Transformer (vViT), in the task of predicting isocitrate dehydrogenase (IDH) status among adult patients with diffuse glioma. MATERIALS AND METHODS vViT was designed to predict IDH status using patient characteristics (sex and age), radiomic features, and contrast-enhanced T1-weighted images (CE-T1WI). Radiomic features were extracted from each enhancing tumor (ET), necrotic tumor core (NCR), and peritumoral edematous/infiltrated tissue (ED). CE-T1WI were split into four images and input to vViT. In the training, internal test, and external test, 271 patients with 1070 images (535 IDH wildtype, 535 IDH mutant), 35 patients with 194 images (97 IDH wildtype, 97 IDH mutant), and 291 patients with 872 images (436 IDH wildtype, 436 IDH mutant) were analyzed, respectively. Metrics including accuracy and AUC-ROC were calculated for the internal and external test datasets. Permutation importance analysis combined with the Mann-Whitney U test was performed to compare inputs. RESULTS For the internal test dataset, vViT correctly predicted IDH status for all patients. For the external test dataset, an accuracy of 0.935 (95% confidence interval; 0.913-0.945) and AUC-ROC of 0.887 (0.798-0.956) were obtained. For both internal and external test datasets, CE-T1WI ET radiomic features and patient characteristics had higher importance than other inputs (p < 0.05). CONCLUSIONS The vViT has the potential to be a competent model in predicting IDH status among adult patients with diffuse glioma. Our results indicate that age, sex, and CE-T1WI ET radiomic features have key information in estimating IDH status.
Collapse
Affiliation(s)
- Takuma Usuzaki
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi 980-8574, Japan; Miyagi Cancer Center, Miyagi, Japan
| | - Ryusei Inamori
- Radiological Imaging and Informatics, Tohoku University Graduate School of Medicine, Sendai, Japan
| | - Takashi Shizukuishi
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi 980-8574, Japan
| | - Yohei Morishita
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi 980-8574, Japan
| | - Hidenobu Takagi
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi 980-8574, Japan; Department of Advanced MRI Collaborative Research, Graduate School of Medicine, Sendai, Japan
| | - Mami Ishikuro
- Tohoku University Graduate School of Medicine, Division of Molecular Epidemiology, Sendai, Japan
| | - Taku Obara
- Tohoku University Graduate School of Medicine, Division of Molecular Epidemiology, Sendai, Japan; Tohoku University Graduate School of Medicine, Division of Molecular Epidemiology, Department of Preventive Medicine and Epidemiology, Tohoku Medical Megabank Organization, Sendai, Japan; Department of Pharmaceutical Sciences, Tohoku University Hospital, Sendai, Japan
| | - Kei Takase
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi 980-8574, Japan
| |
Collapse
|
3
|
Usuzaki T, Ishikuro M, Kikuya M, Murakami K, Noda A, Ueno F, Metoki H, Obara T, Kuriyama S. Child-parent associations of hematocrit in trios of Japanese adulthood confirmed by the random family method: The TMM BirThree Cohort Study. Sci Rep 2024; 14:19047. [PMID: 39152204 PMCID: PMC11329627 DOI: 10.1038/s41598-024-69752-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Accepted: 08/08/2024] [Indexed: 08/19/2024] Open
Abstract
To examine child-parent associations of HCT among Japanese adults and their parents. Factors associated with hematocrit (HCT) were analyzed in 3,574 sons and 7,203 daughters using Pearson's correlation coefficient and Student's t-test. Multiple linear regression analysis, adjusted by the factors identified by univariate analyses and by living with parents, was performed on 242 son-parent trios and 587 daughter-parent trios. When a child-parent association was observed in the multiple linear regression analysis, it was validated using the random family method (RFM). In univariate analyses, the son's HCT was associated with age (correlation coefficient = -0.072), white blood cell (WBC) (0.19), alanine aminotransferase (ALT) (0.20), triglyceride (0.11), and estimated glomerular filtration rate (eGFR) (- 0.087). The daughter's HCT was associated with WBC (0.014), ALT (0.18), and eGFR (- 0.17). In multiple linear regression analysis, the son's HCT was associated with the son's WBC (coefficient = 3.48 × 10-4), the son's eGFR (0.031), the father's HCT (0.11), and the mother's HCT (0.17). RFM confirmed the association between the son's and father's HCT (p = 0.0070) and between the son's and mother's HCT (p = 0.0011). The daughter's HCT was associated with WBC (2.6 × 10-4), ALT (0.037), and the mother's HCT (0.14). RFM confirmed the association between the daughter's and mother's HCT (p = 0.00043). Child-parent association of HCT was confirmed between son-father, son-mother, and daughter-mother relationships, and differed depending on the sex of the child and the parents.
Collapse
Affiliation(s)
- Takuma Usuzaki
- Department of Diagnostic Radiology, Tohoku University Hospital, Sendai, Japan
| | - Mami Ishikuro
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
- Division of Molecular Epidemiology, Graduate School of Medicine, Tohoku University, Sendai, Japan
| | - Masahiro Kikuya
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
- Department of Hygiene and Public Health, Teikyo University School of Medicine, Tokyo, Japan
| | - Keiko Murakami
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
| | - Aoi Noda
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
- Division of Molecular Epidemiology, Graduate School of Medicine, Tohoku University, Sendai, Japan
- Department of Pharmaceutical Sciences, Tohoku University Hospital, Sendai, Japan
| | - Fumihiko Ueno
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
| | - Hirohito Metoki
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
- Division of Public Health, Hygiene and Epidemiology, Faculty of Medicine, Tohoku Medical and Pharmaceutical University, Sendai, Japan
| | - Taku Obara
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan.
- Division of Molecular Epidemiology, Graduate School of Medicine, Tohoku University, Sendai, Japan.
- Department of Pharmaceutical Sciences, Tohoku University Hospital, Sendai, Japan.
| | - Shinichi Kuriyama
- Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-Machi, Aoba-Ku, Sendai, Miyagi, 980-8573, Japan
- Division of Molecular Epidemiology, Graduate School of Medicine, Tohoku University, Sendai, Japan
- Division of Disaster Public Health, International Research Institute of Disaster Science, Tohoku University, Sendai, Japan
| |
Collapse
|
4
|
Usuzaki T, Takahashi K, Inamori R, Morishita Y, Shizukuishi T, Takagi H, Ishikuro M, Obara T, Takase K. Identifying key factors for predicting O6-Methylguanine-DNA methyltransferase status in adult patients with diffuse glioma: a multimodal analysis of demographics, radiomics, and MRI by variable Vision Transformer. Neuroradiology 2024; 66:761-773. [PMID: 38472373 PMCID: PMC11031474 DOI: 10.1007/s00234-024-03329-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 03/04/2024] [Indexed: 03/14/2024]
Abstract
PURPOSE This study aimed to perform multimodal analysis by vision transformer (vViT) in predicting O6-methylguanine-DNA methyl transferase (MGMT) promoter status among adult patients with diffuse glioma using demographics (sex and age), radiomic features, and MRI. METHODS The training and test datasets contained 122 patients with 1,570 images and 30 patients with 484 images, respectively. The radiomic features were extracted from enhancing tumors (ET), necrotic tumor cores (NCR), and the peritumoral edematous/infiltrated tissues (ED) using contrast-enhanced T1-weighted images (CE-T1WI) and T2-weighted images (T2WI). The vViT had 9 sectors; 1 demographic sector, 6 radiomic sectors (CE-T1WI ET, CE-T1WI NCR, CE-T1WI ED, T2WI ET, T2WI NCR, and T2WI ED), 2 image sectors (CE-T1WI, and T2WI). Accuracy and area under the curve of receiver-operating characteristics (AUC-ROC) were calculated for the test dataset. The performance of vViT was compared with AlexNet, GoogleNet, VGG16, and ResNet by McNemar and Delong test. Permutation importance (PI) analysis with the Mann-Whitney U test was performed. RESULTS The accuracy was 0.833 (95% confidence interval [95%CI]: 0.714-0.877) and the area under the curve of receiver-operating characteristics was 0.840 (0.650-0.995) in the patient-based analysis. The vViT had higher accuracy than VGG16 and ResNet, and had higher AUC-ROC than GoogleNet (p<0.05). The ED radiomic features extracted from the T2-weighted image demonstrated the highest importance (PI=0.239, 95%CI: 0.237-0.240) among all other sectors (p<0.0001). CONCLUSION The vViT is a competent deep learning model in predicting MGMT status. The ED radiomic features of the T2-weighted image demonstrated the most dominant contribution.
Collapse
Affiliation(s)
- Takuma Usuzaki
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8574, Japan.
| | - Kengo Takahashi
- Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8573, Japan
| | - Ryusei Inamori
- Tohoku University Graduate School of Medicine, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8573, Japan
| | - Yohei Morishita
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8574, Japan
| | - Takashi Shizukuishi
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8574, Japan
| | - Hidenobu Takagi
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8574, Japan
- Department of Advanced MRI Collaborative Research, Graduate School of Medicine, Tohoku University, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8573, Japan
| | - Mami Ishikuro
- Tohoku University Graduate School of Medicine, Division of Molecular Epidemiology, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8573, Japan
| | - Taku Obara
- Tohoku University Graduate School of Medicine, Division of Molecular Epidemiology, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8573, Japan
- Tohoku University Graduate School of Medicine, Division of Molecular Epidemiology, Department of Preventive Medicine and Epidemiology, Tohoku Medical Megabank Organization, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8573, Japan
- Tohoku University Hospital, Department of Pharmaceutical Sciences, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8574, Japan
| | - Kei Takase
- Department of Diagnostic Radiology, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi, Miyagi, 980-8574, Japan
| |
Collapse
|