1
|
Oettl FC, Zsidai B, Oeding JF, Hirschmann MT, Feldt R, Tischer T, Samuelsson K, ESSKA Artificial Intelligence Working Group. Beyond traditional orthopaedic data analysis: AI, multimodal models and continuous monitoring. Knee Surg Sports Traumatol Arthrosc 2025; 33:2269-2275. [PMID: 40119679 DOI: 10.1002/ksa.12657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/19/2025] [Revised: 02/14/2025] [Accepted: 02/16/2025] [Indexed: 03/24/2025]
Abstract
Multimodal artificial intelligence (AI) has the potential to revolutionise healthcare by enabling the simultaneous processing and integration of various data types, including medical imaging, electronic health records, genomic information and real-time data. This review explores the current applications and future potential of multimodal AI across healthcare, with a particular focus on orthopaedic surgery. In presurgical planning, multimodal AI has demonstrated significant improvements in diagnostic accuracy and risk prediction, with studies reporting an Area under the receiving operator curve presenting good to excellent performance across various orthopaedic conditions. Intraoperative applications leverage advanced imaging and tracking technologies to enhance surgical precision, while postoperative care has been advanced through continuous patient monitoring and early detection of complications. Despite these advances, significant challenges remain in data integration, standardisation, and privacy protection. Technical solutions such as federated learning (allowing decentralisation of models) and edge computing (allowing data analysis to happen on site or closer to site instead of multipurpose datacenters) are being developed to address these concerns while maintaining compliance with regulatory frameworks. As this field continues to evolve, the integration of multimodal AI promises to advance personalised medicine, improve patient outcomes, and transform healthcare delivery through more comprehensive and nuanced analysis of patient data. Level of Evidence: Level V.
Collapse
Affiliation(s)
- Felix C Oettl
- Department of Orthopedic Surgery, Balgrist University Hospital, University of Zürich, Zurich, Switzerland
- Hospital for Special Surgery, New York, New York, USA
| | - Bálint Zsidai
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Sahlgrenska Sports Medicine Center, Göteborg, Sweden
| | - Jacob F Oeding
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Mayo Clinic Alix School of Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Michael T Hirschmann
- Department of Orthopaedic Surgery and Traumatology, Kantonsspital Baselland, Bruderholz, Switzerland
- University of Basel, Basel, Switzerland
| | - Robert Feldt
- Department of Computer Science and Engineering, Chalmers University of Technology, Gothenburg, Sweden
| | - Thomas Tischer
- Department of Orthopaedic Surgery, University Medicine Rostock, Rostock, Germany
- Department of Orthopaedic and Trauma Surgery Malteser Waldkrankenhaus Erlangen Erlangen Germany
| | - Kristian Samuelsson
- Department of Orthopaedics, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden
- Sahlgrenska Sports Medicine Center, Göteborg, Sweden
| | | |
Collapse
|
2
|
Fu L, Pan X, Ding H, Qin Y, Huang W, Lu S, Li K, Long L. The diagnostic value of vascular architecture in solid solitary pulmonary nodules quantified by dynamic contrast enhanced MRI. J Thorac Dis 2025; 17:19-30. [PMID: 39975744 PMCID: PMC11833577 DOI: 10.21037/jtd-24-1467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2024] [Accepted: 12/13/2024] [Indexed: 02/21/2025]
Abstract
Background Alterations in the vascular microenvironment of cancer have gradually gained widespread attention in oncology research, and early qualitative diagnosis using noninvasive examination techniques is crucial in clinical practice. This study aimed to explore the value of quantitative parameters of dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) in the assessment of vascular architecture of solid solitary pulmonary nodules (SSPNs). Methods DCE-MRI scan images of a total of 79 patients with SSPNs from November 2021 to December 2023 were prospectively analyzed. Quantitative permeability parameters Ktrans, Kep, and Ve values of the lesions were measured, labeled immunohistochemically with CD31 microvessel density (CD31-MVD), smooth muscle actin microvessel density (SMA-MVD), and vascular endothelial growth factor (VEGF), and quantitative values of vascular architectural parameters were obtained using the image analysis software Image-J. The diagnostic efficacy of quantitative permeability parameters for the diagnosis of malignant SSPNs was analyzed by receiver operating characteristic (ROC) curves using surgical pathology findings as the gold standard for the diagnosis of malignant SSPNs. Spearman's correlation analysis was used to evaluate the relationship between quantitative permeability parameters and vascular construct parameters. Results The study included 51 female patients (64.6%) with a mean age of 50.5±11.5 years. Only 21 patients (26.6%) had a smoking history, and 30 patients (38.0%) had a normal weight. Statistically significant differences were found between benign and malignant SSPNs subgroups in Ktrans and Ve values in quantitative permeability parameters, and in SMA-MVD and microvascular perfusion index (MPI) in vascular conformation parameters (P<0.05). Ktrans and Ve values showed high diagnostic value for malignant SSPNs [area under the curve (AUC), 0.813 and 0.759]. Ktrans, Kep, and Ve were significantly positively correlated with CD31-MVD, with r-values of 0.857, 0.830, and 0.798 (P<0.05); they were also significantly positively correlated with VEGF, with r-values of 0.851, 0.859, and 0.764 (P<0.05); and Ktrans and Kep were significantly negatively correlated with MPI, with r-values were -0.779 and -0.864 (P<0.05). Conclusions The quantitative permeability parameters of DCE-MRI correlate with some of the vascular architectural parameters, and magnetic resonance image-based quantification of pulmonary nodal vascular architecture provides a noninvasive method for the differential diagnosis of SSPNs.
Collapse
Affiliation(s)
- Liang Fu
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Xiaoyu Pan
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Haiming Ding
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Ying Qin
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Wanyun Huang
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Shunzu Lu
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Kai Li
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Liling Long
- Department of Radiology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
- Key Laboratory of Early Prevention and Treatment for Regional High Frequency Tumor of Guangxi Medical University, Ministry of Education, Nanning, China
| |
Collapse
|
3
|
Jiang J, Xiao Y, Liu J, Cui L, Shao W, Hao S, Xu G, Fu Y, Hu C. T1 mapping-based radiomics in the identification of histological types of lung cancer: a reproducibility and feasibility study. BMC Med Imaging 2024; 24:308. [PMID: 39543517 PMCID: PMC11566602 DOI: 10.1186/s12880-024-01487-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Accepted: 11/03/2024] [Indexed: 11/17/2024] Open
Abstract
BACKGROUND T1 mapping can quantify the longitudinal relaxation time of tissues. This study aimed to investigate the repeatability and reproducibility of T1 mapping radiomics features of lung cancer and the feasibility of T1 mapping-based radiomics model to predict its pathological types. METHODS The chest T1 mapping images and clinical characteristics of 112 lung cancer patients (54 with adenocarcinoma and 58 with other types of lung cancer) were collected retrospectively. 54 patients underwent twice short-term T1 mapping scans. Regions of interest were manually delineated on T1 mapping pseudo-color images to measure the mean native T1 values of lung cancer, and radiomics features were extracted using the semi-automatic segmentation method by two independent observers. The patients were randomly divided into training group (77 cases) and validation group (35 cases) with the ratio of 7:3. Interclass correlation coefficients (ICCs), Student's t-test or Mann-Whitney U tests and least absolute shrinkage and selection operator (LASSO) were used for feature selection. The optimum features were selected to establish a logistic regression (LR) radiomics model. Independent sample t-test, Mann Whitney U-test or chi square test were used to compare the differences of clinical characteristics and T1 values. Performance was compared by the area under the receiver operating characteristic (ROC) curve (AUC). RESULTS In the training group, smoking history, lesion type and native T1 values were different between adenocarcinoma and non-adenocarcinoma patients (P = 0.004-0.038). There were 1035 (54.30%) radiomics features meet the intra-and inter-observer, and test-retest reproducibility with ICC > 0.80. After feature dimensionality reduction and model construction, the AUC of T1 mapping-based radiomics model for predicting the pathological types of lung cancer was 0.833 and 0.843, respectively, in the training and validation cohorts. The AUCs of T1 value and clinical model (including smoking history and lesion type) were 0.657 and 0.692 in the training group, and 0.722 and 0.686 in the validation group. Combined with T1 mapping radiomics, clinical model and T1 value to establish a combined model, the prediction efficiency was further improved to 0.895 and 0.915 in the training and validation groups. CONCLUSIONS About 50% of the T1 mapping-based radiomics features displayed relatively poor repeatability and reproducibility. While T1 mapping-based radiomics model is valuable in identification of histological types of lung cancer despite the measurement variability. Combination of T1 mapping radiomics model, clinical characteristics and native T1 value can improve the predictive value of pathological types of lung cancer.
Collapse
Affiliation(s)
- Jianqin Jiang
- Department of Radiology, The Yancheng Clinical College of Xuzhou Medical University and The First people's Hospital of Yancheng, Yulong West Road No. 166, Yancheng, 224001, China
- Department of Radiology, The First Affiliated Hospital of Soochow University, Shizi Street No. 188, Suzhou, 215002, China
| | - Yong Xiao
- Department of Radiology, The Yancheng Clinical College of Xuzhou Medical University and The First people's Hospital of Yancheng, Yulong West Road No. 166, Yancheng, 224001, China
| | - Jia Liu
- Department of Radiology, The Second Affiliated Hospital of Nantong University, Haierxiang North Road No. 6, Nantong, 226001, China
| | - Lei Cui
- Department of Radiology, The Second Affiliated Hospital of Nantong University, Haierxiang North Road No. 6, Nantong, 226001, China
| | - Weiwei Shao
- Department of Pathology, The Yancheng Clinical College of Xuzhou Medical University and The First people's Hospital of Yancheng, Yulong West Road No. 166, Yancheng, 224001, China
| | - Shaowei Hao
- Siemens Healthineers Digital Technology (Shanghai) Co., Ltd, Haiyang West Road No. 399, Shanghai, 200000, China
| | - Gaofeng Xu
- Department of Radiology, The Yancheng Clinical College of Xuzhou Medical University and The First people's Hospital of Yancheng, Yulong West Road No. 166, Yancheng, 224001, China
| | - Yigang Fu
- Department of Radiology, The Yancheng Clinical College of Xuzhou Medical University and The First people's Hospital of Yancheng, Yulong West Road No. 166, Yancheng, 224001, China.
| | - Chunhong Hu
- Department of Radiology, The First Affiliated Hospital of Soochow University, Shizi Street No. 188, Suzhou, 215002, China.
- Institute of Medical Imaging, Soochow University, Shizi Street No. 1, Suzhou, 215002, China.
| |
Collapse
|
4
|
Xie K, Cui C, Li X, Yuan Y, Wang Z, Zeng L. MRI-Based Clinical-Imaging-Radiomics Nomogram Model for Discriminating Between Benign and Malignant Solid Pulmonary Nodules or Masses. Acad Radiol 2024; 31:4231-4241. [PMID: 38644089 DOI: 10.1016/j.acra.2024.03.042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 03/29/2024] [Accepted: 03/30/2024] [Indexed: 04/23/2024]
Abstract
RATIONALE AND OBJECTIVES Pulmonary nodules or masses are highly prevalent worldwide, and differential diagnosis of benign and malignant lesions remains difficult. Magnetic resonance imaging (MRI) can provide functional and metabolic information of pulmonary lesions. This study aimed to establish a nomogram model based on clinical features, imaging features, and multi-sequence MRI radiomics to identify benign and malignant solid pulmonary nodules or masses. MATERIALS AND METHODS A total of 145 eligible patients (76 male; mean age, 58.4 years ± 13.7 [SD]) with solid pulmonary nodules or masses were retrospectively analyzed. The patients were randomized into two groups (training cohort, n = 102; validation cohort, n = 43). The nomogram was used for predicting malignant pulmonary lesions. The diagnostic performance of different models was evaluated by receiver operating characteristic (ROC) curve analysis. RESULTS Of these patients, 95 patients were diagnosed with benign lesions and 50 with malignant lesions. Multivariate analysis showed that age, DWI value, LSR value, and ADC value were independent predictors of malignant lesions. Among the radiomics models, the multi-sequence MRI-based model (T1WI+T2WI+ADC) achieved the best diagnosis performance with AUCs of 0.858 (95%CI: 0.775, 0.919) and 0.774 (95%CI: 0.621, 0.887) for the training and validation cohorts, respectively. Combining multi-sequence radiomics, clinical and imaging features, the predictive efficacy of the clinical-imaging-radiomics model was significantly better than the clinical model, imaging model and radiomics model (all P < 0.05). CONCLUSION The MRI-based clinical-imaging-radiomics model is helpful to differentiate benign and malignant solid pulmonary nodules or masses, and may be useful for precision medicine of pulmonary diseases.
Collapse
Affiliation(s)
- Kexin Xie
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu 210002, China
| | - Can Cui
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu 210002, China
| | - Xiaoqing Li
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu 210002, China
| | - Yongfeng Yuan
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu 210002, China
| | - Zhongqiu Wang
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu 210002, China
| | - Liang Zeng
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Nanjing, Jiangsu 210002, China.
| |
Collapse
|
5
|
Shi L, Zhao J, Wei Z, Wu H, Sheng M. Radiomics in distinguishing between lung adenocarcinoma and lung squamous cell carcinoma: a systematic review and meta-analysis. Front Oncol 2024; 14:1381217. [PMID: 39381037 PMCID: PMC11458374 DOI: 10.3389/fonc.2024.1381217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Accepted: 09/05/2024] [Indexed: 10/10/2024] Open
Abstract
Objectives The aim of this study was to systematically review the studies on radiomics models in distinguishing between lung adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC) and evaluate the classification performance of radiomics models using images from various imaging techniques. Materials and methods PubMed, Embase and Web of Science Core Collection were utilized to search for radiomics studies that differentiate between LUAD and LUSC. The assessment of the quality of studies included utilized the improved Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and Radiomics Quality Score (RQS). Meta-analysis was conducted to assess the classification performance of radiomics models using various imaging techniques. Results The qualitative analysis included 40 studies, while the quantitative synthesis included 21 studies. Median RQS for 40 studies was 12 (range -5~19). Sixteen studies were deemed to have a low risk of bias and low concerns regarding applicability. The radiomics model based on CT images had a pooled sensitivity of 0.78 (95%CI: 0.71~0.83), specificity of 0.85 (95%CI:0.73~0.92), and the area under summary receiver operating characteristic curve (SROC-AUC) of 0.86 (95%CI:0.82~0.89). As for PET images, the pooled sensitivity was 0.80 (95%CI: 0.61~0.91), specificity was 0.77 (95%CI: 0.60~0.88), and the SROC-AUC was 0.85 (95%CI: 0.82~0.88). PET/CT images had a pooled sensitivity of 0.87 (95%CI: 0.72~0.94), specificity of 0.88 (95%CI: 0.80~0.93), and an SROC-AUC of 0.93 (95%CI: 0.91~0.95). MRI images had a pooled sensitivity of 0.73 (95%CI: 0.61~0.82), specificity of 0.80 (95%CI: 0.65~0.90), and an SROC-AUC of 0.79 (95%CI: 0.75~0.82). Conclusion Radiomics models demonstrate potential in distinguishing between LUAD and LUSC. Nevertheless, it is crucial to conduct a well-designed and powered prospective radiomics studies to establish their credibility in clinical application. Systematic review registration https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=412851, identifier CRD42023412851.
Collapse
Affiliation(s)
- Lili Shi
- Medical School, Nantong University, Nantong, China
| | - Jinli Zhao
- Department of Radiology, Affiliated Hospital of Nantong University, Nantong, China
| | - Zhichao Wei
- Medical School, Nantong University, Nantong, China
| | - Huiqun Wu
- Medical School, Nantong University, Nantong, China
| | - Meihong Sheng
- Department of Radiology, The Second Affiliated Hospital of Nantong University and Nantong First People’s Hospital, Nantong, China
| |
Collapse
|
6
|
Li Y, El Habib Daho M, Conze PH, Zeghlache R, Le Boité H, Tadayoni R, Cochener B, Lamard M, Quellec G. A review of deep learning-based information fusion techniques for multimodal medical image classification. Comput Biol Med 2024; 177:108635. [PMID: 38796881 DOI: 10.1016/j.compbiomed.2024.108635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 03/18/2024] [Accepted: 05/18/2024] [Indexed: 05/29/2024]
Abstract
Multimodal medical imaging plays a pivotal role in clinical diagnosis and research, as it combines information from various imaging modalities to provide a more comprehensive understanding of the underlying pathology. Recently, deep learning-based multimodal fusion techniques have emerged as powerful tools for improving medical image classification. This review offers a thorough analysis of the developments in deep learning-based multimodal fusion for medical classification tasks. We explore the complementary relationships among prevalent clinical modalities and outline three main fusion schemes for multimodal classification networks: input fusion, intermediate fusion (encompassing single-level fusion, hierarchical fusion, and attention-based fusion), and output fusion. By evaluating the performance of these fusion techniques, we provide insight into the suitability of different network architectures for various multimodal fusion scenarios and application domains. Furthermore, we delve into challenges related to network architecture selection, handling incomplete multimodal data management, and the potential limitations of multimodal fusion. Finally, we spotlight the promising future of Transformer-based multimodal fusion techniques and give recommendations for future research in this rapidly evolving field.
Collapse
Affiliation(s)
- Yihao Li
- LaTIM UMR 1101, Inserm, Brest, France; University of Western Brittany, Brest, France
| | - Mostafa El Habib Daho
- LaTIM UMR 1101, Inserm, Brest, France; University of Western Brittany, Brest, France.
| | | | - Rachid Zeghlache
- LaTIM UMR 1101, Inserm, Brest, France; University of Western Brittany, Brest, France
| | - Hugo Le Boité
- Sorbonne University, Paris, France; Ophthalmology Department, Lariboisière Hospital, AP-HP, Paris, France
| | - Ramin Tadayoni
- Ophthalmology Department, Lariboisière Hospital, AP-HP, Paris, France; Paris Cité University, Paris, France
| | - Béatrice Cochener
- LaTIM UMR 1101, Inserm, Brest, France; University of Western Brittany, Brest, France; Ophthalmology Department, CHRU Brest, Brest, France
| | - Mathieu Lamard
- LaTIM UMR 1101, Inserm, Brest, France; University of Western Brittany, Brest, France
| | | |
Collapse
|
7
|
Woodworth CF, Frota Lima LM, Bartholmai BJ, Koo CW. Imaging of Solid Pulmonary Nodules. Clin Chest Med 2024; 45:249-261. [PMID: 38816086 DOI: 10.1016/j.ccm.2023.08.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/01/2024]
Abstract
Early detection with accurate classification of solid pulmonary nodules is critical in reducing lung cancer morbidity and mortality. Computed tomography (CT) remains the most widely used imaging examination for pulmonary nodule evaluation; however, other imaging modalities, such as PET/CT and MRI, are increasingly used for nodule characterization. Current advances in solid nodule imaging are largely due to developments in machine learning, including automated nodule segmentation and computer-aided detection. This review explores current multi-modality solid pulmonary nodule detection and characterization with discussion of radiomics and risk prediction models.
Collapse
Affiliation(s)
- Claire F Woodworth
- Department of Radiology, Mayo Clinic, 200 First Street Southwest, Rochester, MN 55905, USA
| | - Livia Maria Frota Lima
- Department of Radiology, Mayo Clinic, 200 First Street Southwest, Rochester, MN 55905, USA
| | - Brian J Bartholmai
- Department of Radiology, Mayo Clinic, 200 First Street Southwest, Rochester, MN 55905, USA
| | - Chi Wan Koo
- Department of Radiology, Mayo Clinic, 200 First Street Southwest, Rochester, MN 55905, USA.
| |
Collapse
|
8
|
Lin AC, Liu Z, Lee J, Ranvier GF, Taye A, Owen R, Matteson DS, Lee D. Generating a multimodal artificial intelligence model to differentiate benign and malignant follicular neoplasms of the thyroid: A proof-of-concept study. Surgery 2024; 175:121-127. [PMID: 37925261 DOI: 10.1016/j.surg.2023.06.053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 05/08/2023] [Accepted: 06/18/2023] [Indexed: 11/06/2023]
Abstract
BACKGROUND Machine learning has been increasingly used to develop algorithms that can improve medical diagnostics and prognostication and has shown promise in improving the classification of thyroid ultrasound images. This proof-of-concept study aims to develop a multimodal machine-learning model to classify follicular carcinoma from adenoma. METHODS This is a retrospective study of patients with follicular adenoma or carcinoma at a single institution between 2010 and 2022. Demographics, imaging, and perioperative variables were collected. The region of interest was annotated on ultrasound and used to perform radiomics analysis. Imaging features and clinical variables were then used to create a random forest classifier to predict malignancy. Leave-one-out cross-validation was conducted to evaluate classifier performance using the area under the receiver operating characteristic curve. RESULTS Patients with follicular adenomas (n = 7) and carcinomas (n = 11) with complete imaging and perioperative data were included. A total of 910 features were extracted from each image. The t-distributed stochastic neighbor embedding method reduced the dimension to 2 primary represented components. The random forest classifier achieved an area under the receiver operating characteristic curve of 0.76 (clinical only), 0.29 (image only), and 0.79 (multimodal data). CONCLUSION Our multimodal machine learning model demonstrates promising results in classifying follicular carcinoma from adenoma. This approach can potentially be applied in future studies to generate models for preoperative differentiation of follicular thyroid neoplasms.
Collapse
Affiliation(s)
- Ann C Lin
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - Zelong Liu
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - Justine Lee
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York City, NY
| | | | - Aida Taye
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - Randall Owen
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - David S Matteson
- Department of Statistics and Data Science, Cornell University, Ithaca, NY
| | - Denise Lee
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY.
| |
Collapse
|
9
|
Lin J, Yu Y, Zhang X, Wang Z, Li S. Classification of Histological Types and Stages in Non-small Cell Lung Cancer Using Radiomic Features Based on CT Images. J Digit Imaging 2023; 36:1029-1037. [PMID: 36828962 PMCID: PMC10287608 DOI: 10.1007/s10278-023-00792-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Revised: 02/07/2023] [Accepted: 02/08/2023] [Indexed: 02/26/2023] Open
Abstract
Non-invasive diagnostic method based on radiomic features in patients with non-small cell lung cancer (NSCLC) has attracted attention. This study aimed to develop a CT image-based model for both histological typing and clinical staging of patients with NSCLC. A total of 309 NSCLC patients with 537 CT series from The Cancer Imaging Archive (TCIA) database were included in this study. All patients were randomly divided into the training set (247 patients, 425 CT series) and testing set (62 patients, 112 CT series). A total of 107 radiomic features were extracted. Four classifiers including random forest, XGBoost, support vector machine, and logistic regression were used to construct the classification model. The classification model had two output layers: histological type (adenocarcinoma, squamous cell carcinoma, and large cell) and clinical stage (I, II, and III) of NSCLC patients. The area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) with 95% confidence interval (CI) were utilized to evaluate the performance of the model. Seven features were selected for inclusion in the classification model. The random forest model had the best classification ability compared with other classifiers. The AUC of the RF model for histological typing and clinical staging of NSCLC patients in the testing set was 0.700 (95% CI, 0.641-0.759) and 0.881 (95% CI, 0.842-0.920), respectively. The CT image-based radiomic feature model had good classification ability for both histological typing and clinical staging of patients with NSCLC.
Collapse
Affiliation(s)
- Jing Lin
- Department of Medical Imaging, Shanghai Electric Power Hospital, Changning District, No. 937 Yan'an West Road, Shanghai, 20050, China.
| | - Yunjie Yu
- Department of Medical Imaging, Shanghai Electric Power Hospital, Changning District, No. 937 Yan'an West Road, Shanghai, 20050, China
| | - Xianlong Zhang
- Department of Medical Imaging, Shanghai Electric Power Hospital, Changning District, No. 937 Yan'an West Road, Shanghai, 20050, China
| | - Zhenglei Wang
- Department of Medical Imaging, Shanghai Electric Power Hospital, Changning District, No. 937 Yan'an West Road, Shanghai, 20050, China
| | - Shujuan Li
- Department of Medical Imaging, Shanghai Electric Power Hospital, Changning District, No. 937 Yan'an West Road, Shanghai, 20050, China
| |
Collapse
|
10
|
Yang M, Shi L, Huang T, Li G, Shao H, Shen Y, Zhu J, Ni B. Value of contrast-enhanced magnetic resonance imaging-T2WI-based radiomic features in distinguishing lung adenocarcinoma from lung squamous cell carcinoma with solid components >8 mm. J Thorac Dis 2023; 15:635-648. [PMID: 36910079 PMCID: PMC9992614 DOI: 10.21037/jtd-23-142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Accepted: 02/16/2023] [Indexed: 03/05/2023]
Abstract
Background Radiomics is one of the research frontiers in the field of imaging and has excellent diagnostic performance. However, there is a lack of magnetic resonance imaging (MRI)-based omics studies on identifying pathological subtypes of lung cancer. Here we explored the value of the contrast-enhanced MRI-T2-weighted imaging (T2WI)-based radiomic analysis in distinguishing adenocarcinoma (Ade) from squamous cell carcinoma (Squ) with solid components >8 mm. Methods A retrospective analysis was performed of a total of 71 lung cancer patients who undergoing contrast-enhanced MRI and computed tomography (CT) before treatment, and the nodules had solid components ≥8 mm in our center from January 2020 to September 2021. All enrolled patients were divided into Squ and Ade groups according to the pathological results. In addition, the two groups were randomly divided into training set and validation set in a ratio of about 7:3. Radiomics software was used to extract the relevant radiomic features. The least absolute shrinkage and selection operator (Lasso) was used to screen radiomic features that were most relevant to lung cancer subtypes, thus calculating the radiomic scores (Rad-score) and constructing the radiomic models. Multivariate logistic regression was used to combine relevant clinical features with Rad-score to form combined model nomograms. The receiver operating characteristic (ROC) curves. the area under the ROC curve (AUC), the decision curve analysis (DCA) and the DeLong's test were used to evaluate the clinical application potentials. Results The sensitivity and specificity of the clinical model based on smoking was 75.0% and 93.8%. The AUC of the constructed magnetic resonance (MR)-Rad model for differentiating the pathological subtypes of lung cancer was 0.8651 in the validation sets. The AUC of the CT-Rad model in the validation set were 0.9286. The combined model constructed by combining clinical features and Rad-score had AUC of 0.8016, for identifying the 2 pathological subtypes of lung cancer in the validation set. There was no significant difference in diagnostic performance between MR-Rad model and CT-Rad model (P>0.05). Conclusions The MR-Rad model has a diagnostic performance similar to that of CT-Rad model, while the diagnostic performance of the combined mode was better than the single MR model.
Collapse
Affiliation(s)
- Maoyuan Yang
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Liang Shi
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Tianwei Huang
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Guangzheng Li
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Hancheng Shao
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Yijun Shen
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Jun Zhu
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Bin Ni
- Department of Thoracic Surgery, The First Affiliated Hospital of Soochow University, Suzhou, China
| |
Collapse
|
11
|
Saman H, Raza A, Patil K, Uddin S, Crnogorac-Jurcevic T. Non-Invasive Biomarkers for Early Lung Cancer Detection. Cancers (Basel) 2022; 14:5782. [PMID: 36497263 PMCID: PMC9739091 DOI: 10.3390/cancers14235782] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 07/18/2022] [Accepted: 07/20/2022] [Indexed: 11/27/2022] Open
Abstract
Worldwide, lung cancer (LC) is the most common cause of cancer death, and any delay in the detection of new and relapsed disease serves as a major factor for a significant proportion of LC morbidity and mortality. Though invasive methods such as tissue biopsy are considered the gold standard for diagnosis and disease monitoring, they have several limitations. Therefore, there is an urgent need to identify and validate non-invasive biomarkers for the early diagnosis, prognosis, and treatment of lung cancer for improved patient management. Despite recent progress in the identification of non-invasive biomarkers, currently, there is a shortage of reliable and accessible biomarkers demonstrating high sensitivity and specificity for LC detection. In this review, we aim to cover the latest developments in the field, including the utility of biomarkers that are currently used in LC screening and diagnosis. We comment on their limitations and summarise the findings and developmental stages of potential molecular contenders such as microRNAs, circulating tumour DNA, and methylation markers. Furthermore, we summarise research challenges in the development of biomarkers used for screening purposes and the potential clinical applications of newly discovered biomarkers.
Collapse
Affiliation(s)
- Harman Saman
- Hamad Medical Corporation, Doha 3050, Qatar
- Barts Cancer Institute, Queen Mary University of London, London EC1M 5PZ, UK
| | - Afsheen Raza
- National Center for Cancer Care and Research, Hamad Medical Corporation, Doha 3050, Qatar
| | - Kalyani Patil
- Translational Research Institute, Academic Health System, Hamad Medical Corporation, Doha 3050, Qatar
| | - Shahab Uddin
- Translational Research Institute, Academic Health System, Hamad Medical Corporation, Doha 3050, Qatar
- Dermatology Institute, Academic Health System, Hamad Medical Corporation, Doha 3050, Qatar
- Laboratory of Animal Research Centre, Qatar University, Doha 2731, Qatar
| | | |
Collapse
|
12
|
Kline A, Wang H, Li Y, Dennis S, Hutch M, Xu Z, Wang F, Cheng F, Luo Y. Multimodal machine learning in precision health: A scoping review. NPJ Digit Med 2022; 5:171. [PMID: 36344814 PMCID: PMC9640667 DOI: 10.1038/s41746-022-00712-8] [Citation(s) in RCA: 126] [Impact Index Per Article: 42.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 10/14/2022] [Indexed: 11/09/2022] Open
Abstract
Machine learning is frequently being leveraged to tackle problems in the health sector including utilization for clinical decision-support. Its use has historically been focused on single modal data. Attempts to improve prediction and mimic the multimodal nature of clinical expert decision-making has been met in the biomedical field of machine learning by fusing disparate data. This review was conducted to summarize the current studies in this field and identify topics ripe for future research. We conducted this review in accordance with the PRISMA extension for Scoping Reviews to characterize multi-modal data fusion in health. Search strings were established and used in databases: PubMed, Google Scholar, and IEEEXplore from 2011 to 2021. A final set of 128 articles were included in the analysis. The most common health areas utilizing multi-modal methods were neurology and oncology. Early fusion was the most common data merging strategy. Notably, there was an improvement in predictive performance when using data fusion. Lacking from the papers were clear clinical deployment strategies, FDA-approval, and analysis of how using multimodal approaches from diverse sub-populations may improve biases and healthcare disparities. These findings provide a summary on multimodal data fusion as applied to health diagnosis/prognosis problems. Few papers compared the outputs of a multimodal approach with a unimodal prediction. However, those that did achieved an average increase of 6.4% in predictive accuracy. Multi-modal machine learning, while more robust in its estimations over unimodal methods, has drawbacks in its scalability and the time-consuming nature of information concatenation.
Collapse
Affiliation(s)
- Adrienne Kline
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Hanyin Wang
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Yikuan Li
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Saya Dennis
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Meghan Hutch
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA
| | - Zhenxing Xu
- Department of Population Health Sciences, Cornell University, New York, 10065, NY, USA
| | - Fei Wang
- Department of Population Health Sciences, Cornell University, New York, 10065, NY, USA
| | - Feixiong Cheng
- Cleveland Clinic Lerner College of Medicine, Case Western Reserve University, Cleveland, 44195, OH, USA
| | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, 60201, IL, USA.
| |
Collapse
|
13
|
Li H, Song Q, Gui D, Wang M, Min X, Li A. Reconstruction-assisted Feature Encoding Network for Histologic Subtype Classification of Non-small Cell Lung Cancer. IEEE J Biomed Health Inform 2022; 26:4563-4574. [PMID: 35849680 DOI: 10.1109/jbhi.2022.3192010] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Accurate histological subtype classification between adenocarcinoma (ADC) and squamous cell carcinoma (SCC) using computed tomography (CT) images is of great importance to assist clinicians in determining treatment and therapy plans for non-small cell lung cancer (NSCLC) patients. Although current deep learning approaches have achieved promising progress in this field, they are often difficult to capture efficient tumor representations due to inadequate training data, and in consequence show limited performance. In this study, we propose a novel and effective reconstruction-assisted feature encoding network (RAFENet) for histological subtype classification by leveraging an auxiliary image reconstruction task to enable extra guidance and regularization for enhanced tumor feature representations. Different from existing reconstruction-assisted methods that directly use generalizable features obtained from shared encoder for primary task, a dedicated task-aware encoding module is utilized in RAFENet to perform refinement of generalizable features. Specifically, a cascade of cross-level non-local blocks are introduced to progressively refine generalizable features at different levels with the aid of lower-level task-specific information, which can successfully learn multi-level task-specific features tailored to histological subtype classification. Moreover, in addition to widely adopted pixel-wise reconstruction loss, we introduce a powerful semantic consistency loss function to explicitly supervise the training of RAFENet, which combines both feature consistency loss and prediction consistency loss to ensure semantic invariance during image reconstruction. Extensive experimental results show that RAFENet effectively addresses the difficult issues that cannot be resolved by existing reconstruction-based methods and consistently outperforms other state-of-the-art methods on both public and in-house NSCLC datasets.
Collapse
|
14
|
Tang X, Huang H, Du P, Wang L, Yin H, Xu X. Intratumoral and peritumoral CT-based radiomics strategy reveals distinct subtypes of non-small-cell lung cancer. J Cancer Res Clin Oncol 2022; 148:2247-2260. [DOI: 10.1007/s00432-022-04015-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 04/04/2022] [Indexed: 12/24/2022]
|
15
|
Jensen LJ, Kim D, Elgeti T, Steffen IG, Hamm B, Nagel SN. Differentiation of Pulmonary Lymphoma Manifestations and Nonlymphoma Infiltrates in Possible Invasive Fungal Disease Using Fast T1-weighted Magnetic Resonance Imaging at 3 T Comparison of Texture Analysis, Mapping, and Signal Intensity Quotients. J Thorac Imaging 2022; 37:80-89. [PMID: 34269753 DOI: 10.1097/rti.0000000000000606] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
PURPOSE This study aimed to evaluate the diagnostic performance of texture analysis (TA), T1 mapping, and signal intensity quotients derived from fast T1-weighted gradient echo (T1w GRE) sequences for differentiating pulmonary lymphoma manifestations and nonlymphoma infiltrates in possible invasive fungal disease in immunocompromised hematological patients. MATERIALS AND METHODS Twenty patients with hematologic malignancies and concomitant immunosuppression (including 10 patients with pulmonary lymphoma manifestations and 10 patients with nonlymphoma infiltrates) prospectively underwent 3 T magnetic resonance imaging using a conventional T1w GRE sequence and a T1w GRE mapping sequence with variable flip angle. A region of interest was placed around the most representative lesion in each patient. TA was performed using PyRadiomics. T1 relaxation times were extracted from precompiled maps and calculated manually. Signal intensity quotients (lesion/muscle) were calculated from conventional T1w GRE sequences. RESULTS Of all TA features, variance, mean absolute deviation, robust mean absolute deviation, interquartile range, and minimum were significantly different between the 2 entities (P<0.05), with excellent diagnostic performance in receiver operating characteristic analysis (area under the curve [AUC] >80%). Neither T1 relaxation times from precompiled maps (AUC=63%; P=0.353) nor manual calculation (AUC=63%; P=0.353) nor signal intensity quotients (AUC=70%; P=0.143) yielded significant differences. CONCLUSIONS TA from fast T1w GRE images can differentiate pulmonary lymphoma manifestations and nonlymphoma infiltrates in possible invasive fungal disease with excellent diagnostic performance using the TA features variance, mean absolute deviation, robust mean absolute deviation, interquartile range, and minimum. Combining a fast T1w GRE sequence with TA seems to be a promising tool to differentiate these 2 entities noninvasively.
Collapse
Affiliation(s)
| | | | - Thomas Elgeti
- Pediatric Radiology, Charité University Medicine Berlin, Corporate Member of Free University of Berlin, Humboldt University of Berlin, Berlin, Germany
| | | | | | | |
Collapse
|
16
|
Forouzannezhad P, Maes D, Hippe DS, Thammasorn P, Iranzad R, Han J, Duan C, Liu X, Wang S, Chaovalitwongse WA, Zeng J, Bowen SR. Multitask Learning Radiomics on Longitudinal Imaging to Predict Survival Outcomes following Risk-Adaptive Chemoradiation for Non-Small Cell Lung Cancer. Cancers (Basel) 2022; 14:1228. [PMID: 35267535 PMCID: PMC8909466 DOI: 10.3390/cancers14051228] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 02/23/2022] [Accepted: 02/25/2022] [Indexed: 11/16/2022] Open
Abstract
Medical imaging provides quantitative and spatial information to evaluate treatment response in the management of patients with non-small cell lung cancer (NSCLC). High throughput extraction of radiomic features on these images can potentially phenotype tumors non-invasively and support risk stratification based on survival outcome prediction. The prognostic value of radiomics from different imaging modalities and time points prior to and during chemoradiation therapy of NSCLC, relative to conventional imaging biomarker or delta radiomics models, remains uncharacterized. We investigated the utility of multitask learning of multi-time point radiomic features, as opposed to single-task learning, for improving survival outcome prediction relative to conventional clinical imaging feature model benchmarks. Survival outcomes were prospectively collected for 45 patients with unresectable NSCLC enrolled on the FLARE-RT phase II trial of risk-adaptive chemoradiation and optional consolidation PD-L1 checkpoint blockade (NCT02773238). FDG-PET, CT, and perfusion SPECT imaging pretreatment and week 3 mid-treatment was performed and 110 IBSI-compliant pyradiomics shape-/intensity-/texture-based features from the metabolic tumor volume were extracted. Outcome modeling consisted of a fused Laplacian sparse group LASSO with component-wise gradient boosting survival regression in a multitask learning framework. Testing performance under stratified 10-fold cross-validation was evaluated for multitask learning radiomics of different imaging modalities and time points. Multitask learning models were benchmarked against conventional clinical imaging and delta radiomics models and evaluated with the concordance index (c-index) and index of prediction accuracy (IPA). FDG-PET radiomics had higher prognostic value for overall survival in test folds (c-index 0.71 [0.67, 0.75]) than CT radiomics (c-index 0.64 [0.60, 0.71]) or perfusion SPECT radiomics (c-index 0.60 [0.57, 0.63]). Multitask learning of pre-/mid-treatment FDG-PET radiomics (c-index 0.71 [0.67, 0.75]) outperformed benchmark clinical imaging (c-index 0.65 [0.59, 0.71]) and FDG-PET delta radiomics (c-index 0.52 [0.48, 0.58]) models. Similarly, the IPA for multitask learning FDG-PET radiomics (30%) was higher than clinical imaging (26%) and delta radiomics (15%) models. Radiomics models performed consistently under different voxel resampling conditions. Multitask learning radiomics for outcome modeling provides a clinical decision support platform that leverages longitudinal imaging information. This framework can reveal the relative importance of different imaging modalities and time points when designing risk-adaptive cancer treatment strategies.
Collapse
Affiliation(s)
- Parisa Forouzannezhad
- Department of Radiation Oncology, School of Medicine, University of Washington, Seattle, WA 98195, USA; (P.F.); (D.M.); (J.Z.)
| | - Dominic Maes
- Department of Radiation Oncology, School of Medicine, University of Washington, Seattle, WA 98195, USA; (P.F.); (D.M.); (J.Z.)
| | - Daniel S. Hippe
- Clinical Research Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA;
| | - Phawis Thammasorn
- Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA; (P.T.); (R.I.); (X.L.); (W.A.C.)
| | - Reza Iranzad
- Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA; (P.T.); (R.I.); (X.L.); (W.A.C.)
| | - Jie Han
- Department of Industrial, Manufacturing, and System Engineering, University of Texas, Arlington, TX 76019, USA; (J.H.); (S.W.)
| | - Chunyan Duan
- Department of Mechanical Engineering, Tongji University, Shanghai 200092, China;
| | - Xiao Liu
- Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA; (P.T.); (R.I.); (X.L.); (W.A.C.)
| | - Shouyi Wang
- Department of Industrial, Manufacturing, and System Engineering, University of Texas, Arlington, TX 76019, USA; (J.H.); (S.W.)
| | - W. Art Chaovalitwongse
- Department of Industrial Engineering, University of Arkansas, Fayetteville, AR 72701, USA; (P.T.); (R.I.); (X.L.); (W.A.C.)
| | - Jing Zeng
- Department of Radiation Oncology, School of Medicine, University of Washington, Seattle, WA 98195, USA; (P.F.); (D.M.); (J.Z.)
| | - Stephen R. Bowen
- Department of Radiation Oncology, School of Medicine, University of Washington, Seattle, WA 98195, USA; (P.F.); (D.M.); (J.Z.)
- Department of Radiology, School of Medicine, University of Washington, Seattle, WA 98195, USA
| |
Collapse
|
17
|
Tang X, Bai G, Wang H, Guo F, Yin H. Elaboration of Multiparametric MRI-Based Radiomics Signature for the Preoperative Quantitative Identification of the Histological Grade in Patients With Non-Small-Cell Lung Cancer. J Magn Reson Imaging 2022; 56:579-589. [PMID: 35040525 DOI: 10.1002/jmri.28051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 12/21/2021] [Accepted: 12/21/2021] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND The histological grading plays an essential role in the treatment decision of lung cancer. Detected tumors are usually biopsied to confirm histologic grade. How to use MRI extracted radiomics features for accurately grading lung cancer is still challenging. PURPOSE To examine the diagnostic utility of multiparametric MRI radiomics and clinical factors for grading non-small-cell lung cancer (NSCLC). STUDY TYPE Retrospective. POPULATION A total of 148 patients (25.7% female) with postoperative pathologically confirmed NSCLC and divided into the training cohort (N = 110) and the validation cohort (N = 38). FIELD STRENGTH/SEQUENCE A 1.5 T; single-shot turbo spin-echo (TSE), T2-weighted imaging (T2WI), and integrated shimming-echo planar imaging (ISHIM-EPI) diffusion-weighted imaging (DWI). ASSESSMENT A total of 2775 radiomics features were extracted from carcinomatous regions of interest on T2WI, DWI, and the apparent diffusion coefficient (ADC) maps. The five optimal features were selected by using the Student' s t-test, the least absolute shrinkage and selection operator (LASSO) and stepwise regression. The Radscore combined with clinical factors, which selected by univariate and multivariate analyses, to develop a radiomics-clinical nomogram. Its performance was evaluated in the training cohort and the validation cohort. The potential clinical usefulness was analyzed by the receiver operating characteristic curve (ROC), area under the curve (AUC), and the Hosmer-Lemeshow test. STATISTICAL TESTS Student's t-test, univariate analyses, multivariate analyses, LASSO, ROC, AUC, and the Hosmer-Lemeshow test. P < 0.05 was considered statistically significant. RESULTS Favorable discrimination performance was obtained for five optimal features (out of the 2775 features), using the training cohorts (AUC 0.761) and validation cohorts (AUC 0.753). In addition, the radiomics-clinical nomogram significantly improved the ability to identify histological grades in the training cohort (AUC 0.814) and the validation cohort (AUC 0.767). DATA CONCLUSIONS The radiomics-clinical nomogram based on multiparametric MRI might have the potential to distinguish the histological grade of NSCLC. EVIDENCE LEVEL 3 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Xing Tang
- Department of Radiology, Xijing Hospital, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
| | - Guoyan Bai
- Department of Clinical Laboratory, Shaanxi Provincial People's Hospital, Xi'an, Shaanxi, 710032, China
| | - Hong Wang
- Department of Radiology, Xijing Hospital, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
| | - Fan Guo
- Department of Radiology, Xijing Hospital, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
| | - Hong Yin
- Department of Radiology, Xijing Hospital, Fourth Military Medical University, Xi'an, Shaanxi, 710032, China
| |
Collapse
|
18
|
Magnetic Resonance Imaging Segmentation on the Basis of Boundary Tracking Algorithm in Lung Cancer Surgery. CONTRAST MEDIA & MOLECULAR IMAGING 2021; 2021:1368687. [PMID: 34858112 PMCID: PMC8592752 DOI: 10.1155/2021/1368687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/26/2021] [Accepted: 10/01/2021] [Indexed: 11/23/2022]
Abstract
This work was to study the guiding value of magnetic resonance imaging (MRI) based on the target region boundary tracking algorithm in lung cancer surgery. In this study, the traditional boundary tracking algorithm was optimized, and the target neighborhood point boundary tracking method was proposed. The iterative method was used to binarize the lung MRI image, which was applied to the MRI images of 50 lung cancer patients in hospital. The patients were divided into two groups as the progression-free survival (PFS) and overall survival (OS) of surgical treatment group (experimental group, n = 25) and nonsurgical treatment group (control group, n = 25). The experimental group received surgical resection, while the control group received systemic chemotherapy. The results showed that the traditional boundary tracking algorithm needed to manually rejudge whether the concave and convex parts of the image were missing. The target boundary tracking algorithm can effectively avoid the leakage of concave and convex parts and accurately locate the target image contour, fast operation, without manual intervention. The PFS time of the experimental group (325 days) was significantly higher than that of the control group (186 days) (P < 0.05). The OS time of the experimental group (697 days) was significantly higher than that of the control group (428 days) (P < 0.05). Fisher exact probability method was used to test the total survival time of patients in the two groups, and the tumor classification and treatment group had significant influence on the OS time (P < 0.05). The target boundary tracking algorithm in this study can effectively locate the contour of the target image, and the operation speed was fast. Surgical resection of lung cancer can improve the PFS and OS of patients.
Collapse
|
19
|
Sakai K. [2. Radiomics of MRI]. Nihon Hoshasen Gijutsu Gakkai Zasshi 2021; 77:866-875. [PMID: 34421076 DOI: 10.6009/jjrt.2021_jsrt_77.8.866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Koji Sakai
- Department of Radiology, Graduate School of Medical Science, Kyoto Prefectural University of Medicine
| |
Collapse
|
20
|
Khodabakhshi Z, Mostafaei S, Arabi H, Oveisi M, Shiri I, Zaidi H. Non-small cell lung carcinoma histopathological subtype phenotyping using high-dimensional multinomial multiclass CT radiomics signature. Comput Biol Med 2021; 136:104752. [PMID: 34391002 DOI: 10.1016/j.compbiomed.2021.104752] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 07/21/2021] [Accepted: 08/05/2021] [Indexed: 12/12/2022]
Abstract
OBJECTIVE The aim of this study was to identify the most important features and assess their discriminative power in the classification of the subtypes of NSCLC. METHODS This study involved 354 pathologically proven NSCLC patients including 134 squamous cell carcinoma (SCC), 110 large cell carcinoma (LCC), 62 not other specified (NOS), and 48 adenocarcinoma (ADC). In total, 1433 radiomics features were extracted from 3D volumes of interest drawn on the malignant lesion identified on CT images. Wrapper algorithm and multivariate adaptive regression splines were implemented to identify the most relevant/discriminative features. A multivariable multinomial logistic regression was employed with 1000 bootstrapping samples based on the selected features to classify four main subtypes of NSCLC. RESULTS The results revealed that the texture features, specifically gray level size zone matrix features (GLSZM), were the significant indicators of NSCLC subtypes. The optimized classifier achieved an average precision, recall, F1-score, and accuracy of 0.710, 0.703, 0.706, and 0.865, respectively, based on the selected features by the wrapper algorithm. CONCLUSIONS Our CT radiomics approach demonstrated impressive potential for the classification of the four main histological subtypes of NSCLC, It is anticipated that CT radiomics could be useful in treatment planning and precision medicine.
Collapse
Affiliation(s)
- Zahra Khodabakhshi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran
| | - Shayan Mostafaei
- Department of Biostatistics, School of Health, Kermanshah University of Medical Sciences, Kermanshah, Iran; Epidemiology and Biostatistics Unit, Rheumatology Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Mehrdad Oveisi
- Department of Computer Science, University of British Columbia, Vancouver BC, Canada; Comprehensive Cancer Centre, School of Cancer & Pharmaceutical Sciences, Faculty of Life Sciences & Medicine, King's College London, London, United Kingdom
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland; Geneva University Neurocenter, Geneva University, Geneva, Switzerland; Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, Netherlands; Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
21
|
Dahri M, Akbarialiabad H, Jahromi AM, Maleki R. Loading and release of cancer chemotherapy drugs utilizing simultaneous temperature and pH-responsive nanohybrid. BMC Pharmacol Toxicol 2021; 22:41. [PMID: 34261533 PMCID: PMC8278666 DOI: 10.1186/s40360-021-00508-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 06/28/2021] [Indexed: 01/07/2023] Open
Abstract
BACKGROUND Recently, the development of nanocarriers and the improvement of their biochemical properties have became of great importance. Single-walled carbon nanotubes (SWCNT) have many applications in drug delivery systems (DDS) as a common carbon-based structure. In the current work, the penetration, co-loading, and co-release of Doxorubicin (DOX) and Paclitaxel (PAX), as two cancer chemotherapy agents, were investigated using a novel modified copolymer with functionalized SWCNT. RESULTS This study proposes a dual-responsive smart carrier that is sensitive to pH and temperature. The carrier consists of functionalized SWNT and Dimethyl acrylamide-trimethyl chitosan (DMAA-TMC) grafting on SWCNT. This suggested carrier was investigated by utilizing molecular simulations. Interaction energies between DOX, PAX, and carrier as well as the affinity of drugs to the nanocarrier were studied. The energy analysis of drug release and adsorption presented that DOX and PAX delivery using this carrier is selective and sensitive at healthy and cancerous conditions. The attraction of DMAA-TMC, as a biodegradable and biocompatible copolymer, with SWCNT showed that degradation mechanism in acidic environment deformed the copolymer. This leads to a smart release mechanism in an acidic cancerous tissue. Additionally, it improves hydrophilicity, optimum nano-particle size, and cell cytotoxicity concerns. CONCLUSIONS The simulation results manifested a significant contribution of DMAA-TMC in the adsorption and release of cancer chemotherapy drugs in normal and neoplastic tissues. The interaction of copolymer also improves the biocompatibility and biodegradability of the SWCNT. Smart drug delivery carrier can be a valuable nanohybrid for loading, transporting, and releasing of cancer chemotherapy drugs.
Collapse
Affiliation(s)
- Mohammad Dahri
- Computational Biology and Chemistry Group (CBCG), Universal Scientific Education and Research Network (USERN), Tehran, Iran
| | - Hossein Akbarialiabad
- Student Research Committee, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Ahmad Miri Jahromi
- Computational Biology and Chemistry Group (CBCG), Universal Scientific Education and Research Network (USERN), Tehran, Iran
| | - Reza Maleki
- Computational Biology and Chemistry Group (CBCG), Universal Scientific Education and Research Network (USERN), Tehran, Iran.
| |
Collapse
|
22
|
Bębas E, Borowska M, Derlatka M, Oczeretko E, Hładuński M, Szumowski P, Mojsak M. Machine-learning-based classification of the histological subtype of non-small-cell lung cancer using MRI texture analysis. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102446] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
23
|
Ji Y, Qiu Q, Fu J, Cui K, Chen X, Xing L, Sun X. Stage-Specific PET Radiomic Prediction Model for the Histological Subtype Classification of Non-Small-Cell Lung Cancer. Cancer Manag Res 2021; 13:307-317. [PMID: 33469373 PMCID: PMC7811450 DOI: 10.2147/cmar.s287128] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Accepted: 12/28/2020] [Indexed: 12/11/2022] Open
Abstract
Purpose To investigate the impact of staging on differences in glucose metabolic heterogeneity between lung adenocarcinoma (ADC) and squamous cell carcinoma (SCC) by 18F-fluorodeoxyglucose positron emission tomography (18F-FDG PET) textural analysis and to develop a stage-specific PET radiomic prediction model to distinguish lung ADC from SCC. Patients and Methods Patients who were histologically diagnosed with lung ADC or SCC and underwent pretreatment 18F-FDG PET/CT scans were retrospectively identified. Radiomic features were extracted from a semiautomatically outlined tumor region in the Chang-Gung Image Texture Analysis (CGITA) software package. The differences in radiomic parameters between lung ADC and SCC were compared stage-by-stage in 253 consecutive NSCLC patients with stages I to III disease. The least absolute shrinkage and selection operator (LASSO) algorithm was used for feature selection. A radiomic signature for each stage was subsequently constructed and evaluated. Then, an individual nomogram incorporating the radiomic signature and clinical risk factors was established and evaluated. The performance of the constructed models was assessed by receiver operating characteristic (ROC) curve analysis, and the nomogram was further validated by calibration curve analysis. Results The performance of the radiomic signature for distinguishing lung ADC and SCC in both the training and validation cohorts was good, with AUCs of 0.883, 0.854, and 0.895 in the training cohort and 0.932, 0.944, and 0.886 in the validation cohort for stages I, II, and III NSCLC, respectively. The radiomic-clinical nomogram integrating radiomic features with independent clinical predictors exhibited more favorable discriminative performance, with AUCs of 0.982, 0.963, and 0.979 in the training cohort and 0.989, 0.984, and 0.978 in the validation cohort for stages I, II, and III, respectively. Conclusion Differences in PET radiomic features between lung ADC and SCC varied in different stages. Stage-specific PET radiomic prediction models provided more favorable performance for discriminating the histological subtype of NSCLC.
Collapse
Affiliation(s)
- Yanlei Ji
- Department of Ultrasound Medicine, Shandong Cancer Hospital and Institute, Cheeloo College of Medicine, Shandong University, Jinan, Shandong 250012, People's Republic of China.,Department of Ultrasound Medicine, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong 250117, People's Republic of China
| | - Qingtao Qiu
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong 250117, People's Republic of China
| | - Jing Fu
- Department of Ultrasound Medicine, The First Affiliated Hospital of Shandong First Medical University, Jinan, Shandong 250014, People's Republic of China
| | - Kai Cui
- Department of PET/CT, The Second Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong 250033, People's Republic of China
| | - Xia Chen
- Department of Nuclear Medicine, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong 250117, People's Republic of China
| | - Ligang Xing
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong 250117, People's Republic of China
| | - Xiaorong Sun
- Department of Nuclear Medicine, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, Shandong 250117, People's Republic of China
| |
Collapse
|
24
|
Liu Y, Zheng H, Xu X, Zhang X, Du P, Liang J, Lu H. The invasion depth measurement of bladder cancer using T2-weighted magnetic resonance imaging. Biomed Eng Online 2020; 19:92. [PMID: 33287834 PMCID: PMC7720543 DOI: 10.1186/s12938-020-00834-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Accepted: 11/19/2020] [Indexed: 12/28/2022] Open
Abstract
BACKGROUND Invasion depth is an important index for staging and clinical treatment strategy of bladder cancer (BCa). The aim of this study was to investigate the feasibility of segmenting the BCa region from bladder wall region on MRI, and quantitatively measuring the invasion depth of the tumor mass in bladder lumen for further clinical decision-making. This retrospective study involved 20 eligible patients with postoperatively pathologically confirmed BCa. It was conducted in the following steps: (1) a total of 1159 features were extracted from each voxel of both the certain cancerous and wall tissues with the T2-weighted (T2W) MRI data; (2) the support vector machine (SVM)-based recursive feature elimination (RFE) method was implemented to first select an optimal feature subset, and then develop the classification model for the precise separation of the cancerous regions; (3) after excluding the cancerous region from the bladder wall, the three-dimensional bladder wall thickness (BWT) was calculated using Laplacian method, and the invasion depth of BCa was eventually defined by the subtraction of the mean BWT excluding the cancerous region and the minimum BWT of the cancerous region. RESULTS The segmented results showed a promising accuracy, with the mean Dice similarity coefficient of 0.921. The "soft boundary" defined by the voxels with the probabilities between 0.1 and 0.9 could demonstrate the overlapped region of cancerous and wall tissues. The invasion depth calculated from proposed segmentation method was compared with that from manual segmentation, with a mean difference of 0.277 mm. CONCLUSION The proposed strategy could accurately segment the BCa region, and, as the first attempt, realize the quantitative measurement of BCa invasion depth.
Collapse
Affiliation(s)
- Yang Liu
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, 710032, PR China
| | - Haojie Zheng
- School of Life Sciences and Technology, Xidian University, 266 Xinglong Section of Xifeng Road, Xi'an, Shaanxi, 710126, PR China
| | - Xiaopan Xu
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, 710032, PR China
| | - Xi Zhang
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, 710032, PR China
| | - Peng Du
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, 710032, PR China
| | - Jimin Liang
- School of Life Sciences and Technology, Xidian University, 266 Xinglong Section of Xifeng Road, Xi'an, Shaanxi, 710126, PR China.
| | - Hongbing Lu
- School of Biomedical Engineering, Air Force Medical University, No. 169 Changle West Road, Xi'an, Shaanxi, 710032, PR China.
| |
Collapse
|
25
|
Yan M, Wang W. Development of a Radiomics Prediction Model for Histological Type Diagnosis in Solitary Pulmonary Nodules: The Combination of CT and FDG PET. Front Oncol 2020; 10:555514. [PMID: 33042839 PMCID: PMC7523028 DOI: 10.3389/fonc.2020.555514] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2020] [Accepted: 08/24/2020] [Indexed: 12/24/2022] Open
Abstract
PURPOSE To develop a diagnostic model for histological subtypes in lung cancer combined CT and FDG PET. METHODS Machine learning binary and four class classification of a cohort of 445 lung cancer patients who have CT and PET simultaneously. The outcomes to be predicted were primary, metastases (Mts), adenocarcinoma (Adc), and squamous cell carcinoma (Sqc). The classification method is a combination of machine learning and feature selection that is a Partition-Membership. The performance metrics include accuracy (Acc), precision (Pre), area under curve (AUC) and kappa statistics. RESULTS The combination of CT and PET radiomics (CPR) binary model showed more than 98% Acc and AUC on predicting Adc, Sqc, primary, and metastases, CPR four-class classification model showed 91% Acc and 0.89 Kappa. CONCLUSION The proposed CPR models can be used to obtain valid predictions of histological subtypes in lung cancer patients, assisting in diagnosis and shortening the time to diagnostic.
Collapse
Affiliation(s)
- Mengmeng Yan
- Urban Vocational College of Sichuan, Chengdu, China
- Sichuan Cancer Hospital & Institute, Chengdu, China
| | - Weidong Wang
- Department of Radiation Oncology, Sichuan Cancer Hospital & Institute, Chengdu, China
- Radiation Oncology Key Laboratory of Sichuan Province, Sichuan Cancer Hospital, Chengdu, China
| |
Collapse
|
26
|
Yan M, Wang W. A Non-invasive Method to Diagnose Lung Adenocarcinoma. Front Oncol 2020; 10:602. [PMID: 32411600 PMCID: PMC7200977 DOI: 10.3389/fonc.2020.00602] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2020] [Accepted: 04/02/2020] [Indexed: 12/19/2022] Open
Abstract
Purpose: To find out the CT radiomics features of differentiating lung adenocarcinoma from another lung cancer histological type. Methods: This was a historical cohort study, three independent lung cancer cohorts included. One cohort was used to evaluate the stability of radiomics features, one cohort was used to feature selection, and the last was used to construct and evaluate classification models. The research is divided into four steps: region of interest segmentation, feature extraction, feature selection, and model building and validation. The feature selection methods included the intraclass correlation coefficient, ReliefF coefficient, and Partition-Membership filter. The performance metrics of the classification model included accuracy (Acc), precision (Pre), area under curve (AUC), and kappa statistics. Results: The 10 features (First order shape features: Sphericity and Compacity, Gray-Level Run Length Matrix: Short-Run Emphasis, Low Gray-level Run Emphasis, and High Gray-level Run Emphasis, Gray Level Co-occurrence Matrix: Homogeneity, Energy, Contrast, Correlation, and Dissimilarity) showed the most stable and classification capability. The 6 classifiers, Logistic regression classifier (LR), Sequence Minimum Optimization algorithm, Random Forest, KStar, Naive Bayes and Random Committee, have great performance both on the train and the test sets, and especially LR has the best performance on the test set (Acc = 98.72, Pre = 0.988, AUC = 1, and kappa = 0.974). Conclusion: Lung adenocarcinoma can be identified based on CT radiomics features. We can diagnose lung adenocarcinoma with CT non-invasively.
Collapse
Affiliation(s)
- Mengmeng Yan
- Urban Vocational College of Sichuan, Chengdu, China
- School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
| | - Weidong Wang
- Department of Radiation Oncology, Sichuan Cancer Hospital and Institute, Chengdu, China
- Radiation Oncology Key Laboratory of Sichuan Province, Chengdu, China
| |
Collapse
|