1
|
Dong X, Chen G, Zhu Y, Ma B, Ban X, Wu N, Ming Y. Artificial intelligence in skeletal metastasis imaging. Comput Struct Biotechnol J 2024; 23:157-164. [PMID: 38144945 PMCID: PMC10749216 DOI: 10.1016/j.csbj.2023.11.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 11/02/2023] [Accepted: 11/02/2023] [Indexed: 12/26/2023] Open
Abstract
In the field of metastatic skeletal oncology imaging, the role of artificial intelligence (AI) is becoming more prominent. Bone metastasis typically indicates the terminal stage of various malignant neoplasms. Once identified, it necessitates a comprehensive revision of the initial treatment regime, and palliative care is often the only resort. Given the gravity of the condition, the diagnosis of bone metastasis should be approached with utmost caution. AI techniques are being evaluated for their efficacy in a range of tasks within medical imaging, including object detection, disease classification, region segmentation, and prognosis prediction in medical imaging. These methods offer a standardized solution to the frequently subjective challenge of image interpretation.This subjectivity is most desirable in bone metastasis imaging. This review describes the basic imaging modalities of bone metastasis imaging, along with the recent developments and current applications of AI in the respective imaging studies. These concrete examples emphasize the importance of using computer-aided systems in the clinical setting. The review culminates with an examination of the current limitations and prospects of AI in the realm of bone metastasis imaging. To establish the credibility of AI in this domain, further research efforts are required to enhance the reproducibility and attain robust level of empirical support.
Collapse
Affiliation(s)
- Xiying Dong
- Department of Orthopedic Surgery, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing 100730, China
- Key Laboratory of Big Data for Spinal Deformities, Chinese Academy of Medical Sciences, Beijing 100730, China
- Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing, China
- Department of Urology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, 100021 Beijing, China
| | - Guilin Chen
- Department of Orthopedic Surgery, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing 100730, China
- Key Laboratory of Big Data for Spinal Deformities, Chinese Academy of Medical Sciences, Beijing 100730, China
- Graduate School of Peking Union Medical College, Beijing 100730, China
| | - Yuanpeng Zhu
- Department of Orthopedic Surgery, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing 100730, China
- Key Laboratory of Big Data for Spinal Deformities, Chinese Academy of Medical Sciences, Beijing 100730, China
- Graduate School of Peking Union Medical College, Beijing 100730, China
| | - Boyuan Ma
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Xiaojuan Ban
- School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
| | - Nan Wu
- Department of Orthopedic Surgery, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing 100730, China
- Key Laboratory of Big Data for Spinal Deformities, Chinese Academy of Medical Sciences, Beijing 100730, China
- Beijing Key Laboratory for Genetic Research of Skeletal Deformity, Beijing 100730, China
| | - Yue Ming
- Department of Nuclear Medicine (PET-CT Center), National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
| |
Collapse
|
2
|
Zamani-Siahkali N, Mirshahvalad SA, Farbod A, Divband G, Pirich C, Veit-Haibach P, Cook G, Beheshti M. SPECT/CT, PET/CT, and PET/MRI for Response Assessment of Bone Metastases. Semin Nucl Med 2024; 54:356-370. [PMID: 38172001 DOI: 10.1053/j.semnuclmed.2023.11.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 11/14/2023] [Indexed: 01/05/2024]
Abstract
Recent developments in hybrid SPECT/CT systems and the use of cadmium-zinc-telluride (CZT) detectors have improved the diagnostic accuracy of bone scintigraphy. These advancements have paved the way for novel quantitative approaches to accurate and reproducible treatment monitoring of bone metastases. PET/CT imaging using [18F]F-FDG and [18F]F-NaF have shown promising clinical utility in bone metastases assessment and monitoring response to therapy and prediction of treatment response in a broad range of malignancies. Additionally, specific tumor-targeting tracers like [99mTc]Tc-PSMA, [68Ga]Ga-PSMA, or [11C]C- or [18F]F-Choline revealed high diagnostic performance for early assessment and prognostication of bone metastases, particularly in prostate cancer. PET/MRI appears highly accurate imaging modality, but has associated limitations notably, limited availability, more complex logistics and high installation costs. Advances in artificial intelligence (Al) seem to improve the accuracy of imaging modalities and provide an assistant role in the evaluation of treatment response of bone metastases.
Collapse
Affiliation(s)
- Nazanin Zamani-Siahkali
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria; Research Center for Nuclear Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Seyed Ali Mirshahvalad
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria; Joint Department of Medical Imaging, University Medical Imaging Toronto, University Health Network, Sinai Health System, Women's College Hospital, University of Toronto, Toronto, Canada
| | - Abolfazl Farbod
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria; Research Center for Nuclear Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | | | - Christian Pirich
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Patrick Veit-Haibach
- Joint Department of Medical Imaging, University Medical Imaging Toronto, University Health Network, Sinai Health System, Women's College Hospital, University of Toronto, Toronto, Canada
| | - Gary Cook
- Cancer Imaging Department, School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Mohsen Beheshti
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria.
| |
Collapse
|
3
|
Hajianfar G, Sabouri M, Salimi Y, Amini M, Bagheri S, Jenabi E, Hekmat S, Maghsudi M, Mansouri Z, Khateri M, Hosein Jamshidi M, Jafari E, Bitarafan Rajabi A, Assadi M, Oveisi M, Shiri I, Zaidi H. Artificial intelligence-based analysis of whole-body bone scintigraphy: The quest for the optimal deep learning algorithm and comparison with human observer performance. Z Med Phys 2024; 34:242-257. [PMID: 36932023 PMCID: PMC11156776 DOI: 10.1016/j.zemedi.2023.01.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/22/2022] [Accepted: 01/18/2023] [Indexed: 03/17/2023]
Abstract
PURPOSE Whole-body bone scintigraphy (WBS) is one of the most widely used modalities in diagnosing malignant bone diseases during the early stages. However, the procedure is time-consuming and requires vigour and experience. Moreover, interpretation of WBS scans in the early stages of the disorders might be challenging because the patterns often reflect normal appearance that is prone to subjective interpretation. To simplify the gruelling, subjective, and prone-to-error task of interpreting WBS scans, we developed deep learning (DL) models to automate two major analyses, namely (i) classification of scans into normal and abnormal and (ii) discrimination between malignant and non-neoplastic bone diseases, and compared their performance with human observers. MATERIALS AND METHODS After applying our exclusion criteria on 7188 patients from three different centers, 3772 and 2248 patients were enrolled for the first and second analyses, respectively. Data were split into two parts, including training and testing, while a fraction of training data were considered for validation. Ten different CNN models were applied to single- and dual-view input (posterior and anterior views) modes to find the optimal model for each analysis. In addition, three different methods, including squeeze-and-excitation (SE), spatial pyramid pooling (SPP), and attention-augmented (AA), were used to aggregate the features for dual-view input models. Model performance was reported through area under the receiver operating characteristic (ROC) curve (AUC), accuracy, sensitivity, and specificity and was compared with the DeLong test applied to ROC curves. The test dataset was evaluated by three nuclear medicine physicians (NMPs) with different levels of experience to compare the performance of AI and human observers. RESULTS DenseNet121_AA (DensNet121, with dual-view input aggregated by AA) and InceptionResNetV2_SPP achieved the highest performance (AUC = 0.72) for the first and second analyses, respectively. Moreover, on average, in the first analysis, Inception V3 and InceptionResNetV2 CNN models and dual-view input with AA aggregating method had superior performance. In addition, in the second analysis, DenseNet121 and InceptionResNetV2 as CNN methods and dual-view input with AA aggregating method achieved the best results. Conversely, the performance of AI models was significantly higher than human observers for the first analysis, whereas their performance was comparable in the second analysis, although the AI model assessed the scans in a drastically lower time. CONCLUSION Using the models designed in this study, a positive step can be taken toward improving and optimizing WBS interpretation. By training DL models with larger and more diverse cohorts, AI could potentially be used to assist physicians in the assessment of WBS images.
Collapse
Affiliation(s)
- Ghasem Hajianfar
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Maziar Sabouri
- Department of Medical Physics, School of Medicine, Iran University of Medical Science, Tehran, Iran; Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Mehdi Amini
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Soroush Bagheri
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Elnaz Jenabi
- Research Center for Nuclear Medicine, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Sepideh Hekmat
- Hasheminejad Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Mehdi Maghsudi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Zahra Mansouri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Maziar Khateri
- Department of Medical Radiation Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Mohammad Hosein Jamshidi
- Department of Medical Imaging and Radiation Sciences, School of Allied Medical Sciences, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Esmail Jafari
- The Persian Gulf Nuclear Medicine Research Center, Department of Molecular Imaging and Radionuclide Therapy, Bushehr Medical University Hospital, School of Medicine, Bushehr University of Medical Sciences, Bushehr, Iran
| | - Ahmad Bitarafan Rajabi
- Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Majid Assadi
- The Persian Gulf Nuclear Medicine Research Center, Department of Molecular Imaging and Radionuclide Therapy, Bushehr Medical University Hospital, School of Medicine, Bushehr University of Medical Sciences, Bushehr, Iran
| | - Mehrdad Oveisi
- Department of Computer Science, University of British Columbia, Vancouver, BC, Canada
| | - Isaac Shiri
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva 4, Switzerland; Geneva University Neurocenter, Geneva University, Geneva, Switzerland; Department of Nuclear Medicine and Molecular Imaging, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands; Department of Nuclear Medicine, University of Southern Denmark, Odense, Denmark.
| |
Collapse
|
4
|
Sung C, Oh JS, Park BS, Kim SS, Song SY, Lee JJ. Diagnostic performance of a deep-learning model using 18F-FDG PET/CT for evaluating recurrence after radiation therapy in patients with lung cancer. Ann Nucl Med 2024:10.1007/s12149-024-01925-5. [PMID: 38589677 DOI: 10.1007/s12149-024-01925-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Accepted: 03/21/2024] [Indexed: 04/10/2024]
Abstract
OBJECTIVE We developed a deep learning model for distinguishing radiation therapy (RT)-related changes and tumour recurrence in patients with lung cancer who underwent RT, and evaluated its performance. METHODS We retrospectively recruited 308 patients with lung cancer with RT-related changes observed on 18F-fluorodeoxyglucose positron emission tomography-computed tomography (18F-FDG PET/CT) performed after RT. Patients were labelled as positive or negative for tumour recurrence through histologic diagnosis or clinical follow-up after 18F-FDG PET/CT. A two-dimensional (2D) slice-based convolutional neural network (CNN) model was created with a total of 3329 slices as input, and performance was evaluated with five independent test sets. RESULTS For the five independent test sets, the area under the curve (AUC) of the receiver operating characteristic curve, sensitivity, and specificity were in the range of 0.98-0.99, 95-98%, and 87-95%, respectively. The region determined by the model was confirmed as an actual recurred tumour through the explainable artificial intelligence (AI) using gradient-weighted class activation mapping (Grad-CAM). CONCLUSION The 2D slice-based CNN model using 18F-FDG PET imaging was able to distinguish well between RT-related changes and tumour recurrence in patients with lung cancer.
Collapse
Affiliation(s)
- Changhwan Sung
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Korea
| | - Jungsu S Oh
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Korea
| | - Byung Soo Park
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Korea
| | - Su Ssan Kim
- Department of Radiation Oncology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Si Yeol Song
- Department of Radiation Oncology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Jong Jin Lee
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-Ro 43-Gil, Songpa-Gu, Seoul, 05505, Korea.
| |
Collapse
|
5
|
Mohseninia N, Zamani-Siahkali N, Harsini S, Divband G, Pirich C, Beheshti M. Bone Metastasis in Prostate Cancer: Bone Scan Versus PET Imaging. Semin Nucl Med 2024; 54:97-118. [PMID: 37596138 DOI: 10.1053/j.semnuclmed.2023.07.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 07/11/2023] [Indexed: 08/20/2023]
Abstract
Prostate cancer is the second most common cause of malignancy among men, with bone metastasis being a significant source of morbidity and mortality in advanced cases. Detecting and treating bone metastasis at an early stage is crucial to improve the quality of life and survival of prostate cancer patients. This objective strongly relies on imaging studies. While CT and MRI have their specific utilities, they also possess certain drawbacks. Bone scintigraphy, although cost-effective and widely available, presents high false-positive rates. The emergence of PET/CT and PET/MRI, with their ability to overcome the limitations of standard imaging methods, offers promising alternatives for the detection of bone metastasis. Various radiotracers targeting cell division activity or cancer-specific membrane proteins, as well as bone seeking agents, have been developed and tested. The use of positron-emitting isotopes such as fluorine-18 and gallium-68 for labeling allows for a reduced radiation dose and unaffected biological properties. Furthermore, the integration of artificial intelligence (AI) and radiomics techniques in medical imaging has shown significant advancements in reducing interobserver variability, improving accuracy, and saving time. This article provides an overview of the advantages and limitations of bone scan using SPECT and SPECT/CT and PET imaging methods with different radiopharmaceuticals and highlights recent developments in hybrid scanners, AI, and radiomics for the identification of prostate cancer bone metastasis using molecular imaging.
Collapse
Affiliation(s)
- Nasibeh Mohseninia
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Nazanin Zamani-Siahkali
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria; Department of Nuclear Medicine, Research center for Nuclear Medicine and Molecular Imaging, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Sara Harsini
- Department of Molecular Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | | | - Christian Pirich
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria
| | - Mohsen Beheshti
- Division of Molecular Imaging and Theranostics, Department of Nuclear Medicine, University Hospital, Paracelsus Medical University, Salzburg, Austria.
| |
Collapse
|
6
|
Han S, Oh JS, Seo SY, Lee JJ. Performance of deep learning models for response evaluation on whole-body bone scans in prostate cancer. Ann Nucl Med 2023; 37:685-694. [PMID: 37819584 DOI: 10.1007/s12149-023-01872-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 09/25/2023] [Indexed: 10/13/2023]
Abstract
OBJECTIVE We aimed to develop deep learning classifiers for assessing therapeutic response on bone scans of patients with prostate cancer. METHODS A set of 3791 consecutive bone scans coupled with their last previous scan (1528 patients) was evaluated. Bone scans were labeled as "progression" or "nonprogression" on the basis of clinical reports and image review. A 2D-convolutional neural network architecture was trained with three different preprocessing methods: 1) no preprocessing (Raw), 2) spatial normalization (SN), and 3) spatial and count normalization (SCN). Data were allocated into training, validation, and test sets in the ratio of 72:8:20, with the 20% independent test set rotating all scans over a five-fold testing procedure. A Grad-CAM algorithm was employed to generate class activation maps to visualize the lesions contributing to the decision. Diagnostic performance was compared using area under the receiver operating characteristics curves (AUCs). RESULTS The data consisted of 791 scans labeled as "progression" and 3000 scans labeled as "nonprogression." The AUCs of the classifiers were 0.632-0.710 on the Raw dataset, were significantly higher with the use of SN at 0.784-0.854 (p < 0.001 for Raw versus SN), and higher still with SCN at 0.954-0.979 (p < 0.001 for SN versus SCN). Class activation maps of the SCN model visualized lesions contributing to the model's decision of progression. CONCLUSION With preprocessing of spatial and count normalization, our deep learning model achieved excellent performance in classifying the therapeutic response of bone scans in patients with prostate cancer.
Collapse
Affiliation(s)
- Sangwon Han
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-ro 43-gil, Songpa-gu, Seoul, 05505, South Korea
| | - Jungsu S Oh
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-ro 43-gil, Songpa-gu, Seoul, 05505, South Korea
| | - Seung Yeon Seo
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-ro 43-gil, Songpa-gu, Seoul, 05505, South Korea
| | - Jong Jin Lee
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-ro 43-gil, Songpa-gu, Seoul, 05505, South Korea.
| |
Collapse
|
7
|
Meng Y, Yang Y, Hu M, Zhang Z, Zhou X. Artificial intelligence-based radiomics in bone tumors: Technical advances and clinical application. Semin Cancer Biol 2023; 95:75-87. [PMID: 37499847 DOI: 10.1016/j.semcancer.2023.07.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 07/21/2023] [Accepted: 07/22/2023] [Indexed: 07/29/2023]
Abstract
Radiomics is the extraction of predefined mathematic features from medical images for predicting variables of clinical interest. Recent research has demonstrated that radiomics can be processed by artificial intelligence algorithms to reveal complex patterns and trends for diagnosis, and prediction of prognosis and response to treatment modalities in various types of cancer. Artificial intelligence tools can utilize radiological images to solve next-generation issues in clinical decision making. Bone tumors can be classified as primary and secondary (metastatic) tumors. Osteosarcoma, Ewing sarcoma, and chondrosarcoma are the dominating primary tumors of bone. The development of bone tumor model systems and relevant research, and the assessment of novel treatment methods are ongoing to improve clinical outcomes, notably for patients with metastases. Artificial intelligence and radiomics have been utilized in almost full spectrum of clinical care of bone tumors. Radiomics models have achieved excellent performance in the diagnosis and grading of bone tumors. Furthermore, the models enable to predict overall survival, metastases, and recurrence. Radiomics features have exhibited promise in assisting therapeutic planning and evaluation, especially neoadjuvant chemotherapy. This review provides an overview of the evolution and opportunities for artificial intelligence in imaging, with a focus on hand-crafted features and deep learning-based radiomics approaches. We summarize the current application of artificial intelligence-based radiomics both in primary and metastatic bone tumors, and discuss the limitations and future opportunities of artificial intelligence-based radiomics in this field. In the era of personalized medicine, our in-depth understanding of emerging artificial intelligence-based radiomics approaches will bring innovative solutions to bone tumors and achieve clinical application.
Collapse
Affiliation(s)
- Yichen Meng
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Yue Yang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Miao Hu
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China
| | - Zheng Zhang
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| | - Xuhui Zhou
- Department of Orthopedics, Second Affiliated Hospital of Naval Medical University, Shanghai 200003, PR China.
| |
Collapse
|
8
|
Doi K, Takegawa H, Yui M, Anetai Y, Koike Y, Nakamura S, Tanigawa N, Koziumi M, Nishio T. Deep learning-based detection of patients with bone metastasis from Japanese radiology reports. Jpn J Radiol 2023; 41:900-908. [PMID: 36988827 DOI: 10.1007/s11604-023-01413-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 03/07/2023] [Indexed: 03/30/2023]
Abstract
PURPOSE Deep learning (DL) is a state-of-the-art technique for developing artificial intelligence in various domains and it improves the performance of natural language processing (NLP). Therefore, we aimed to develop a DL-based NLP model that classifies the status of bone metastasis (BM) in radiology reports to detect patients with BM. MATERIALS AND METHODS The DL-based NLP model was developed by training long short-term memory using 1,749 free-text radiology reports written in Japanese. We adopted five-fold cross-validation and used 200 reports for testing the five models. The accuracy, sensitivity, specificity, precision, and area under the receiver operating characteristics curve (AUROC) were used for the model evaluation. RESULTS The developed model demonstrated classification performance with mean ± standard deviation of 0.912 ± 0.012, 0.924 ± 0.029, 0.901 ± 0.014, 0.898 ± 0.012, and 0.968 ± 0.004 for accuracy, sensitivity, specificity, precision, and AUROC, respectively. CONCLUSION The proposed DL-based NLP model may help in the early and efficient detection of patients with BM.
Collapse
Affiliation(s)
- Kentaro Doi
- Department of Medical Physics and Engineering, Osaka University Graduate School of Medicine, 1-7 Yamadaoka, Suita-Shi, Osaka, Japan
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
| | - Hideki Takegawa
- Department of Medical Physics and Engineering, Osaka University Graduate School of Medicine, 1-7 Yamadaoka, Suita-Shi, Osaka, Japan.
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan.
- Department of Radiation Oncology, Kansai Medical University Hospital, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan.
| | - Midori Yui
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
- Department of Radiation Oncology, Kansai Medical University Hospital, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
| | - Yusuke Anetai
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
- Department of Radiation Oncology, Kansai Medical University Hospital, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
| | - Yuhei Koike
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
- Department of Radiation Oncology, Kansai Medical University Hospital, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
| | - Satoaki Nakamura
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
- Department of Radiation Oncology, Kansai Medical University Hospital, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
| | - Noboru Tanigawa
- Department of Radiology, Kansai Medical University Graduate School of Medicine, 2-5-1 Shinmachi, Hirakata-Shi, Osaka, Japan
| | - Masahiko Koziumi
- Department of Medical Physics and Engineering, Osaka University Graduate School of Medicine, 1-7 Yamadaoka, Suita-Shi, Osaka, Japan
| | - Teiji Nishio
- Department of Medical Physics and Engineering, Osaka University Graduate School of Medicine, 1-7 Yamadaoka, Suita-Shi, Osaka, Japan
| |
Collapse
|
9
|
Seo SY, Oh JS, Chung J, Kim SY, Kim JS. MR Template-Based Individual Brain PET Volumes-of-Interest Generation Neither Using MR nor Using Spatial Normalization. Nucl Med Mol Imaging 2023; 57:73-85. [PMID: 36998592 PMCID: PMC10043100 DOI: 10.1007/s13139-022-00772-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Revised: 07/01/2022] [Accepted: 08/29/2022] [Indexed: 10/10/2022] Open
Abstract
For more anatomically precise quantitation of mouse brain PET, spatial normalization (SN) of PET onto MR template and subsequent template volumes-of-interest (VOIs)-based analysis are commonly used. Although this leads to dependency on the corresponding MR and the process of SN, routine preclinical/clinical PET images cannot always afford corresponding MR and relevant VOIs. To resolve this issue, we propose a deep learning (DL)-based individual-brain-specific VOIs (i.e., cortex, hippocampus, striatum, thalamus, and cerebellum) directly generated from PET images using the inverse-spatial-normalization (iSN)-based VOI labels and deep convolutional neural network model (deep CNN). Our technique was applied to mutated amyloid precursor protein and presenilin-1 mouse model of Alzheimer's disease. Eighteen mice underwent T2-weighted MRI and 18F FDG PET scans before and after the administration of human immunoglobin or antibody-based treatments. To train the CNN, PET images were used as inputs and MR iSN-based target VOIs as labels. Our devised methods achieved decent performance in terms of not only VOI agreements (i.e., Dice similarity coefficient) but also the correlation of mean counts and SUVR, and CNN-based VOIs was highly accordant with ground-truth (the corresponding MR and MR template-based VOIs). Moreover, the performance metrics were comparable to that of VOI generated by MR-based deep CNN. In conclusion, we established a novel quantitative analysis method both MR-less and SN-less fashion to generate individual brain space VOIs using MR template-based VOIs for PET image quantification. Supplementary Information The online version contains supplementary material available at 10.1007/s13139-022-00772-4.
Collapse
Affiliation(s)
- Seung Yeon Seo
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympicro-43 Rd, Songpa-gu, Seoul, 05505 South Korea
- Department of Biomedical Engineering, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
| | - Jungsu S. Oh
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympicro-43 Rd, Songpa-gu, Seoul, 05505 South Korea
| | - Jinwha Chung
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympicro-43 Rd, Songpa-gu, Seoul, 05505 South Korea
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
| | - Seog-Young Kim
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympicro-43 Rd, Songpa-gu, Seoul, 05505 South Korea
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
| | - Jae Seung Kim
- Department of Nuclear Medicine, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympicro-43 Rd, Songpa-gu, Seoul, 05505 South Korea
| |
Collapse
|
10
|
Systematic Review of Tumor Segmentation Strategies for Bone Metastases. Cancers (Basel) 2023; 15:cancers15061750. [PMID: 36980636 PMCID: PMC10046265 DOI: 10.3390/cancers15061750] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 03/09/2023] [Accepted: 03/10/2023] [Indexed: 03/18/2023] Open
Abstract
Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.
Collapse
|
11
|
Ibrahim A, Vaidyanathan A, Primakov S, Belmans F, Bottari F, Refaee T, Lovinfosse P, Jadoul A, Derwael C, Hertel F, Woodruff HC, Zacho HD, Walsh S, Vos W, Occhipinti M, Hanin FX, Lambin P, Mottaghy FM, Hustinx R. Deep learning based identification of bone scintigraphies containing metastatic bone disease foci. Cancer Imaging 2023; 23:12. [PMID: 36698217 PMCID: PMC9875407 DOI: 10.1186/s40644-023-00524-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 01/05/2023] [Indexed: 01/26/2023] Open
Abstract
PURPOSE Metastatic bone disease (MBD) is the most common form of metastases, most frequently deriving from prostate cancer. MBD is screened with bone scintigraphy (BS), which have high sensitivity but low specificity for the diagnosis of MBD, often requiring further investigations. Deep learning (DL) - a machine learning technique designed to mimic human neuronal interactions- has shown promise in the field of medical imaging analysis for different purposes, including segmentation and classification of lesions. In this study, we aim to develop a DL algorithm that can classify areas of increased uptake on bone scintigraphy scans. METHODS We collected 2365 BS from three European medical centres. The model was trained and validated on 1203 and 164 BS scans respectively. Furthermore we evaluated its performance on an external testing set composed of 998 BS scans. We further aimed to enhance the explainability of our developed algorithm, using activation maps. We compared the performance of our algorithm to that of 6 nuclear medicine physicians. RESULTS The developed DL based algorithm is able to detect MBD on BSs, with high specificity and sensitivity (0.80 and 0.82 respectively on the external test set), in a shorter time compared to the nuclear medicine physicians (2.5 min for AI and 30 min for nuclear medicine physicians to classify 134 BSs). Further prospective validation is required before the algorithm can be used in the clinic.
Collapse
Affiliation(s)
- Abdalla Ibrahim
- grid.5012.60000 0001 0481 6099The D-Lab, Department of Precision Medicine, GROW- School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands ,grid.239585.00000 0001 2285 2675Department of Radiology and Nuclear Medicine, Columbia University Irving Medical Center, New York, United States ,grid.411374.40000 0000 8607 6858Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege, Liege, Belgium ,grid.412301.50000 0000 8653 1507Department of Nuclear Medicine and Comprehensive diagnostic centre Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - Akshayaa Vaidyanathan
- grid.5012.60000 0001 0481 6099The D-Lab, Department of Precision Medicine, GROW- School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands ,Radiomics (Oncoradiomics SA), Liege, Belgium
| | - Sergey Primakov
- grid.5012.60000 0001 0481 6099The D-Lab, Department of Precision Medicine, GROW- School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands ,grid.239585.00000 0001 2285 2675Department of Radiology and Nuclear Medicine, Columbia University Irving Medical Center, New York, United States
| | | | | | - Turkey Refaee
- grid.5012.60000 0001 0481 6099The D-Lab, Department of Precision Medicine, GROW- School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands ,grid.411831.e0000 0004 0398 1027Department of Diagnostic Radiology, Faculty of Applied Medical Sciences, Jazan University, Jazan, Saudi Arabia
| | - Pierre Lovinfosse
- grid.411374.40000 0000 8607 6858Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege, Liege, Belgium
| | - Alexandre Jadoul
- grid.411374.40000 0000 8607 6858Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege, Liege, Belgium
| | - Celine Derwael
- grid.411374.40000 0000 8607 6858Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege, Liege, Belgium
| | - Fabian Hertel
- grid.412301.50000 0000 8653 1507Department of Nuclear Medicine and Comprehensive diagnostic centre Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - Henry C. Woodruff
- grid.5012.60000 0001 0481 6099The D-Lab, Department of Precision Medicine, GROW- School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands ,grid.239585.00000 0001 2285 2675Department of Radiology and Nuclear Medicine, Columbia University Irving Medical Center, New York, United States
| | - Helle D. Zacho
- grid.27530.330000 0004 0646 7349Department of Nuclear Medicine, Clinical Cancer Research Centre, Aalborg University Hospital, Aalborg, Denmark ,grid.5117.20000 0001 0742 471XDepartment of Clinical Medicine, Aalborg University, Aalborg, Denmark
| | - Sean Walsh
- Radiomics (Oncoradiomics SA), Liege, Belgium
| | - Wim Vos
- Radiomics (Oncoradiomics SA), Liege, Belgium
| | | | - François-Xavier Hanin
- grid.7942.80000 0001 2294 713XDepartment of Nuclear Medicine, Universite´CatholiqueUniversite´Catholique de Louvain, CHU-UCL-Namur, Ottignies-Louvain-la-Neuve, Belgium
| | - Philippe Lambin
- grid.5012.60000 0001 0481 6099The D-Lab, Department of Precision Medicine, GROW- School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands ,grid.239585.00000 0001 2285 2675Department of Radiology and Nuclear Medicine, Columbia University Irving Medical Center, New York, United States
| | - Felix M. Mottaghy
- grid.239585.00000 0001 2285 2675Department of Radiology and Nuclear Medicine, Columbia University Irving Medical Center, New York, United States ,grid.412301.50000 0000 8653 1507Department of Nuclear Medicine and Comprehensive diagnostic centre Aachen (CDCA), University Hospital RWTH Aachen University, Aachen, Germany
| | - Roland Hustinx
- grid.411374.40000 0000 8607 6858Division of Nuclear Medicine and Oncological Imaging, Department of Medical Physics, University Hospital of Liege, Liege, Belgium
| |
Collapse
|
12
|
Kao YS, Huang CP, Tsai WW, Yang J. A systematic review for using deep learning in bone scan classification. Clin Transl Imaging 2023. [DOI: 10.1007/s40336-023-00539-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
13
|
Zhou X, Wang H, Feng C, Xu R, He Y, Li L, Tu C. Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges. Front Oncol 2022; 12:908873. [PMID: 35928860 PMCID: PMC9345628 DOI: 10.3389/fonc.2022.908873] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 06/15/2022] [Indexed: 12/12/2022] Open
Abstract
Deep learning is a subfield of state-of-the-art artificial intelligence (AI) technology, and multiple deep learning-based AI models have been applied to musculoskeletal diseases. Deep learning has shown the capability to assist clinical diagnosis and prognosis prediction in a spectrum of musculoskeletal disorders, including fracture detection, cartilage and spinal lesions identification, and osteoarthritis severity assessment. Meanwhile, deep learning has also been extensively explored in diverse tumors such as prostate, breast, and lung cancers. Recently, the application of deep learning emerges in bone tumors. A growing number of deep learning models have demonstrated good performance in detection, segmentation, classification, volume calculation, grading, and assessment of tumor necrosis rate in primary and metastatic bone tumors based on both radiological (such as X-ray, CT, MRI, SPECT) and pathological images, implicating a potential for diagnosis assistance and prognosis prediction of deep learning in bone tumors. In this review, we first summarized the workflows of deep learning methods in medical images and the current applications of deep learning-based AI for diagnosis and prognosis prediction in bone tumors. Moreover, the current challenges in the implementation of the deep learning method and future perspectives in this field were extensively discussed.
Collapse
Affiliation(s)
- Xiaowen Zhou
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Xiangya School of Medicine, Central South University, Changsha, China
| | - Hua Wang
- Xiangya School of Medicine, Central South University, Changsha, China
| | - Chengyao Feng
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Hunan Key Laboratory of Tumor Models and Individualized Medicine, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Ruilin Xu
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Hunan Key Laboratory of Tumor Models and Individualized Medicine, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Yu He
- Department of Radiology, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Lan Li
- Department of Pathology, The Second Xiangya Hospital, Central South University, Changsha, China
| | - Chao Tu
- Department of Orthopaedics, The Second Xiangya Hospital, Central South University, Changsha, China
- Hunan Key Laboratory of Tumor Models and Individualized Medicine, The Second Xiangya Hospital, Central South University, Changsha, China
- *Correspondence: Chao Tu,
| |
Collapse
|
14
|
Fully Automatic Quantitative Measurement of 18F-FDG PET/CT in Thymic Epithelial Tumors Using a Convolutional Neural Network. Clin Nucl Med 2022; 47:590-598. [DOI: 10.1097/rlu.0000000000004146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
15
|
Deng F, Li X, Yang F, Sun H, Yuan J, He Q, Xu W, Yang Y, Liang D, Liu X, Mok GSP, Zheng H, Hu Z. Low-Dose 68 Ga-PSMA Prostate PET/MRI Imaging Using Deep Learning Based on MRI Priors. Front Oncol 2022; 11:818329. [PMID: 35155207 PMCID: PMC8825350 DOI: 10.3389/fonc.2021.818329] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 12/27/2021] [Indexed: 12/02/2022] Open
Abstract
Background 68 Ga-prostate-specific membrane antigen (PSMA) PET/MRI has become an effective imaging method for prostate cancer. The purpose of this study was to use deep learning methods to perform low-dose image restoration on PSMA PET/MRI and to evaluate the effect of synthesis on the images and the medical diagnosis of patients at risk of prostate cancer. Methods We reviewed the 68 Ga-PSMA PET/MRI data of 41 patients. The low-dose PET (LDPET) images of these patients were restored to full-dose PET (FDPET) images through a deep learning method based on MRI priors. The synthesized images were evaluated according to quantitative scores from nuclear medicine doctors and multiple imaging indicators, such as peak-signal noise ratio (PSNR), structural similarity (SSIM), normalization mean square error (NMSE), and relative contrast-to-noise ratio (RCNR). Results The clinical quantitative scores of the FDPET images synthesized from 25%- and 50%-dose images based on MRI priors were 3.84±0.36 and 4.03±0.17, respectively, which were higher than the scores of the target images. Correspondingly, the PSNR, SSIM, NMSE, and RCNR values of the FDPET images synthesized from 50%-dose PET images based on MRI priors were 39.88±3.83, 0.896±0.092, 0.012±0.007, and 0.996±0.080, respectively. Conclusion According to a combination of quantitative scores from nuclear medicine doctors and evaluations with multiple image indicators, the synthesis of FDPET images based on MRI priors using and 50%-dose PET images did not affect the clinical diagnosis of prostate cancer. Prostate cancer patients can undergo 68 Ga-PSMA prostate PET/MRI scans with radiation doses reduced by up to 50% through the use of deep learning methods to synthesize FDPET images.
Collapse
Affiliation(s)
- Fuquan Deng
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Computer Department, North China Electric Power University, Baoding, China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen, China
| | - Xiaoyuan Li
- Department of Nuclear Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Fengjiao Yang
- Department of Nuclear Medicine, Nanjing First Hospital, Nanjing Medical University, Nanjing, China
| | - Hongwei Sun
- United Imaging Research Institute of Intelligent Imaging, Beijing, China
| | - Jianmin Yuan
- Central Research Institute, United Imaging Healthcare Group, Shanghai, China
| | - Qiang He
- Central Research Institute, United Imaging Healthcare Group, Shanghai, China
| | - Weifeng Xu
- Computer Department, North China Electric Power University, Baoding, China
| | - Yongfeng Yang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen, China
| | - Dong Liang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen, China
| | - Xin Liu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen, China
| | - Greta S P Mok
- Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau, Avenida da Universidade, Macau SAR, China
| | - Hairong Zheng
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen, China
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.,Chinese Academy of Sciences Key Laboratory of Health Informatics, Shenzhen, China
| |
Collapse
|
16
|
Liu S, Feng M, Qiao T, Cai H, Xu K, Yu X, Jiang W, Lv Z, Wang Y, Li D. Deep Learning for the Automatic Diagnosis and Analysis of Bone Metastasis on Bone Scintigrams. Cancer Manag Res 2022; 14:51-65. [PMID: 35018121 PMCID: PMC8740774 DOI: 10.2147/cmar.s340114] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 12/19/2021] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVE To develop an approach for automatically analyzing bone metastases (BMs) on bone scintigrams based on deep learning technology. METHODS This research included a bone scan classification model, a regional segmentation model, an assessment model for tumor burden and a diagnostic report generation model. Two hundred eighty patients with BMs and 341 patients with non-BMs were involved. Eighty percent of cases were randomly extracted from two groups as training set. Remaining cases were as testing set. A deep residual convolutional neural network with different structures was used to determine whether metastatic bone lesions existed, regions of lesions were automatically segmented. Bone scan tumor burden index (BSTBI) was calculated; finally, diagnostic report could be automatically generated. The sensitivity, specificity and accuracy of classification model were compared with three physicians with different clinical experience. The Dice coefficient evaluated the effect of segmentation model and compared to the result of nnU-Net model. The correlation between BSTBI and blood alkaline phosphatase (ALP) level was analyzed to verify the efficiency of BSTBI. The performance of report generation model was evaluated by the accuracy of interpretation of report. RESULTS In testing set, the sensitivity, specificity and accuracy of classification model were 92.59%, 85.51% and 88.62%, respectively. The accuracy showed no statistical difference with moderately and experienced physicians and obviously outperformed the inexperienced. The Dice coefficient of BMs area was 0.7387 in segmentation stage. Based on the whole model frame, our segmentation model outperformed the nnU-Net. BSTBI value changed as the BMs changed. There was a positive correlation between BSTBI and ALP level. The accuracy of report generation model was 78.05%. CONCLUSION Deep learning based on automatic analysis frameworks for BMs can accurately identify BMs, preliminarily realize a fully automatic analysis process from raw data to report generation. BSTBI can be used as a quantitative evaluation indicator to assess the effect of therapy on BMs in different patients or in the same patient before and after treatment.
Collapse
Affiliation(s)
- Simin Liu
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| | - Ming Feng
- School of Electronic and Information Engineering, Tongji University, Shanghai, People’s Republic of China
| | - Tingting Qiao
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| | - Haidong Cai
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| | - Kele Xu
- National Key Laboratory of Parallel and Distributed Processing, National University of Defense Technology, Changsha, People’s Republic of China
| | - Xiaqing Yu
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| | - Wen Jiang
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| | - Zhongwei Lv
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| | - Yin Wang
- School of Electronic and Information Engineering, Tongji University, Shanghai, People’s Republic of China
| | - Dan Li
- Department of Nuclear Medicine, Shanghai Tenth People’s Hospital, Tongji University School of Medicine, Shanghai, People’s Republic of China
| |
Collapse
|
17
|
Detection of Bone Metastases on Bone Scans through Image Classification with Contrastive Learning. J Pers Med 2021; 11:jpm11121248. [PMID: 34945720 PMCID: PMC8708961 DOI: 10.3390/jpm11121248] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 11/16/2021] [Accepted: 11/22/2021] [Indexed: 01/01/2023] Open
Abstract
Patients with bone metastases have poor prognoses. A bone scan is a commonly applied diagnostic tool for this condition. However, its accuracy is limited by the nonspecific character of radiopharmaceutical accumulation, which indicates all-cause bone remodeling. The current study evaluated deep learning techniques to improve the efficacy of bone metastasis detection on bone scans, retrospectively examining 19,041 patients aged 22 to 92 years who underwent bone scans between May 2011 and December 2019. We developed several functional imaging binary classification deep learning algorithms suitable for bone scans. The presence or absence of bone metastases as a reference standard was determined through a review of image reports by nuclear medicine physicians. Classification was conducted with convolutional neural network-based (CNN-based), residual neural network (ResNet), and densely connected convolutional networks (DenseNet) models, with and without contrastive learning. Each set of bone scans contained anterior and posterior images with resolutions of 1024 × 256 pixels. A total of 37,427 image sets were analyzed. The overall performance of all models improved with contrastive learning. The accuracy, precision, recall, F1 score, area under the receiver operating characteristic curve, and negative predictive value (NPV) for the optimal model were 0.961, 0.878, 0.599, 0.712, 0.92 and 0.965, respectively. In particular, the high NPV may help physicians safely exclude bone metastases, decreasing physician workload, and improving patient care.
Collapse
|