1
|
Currie G, Hawk KE, Rohren E. The transformational potential of molecular radiomics. J Med Radiat Sci 2022; 70 Suppl 2:77-88. [PMID: 36238997 PMCID: PMC10122929 DOI: 10.1002/jmrs.626] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 09/28/2022] [Indexed: 11/06/2022] Open
Abstract
Conventional radiomics in nuclear medicine involve hand-crafted and computer-assisted regions of interest. Recent developments in artificial intelligence (AI) have seen the emergence of AI-augmented segmentation and extraction of lower order traditional radiomic features. Deep learning (DL) affords the opportunity to extract abstract radiomic features directly from input tensors (images) without the need for segmentation. These fourth-order, high dimensional radiomics produce deep radiomics and are well suited to the data density associated with the molecular nature of hybrid imaging. Molecular radiomics and deep molecular radiomics provide insights beyond images and quantitation typical of semantic reporting. While the application of molecular radiomics using hand-crafted and computer-generated features is integrated into decision-making in nuclear medicine, the acceptance of deep molecular radiomics is less universal. This manuscript aims to provide an understanding of the language and principles associated with radiomics and deep radiomics in nuclear medicine.
Collapse
Affiliation(s)
- Geoffrey Currie
- School of Dentistry and Medical Science, Charles Sturt University, Wagga Wagga, New South Wales, Australia.,Department of Radiology, Baylor College of Medicine, Houston, Texas, USA
| | - K Elizabeth Hawk
- School of Medicine, Stanford University, Stanford, California, USA.,Department of Radiology, University of California San Diego, San Diego, California, USA
| | - Eric Rohren
- School of Dentistry and Medical Science, Charles Sturt University, Wagga Wagga, New South Wales, Australia.,Department of Radiology, Baylor College of Medicine, Houston, Texas, USA
| |
Collapse
|
2
|
Gao T, Zou C, Li J, Han C, Zhang H, Li Y, Tang X, Fan Y. Identification of moyamoya disease based on cerebral oxygen saturation signals using machine learning methods. JOURNAL OF BIOPHOTONICS 2022; 15:e202100388. [PMID: 35102703 DOI: 10.1002/jbio.202100388] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 01/28/2022] [Accepted: 01/31/2022] [Indexed: 06/14/2023]
Abstract
Moyamoya is a cerebrovascular disease with a high mortality rate. Early detection and mechanistic studies are necessary. Near-infrared spectroscopy (NIRS) was used to study the signals of the cerebral tissue oxygen saturation index (TOI) and the changes in oxygenated and deoxygenated hemoglobin concentrations (HbO and Hb) in 64 patients with moyamoya disease and 64 healthy volunteers. The wavelet transforms (WT) of TOI, HbO and Hb signals, as well as the wavelet phase coherence (WPCO) of these signals from the left and right frontal lobes of the same subject, were calculated. Features were extracted from the spontaneous oscillations of TOI, HbO and Hb in five physiological activity-related frequency segments. Machine learning models based on support vector machine (SVM), random forest (RF) and extreme gradient boosting (XGBoost) have been built to classify the two groups. For 20-min signals, the 10-fold cross-validation accuracies of SVM, RF and XGBoost were 87%, 85% and 85%, respectively. For 5-min signals, the accuracies of the three methods were 88%, 88% and 84%, respectively. The method proposed in this article has potential for detecting and screening moyamoya with high proficiency. Evaluating the cerebral oxygenation with NIRS shows great potential in screening moyamoya diseases.
Collapse
Affiliation(s)
- Tianxin Gao
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Chuyue Zou
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Jinyu Li
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Cong Han
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
- Medical School of Chinese PLA, Beijing, China
| | - Houdi Zhang
- Department of Neurosurgery, Chinese PLA General Hospital, Beijing, China
| | - Yue Li
- School of Medicine, Tsinghua University, Beijing, China
| | - Xiaoying Tang
- School of Life Science, Beijing Institute of Technology, Beijing, China
| | - Yingwei Fan
- School of Medical Technology, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
3
|
Lee JS, Kim KM, Choi Y, Kim HJ. A Brief History of Nuclear Medicine Physics, Instrumentation, and Data Sciences in Korea. Nucl Med Mol Imaging 2021; 55:265-284. [PMID: 34868376 DOI: 10.1007/s13139-021-00721-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 10/14/2021] [Accepted: 10/18/2021] [Indexed: 10/19/2022] Open
Abstract
We review the history of nuclear medicine physics, instrumentation, and data sciences in Korea to commemorate the 60th anniversary of the Korean Society of Nuclear Medicine. In the 1970s and 1980s, the development of SPECT, nuclear stethoscope, and bone densitometry systems, as well as kidney and cardiac image analysis technology, marked the beginning of nuclear medicine physics and engineering in Korea. With the introduction of PET and cyclotron in Korea in 1994, nuclear medicine imaging research was further activated. With the support of large-scale government projects, the development of gamma camera, SPECT, and PET systems was carried out. Exploiting the use of PET scanners in conjunction with cyclotrons, extensive studies on myocardial blood flow quantification and brain image analysis were also actively pursued. In 2005, Korea's first domestic cyclotron succeeded in producing radioactive isotopes, and the cyclotron was provided to six universities and university hospitals, thereby facilitating the nationwide supply of PET radiopharmaceuticals. Since the late 2000s, research on PET/MRI has been actively conducted, and the advanced research results of Korean scientists in the fields of silicon photomultiplier PET and simultaneous PET/MRI have attracted significant attention from the academic community. Currently, Korean researchers are actively involved in endeavors to solve a variety of complex problems in nuclear medicine using artificial intelligence and deep learning technologies.
Collapse
Affiliation(s)
- Jae Sung Lee
- Department of Nuclear Medicine, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, Seoul, 03080 Korea
| | - Kyeong Min Kim
- Department of Isotopic Drug Development, Korea Radioisotope Center for Pharmaceuticals, Korea Institute of Radiological and Medical Sciences, Seoul, Korea
| | - Yong Choi
- Department of Electronic Engineering, Sogang University, Seoul, Korea
| | - Hee-Joung Kim
- Department of Radiological Science, Yonsei University, Wonju, Korea
| |
Collapse
|
4
|
Yousefirizi F, Pierre Decazes, Amyar A, Ruan S, Saboury B, Rahmim A. AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics. PET Clin 2021; 17:183-212. [PMID: 34809866 DOI: 10.1016/j.cpet.2021.09.010] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.
Collapse
Affiliation(s)
- Fereshteh Yousefirizi
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, British Columbia V5Z 1L3, Canada.
| | - Pierre Decazes
- Department of Nuclear Medicine, Henri Becquerel Centre, Rue d'Amiens - CS 11516 - 76038 Rouen Cedex 1, France; QuantIF-LITIS, Faculty of Medicine and Pharmacy, Research Building - 1st floor, 22 boulevard Gambetta, 76183 Rouen Cedex, France
| | - Amine Amyar
- QuantIF-LITIS, Faculty of Medicine and Pharmacy, Research Building - 1st floor, 22 boulevard Gambetta, 76183 Rouen Cedex, France; General Electric Healthcare, Buc, France
| | - Su Ruan
- QuantIF-LITIS, Faculty of Medicine and Pharmacy, Research Building - 1st floor, 22 boulevard Gambetta, 76183 Rouen Cedex, France
| | - Babak Saboury
- Department of Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, USA; Department of Computer Science and Electrical Engineering, University of Maryland, Baltimore County, Baltimore, MD, USA; Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA, USA
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, 675 West 10th Avenue, Vancouver, British Columbia V5Z 1L3, Canada; Department of Radiology, University of British Columbia, Vancouver, British Columbia, Canada; Department of Physics, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
5
|
Saba L, Sanagala SS, Gupta SK, Koppula VK, Johri AM, Khanna NN, Mavrogeni S, Laird JR, Pareek G, Miner M, Sfikakis PP, Protogerou A, Misra DP, Agarwal V, Sharma AM, Viswanathan V, Rathore VS, Turk M, Kolluri R, Viskovic K, Cuadrado-Godia E, Kitas GD, Sharma N, Nicolaides A, Suri JS. Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:1206. [PMID: 34430647 PMCID: PMC8350643 DOI: 10.21037/atm-20-7676] [Citation(s) in RCA: 36] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 02/25/2021] [Indexed: 12/12/2022]
Abstract
Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (AOU), Cagliari, Italy
| | - Skandha S Sanagala
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India.,CSE Department, Bennett University, Greater Noida, UP, India
| | - Suneet K Gupta
- CSE Department, Bennett University, Greater Noida, UP, India
| | - Vijaya K Koppula
- CSE Department, CMR College of Engineering & Technology, Hyderabad, India
| | - Amer M Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Ontario, Canada
| | - Narendra N Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, India
| | - Sophie Mavrogeni
- Cardiology Clinic, Onassis Cardiac Surgery Center, Athens, Greece
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, USA
| | - Gyan Pareek
- Minimally Invasive Urology Institute, Brown University, Providence, Rhode Island, USA
| | - Martin Miner
- Men's Health Center, Miriam Hospital Providence, Rhode Island, USA
| | - Petros P Sfikakis
- Rheumatology Unit, National Kapodistrian University of Athens, Greece
| | - Athanasios Protogerou
- Department of Cardiovascular Prevention, National and Kapodistrian University of Athens, Athens, Greece
| | - Durga P Misra
- Department of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Vikas Agarwal
- Department of Clinical Immunology and Rheumatology, SGPGIMS, Lucknow, India
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, VA, USA
| | - Vijay Viswanathan
- MV Hospital for Diabetes & Professor M Viswanathan Diabetes Research Centre, Chennai, India
| | - Vijay S Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, USA
| | - Monika Turk
- The Hanse-Wissenschaftskolleg Institute for Advanced Study, Delmenhorst, Germany
| | | | | | | | - George D Kitas
- R & D Academic Affairs, Dudley Group NHS Foundation Trust, Dudley, UK
| | - Neeraj Sharma
- Department of Biomedical Engineering, IIT-BHU, Banaras, UP, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia, Cyprus
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| |
Collapse
|