1
|
Katseena Yawson A, Sallem H, Seidensaal K, Welzel T, Klüter S, Maria Paul K, Dorsch S, Beyer C, Debus J, Jäkel O, Bauer J, Giske K. Enhancing U-Net-based Pseudo-CT generation from MRI using CT-guided bone segmentation for radiation treatment planning in head & neck cancer patients. Phys Med Biol 2025; 70:045018. [PMID: 39898433 DOI: 10.1088/1361-6560/adb124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2024] [Accepted: 01/31/2025] [Indexed: 02/04/2025]
Abstract
Objective.This study investigates the effects of various training protocols on enhancing the precision of MRI-only Pseudo-CT generation for radiation treatment planning and adaptation in head & neck cancer patients. It specifically tackles the challenge of differentiating bone from air, a limitation that frequently results in substantial deviations in the representation of bony structures on Pseudo-CT images.Approach.The study included 25 patients, utilizing pre-treatment MRI-CT image pairs. Five cases were randomly selected for testing, with the remaining 20 used for model training and validation. A 3D U-Net deep learning model was employed, trained on patches of size 643with an overlap of 323. MRI scans were acquired using the Dixon gradient echo (GRE) technique, and various contrasts were explored to improve Pseudo-CT accuracy, including in-phase, water-only, and combined water-only and fat-only images. Additionally, bone extraction from the fat-only image was integrated as an additional channel to better capture bone structures on Pseudo-CTs. The evaluation involved both image quality and dosimetric metrics.Main results.The generated Pseudo-CTs were compared with their corresponding registered target CTs. The mean absolute error (MAE) and peak signal-to-noise ratio (PSNR) for the base model using combined water-only and fat-only images were 19.20 ± 5.30 HU and 57.24 ± 1.44 dB, respectively. Following the integration of an additional channel using a CT-guided bone segmentation, the model's performance improved, achieving MAE and PSNR of 18.32 ± 5.51 HU and 57.82 ± 1.31 dB, respectively. The measured results are statistically significant, with ap-value<0.05. The dosimetric assessment confirmed that radiation treatment planning on Pseudo-CT achieved accuracy comparable to conventional CT.Significance.This study demonstrates improved accuracy in bone representation on Pseudo-CTs achieved through a combination of water-only, fat-only and extracted bone images; thus, enhancing feasibility of MRI-based simulation for radiation treatment planning.
Collapse
Affiliation(s)
- Ama Katseena Yawson
- German Cancer Research Center (DKFZ), Division of Medical Physics in Radiation Oncology, Heidelberg, Germany
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University, Medical Faculty, Heidelberg, Germany
| | - Habiba Sallem
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University, Medical Faculty, Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Katharina Seidensaal
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Thomas Welzel
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Sebastian Klüter
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Katharina Maria Paul
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Stefan Dorsch
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Cedric Beyer
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Jürgen Debus
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
- Heidelberg Ion Therapy Center (HIT), Heidelberg, Germany
| | - Oliver Jäkel
- German Cancer Research Center (DKFZ), Division of Medical Physics in Radiation Oncology, Heidelberg, Germany
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg Ion Therapy Center (HIT), Heidelberg, Germany
| | - Julia Bauer
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
- Heidelberg University Hospital, Department of Radiation Oncology, Heidelberg, Germany
| | - Kristina Giske
- German Cancer Research Center (DKFZ), Division of Medical Physics in Radiation Oncology, Heidelberg, Germany
- Heidelberg Institute for Radiation Oncology (HIRO), National Center for Radiation Research in Oncology (NCRO), Heidelberg, Germany
| |
Collapse
|
2
|
McGee KP, Cao M, Das IJ, Yu V, Witte RJ, Kishan AU, Valle LF, Wiesinger F, De-Colle C, Cao Y, Breen WG, Traughber BJ. The Use of Magnetic Resonance Imaging in Radiation Therapy Treatment Simulation and Planning. J Magn Reson Imaging 2024; 60:1786-1805. [PMID: 38265188 PMCID: PMC12052475 DOI: 10.1002/jmri.29246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 01/08/2024] [Accepted: 01/08/2024] [Indexed: 01/25/2024] Open
Abstract
Ever since its introduction as a diagnostic imaging tool the potential of magnetic resonance imaging (MRI) in radiation therapy (RT) treatment simulation and planning has been recognized. Recent technical advances have addressed many of the impediments to use of this technology and as a result have resulted in rapid and growing adoption of MRI in RT. The purpose of this article is to provide a broad review of the multiple uses of MR in the RT treatment simulation and planning process, identify several of the most used clinical scenarios in which MR is integral to the simulation and planning process, highlight existing limitations and provide multiple unmet needs thereby highlighting opportunities for the diagnostic MR imaging community to contribute and collaborate with our oncology colleagues. EVIDENCE LEVEL: 5 TECHNICAL EFFICACY: Stage 5.
Collapse
Affiliation(s)
- Kiaran P. McGee
- Department of Radiology, Mayo Clinic & Foundation, Rochester, Minnesota, USA
| | - Minsong Cao
- Department of Radiation Oncology, University of California, Los Angeles, California, USA
| | - Indra J. Das
- Department of Radiation Oncology, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA
| | - Victoria Yu
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Robert J. Witte
- Department of Radiology, Mayo Clinic & Foundation, Rochester, Minnesota, USA
| | - Amar U. Kishan
- Department of Radiation Oncology, University of California, Los Angeles, California, USA
| | - Luca F. Valle
- Department of Radiation Oncology, University of California, Los Angeles, California, USA
| | | | - Chiara De-Colle
- Department of Radiation Oncology, University Hospital and Medical Faculty, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Yue Cao
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan, USA
| | - William G. Breen
- Department of Radiation Oncology, Mayo Clinic & Foundation, Rochester, Minnesota, USA
| | - Bryan J. Traughber
- Department of Radiation Oncology, Mayo Clinic & Foundation, Rochester, Minnesota, USA
| |
Collapse
|
3
|
Stabile AM, Pistilli A, Mariangela R, Rende M, Bartolini D, Di Sante G. New Challenges for Anatomists in the Era of Omics. Diagnostics (Basel) 2023; 13:2963. [PMID: 37761332 PMCID: PMC10529314 DOI: 10.3390/diagnostics13182963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 09/08/2023] [Accepted: 09/10/2023] [Indexed: 09/29/2023] Open
Abstract
Anatomic studies have traditionally relied on macroscopic, microscopic, and histological techniques to investigate the structure of tissues and organs. Anatomic studies are essential in many fields, including medicine, biology, and veterinary science. Advances in technology, such as imaging techniques and molecular biology, continue to provide new insights into the anatomy of living organisms. Therefore, anatomy remains an active and important area in the scientific field. The consolidation in recent years of some omics technologies such as genomics, transcriptomics, proteomics, and metabolomics allows for a more complete and detailed understanding of the structure and function of cells, tissues, and organs. These have been joined more recently by "omics" such as radiomics, pathomics, and connectomics, supported by computer-assisted technologies such as neural networks, 3D bioprinting, and artificial intelligence. All these new tools, although some are still in the early stages of development, have the potential to strongly contribute to the macroscopic and microscopic characterization in medicine. For anatomists, it is time to hitch a ride and get on board omics technologies to sail to new frontiers and to explore novel scenarios in anatomy.
Collapse
Affiliation(s)
- Anna Maria Stabile
- Department of Medicine and Surgery, Section of Human, Clinical and Forensic Anatomy, University of Perugia, 60132 Perugia, Italy; (A.M.S.); (A.P.); (R.M.); (M.R.)
| | - Alessandra Pistilli
- Department of Medicine and Surgery, Section of Human, Clinical and Forensic Anatomy, University of Perugia, 60132 Perugia, Italy; (A.M.S.); (A.P.); (R.M.); (M.R.)
| | - Ruggirello Mariangela
- Department of Medicine and Surgery, Section of Human, Clinical and Forensic Anatomy, University of Perugia, 60132 Perugia, Italy; (A.M.S.); (A.P.); (R.M.); (M.R.)
| | - Mario Rende
- Department of Medicine and Surgery, Section of Human, Clinical and Forensic Anatomy, University of Perugia, 60132 Perugia, Italy; (A.M.S.); (A.P.); (R.M.); (M.R.)
| | - Desirée Bartolini
- Department of Medicine and Surgery, Section of Human, Clinical and Forensic Anatomy, University of Perugia, 60132 Perugia, Italy; (A.M.S.); (A.P.); (R.M.); (M.R.)
- Department of Pharmaceutical Sciences, University of Perugia, 06126 Perugia, Italy
| | - Gabriele Di Sante
- Department of Medicine and Surgery, Section of Human, Clinical and Forensic Anatomy, University of Perugia, 60132 Perugia, Italy; (A.M.S.); (A.P.); (R.M.); (M.R.)
| |
Collapse
|
4
|
Krokos G, MacKewn J, Dunn J, Marsden P. A review of PET attenuation correction methods for PET-MR. EJNMMI Phys 2023; 10:52. [PMID: 37695384 PMCID: PMC10495310 DOI: 10.1186/s40658-023-00569-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Accepted: 08/07/2023] [Indexed: 09/12/2023] Open
Abstract
Despite being thirteen years since the installation of the first PET-MR system, the scanners constitute a very small proportion of the total hybrid PET systems installed. This is in stark contrast to the rapid expansion of the PET-CT scanner, which quickly established its importance in patient diagnosis within a similar timeframe. One of the main hurdles is the development of an accurate, reproducible and easy-to-use method for attenuation correction. Quantitative discrepancies in PET images between the manufacturer-provided MR methods and the more established CT- or transmission-based attenuation correction methods have led the scientific community in a continuous effort to develop a robust and accurate alternative. These can be divided into four broad categories: (i) MR-based, (ii) emission-based, (iii) atlas-based and the (iv) machine learning-based attenuation correction, which is rapidly gaining momentum. The first is based on segmenting the MR images in various tissues and allocating a predefined attenuation coefficient for each tissue. Emission-based attenuation correction methods aim in utilising the PET emission data by simultaneously reconstructing the radioactivity distribution and the attenuation image. Atlas-based attenuation correction methods aim to predict a CT or transmission image given an MR image of a new patient, by using databases containing CT or transmission images from the general population. Finally, in machine learning methods, a model that could predict the required image given the acquired MR or non-attenuation-corrected PET image is developed by exploiting the underlying features of the images. Deep learning methods are the dominant approach in this category. Compared to the more traditional machine learning, which uses structured data for building a model, deep learning makes direct use of the acquired images to identify underlying features. This up-to-date review goes through the literature of attenuation correction approaches in PET-MR after categorising them. The various approaches in each category are described and discussed. After exploring each category separately, a general overview is given of the current status and potential future approaches along with a comparison of the four outlined categories.
Collapse
Affiliation(s)
- Georgios Krokos
- School of Biomedical Engineering and Imaging Sciences, The PET Centre at St Thomas' Hospital London, King's College London, 1st Floor Lambeth Wing, Westminster Bridge Road, London, SE1 7EH, UK.
| | - Jane MacKewn
- School of Biomedical Engineering and Imaging Sciences, The PET Centre at St Thomas' Hospital London, King's College London, 1st Floor Lambeth Wing, Westminster Bridge Road, London, SE1 7EH, UK
| | - Joel Dunn
- School of Biomedical Engineering and Imaging Sciences, The PET Centre at St Thomas' Hospital London, King's College London, 1st Floor Lambeth Wing, Westminster Bridge Road, London, SE1 7EH, UK
| | - Paul Marsden
- School of Biomedical Engineering and Imaging Sciences, The PET Centre at St Thomas' Hospital London, King's College London, 1st Floor Lambeth Wing, Westminster Bridge Road, London, SE1 7EH, UK
| |
Collapse
|
5
|
Chen J, Lu C, Huang H, Zhu D, Yang Q, Liu J, Huang Y, Deng A, Han X. Cognitive Computing-Based CDSS in Medical Practice. HEALTH DATA SCIENCE 2021; 2021:9819851. [PMID: 38487503 PMCID: PMC10880153 DOI: 10.34133/2021/9819851] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 06/28/2021] [Indexed: 03/17/2024]
Abstract
Importance. The last decade has witnessed the advances of cognitive computing technologies that learn at scale and reason with purpose in medicine studies. From the diagnosis of diseases till the generation of treatment plans, cognitive computing encompasses both data-driven and knowledge-driven machine intelligence to assist health care roles in clinical decision-making. This review provides a comprehensive perspective from both research and industrial efforts on cognitive computing-based CDSS over the last decade.Highlights. (1) A holistic review of both research papers and industrial practice about cognitive computing-based CDSS is conducted to identify the necessity and the characteristics as well as the general framework of constructing the system. (2) Several of the typical applications of cognitive computing-based CDSS as well as the existing systems in real medical practice are introduced in detail under the general framework. (3) The limitations of the current cognitive computing-based CDSS is discussed that sheds light on the future work in this direction.Conclusion. Different from medical content providers, cognitive computing-based CDSS provides probabilistic clinical decision support by automatically learning and inferencing from medical big data. The characteristics of managing multimodal data and computerizing medical knowledge distinguish cognitive computing-based CDSS from other categories. Given the current status of primary health care like high diagnostic error rate and shortage of medical resources, it is time to introduce cognitive computing-based CDSS to the medical community which is supposed to be more open-minded and embrace the convenience and low cost but high efficiency brought by cognitive computing-based CDSS.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Aijun Deng
- The Affiliated Hospital of Weifang Medical University, Shandong, China
| | - Xiaoxu Han
- National Clinical Research Center for Laboratory MedicineChina
- The First Affiliated Hospital, China Medical University, Liaoning, China
| |
Collapse
|
6
|
Hou KY, Lu HY, Yang CC. Applying MRI Intensity Normalization on Non-Bone Tissues to Facilitate Pseudo-CT Synthesis from MRI. Diagnostics (Basel) 2021; 11:diagnostics11050816. [PMID: 33946436 PMCID: PMC8147160 DOI: 10.3390/diagnostics11050816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 04/27/2021] [Accepted: 04/28/2021] [Indexed: 11/16/2022] Open
Abstract
This study aimed to facilitate pseudo-CT synthesis from MRI by normalizing MRI intensity of the same tissue type to a similar intensity level. MRI intensity normalization was conducted through dividing MRI by a shading map, which is a smoothed ratio image between MRI and a three-intensity mask. Regarding pseudo-CT synthesis from MRI, a conversion model based on a three-layer convolutional neural network was trained and validated. Before MRI intensity normalization, the mean value ± standard deviation of fat tissue in 0.35 T chest MRI was 297 ± 73 (coefficient of variation (CV) = 24.58%), which was 533 ± 91 (CV = 17.07%) in 1.5 T abdominal MRI. The corresponding results were 149 ± 32 (CV = 21.48%) and 148 ± 28 (CV = 18.92%) after intensity normalization. With regards to pseudo-CT synthesis from MRI, the differences in mean values between pseudo-CT and real CT were 3, 15, and 12 HU for soft tissue, fat, and lung/air in 0.35 T chest imaging, respectively, while the corresponding results were 3, 14, and 15 HU in 1.5 T abdominal imaging. Overall, the proposed workflow is reliable in pseudo-CT synthesis from MRI and is more practicable in clinical routine practice compared with deep learning methods, which demand a high level of resources for building a conversion model.
Collapse
Affiliation(s)
- Kuei-Yuan Hou
- Department of Radiology, Cathay General Hospital, Taipei 106, Taiwan;
- Department of Biomedical Imaging and Radiological Sciences, National Yang-Ming Chiao-Tung University, Taipei 711, Taiwan
| | - Hao-Yuan Lu
- Institute of Radiological Sciences, Tzu-Chi University of Science and Technology, Hualien 970, Taiwan;
| | - Ching-Ching Yang
- Department of Medical Imaging and Radiological Sciences, Kaohsiung Medical University, Kaohsiung 807, Taiwan
- Department of Medical Research, Kaohsiung Medical University Chung-Ho Memorial Hospital, Kaohsiung 807, Taiwan
- Correspondence:
| |
Collapse
|