1
|
Dai X, Lei Y, Wang T, Axente M, Xu D, Patel P, Jani AB, Curran WJ, Liu T, Yang X. Self-supervised learning for accelerated 3D high-resolution ultrasound imaging. Med Phys 2021; 48:3916-3926. [PMID: 33993508 DOI: 10.1002/mp.14946] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 05/03/2021] [Accepted: 05/10/2021] [Indexed: 12/23/2022] Open
Abstract
PURPOSE Ultrasound (US) imaging has been widely used in diagnosis, image-guided intervention, and therapy, where high-quality three-dimensional (3D) images are highly desired from sparsely acquired two-dimensional (2D) images. This study aims to develop a deep learning-based algorithm to reconstruct high-resolution (HR) 3D US images only reliant on the acquired sparsely distributed 2D images. METHODS We propose a self-supervised learning framework using cycle-consistent generative adversarial network (cycleGAN), where two independent cycleGAN models are trained with paired original US images and two sets of low-resolution (LR) US images, respectively. The two sets of LR US images are obtained through down-sampling the original US images along the two axes, respectively. In US imaging, in-plane spatial resolution is generally much higher than through-plane resolution. By learning the mapping from down-sampled in-plane LR images to original HR US images, cycleGAN can generate through-plane HR images from original sparely distributed 2D images. Finally, HR 3D US images are reconstructed by combining the generated 2D images from the two cycleGAN models. RESULTS The proposed method was assessed on two different datasets. One is automatic breast ultrasound (ABUS) images from 70 breast cancer patients, the other is collected from 45 prostate cancer patients. By applying a spatial resolution enhancement factor of 3 to the breast cases, our proposed method achieved the mean absolute error (MAE) value of 0.90 ± 0.15, the peak signal-to-noise ratio (PSNR) value of 37.88 ± 0.88 dB, and the visual information fidelity (VIF) value of 0.69 ± 0.01, which significantly outperforms bicubic interpolation. Similar performances have been achieved using the enhancement factor of 5 in these breast cases and using the enhancement factors of 5 and 10 in the prostate cases. CONCLUSIONS We have proposed and investigated a new deep learning-based algorithm for reconstructing HR 3D US images from sparely acquired 2D images. Significant improvement on through-plane resolution has been achieved by only using the acquired 2D images without any external atlas images. Its self-supervision capability could accelerate HR US imaging.
Collapse
Affiliation(s)
- Xianjin Dai
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Yang Lei
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Tonghe Wang
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Marian Axente
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Dong Xu
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Pretesh Patel
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Ashesh B Jani
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Walter J Curran
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Tian Liu
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| | - Xiaofeng Yang
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, 30322, USA
| |
Collapse
|
2
|
Wilby S, Palmer A, Polak W, Bucchi A. A review of brachytherapy physical phantoms developed over the last 20 years: clinical purpose and future requirements. J Contemp Brachytherapy 2021; 13:101-115. [PMID: 34025743 PMCID: PMC8117707 DOI: 10.5114/jcb.2021.103593] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2020] [Accepted: 11/13/2020] [Indexed: 12/04/2022] Open
Abstract
Within the brachytherapy community, many phantoms are constructed in-house, and less commercial development is observed as compared to the field of external beam. Computational or virtual phantom design has seen considerable growth; however, physical phantoms are beneficial for brachytherapy, in which quality is dependent on physical processes, such as accuracy of source placement. Focusing on the design of physical phantoms, this review paper presents a summary of brachytherapy specific phantoms in published journal articles over the last twenty years (January 1, 2000 - December 31, 2019). The papers were analyzed and tabulated by their primary clinical purpose, which was deduced from their associated publications. A substantial body of work has been published on phantom designs from the brachytherapy community, but a standardized method of reporting technical aspects of the phantoms is lacking. In-house phantom development demonstrates an increasing interest in magnetic resonance (MR) tissue mimicking materials, which is not yet reflected in commercial phantoms available for brachytherapy. The evaluation of phantom design provides insight into the way, in which brachytherapy practice has changed over time, and demonstrates the customised and broad nature of treatments offered.
Collapse
Affiliation(s)
- Sarah Wilby
- Department of Radiotherapy Physics, Clinical Hematology, and Oncology Centre, Portsmouth Hospitals NHS Trust, Cosham, Portsmouth, United Kingdom
- Department of Mechanical Engineering, Faculty of Technology University of Portsmouth, Portsmouth, United Kingdom
| | - Antony Palmer
- Department of Radiotherapy Physics, Clinical Hematology, and Oncology Centre, Portsmouth Hospitals NHS Trust, Cosham, Portsmouth, United Kingdom
- Department of Mechanical Engineering, Faculty of Technology University of Portsmouth, Portsmouth, United Kingdom
| | - Wojciech Polak
- Department of Radiotherapy Physics, Clinical Hematology, and Oncology Centre, Portsmouth Hospitals NHS Trust, Cosham, Portsmouth, United Kingdom
- Department of Mechanical Engineering, Faculty of Technology University of Portsmouth, Portsmouth, United Kingdom
| | - Andrea Bucchi
- Department of Mechanical Engineering, Faculty of Technology University of Portsmouth, Portsmouth, United Kingdom
| |
Collapse
|
3
|
Steiner J, Matthews K, Jia G. Endorectal digital prostate tomosynthesis (endoDPT): a proof-of-concept study. Biomed Phys Eng Express 2021; 7. [PMID: 34037539 DOI: 10.1088/2057-1976/abd59b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 12/21/2020] [Indexed: 11/12/2022]
Abstract
In this study we present endorectal digital prostate tomosynthesis (endoDPT), a proposed method of high resolution prostate imaging using an endorectal x-ray sensor and an external x-ray source. endoDPT may be useful for visualizing the fine detail of small structures such as low dose rate brachytherapy (LDRBT) seeds that are difficult to visualize with current methods. The resolution of endoDPT was characterized through measurement of the modulation transfer function (MTF) and artifact spread function (ASF) in computational and physical phantoms. The qualitative resolution of endoDPT was assessed relative to computed tomography (CT) through imaging of LDRBT seeds implanted inex vivocanine prostates. The x-ray sensor MTF reached 10% at 11.50 mm-1, the reconstruction algorithm MTF reached a maximum at 7.08 mm-1, and the ASF was 2.5 mm (full-width at half-maximum). Fine structures in LDRBT seeds like the 0.05 mm thick shell were visible with endoDPT but not CT. All endoDPT images exhibited an overshoot artifact. The measured MTFs were consistent with other studies using similar x-ray sensors and demonstrated improved resolution compared to digital breast tomosynthesis; this result was due to the smaller endoDPT x-ray sensor detection element size and quantitatively demonstrates the high resolution of endoDPT. The ASF demonstrated worse depth resolution compared to in-plane resolution, due to partial angular sampling; partial angular sampling also caused the observed overshoot artifact in the endoDPT images. However, endoDPT still was able to visualize fine structures such as the LDRBT seed shell to a much higher degree than CT. This high-resolution visualization may be useful for improvements in patient specific LDRBT dosimetry. Overall, these results indicate endoDPT is capable of high in-plane spatial resolution and is thus well poised for optimization and studies assessing clinical utility.
Collapse
Affiliation(s)
- Joseph Steiner
- Department of Physics and Astronomy, Louisiana State University, Baton Rouge, LA, 70803, United States of America
| | - Kenneth Matthews
- Department of Physics and Astronomy, Louisiana State University, Baton Rouge, LA, 70803, United States of America
| | - Guang Jia
- School of Computer Science and Technology, Xidian University, Xi'an, Shaanxi, 710071, People's Republic of China
| |
Collapse
|
4
|
Brennen T, Galli L, Cutajar DL, Alnaghy S, Bucci J, Bece A, Enari K, Favoino M, Carriero M, Tartaglia M, Archer J, Lerch M, Rosenfeld AB, Petasecca M. BrachyView: development of an algorithm for real-time automatic LDR brachytherapy seed detection. Phys Med Biol 2020; 65:215015. [PMID: 32756019 DOI: 10.1088/1361-6560/abac9e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
BrachyView is a novel in-body imaging system developed to provide real-time intraoperative dosimetry for low dose rate prostate brachytherapy treatments. Seed positions can be reconstructed after in-vivo implantation using a high-resolution pinhole gamma camera inserted into the patient rectum. The obtained data is a set of 2D projections of the seeds on the image plane. The 3D reconstruction algorithm requires the identification of the seed's centre of mass. This work presents the development and techniques adopted to build an algorithm that provides the means for fully automatic seed centre of mass identification and 3D position reconstruction for real-time applications. The algorithm presented uses a local feature detector, speeded up robust features, to perform detection of brachytherapy seed 2D projections from images, allowing for robust seed identification. Initial results have been obtained with datasets of 30, 96 and 98 I-125 brachytherapy seeds implanted into a prostate gel phantom. It can detect 97% of seeds and correctly match 97% of seeds. The average overall computation time of 2.75 s per image and improved reconstruction accuracy of 22.87% for the 98 seed dataset was noted. Elimination processes for initial false positive detection removal have shown to be extremely effective, resulting in a 99.9% reduction of false positives, and when paired with automatic frame alignment and subtraction procedures allows for the effective removal of excess counts generated by previously implanted needles. The proposed algorithm will allow the BrachyView system to be used as a real-time intraoperative dosimetry tool for low dose rate prostate brachytherapy treatments.
Collapse
Affiliation(s)
- T Brennen
- Centre for Medical Radiation Physics, University of Wollongong, Australia. Author to whom any correspondence should be addressed
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
5
|
|
6
|
BrachyView: Reconstruction of seed positions and volume of an LDR prostate brachytherapy patient plan using a baseline subtraction algorithm. Phys Med 2019; 66:66-76. [PMID: 31563727 DOI: 10.1016/j.ejmp.2019.09.237] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 09/13/2019] [Accepted: 09/19/2019] [Indexed: 11/22/2022] Open
Abstract
PURPOSE BrachyView is a novel in-body imaging system developed with the objective to provide real-time intraoperative dosimetry for low dose rate (LDR) prostate brachytherapy treatments. The BrachyView coordinates combined with conventional transrectal ultrasound (TRUS) imaging, provides the possibility to localise the effective position of the implanted seeds inside the prostate volume, providing a unique tool for intra-operative verification of the quality of the implantation. This research presents the first complete LDR brachytherapy plan reconstructed by the BrachyView system and is used to evaluate the effectiveness of an imaging algorithm with baseline subtraction. METHODS A plan featuring 98 I-125 brachytherapy seeds, with an average activity of 0.248 mCi, were implanted into a prostate gel phantom under TRUS guidance. Images of implanted seeds were obtained by the BrachyView after the implantation of seeds. The baseline subtraction algorithm is applied as a pixel-to-pixel counts subtraction and is applied to every second projection obtained after the implantation of each needle. Seed positions and effectiveness of the baseline reconstruction in the identification of seeds were verified by a high-resolution post-implant CT scan. RESULTS A complete brachytherapy plan has been reconstructed with a 100% detection rate. This is possible due to the effectiveness of the baseline subtraction, with its application an overall increase of 11.3% in position accuracy and 8.2% increase in detection rate was noted. CONCLUSION It has been demonstrated that the BrachyView system shows the potential to be a solution to providing clinics with the means for intraoperative dosimetry for LDR prostate brachytherapy treatments.
Collapse
|
7
|
Alabd R, Safavi-Naeini M, Wilson KJ, Rosenfeld AB, Franklin DR. A simulation study of BrachyShade, a shadow-based internal source tracking system for HDR prostate brachytherapy. Phys Med Biol 2018; 63:205019. [PMID: 30239336 DOI: 10.1088/1361-6560/aae33d] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
This paper presents a simulation study of BrachyShade, a proposed internal source-tracking system for real time quality assurance in high dose rate prostate brachytherapy. BrachyShade consists of a set of spherical tungsten occluders located above a pixellated silicon photodetector. The source location is estimated by minimising the mean squared error between a parametric model of the shadow image and acquired images of the shadows projected on the detector plane. A novel algorithm is finally employed to correct the systemic error resulting from Compton scattering in the medium. The worst-case error obtained with BrachyShade for a 13.5 ms image acquisition is less than 1.3 mm in the most distant part of the treatment volume, while for 75% of source locations an error of less than 0.42 mm was achieved.
Collapse
Affiliation(s)
- Roumani Alabd
- School of Electrical and Data Engineering, University of Technology Sydney, Ultimo NSW 2007, Australia
| | | | | | | | | |
Collapse
|
8
|
Semiconductor real-time quality assurance dosimetry in brachytherapy. Brachytherapy 2017; 17:133-145. [PMID: 28964727 DOI: 10.1016/j.brachy.2017.08.013] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2017] [Revised: 08/22/2017] [Accepted: 08/28/2017] [Indexed: 11/23/2022]
Abstract
With the increase in complexity of brachytherapy treatments, there has been a demand for the development of sophisticated devices for delivery verification. The Centre for Medical Radiation Physics (CMRP), University of Wollongong, has demonstrated the applicability of semiconductor devices to provide cost-effective real-time quality assurance for a wide range of brachytherapy treatment modalities. Semiconductor devices have shown great promise to the future of pretreatment and in vivo quality assurance in a wide range of brachytherapy treatments, from high-dose-rate (HDR) prostate procedures to eye plaque treatments. The aim of this article is to give an insight into several semiconductor-based dosimetry instruments developed by the CMRP. Applications of these instruments are provided for breast and rectal wall in vivo dosimetry in HDR brachytherapy, urethral in vivo dosimetry in prostate low-dose-rate (LDR) brachytherapy, quality assurance of HDR brachytherapy afterloaders, HDR pretreatment plan verification, and real-time verification of LDR and HDR source dwell positions.
Collapse
|