1
|
Bordigoni B, Trivellato S, Pellegrini R, Meregalli S, Bonetto E, Belmonte M, Castellano M, Panizza D, Arcangeli S, De Ponti E. Automated segmentation in pelvic radiotherapy: A comprehensive evaluation of ATLAS-, machine learning-, and deep learning-based models. Phys Med 2024; 125:104486. [PMID: 39098106 DOI: 10.1016/j.ejmp.2024.104486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Revised: 06/20/2024] [Accepted: 07/17/2024] [Indexed: 08/06/2024] Open
Abstract
Artificial intelligence can standardize and automatize highly demanding procedures, such as manual segmentation, especially in an anatomical site as common as the pelvis. This study investigated four automated segmentation tools on computed tomography (CT) images in female and male pelvic radiotherapy (RT) starting from simpler and well-known atlas-based methods to the most recent neural networks-based algorithms. The evaluation included quantitative, qualitative and time efficiency assessments. A mono-institutional consecutive series of 40 cervical cancer and 40 prostate cancer structure sets were retrospectively selected. After a preparatory phase, the remaining 20 testing sets per each site were auto-segmented by the atlas-based model STAPLE, a Random Forest-based model, and two Deep Learning-based tools (DL), MVision and LimbusAI. Setting manual segmentation as the Ground Truth, 200 structure sets were compared in terms of Dice Similarity Coefficient (DSC), Hausdorff Distance (HD), and Distance-to-Agreement Portion (DAP). Automated segmentation and manual correction durations were recorded. Expert clinicians performed a qualitative evaluation. In cervical cancer CTs, DL outperformed the other tools with higher quantitative metrics, qualitative scores, and shorter correction times. On the other hand, in prostate cancer CTs, the performance across all the analyzed tools was comparable in terms of both quantitative and qualitative metrics. Such discrepancy in performance outcome could be explained by the wide range of anatomical variability in cervical cancer with respect to the strict bladder and rectum filling preparation in prostate Stereotactic Body Radiation Therapy (SBRT). Decreasing segmentation times can reduce the burden of pelvic radiation therapy routine in an automated workflow.
Collapse
Affiliation(s)
- B Bordigoni
- Medical Physics, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - S Trivellato
- Medical Physics, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | | | - S Meregalli
- Radiation Oncology, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - E Bonetto
- Radiation Oncology, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - M Belmonte
- School of Medicine and Surgery, University of Milano Bicocca, Milano, Italy; Radiation Oncology, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - M Castellano
- School of Medicine and Surgery, University of Milano Bicocca, Milano, Italy; Radiation Oncology, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy
| | - D Panizza
- Medical Physics, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; School of Medicine and Surgery, University of Milano Bicocca, Milano, Italy
| | - S Arcangeli
- School of Medicine and Surgery, University of Milano Bicocca, Milano, Italy; Radiation Oncology, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy.
| | - E De Ponti
- Medical Physics, Fondazione IRCCS San Gerardo dei Tintori, Monza, Italy; School of Medicine and Surgery, University of Milano Bicocca, Milano, Italy
| |
Collapse
|
2
|
Russo L, Charles-Davies D, Bottazzi S, Sala E, Boldrini L. Radiomics for clinical decision support in radiation oncology. Clin Oncol (R Coll Radiol) 2024; 36:e269-e281. [PMID: 38548581 DOI: 10.1016/j.clon.2024.03.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 02/14/2024] [Accepted: 03/08/2024] [Indexed: 07/09/2024]
Abstract
Radiomics is a promising tool for the development of quantitative biomarkers to support clinical decision-making. It has been shown to improve the prediction of response to treatment and outcome in different settings, particularly in the field of radiation oncology by optimising the dose delivery solutions and reducing the rate of radiation-induced side effects, leading to a fully personalised approach. Despite the promising results offered by radiomics at each of these stages, standardised methodologies, reproducibility and interpretability of results are still lacking, limiting the potential clinical impact of these tools. In this review, we briefly describe the principles of radiomics and the most relevant applications of radiomics at each stage of cancer management in the framework of radiation oncology. Furthermore, the integration of radiomics into clinical decision support systems is analysed, defining the challenges and offering possible solutions for translating radiomics into a clinically applicable tool.
Collapse
Affiliation(s)
- L Russo
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy; Dipartimento di Scienze Radiologiche ed Ematologiche. Università Cattolica Del Sacro Cuore, Rome, Italy.
| | - D Charles-Davies
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
| | - S Bottazzi
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
| | - E Sala
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy; Dipartimento di Scienze Radiologiche ed Ematologiche. Università Cattolica Del Sacro Cuore, Rome, Italy
| | - L Boldrini
- Dipartimento di Diagnostica per Immagini, Radioterapia Oncologica ed Ematologia, Fondazione Policlinico Universitario A. Gemelli IRCCS, Rome, Italy
| |
Collapse
|
3
|
Sha X, Wang H, Sha H, Xie L, Zhou Q, Zhang W, Yin Y. Clinical target volume and organs at risk segmentation for rectal cancer radiotherapy using the Flex U-Net network. Front Oncol 2023; 13:1172424. [PMID: 37324028 PMCID: PMC10266488 DOI: 10.3389/fonc.2023.1172424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 05/05/2023] [Indexed: 06/17/2023] Open
Abstract
Purpose/Objectives The aim of this study was to improve the accuracy of the clinical target volume (CTV) and organs at risk (OARs) segmentation for rectal cancer preoperative radiotherapy. Materials/Methods Computed tomography (CT) scans from 265 rectal cancer patients treated at our institution were collected to train and validate automatic contouring models. The regions of CTV and OARs were delineated by experienced radiologists as the ground truth. We improved the conventional U-Net and proposed Flex U-Net, which used a register model to correct the noise caused by manual annotation, thus refining the performance of the automatic segmentation model. Then, we compared its performance with that of U-Net and V-Net. The Dice similarity coefficient (DSC), Hausdorff distance (HD), and average symmetric surface distance (ASSD) were calculated for quantitative evaluation purposes. With a Wilcoxon signed-rank test, we found that the differences between our method and the baseline were statistically significant (P< 0.05). Results Our proposed framework achieved DSC values of 0.817 ± 0.071, 0.930 ± 0.076, 0.927 ± 0.03, and 0.925 ± 0.03 for CTV, the bladder, Femur head-L and Femur head-R, respectively. Conversely, the baseline results were 0.803 ± 0.082, 0.917 ± 0.105, 0.923 ± 0.03 and 0.917 ± 0.03, respectively. Conclusion In conclusion, our proposed Flex U-Net can enable satisfactory CTV and OAR segmentation for rectal cancer and yield superior performance compared to conventional methods. This method provides an automatic, fast and consistent solution for CTV and OAR segmentation and exhibits potential to be widely applied for radiation therapy planning for a variety of cancers.
Collapse
Affiliation(s)
- Xue Sha
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, China
| | - Hui Wang
- Department of Radiation Oncology, Qingdao Central Hospital, Qingdao, Shandong, China
| | - Hui Sha
- Hunan Cancer Hospital, Xiangya School of Medicine, Central South University, Changsha, Hunan, China
| | - Lu Xie
- Manteia Technologies Co., Ltd, Xiamen, Fujian, China
| | - Qichao Zhou
- Manteia Technologies Co., Ltd, Xiamen, Fujian, China
| | - Wei Zhang
- Manteia Technologies Co., Ltd, Xiamen, Fujian, China
| | - Yong Yin
- Department of Radiation Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, China
| |
Collapse
|
4
|
Guzene L, Beddok A, Nioche C, Modzelewski R, Loiseau C, Salleron J, Thariat J. Assessing Interobserver Variability in the Delineation of Structures in Radiation Oncology: A Systematic Review. Int J Radiat Oncol Biol Phys 2023; 115:1047-1060. [PMID: 36423741 DOI: 10.1016/j.ijrobp.2022.11.021] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Revised: 11/04/2022] [Accepted: 11/09/2022] [Indexed: 11/23/2022]
Abstract
PURPOSE The delineation of target volumes and organs at risk is the main source of uncertainty in radiation therapy. Numerous interobserver variability (IOV) studies have been conducted, often with unclear methodology and nonstandardized reporting. We aimed to identify the parameters chosen in conducting delineation IOV studies and assess their performances and limits. METHODS AND MATERIALS We conducted a systematic literature review to highlight major points of heterogeneity and missing data in IOV studies published between 2018 and 2021. For the main used metrics, we did in silico analyses to assess their limits in specific clinical situations. RESULTS All disease sites were represented in the 66 studies examined. Organs at risk were studied independently of tumor site in 29% of reviewed IOV studies. In 65% of studies, statistical analyses were performed. No gold standard (GS; ie, reference) was defined in 36% of studies. A single expert was considered as the GS in 21% of studies, without testing intraobserver variability. All studies reported both absolute and relative indices, including the Dice similarity coefficient (DSC) in 68% and the Hausdorff distance (HD) in 42%. Limitations were shown in silico for small structures when using the DSC and dependence on irregular shapes when using the HD. Variations in DSC values were large between studies, and their thresholds were inconsistent. Most studies (51%) included 1 to 10 cases. The median number of observers or experts was 7 (range, 2-35). The intraclass correlation coefficient was reported in only 9% of cases. Investigating the feasibility of studying IOV in delineation, a minimum of 8 observers with 3 cases, or 11 observers with 2 cases, was required to demonstrate moderate reproducibility. CONCLUSIONS Implementation of future IOV studies would benefit from a more standardized methodology: clear definitions of the gold standard and metrics and a justification of the tradeoffs made in the choice of the number of observers and number of delineated cases should be provided.
Collapse
Affiliation(s)
- Leslie Guzene
- Department of Radiation Oncology, University Hospital of Amiens, Amiens, France
| | - Arnaud Beddok
- Department of Radiation Oncology, Institut Curie, Paris/Saint-Cloud/Orsay, France; Laboratory of Translational Imaging in Oncology (LITO), InsermUMR, Institut Curie, Orsay, France
| | - Christophe Nioche
- Laboratory of Translational Imaging in Oncology (LITO), InsermUMR, Institut Curie, Orsay, France
| | - Romain Modzelewski
- LITIS - EA4108-Quantif, Normastic, University of Rouen, and Nuclear Medicine Department, Henri Becquerel Center, Rouen, France
| | - Cedric Loiseau
- Department of Radiation Oncology, Centre François Baclesse; ARCHADE Research Community Caen, France; Département de Biostatistiques, Institut de Cancérologie de Lorraine, Vandœuvre-lès-Nancy, France
| | - Julia Salleron
- Département de Biostatistiques, Institut de Cancérologie de Lorraine, Vandœuvre-lès-Nancy, France
| | - Juliette Thariat
- Department of Radiation Oncology, Centre François Baclesse; ARCHADE Research Community Caen, France; Laboratoire de Physique Corpusculaire, Caen, France; Unicaen-Université de Normandie, Caen, France.
| |
Collapse
|
5
|
Fernandes MC, Yildirim O, Woo S, Vargas HA, Hricak H. The role of MRI in prostate cancer: current and future directions. MAGMA (NEW YORK, N.Y.) 2022; 35:503-521. [PMID: 35294642 PMCID: PMC9378354 DOI: 10.1007/s10334-022-01006-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Revised: 01/16/2022] [Accepted: 03/03/2022] [Indexed: 06/14/2023]
Abstract
There has been an increasing role of magnetic resonance imaging (MRI) in the management of prostate cancer. MRI already plays an essential role in the detection and staging, with the introduction of functional MRI sequences. Recent advancements in radiomics and artificial intelligence are being tested to potentially improve detection, assessment of aggressiveness, and provide usefulness as a prognostic marker. MRI can improve pretreatment risk stratification and therefore selection of and follow-up of patients for active surveillance. MRI can also assist in guiding targeted biopsy, treatment planning and follow-up after treatment to assess local recurrence. MRI has gained importance in the evaluation of metastatic disease with emerging technology including whole-body MRI and integrated positron emission tomography/MRI, allowing for not only better detection but also quantification. The main goal of this article is to review the most recent advances on MRI in prostate cancer and provide insights into its potential clinical roles from the radiologist's perspective. In each of the sections, specific roles of MRI tailored to each clinical setting are discussed along with its strengths and weakness including already established material related to MRI and the introduction of recent advancements on MRI.
Collapse
Affiliation(s)
- Maria Clara Fernandes
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Onur Yildirim
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Sungmin Woo
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA.
| | - Hebert Alberto Vargas
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| | - Hedvig Hricak
- Department of Radiology, Memorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, 10065, USA
| |
Collapse
|
6
|
Abdollahi H, Chin E, Clark H, Hyde DE, Thomas S, Wu J, Uribe CF, Rahmim A. Radiomics-guided radiation therapy: opportunities and challenges. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac6fab] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 05/13/2022] [Indexed: 11/11/2022]
Abstract
Abstract
Radiomics is an advanced image-processing framework, which extracts image features and considers them as biomarkers towards personalized medicine. Applications include disease detection, diagnosis, prognosis, and therapy response assessment/prediction. As radiation therapy aims for further individualized treatments, radiomics could play a critical role in various steps before, during and after treatment. Elucidation of the concept of radiomics-guided radiation therapy (RGRT) is the aim of this review, attempting to highlight opportunities and challenges underlying the use of radiomics to guide clinicians and physicists towards more effective radiation treatments. This work identifies the value of RGRT in various steps of radiotherapy from patient selection to follow-up, and subsequently provides recommendations to improve future radiotherapy using quantitative imaging features.
Collapse
|
7
|
Duan J, Bernard M, Downes L, Willows B, Feng X, Mourad W, St Clair W, Chen Q. Evaluating the clinical acceptability of deep learning contours of prostate and organs-at-risk in an automated prostate treatment planning process. Med Phys 2022; 49:2570-2581. [PMID: 35147216 DOI: 10.1002/mp.15525] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 01/17/2022] [Accepted: 01/29/2021] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Radiation treatment is considered an effective and the most common treatment option for prostate cancer. The treatment planning process requires accurate and precise segmentation of the prostate and organs at risk (OARs), which is laborious and time-consuming when contoured manually. Artificial intelligence (AI)-based auto-segmentation has the potential to significantly accelerate the radiation therapy treatment planning process; however, the accuracy of auto-segmentation needs to be validated before its full clinical adoption. PURPOSE A commercial AI-based contouring model was trained to provide segmentation of the prostate and surrounding OARs. The segmented structures were input to a commercial auto-planning module for automated prostate treatment planning. This study comprehensively evaluates the performance of this contouring model in the automated prostate treatment planning process. METHODS AND MATERIALS A 3D U-Net-based model (INTContour, Carina AI) was trained and validated on 84 computed tomography (CT) scans and tested on an additional 23 CT scans from patients treated in our local institution. Prostate and OARs contours generated by the AI model (AI contour) were geometrically evaluated against Reference contours. The prostate contours were further evaluated against AI, Reference, and two additional observer contours for comparison using inter-observer variation (IOV) and 3D boundaries discrepancy analyses. A blinded evaluation was introduced to assess subjectively the clinical acceptability of the AI contours. Finally, treatment plans were created from an automated prostate planning workflow using the AI contours and were evaluated for their clinical acceptability following the RTOG-0815 protocol. RESULTS The AI contours demonstrated good geometric accuracy on OARs and prostate contours, with average Dice similarity coefficients (DSC) for bladder, rectum, femoral heads, seminal vesicles, and penile bulb of 0.93, 0.85, 0.96, 0.72, and 0.53, respectively. The DSC, 95% directed Hausdorff Distance (HD95), and Mean Surface Distance (MSD) for the prostate were 0.83±0.05, 6.07±1.87 mm, and 2.07±0.73 mm, respectively. No significant differences were found when comparing with IOV. In the double-blinded evaluation, 95.7% of the AI contours were scored as either "Perfect" (34.8%) or "Acceptable" (60.9%), while only one case (4.3%) was scored as "Unacceptable with minor changes required". In total, 69.6% of the AI contours were considered equal to or better than the Reference contours by an independent radiation oncologist. Automated treatment plans created from the AI contours produced similar and clinically-acceptable dosimetric distributions as those from plans created from Reference contours. CONCLUSIONS The investigated AI-based commercial model for prostate segmentation demonstrated good performance in clinical practice. Using this model, the implementation of an automated prostate treatment planning process is clinically feasible. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Jingwei Duan
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| | - Mark Bernard
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| | - Laura Downes
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| | - Brooke Willows
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| | - Xue Feng
- Carina Medical LLC, 145 Graham Ave, A168, Lexington, 40506, KY
| | - Waleed Mourad
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| | - William St Clair
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| | - Quan Chen
- Department of Radiation Medicine, University of Kentucky, Lexington, 40506, KY
| |
Collapse
|
8
|
Harrison K, Pullen H, Welsh C, Oktay O, Alvarez-Valle J, Jena R. Machine Learning for Auto-Segmentation in Radiotherapy Planning. Clin Oncol (R Coll Radiol) 2022; 34:74-88. [PMID: 34996682 DOI: 10.1016/j.clon.2021.12.003] [Citation(s) in RCA: 37] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Revised: 11/27/2021] [Accepted: 12/03/2021] [Indexed: 12/12/2022]
Abstract
Manual segmentation of target structures and organs at risk is a crucial step in the radiotherapy workflow. It has the disadvantages that it can require several hours of clinician time per patient and is prone to inter- and intra-observer variability. Automatic segmentation (auto-segmentation), using computer algorithms, seeks to address these issues. Advances in machine learning and computer vision have led to the development of methods for accurate and efficient auto-segmentation. This review surveys auto-segmentation techniques and applications in radiotherapy planning. It provides an overview of traditional approaches to auto-segmentation, including intensity analysis, shape modelling and atlas-based methods. The focus, though, is on uses of machine learning and deep learning, including convolutional neural networks. Finally, the future of machine-learning-driven auto-segmentation in clinical settings is considered, and the barriers that must be overcome for it to be widely accepted into routine practice are highlighted.
Collapse
Affiliation(s)
- K Harrison
- Cavendish Laboratory, University of Cambridge, Cambridge, UK.
| | - H Pullen
- Cavendish Laboratory, University of Cambridge, Cambridge, UK
| | - C Welsh
- Department of Oncology, University of Cambridge, Cambridge, UK
| | - O Oktay
- Health Intelligence, Microsoft Research, Cambridge, UK
| | | | - R Jena
- Department of Oncology, University of Cambridge, Cambridge, UK; Department of Oncology, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| |
Collapse
|
9
|
Almeida G, Figueira AR, Lencart J, Tavares JMRS. Segmentation of male pelvic organs on computed tomography with a deep neural network fine-tuned by a level-set method. Comput Biol Med 2022; 140:105107. [PMID: 34872011 DOI: 10.1016/j.compbiomed.2021.105107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 11/30/2021] [Accepted: 11/30/2021] [Indexed: 11/21/2022]
Abstract
Computed Tomography (CT) imaging is used in Radiation Therapy planning, where the treatment is carefully tailored to each patient in order to maximize radiation dose to the target while decreasing adverse effects to nearby healthy tissues. A crucial step in this process is manual organ contouring, which if performed automatically could considerably decrease the time to starting treatment and improve outcomes. Computerized segmentation of male pelvic organs has been studied for decades and deep learning models have brought considerable advances to the field, but improvements are still demanded. A two-step framework for automatic segmentation of the prostate, bladder and rectum is presented: a convolutional neural network enhanced with attention gates performs an initial segmentation, followed by a region-based active contour model to fine-tune the segmentations to each patient's specific anatomy. The framework was evaluated on a large collection of planning CTs of patients who had Radiation Therapy for prostate cancer. The Surface Dice Coefficient improved from 79.41 to 81.00% on segmentation of the prostate, 94.03-95.36% on the bladder and 82.17-83.68% on the rectum, comparing the proposed framework with the baseline convolutional neural network. This study shows that traditional image segmentation algorithms can help improve the immense gains that deep learning models have brought to the medical imaging segmentation field.
Collapse
Affiliation(s)
- Gonçalo Almeida
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal.
| | - Ana Rita Figueira
- Serviço de Radioterapia, Centro Hospitalar Universitário de São João, Porto, Portugal.
| | - Joana Lencart
- Serviço de Física Médica e Grupo de Física Médica Radiobiologia e Protecção Radiológica do Centro de Investigação, Instituto Português de Oncologia do Porto (CI-IPOP), Porto, Portugal.
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal.
| |
Collapse
|
10
|
Ferro M, de Cobelli O, Musi G, del Giudice F, Carrieri G, Busetto GM, Falagario UG, Sciarra A, Maggi M, Crocetto F, Barone B, Caputo VF, Marchioni M, Lucarelli G, Imbimbo C, Mistretta FA, Luzzago S, Vartolomei MD, Cormio L, Autorino R, Tătaru OS. Radiomics in prostate cancer: an up-to-date review. Ther Adv Urol 2022; 14:17562872221109020. [PMID: 35814914 PMCID: PMC9260602 DOI: 10.1177/17562872221109020] [Citation(s) in RCA: 53] [Impact Index Per Article: 26.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2021] [Accepted: 05/30/2022] [Indexed: 12/24/2022] Open
Abstract
Prostate cancer (PCa) is the most common worldwide diagnosed malignancy in male population. The diagnosis, the identification of aggressive disease, and the post-treatment follow-up needs a more comprehensive and holistic approach. Radiomics is the extraction and interpretation of images phenotypes in a quantitative manner. Radiomics may give an advantage through advancements in imaging modalities and through the potential power of artificial intelligence techniques by translating those features into clinical outcome prediction. This article gives an overview on the current evidence of methodology and reviews the available literature on radiomics in PCa patients, highlighting its potential for personalized treatment and future applications.
Collapse
Affiliation(s)
- Matteo Ferro
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy, via Ripamonti 435 Milano, Italy
| | - Ottavio de Cobelli
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Gennaro Musi
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy; Department of Oncology and Hematology-Oncology, Università degli Studi di Milano, Milan, Italy
| | - Francesco del Giudice
- Department of Urology, Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
| | - Giuseppe Carrieri
- Department of Urology and Organ Transplantation, University of Foggia, Foggia, Italy
| | - Gian Maria Busetto
- Department of Urology and Organ Transplantation, University of Foggia, Foggia, Italy
| | | | - Alessandro Sciarra
- Department of Urology, Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
| | - Martina Maggi
- Department of Urology, Policlinico Umberto I, Sapienza University of Rome, Rome, Italy
| | - Felice Crocetto
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Biagio Barone
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Vincenzo Francesco Caputo
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Michele Marchioni
- Department of Medical, Oral and Biotechnological Sciences, G. d’Annunzio, University of Chieti, Chieti, Italy; Urology Unit, ‘SS. Annunziata’ Hospital, Chieti, Italy
- Department of Urology, ASL Abruzzo 2, Chieti, Italy
| | - Giuseppe Lucarelli
- Department of Emergency and Organ Transplantation, Urology, Andrology and Kidney Transplantation Unit, University of Bari, Bari, Italy
| | - Ciro Imbimbo
- Department of Neurosciences, Reproductive Sciences and Odontostomatology, University of Naples ‘Federico II’, Naples, Italy
| | - Francesco Alessandro Mistretta
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy
- Università degli Studi di Milano, Milan, Italy
| | - Stefano Luzzago
- Department of Urology, European Institute of Oncology, IRCCS, Milan, Italy
- Università degli Studi di Milano, Milan, Italy
| | - Mihai Dorin Vartolomei
- Department of Cell and Molecular Biology, George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mures, Târgu Mures, Romania
- Department of Urology, Medical University of Vienna, Vienna, Austria
| | - Luigi Cormio
- Urology and Renal Transplantation Unit, Department of Medical and Surgical Sciences, University of Foggia, Foggia, Italy
- Urology Unit, Bonomo Teaching Hospital, Foggia, Italy
| | | | - Octavian Sabin Tătaru
- Institution Organizing University Doctoral Studies, I.O.S.U.D., George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Târgu Mures, Târgu Mures, Romania
| |
Collapse
|
11
|
Prostate Cancer Radiogenomics-From Imaging to Molecular Characterization. Int J Mol Sci 2021; 22:ijms22189971. [PMID: 34576134 PMCID: PMC8465891 DOI: 10.3390/ijms22189971] [Citation(s) in RCA: 51] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 09/06/2021] [Accepted: 09/10/2021] [Indexed: 12/24/2022] Open
Abstract
Radiomics and genomics represent two of the most promising fields of cancer research, designed to improve the risk stratification and disease management of patients with prostate cancer (PCa). Radiomics involves a conversion of imaging derivate quantitative features using manual or automated algorithms, enhancing existing data through mathematical analysis. This could increase the clinical value in PCa management. To extract features from imaging methods such as magnetic resonance imaging (MRI), the empiric nature of the analysis using machine learning and artificial intelligence could help make the best clinical decisions. Genomics information can be explained or decoded by radiomics. The development of methodologies can create more-efficient predictive models and can better characterize the molecular features of PCa. Additionally, the identification of new imaging biomarkers can overcome the known heterogeneity of PCa, by non-invasive radiological assessment of the whole specific organ. In the future, the validation of recent findings, in large, randomized cohorts of PCa patients, can establish the role of radiogenomics. Briefly, we aimed to review the current literature of highly quantitative and qualitative results from well-designed studies for the diagnoses, treatment, and follow-up of prostate cancer, based on radiomics, genomics and radiogenomics research.
Collapse
|
12
|
Urago Y, Okamoto H, Kaneda T, Murakami N, Kashihara T, Takemori M, Nakayama H, Iijima K, Chiba T, Kuwahara J, Katsuta S, Nakamura S, Chang W, Saitoh H, Igaki H. Evaluation of auto-segmentation accuracy of cloud-based artificial intelligence and atlas-based models. Radiat Oncol 2021; 16:175. [PMID: 34503533 PMCID: PMC8427857 DOI: 10.1186/s13014-021-01896-1] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Accepted: 08/26/2021] [Indexed: 01/13/2023] Open
Abstract
Background Contour delineation, a crucial process in radiation oncology, is time-consuming and inaccurate due to inter-observer variation has been a critical issue in this process. An atlas-based automatic segmentation was developed to improve the delineation efficiency and reduce inter-observer variation. Additionally, automated segmentation using artificial intelligence (AI) has recently become available. In this study, auto-segmentations by atlas- and AI-based models for Organs at Risk (OAR) in patients with prostate and head and neck cancer were performed and delineation accuracies were evaluated. Methods Twenty-one patients with prostate cancer and 30 patients with head and neck cancer were evaluated. MIM Maestro was used to apply the atlas-based segmentation. MIM Contour ProtégéAI was used to apply the AI-based segmentation. Three similarity indices, the Dice similarity coefficient (DSC), Hausdorff distance (HD), and mean distance to agreement (MDA), were evaluated and compared with manual delineations. In addition, radiation oncologists visually evaluated the delineation accuracies. Results Among patients with prostate cancer, the AI-based model demonstrated higher accuracy than the atlas-based on DSC, HD, and MDA for the bladder and rectum. Upon visual evaluation, some errors were observed in the atlas-based delineations when the boundary between the small bowel or the seminal vesicle and the bladder was unclear. For patients with head and neck cancer, no significant differences were observed between the two models for almost all OARs, except small delineations such as the optic chiasm and optic nerve. The DSC tended to be lower when the HD and the MDA were smaller in small volume delineations. Conclusions In terms of efficiency, the processing time for head and neck cancers was much shorter than manual delineation. While quantitative evaluation with AI-based segmentation was significantly more accurate than atlas-based for prostate cancer, there was no significant difference for head and neck cancer. According to the results of visual evaluation, less necessity of manual correction in AI-based segmentation indicates that the segmentation efficiency of AI-based model is higher than that of atlas-based model. The effectiveness of the AI-based model can be expected to improve the segmentation efficiency and to significantly shorten the delineation time. Supplementary Information The online version contains supplementary material available at 10.1186/s13014-021-01896-1.
Collapse
Affiliation(s)
- Yuka Urago
- Department of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.,Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Hiroyuki Okamoto
- Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
| | - Tomoya Kaneda
- Department of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Naoya Murakami
- Department of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Tairo Kashihara
- Department of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Mihiro Takemori
- Department of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.,Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Hiroki Nakayama
- Department of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan.,Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Kotaro Iijima
- Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Takahito Chiba
- Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Junichi Kuwahara
- Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.,Department of Radiological Technology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Shouichi Katsuta
- Department of Radiological Technology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Satoshi Nakamura
- Department of Medical Physics, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Weishan Chang
- Department of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan
| | - Hidetoshi Saitoh
- Department of Radiological Sciences, Graduate School of Human Health Sciences, Tokyo Metropolitan University, 7-2-10 Higashi-Ogu, Arakawa-ku, Tokyo, 116-8551, Japan
| | - Hiroshi Igaki
- Department of Radiation Oncology, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| |
Collapse
|
13
|
Hirashima H, Nakamura M, Baillehache P, Fujimoto Y, Nakagawa S, Saruya Y, Kabasawa T, Mizowaki T. Development of in-house fully residual deep convolutional neural network-based segmentation software for the male pelvic CT. Radiat Oncol 2021; 16:135. [PMID: 34294090 PMCID: PMC8299691 DOI: 10.1186/s13014-021-01867-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 07/19/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND This study aimed to (1) develop a fully residual deep convolutional neural network (CNN)-based segmentation software for computed tomography image segmentation of the male pelvic region and (2) demonstrate its efficiency in the male pelvic region. METHODS A total of 470 prostate cancer patients who had undergone intensity-modulated radiotherapy or volumetric-modulated arc therapy were enrolled. Our model was based on FusionNet, a fully residual deep CNN developed to semantically segment biological images. To develop the CNN-based segmentation software, 450 patients were randomly selected and separated into the training, validation and testing groups (270, 90, and 90 patients, respectively). In Experiment 1, to determine the optimal model, we first assessed the segmentation accuracy according to the size of the training dataset (90, 180, and 270 patients). In Experiment 2, the effect of varying the number of training labels on segmentation accuracy was evaluated. After determining the optimal model, in Experiment 3, the developed software was used on the remaining 20 datasets to assess the segmentation accuracy. The volumetric dice similarity coefficient (DSC) and the 95th-percentile Hausdorff distance (95%HD) were calculated to evaluate the segmentation accuracy for each organ in Experiment 3. RESULTS In Experiment 1, the median DSC for the prostate were 0.61 for dataset 1 (90 patients), 0.86 for dataset 2 (180 patients), and 0.86 for dataset 3 (270 patients), respectively. The median DSCs for all the organs increased significantly when the number of training cases increased from 90 to 180 but did not improve upon further increase from 180 to 270. The number of labels applied during training had a little effect on the DSCs in Experiment 2. The optimal model was built by 270 patients and four organs. In Experiment 3, the median of the DSC and the 95%HD values were 0.82 and 3.23 mm for prostate; 0.71 and 3.82 mm for seminal vesicles; 0.89 and 2.65 mm for the rectum; 0.95 and 4.18 mm for the bladder, respectively. CONCLUSIONS We have developed a CNN-based segmentation software for the male pelvic region and demonstrated that the CNN-based segmentation software is efficient for the male pelvic region.
Collapse
Affiliation(s)
- Hideaki Hirashima
- Department of Radiation Oncology and Image-Applied Therapy, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Mitsuhiro Nakamura
- Department of Radiation Oncology and Image-Applied Therapy, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan. .,Division of Medical Physics, Department of Information Technology and Medical Engineering, Human Health Sciences, Graduate School of Medicine, Kyoto University, 53 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan.
| | - Pascal Baillehache
- Rist, Inc., Impact HUB Tokyo, 2-11-3 Meguro, Meguro-ku, Tokyo, 153-0063, Japan
| | - Yusuke Fujimoto
- Rist, Inc., Impact HUB Tokyo, 2-11-3 Meguro, Meguro-ku, Tokyo, 153-0063, Japan
| | - Shota Nakagawa
- Rist, Inc., Impact HUB Tokyo, 2-11-3 Meguro, Meguro-ku, Tokyo, 153-0063, Japan
| | - Yusuke Saruya
- Rist, Inc., Impact HUB Tokyo, 2-11-3 Meguro, Meguro-ku, Tokyo, 153-0063, Japan
| | - Tatsumasa Kabasawa
- Rist, Inc., Impact HUB Tokyo, 2-11-3 Meguro, Meguro-ku, Tokyo, 153-0063, Japan
| | - Takashi Mizowaki
- Department of Radiation Oncology and Image-Applied Therapy, Graduate School of Medicine, Kyoto University, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| |
Collapse
|
14
|
Michalet M, Azria D, Tardieu M, Tibermacine H, Nougaret S. Radiomics in radiation oncology for gynecological malignancies: a review of literature. Br J Radiol 2021; 94:20210032. [PMID: 33882246 DOI: 10.1259/bjr.20210032] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Radiomics is the extraction of a significant number of quantitative imaging features with the aim of detecting information in correlation with useful clinical outcomes. Features are extracted, after delineation of an area of interest, from a single or a combined set of imaging modalities (including X-ray, US, CT, PET/CT and MRI). Given the high dimensionality, the analytical process requires the use of artificial intelligence algorithms. Firstly developed for diagnostic performance in radiology, it has now been translated to radiation oncology mainly to predict tumor response and patient outcome but other applications have been developed such as dose painting, prediction of side-effects, and quality assurance. In gynecological cancers, most studies have focused on outcomes of cervical cancers after chemoradiation. This review highlights the role of this new tool for the radiation oncologists with particular focus on female GU oncology.
Collapse
Affiliation(s)
- Morgan Michalet
- University Federation of Radiation Oncology of Mediterranean Occitanie, Montpellier Cancer Institute, Univ Montpellier, Montpellier, France.,INSERM U1194 IRCM, Montpellier, France
| | - David Azria
- University Federation of Radiation Oncology of Mediterranean Occitanie, Montpellier Cancer Institute, Univ Montpellier, Montpellier, France.,INSERM U1194 IRCM, Montpellier, France
| | | | | | | |
Collapse
|
15
|
Magnetic Resonance Imaging Based Radiomic Models of Prostate Cancer: A Narrative Review. Cancers (Basel) 2021; 13:cancers13030552. [PMID: 33535569 PMCID: PMC7867056 DOI: 10.3390/cancers13030552] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2020] [Revised: 01/18/2021] [Accepted: 01/27/2021] [Indexed: 12/11/2022] Open
Abstract
Simple Summary The increasing interest in implementing artificial intelligence in radiomic models has occurred alongside advancement in the tools used for computer-aided diagnosis. Such tools typically apply both statistical and machine learning methodologies to assess the various modalities used in medical image analysis. Specific to prostate cancer, the radiomics pipeline has multiple facets that are amenable to improvement. This review discusses the steps of a magnetic resonance imaging based radiomics pipeline. Present successes, existing opportunities for refinement, and the most pertinent pending steps leading to clinical validation are highlighted. Abstract The management of prostate cancer (PCa) is dependent on biomarkers of biological aggression. This includes an invasive biopsy to facilitate a histopathological assessment of the tumor’s grade. This review explores the technical processes of applying magnetic resonance imaging based radiomic models to the evaluation of PCa. By exploring how a deep radiomics approach further optimizes the prediction of a PCa’s grade group, it will be clear how this integration of artificial intelligence mitigates existing major technological challenges faced by a traditional radiomic model: image acquisition, small data sets, image processing, labeling/segmentation, informative features, predicting molecular features and incorporating predictive models. Other potential impacts of artificial intelligence on the personalized treatment of PCa will also be discussed. The role of deep radiomics analysis-a deep texture analysis, which extracts features from convolutional neural networks layers, will be highlighted. Existing clinical work and upcoming clinical trials will be reviewed, directing investigators to pertinent future directions in the field. For future progress to result in clinical translation, the field will likely require multi-institutional collaboration in producing prospectively populated and expertly labeled imaging libraries.
Collapse
|
16
|
Wong K, Gallant F, Szumacher E. Perceptions of Canadian radiation oncologists, radiation physicists, radiation therapists and radiation trainees about the impact of artificial intelligence in radiation oncology - national survey. J Med Imaging Radiat Sci 2020; 52:44-48. [PMID: 33323332 DOI: 10.1016/j.jmir.2020.11.013] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Revised: 11/22/2020] [Accepted: 11/25/2020] [Indexed: 12/22/2022]
Abstract
BACKGROUND Artificial Intelligence (AI) is making a continuous progression into the field of Radiation Oncology in Canada and globally. While this field continues to evolve, there is no clear understanding about how radiation oncologists, radiation therapists, medical physicists and radiation trainees perceive AI and its' impact on radiation oncology as a discipline. The purpose of this study was to investigate the perception of these four Canadian professional groups about AI. and how AI will affect radiation oncology as a specialty. METHODS Following an in-depth scientific review of the existing literature, a 29 Likert-scale questionnaire was developed using Google Survey. The questionnaire was piloted and distributed through national organizations including the Canadian Association for Radiation Oncology (CARO), the Canadian Association of Medical Radiation Therapy (CAMRT) and the Canadian Organization of Medical Physicists (COMP), initially in February, and again between March and June 2020. The results were analyzed using descriptive statistics. RESULTS 159 responses were received from 10 Canadian provinces. Knowledge about AI was moderate with an average of 5/10, but 91% responded interest in learning more about it. The negative implications of AI were related to fear of losing jobs and shift of practice. The majority of participants agreed AI would positively impact on patient treatment. CONCLUSION Radiation oncology professionals believe AI will be an important part of patient treatment in their future practices. The fear about AI may be mitigated with further education programs about AI, which can gain more confidence in the acceptance of AI.
Collapse
Affiliation(s)
- Kristen Wong
- Odette Cancer Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| | - François Gallant
- Odette Cancer Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| | - Ewa Szumacher
- Odette Cancer Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.
| |
Collapse
|
17
|
Zhang Z, Zhao T, Gay H, Zhang W, Sun B. ARPM-net: A novel CNN-based adversarial method with Markov random field enhancement for prostate and organs at risk segmentation in pelvic CT images. Med Phys 2020; 48:227-237. [PMID: 33151620 DOI: 10.1002/mp.14580] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 09/21/2020] [Accepted: 10/21/2020] [Indexed: 01/30/2023] Open
Abstract
PURPOSE The research is to develop a novel CNN-based adversarial deep learning method to improve and expedite the multi-organ semantic segmentation of CT images and to generate accurate contours on pelvic CT images. METHODS Planning CT and structure datasets for 120 patients with intact prostate cancer were retrospectively selected and divided for tenfold cross-validation. The proposed adversarial multi-residual multi-scale pooling Markov random field (MRF) enhanced network (ARPM-net) implements an adversarial training scheme. A segmentation network and a discriminator network were trained jointly, and only the segmentation network was used for prediction. The segmentation network integrates a newly designed MRF block into a variation of multi-residual U-net. The discriminator takes the product of the original CT and the prediction/ground-truth as input and classifies the input into fake/real. The segmentation network and discriminator network can be trained jointly as a whole, or the discriminator can be used for fine-tuning after the segmentation network is coarsely trained. Multi-scale pooling layers were introduced to preserve spatial resolution during pooling using less memory compared to atrous convolution layers. An adaptive loss function was proposed to enhance the training on small or low contrast organs. The accuracy of modeled contours was measured with the dice similarity coefficient (DSC), average Hausdorff distance (AHD), average surface Hausdorff distance (ASHD), and relative volume difference (VD) using clinical contours as references to the ground-truth. The proposed ARPM-net method was compared to several state-of-the-art deep learning methods. RESULTS ARPM-net outperformed several existing deep learning approaches and MRF methods and achieved state-of-the-art performance on a testing dataset. On the test set with 20 cases, the average DSC on the prostate, bladder, rectum, left femur, and right femur were 0.88 ( ± 0.11), 0.97 ( ± 0.07), 0.86 ( ± 0.12), 0.97 ( ± 0.01), and 0.97 ( ± 0.01), respectively. The average HD (mm) on these organs were 1.58 ( ± 1.77), 1.91 ( ± 1.29), 3.14 ( ± 2.39), 1.76 ( ± 1.57), and 1.92 ( ± 1.01). The average surface HD (mm) on these organs are 2.11 ( ± 2.03), 2.36 ( ± 2.43), 3.05 ( ± 2.11), 1.99 ( ± 1.66), and 2.00 ( ± 2.07). CONCLUSION ARPM-net was designed for the automatic segmentation of pelvic CT images. With adversarial fine-tuning, ARPM-net produces state-of-the-art accurate contouring of multiple organs on CT images and has the potential to facilitate routine pelvic cancer radiation therapy planning process.
Collapse
Affiliation(s)
- Zhuangzhuang Zhang
- Department of Computer Science and Engineering, Washington University, One Brookings Drive, Campus Box 1045, St. Louis, MO, 63130, USA
| | - Tianyu Zhao
- Department of Radiation Oncology, Washington University School of Medicine, 4921 Parkview Place, Campus Box 8224, St. Louis, MO, 63110, USA
| | - Hiram Gay
- Department of Radiation Oncology, Washington University School of Medicine, 4921 Parkview Place, Campus Box 8224, St. Louis, MO, 63110, USA
| | - Weixiong Zhang
- Department of Computer Science and Engineering, Department of Genetics, Washington University, One Brookings Drive, Campus Box 1045, St. Louis, MO, 63130, USA
| | - Baozhou Sun
- Department of Radiation Oncology, Washington University School of Medicine, 4921 Parkview Place, Campus Box 8224, St. Louis, MO, 63110, USA
| |
Collapse
|
18
|
Rhee DJ, Jhingran A, Rigaud B, Netherton T, Cardenas CE, Zhang L, Vedam S, Kry S, Brock KK, Shaw W, O’Reilly F, Parkes J, Burger H, Fakie N, Trauernicht C, Simonds H, Court LE. Automatic contouring system for cervical cancer using convolutional neural networks. Med Phys 2020; 47:5648-5658. [PMID: 32964477 PMCID: PMC7756586 DOI: 10.1002/mp.14467] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 09/01/2020] [Accepted: 09/07/2020] [Indexed: 02/06/2023] Open
Abstract
PURPOSE To develop a tool for the automatic contouring of clinical treatment volumes (CTVs) and normal tissues for radiotherapy treatment planning in cervical cancer patients. METHODS An auto-contouring tool based on convolutional neural networks (CNN) was developed to delineate three cervical CTVs and 11 normal structures (seven OARs, four bony structures) in cervical cancer treatment for use with the Radiation Planning Assistant, a web-based automatic plan generation system. A total of 2254 retrospective clinical computed tomography (CT) scans from a single cancer center and 210 CT scans from a segmentation challenge were used to train and validate the CNN-based auto-contouring tool. The accuracy of the tool was evaluated by calculating the Sørensen-dice similarity coefficient (DSC) and mean surface and Hausdorff distances between the automatically generated contours and physician-drawn contours on 140 internal CT scans. A radiation oncologist scored the automatically generated contours on 30 external CT scans from three South African hospitals. RESULTS The average DSC, mean surface distance, and Hausdorff distance of our CNN-based tool were 0.86/0.19 cm/2.02 cm for the primary CTV, 0.81/0.21 cm/2.09 cm for the nodal CTV, 0.76/0.27 cm/2.00 cm for the PAN CTV, 0.89/0.11 cm/1.07 cm for the bladder, 0.81/0.18 cm/1.66 cm for the rectum, 0.90/0.06 cm/0.65 cm for the spinal cord, 0.94/0.06 cm/0.60 cm for the left femur, 0.93/0.07 cm/0.66 cm for the right femur, 0.94/0.08 cm/0.76 cm for the left kidney, 0.95/0.07 cm/0.84 cm for the right kidney, 0.93/0.05 cm/1.06 cm for the pelvic bone, 0.91/0.07 cm/1.25 cm for the sacrum, 0.91/0.07 cm/0.53 cm for the L4 vertebral body, and 0.90/0.08 cm/0.68 cm for the L5 vertebral bodies. On average, 80% of the CTVs, 97% of the organ at risk, and 98% of the bony structure contours in the external test dataset were clinically acceptable based on physician review. CONCLUSIONS Our CNN-based auto-contouring tool performed well on both internal and external datasets and had a high rate of clinical acceptability.
Collapse
Affiliation(s)
- Dong Joo Rhee
- MD Anderson UTHealth Graduate SchoolHoustonTXUSA
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Anuja Jhingran
- Department of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Bastien Rigaud
- Department of Imaging PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Tucker Netherton
- MD Anderson UTHealth Graduate SchoolHoustonTXUSA
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Carlos E. Cardenas
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Lifei Zhang
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Sastry Vedam
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Stephen Kry
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - Kristy K. Brock
- Department of Imaging PhysicsThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| | - William Shaw
- Department of Medical Physics (G68)University of the Free StateBloemfonteinSouth Africa
| | - Frederika O’Reilly
- Department of Medical Physics (G68)University of the Free StateBloemfonteinSouth Africa
| | - Jeannette Parkes
- Division of Radiation Oncology and Medical PhysicsUniversity of Cape Town and Groote Schuur HospitalCape TownSouth Africa
| | - Hester Burger
- Division of Radiation Oncology and Medical PhysicsUniversity of Cape Town and Groote Schuur HospitalCape TownSouth Africa
| | - Nazia Fakie
- Division of Radiation Oncology and Medical PhysicsUniversity of Cape Town and Groote Schuur HospitalCape TownSouth Africa
| | - Chris Trauernicht
- Division of Medical PhysicsStellenbosch UniversityTygerberg Academic HospitalCape TownSouth Africa
| | - Hannah Simonds
- Division of Radiation OncologyStellenbosch UniversityTygerberg Academic HospitalCape TownSouth Africa
| | - Laurence E. Court
- Department of Radiation PhysicsDivision of Radiation OncologyThe University of Texas MD Anderson Cancer CenterHoustonTXUSA
| |
Collapse
|
19
|
Rhee DJ, Jhingran A, Kisling K, Cardenas C, Simonds H, Court L. Automated Radiation Treatment Planning for Cervical Cancer. Semin Radiat Oncol 2020; 30:340-347. [PMID: 32828389 DOI: 10.1016/j.semradonc.2020.05.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The radiation treatment-planning process includes contouring, planning, and reviewing the final plan, and each component requires substantial time and effort from multiple experts. Automation of treatment planning can save time and reduce the cost of radiation treatment, and potentially provides more consistent and better quality plans. With the recent breakthroughs in computer hardware and artificial intelligence technology, automation methods for radiation treatment planning have achieved a clinically acceptable level of performance in general. At the same time, the automation process should be developed and evaluated independently for different disease sites and treatment techniques as they are unique from each other. In this article, we will discuss the current status of automated radiation treatment planning for cervical cancer for simple and complex plans and corresponding automated quality assurance methods. Furthermore, we will introduce Radiation Planning Assistant, a web-based system designed to fully automate treatment planning for cervical cancer and other treatment sites.
Collapse
Affiliation(s)
- Dong Joo Rhee
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX.
| | - Anuja Jhingran
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Kelly Kisling
- Department of Radiation Medicine and Applied Sciences, The University of California, San Diego, San Diego, CA
| | - Carlos Cardenas
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Hannah Simonds
- Department of Radiation Oncology, Tygerberg Hospital/University of Stellenbosch, Stellenbosch, South Africa
| | - Laurence Court
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX
| |
Collapse
|
20
|
Artificial Intelligence in radiotherapy: state of the art and future directions. Med Oncol 2020; 37:50. [PMID: 32323066 DOI: 10.1007/s12032-020-01374-w] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2020] [Accepted: 04/13/2020] [Indexed: 02/06/2023]
Abstract
Recent advances in computing capability allowed the development of sophisticated predictive models to assess complex relationships within observational data, described as Artificial Intelligence. Medicine is one of the several fields of application and Radiation oncology could benefit from these approaches, particularly in patients' medical records, imaging, baseline pathology, planning or instrumental data. Artificial Intelligence systems could simplify many steps of the complex workflow of radiotherapy such as segmentation, planning or delivery. However, Artificial Intelligence could be considered as a "black box" in which human operator may only understand input and output predictions and its application to the clinical practice remains a challenge. The low transparency of the overall system is questionable from manifold points of view (ethical included). Given the complexity of this issue, we collected the basic definitions to help the clinician to understand current literature, and overviewed experiences regarding implementation of AI within radiotherapy clinical workflow, aiming to describe this field from the clinician perspective.
Collapse
|
21
|
Prisciandaro JI, Zhao X, Dieterich S, Hasan Y, Jolly S, Al-Hallaq HA. Interstitial High-Dose-Rate Gynecologic Brachytherapy: Clinical Workflow Experience From Three Academic Institutions. Semin Radiat Oncol 2019; 30:29-38. [PMID: 31727297 DOI: 10.1016/j.semradonc.2019.08.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
An interstitial brachytherapy approach for gynecologic cancers is typically considered for patients with lesions exceeding 5 mm within tissue or that are not easily accessible for intracavitary applications. Recommendations for treating gynecologic malignancies with this approach are available through the American Brachytherapy Society, but vary based on available resources, staffing, and logistics. The intent of this manuscript is to share the collective experience of 3 academic centers that routinely perform interstitial gynecologic brachytherapy. Discussion points include indications for interstitial implants, procedural preparations, applicator selection, anesthetic options, imaging, treatment planning objectives, clinical workflows, timelines, safety, and potential challenges. Interstitial brachytherapy is a complex, high-skill procedure requiring routine practice to optimize patient safety and treatment efficacy. Clinics planning to implement this approach into their brachytherapy practice may benefit from considering the discussion points shared in this manuscript.
Collapse
Affiliation(s)
- Joann I Prisciandaro
- Department of Radiation Oncology, University of Michigan/Michigan Medicine, Ann Arbor, MI.
| | - Xiao Zhao
- Department of Radiation Oncology, University of California Davis Medical Center, Sacramento, CA
| | - Sonja Dieterich
- Department of Radiation Oncology, University of California Davis Medical Center, Sacramento, CA
| | - Yasmin Hasan
- Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL
| | - Shruti Jolly
- Department of Radiation Oncology, University of Michigan/Michigan Medicine, Ann Arbor, MI
| | - Hania A Al-Hallaq
- Department of Radiation and Cellular Oncology, The University of Chicago, Chicago, IL
| |
Collapse
|