1
|
Fassia MK, Balasubramanian A, Woo S, Vargas HA, Hricak H, Konukoglu E, Becker AS. Deep Learning Prostate MRI Segmentation Accuracy and Robustness: A Systematic Review. Radiol Artif Intell 2024:e230138. [PMID: 38568094 DOI: 10.1148/ryai.230138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/28/2024]
Abstract
"Just Accepted" papers have undergone full peer review and have been accepted for publication in Radiology: Artificial Intelligence. This article will undergo copyediting, layout, and proof review before it is published in its final version. Please note that during production of the final copyedited article, errors may be discovered which could affect the content. Purpose To investigate the accuracy and robustness of prostate segmentation using deep learning across various training data sizes, MRI vendors, prostate zones, and testing methods relative to fellowship-trained diagnostic radiologists. Materials and methods In this systematic review, EMBASE, PubMed, Scopus and Web of Science databases were queried for English-language articles using keywords and related terms for prostate MRI segmentation and deep learning algorithms dated to July 31, 2022. A total of 691 articles from the search query were collected, and subsequently filtered to 48 based on predefined inclusion and exclusion criteria. Multiple characteristics were extracted from selected studies, such as deep learning algorithm performance, MRI vendor, and training dataset features. The primary outcome was comparison of mean Dice similarity coefficient (DSC) for prostate segmentation for deep learning algorithms versus diagnostic radiologists. Results Forty-eight studies were included. The vast majority of published deep learning algorithms for whole prostate gland segmentation (39/42 or 93%) had a DSC at or above expert level (DSC ≥ 0.86). The mean DSC was 0.79 ± 0.06 for peripheral zone, 0.87 ± 0.05 for transition zone, and 0.90 ± 0.04 for whole prostate gland segmentation. For selected studies using one major MRI vendor, the mean DSCs of each were as follows: GE (3/48 studies) 0.92 ± 0.03, Philips (4/48 studies) 0.92 ± 0.02, and Siemens (6/48 studies) 0.91 ± 0.03. Conclusion Deep learning algorithms for prostate MRI segmentation demonstrated comparable accuracy to expert radiologists despite varying parameters, therefore future research should shift toward evaluating segmentation robustness and patient outcomes across diverse clinical settings. ©RSNA, 2024.
Collapse
Affiliation(s)
- Mohammad-Kasim Fassia
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| | - Adithiya Balasubramanian
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| | - Sungmin Woo
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| | - Hebert Alberto Vargas
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| | - Hedvig Hricak
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| | - Ender Konukoglu
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| | - Anton S Becker
- From the Departments of Radiology (M.K.F.) and Urology (A.B.), NewYork-Presbyterian Weill Cornell Medical Center, 525 E 68th St, New York, NY 10065-4870; Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (S.W., H.A.V., H.H., A.S.B.); and Department of Biomedical Imaging, ETH-Zurich, Zurich Switzerland (E.K.)
| |
Collapse
|
2
|
Soliman MM, Kim TH, Cheng M, McKenney AS, Fassia MK, Lamparello NA, Lee JM, Vargas HA, Woo S. Mentorship in Radiology Research: A Guide for Mentors and Mentees. Radiol Imaging Cancer 2023; 5:e230176. [PMID: 37975804 DOI: 10.1148/rycan.230176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2023]
Affiliation(s)
- Mohamed M Soliman
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Tae-Hyung Kim
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Monica Cheng
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Anna Sophia McKenney
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Mohammad-Kasim Fassia
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Nicole A Lamparello
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Jeong Min Lee
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Hebert A Vargas
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| | - Sungmin Woo
- From the Department of Radiology, New York-Presbyterian Hospital, Weill Cornell Medical Center, New York, NY (M.M.S., A.S.M., M.K.F., N.A.L.); Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY (T.H.K.); Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Mass (M.C.); Department of Radiology, Seoul National University Hospital, Seoul, Korea (J.M.L.); Department of Radiology and Institute of Radiation Medicine, Seoul National University College of Medicine, Seoul, Korea (J.M.L.); and Department of Radiology, NYU Langone Health, 660 1st Avenue, New York, NY 10016 (H.A.V., S.W.)
| |
Collapse
|
4
|
Muldoon JJ, Yu JS, Fassia MK, Bagheri N. Network inference performance complexity: a consequence of topological, experimental and algorithmic determinants. Bioinformatics 2019; 35:3421-3432. [PMID: 30932143 PMCID: PMC6748731 DOI: 10.1093/bioinformatics/btz105] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2018] [Revised: 01/24/2019] [Accepted: 02/11/2019] [Indexed: 12/21/2022] Open
Abstract
MOTIVATION Network inference algorithms aim to uncover key regulatory interactions governing cellular decision-making, disease progression and therapeutic interventions. Having an accurate blueprint of this regulation is essential for understanding and controlling cell behavior. However, the utility and impact of these approaches are limited because the ways in which various factors shape inference outcomes remain largely unknown. RESULTS We identify and systematically evaluate determinants of performance-including network properties, experimental design choices and data processing-by developing new metrics that quantify confidence across algorithms in comparable terms. We conducted a multifactorial analysis that demonstrates how stimulus target, regulatory kinetics, induction and resolution dynamics, and noise differentially impact widely used algorithms in significant and previously unrecognized ways. The results show how even if high-quality data are paired with high-performing algorithms, inferred models are sometimes susceptible to giving misleading conclusions. Lastly, we validate these findings and the utility of the confidence metrics using realistic in silico gene regulatory networks. This new characterization approach provides a way to more rigorously interpret how algorithms infer regulation from biological datasets. AVAILABILITY AND IMPLEMENTATION Code is available at http://github.com/bagherilab/networkinference/. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Joseph J Muldoon
- Department of Chemical and Biological Engineering, Northwestern University, Evanston, IL, USA
- Interdisciplinary Biological Sciences Program, Northwestern University, Evanston, IL, USA
| | - Jessica S Yu
- Department of Chemical and Biological Engineering, Northwestern University, Evanston, IL, USA
| | - Mohammad-Kasim Fassia
- Department of Chemical and Biological Engineering, Northwestern University, Evanston, IL, USA
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, USA
| | - Neda Bagheri
- Department of Chemical and Biological Engineering, Northwestern University, Evanston, IL, USA
- Interdisciplinary Biological Sciences Program, Northwestern University, Evanston, IL, USA
- Center for Synthetic Biology, Northwestern University, Evanston, IL, USA
- Chemistry of Life Processes Institute, Northwestern University, Evanston, IL, USA
- Northwestern Institute on Complex Systems, Northwestern University, Evanston, IL, USA
| |
Collapse
|