1
|
Lee SE, Hong H, Kim EK. Diagnostic performance with and without artificial intelligence assistance in real-world screening mammography. Eur J Radiol Open 2024; 12:100545. [PMID: 38293282 PMCID: PMC10825593 DOI: 10.1016/j.ejro.2023.100545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 12/27/2023] [Accepted: 12/29/2023] [Indexed: 02/01/2024] Open
Abstract
Purpose To evaluate artificial intelligence-based computer-aided diagnosis (AI-CAD) for screening mammography, we analyzed the diagnostic performance of radiologists by providing and withholding AI-CAD results alternatively every month. Methods This retrospective study was approved by the institutional review board with a waiver for informed consent. Between August 2020 and May 2022, 1819 consecutive women (mean age 50.8 ± 9.4 years) with 2061 screening mammography and ultrasound performed on the same day in a single institution were included. Radiologists interpreted screening mammography in clinical practice with AI-CAD results being provided or withheld alternatively by month. The AI-CAD results were retrospectively obtained for analysis even when withheld from radiologists. The diagnostic performances of radiologists and stand-alone AI-CAD were compared and the performances of radiologists with and without AI-CAD assistance were also compared by cancer detection rate, recall rate, sensitivity, specificity, accuracy and area under the receiver-operating-characteristics curve (AUC). Results Twenty-nine breast cancer patients and 1790 women without cancers were included. Diagnostic performances of the radiologists did not significantly differ with and without AI-CAD assistance. Radiologists with AI-CAD assistance showed the same sensitivity (76.5%) and similar specificity (92.3% vs 93.8%), AUC (0.844 vs 0.851), and recall rates (8.8% vs. 7.4%) compared to standalone AI-CAD. Radiologists without AI-CAD assistance showed lower specificity (91.9% vs 94.6%) and accuracy (91.5% vs 94.1%) and higher recall rates (8.6% vs 5.9%, all p < 0.05) compared to stand-alone AI-CAD. Conclusion Radiologists showed no significant difference in diagnostic performance when both screening mammography and ultrasound were performed with or without AI-CAD assistance for mammography. However, without AI-CAD assistance, radiologists showed lower specificity and accuracy and higher recall rates compared to stand-alone AI-CAD.
Collapse
Affiliation(s)
| | | | - Eun-Kyung Kim
- Correspondence to: Department of Radiology, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gul̥, Yongin-si, Gyeonggi-do, Korea.
| |
Collapse
|
2
|
Lee SE, Kim GR, Yoon JH, Han K, Son WJ, Shin HJ, Moon HJ. Artificial intelligence assistance for women who had spot compression view: reducing recall rates for digital mammography. Acta Radiol 2022; 64:1808-1815. [PMID: 36426409 DOI: 10.1177/02841851221140556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Background Mammography yields inevitable recall for indeterminate findings that need to be confirmed with additional views. Purpose To explore whether the artificial intelligence (AI) algorithm for mammography can reduce false-positive recall in patients who undergo the spot compression view. Material and Methods From January to December 2017, 236 breasts from 225 women who underwent the spot compression view due to focal asymmetry, mass, or architectural distortion on standard digital mammography were included. Three readers who were blinded to the study purpose, patient information, previous mammograms, following spot compression views, and any clinical or pathologic reports retrospectively reviewed 236 standard mammograms and determined the necessity of patient recall and the probability of malignancy per breast, first without and then with AI assistance. The performances of AI and the readers were evaluated with the recall rate, area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and accuracy. Results Among 236 examinations, 8 (3.4%) were cancers and 228 (96.6%) were benign. The recall rates of all three readers significantly decreased with AI assistance ( P < 0.05). The reader-averaged recall rates significantly decreased with AI assistance regardless of breast composition (fatty breasts: 32.7% to 24.1%m P = 0.002; dense breasts: 33.6% to 21.2%, P < 0.001). The reader-averaged AUC increased with AI assistance and was comparable to that of standalone AI (0.835 vs. 0.895; P = 0.234). The reader-averaged specificity (71.2% to 79.8%, P < 0.001) and accuracy (71.3% to 79.7%, P < 0.001) significantly improved with AI assistance. Conclusion AI assistance significantly reduced false-positive recall without compromising cancer detection in women with focal asymmetry, mass, or architectural distortion on standard digital mammography regardless of mammographic breast density.
Collapse
Affiliation(s)
- Si Eun Lee
- Department of Radiology, Yongin Severance Hospital, Yonsei University College of Medicine, Yongin, Republic of Korea
| | - Ga Ram Kim
- Department of Radiology, Research Institute of Radiologic Science, Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Jung Hyun Yoon
- Department of Radiology, Research Institute of Radiologic Science, Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology, Research Institute of Radiologic Science, Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Won Jeong Son
- Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Hye Jung Shin
- Biostatistics Collaboration Unit, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Hee Jung Moon
- Department of Radiology, Wonju Severance Christian Hospital, Yonsei University Wonju College of Medicine, Wonju, Republic of Korea
| |
Collapse
|
3
|
Winter AM, Moy L, Gao Y, Bennett DL. Comparison of Narrow-angle and Wide-angle Digital Breast Tomosynthesis Systems in Clinical Practice. JOURNAL OF BREAST IMAGING 2021; 3:240-255. [PMID: 38424829 DOI: 10.1093/jbi/wbaa114] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Indexed: 03/02/2024]
Abstract
Digital breast tomosynthesis (DBT) is a pseudo 3D mammography imaging technique that has become widespread since gaining Food and Drug Administration approval in 2011. With this technology, a variable number of tomosynthesis projection images are obtained over an angular range between 15° and 50° for currently available clinical DBT systems. The angular range impacts various aspects of clinical imaging, such as radiation dose, scan time, and image quality, including visualization of calcifications, masses, and architectural distortion. This review presents an overview of the differences between narrow- and wide-angle DBT systems, with an emphasis on their applications in clinical practice. Comparison examples of patients imaged on both narrow- and wide-angle DBT systems illustrate these differences. Understanding the potential variable appearance of imaging findings with narrow- and wide-angle DBT systems is important for radiologists, particularly when comparison images have been obtained on a different DBT system. Furthermore, knowledge about the comparative strengths and limitations of DBT systems is needed for appropriate equipment selection.
Collapse
Affiliation(s)
- Andrea M Winter
- Saint Louis University, Department of Radiology, St. Louis, MO, USA
| | - Linda Moy
- NYU Langone Health, NYU School of Medicine, Department of Radiology, New York, NY, USA
| | - Yiming Gao
- NYU Langone Health, NYU School of Medicine, Department of Radiology, New York, NY, USA
| | - Debbie L Bennett
- Saint Louis University, Department of Radiology, St. Louis, MO, USA
| |
Collapse
|
4
|
Spuur K. A review of mammographic lesion localisation and work up imaging in Australia in the digital era. Radiography (Lond) 2019; 25:385-391. [PMID: 31582249 DOI: 10.1016/j.radi.2019.03.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2018] [Revised: 02/28/2019] [Accepted: 03/14/2019] [Indexed: 11/19/2022]
Abstract
OBJECTIVES To investigate the use of coned compression with and without magnification in contemporary Australian digital imaging. To describe lesion localisation techniques used for mammographic work up. KEY FINDINGS As digital breast tomosynthesis becomes mainstream, the need for coned compression imaging has reduced, however the need for coned compression with fine focus magnification for assessment of microcalcification remains. Adapting film screen lesion localisation techniques to the digital setting is limited by the need for "true size" 1:1 ratio images for ease of measurement. Both the digital ruler and a grid technique can be used as an alternate. CONCLUSION Advances in image acquisition has evidenced a change in imaging protocols for suspicions lesions within the breast with breast tomosynthesis superseding the need for non-magnified coned compression views of the breast. Adaptation of the approaches to localising these lesions in the digital setting has also been necessary.
Collapse
Affiliation(s)
- K Spuur
- School of Dentistry and Health Sciences, Faculty of Science, Charles Sturt University, Locked Bag 588, Building 30, Boorooma Street, Wagga Wagga, NSW, 2678, Australia.
| |
Collapse
|
5
|
Affiliation(s)
- Per Skaane
- From the Department of Radiology and Nuclear Medicine, Oslo University Hospital, The Norwegian Radium Hospital, Breast Imaging Center, Ullernchausseen 64-66, Postboks 4950 Nydalen, 0424 Oslo, Norway
| |
Collapse
|
6
|
Choudhery S, Axmacher J, Conners AL, Geske J, Brandt K. Masses in the era of screening tomosynthesis: Is diagnostic ultrasound sufficient? Br J Radiol 2018; 92:20180801. [PMID: 30495975 DOI: 10.1259/bjr.20180801] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023] Open
Abstract
METHODS: All masses recalled from screening digital breast tomosynthesis between July 1, 2017 and December 31, 2017 that were sent either to diagnostic mammography or ultrasound were compared. Size, shape, margins, visibility on ultrasound, diagnostic assessment and pathology of all masses along with breast density were evaluated. RESULTS: 102/212 digital breast tomosynthesis screen-detected masses were worked up with diagnostic mammography initially and 110/212 were worked up with ultrasound directly. There was no significant difference in ultrasound visibility of masses sent to diagnostic mammography first with those sent to ultrasound first (p = 0.42). 4 (4%) masses sent to mammogram first and 2 (2%) masses sent to ultrasound first were not visualized. There was a significant difference in size between masses that were visualized under ultrasound versus those that were not (p = 0.01), when masses in both groups were assessed cumulatively. CONCLUSIONS: 98% of digital breast tomosynthesis screen-detected masses sent to ultrasound directly were adequately assessed without diagnostic mammography. ADVANCES IN KNOWLEDGE: There is potential for avoiding a diagnostic mammogram for evaluation of majority of digital breast tomosynthesis screen-detected masses.
Collapse
Affiliation(s)
| | | | | | - Jennifer Geske
- 2 Biomedical Statistics and Informatics, Mayo Clinic , Rochester MN , US
| | - Kathy Brandt
- 1 Department of Radiology, Mayo Clinic , Rochester MN , US
| |
Collapse
|
7
|
Mall S, Noakes J, Kossoff M, Lee W, McKessar M, Goy A, Duncombe J, Roberts M, Giuffre B, Miller A, Bhola N, Kapoor C, Shearman C, DaCosta G, Choi S, Sterba J, Kay M, Bruderlin K, Winarta N, Donohue K, Macdonell-Scott B, Klijnsma F, Suzuki K, Brennan P, Mello-Thoms C. Can digital breast tomosynthesis perform better than standard digital mammography work-up in breast cancer assessment clinic? Eur Radiol 2018; 28:5182-5194. [PMID: 29846804 DOI: 10.1007/s00330-018-5473-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Revised: 03/24/2018] [Accepted: 04/10/2018] [Indexed: 11/30/2022]
Affiliation(s)
- S Mall
- Faculty of Health Sciences, University of Sydney, 75 East Street, Room M204, Lidcombe, New South Wales, Australia.
| | - J Noakes
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - M Kossoff
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - W Lee
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - M McKessar
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - A Goy
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - J Duncombe
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - M Roberts
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - B Giuffre
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - A Miller
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - N Bhola
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - C Kapoor
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - C Shearman
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - G DaCosta
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - S Choi
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - J Sterba
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - M Kay
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - K Bruderlin
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - N Winarta
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - K Donohue
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - B Macdonell-Scott
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - F Klijnsma
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - K Suzuki
- Northern Sydney & Central Coast BreastScreen, Royal North Shore Hospital, St. Leonards, New South Wales, Australia
| | - P Brennan
- Faculty of Health Sciences, University of Sydney, 75 East Street, Room M204, Lidcombe, New South Wales, Australia
| | - C Mello-Thoms
- Faculty of Health Sciences, University of Sydney, 75 East Street, Room M204, Lidcombe, New South Wales, Australia
| |
Collapse
|
8
|
|