1
|
Çelik L, Aribal E. The efficacy of artificial intelligence (AI) in detecting interval cancers in the national screening program of a middle-income country. Clin Radiol 2024; 79:e885-e891. [PMID: 38649312 DOI: 10.1016/j.crad.2024.03.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Revised: 03/14/2024] [Accepted: 03/21/2024] [Indexed: 04/25/2024]
Abstract
AIM We aimed to investigate the efficiency and accuracy of an artificial intelligence (AI) algorithm for detecting interval cancers in a middle-income country's national screening program. MATERIAL AND METHODS A total of 2,129,486 mammograms reported as BIRADS 1 and 2 were matched with the national cancer registry for interval cancers (IC). The IC group consisted of 442 cases, of which 36 were excluded due to having mammograms incompatible with the AI system. A control group of 446 women with two negative consequent mammograms was defined as time-proven normal and constituted the normal group. The cancer risk scores of both groups were determined from 1 to 10 with the AI system. The sensitivity and specificity values of the AI system were defined in terms of IC detection. The IC group was divided into subgroups with six-month intervals according to their time from screening to diagnosis: 0-6 months, 6-12 months, 12-18 months, and 18-24 months. The diagnostic performance of the AI system for all patients was evaluated using receiver operating characteristics (ROC) curve analysis. The diagnostic performance of the AI system for major and minor findings that expert readers determined was re-evaluated. RESULTS AI labeled 53% of ICs with the highest score of 10. The sensitivity of AI in detecting ICs was 53.7% and 38.5% at specificities of 90% and 95%, respectively. Area under the curve (AUC) of AI in detecting major signs was 0.93 (95% CI: 0.90-0.95) with a sensitivity of 81.6% and 72.4% at specificities of 90% and 95%, respectively (95% CI: 0.73-0.88 and 95% CI: 0.60-0.82 respectively) and minor signs was 0.87 (95% CI: 0.87-0.92) with a sensitivity of 70% and 53% at a specificity of 90% and 95%, respectively (95% CI: 0.65-0.82 and 95% CI: 0.52-0.71 respectively). In subgroup analysis for time to diagnosis, the AUC value of the AI system was higher in the 0-6 month period than in later periods. CONCLUSION This study showed the potential of AI in detecting ICs in initial mammograms and reducing human errors and undetected cancers.
Collapse
Affiliation(s)
- L Çelik
- Maltepe University Hospital, Feyzullah cad 39, Maltepe, 34843, Istanbul, Turkey.
| | - E Aribal
- Acibadem University, School of Medicine, 34752, Istanbul, Turkey; Acibadem Altunizade Hospital, Tophanelioglu cad 13, Altunizade, 34662, Istanbul, Turkey.
| |
Collapse
|
2
|
Holen ÅS, Martiniussen MA, Bergan MB, Moshina N, Hovda T, Hofvind S. Women's attitudes and perspectives on the use of artificial intelligence in the assessment of screening mammograms. Eur J Radiol 2024; 175:111431. [PMID: 38520804 DOI: 10.1016/j.ejrad.2024.111431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 02/26/2024] [Accepted: 03/15/2024] [Indexed: 03/25/2024]
Abstract
PURPOSE To investigate attitudes and perspectives on the use of artificial intelligence (AI) in the assessment of screening mammograms among women invited to BreastScreen Norway. METHOD An anonymous survey was sent to all women invited to BreastScreen Norway during the study period, October 10, 2022, to December 25, 2022 (n = 84,543). Questions were answered on a 10-point Likert scale and as multiple-choice, addressing knowledge of AI, willingness to participate in AI studies, information needs, confidence in AI results and AI assisted reading strategies, and thoughts on concerns and benefits of AI in mammography screening. Analyses were performed using χ2 and logistic regression tests. RESULTS General knowledge of AI was reported as extensive by 11.0% of the 8,355 respondents. Respondents were willing to participate in studies using AI either for decision support (64.0%) or triaging (54.9%). Being informed about use of AI-assisted image assessment was considered important, and a reading strategy of AI in combination with one radiologist preferred. Having extensive knowledge of AI was associated with willingness to participate in AI studies (decision support; odds ratio [OR]: 5.1, 95% confidence interval [CI]: 4.1-6.4, and triaging; OR: 3.4, 95% CI: 2.8-4.0) and trust in AI's independent assessment (OR: 6.8, 95% CI: 5.7, 8.3). CONCLUSIONS Women invited to BreastScreen Norway had a positive attitude towards the use of AI in image assessment, given that human readers are still involved. Targeted information and increased public knowledge of AI could help achieve high participation in AI studies and successful implementation of AI in mammography screening.
Collapse
Affiliation(s)
- Åsne Sørlien Holen
- Cancer Registry of Norway, Norwegian Institute of Public Health, Oslo, Norway.
| | - Marit Almenning Martiniussen
- Department of Radiology, Østfold Hospital Trust, Kalnes, Norway; University of Oslo, Institute of Clinical Medicine, Oslo, Norway.
| | - Marie Burns Bergan
- Cancer Registry of Norway, Norwegian Institute of Public Health, Oslo, Norway.
| | - Nataliia Moshina
- Cancer Registry of Norway, Norwegian Institute of Public Health, Oslo, Norway.
| | - Tone Hovda
- Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway.
| | - Solveig Hofvind
- Cancer Registry of Norway, Norwegian Institute of Public Health, Oslo, Norway; Department of Health and Care Sciences, UiT, The Artic University of Norway, Tromsø, Norway.
| |
Collapse
|
3
|
Larsen M, Olstad CF, Lee CI, Hovda T, Hoff SR, Martiniussen MA, Mikalsen KØ, Lund-Hanssen H, Solli HS, Silberhorn M, Sulheim ÅØ, Auensen S, Nygård JF, Hofvind S. Performance of an Artificial Intelligence System for Breast Cancer Detection on Screening Mammograms from BreastScreen Norway. Radiol Artif Intell 2024; 6:e230375. [PMID: 38597784 PMCID: PMC11140504 DOI: 10.1148/ryai.230375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 02/18/2024] [Accepted: 03/19/2024] [Indexed: 04/11/2024]
Abstract
Purpose To explore the stand-alone breast cancer detection performance, at different risk score thresholds, of a commercially available artificial intelligence (AI) system. Materials and Methods This retrospective study included information from 661 695 digital mammographic examinations performed among 242 629 female individuals screened as a part of BreastScreen Norway, 2004-2018. The study sample included 3807 screen-detected cancers and 1110 interval breast cancers. A continuous examination-level risk score by the AI system was used to measure performance as the area under the receiver operating characteristic curve (AUC) with 95% CIs and cancer detection at different AI risk score thresholds. Results The AUC of the AI system was 0.93 (95% CI: 0.92, 0.93) for screen-detected cancers and interval breast cancers combined and 0.97 (95% CI: 0.97, 0.97) for screen-detected cancers. In a setting where 10% of the examinations with the highest AI risk scores were defined as positive and 90% with the lowest scores as negative, 92.0% (3502 of 3807) of the screen-detected cancers and 44.6% (495 of 1110) of the interval breast cancers were identified with AI. In this scenario, 68.5% (10 987 of 16 040) of false-positive screening results (negative recall assessment) were considered negative by AI. When 50% was used as the cutoff, 99.3% (3781 of 3807) of the screen-detected cancers and 85.2% (946 of 1110) of the interval breast cancers were identified as positive by AI, whereas 17.0% (2725 of 16 040) of the false-positive results were considered negative. Conclusion The AI system showed high performance in detecting breast cancers within 2 years of screening mammography and a potential for use to triage low-risk mammograms to reduce radiologist workload. Keywords: Mammography, Breast, Screening, Convolutional Neural Network (CNN), Deep Learning Algorithms Supplemental material is available for this article. © RSNA, 2024 See also commentary by Bahl and Do in this issue.
Collapse
Affiliation(s)
- Marthe Larsen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Camilla F. Olstad
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Christoph I. Lee
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Tone Hovda
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Solveig R. Hoff
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Marit A. Martiniussen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Karl Øyvind Mikalsen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Håkon Lund-Hanssen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Helene S. Solli
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Marko Silberhorn
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Åse Ø. Sulheim
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Steinar Auensen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Jan F. Nygård
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| | - Solveig Hofvind
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.F.N.), Cancer Registry of Norway, Norwegian Institute of Public Health, PO 5313, Majorstuen, 0304 Oslo, Norway; Department of Radiology, University of Washington School of Medicine, Seattle, Wash (C.I.L.); Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, Wash (C.I.L.); Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway (T.H.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation, Medical Imaging, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); SPKI–The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine, Faculty of Health Sciences (K.Ø.M.), Department of Physics and Technology, Faculty of Science and Technology (J.F.N.), and Department of Health and Care Sciences, Faculty of Health Sciences (S.H.), UiT–The Arctic University of Norway, Tromsø, Norway; Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); Department of Radiology, Innlandet Hospital Trust, Hamar, Norway (M.S.); and Department of Radiology, Innlandet Hospital Trust, Lillehammer, Norway (Å.Ø.S.)
| |
Collapse
|
4
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, Dos Santos DP, Tang A, Wald C, Slavotinek J. Developing, Purchasing, Implementing and Monitoring AI Tools in Radiology: Practical Considerations. A Multi-Society Statement From the ACR, CAR, ESR, RANZCR & RSNA. Can Assoc Radiol J 2024; 75:226-244. [PMID: 38251882 DOI: 10.1177/08465371231222229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024] Open
Abstract
Artificial Intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever‑growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones. This multi‑society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical Center, Birmingham, AL, USA
- Data Science Institute, American College of Radiology, Reston, VA, USA
| | - Jaron Chong
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Elmar Kotter
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, CA, USA
- Stanford Center for Artificial Intelligence in Medicine & Imaging, Palo Alto, CA, USA
| | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, USA
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, SA, Australia
| | - Daniel Pinto Dos Santos
- Department of Radiology, University Hospital of Cologne, Cologne, Germany
- Department of Radiology, University Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation Oncology, and Nuclear Medicine, Université de Montréal, Montréal, QC, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital & Medical Center, Burlington, MA, USA
- Tufts University Medical School, Boston, MA, USA
- American College of Radiology, Reston, VA, USA
| | - John Slavotinek
- South Australia Medical Imaging, Flinders Medical Centre Adelaide, SA, Australia
- College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| |
Collapse
|
5
|
Kwon MR, Chang Y, Ham SY, Cho Y, Kim EY, Kang J, Park EK, Kim KH, Kim M, Kim TS, Lee H, Kwon R, Lim GY, Choi HR, Choi J, Kook SH, Ryu S. Screening mammography performance according to breast density: a comparison between radiologists versus standalone intelligence detection. Breast Cancer Res 2024; 26:68. [PMID: 38649889 PMCID: PMC11036604 DOI: 10.1186/s13058-024-01821-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 04/08/2024] [Indexed: 04/25/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) algorithms for the independent assessment of screening mammograms have not been well established in a large screening cohort of Asian women. We compared the performance of screening digital mammography considering breast density, between radiologists and AI standalone detection among Korean women. METHODS We retrospectively included 89,855 Korean women who underwent their initial screening digital mammography from 2009 to 2020. Breast cancer within 12 months of the screening mammography was the reference standard, according to the National Cancer Registry. Lunit software was used to determine the probability of malignancy scores, with a cutoff of 10% for breast cancer detection. The AI's performance was compared with that of the final Breast Imaging Reporting and Data System category, as recorded by breast radiologists. Breast density was classified into four categories (A-D) based on the radiologist and AI-based assessments. The performance metrics (cancer detection rate [CDR], sensitivity, specificity, positive predictive value [PPV], recall rate, and area under the receiver operating characteristic curve [AUC]) were compared across breast density categories. RESULTS Mean participant age was 43.5 ± 8.7 years; 143 breast cancer cases were identified within 12 months. The CDRs (1.1/1000 examination) and sensitivity values showed no significant differences between radiologist and AI-based results (69.9% [95% confidence interval [CI], 61.7-77.3] vs. 67.1% [95% CI, 58.8-74.8]). However, the AI algorithm showed better specificity (93.0% [95% CI, 92.9-93.2] vs. 77.6% [95% CI, 61.7-77.9]), PPV (1.5% [95% CI, 1.2-1.9] vs. 0.5% [95% CI, 0.4-0.6]), recall rate (7.1% [95% CI, 6.9-7.2] vs. 22.5% [95% CI, 22.2-22.7]), and AUC values (0.8 [95% CI, 0.76-0.84] vs. 0.74 [95% CI, 0.7-0.78]) (all P < 0.05). Radiologist and AI-based results showed the best performance in the non-dense category; the CDR and sensitivity were higher for radiologists in the heterogeneously dense category (P = 0.059). However, the specificity, PPV, and recall rate consistently favored AI-based results across all categories, including the extremely dense category. CONCLUSIONS AI-based software showed slightly lower sensitivity, although the difference was not statistically significant. However, it outperformed radiologists in recall rate, specificity, PPV, and AUC, with disparities most prominent in extremely dense breast tissue.
Collapse
Affiliation(s)
- Mi-Ri Kwon
- Department of Radiology, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, South Korea
| | - Yoosoo Chang
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea.
- Department of Occupational and Environmental Medicine, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.
- Department of Clinical Research Design & Evaluation, Samsung Advanced Institute for Health Sciences & Technology, Sungkyunkwan University, Seoul, Republic of Korea.
| | - Soo-Youn Ham
- Department of Radiology, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, South Korea
| | - Yoosun Cho
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea
| | - Eun Young Kim
- Department of Surgery, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Jeonggyu Kang
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea
| | | | | | - Minjeong Kim
- Lunit Inc, Seoul, Republic of Korea
- Department of Statistics, Ewha Womans University, Seoul, Republic of Korea
| | | | | | - Ria Kwon
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea
- Institute of Medical Research, Sungkyunkwan University School of Medicine, Suwon, Republic of Korea
| | - Ga-Young Lim
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea
- Institute of Medical Research, Sungkyunkwan University School of Medicine, Suwon, Republic of Korea
| | - Hye Rin Choi
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea
- Institute of Medical Research, Sungkyunkwan University School of Medicine, Suwon, Republic of Korea
| | - JunHyeok Choi
- School of Mechanical Engineering, Sunkyungkwan University, Seoul, Republic of Korea
| | - Shin Ho Kook
- Department of Radiology, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, South Korea
| | - Seungho Ryu
- Center for Cohort Studies, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Samsung Main Building B2, 250, Taepyung-ro 2ga, Jung-gu, 04514, Seoul, South Korea.
- Department of Occupational and Environmental Medicine, Kangbuk Samsung Hospital, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.
- Department of Clinical Research Design & Evaluation, Samsung Advanced Institute for Health Sciences & Technology, Sungkyunkwan University, Seoul, Republic of Korea.
| |
Collapse
|
6
|
Bergan MB, Larsen M, Moshina N, Bartsch H, Koch HW, Aase HS, Satybaldinov Z, Haldorsen IHS, Lee CI, Hofvind S. AI performance by mammographic density in a retrospective cohort study of 99,489 participants in BreastScreen Norway. Eur Radiol 2024:10.1007/s00330-024-10681-z. [PMID: 38528136 DOI: 10.1007/s00330-024-10681-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 01/19/2024] [Accepted: 02/10/2024] [Indexed: 03/27/2024]
Abstract
OBJECTIVE To explore the ability of artificial intelligence (AI) to classify breast cancer by mammographic density in an organized screening program. MATERIALS AND METHOD We included information about 99,489 examinations from 74,941 women who participated in BreastScreen Norway, 2013-2019. All examinations were analyzed with an AI system that assigned a malignancy risk score (AI score) from 1 (lowest) to 10 (highest) for each examination. Mammographic density was classified into Volpara density grade (VDG), VDG1-4; VDG1 indicated fatty and VDG4 extremely dense breasts. Screen-detected and interval cancers with an AI score of 1-10 were stratified by VDG. RESULTS We found 10,406 (10.5% of the total) examinations to have an AI risk score of 10, of which 6.7% (704/10,406) was breast cancer. The cancers represented 89.7% (617/688) of the screen-detected and 44.6% (87/195) of the interval cancers. 20.3% (20,178/99,489) of the examinations were classified as VDG1 and 6.1% (6047/99,489) as VDG4. For screen-detected cancers, 84.0% (68/81, 95% CI, 74.1-91.2) had an AI score of 10 for VDG1, 88.9% (328/369, 95% CI, 85.2-91.9) for VDG2, 92.5% (185/200, 95% CI, 87.9-95.7) for VDG3, and 94.7% (36/38, 95% CI, 82.3-99.4) for VDG4. For interval cancers, the percentages with an AI score of 10 were 33.3% (3/9, 95% CI, 7.5-70.1) for VDG1 and 48.0% (12/25, 95% CI, 27.8-68.7) for VDG4. CONCLUSION The tested AI system performed well according to cancer detection across all density categories, especially for extremely dense breasts. The highest proportion of screen-detected cancers with an AI score of 10 was observed for women classified as VDG4. CLINICAL RELEVANCE STATEMENT Our study demonstrates that AI can correctly classify the majority of screen-detected and about half of the interval breast cancers, regardless of breast density. KEY POINTS • Mammographic density is important to consider in the evaluation of artificial intelligence in mammographic screening. • Given a threshold representing about 10% of those with the highest malignancy risk score by an AI system, we found an increasing percentage of cancers with increasing mammographic density. • Artificial intelligence risk score and mammographic density combined may help triage examinations to reduce workload for radiologists.
Collapse
Affiliation(s)
- Marie Burns Bergan
- Section for Breast Cancer Screening, Cancer Registry of Norway, Norwegian Institute of Public Health, P.O. Box 5313, 0304, Oslo, Norway
| | - Marthe Larsen
- Section for Breast Cancer Screening, Cancer Registry of Norway, Norwegian Institute of Public Health, P.O. Box 5313, 0304, Oslo, Norway
| | - Nataliia Moshina
- Section for Breast Cancer Screening, Cancer Registry of Norway, Norwegian Institute of Public Health, P.O. Box 5313, 0304, Oslo, Norway
| | - Hauke Bartsch
- Department of Radiology, Mohn Medical Imaging and Visualization Centre (MMIV), Haukeland University Hospital, Bergen, Norway
| | - Henrik Wethe Koch
- Department of Radiology, Stavanger University Hospital, Stavanger, Norway
- Faculty of Health Sciences, University of Stavanger, Stavanger, Norway
| | | | - Zhanbolat Satybaldinov
- Department of Radiology, Mohn Medical Imaging and Visualization Centre (MMIV), Haukeland University Hospital, Bergen, Norway
| | - Ingfrid Helene Salvesen Haldorsen
- Department of Radiology, Mohn Medical Imaging and Visualization Centre (MMIV), Haukeland University Hospital, Bergen, Norway
- Section for Radiology, Department of Clinical Medicine, University of Bergen, Bergen, Norway
| | - Christoph I Lee
- Department of Radiology, University of Washington School of Medicine, Seattle, WA, USA
- Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, WA, USA
| | - Solveig Hofvind
- Section for Breast Cancer Screening, Cancer Registry of Norway, Norwegian Institute of Public Health, P.O. Box 5313, 0304, Oslo, Norway.
- Department of Health and Care Sciences, Faculty of Health Sciences, UiT The Arctic University of Norway, Tromsø, Norway.
| |
Collapse
|
7
|
Koch HW, Larsen M, Bartsch H, Martiniussen MA, Styr BM, Fagerheim S, Haldorsen IHS, Hofvind S. How do AI markings on screening mammograms correspond to cancer location? An informed review of 270 breast cancer cases in BreastScreen Norway. Eur Radiol 2024:10.1007/s00330-024-10662-2. [PMID: 38396248 DOI: 10.1007/s00330-024-10662-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 01/18/2024] [Accepted: 01/28/2024] [Indexed: 02/25/2024]
Abstract
OBJECTIVES To compare the location of AI markings on screening mammograms with cancer location on diagnostic mammograms, and to classify interval cancers with high AI score as false negative, minimal sign, or true negative. METHODS In a retrospective study from 2022, we compared the performance of an AI system with independent double reading according to cancer detection. We found 93% (880/949) of the screen-detected cancers, and 40% (122/305) of the interval cancers to have the highest AI risk score (AI score of 10). In this study, four breast radiologists reviewed mammograms from 126 randomly selected screen-detected cancers and all 120 interval cancers with an AI score of 10. The location of the AI marking was stated as correct/not correct in craniocaudal and mediolateral oblique view. Interval cancers with an AI score of 10 were classified as false negative, minimal sign significant/non-specific, or true negative. RESULTS All screen-detected cancers and 78% (93/120) of the interval cancers with an AI score of 10 were correctly located by the AI system. The AI markings matched in both views for 79% (100/126) of the screen-detected cancers and 22% (26/120) of the interval cancers. For interval cancers with an AI score of 10, 11% (13/120) were correctly located and classified as false negative, 10% (12/120) as minimal sign significant, 26% (31/120) as minimal sign non-specific, and 31% (37/120) as true negative. CONCLUSION AI markings corresponded to cancer location for all screen-detected cancers and 78% of the interval cancers with high AI score, indicating a potential for reducing the number of interval cancers. However, it is uncertain whether interval cancers with subtle findings in only one view are actionable for recall in a true screening setting. CLINICAL RELEVANCE STATEMENT In this study, AI markings corresponded to the location of the cancer in a high percentage of cases, indicating that the AI system accurately identifies the cancer location in mammograms with a high AI score. KEY POINTS • All screen-detected and 78% of the interval cancers with high AI risk score (AI score of 10) had AI markings in one or two views corresponding to the location of the cancer on diagnostic images. • Among all 120 interval cancers with an AI score of 10, 21% (25/120) were classified as a false negative or minimal sign significant and had AI markings matching the cancer location, suggesting they may be visible on prior screening. • Most of the correctly located interval cancers matched only in one view, and the majority were classified as either true negative or minimal sign non-specific, indicating low potential for being detected earlier in a real screening setting.
Collapse
Affiliation(s)
- Henrik Wethe Koch
- Department of Radiology, Stavanger University Hospital, Stavanger, Norway
- Faculty of Health Sciences, University of Stavanger, Stavanger, Norway
| | - Marthe Larsen
- Section for Breast Cancer Screening, Cancer Registry of Norway, Norwegian Institute of Public Health, P.O. Box 5313, 0304, Oslo, Norway
| | - Hauke Bartsch
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of Radiology, Haukeland University Hospital, Bergen, Norway
| | - Marit Almenning Martiniussen
- Department of Radiology, Østfold Hospital Trust, Kalnes, Norway
- University of Oslo, Institute of Clinical Medicine, Oslo, Norway
| | | | - Siri Fagerheim
- Department of Radiology, Stavanger University Hospital, Stavanger, Norway
| | - Ingfrid Helene Salvesen Haldorsen
- Mohn Medical Imaging and Visualization Centre (MMIV), Department of Radiology, Haukeland University Hospital, Bergen, Norway
- Section for Radiology, Department of Clinical Medicine, University of Bergen, Bergen, Norway
| | - Solveig Hofvind
- Section for Breast Cancer Screening, Cancer Registry of Norway, Norwegian Institute of Public Health, P.O. Box 5313, 0304, Oslo, Norway.
- Department of Health and Care Sciences, Faculty of Health Sciences, UiT The Arctic University of Norway, Tromsø, Norway.
| |
Collapse
|
8
|
Seker ME, Koyluoglu YO, Ozaydin AN, Gurdal SO, Ozcinar B, Cabioglu N, Ozmen V, Aribal E. Diagnostic capabilities of artificial intelligence as an additional reader in a breast cancer screening program. Eur Radiol 2024:10.1007/s00330-024-10661-3. [PMID: 38388718 DOI: 10.1007/s00330-024-10661-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 01/18/2024] [Accepted: 01/27/2024] [Indexed: 02/24/2024]
Abstract
OBJECTIVES We aimed to evaluate the early-detection capabilities of AI in a screening program over its duration, with a specific focus on the detection of interval cancers, the early detection of cancers with the assistance of AI from prior visits, and its impact on workload for various reading scenarios. MATERIALS AND METHODS The study included 22,621 mammograms of 8825 women within a 10-year biennial two-reader screening program. The statistical analysis focused on 5136 mammograms from 4282 women due to data retrieval issues, among whom 105 were diagnosed with breast cancer. The AI software assigned scores from 1 to 100. Histopathology results determined the ground truth, and Youden's index was used to establish a threshold. Tumor characteristics were analyzed with ANOVA and chi-squared test, and different workflow scenarios were evaluated using bootstrapping. RESULTS The AI software achieved an AUC of 89.6% (86.1-93.2%, 95% CI). The optimal threshold was 30.44, yielding 72.38% sensitivity and 92.86% specificity. Initially, AI identified 57 screening-detected cancers (83.82%), 15 interval cancers (51.72%), and 4 missed cancers (50%). AI as a second reader could have led to earlier diagnosis in 24 patients (average 29.92 ± 19.67 months earlier). No significant differences were found in cancer-characteristics groups. A hybrid triage workflow scenario showed a potential 69.5% reduction in workload and a 30.5% increase in accuracy. CONCLUSION This AI system exhibits high sensitivity and specificity in screening mammograms, effectively identifying interval and missed cancers and identifying 23% of cancers earlier in prior mammograms. Adopting AI as a triage mechanism has the potential to reduce workload by nearly 70%. CLINICAL RELEVANCE STATEMENT The study proposes a more efficient method for screening programs, both in terms of workload and accuracy. KEY POINTS • Incorporating AI as a triage tool in screening workflow improves sensitivity (72.38%) and specificity (92.86%), enhancing detection rates for interval and missed cancers. • AI-assisted triaging is effective in differentiating low and high-risk cases, reduces radiologist workload, and potentially enables broader screening coverage. • AI has the potential to facilitate early diagnosis compared to human reading.
Collapse
Affiliation(s)
- Mustafa Ege Seker
- Department of Radiology, Acibadem Mehmet Ali Aydinlar University, School of Medicine, Istanbul, Turkey
| | - Yilmaz Onat Koyluoglu
- Department of Radiology, Acibadem Mehmet Ali Aydinlar University, School of Medicine, Istanbul, Turkey
| | | | | | - Beyza Ozcinar
- Istanbul University, School of Medicine, Istanbul, Turkey
| | | | - Vahit Ozmen
- Istanbul University, School of Medicine, Istanbul, Turkey
| | - Erkin Aribal
- Department of Radiology, Acibadem Mehmet Ali Aydinlar University, School of Medicine, Istanbul, Turkey.
| |
Collapse
|
9
|
Guenoun D, Zins M, Champsaur P, Thomassin-Naggara I. French community grid for the evaluation of radiological artificial intelligence solutions (DRIM France Artificial Intelligence Initiative). Diagn Interv Imaging 2024; 105:74-81. [PMID: 37749026 DOI: 10.1016/j.diii.2023.09.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 09/08/2023] [Accepted: 09/09/2023] [Indexed: 09/27/2023]
Abstract
PURPOSE The purpose of this study was to validate a national descriptive and analytical grid for artificial intelligence (AI) solutions in radiology. MATERIALS AND METHODS The RAND-UCLA Appropriateness Method was chosen by expert radiologists from the DRIM France IA group for this statement paper. The study, initiated by the radiology community, involved seven steps including literature review, template development, panel selection, pre-panel meeting survey, data extraction and analysis, second and final panel meeting, and data reporting. RESULTS The panel consisted of seven software vendors, three for bone fracture detection using conventional radiology and four for breast cancer detection using mammography. A consensus was reached on various aspects, including general target, main objective, certification marking, integration, expression of results, forensic aspects and cybersecurity, performance and scientific validation, description of the company and economic details, possible usage scenarios in the clinical workflow, database, specific objectives and targets of the AI tool. CONCLUSION The study validates a descriptive and analytical grid for radiological AI solutions consisting of ten items, using breast cancer and bone fracture as an experimental guide. This grid would assist radiologists in selecting relevant and validated AI solutions. Further developments of the grid are needed to include other organs and tasks.
Collapse
Affiliation(s)
- Daphné Guenoun
- APHM, Sainte-Marguerite Hospital, Institute for Locomotion, Department of Radiology, 13009, Marseille, France; Aix Marseille Univ, CNRS, ISM, Inst Movement Sci, 13009, Marseille, France.
| | - Marc Zins
- Department of Radiology and Medical Imaging, Saint-Joseph Hospital, 75014, Paris, France
| | - Pierre Champsaur
- APHM, Sainte-Marguerite Hospital, Institute for Locomotion, Department of Radiology, 13009, Marseille, France; Aix Marseille Univ, CNRS, ISM, Inst Movement Sci, 13009, Marseille, France
| | - Isabelle Thomassin-Naggara
- Sorbonne Université, 75005, Paris, France; Department of Diagnostic and Interventional Imaging, Assistance Publique-Hôpitaux de Paris, Hôpital Tenon, 75020 Paris, France
| |
Collapse
|
10
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, Pinto Dos Santos D, Tang A, Wald C, Slavotinek J. Developing, purchasing, implementing and monitoring AI tools in radiology: Practical considerations. A multi-society statement from the ACR, CAR, ESR, RANZCR & RSNA. J Med Imaging Radiat Oncol 2024; 68:7-26. [PMID: 38259140 DOI: 10.1111/1754-9485.13612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Accepted: 11/23/2023] [Indexed: 01/24/2024]
Abstract
Artificial Intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever-growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones. This multi-society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical Center, Birmingham, Alabama, USA
- American College of Radiology Data Science Institute, Reston, Virginia, USA
| | - Jaron Chong
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada
| | - Elmar Kotter
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, California, USA
- Stanford Center for Artificial Intelligence in Medicine & Imaging, Palo Alto, California, USA
| | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, California, USA
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, South Australia, Australia
| | - Daniel Pinto Dos Santos
- Department of Radiology, University Hospital of Cologne, Cologne, Germany
- Department of Radiology, University Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation Oncology, and Nuclear Medicine, Université de Montréal, Montreal, Quebec, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital & Medical Center, Burlington, Massachusetts, USA
- Tufts University Medical School, Boston, Massachusetts, USA
- Commision On Informatics, and Member, Board of Chancellors, American College of Radiology, Reston, Virginia, USA
| | - John Slavotinek
- South Australia Medical Imaging, Flinders Medical Centre Adelaide, Adelaide, South Australia, Australia
- College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia
| |
Collapse
|
11
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, Pinto Dos Santos D, Tang A, Wald C, Slavotinek J. Developing, Purchasing, Implementing and Monitoring AI Tools in Radiology: Practical Considerations. A Multi-Society Statement From the ACR, CAR, ESR, RANZCR & RSNA. J Am Coll Radiol 2024:S1546-1440(23)01020-7. [PMID: 38276923 DOI: 10.1016/j.jacr.2023.12.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
Artificial intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever-growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones. This multi-society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools. KEY POINTS.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical Center, Birmingham, Alabama; American College of Radiology Data Science Institute, Reston, Virginia
| | - Jaron Chong
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Elmar Kotter
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, California; Stanford Center for Artificial Intelligence in Medicine & Imaging, Palo Alto, California
| | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, California
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Daniel Pinto Dos Santos
- Department of Radiology, University Hospital of Cologne, Cologne, Germany; Department of Radiology, University Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation Oncology, and Nuclear Medicine, Université de Montréal, Montréal, Québec, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital & Medical Center, Burlington, Massachusetts; Tufts University Medical School, Boston, Massachusetts; Commision on Informatics, and Member, Board of Chancellors, American College of Radiology, Virginia
| | - John Slavotinek
- South Australia Medical Imaging, Flinders Medical Centre Adelaide, Adelaide, Australia; College of Medicine and Public Health, Flinders University, Adelaide, Australia
| |
Collapse
|
12
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, Dos Santos DP, Tang A, Wald C, Slavotinek J. Developing, purchasing, implementing and monitoring AI tools in radiology: practical considerations. A multi-society statement from the ACR, CAR, ESR, RANZCR & RSNA. Insights Imaging 2024; 15:16. [PMID: 38246898 PMCID: PMC10800328 DOI: 10.1186/s13244-023-01541-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024] Open
Abstract
Artificial Intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever-growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones.This multi-society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools.Key points • The incorporation of artificial intelligence (AI) in radiological practice demands increased monitoring of its utility and safety.• Cooperation between developers, clinicians, and regulators will allow all involved to address ethical issues and monitor AI performance.• AI can fulfil its promise to advance patient well-being if all steps from development to integration in healthcare are rigorously evaluated.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical Center, Birmingham, AL, USA
- American College of Radiology Data Science Institute, Reston, VA, USA
| | - Jaron Chong
- Department of Medical Imaging, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Elmar Kotter
- Department of Diagnostic and Interventional Radiology, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, CA, USA
- Stanford Center for Artificial Intelligence in Medicine & Imaging, Palo Alto, CA, USA
| | - John Mongan
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, USA
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Daniel Pinto Dos Santos
- Department of Radiology, University Hospital of Cologne, Cologne, Germany
- Department of Radiology, University Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation Oncology, and Nuclear Medicine, Université de Montréal, Montréal, Québec, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital & Medical Center, Burlington, MA, USA
- Tufts University Medical School, Boston, MA, USA
- Commision On Informatics, and Member, Board of Chancellors, American College of Radiology, Virginia, USA
| | - John Slavotinek
- South Australia Medical Imaging, Flinders Medical Centre Adelaide, Adelaide, Australia
- College of Medicine and Public Health, Flinders University, Adelaide, Australia
| |
Collapse
|
13
|
Al-Bazzaz H, Janicijevic M, Strand F. Reader bias in breast cancer screening related to cancer prevalence and artificial intelligence decision support-a reader study. Eur Radiol 2024:10.1007/s00330-023-10514-5. [PMID: 38165430 DOI: 10.1007/s00330-023-10514-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Revised: 09/23/2023] [Accepted: 11/01/2023] [Indexed: 01/03/2024]
Abstract
OBJECTIVES The aim of our study was to examine how breast radiologists would be affected by high cancer prevalence and the use of artificial intelligence (AI) for decision support. MATERIALS AND METHOD This reader study was based on selection of screening mammograms, including the original radiologist assessment, acquired in 2010 to 2013 at the Karolinska University Hospital, with a ratio of 1:1 cancer versus healthy based on a 2-year follow-up. A commercial AI system generated an exam-level positive or negative read, and image markers. Double-reading and consensus discussions were first performed without AI and later with AI, with a 6-week wash-out period in between. The chi-squared test was used to test for differences in contingency tables. RESULTS Mammograms of 758 women were included, half with cancer and half healthy. 52% were 40-55 years; 48% were 56-75 years. In the original non-enriched screening setting, the sensitivity was 61% (232/379) at specificity 98% (323/379). In the reader study, the sensitivity without and with AI was 81% (307/379) and 75% (284/379) respectively (p < 0.001). The specificity without and with AI was 67% (255/379) and 86% (326/379) respectively (p < 0.001). The tendency to change assessment from positive to negative based on erroneous AI information differed between readers and was affected by type and number of image signs of malignancy. CONCLUSION Breast radiologists reading a list with high cancer prevalence performed at considerably higher sensitivity and lower specificity than the original screen-readers. Adding AI information, calibrated to a screening setting, decreased sensitivity and increased specificity. CLINICAL RELEVANCE STATEMENT Radiologist screening mammography assessments will be biased towards higher sensitivity and lower specificity by high-risk triaging and nudged towards the sensitivity and specificity setting of AI reads. After AI implementation in clinical practice, there is reason to carefully follow screening metrics to ensure the impact is desired. KEY POINTS • Breast radiologists' sensitivity and specificity will be affected by changes brought by artificial intelligence. • Reading in a high cancer prevalence setting markedly increased sensitivity and decreased specificity. • Reviewing the binary reads by AI, negative or positive, biased screening radiologists towards the sensitivity and specificity of the AI system.
Collapse
Affiliation(s)
- Hanen Al-Bazzaz
- Mälarsjukhuset Eskilstuna, Kungsvägen 42, 633 49, Eskilstuna, Sweden
| | | | - Fredrik Strand
- Department of Oncology-Pathology, Karolinska Institutet, L2:03, Karolinska Vägen 8, 171 64, Solna, Sweden.
- Breast Radiology, Medical Diagnostics Karolinska, Karolinska University Hospital, NB1:03, Gävlegatan 55, 171 76, Stockholm, Sweden.
| |
Collapse
|
14
|
Brady AP, Allen B, Chong J, Kotter E, Kottler N, Mongan J, Oakden-Rayner L, dos Santos DP, Tang A, Wald C, Slavotinek J. Developing, Purchasing, Implementing and Monitoring AI Tools in Radiology: Practical Considerations. A Multi-Society Statement from the ACR, CAR, ESR, RANZCR and RSNA. Radiol Artif Intell 2024; 6:e230513. [PMID: 38251899 PMCID: PMC10831521 DOI: 10.1148/ryai.230513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Abstract
Artificial Intelligence (AI) carries the potential for unprecedented disruption in radiology, with possible positive and negative consequences. The integration of AI in radiology holds the potential to revolutionize healthcare practices by advancing diagnosis, quantification, and management of multiple medical conditions. Nevertheless, the ever-growing availability of AI tools in radiology highlights an increasing need to critically evaluate claims for its utility and to differentiate safe product offerings from potentially harmful, or fundamentally unhelpful ones. This multi-society paper, presenting the views of Radiology Societies in the USA, Canada, Europe, Australia, and New Zealand, defines the potential practical problems and ethical issues surrounding the incorporation of AI into radiological practice. In addition to delineating the main points of concern that developers, regulators, and purchasers of AI tools should consider prior to their introduction into clinical practice, this statement also suggests methods to monitor their stability and safety in clinical use, and their suitability for possible autonomous function. This statement is intended to serve as a useful summary of the practical issues which should be considered by all parties involved in the development of radiology AI resources, and their implementation as clinical tools. This article is simultaneously published in Insights into Imaging (DOI 10.1186/s13244-023-01541-3), Journal of Medical Imaging and Radiation Oncology (DOI 10.1111/1754-9485.13612), Canadian Association of Radiologists Journal (DOI 10.1177/08465371231222229), Journal of the American College of Radiology (DOI 10.1016/j.jacr.2023.12.005), and Radiology: Artificial Intelligence (DOI 10.1148/ryai.230513). Keywords: Artificial Intelligence, Radiology, Automation, Machine Learning Published under a CC BY 4.0 license. ©The Author(s) 2024. Editor's Note: The RSNA Board of Directors has endorsed this article. It has not undergone review or editing by this journal.
Collapse
Affiliation(s)
| | - Bibb Allen
- Department of Radiology, Grandview Medical
Center, Birmingham, AL, USA
- American College of Radiology Data Science
Institute, Reston, VA, USA
| | - Jaron Chong
- Department of Medical Imaging, Schulich
School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Elmar Kotter
- Department of Diagnostic and
Interventional Radiology, Medical Center, Faculty of Medicine, University of
Freiburg, Freiburg, Germany
| | - Nina Kottler
- Radiology Partners, El Segundo, CA,
USA
- Stanford Center for Artificial
Intelligence in Medicine & Imaging, Palo Alto, CA, USA
| | - John Mongan
- Department of Radiology and Biomedical
Imaging, University of California, San Francisco, USA
| | - Lauren Oakden-Rayner
- Australian Institute for Machine Learning,
University of Adelaide, Adelaide, Australia
| | - Daniel Pinto dos Santos
- Department of Radiology, University
Hospital of Cologne, Cologne, Germany
- Department of Radiology, University
Hospital of Frankfurt, Frankfurt, Germany
| | - An Tang
- Department of Radiology, Radiation
Oncology, and Nuclear Medicine, Université de Montréal,
Montréal, Québec, Canada
| | - Christoph Wald
- Department of Radiology, Lahey Hospital
& Medical Center, Burlington, MA, USA
- Tufts University Medical School, Boston,
MA, USA
- Commission On Informatics, and Member,
Board of Chancellors, American College of Radiology, Virginia, USA
| | - John Slavotinek
- South Australia Medical Imaging,
Flinders Medical Centre Adelaide, Adelaide, Australia
- College of Medicine and Public Health,
Flinders University, Adelaide, Australia
| |
Collapse
|
15
|
Raya-Povedano JL. AI in breast cancer screening: a critical overview of what we know. Eur Radiol 2023:10.1007/s00330-023-10530-5. [PMID: 38123690 DOI: 10.1007/s00330-023-10530-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 11/08/2023] [Accepted: 12/10/2023] [Indexed: 12/23/2023]
Affiliation(s)
- José Luis Raya-Povedano
- Maimónides Biomedical Research Institute of Córdoba (IMIBIC), Córdoba, Spain.
- Breast Cancer Unit, Department of Diagnostic Radiology, Reina Sofia University Hospital, Menéndez Pidal Avenue s/n, 14004, Córdoba, Spain.
- University of Córdoba, Córdoba, Spain.
| |
Collapse
|
16
|
Xavier D, Miyawaki I, Campello Jorge CA, Freitas Silva GB, Lloyd M, Moraes F, Patel B, Batalini F. Artificial intelligence for triaging of breast cancer screening mammograms and workload reduction: A meta-analysis of a deep learning software. J Med Screen 2023:9691413231219952. [PMID: 38115810 DOI: 10.1177/09691413231219952] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2023]
Abstract
OBJECTIVE Deep learning (DL) has shown promising results for improving mammographic breast cancer diagnosis. However, the impact of artificial intelligence (AI) on the breast cancer screening process has not yet been fully elucidated in terms of potential workload reduction. We aim to assess if AI-based triaging of breast cancer screening mammograms could reduce the radiologist's workload with non-inferior sensitivity. METHODS PubMed, EMBASE, Cochrane Central, and Web of Science databases were systematically searched for studies that evaluated AI algorithms on computer-aided triage of breast cancer screening mammograms. We extracted data from homogenous studies and performed a proportion meta-analysis with a random-effects model to examine the radiologist's workload reduction (proportion of low-risk mammograms that could be theoretically ruled out from human's assessment) and the software's sensitivity to breast cancer detection. RESULTS Thirteen studies were selected for full review, and three studies that used the same commercially available DL algorithm were included in the meta-analysis. In the 156,852 examinations included, the threshold of 7 was identified as optimal. With these parameters, radiologist workload decreased by 68.3% (95%CI 0.655-0.711, I² = 98.76%, p < 0.001), while achieving a sensitivity of 93.1% (95%CI 0.882-0.979, I² = 83.86%, p = 0.002) and a specificity of 68.7% (95% CI 0.684-0.723, I² = 97.5%, p < 0.01). CONCLUSIONS The deployment of DL computer-aided triage of breast cancer screening mammograms reduces the radiology workload while maintaining high sensitivity. Although the implementation of AI remains complex and heterogeneous, it is a promising tool to optimize healthcare resources.
Collapse
Affiliation(s)
| | | | | | | | - Maxwell Lloyd
- Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Fabio Moraes
- Department of Oncology, Queen's University, Kingston, ON, Canada
| | | | | |
Collapse
|
17
|
Elías-Cabot E, Romero-Martín S, Raya-Povedano JL, Brehl AK, Álvarez-Benito M. Impact of real-life use of artificial intelligence as support for human reading in a population-based breast cancer screening program with mammography and tomosynthesis. Eur Radiol 2023:10.1007/s00330-023-10426-4. [PMID: 37975920 DOI: 10.1007/s00330-023-10426-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 08/11/2023] [Accepted: 10/01/2023] [Indexed: 11/19/2023]
Abstract
OBJECTIVES To evaluate the impact of using an artificial intelligence (AI) system as support for human double reading in a real-life scenario of a breast cancer screening program with digital mammography (DM) or digital breast tomosynthesis (DBT). MATERIAL AND METHODS We analyzed the performance of double reading screening with mammography and tomosynthesis after implementarion of AI as decision support. The study group consisted of a consecutive cohort of 1 year screening between March 2021 and March 2022 where double reading was performed with concurrent AI support that automatically detects and highlights lesions suspicious of breast cancer in mammography and tomosynthesis. Screening performance was measured as cancer detection rate (CDR), recall rate (RR), and positive predictive value (PPV) of recalls. Performance in the study group was compared using a McNemar test to a control group that included a screening cohort of the same size, recorded just prior to the implementation of AI. RESULTS A total of 11,998 women (mean age 57.59 years ± 5.8 [sd]) were included in the study group (5049 DM and 6949 DBT). Comparing global results (including DM and DBT) of double reading with vs. without AI support, we observed an increase in CDR, PPV, and RR by 3.2/‰ (5.8 vs. 9; p < 0.001), 4% (10.6 vs. 14.6; p < 0.001), and 0.7% (5.4 vs. 6.1; p < 0.001) respectively. CONCLUSION AI used as support for human double reading in a real-life breast cancer screening program with DM and DBT increases CDR and PPV of the recalled women. CLINICAL RELEVANCE STATEMENT Artificial intelligence as support for human double reading improves accuracy in a real-life breast cancer screening program both in digital mammography and digital breast tomosynthesis. KEY POINTS • AI systems based on deep learning technology offer potential for improving breast cancer screening programs. • Using artificial intelligence as support for reading improves radiologists' performance in breast cancer screening programs with mammography or tomosynthesis. • Artificial intelligence used concurrently with human reading in clinical screening practice increases breast cancer detection rate and positive predictive value of the recalled women.
Collapse
Affiliation(s)
- Esperanza Elías-Cabot
- Maimónides Biomedical Research Institute of Córdoba (IMIBIC), Córdoba, Spain.
- Breast Cancer Unit, Department of Diagnostic Radiology, Reina Sofía University Hospital, Menéndez Pidal Avenue s/n, 14004, Córdoba, Spain.
- University of Córdoba, Córdoba, Spain.
| | - Sara Romero-Martín
- Maimónides Biomedical Research Institute of Córdoba (IMIBIC), Córdoba, Spain
- Breast Cancer Unit, Department of Diagnostic Radiology, Reina Sofía University Hospital, Menéndez Pidal Avenue s/n, 14004, Córdoba, Spain
- University of Córdoba, Córdoba, Spain
| | - José Luis Raya-Povedano
- Maimónides Biomedical Research Institute of Córdoba (IMIBIC), Córdoba, Spain
- Breast Cancer Unit, Department of Diagnostic Radiology, Reina Sofía University Hospital, Menéndez Pidal Avenue s/n, 14004, Córdoba, Spain
- University of Córdoba, Córdoba, Spain
| | - A-K Brehl
- ScreenPoint Medical BV, Toernooiveld 300, 6525 EC, Nijmegen, The Netherlands
| | - Marina Álvarez-Benito
- Maimónides Biomedical Research Institute of Córdoba (IMIBIC), Córdoba, Spain
- Breast Cancer Unit, Department of Diagnostic Radiology, Reina Sofía University Hospital, Menéndez Pidal Avenue s/n, 14004, Córdoba, Spain
- University of Córdoba, Córdoba, Spain
| |
Collapse
|
18
|
Álvarez Sánchez-Bayuela D, Giovanetti González R, Aguilar Angulo PM, Cruz Hernández LM, Sánchez-Camacho González-Carrato MDP, Rodríguez Sánchez A, Tiberi G, Romero Castellano C. Integrating clinical research in an operative screening and diagnostic breast imaging department: First experience, results and perspectives using microwave imaging. Heliyon 2023; 9:e21904. [PMID: 38027895 PMCID: PMC10661199 DOI: 10.1016/j.heliyon.2023.e21904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/30/2023] [Accepted: 10/31/2023] [Indexed: 12/01/2023] Open
Abstract
Rationale and objectives Clinical research is crucial for evaluating new medical procedures and devices. It is important for healthcare units and hospitals to minimize the disruptions caused by conducting clinical studies; however, complex clinical pathways require dedicated recruitment and study designs.This work presents the effective introduction of novel microwave breast imaging (MBI), via MammoWave apparatus, into the clinical routine of an operative screening and diagnostic breast imaging department for conducting a multicentric clinical study. Materials and methods Microwave breast imaging, using MammoWave apparatus, was performed on volunteers coming from different clinical pathways. Clinical data, comprising demographics and conventional radiologic reports (used as reference standard), was collected; a satisfaction questionnaire was filled by every volunteer. Microwave images were analyzed by an automatic clinical decision support system, which quantified their corresponding features to discriminate between breasts with no relevant radiological findings (NF) and breasts with described findings (WF). Results Conventional breast imaging (DBT, US, MRI) and MBI were performed and adapted to assure best clinical practices and optimum pathways. 180 volunteers, both symptomatic and asymptomatic, were enrolled in the study. After microwave images' quality assessment, 48 NF (15 dense) and 169 WF (88 dense) breasts were used for the prospective study; 48 (18 dense) breasts suffered from a histology-confirmed carcinoma. An overall sensitivity of 85.8 % in breasts lesions' detection was achieved by the microwave imaging apparatus. Conclusion An optimum recruitment strategy was implemented to assess MBI. Future trials may show the clinical usefulness of microwave imaging, which may play an important role in breast screening.
Collapse
Affiliation(s)
- Daniel Álvarez Sánchez-Bayuela
- Breast Imaging Department, Radiology Service, Complejo Hospitalario Universitario de Toledo, 45007, Toledo, Spain
- Faculty of Chemical Science and Technology, Instituto Regional de Investigación Científica Aplicada, University of Castilla, La Mancha, 13001, Ciudad Real, Spain
| | - Rubén Giovanetti González
- Breast Imaging Department, Radiology Service, Complejo Hospitalario Universitario de Toledo, 45007, Toledo, Spain
| | - Paul Martín Aguilar Angulo
- Breast Imaging Department, Radiology Service, Complejo Hospitalario Universitario de Toledo, 45007, Toledo, Spain
| | - Lina Marcela Cruz Hernández
- Breast Imaging Department, Radiology Service, Complejo Hospitalario Universitario de Toledo, 45007, Toledo, Spain
| | | | - Ana Rodríguez Sánchez
- Breast Imaging Department, Radiology Service, Complejo Hospitalario Universitario de Toledo, 45007, Toledo, Spain
| | - Gianluigi Tiberi
- UBT—Umbria Bioengineering Technologies, 06081, Perugia, Italy
- School of Engineering, London South Bank University, London, SE1 0AA, United Kingdom
| | - Cristina Romero Castellano
- Breast Imaging Department, Radiology Service, Complejo Hospitalario Universitario de Toledo, 45007, Toledo, Spain
| |
Collapse
|
19
|
Hickman SE, Payne NR, Black RT, Huang Y, Priest AN, Hudson S, Kasmai B, Juette A, Nanaa M, Aniq MI, Sienko A, Gilbert FJ. Mammography Breast Cancer Screening Triage Using Deep Learning: A UK Retrospective Study. Radiology 2023; 309:e231173. [PMID: 37987665 DOI: 10.1148/radiol.231173] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
Background Breast screening enables early detection of cancers; however, most women have normal mammograms, resulting in repetitive and resource-intensive reading tasks. Purpose To investigate if deep learning (DL) algorithms can be used to triage mammograms by identifying normal results to reduce workload or flag cancers that may be overlooked. Materials and Methods In this retrospective study, three commercial DL algorithms were investigated using consecutive mammograms from two UK Breast Screening Program sites from January 2015 to December 2017 and January 2017 to December 2018 on devices from two mammography vendors. Normal mammograms with a 3-year follow-up and histopathologically proven cancer detected at screening, the subsequent round, or in the 3-year interval were included. Two algorithm thresholds were set: in scenario A, 99.0% sensitivity for rule-out triage to a lone reader, and in scenario B, approximately 1.0% additional recall providing a rule-in triage for further assessment. Both thresholds were then applied to the screening workflow in scenario C. The sensitivity and specificity were used to assess the overall predictive performance of each DL algorithm. Results The data set comprised 78 849 patients (median age, 59 years [IQR, 53-63 years]) and 887 screening-detected, 439 interval, and 688 subsequent screening round-detected cancers. In scenario A (rule-out triage), models DL-1, DL-2, and DL-3 triaged 35.0% (27 565 of 78 849), 53.2% (41 937 of 78 849), and 55.6% (43 869 of 78 849) of mammograms, respectively, with 0.0% (0 of 887) to 0.1% (one of 887) of screening-detected cancers undetected. In scenario B, DL algorithms triaged in 4.6% (20 of 439) to 8.2% (36 of 439) of interval and 5.2% (36 of 688) to 6.1% (42 of 688) of subsequent-round cancers when applied after the routine double-reading workflow. Combining both approaches in scenario C resulted in an overall noninferior specificity (difference, -0.9%; P < .001) and superior sensitivity (difference, 2.7%; P < .001) for the adaptive workflow compared with routine double reading for all three algorithms. Conclusion Rule-out and rule-in DL-adapted triage workflows can improve the efficiency and efficacy of mammography breast cancer screening. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Nishikawa and Lu in this issue.
Collapse
Affiliation(s)
- Sarah E Hickman
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Nicholas R Payne
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Richard T Black
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Yuan Huang
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Andrew N Priest
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Sue Hudson
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Bahman Kasmai
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Arne Juette
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Muzna Nanaa
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Muhammad Iqbal Aniq
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Anna Sienko
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| | - Fiona J Gilbert
- From the Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, UK (S.E.H., N.R.P., Y.H., A.N.P., M.N., F.J.G.); University of Cambridge School of Clinical Medicine, Cambridge, UK (M.I.A, A.S.); Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, London, UK (S.E.H.); Department of Radiology, Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK (R.T.B., A.N.P., F.J.G.); EPSRC Cambridge Mathematics of Information in Healthcare Hub, University of Cambridge, Cambridge, UK (Y.H.); Peel & Schriek Consulting, London, UK (S.H.); Department of Radiology, Norfolk and Norwich University Hospital, Norwich, UK (B.K., A.J.); and University of East Anglia, Norwich Research Park, Norwich, UK (B.K.)
| |
Collapse
|
20
|
Patel K, Huang S, Rashid A, Varghese B, Gholamrezanezhad A. A Narrative Review of the Use of Artificial Intelligence in Breast, Lung, and Prostate Cancer. Life (Basel) 2023; 13:2011. [PMID: 37895393 PMCID: PMC10608739 DOI: 10.3390/life13102011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Revised: 09/30/2023] [Accepted: 09/30/2023] [Indexed: 10/29/2023] Open
Abstract
Artificial intelligence (AI) has been an important topic within radiology. Currently, AI is used clinically to assist with the detection of lesions through detection systems. However, a number of recent studies have demonstrated the increased value of neural networks in radiology. With an increasing number of screening requirements for cancers, this review aims to study the accuracy of the numerous AI models used in the detection and diagnosis of breast, lung, and prostate cancers. This study summarizes pertinent findings from reviewed articles and provides analysis on the relevancy to clinical radiology. This study found that whereas AI is showing continual improvement in radiology, AI alone does not surpass the effectiveness of a radiologist. Additionally, it was found that there are multiple variations on how AI should be integrated with a radiologist's workflow.
Collapse
Affiliation(s)
- Kishan Patel
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA (A.G.)
| | - Sherry Huang
- Department of Urology, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Arnav Rashid
- Department of Biological Sciences, Dana and David Dornsife College of Letters, Arts and Sciences, University of Southern California, Los Angeles, CA 90089, USA
| | - Bino Varghese
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA (A.G.)
| | - Ali Gholamrezanezhad
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA (A.G.)
| |
Collapse
|
21
|
Houssami N, Marinovich ML. AI for mammography screening: enter evidence from prospective trials. Lancet Digit Health 2023; 5:e641-e642. [PMID: 37690910 DOI: 10.1016/s2589-7500(23)00176-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 08/17/2023] [Indexed: 09/12/2023]
Affiliation(s)
- Nehmat Houssami
- The Daffodil Centre, the University of Sydney, a joint venture with Cancer Council NSW, Sydney, NSW, Australia; School of Public Health, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia.
| | - M Luke Marinovich
- The Daffodil Centre, the University of Sydney, a joint venture with Cancer Council NSW, Sydney, NSW, Australia; School of Public Health, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
22
|
Martiniussen MA, Larsen M, Larsen ASF, Hovda T, Koch HW, Bjørnerud A, Hofvind S. Norwegian radiologists' expectations of artificial intelligence in mammographic screening - A cross-sectional survey. Eur J Radiol 2023; 167:111061. [PMID: 37657381 DOI: 10.1016/j.ejrad.2023.111061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 08/13/2023] [Accepted: 08/22/2023] [Indexed: 09/03/2023]
Abstract
PURPOSE To explore Norwegian breast radiologists' expectations of adding artificial intelligence (AI) in the interpretation procedure of screening mammograms. METHODS All breast radiologists involved in interpretation of screening mammograms in BreastScreen Norway during 2021 and 2022 (n = 98) were invited to take part in this anonymous cross-sectional survey about use of AI in mammographic screening. The questionnaire included background information of the respondents, their expectations, considerations of biases, and ethical and social implications of implementing AI in screen reading. Data was collected digitally and analyzed using descriptive statistics. RESULTS The response rate was 61% (60/98), and 67% (40/60) of the respondents were women. Sixty percent (36/60) reported ≥10 years' experience in screen reading, while 82% (49/60) reported no or limited experience with AI in health care. Eighty-two percent of the respondents were positive to explore AI in the interpretation procedure in mammographic screening. When used as decision support, 68% (41/60) expected AI to increase the radiologists' sensitivity for cancer detection. As potential challenges, 55% (33/60) reported lack of trust in the AI system and 45% (27/60) reported discrepancy between radiologists and AI systems as possible challenges. The risk of automation bias was considered high among 47% (28/60). Reduced time spent reading mammograms was rated as a potential benefit by 70% (42/60). CONCLUSION The radiologists reported positive expectations of AI in the interpretation procedure of screening mammograms. Efforts to minimize the risk of automation bias and increase trust in the AI systems are important before and during future implementation of the tool.
Collapse
Affiliation(s)
- Marit A Martiniussen
- Department of Radiology, Østfold Hospital Trust, Kalnes, Norway; University of Oslo, Institute of Clinical Medicine, Oslo, Norway
| | - Marthe Larsen
- Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway
| | | | - Tone Hovda
- Department of Radiology, Vestre Viken Hospital Trust, Drammen, Norway
| | - Henrik W Koch
- Department of Radiology, Stavanger University Hospital, Stavanger, Norway; Faculty of Health Sciences, University of Stavanger, Stavanger, Norway
| | - Atle Bjørnerud
- Computational Radiology & Artificial Intelligence (CRAI) Unit, Division of Radiology and Nuclear Medicine, Oslo University Hospital, Oslo, Norway; Department of Physics, Faculty of Mathematics and Natural Sciences, University of Oslo, Oslo, Norway
| | - Solveig Hofvind
- Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway; Department of Health and Care Sciences, UiT, The Artic University of Norway, Tromsø, Norway.
| |
Collapse
|
23
|
El Naqa I, Karolak A, Luo Y, Folio L, Tarhini AA, Rollison D, Parodi K. Translation of AI into oncology clinical practice. Oncogene 2023; 42:3089-3097. [PMID: 37684407 DOI: 10.1038/s41388-023-02826-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 08/23/2023] [Accepted: 08/25/2023] [Indexed: 09/10/2023]
Abstract
Artificial intelligence (AI) is a transformative technology that is capturing popular imagination and can revolutionize biomedicine. AI and machine learning (ML) algorithms have the potential to break through existing barriers in oncology research and practice such as automating workflow processes, personalizing care, and reducing healthcare disparities. Emerging applications of AI/ML in the literature include screening and early detection of cancer, disease diagnosis, response prediction, prognosis, and accelerated drug discovery. Despite this excitement, only few AI/ML models have been properly validated and fewer have become regulated products for routine clinical use. In this review, we highlight the main challenges impeding AI/ML clinical translation. We present different clinical use cases from the domains of radiology, radiation oncology, immunotherapy, and drug discovery in oncology. We dissect the unique challenges and opportunities associated with each of these cases. Finally, we summarize the general requirements for successful AI/ML implementation in the clinic, highlighting specific examples and points of emphasis including the importance of multidisciplinary collaboration of stakeholders, role of domain experts in AI augmentation, transparency of AI/ML models, and the establishment of a comprehensive quality assurance program to mitigate risks of training bias and data drifts, all culminating toward safer and more beneficial AI/ML applications in oncology labs and clinics.
Collapse
Affiliation(s)
- Issam El Naqa
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA.
| | - Aleksandra Karolak
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Yi Luo
- Department of Machine Learning, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Les Folio
- Diagnostic Imaging & Interventional Radiology, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Ahmad A Tarhini
- Cutaneous Oncology and Immunology, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Dana Rollison
- Department of Cancer Epidemiology, Moffitt Cancer Center, Tampa, FL, 33612, USA
| | - Katia Parodi
- Department of Medical Physics, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
24
|
Dembrower K, Crippa A, Colón E, Eklund M, Strand F. Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study. Lancet Digit Health 2023; 5:e703-e711. [PMID: 37690911 DOI: 10.1016/s2589-7500(23)00153-x] [Citation(s) in RCA: 38] [Impact Index Per Article: 38.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 06/21/2023] [Accepted: 07/28/2023] [Indexed: 09/12/2023]
Abstract
BACKGROUND Artificial intelligence (AI) as an independent reader of screening mammograms has shown promise, but there are few prospective studies. Our aim was to conduct a prospective clinical trial to examine how AI affects cancer detection and false positive findings in a real-world setting. METHODS ScreenTrustCAD was a prospective, population-based, paired-reader, non-inferiority study done at the Capio Sankt Göran Hospital in Stockholm, Sweden. Consecutive women without breast implants aged 40-74 years participating in population-based screening in the geographical uptake area of the study hospital were included. The primary outcome was screen-detected breast cancer within 3 months of mammography, and the primary analysis was to assess non-inferiority (non-inferiority margin of 0·15 relative reduction in breast cancer diagnoses) of double reading by one radiologist plus AI compared with standard-of-care double reading by two radiologists. We also assessed single reading by AI alone and triple reading by two radiologists plus AI compared with standard-of-care double reading by two radiologists. This study is registered with ClinicalTrials.gov, NCT04778670. FINDINGS From April 1, 2021, to June 9, 2022, 58 344 women aged 40-74 years underwent regular mammography screening, of whom 55 581 were included in the study. 269 (0·5%) women were diagnosed with screen-detected breast cancer based on an initial positive read: double reading by one radiologist plus AI was non-inferior for cancer detection compared with double reading by two radiologists (261 [0·5%] vs 250 [0·4%] detected cases; relative proportion 1·04 [95% CI 1·00-1·09]). Single reading by AI (246 [0·4%] vs 250 [0·4%] detected cases; relative proportion 0·98 [0·93-1·04]) and triple reading by two radiologists plus AI (269 [0·5%] vs 250 [0·4%] detected cases; relative proportion 1·08 [1·04-1·11]) were also non-inferior to double reading by two radiologists. INTERPRETATION Replacing one radiologist with AI for independent reading of screening mammograms resulted in a 4% higher non-inferior cancer detection rate compared with radiologist double reading. Our study suggests that AI in the study setting has potential for controlled implementation, which would include risk management and real-world follow-up of performance. FUNDING Swedish Research Council, Swedish Cancer Society, Region Stockholm, and Lunit.
Collapse
Affiliation(s)
- Karin Dembrower
- Breast Imaging Unit, Department of Radiology, Capio Sankt Göran Hospital, Sankt Göransplan, Stockholm, Sweden; Department of Oncology-Pathology, Karolinska Institutet, Stockholm, Sweden.
| | - Alessio Crippa
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Eugenia Colón
- Department of Pathology, Unilabs, Capio Sankt Göran Hospital, Sankt Göransplan, Stockholm, Sweden
| | - Martin Eklund
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Fredrik Strand
- Department of Oncology-Pathology, Karolinska Institutet, Stockholm, Sweden; Breast Radiology Unit, Medical Diagnostics Karolinska, Karolinska University Hospital, Stockholm, Sweden
| |
Collapse
|
25
|
van Nijnatten TJA, Payne NR, Hickman SE, Ashrafian H, Gilbert FJ. Overview of trials on artificial intelligence algorithms in breast cancer screening - A roadmap for international evaluation and implementation. Eur J Radiol 2023; 167:111087. [PMID: 37690352 DOI: 10.1016/j.ejrad.2023.111087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 08/23/2023] [Accepted: 09/04/2023] [Indexed: 09/12/2023]
Abstract
Accumulating evidence from retrospective studies demonstrate at least non-inferior performance when using AI algorithms with different strategies versus double-reading in mammography screening. In addition, AI algorithms for mammography screening can reduce work load by moving to single human reading. Prospective trials are essential to avoid unintended adverse consequences before incorporation of AI algorithms into UK's National Health Service (NHS) Breast Screening Programme (BSP). A stakeholders' meeting was organized in Newnham College, Cambridge, UK to undertake a review of the current evidence to enable consensus discussion on next steps required before implementation into a screening programme. It was concluded that a multicentre multivendor testing platform study with opt-out consent is preferred. AI thresholds from different vendors should be determined while maintaining non-inferior screening performance results, particularly ensuring recall rates are not increased. Automatic recall of cases using an agreed high sensitivity AI score versus automatic rule out with a low AI score set at a high sensitivity could be used. A human reader should still be involved in decision making with AI-only recalls requiring human arbitration. Standalone AI algorithms used without prompting maintain unbiased screening reading performance, but reading with prompts should be tested prospectively and ideally provided for arbitration.
Collapse
Affiliation(s)
- T J A van Nijnatten
- Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, United Kingdom; Department of Radiology and Nuclear Medicine, Maastricht University Medical Center+, Maastricht, the Netherlands; GROW - School for Oncology and Reproduction, Maastricht University Medical Center+, Maastricht, the Netherlands
| | - N R Payne
- Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, United Kingdom
| | - S E Hickman
- Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, United Kingdom; Department of Radiology, Barts Health NHS Trust, The Royal London Hospital, 80 Newark Street, London E1 2ES, United Kingdom
| | - H Ashrafian
- Institute of Global Health Innovation, Department of Surgery and Cancer, Imperial College London, St Mary's Hospital, London, United Kingdom
| | - F J Gilbert
- Department of Radiology, University of Cambridge School of Clinical Medicine, Box 218, Level 5, Cambridge Biomedical Campus, Cambridge CB2 0QQ, United Kingdom; Cambridge University Hospitals NHS Foundation Trust, Hills Road, Cambridge CB2 0QQ, United Kingdom.
| |
Collapse
|
26
|
Larsen M, Olstad CF, Koch HW, Martiniussen MA, Hoff SR, Lund-Hanssen H, Solli HS, Mikalsen KØ, Auensen S, Nygård J, Lång K, Chen Y, Hofvind S. AI Risk Score on Screening Mammograms Preceding Breast Cancer Diagnosis. Radiology 2023; 309:e230989. [PMID: 37847135 DOI: 10.1148/radiol.230989] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2023]
Abstract
Background Few studies have evaluated the role of artificial intelligence (AI) in prior screening mammography. Purpose To examine AI risk scores assigned to screening mammography in women who were later diagnosed with breast cancer. Materials and Methods Image data and screening information of examinations performed from January 2004 to December 2019 as part of BreastScreen Norway were used in this retrospective study. Prior screening examinations from women who were later diagnosed with cancer were assigned an AI risk score by a commercially available AI system (scores of 1-7, low risk of malignancy; 8-9, intermediate risk; and 10, high risk of malignancy). Mammographic features of the cancers based on the AI score were also assessed. The association between AI score and mammographic features was tested with a bivariate test. Results A total of 2787 prior screening examinations from 1602 women (mean age, 59 years ± 5.1 [SD]) with screen-detected (n = 1016) or interval (n = 586) cancers showed an AI risk score of 10 for 389 (38.3%) and 231 (39.4%) cancers, respectively, on the mammograms in the screening round prior to diagnosis. Among the screen-detected cancers with AI scores available two screening rounds (4 years) before diagnosis, 23.0% (122 of 531) had a score of 10. Mammographic features were associated with AI score for invasive screen-detected cancers (P < .001). Density with calcifications was registered for 13.6% (43 of 317) of screen-detected cases with a score of 10 and 4.6% (15 of 322) for those with a score of 1-7. Conclusion More than one in three cases of screen-detected and interval cancers had the highest AI risk score at prior screening, suggesting that the use of AI in mammography screening may lead to earlier detection of breast cancers. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Mehta in this issue.
Collapse
Affiliation(s)
- Marthe Larsen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Camilla F Olstad
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Henrik W Koch
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Marit A Martiniussen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Solveig R Hoff
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Håkon Lund-Hanssen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Helene S Solli
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Karl Øyvind Mikalsen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Steinar Auensen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Jan Nygård
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Kristina Lång
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Yan Chen
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| | - Solveig Hofvind
- From the Section for Breast Cancer Screening (M.L., C.F.O., S.H.) and Department of Register Informatics (S.A., J.N.), Cancer Registry of Norway, P.O. Box 5313, 0304 Oslo, Norway; Department of Radiology, Stavanger University Hospital, Stavanger, Norway (H.W.K.); Faculty of Health Sciences, University of Stavanger, Stavanger, Norway (H.W.K.); Department of Radiology, Østfold Hospital Trust, Kalnes, Norway (M.A.M.); Institute of Clinical Medicine, University of Oslo, Oslo, Norway (M.A.M.); Department of Radiology, Ålesund Hospital, Møre og Romsdal Hospital Trust, Ålesund, Norway (S.R.H.); Department of Circulation and Medical Imaging, Faculty of Medicine and Health Sciences, National University for Science and Technology, Trondheim, Norway (S.R.H.); Department of Radiology and Nuclear Medicine, St Olavs University Hospital, Trondheim, Norway (H.L.H.); Department of Radiology, Hospital of Southern Norway, Kristiansand, Norway (H.S.S.); SPKI-The Norwegian Centre for Clinical Artificial Intelligence, University Hospital of North Norway, Tromsø, Norway (K.Ø.M.); Department of Clinical Medicine (K.Ø.M.) and Health and Care Sciences (S.H.), Faculty of Health Sciences, UiT-The Arctic University of Norway, Tromsø, Norway; Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden (K.L.); Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden (K.L.); School of Medicine, University of Nottingham, Clinical Science Building, Nottingham City Hospital, Nottingham, United Kingdom (Y.C.)
| |
Collapse
|
27
|
Chen Y, Taib AG, Darker IT, James JJ. Performance of a Breast Cancer Detection AI Algorithm Using the Personal Performance in Mammographic Screening Scheme. Radiology 2023; 308:e223299. [PMID: 37668522 DOI: 10.1148/radiol.223299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
Background The Personal Performance in Mammographic Screening (PERFORMS) scheme is used to assess reader performance. Whether this scheme can assess the performance of artificial intelligence (AI) algorithms is unknown. Purpose To compare the performance of human readers and a commercially available AI algorithm interpreting PERFORMS test sets. Materials and Methods In this retrospective study, two PERFORMS test sets, each consisting of 60 challenging cases, were evaluated by human readers between May 2018 and March 2021 and were evaluated by an AI algorithm in 2022. AI considered each breast separately, assigning a suspicion of malignancy score to features detected. Performance was assessed using the highest score per breast. Performance metrics, including sensitivity, specificity, and area under the receiver operating characteristic curve (AUC), were calculated for AI and humans. The study was powered to detect a medium-sized effect (odds ratio, 3.5 or 0.29) for sensitivity. Results A total of 552 human readers interpreted both PERFORMS test sets, consisting of 161 normal breasts, 70 malignant breasts, and nine benign breasts. No difference was observed at the breast level between the AUC for AI and the AUC for human readers (0.93% and 0.88%, respectively; P = .15). When using the developer's suggested recall score threshold, no difference was observed for AI versus human reader sensitivity (84% and 90%, respectively; P = .34), but the specificity of AI was higher (89%) than that of the human readers (76%, P = .003). However, it was not possible to demonstrate equivalence due to the size of the test sets. When using recall thresholds to match mean human reader performance (90% sensitivity, 76% specificity), AI showed no differences inperformance, with a sensitivity of 91% (P =. 73) and a specificity of 77% (P = .85). Conclusion Diagnostic performance of AI was comparable with that of the average human reader when evaluating cases from two enriched test sets from the PERFORMS scheme. © RSNA, 2023 See also the editorial by Philpotts in this issue.
Collapse
Affiliation(s)
- Yan Chen
- From the Department of Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, Nottingham City Hospital, City Hospital Campus, Hucknall Rd, Nottingham NG5 1PB, United Kingdom (Y.C., A.G.T., I.T.D.); and Nottingham Breast Institute, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom (J.J.J.)
| | - Adnan G Taib
- From the Department of Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, Nottingham City Hospital, City Hospital Campus, Hucknall Rd, Nottingham NG5 1PB, United Kingdom (Y.C., A.G.T., I.T.D.); and Nottingham Breast Institute, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom (J.J.J.)
| | - Iain T Darker
- From the Department of Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, Nottingham City Hospital, City Hospital Campus, Hucknall Rd, Nottingham NG5 1PB, United Kingdom (Y.C., A.G.T., I.T.D.); and Nottingham Breast Institute, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom (J.J.J.)
| | - Jonathan J James
- From the Department of Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, Nottingham City Hospital, City Hospital Campus, Hucknall Rd, Nottingham NG5 1PB, United Kingdom (Y.C., A.G.T., I.T.D.); and Nottingham Breast Institute, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom (J.J.J.)
| |
Collapse
|
28
|
Lång K, Josefsson V, Larsson AM, Larsson S, Högberg C, Sartor H, Hofvind S, Andersson I, Rosso A. Artificial intelligence-supported screen reading versus standard double reading in the Mammography Screening with Artificial Intelligence trial (MASAI): a clinical safety analysis of a randomised, controlled, non-inferiority, single-blinded, screening accuracy study. Lancet Oncol 2023; 24:936-944. [PMID: 37541274 DOI: 10.1016/s1470-2045(23)00298-x] [Citation(s) in RCA: 68] [Impact Index Per Article: 68.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 06/07/2023] [Accepted: 06/21/2023] [Indexed: 08/06/2023]
Abstract
BACKGROUND Retrospective studies have shown promising results using artificial intelligence (AI) to improve mammography screening accuracy and reduce screen-reading workload; however, to our knowledge, a randomised trial has not yet been conducted. We aimed to assess the clinical safety of an AI-supported screen-reading protocol compared with standard screen reading by radiologists following mammography. METHODS In this randomised, controlled, population-based trial, women aged 40-80 years eligible for mammography screening (including general screening with 1·5-2-year intervals and annual screening for those with moderate hereditary risk of breast cancer or a history of breast cancer) at four screening sites in Sweden were informed about the study as part of the screening invitation. Those who did not opt out were randomly allocated (1:1) to AI-supported screening (intervention group) or standard double reading without AI (control group). Screening examinations were automatically randomised by the Picture Archive and Communications System with a pseudo-random number generator after image acquisition. The participants and the radiographers acquiring the screening examinations, but not the radiologists reading the screening examinations, were masked to study group allocation. The AI system (Transpara version 1.7.0) provided an examination-based malignancy risk score on a 10-level scale that was used to triage screening examinations to single reading (score 1-9) or double reading (score 10), with AI risk scores (for all examinations) and computer-aided detection marks (for examinations with risk score 8-10) available to the radiologists doing the screen reading. Here we report the prespecified clinical safety analysis, to be done after 80 000 women were enrolled, to assess the secondary outcome measures of early screening performance (cancer detection rate, recall rate, false positive rate, positive predictive value [PPV] of recall, and type of cancer detected [invasive or in situ]) and screen-reading workload. Analyses were done in the modified intention-to-treat population (ie, all women randomly assigned to a group with one complete screening examination, excluding women recalled due to enlarged lymph nodes diagnosed with lymphoma). The lowest acceptable limit for safety in the intervention group was a cancer detection rate of more than 3 per 1000 participants screened. The trial is registered with ClinicalTrials.gov, NCT04838756, and is closed to accrual; follow-up is ongoing to assess the primary endpoint of the trial, interval cancer rate. FINDINGS Between April 12, 2021, and July 28, 2022, 80 033 women were randomly assigned to AI-supported screening (n=40 003) or double reading without AI (n=40 030). 13 women were excluded from the analysis. The median age was 54·0 years (IQR 46·7-63·9). Race and ethnicity data were not collected. AI-supported screening among 39 996 participants resulted in 244 screen-detected cancers, 861 recalls, and a total of 46 345 screen readings. Standard screening among 40 024 participants resulted in 203 screen-detected cancers, 817 recalls, and a total of 83 231 screen readings. Cancer detection rates were 6·1 (95% CI 5·4-6·9) per 1000 screened participants in the intervention group, above the lowest acceptable limit for safety, and 5·1 (4·4-5·8) per 1000 in the control group-a ratio of 1·2 (95% CI 1·0-1·5; p=0·052). Recall rates were 2·2% (95% CI 2·0-2·3) in the intervention group and 2·0% (1·9-2·2) in the control group. The false positive rate was 1·5% (95% CI 1·4-1·7) in both groups. The PPV of recall was 28·3% (95% CI 25·3-31·5) in the intervention group and 24·8% (21·9-28·0) in the control group. In the intervention group, 184 (75%) of 244 cancers detected were invasive and 60 (25%) were in situ; in the control group, 165 (81%) of 203 cancers were invasive and 38 (19%) were in situ. The screen-reading workload was reduced by 44·3% using AI. INTERPRETATION AI-supported mammography screening resulted in a similar cancer detection rate compared with standard double reading, with a substantially lower screen-reading workload, indicating that the use of AI in mammography screening is safe. The trial was thus not halted and the primary endpoint of interval cancer rate will be assessed in 100 000 enrolled participants after 2-years of follow up. FUNDING Swedish Cancer Society, Confederation of Regional Cancer Centres, and the Swedish governmental funding for clinical research (ALF).
Collapse
Affiliation(s)
- Kristina Lång
- Division of Diagnostic Radiology, Department of Translational Medicine, Lund University, Malmö, Sweden; Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden.
| | - Viktoria Josefsson
- Division of Diagnostic Radiology, Department of Translational Medicine, Lund University, Malmö, Sweden; Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden
| | - Anna-Maria Larsson
- Division of Oncology, Department of Clinical Sciences, Lund University, Lund, Sweden
| | - Stefan Larsson
- Department of Technology and Society, Lund University, Lund, Sweden
| | | | - Hanna Sartor
- Division of Diagnostic Radiology, Department of Translational Medicine, Lund University, Malmö, Sweden; Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden
| | - Solveig Hofvind
- Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway; Health and Care Sciences, Faculty of Health Sciences, The Arctic University of Norway, Tromsø, Norway
| | - Ingvar Andersson
- Division of Diagnostic Radiology, Department of Translational Medicine, Lund University, Malmö, Sweden; Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden
| | - Aldana Rosso
- Division of Diagnostic Radiology, Department of Translational Medicine, Lund University, Malmö, Sweden
| |
Collapse
|
29
|
Dvijotham KD, Winkens J, Barsbey M, Ghaisas S, Stanforth R, Pawlowski N, Strachan P, Ahmed Z, Azizi S, Bachrach Y, Culp L, Daswani M, Freyberg J, Kelly C, Kiraly A, Kohlberger T, McKinney S, Mustafa B, Natarajan V, Geras K, Witowski J, Qin ZZ, Creswell J, Shetty S, Sieniek M, Spitz T, Corrado G, Kohli P, Cemgil T, Karthikesalingam A. Enhancing the reliability and accuracy of AI-enabled diagnosis via complementarity-driven deferral to clinicians. Nat Med 2023; 29:1814-1820. [PMID: 37460754 DOI: 10.1038/s41591-023-02437-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 06/05/2023] [Indexed: 07/20/2023]
Abstract
Predictive artificial intelligence (AI) systems based on deep learning have been shown to achieve expert-level identification of diseases in multiple medical imaging settings, but can make errors in cases accurately diagnosed by clinicians and vice versa. We developed Complementarity-Driven Deferral to Clinical Workflow (CoDoC), a system that can learn to decide between the opinion of a predictive AI model and a clinical workflow. CoDoC enhances accuracy relative to clinician-only or AI-only baselines in clinical workflows that screen for breast cancer or tuberculosis (TB). For breast cancer screening, compared to double reading with arbitration in a screening program in the UK, CoDoC reduced false positives by 25% at the same false-negative rate, while achieving a 66% reduction in clinician workload. For TB triaging, compared to standalone AI and clinical workflows, CoDoC achieved a 5-15% reduction in false positives at the same false-negative rate for three of five commercially available predictive AI systems. To facilitate the deployment of CoDoC in novel futuristic clinical settings, we present results showing that CoDoC's performance gains are sustained across several axes of variation (imaging modality, clinical setting and predictive AI system) and discuss the limitations of our evaluation and where further validation would be needed. We provide an open-source implementation to encourage further research and application.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | - Laura Culp
- Google DeepMind, Toronto, Ontario, Canada
| | | | | | | | | | | | | | | | | | | | - Jan Witowski
- NYU Grossman School of Medicine, New York, NY, USA
| | | | | | | | | | | | | | | | | | | |
Collapse
|
30
|
Vachon CM, Scott CG, Norman AD, Khanani SA, Jensen MR, Hruska CB, Brandt KR, Winham SJ, Kerlikowske K. Impact of Artificial Intelligence System and Volumetric Density on Risk Prediction of Interval, Screen-Detected, and Advanced Breast Cancer. J Clin Oncol 2023; 41:3172-3183. [PMID: 37104728 PMCID: PMC10256336 DOI: 10.1200/jco.22.01153] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Revised: 12/13/2022] [Accepted: 02/24/2023] [Indexed: 04/29/2023] Open
Abstract
PURPOSE Artificial intelligence (AI) algorithms improve breast cancer detection on mammography, but their contribution to long-term risk prediction for advanced and interval cancers is unknown. METHODS We identified 2,412 women with invasive breast cancer and 4,995 controls matched on age, race, and date of mammogram, from two US mammography cohorts, who had two-dimensional full-field digital mammograms performed 2-5.5 years before cancer diagnosis. We assessed Breast Imaging Reporting and Data System density, an AI malignancy score (1-10), and volumetric density measures. We used conditional logistic regression to estimate odds ratios (ORs), 95% CIs, adjusted for age and BMI, and C-statistics (AUC) to describe the association of AI score with invasive cancer and its contribution to models with breast density measures. Likelihood ratio tests (LRTs) and bootstrapping methods were used to compare model performance. RESULTS On mammograms between 2-5.5 years prior to cancer, a one unit increase in AI score was associated with 20% greater odds of invasive breast cancer (OR, 1.20; 95% CI, 1.17 to 1.22; AUC, 0.63; 95% CI, 0.62 to 0.64) and was similarly predictive of interval (OR, 1.20; 95% CI, 1.13 to 1.27; AUC, 0.63) and advanced cancers (OR, 1.23; 95% CI, 1.16 to 1.31; AUC, 0.64) and in dense (OR, 1.18; 95% CI, 1.15 to 1.22; AUC, 0.66) breasts. AI score improved prediction of all cancer types in models with density measures (PLRT values < .001); discrimination improved for advanced cancer (ie, AUC for dense volume increased from 0.624 to 0.679, Δ AUC 0.065, P = .01) but did not reach statistical significance for interval cancer. CONCLUSION AI imaging algorithms coupled with breast density independently contribute to long-term risk prediction of invasive breast cancers, in particular, advanced cancer.
Collapse
Affiliation(s)
- Celine M. Vachon
- Division of Epidemiology, Department Quantitative Sciences, Mayo Clinic, Rochester, MN
| | - Christopher G. Scott
- Division of Clinical Trials and Biostatistics, Department Quantitative Sciences, Mayo Clinic, Rochester, MN
| | - Aaron D. Norman
- Division of Epidemiology, Department Quantitative Sciences, Mayo Clinic, Rochester, MN
| | - Sadia A. Khanani
- Division of Breast Imaging, Department of Radiology, Mayo Clinic, Rochester, MN
| | - Matthew R. Jensen
- Division of Clinical Trials and Biostatistics, Department Quantitative Sciences, Mayo Clinic, Rochester, MN
| | - Carrie B. Hruska
- Division of Breast Imaging, Department of Radiology, Mayo Clinic, Rochester, MN
| | - Kathleen R. Brandt
- Division of Breast Imaging, Department of Radiology, Mayo Clinic, Rochester, MN
| | - Stacey J. Winham
- Division of Computational Biology, Department Quantitative Sciences, Mayo Clinic, Rochester, MN
| | | |
Collapse
|
31
|
Anaby D, Shavin D, Zimmerman-Moreno G, Nissan N, Friedman E, Sklair-Levy M. 'Earlier than Early' Detection of Breast Cancer in Israeli BRCA Mutation Carriers Applying AI-Based Analysis to Consecutive MRI Scans. Cancers (Basel) 2023; 15:3120. [PMID: 37370730 DOI: 10.3390/cancers15123120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 05/30/2023] [Accepted: 06/02/2023] [Indexed: 06/29/2023] Open
Abstract
Female BRCA1/BRCA2 (=BRCA) pathogenic variants (PVs) carriers are at a substantially higher risk for developing breast cancer (BC) compared with the average risk population. Detection of BC at an early stage significantly improves prognosis. To facilitate early BC detection, a surveillance scheme is offered to BRCA PV carriers from age 25-30 years that includes annual MRI based breast imaging. Indeed, adherence to the recommended scheme has been shown to be associated with earlier disease stages at BC diagnosis, more in-situ pathology, smaller tumors, and less axillary involvement. While MRI is the most sensitive modality for BC detection in BRCA PV carriers, there are a significant number of overlooked or misinterpreted radiological lesions (mostly enhancing foci), leading to a delayed BC diagnosis at a more advanced stage. In this study we developed an artificial intelligence (AI)-network, aimed at a more accurate classification of enhancing foci, in MRIs of BRCA PV carriers, thus reducing false-negative interpretations. Retrospectively identified foci in prior MRIs that were either diagnosed as BC or benign/normal in a subsequent MRI were manually segmented and served as input for a convolutional network architecture. The model was successful in classification of 65% of the cancerous foci, most of them triple-negative BC. If validated, applying this scheme routinely may facilitate 'earlier than early' BC diagnosis in BRCA PV carriers.
Collapse
Affiliation(s)
- Debbie Anaby
- Department of Diagnostic Imaging, Sheba Medical Center, Ramat Gan 52621, Israel
- Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv 6910201, Israel
| | - David Shavin
- Department of Diagnostic Imaging, Sheba Medical Center, Ramat Gan 52621, Israel
| | | | - Noam Nissan
- Department of Diagnostic Imaging, Sheba Medical Center, Ramat Gan 52621, Israel
- Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv 6910201, Israel
| | - Eitan Friedman
- Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv 6910201, Israel
- Meirav High Risk Center, Sheba Medical Center, Ramat Gan 52621, Israel
| | - Miri Sklair-Levy
- Department of Diagnostic Imaging, Sheba Medical Center, Ramat Gan 52621, Israel
- Sackler Faculty of Medicine, Tel-Aviv University, Tel-Aviv 6910201, Israel
- Meirav High Risk Center, Sheba Medical Center, Ramat Gan 52621, Israel
| |
Collapse
|
32
|
Zhang M, Mesurolle B, Theriault M, Meterissian S, Morris EA. Imaging of breast cancer-beyond the basics. Curr Probl Cancer 2023:100967. [PMID: 37316336 DOI: 10.1016/j.currproblcancer.2023.100967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 04/12/2023] [Accepted: 05/20/2023] [Indexed: 06/16/2023]
Abstract
Imaging of breast cancer is the backbone of breast cancer screening, diagnosis, preoperative/treatment assessment and follow-up. The main modalities are mammography, ultrasound and magnetic resonance imaging, each with its own advantages and disadvantages. New emerging technologies have also enabled each modality to improve on their weaknesses. Imaging-guided biopsies have allowed for accurate diagnosis of breast cancer, with low complication rates. The purpose of this article is to review the common modalities for breast cancer imaging in current practice with emphasis on the strengths and potential weaknesses, discuss the selection of the best imaging modality for the specific clinical question or patient population, and explore new technologies / future directions of breast cancer imaging.
Collapse
Affiliation(s)
- Michelle Zhang
- Department of Radiology, McGill University Health Center, Montreal, Quebec, Canada.
| | - Benoit Mesurolle
- Department of Radiology, Elsan, Pôle Santé République, Clermont-Ferrand, France
| | - Melanie Theriault
- Department of Radiology, McGill University Health Center, Montreal, Quebec, Canada
| | - Sarkis Meterissian
- Department of Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | | |
Collapse
|
33
|
Yoon JH, Strand F, Baltzer PAT, Conant EF, Gilbert FJ, Lehman CD, Morris EA, Mullen LA, Nishikawa RM, Sharma N, Vejborg I, Moy L, Mann RM. Standalone AI for Breast Cancer Detection at Screening Digital Mammography and Digital Breast Tomosynthesis: A Systematic Review and Meta-Analysis. Radiology 2023; 307:e222639. [PMID: 37219445 PMCID: PMC10315526 DOI: 10.1148/radiol.222639] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Revised: 03/23/2023] [Accepted: 04/03/2023] [Indexed: 05/24/2023]
Abstract
Background There is considerable interest in the potential use of artificial intelligence (AI) systems in mammographic screening. However, it is essential to critically evaluate the performance of AI before it can become a modality used for independent mammographic interpretation. Purpose To evaluate the reported standalone performances of AI for interpretation of digital mammography and digital breast tomosynthesis (DBT). Materials and Methods A systematic search was conducted in PubMed, Google Scholar, Embase (Ovid), and Web of Science databases for studies published from January 2017 to June 2022. Sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) values were reviewed. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 and Comparative (QUADAS-2 and QUADAS-C, respectively). A random effects meta-analysis and meta-regression analysis were performed for overall studies and for different study types (reader studies vs historic cohort studies) and imaging techniques (digital mammography vs DBT). Results In total, 16 studies that include 1 108 328 examinations in 497 091 women were analyzed (six reader studies, seven historic cohort studies on digital mammography, and four studies on DBT). Pooled AUCs were significantly higher for standalone AI than radiologists in the six reader studies on digital mammography (0.87 vs 0.81, P = .002), but not for historic cohort studies (0.89 vs 0.96, P = .152). Four studies on DBT showed significantly higher AUCs in AI compared with radiologists (0.90 vs 0.79, P < .001). Higher sensitivity and lower specificity were seen for standalone AI compared with radiologists. Conclusion Standalone AI for screening digital mammography performed as well as or better than radiologists. Compared with digital mammography, there is an insufficient number of studies to assess the performance of AI systems in the interpretation of DBT screening examinations. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Scaranelo in this issue.
Collapse
Affiliation(s)
- Jung Hyun Yoon
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Fredrik Strand
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Pascal A. T. Baltzer
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Emily F. Conant
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Fiona J. Gilbert
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Constance D. Lehman
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Elizabeth A. Morris
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Lisa A. Mullen
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Robert M. Nishikawa
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Nisha Sharma
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | - Ilse Vejborg
- From the Department of Radiology, Severance Hospital, Research
Institute of Radiological Science, Yonsei University, College of Medicine, 50
Yonsei-ro, Seodaemun-gu, 03722 Seoul, Korea (J.H.Y.); Department of Oncology and
Pathology, Karolinska Institute, Stockholm, Sweden (F.S.); Department of
Radiology, Unit of Breast Imaging, Karolinska University Hospital, Stockholm,
Sweden (F.S.); Department of Biomedical Imaging and Image-guided Therapy,
Medical University of Vienna, Vienna, Austria (P.A.T.B.); Department of
Radiology, University of Pennsylvania, Philadelphia, Pa (E.F.C.); Department of
Radiology, University of Cambridge, Cambridge, UK (F.J.G.); Department of
Radiology, Harvard Medical School, Massachusetts General Hospital, Boston, Mass
(C.D.L.); Department of Radiology, University of California Davis, Davis, Calif
(E.A.M.); Department of Radiology, Breast Imaging Division, Johns Hopkins
Medicine, Baltimore, Md (L.A.M.); Department of Radiology, University of
Pittsburgh, UPMC Magee-Womens Hospital, Pittsburgh, Pa (R.M.N.); Department of
Radiology, St James Hospital, Leeds, UK (N.S.); Department of Breast
Examinations, Copenhagen University Hospital Herlev-Gentofte, Copenhagen,
Denmark (I.V.); Department of Radiology, Laura and Isaac Perlmutter Cancer
Center, Center for Biomedical Imaging, Center for Advanced Imaging Innovation
and Research, New York University Grossman School of Medicine, New York, NY
(L.M.); Department of Medical Imaging, Radboud University Medical Center,
Nijmegen, the Netherlands (R.M.M.); and Department of Radiology, Netherlands
Cancer Institute, Amsterdam, the Netherlands (R.M.M.)
| | | | | |
Collapse
|
34
|
Larsen M, Lynge E, Lee CI, Lång K, Hofvind S. Mammographic density and interval cancers in mammographic screening: Moving towards more personalized screening. Breast 2023; 69:306-311. [PMID: 36966656 PMCID: PMC10066543 DOI: 10.1016/j.breast.2023.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 03/18/2023] [Indexed: 03/29/2023] Open
Abstract
PURPOSE The European Society on Breast Imaging has recommended supplemental magnetic resonance imaging (MRI) every two to four years for women with mammographically dense breasts. This may not be feasible in many screening programs. Also, the European Commission Initiative on Breast Cancer suggests not implementing screening with MRI. By analyzing interval cancers and time from screening to diagnosis by density, we present alternative screening strategies for women with dense breasts. METHODS Our BreastScreen Norway cohort included 508 536 screening examinations, including 3125 screen-detected and 945 interval breast cancers. Time from screening to interval cancer was stratified by density measured by an automated software and classified into Volpara Density Grades (VDGs) 1-4. Examinations with volumetric density ≤3.4% were categorized as VDG1, 3.5%-7.4% as VDG2, 7.5%-15.4% as VDG3, and ≥15.5% as VDG4. Interval cancer rates were also determined by continuous density measures. RESULTS Median time from screening to interval cancer was 496 (IQR: 391-587) days for VDG1, 500 (IQR: 350-616) for VDG2, 482 (IQR: 309-595) for VDG3 and 427 (IQR: 266-577) for VDG4. A total of 35.9% of the interval cancers among VDG4 were detected within the first year of the biennial screening interval. For VDG2, 26.3% were detected within the first year. The highest annual interval cancer rate (2.7 per 1000 examinations) was observed for VDG4 in the second year of the biennial interval. CONCLUSIONS Annual screening of women with extremely dense breasts may reduce the interval cancer rate and increase program-wide sensitivity, especially in settings where supplemental MRI screening is not feasible.
Collapse
Affiliation(s)
- Marthe Larsen
- Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway
| | - Elsebeth Lynge
- Nykøbing Falster Hospital, University of Copenhagen, Nykøbing Falster, Denmark
| | - Christoph I Lee
- Department of Radiology, University of Washington School of Medicine, Seattle, WA, USA; Department of Health Systems and Population Health, University of Washington School of Public Health, Seattle, WA, USA
| | - Kristina Lång
- Department of Translational Medicine, Diagnostic Radiology, Lund University, Lund, Sweden; Unilabs Mammography Unit, Skåne University Hospital, Malmø, Sweden
| | - Solveig Hofvind
- Section for Breast Cancer Screening, Cancer Registry of Norway, Oslo, Norway; Department of Health and Care Sciences, Faculty of Health Sciences, UiT, The Arctic University of Norway, Tromsø, Norway.
| |
Collapse
|
35
|
Moy L. Change Is Good: The Evolution and Future of Breast Imaging. Radiology 2023; 306:e230018. [PMID: 36803001 PMCID: PMC9968764 DOI: 10.1148/radiol.230018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Accepted: 01/03/2023] [Indexed: 02/10/2023]
Affiliation(s)
- Linda Moy
- From the Department of Radiology, New York University, 160 E 34th St,
New York, NY 10016
| |
Collapse
|
36
|
Marinovich ML, Wylie E, Lotter W, Lund H, Waddell A, Madeley C, Pereira G, Houssami N. Artificial intelligence (AI) for breast cancer screening: BreastScreen population-based cohort study of cancer detection. EBioMedicine 2023; 90:104498. [PMID: 36863255 PMCID: PMC9996220 DOI: 10.1016/j.ebiom.2023.104498] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 01/27/2023] [Accepted: 02/09/2023] [Indexed: 03/04/2023] Open
Abstract
BACKGROUND Artificial intelligence (AI) has been proposed to reduce false-positive screens, increase cancer detection rates (CDRs), and address resourcing challenges faced by breast screening programs. We compared the accuracy of AI versus radiologists in real-world population breast cancer screening, and estimated potential impacts on CDR, recall and workload for simulated AI-radiologist reading. METHODS External validation of a commercially-available AI algorithm in a retrospective cohort of 108,970 consecutive mammograms from a population-based screening program, with ascertained outcomes (including interval cancers by registry linkage). Area under the ROC curve (AUC), sensitivity and specificity for AI were compared with radiologists who interpreted the screens in practice. CDR and recall were estimated for simulated AI-radiologist reading (with arbitration) and compared with program metrics. FINDINGS The AUC for AI was 0.83 compared with 0.93 for radiologists. At a prospective threshold, sensitivity for AI (0.67; 95% CI: 0.64-0.70) was comparable to radiologists (0.68; 95% CI: 0.66-0.71) with lower specificity (0.81 [95% CI: 0.81-0.81] versus 0.97 [95% CI: 0.97-0.97]). Recall rate for AI-radiologist reading (3.14%) was significantly lower than for the BSWA program (3.38%) (-0.25%; 95% CI: -0.31 to -0.18; P < 0.001). CDR was also lower (6.37 versus 6.97 per 1000) (-0.61; 95% CI: -0.77 to -0.44; P < 0.001); however, AI detected interval cancers that were not found by radiologists (0.72 per 1000; 95% CI: 0.57-0.90). AI-radiologist reading increased arbitration but decreased overall screen-reading volume by 41.4% (95% CI: 41.2-41.6). INTERPRETATION Replacement of one radiologist by AI (with arbitration) resulted in lower recall and overall screen-reading volume. There was a small reduction in CDR for AI-radiologist reading. AI detected interval cases that were not identified by radiologists, suggesting potentially higher CDR if radiologists were unblinded to AI findings. These results indicate AI's potential role as a screen-reader of mammograms, but prospective trials are required to determine whether CDR could improve if AI detection was actioned in double-reading with arbitration. FUNDING National Breast Cancer Foundation (NBCF), National Health and Medical Research Council (NHMRC).
Collapse
Affiliation(s)
- M Luke Marinovich
- The Daffodil Centre, The University of Sydney, a joint venture with Cancer Council NSW, Sydney, New South Wales, Australia; Curtin School of Population Health, Curtin University, Perth, Western Australia, Australia.
| | | | - William Lotter
- Dana-Farber Cancer Institute, Boston, MA, USA; Harvard Medical School, Boston, MA, USA
| | - Helen Lund
- BreastScreen WA, Perth, Western Australia, Australia
| | | | | | - Gavin Pereira
- Curtin School of Population Health, Curtin University, Perth, Western Australia, Australia
| | - Nehmat Houssami
- The Daffodil Centre, The University of Sydney, a joint venture with Cancer Council NSW, Sydney, New South Wales, Australia; Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| |
Collapse
|
37
|
Moy L. Top Publications in Radiology, 2022. Radiology 2023; 306:e222914. [PMID: 36625749 DOI: 10.1148/radiol.222914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
|
38
|
Magni V, Cozzi A, Schiaffino S, Colarieti A, Sardanelli F. Artificial intelligence for digital breast tomosynthesis: Impact on diagnostic performance, reading times, and workload in the era of personalized screening. Eur J Radiol 2023; 158:110631. [PMID: 36481480 DOI: 10.1016/j.ejrad.2022.110631] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 11/24/2022] [Indexed: 12/05/2022]
Abstract
The ultimate goals of the application of artificial intelligence (AI) to digital breast tomosynthesis (DBT) are the reduction of reading times, the increase of diagnostic performance, and the reduction of interval cancer rates. In this review, after outlining the journey from computer-aided detection/diagnosis systems to AI applied to digital mammography (DM), we summarize the results of studies where AI was applied to DBT, noting that long-term advantages of DBT screening and its crucial ability to decrease the interval cancer rate are still under scrutiny. AI has shown the capability to overcome some shortcomings of DBT in the screening setting by improving diagnostic performance and by reducing recall rates (from -2 % to -27 %) and reading times (up to -53 %, with an average 20 % reduction), but the ability of AI to reduce interval cancer rates has not yet been clearly investigated. Prospective validation is needed to assess the cost-effectiveness and real-world impact of AI models assisting DBT interpretation, especially in large-scale studies with low breast cancer prevalence. Finally, we focus on the incoming era of personalized and risk-stratified screening that will first see the application of contrast-enhanced breast imaging to screen women with extremely dense breasts. As the diagnostic advantage of DBT over DM was concentrated in this category, we try to understand if the application of AI to DM in the remaining cohorts of women with heterogeneously dense or non-dense breast could close the gap in diagnostic performance between DM and DBT, thus neutralizing the usefulness of AI application to DBT.
Collapse
Affiliation(s)
- Veronica Magni
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Luigi Mangiagalli 31, 20133 Milano, Italy.
| | - Andrea Cozzi
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy
| | - Simone Schiaffino
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy
| | - Anna Colarieti
- Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy
| | - Francesco Sardanelli
- Department of Biomedical Sciences for Health, Università degli Studi di Milano, Via Luigi Mangiagalli 31, 20133 Milano, Italy; Unit of Radiology, IRCCS Policlinico San Donato, Via Rodolfo Morandi 30, 20097 San Donato Milanese, Italy.
| |
Collapse
|
39
|
Affiliation(s)
| | - Athena Ko
- University of Ottawa, Department of Psychiatry, Ottawa, ON, Canada
| |
Collapse
|
40
|
Chen MM, Terzic A, Becker AS, Johnson JM, Wu CC, Wintermark M, Wald C, Wu J. Artificial intelligence in oncologic imaging. Eur J Radiol Open 2022; 9:100441. [PMID: 36193451 PMCID: PMC9525817 DOI: 10.1016/j.ejro.2022.100441] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 09/25/2022] [Accepted: 09/26/2022] [Indexed: 01/07/2023] Open
Abstract
Radiology is integral to cancer care. Compared to molecular assays, imaging has its advantages. Imaging as a noninvasive tool can assess the entirety of tumor unbiased by sampling error and is routinely acquired at multiple time points in oncological practice. Imaging data can be digitally post-processed for quantitative assessment. The ever-increasing application of Artificial intelligence (AI) to clinical imaging is challenging radiology to become a discipline with competence in data science, which plays an important role in modern oncology. Beyond streamlining certain clinical tasks, the power of AI lies in its ability to reveal previously undetected or even imperceptible radiographic patterns that may be difficult to ascertain by the human sensory system. Here, we provide a narrative review of the emerging AI applications relevant to the oncological imaging spectrum and elaborate on emerging paradigms and opportunities. We envision that these technical advances will change radiology in the coming years, leading to the optimization of imaging acquisition and discovery of clinically relevant biomarkers for cancer diagnosis, staging, and treatment monitoring. Together, they pave the road for future clinical translation in precision oncology.
Collapse
Affiliation(s)
- Melissa M. Chen
- Department of Neuroradiology, MD Anderson Cancer Center, Houston, TX, USA
| | - Admir Terzic
- Department of Radiology, Dom Zdravlja Odzak, Odzak, Bosnia and Herzegovina
| | - Anton S. Becker
- Department Radiology, Memorial Sloan Kettering, New York, NY, USA
| | - Jason M. Johnson
- Department of Neuroradiology, MD Anderson Cancer Center, Houston, TX, USA
| | - Carol C. Wu
- Department of Thoracic Imaging, MD Anderson Cancer Center, Houston, TX, USA
| | - Max Wintermark
- Department of Neuroradiology, MD Anderson Cancer Center, Houston, TX, USA
| | - Christoph Wald
- Department of Radiology, Lahey Hospital and Medical Center, Burlington, MA, USA
| | - Jia Wu
- Department of Imaging Physics, MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
41
|
Cè M, Caloro E, Pellegrino ME, Basile M, Sorce A, Fazzini D, Oliva G, Cellina M. Artificial intelligence in breast cancer imaging: risk stratification, lesion detection and classification, treatment planning and prognosis-a narrative review. EXPLORATION OF TARGETED ANTI-TUMOR THERAPY 2022; 3:795-816. [PMID: 36654817 PMCID: PMC9834285 DOI: 10.37349/etat.2022.00113] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 09/28/2022] [Indexed: 12/28/2022] Open
Abstract
The advent of artificial intelligence (AI) represents a real game changer in today's landscape of breast cancer imaging. Several innovative AI-based tools have been developed and validated in recent years that promise to accelerate the goal of real patient-tailored management. Numerous studies confirm that proper integration of AI into existing clinical workflows could bring significant benefits to women, radiologists, and healthcare systems. The AI-based approach has proved particularly useful for developing new risk prediction models that integrate multi-data streams for planning individualized screening protocols. Furthermore, AI models could help radiologists in the pre-screening and lesion detection phase, increasing diagnostic accuracy, while reducing workload and complications related to overdiagnosis. Radiomics and radiogenomics approaches could extrapolate the so-called imaging signature of the tumor to plan a targeted treatment. The main challenges to the development of AI tools are the huge amounts of high-quality data required to train and validate these models and the need for a multidisciplinary team with solid machine-learning skills. The purpose of this article is to present a summary of the most important AI applications in breast cancer imaging, analyzing possible challenges and new perspectives related to the widespread adoption of these new tools.
Collapse
Affiliation(s)
- Maurizio Cè
- Postgraduate School in Diagnostic and Interventional Radiology, University of Milan, 20122 Milan, Italy,Correspondence: Maurizio Cè, Postgraduate School in Diagnostic and Interventional Radiology, University of Milan, Via Festa del Perdono, 7, 20122 Milan, Italy.
| | - Elena Caloro
- Postgraduate School in Diagnostic and Interventional Radiology, University of Milan, 20122 Milan, Italy
| | - Maria E. Pellegrino
- Postgraduate School in Diagnostic and Interventional Radiology, University of Milan, 20122 Milan, Italy
| | - Mariachiara Basile
- Postgraduate School in Diagnostic and Interventional Radiology, University of Milan, 20122 Milan, Italy
| | - Adriana Sorce
- Postgraduate School in Diagnostic and Interventional Radiology, University of Milan, 20122 Milan, Italy
| | | | - Giancarlo Oliva
- Department of Radiology, ASST Fatebenefratelli Sacco, 20121 Milan, Italy
| | - Michaela Cellina
- Department of Radiology, ASST Fatebenefratelli Sacco, 20121 Milan, Italy
| |
Collapse
|