1
|
Wenderott K, Krups J, Luetkens JA, Weigl M. Radiologists' perspectives on the workflow integration of an artificial intelligence-based computer-aided detection system: A qualitative study. Appl Ergon 2024; 117:104243. [PMID: 38306741 DOI: 10.1016/j.apergo.2024.104243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 12/18/2023] [Accepted: 01/23/2024] [Indexed: 02/04/2024]
Abstract
In healthcare, artificial intelligence (AI) is expected to improve work processes, yet most research focuses on the technical features of AI rather than its real-world clinical implementation. To evaluate the implementation process of an AI-based computer-aided detection system (AI-CAD) for prostate MRI readings, we interviewed German radiologists in a pre-post design. We embedded our findings in the Model of Workflow Integration and the Technology Acceptance Model to analyze workflow effects, facilitators, and barriers. The most prominent barriers were: (i) a time delay in the work process, (ii) additional work steps to be taken, and (iii) an unstable performance of the AI-CAD. Most frequently named facilitators were (i) good self-organization, and (ii) good usability of the software. Our results underline the importance of a holistic approach to AI implementation considering the sociotechnical work system and provide valuable insights into key factors of the successful adoption of AI technologies in work systems.
Collapse
Affiliation(s)
- Katharina Wenderott
- Institute for Patient Safety, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany.
| | - Jim Krups
- Institute for Patient Safety, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany
| | - Julian A Luetkens
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), University Hospital Bonn, Germany
| | - Matthias Weigl
- Institute for Patient Safety, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany
| |
Collapse
|
2
|
Wenderott K, Krups J, Luetkens JA, Gambashidze N, Weigl M. Prospective effects of an artificial intelligence-based computer-aided detection system for prostate imaging on routine workflow and radiologists' outcomes. Eur J Radiol 2024; 170:111252. [PMID: 38096741 DOI: 10.1016/j.ejrad.2023.111252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 11/15/2023] [Accepted: 12/04/2023] [Indexed: 01/16/2024]
Abstract
OBJECTIVES Artificial intelligence (AI) is expected to alleviate the negative consequences of rising case numbers for radiologists. Currently, systematic evaluations of the impact of AI solutions in real-world radiological practice are missing. Our study addresses this gap by investigating the impact of the clinical implementation of an AI-based computer-aided detection system (CAD) for prostate MRI reading on clinicians' workflow, workflow throughput times, workload, and stress. MATERIALS AND METHODS CAD was newly implemented into radiology workflow and accompanied by a prospective pre-post study design. We assessed prostate MRI case readings using standardized work observations and questionnaires. The observation period was three months each in a single department. Workflow throughput times, PI-RADS score, CAD usage and radiologists' self-reported workload and stress were recorded. Linear mixed models were employed for effect identification. RESULTS In data analyses, 91 observed case readings (pre: 50, post: 41) were included. Variation of routine workflow was observed following CAD implementation. A non-significant increase in overall workflow throughput time was associated with CAD implementation (mean 16.99 ± 6.21 vs 18.77 ± 9.69 min, p = .51), along with an increase in diagnostic reading time for high suspicion cases (mean 15.73 ± 4.99 vs 23.07 ± 8.75 min, p = .02). Changes in radiologists' self-reported workload or stress were not found. CONCLUSION Implementation of an AI-based detection aid was associated with lower standardization and no effects over time on radiologists' workload or stress. Expectations of AI decreasing the workload of radiologists were not confirmed by our real-world study. PRE-REGISTRATION German register for clinical trials https://drks.de/; DRKS00027391.
Collapse
Affiliation(s)
| | - Jim Krups
- Institute for Patient Safety, University Hospital Bonn, Germany
| | - Julian A Luetkens
- Department of Radiology and Quantitative Imaging Lab Bonn (QILaB), University Hospital Bonn, Germany
| | | | - Matthias Weigl
- Institute for Patient Safety, University Hospital Bonn, Germany
| |
Collapse
|
3
|
Woernle A, Englman C, Dickinson L, Kirkham A, Punwani S, Haider A, Freeman A, Kasivisivanathan V, Emberton M, Hines J, Moore CM, Allen C, Giganti F. Picture Perfect: The Status of Image Quality in Prostate MRI. J Magn Reson Imaging 2023. [PMID: 37804007 DOI: 10.1002/jmri.29025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Revised: 09/07/2023] [Accepted: 09/08/2023] [Indexed: 10/08/2023] Open
Abstract
Magnetic resonance imaging is the gold standard imaging modality for the diagnosis of prostate cancer (PCa). Image quality is a fundamental prerequisite for the ability to detect clinically significant disease. In this critical review, we separate the issue of image quality into quality improvement and quality assessment. Beginning with the evolution of technical recommendations for scan acquisition, we investigate the role of patient preparation, scanner factors, and more advanced sequences, including those featuring Artificial Intelligence (AI), in determining image quality. As means of quality appraisal, the published literature on scoring systems (including the Prostate Imaging Quality score), is evaluated. Finally, the application of AI and teaching courses as ways to facilitate quality assessment are discussed, encouraging the implementation of future image quality initiatives along the PCa diagnostic and monitoring pathway. EVIDENCE LEVEL: 3 TECHNICAL EFFICACY: Stage 3.
Collapse
Affiliation(s)
- Alexandre Woernle
- Faculty of Medical Sciences, University College London, London, UK
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
| | - Cameron Englman
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
- Division of Surgery & Interventional Science, University College London, London, UK
| | - Louise Dickinson
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
| | - Alex Kirkham
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
| | - Shonit Punwani
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
- Centre for Medical Imaging, University College London, London, UK
| | - Aiman Haider
- Department of Pathology, University College London Hospital NHS Foundation Trust, London, UK
| | - Alex Freeman
- Department of Pathology, University College London Hospital NHS Foundation Trust, London, UK
| | - Veeru Kasivisivanathan
- Division of Surgery & Interventional Science, University College London, London, UK
- Department of Urology, University College London Hospital NHS Foundation Trust, London, UK
| | - Mark Emberton
- Division of Surgery & Interventional Science, University College London, London, UK
- Department of Urology, University College London Hospital NHS Foundation Trust, London, UK
| | - John Hines
- Faculty of Medical Sciences, University College London, London, UK
- Department of Urology, University College London Hospital NHS Foundation Trust, London, UK
- North East London Cancer Alliance & North Central London Cancer Alliance Urology, London, UK
| | - Caroline M Moore
- Division of Surgery & Interventional Science, University College London, London, UK
- Department of Urology, University College London Hospital NHS Foundation Trust, London, UK
| | - Clare Allen
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
| | - Francesco Giganti
- Department of Radiology, University College London Hospital NHS Foundation Trust, London, UK
- Division of Surgery & Interventional Science, University College London, London, UK
| |
Collapse
|