1
|
Frost EK, Bosward R, Aquino YSJ, Braunack-Mayer A, Carter SM. Facilitating public involvement in research about healthcare AI: A scoping review of empirical methods. Int J Med Inform 2024; 186:105417. [PMID: 38564959 DOI: 10.1016/j.ijmedinf.2024.105417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 03/06/2024] [Accepted: 03/17/2024] [Indexed: 04/04/2024]
Abstract
OBJECTIVE With the recent increase in research into public views on healthcare artificial intelligence (HCAI), the objective of this review is to examine the methods of empirical studies on public views on HCAI. We map how studies provided participants with information about HCAI, and we examine the extent to which studies framed publics as active contributors to HCAI governance. MATERIALS AND METHODS We searched 5 academic databases and Google Advanced for empirical studies investigating public views on HCAI. We extracted information including study aims, research instruments, and recommendations. RESULTS Sixty-two studies were included. Most were quantitative (N = 42). Most (N = 47) reported providing participants with background information about HCAI. Despite this, studies often reported participants' lack of prior knowledge about HCAI as a limitation. Over three quarters (N = 48) of the studies made recommendations that envisaged public views being used to guide governance of AI. DISCUSSION Provision of background information is an important component of facilitating research with publics on HCAI. The high proportion of studies reporting participants' lack of knowledge about HCAI as a limitation reflects the need for more guidance on how information should be presented. A minority of studies adopted technocratic positions that construed publics as passive beneficiaries of AI, rather than as active stakeholders in HCAI design and implementation. CONCLUSION This review draws attention to how public roles in HCAI governance are constructed in empirical studies. To facilitate active participation, we recommend that research with publics on HCAI consider methodological designs that expose participants to diverse information sources.
Collapse
Affiliation(s)
- Emma Kellie Frost
- Australian Centre for Health Engagement, Evidence and Values, School of Health and Society, Faculty of the Arts, Social Sciences, and Humanities, University of Wollongong, Australia.
| | - Rebecca Bosward
- Australian Centre for Health Engagement, Evidence and Values, School of Health and Society, Faculty of the Arts, Social Sciences, and Humanities, University of Wollongong, Australia.
| | - Yves Saint James Aquino
- Australian Centre for Health Engagement, Evidence and Values, School of Health and Society, Faculty of the Arts, Social Sciences, and Humanities, University of Wollongong, Australia.
| | - Annette Braunack-Mayer
- Australian Centre for Health Engagement, Evidence and Values, School of Health and Society, Faculty of the Arts, Social Sciences, and Humanities, University of Wollongong, Australia.
| | - Stacy M Carter
- Australian Centre for Health Engagement, Evidence and Values, School of Health and Society, Faculty of the Arts, Social Sciences, and Humanities, University of Wollongong, Australia.
| |
Collapse
|
2
|
Newlands R, Bruhn H, Díaz MR, Lip G, Anderson LA, Ramsay C. A stakeholder analysis to prepare for real-world evaluation of integrating artificial intelligent algorithms into breast screening (PREP-AIR study): a qualitative study using the WHO guide. BMC Health Serv Res 2024; 24:569. [PMID: 38698386 PMCID: PMC11067265 DOI: 10.1186/s12913-024-10926-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Accepted: 03/28/2024] [Indexed: 05/05/2024] Open
Abstract
BACKGROUND The national breast screening programme in the United Kingdom is under pressure due to workforce shortages and having been paused during the COVID-19 pandemic. Artificial intelligence has the potential to transform how healthcare is delivered by improving care processes and patient outcomes. Research on the clinical and organisational benefits of artificial intelligence is still at an early stage, and numerous concerns have been raised around its implications, including patient safety, acceptance, and accountability for decisions. Reforming the breast screening programme to include artificial intelligence is a complex endeavour because numerous stakeholders influence it. Therefore, a stakeholder analysis was conducted to identify relevant stakeholders, explore their views on the proposed reform (i.e., integrating artificial intelligence algorithms into the Scottish National Breast Screening Service for breast cancer detection) and develop strategies for managing 'important' stakeholders. METHODS A qualitative study (i.e., focus groups and interviews, March-November 2021) was conducted using the stakeholder analysis guide provided by the World Health Organisation and involving three Scottish health boards: NHS Greater Glasgow & Clyde, NHS Grampian and NHS Lothian. The objectives included: (A) Identify possible stakeholders (B) Explore stakeholders' perspectives and describe their characteristics (C) Prioritise stakeholders in terms of importance and (D) Develop strategies to manage 'important' stakeholders. Seven stakeholder characteristics were assessed: their knowledge of the targeted reform, position, interest, alliances, resources, power and leadership. RESULTS Thirty-two participants took part from 14 (out of 17 identified) sub-groups of stakeholders. While they were generally supportive of using artificial intelligence in breast screening programmes, some concerns were raised. Stakeholder knowledge, influence and interests in the reform varied. Key advantages mentioned include service efficiency, quicker results and reduced work pressure. Disadvantages included overdiagnosis or misdiagnosis of cancer, inequalities in detection and the self-learning capacity of the algorithms. Five strategies (with considerations suggested by stakeholders) were developed to maintain and improve the support of 'important' stakeholders. CONCLUSIONS Health services worldwide face similar challenges of workforce issues to provide patient care. The findings of this study will help others to learn from Scottish experiences and provide guidance to conduct similar studies targeting healthcare reform. STUDY REGISTRATION researchregistry6579, date of registration: 16/02/2021.
Collapse
Affiliation(s)
- Rumana Newlands
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK.
| | - Hanne Bruhn
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | | | - Gerald Lip
- North East Scotland Breast Screening Programme, NHS Grampian, Aberdeen, UK
| | - Lesley A Anderson
- Centre for Health Data Science, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, UK
| | - Craig Ramsay
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| |
Collapse
|
3
|
Jenkinson GP, Houghton N, van Zalk N, Waller J, Bello F, Tzemanaki A. Acceptability of Automated Robotic Clinical Breast Examination: Survey Study. J Particip Med 2023; 15:e42704. [PMID: 37010907 PMCID: PMC10131668 DOI: 10.2196/42704] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 01/14/2023] [Accepted: 02/20/2023] [Indexed: 02/22/2023] Open
Abstract
BACKGROUND In the United Kingdom, women aged 50 to 70 years are invited to undergo mammography. However, 10% of invasive breast cancers occur in women aged ≤45 years, representing an unmet need for young women. Identifying a suitable screening modality for this population is challenging; mammography is insufficiently sensitive, whereas alternative diagnostic methods are invasive or costly. Robotic clinical breast examination (R-CBE)-using soft robotic technology and machine learning for fully automated clinical breast examination-is a theoretically promising screening modality with early prototypes under development. Understanding the perspectives of potential users and partnering with patients in the design process from the outset is essential for ensuring the patient-centered design and implementation of this technology. OBJECTIVE This study investigated the attitudes and perspectives of women regarding the use of soft robotics and intelligent systems in breast cancer screening. It aimed to determine whether such technology is theoretically acceptable to potential users and identify aspects of the technology and implementation system that are priorities for patients, allowing these to be integrated into technology design. METHODS This study used a mixed methods design. We conducted a 30-minute web-based survey with 155 women in the United Kingdom. The survey comprised an overview of the proposed concept followed by 5 open-ended questions and 17 closed questions. Respondents were recruited through a web-based survey linked to the Cancer Research United Kingdom patient involvement opportunities web page and distributed through research networks' mailing lists. Qualitative data generated via the open-ended questions were analyzed using thematic analysis. Quantitative data were analyzed using 2-sample Kolmogorov-Smirnov tests, 1-tailed t tests, and Pearson coefficients. RESULTS Most respondents (143/155, 92.3%) indicated that they would definitely or probably use R-CBE, with 82.6% (128/155) willing to be examined for up to 15 minutes. The most popular location for R-CBE was at a primary care setting, whereas the most accepted method for receiving the results was an on-screen display (with an option to print information) immediately after the examination. Thematic analysis of free-text responses identified the following 7 themes: women perceive that R-CBE has the potential to address limitations in current screening services; R-CBE may facilitate increased user choice and autonomy; ethical motivations for supporting R-CBE development; accuracy (and users' perceptions of accuracy) is essential; results management with clear communication is a priority for users; device usability is important; and integration with health services is key. CONCLUSIONS There is a high potential for the acceptance of R-CBE in its target user group and a high concordance between user expectations and technological feasibility. Early patient participation in the design process allowed the authors to identify key development priorities for ensuring that this new technology meets the needs of users. Ongoing patient and public involvement at each development stage is essential.
Collapse
Affiliation(s)
- George P Jenkinson
- Bristol Robotics Laboratory, Department of Mechanical Engineering, University of Bristol, Bristol, United Kingdom
| | - Natasha Houghton
- Centre for Engagement and Simulation Science, Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Nejra van Zalk
- Dyson School of Design Engineering, Imperial College London, London, United Kingdom
| | - Jo Waller
- Cancer Prevention Group, School of Cancer & Pharmaceutical Sciences, King's College London, London, United Kingdom
| | - Fernando Bello
- Centre for Engagement and Simulation Science, Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Antonia Tzemanaki
- Bristol Robotics Laboratory, Department of Mechanical Engineering, University of Bristol, Bristol, United Kingdom
| |
Collapse
|
4
|
AI in breast screening mammography: breast screening readers' perspectives. Insights Imaging 2022; 13:186. [PMID: 36484919 PMCID: PMC9733732 DOI: 10.1186/s13244-022-01322-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 11/01/2022] [Indexed: 12/13/2022] Open
Abstract
OBJECTIVES This study surveyed the views of breast screening readers in the UK on how to incorporate Artificial Intelligence (AI) technology into breast screening mammography. METHODS An online questionnaire was circulated to the UK breast screening readers. Questions included their degree of approval of four AI implementation scenarios: AI as triage, AI as a companion reader/reader aid, AI replacing one of the initial two readers, and AI replacing all readers. They were also asked to rank five AI representation options (discrete opinion; mammographic scoring; percentage score with 100% indicating malignancy; region of suspicion; heat map) and indicate which evidence they considered necessary to support the implementation of AI into their practice among six options offered. RESULTS The survey had 87 nationally accredited respondents across the UK; 73 completed the survey in full. Respondents approved of AI replacing one of the initial two human readers and objected to AI replacing all human readers. Participants were divided on AI as triage and AI as a reader companion. A region of suspicion superimposed on the image was the preferred AI representation option. Most screen readers considered national guidelines (77%), studies using a nationally representative dataset (65%) and independent prospective studies (60%) as essential evidence. Participants' free-text comments highlighted concerns and the need for additional validation. CONCLUSIONS Overall, screen readers supported the introduction of AI as a partial replacement of human readers and preferred a graphical indication of the suspected tumour area, with further evidence and national guidelines considered crucial prior to implementation.
Collapse
|
5
|
Pesapane F, Rotili A, Valconi E, Agazzi GM, Montesano M, Penco S, Nicosia L, Bozzini A, Meneghetti L, Latronico A, Pizzamiglio M, Rossero E, Gaeta A, Raimondi S, Pizzoli SFM, Grasso R, Carrafiello G, Pravettoni G, Cassano E. Women’s perceptions and attitudes to the use of AI in breast cancer screening: a survey in a cancer referral centre. Br J Radiol 2022; 96:20220569. [DOI: 10.1259/bjr.20220569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Objective: Although breast cancer screening can benefit from Artificial Intelligence (AI), it is still unknown whether, to which extent or under which conditions, the use of AI is going to be accepted by the general population. The aim of our study is to evaluate what the females who are eligible for breast cancer screening know about AI and how they perceive such innovation. Methods: We used a prospective survey consisting of a 11-multiple-choice questionnaire evaluating statistical associations with Chi-Square-test or Fisher-exact-test. Multinomial-logistic-regression was performed on items with more than two response categories. Odds ratio (OR) with 95% CI were computed to estimate the probability of a specific response according to patient’s characteristics. Results: In the 800 analysed questionnaires, 51% of respondents confirmed to have knowledge of AI. Of these, 88% expressed a positive opinion about its use in medicine. Non-Italian respondents were associated with the belief of having a deep awareness about AI more often than Italian respondents (OR = 1.91;95% CI[1.10–3.33]). Higher education level was associated with better opinions on the use of AI in medicine (OR = 4.69;95% CI[1.36–16.12]). According to 94% of respondents, the radiologists should always produce their own report on mammograms, whilst 77% agreed that AI should be used as a second reader. Most respondents (52%) considered that both the software developer and the radiologist should be held accountable for AI errors. Conclusions: Most of the females undergoing screening in our Institute approve the introduction of AI, although only as a support to radiologist, and not in substitution thereof. Yet, accountability in case of AI errors is still unsolved. advances in knowledge: This survey may be considered as a pilot-study for the development of large-scale studies to understand females’s demands and concerns about AI applications in breast cancer screening.
Collapse
Affiliation(s)
- Filippo Pesapane
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Anna Rotili
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Elena Valconi
- Diagnostic and Interventional Radiology Unit, Department of Diagnostic and Therapeutic Advanced Technology, Azienda Socio Sanitaria Territoriale Santi Paolo and Carlo Hospital, Milan, Italy
| | - Giorgio Maria Agazzi
- Diagnostic and Interventional Radiology Unit, Department of Diagnostic and Therapeutic Advanced Technology, Azienda Socio Sanitaria Territoriale Santi Paolo and Carlo Hospital, Milan, Italy
| | - Marta Montesano
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Silvia Penco
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Luca Nicosia
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Anna Bozzini
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Lorenza Meneghetti
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Antuono Latronico
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Maria Pizzamiglio
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Eleonora Rossero
- Laboratorio dei Diritti Fondamentali, Collegio Carlo Alberto, Torino ER, Turin, Italy
| | - Aurora Gaeta
- Department of Experimental Oncology, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Sara Raimondi
- Department of Experimental Oncology, IEO European Institute of Oncology IRCCS, Milan, Italy
| | | | - Roberto Grasso
- Applied Research Division for Cognitive and Psychological Science, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Gianpaolo Carrafiello
- Department of Radiology and Department of Health Sciences, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico and University of Milano, Milan, Italy
| | - Gabriella Pravettoni
- Dipartimento di Oncologia ed Emato Oncologia, Università degli studi di Milano, Milan, Italy
- Applied Research Division for Cognitive and Psychological Science, IEO European Institute of Oncology IRCCS, Milan, Italy
| | - Enrico Cassano
- Breast Imaging Division, IEO European Institute of Oncology IRCCS, Milan, Italy
| |
Collapse
|
6
|
Rakovic K, Colling R, Browning L, Dolton M, Horton MR, Protheroe A, Lamb AD, Bryant RJ, Scheffer R, Crofts J, Stanislaus E, Verrill C. The Use of Digital Pathology and Artificial Intelligence in Histopathological Diagnostic Assessment of Prostate Cancer: A Survey of Prostate Cancer UK Supporters. Diagnostics (Basel) 2022; 12:1225. [PMID: 35626380 PMCID: PMC9141178 DOI: 10.3390/diagnostics12051225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Revised: 05/09/2022] [Accepted: 05/11/2022] [Indexed: 12/03/2022] Open
Abstract
There has been particular interest in the deployment of digital pathology (DP) and artificial intelligence (AI) in the diagnosis of prostate cancer, but little is known about the views of the public on their use. Prostate Cancer UK supporters were invited to an online survey which included quantitative and qualitative questions exploring views on the use of DP and AI in histopathological assessment. A total of 1276 responses to the survey were analysed (response rate 12.5%). Most respondents were supportive of DP (87%, 1113/1276) and of testing AI in clinical practice as a diagnostic adjunct (83%, 1058/1276). Respondents saw DP as potentially increasing workflow efficiency, facilitating research, education/training and fostering clinical discussions between clinician and patient. Some respondents raised concerns regarding data security, reliability and the need for human oversight. Among those who were unsure about AI, information was requested regarding its performance and others wanted to defer the decision to use it to an expert. Although most are in favour of its use, some are unsure, and their concerns could be addressed with more information or better communication. A small minority (<1%) are not in favour of the testing of the use of AI in histopathology for reasons which are not easily addressed.
Collapse
Affiliation(s)
- Kai Rakovic
- Institute of Cancer Sciences, University of Glasgow, Switchback Road, Glasgow G61 1QH, UK
- Department of Pathology, Queen Elizabeth University Hospital, Govan Road, Glasgow G51 4TF, UK
| | - Richard Colling
- Department of Cellular Pathology, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (R.C.); (L.B.); (C.V.)
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
| | - Lisa Browning
- Department of Cellular Pathology, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (R.C.); (L.B.); (C.V.)
- NIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK
| | - Monica Dolton
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
| | | | - Andrew Protheroe
- Department of Oncology, University of Oxford, Roosevelt Drive, Oxford OX3 7DQ, UK;
- Oxford Cancer & Haematology Centre, Oxford University Hospitals NHS Foundation Trust, Churchill Hospital, Old Road, Oxford OX3 7LE, UK
| | - Alastair D. Lamb
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
- Department of Urology, Oxford University Hospitals NHS Foundation Trust, Churchill Hospital, Old Road, Oxford OX3 7LE, UK
| | - Richard J. Bryant
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
- Department of Urology, Oxford University Hospitals NHS Foundation Trust, Churchill Hospital, Old Road, Oxford OX3 7LE, UK
| | - Richard Scheffer
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
| | - James Crofts
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
| | - Ewart Stanislaus
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
| | - Clare Verrill
- Department of Cellular Pathology, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (R.C.); (L.B.); (C.V.)
- Nuffield Department of Surgical Sciences, University of Oxford, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK; (M.D.); (A.D.L.); (R.J.B.); (R.S.); (J.C.); (E.S.)
- NIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Headley Way, Oxford OX3 9DU, UK
| |
Collapse
|