1
|
Vallo Hult H, Abovarda A, Master Östlund C, Pålsson P. Digital learning strategies in residency education. Ann Med 2025; 57:2440630. [PMID: 39692274 DOI: 10.1080/07853890.2024.2440630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 10/24/2024] [Accepted: 11/14/2024] [Indexed: 12/19/2024] Open
Abstract
BACKGROUND New digital learning environments have transformed medical education and training, allowing students and teachers to engage in synchronous, real-time interactions and asynchronous learning activities online. Despite extensive research on the role of digital technologies in education, understanding the interplay between digital technology, work, and learning, especially in complex fields like healthcare, remains a challenge. OBJECTIVE The objective of this study is to examine resident physicians' perceptions and experiences of using a digital learning environment as part of their specialist medical training. The paper focuses on digital learning through video conferencing (virtual lectures and seminars) and related learning technologies. It aims to understand how resident physicians perceive pedagogical opportunities and challenges in digital learning environments during their medical training and what strategies they use to address these. MATERIALS AND METHODS The methodological approach is qualitative, aiming to capture and understand participants' experiences and views of digital learning. The empirical data gathered from open-ended responses to four course evaluation surveys and semi-structured interviews with nine physicians from a cohort of participants enrolled in two or more digital courses were analyzed through thematic analysis. The analysis revealed three main themes related to digital transformation of learning: sociotechnical, educational and administrative. RESULTS The results suggest that (i) sociotechnical aspects and understanding of the context in which the learning takes place contribute to enhancing digital learning for resident physicians; (ii) insights into participants' perceptions of digital learning emphasize that interactive communication and group discussions are significant for their learning, and (iii) administrative aspects related to course design, lecture management, and instructional support are more important in digital learning environments compared to traditional teaching and learning. CONCLUSION Findings from this study confirm and extend prior studies on digital learning in healthcare, contributing to a better understanding of how digital learning environments, especially virtual lectures and seminars, can be developed and integrated into residency programs and health professions education to increase their usefulness.
Collapse
Affiliation(s)
- Helena Vallo Hult
- School of Business, Economics and IT, University West, Trollhättan, Sweden
- Department of Education, NU Hospital Group, Trollhättan, Sweden
| | - Adam Abovarda
- School of Business, Economics and IT, University West, Trollhättan, Sweden
| | | | - Paul Pålsson
- Department of Education, NU Hospital Group, Trollhättan, Sweden
- Institute of Neuroscience and Physiology, University of Gothenburg, Sahlgrenska Academy, Gothenburg, Sweden
| |
Collapse
|
2
|
Dingel J, Kleine AK, Cecil J, Sigl AL, Lermer E, Gaube S. Predictors of Health Care Practitioners' Intention to Use AI-Enabled Clinical Decision Support Systems: Meta-Analysis Based on the Unified Theory of Acceptance and Use of Technology. J Med Internet Res 2024; 26:e57224. [PMID: 39102675 PMCID: PMC11333871 DOI: 10.2196/57224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 05/03/2024] [Accepted: 05/13/2024] [Indexed: 08/07/2024] Open
Abstract
BACKGROUND Artificial intelligence-enabled clinical decision support systems (AI-CDSSs) offer potential for improving health care outcomes, but their adoption among health care practitioners remains limited. OBJECTIVE This meta-analysis identified predictors influencing health care practitioners' intention to use AI-CDSSs based on the Unified Theory of Acceptance and Use of Technology (UTAUT). Additional predictors were examined based on existing empirical evidence. METHODS The literature search using electronic databases, forward searches, conference programs, and personal correspondence yielded 7731 results, of which 17 (0.22%) studies met the inclusion criteria. Random-effects meta-analysis, relative weight analyses, and meta-analytic moderation and mediation analyses were used to examine the relationships between relevant predictor variables and the intention to use AI-CDSSs. RESULTS The meta-analysis results supported the application of the UTAUT to the context of the intention to use AI-CDSSs. The results showed that performance expectancy (r=0.66), effort expectancy (r=0.55), social influence (r=0.66), and facilitating conditions (r=0.66) were positively associated with the intention to use AI-CDSSs, in line with the predictions of the UTAUT. The meta-analysis further identified positive attitude (r=0.63), trust (r=0.73), anxiety (r=-0.41), perceived risk (r=-0.21), and innovativeness (r=0.54) as additional relevant predictors. Trust emerged as the most influential predictor overall. The results of the moderation analyses show that the relationship between social influence and use intention becomes weaker with increasing age. In addition, the relationship between effort expectancy and use intention was stronger for diagnostic AI-CDSSs than for devices that combined diagnostic and treatment recommendations. Finally, the relationship between facilitating conditions and use intention was mediated through performance and effort expectancy. CONCLUSIONS This meta-analysis contributes to the understanding of the predictors of intention to use AI-CDSSs based on an extended UTAUT model. More research is needed to substantiate the identified relationships and explain the observed variations in effect sizes by identifying relevant moderating factors. The research findings bear important implications for the design and implementation of training programs for health care practitioners to ease the adoption of AI-CDSSs into their practice.
Collapse
Affiliation(s)
- Julius Dingel
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
| | - Anne-Kathrin Kleine
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
| | - Julia Cecil
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
| | - Anna Leonie Sigl
- Department of Liberal Arts and Sciences, Technical University of Applied Sciences Augsburg, Augsburg, Germany
| | - Eva Lermer
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
- Department of Liberal Arts and Sciences, Technical University of Applied Sciences Augsburg, Augsburg, Germany
| | - Susanne Gaube
- Human Factors in Healthcare, Global Business School for Health, University College London, London, United Kingdom
| |
Collapse
|
3
|
Koshy AN, Vengrenyuk A, Baber U, Kyaw H, Tang GH, Goldman M, Hooda A, Krishnamoorthy P, Sharma SK, Kini AS. The Future of Education in Cardiology: Development and Utilization of a Novel App-Based Educational Platform. JACC. ADVANCES 2023; 2:100376. [PMID: 38939011 PMCID: PMC11198508 DOI: 10.1016/j.jacadv.2023.100376] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/29/2024]
Affiliation(s)
| | | | | | | | | | | | | | | | | | - Annapoorna S. Kini
- The Zena and Michael A. Weiner Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, One Gustave L. Levy Place, Box 1030, New York, New York 10029-6574, USA
| |
Collapse
|
4
|
Zhang Z, Xia E, Huang J. Impact of the Moderating Effect of National Culture on Adoption Intention in Wearable Health Care Devices: Meta-analysis. JMIR Mhealth Uhealth 2022; 10:e30960. [PMID: 35657654 PMCID: PMC9206205 DOI: 10.2196/30960] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 01/05/2022] [Accepted: 02/09/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Wearable health care devices have not yet been commercialized on a large scale. Additionally, people in different countries have different utilization rates. Therefore, more in-depth studies on the moderating effect of national culture on adoption intention in wearable health care devices are necessary. OBJECTIVE This study aims to explore the summary results of the relationships between perceived usefulness and perceived ease of use with adoption intention in wearable health care devices and the impact of the moderating effect of national culture on these two relationships. METHODS We searched for studies published before September 2021 in the Web of Science, EBSCO, Engineering Village, China National Knowledge Infrastructure, IEEE Xplore, and Wiley Online Library databases. CMA (version 2.0, Biostat Inc) software was used to perform the meta-analysis. We conducted publication bias and heterogeneity tests on the data. The random-effects model was used to estimate the main effect size, and a sensitivity analysis was conducted. A meta-regression analysis was used to test the moderating effect of national culture. RESULTS This meta-analysis included 20 publications with a total of 6128 participants. Perceived usefulness (r=0.612, P<.001) and perceived ease of use (r=0.462, P<.001) positively affect adoption intention. The relationship between perceived usefulness and adoption intention is positively moderated by individualism/collectivism (β=.003, P<.001), masculinity/femininity (β=.008, P<.001) and indulgence/restraint (β=.005, P<.001), and negatively moderated by uncertainty avoidance (β=-.005, P<.001). The relationship between perceived ease of use and adoption intention is positively moderated by individualism/collectivism (β=.003, P<.001), masculinity/femininity (β=.006, P<.001) and indulgence/restraint (β=.009, P<.001), and negatively moderated by uncertainty avoidance (β=-.004, P<.001). CONCLUSIONS This meta-analysis provided comprehensive evidence on the positive relationship between perceived usefulness and perceived ease of use with adoption intention and the moderating effect of national culture on these two relationships. Regarding the moderating effect, perceived usefulness and perceived ease of use have a greater impact on adoption intention for people in individualistic, masculine, low uncertainty avoidance, and indulgence cultures, respectively.
Collapse
Affiliation(s)
- Zhenming Zhang
- School of Management and Economics, Beijing Institute of Technology, Beijing, China
| | - Enjun Xia
- School of Management and Economics, Beijing Institute of Technology, Beijing, China
| | - Jieping Huang
- School of Management and Economics, Beijing Institute of Technology, Beijing, China
| |
Collapse
|
5
|
Shuldiner J, Srinivasan D, Hall JN, May CR, Desveaux L. Implementing a virtual emergency department: a qualitative study using the NPT theory (Preprint). JMIR Hum Factors 2022; 9:e39430. [PMID: 36094801 PMCID: PMC9513685 DOI: 10.2196/39430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 07/14/2022] [Accepted: 07/31/2022] [Indexed: 11/26/2022] Open
Abstract
Background COVID-19 necessitated the rapid implementation and uptake of virtual health care; however, virtual care’s potential role remains unclear in the urgent care setting. In December 2020, the first virtual emergency department (ED) in the Greater Toronto Area was piloted at Sunnybrook Health Sciences Centre by connecting patients to emergency physicians through an online portal. Objective This study aims to understand whether and how ED physicians were able to integrate a virtual ED alongside in-person operations. Methods We conducted semistructured interviews with ED physicians guided by the Normalization Process Theory (NPT). The NPT provides a framework to understand how individuals and teams navigate the process of embedding new models of care as part of normal practice. All physicians who had worked within the virtual ED model were invited to participate. Data were analyzed using a combination of inductive and deductive techniques informed by the NPT. Results A total of 14 physicians were interviewed. Participant experiences were categorized into 1 of 2 groups: 1 group moved to normalize the virtual ED in practice, while the other described barriers to routine adoption. These groups differed in their perception of the patient benefits as well as the perceived role in the virtual ED. The group that normalized the virtual ED model saw value for patients (coherence) and was motivated by patient satisfaction witnessed (reflexive monitoring) at the end of the virtual appointment. By contrast, the other group did not find virtual ED work reflective of the perceived role of urgent care (cognitive participation) and felt their skills as ED physicians were underutilized. The limited ability to examine patients and a sense that patient issues were not fully resolved at the end of the virtual appointment caused frustration among the second group. Conclusions As further digital integration within the health care system occurs, it will be essential to support the evolution of staff skill sets to ensure physicians are satisfied with the care they are providing to their patients, while also ensuring the technology and process are efficient.
Collapse
Affiliation(s)
- Jennifer Shuldiner
- Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada
| | - Diya Srinivasan
- Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada
| | - Justin N Hall
- Department of Emergency Services, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
- Division of Emergency Medicine, Temerty Faculty of Medicine, University of Toronto, Toronto, ON, Canada
| | - Carl R May
- Faculty of Public Health and Policy, London School of Hygiene and Tropical Medicine, London, United Kingdom
- North Thames Applied Research Collaboration, London, United Kingdom
| | - Laura Desveaux
- Institute for Health System Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada
| |
Collapse
|
6
|
Leo CG, Tumolo MR, Sabina S, Colella R, Recchia V, Ponzini G, Fotiadis DI, Bodini A, Mincarone P. Health Technology Assessment for In Silico Medicine: Social, Ethical and Legal Aspects. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19031510. [PMID: 35162529 PMCID: PMC8835251 DOI: 10.3390/ijerph19031510] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 01/25/2022] [Accepted: 01/26/2022] [Indexed: 12/28/2022]
Abstract
The application of in silico medicine is constantly growing in the prevention, diagnosis, and treatment of diseases. These technologies allow us to support medical decisions and self-management and reduce, refine, and partially replace real studies of medical technologies. In silico medicine may challenge some key principles: transparency and fairness of data usage; data privacy and protection across platforms and systems; data availability and quality; data integration and interoperability; intellectual property; data sharing; equal accessibility for persons and populations. Several social, ethical, and legal issues may consequently arise from its adoption. In this work, we provide an overview of these issues along with some practical suggestions for their assessment from a health technology assessment perspective. We performed a narrative review with a search on MEDLINE/Pubmed, ISI Web of Knowledge, Scopus, and Google Scholar. The following key aspects emerge as general reflections with an impact on the operational level: cultural resistance, level of expertise of users, degree of patient involvement, infrastructural requirements, risks for health, respect of several patients’ rights, potential discriminations for access and use of the technology, and intellectual property of innovations. Our analysis shows that several challenges still need to be debated to allow in silico medicine to express all its potential in healthcare processes.
Collapse
Affiliation(s)
- Carlo Giacomo Leo
- Institute of Clinical Physiology, National Research Council, 73100 Lecce, Italy; (C.G.L.); (M.R.T.); (V.R.)
| | - Maria Rosaria Tumolo
- Institute of Clinical Physiology, National Research Council, 73100 Lecce, Italy; (C.G.L.); (M.R.T.); (V.R.)
- Department of Biological and Environmental Sciences and Technology, University of Salento, 73100 Lecce, Italy;
| | - Saverio Sabina
- Institute of Clinical Physiology, National Research Council, 73100 Lecce, Italy; (C.G.L.); (M.R.T.); (V.R.)
- Correspondence:
| | - Riccardo Colella
- Department of Biological and Environmental Sciences and Technology, University of Salento, 73100 Lecce, Italy;
| | - Virginia Recchia
- Institute of Clinical Physiology, National Research Council, 73100 Lecce, Italy; (C.G.L.); (M.R.T.); (V.R.)
| | - Giuseppe Ponzini
- Institute for Research on Population and Social Policies, National Research Council, 72100 Brindisi, Italy; (G.P.); (P.M.)
| | - Dimitrios Ioannis Fotiadis
- Unit of Medical Technology and Intelligent Information Systems, Department of Materials Science and Engineering, University of Ioannina, 45110 Ioannina, Greece;
- Department of Biomedical Research, Institute of Molecular Biology and Biotechnology—Foundation for Research and Technology Hellas (IMBB-FORTH), 45115 Ioannina, Greece
| | - Antonella Bodini
- Institute for Applied Mathematics and Information Technologies “E. Magenes”, National Research Council, 20133 Milan, Italy;
| | - Pierpaolo Mincarone
- Institute for Research on Population and Social Policies, National Research Council, 72100 Brindisi, Italy; (G.P.); (P.M.)
| |
Collapse
|
7
|
Affiliation(s)
- Nilufar Foadi
- Department of Anesthesiology and Intensive Care Medicine, Hannover Medical School, Hannover, Germany
| | - Julian Varghese
- Institute of Medical Informatics, University of Münster, Münster, Germany
| |
Collapse
|
8
|
Andrews JA, Craven MP, Lang AR, Guo B, Morriss R, Hollis C. The impact of data from remote measurement technology on the clinical practice of healthcare professionals in depression, epilepsy and multiple sclerosis: survey. BMC Med Inform Decis Mak 2021; 21:282. [PMID: 34645428 PMCID: PMC8513566 DOI: 10.1186/s12911-021-01640-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Accepted: 09/22/2021] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND A variety of smartphone apps and wearables are available both to help patients monitor their health and to support health care professionals (HCPs) in providing clinical care. As part of the RADAR-CNS consortium, we have conducted research into the application of wearables and smartphone apps in the care of people with multiple sclerosis, epilepsy, or depression. METHODS We conducted a large online survey study to explore the experiences of HCPs working with patients who have one or more of these conditions. The survey covered smartphone apps and wearables used by clinicians and their patients, and how data from these technologies impacted on the respondents' clinical practice. The survey was conducted between February 2019 and March 2020 via a web-based platform. Detailed statistical analysis was performed on the answers. RESULTS Of 1009 survey responses from HCPs, 1006 were included in the analysis after data cleaning. Smartphone apps are used by more than half of responding HCPs and more than three quarters of their patients use smartphone apps or wearable devices for health-related purposes. HCPs widely believe the data that patients collect using these devices impacts their clinical practice. Subgroup analyses show that views on the impact of this data on different aspects of clinical work varies according to whether respondents use apps themselves, and, to a lesser extent, according to their clinical setting and job role. CONCLUSIONS Use of smartphone apps is widespread among HCPs participating in this large European survey and caring for people with epilepsy, multiple sclerosis and depression. The majority of respondents indicate that they treat patients who use wearables and other devices for health-related purposes and that data from these devices has an impact on clinical practice.
Collapse
Affiliation(s)
- J A Andrews
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, University of Nottingham, Triumph Road, Jubilee Campus, Nottingham, NG7 2TU, UK.
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK.
| | - M P Craven
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, University of Nottingham, Triumph Road, Jubilee Campus, Nottingham, NG7 2TU, UK
- Human Factors Research Group, Faculty of Engineering, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK
| | - A R Lang
- Human Factors Research Group, Faculty of Engineering, University of Nottingham, Nottingham, UK
| | - B Guo
- ARC-EM, School of Medicine, University of Nottingham, Nottingham, UK
| | - R Morriss
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, University of Nottingham, Triumph Road, Jubilee Campus, Nottingham, NG7 2TU, UK
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK
- ARC-EM, School of Medicine, University of Nottingham, Nottingham, UK
| | - C Hollis
- NIHR MindTech MedTech Co-operative, Institute of Mental Health, University of Nottingham, Triumph Road, Jubilee Campus, Nottingham, NG7 2TU, UK
- Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK
- NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK
| |
Collapse
|