1
|
Popov V, Harmer B, Raphael S, Scott I, Sample AP, Cooke JM, Cole M. Elucidating cognitive processes in cardiac arrest team leaders: a virtual reality-based cued-recall study of experts and novices. Ann Med 2025; 57:2470976. [PMID: 40028867 DOI: 10.1080/07853890.2025.2470976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Revised: 02/02/2025] [Accepted: 02/09/2025] [Indexed: 03/05/2025] Open
Abstract
BACKGROUND Team leadership during medical emergencies like cardiac arrest resuscitation is cognitively demanding, especially for trainees. These cognitive processes remain poorly characterized due to measurement challenges. Using virtual reality simulation, this study aimed to elucidate and compare communication and cognitive processes-such as decision-making, cognitive load, perceived pitfalls, and strategies-between expert and novice code team leaders to inform strategies for accelerating proficiency development. METHODS A simulation-based mixed methods approach was utilized within a single large academic medical center, involving twelve standardized virtual reality cardiac arrest simulations. These 10- to 15-minutes simulation sessions were performed by seven experts and five novices. Following the simulations, a cognitive task analysis was conducted using a cued-recall protocol to identify the challenges, decision-making processes, and cognitive load experienced across the seven stages of each simulation. RESULTS The analysis revealed 250 unique cognitive processes. In terms of reasoning patterns, experts used inductive reasoning, while novices tended to use deductive reasoning, considering treatments before assessments. Experts also demonstrated earlier consideration of potential reversible causes of cardiac arrest. Regarding team communication, experts reported more critical communications, with no shared subthemes between groups. Experts identified more teamwork pitfalls, and suggested more strategies compared to novices. For cognitive load, experts reported lower median cognitive load (53) compared to novices (80) across all stages, with the exception of the initial presentation phase. CONCLUSIONS The identified patterns of expert performance - superior teamwork skills, inductive clinical reasoning, and distributed cognitive strategiesn - can inform training programs aimed at accelerating expertise development.
Collapse
Affiliation(s)
- Vitaliy Popov
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA
- School of Information, University of Michigan, Ann Arbor, MI, USA
| | - Bryan Harmer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Sophie Raphael
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Isabella Scott
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Alanson P Sample
- Electrical Engineering and Computer Science Department, University of Michigan, Ann Arbor, MI, USA
| | - James M Cooke
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, USA
- Department of Family Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Michael Cole
- Department of Emergency Medicine, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
2
|
Hernández-Torres I, Pons-Álvarez ON, Romero-Henríquez LF, López-Ortiz G. Challenges in teacher-student communication during family medicine residency: A qualitative study. PLoS One 2024; 19:e0310455. [PMID: 39288138 PMCID: PMC11407679 DOI: 10.1371/journal.pone.0310455] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Accepted: 09/01/2024] [Indexed: 09/19/2024] Open
Abstract
BACKGROUND Deficiencies in communication among healthcare professionals, recognized by medical educators and healthcare institutions, can negatively impact medical education and clinical practice. Analyzing teacher-resident communication difficulties shed light on this issue and propose practical strategies for its mitigation. OBJECTIVE To identify common communication challenges between teacher and residents during Family Medicine residency and to analyze their impact on interactions with peers, the work team, and patients. DESIGN Qualitative study, the critical incident technique was used to collect information of interest. PARTICIPANTS Seventy teachers, and fifty third-year residents from the Mexican Republic described critical incidents related to their communication experiences during Family Medicine residency. RESULTS 192 critical incidents were collected (several participants reported more than one incident), comprising 127 reports from teachers, and 65 from residents. Four themes were identified: 1) asymmetric communication, 2) assertive communication, 3) organizational communication, and 4) effective communication. The main challenges identified were abuse of power in communication, lack of communication skills, and the absence of institutional communication channels. These issues significantly impacted learning, work environment, interpersonal relationships, and medical care. CONCLUSION This study highlights communication issues within Family Medicine residency in Mexico. The issues detected hindered learning and effective collaboration and negatively impacted the work environment, interpersonal relationships, and the quality of medical care. These findings underscore the urgent need to reorient the medical specialty curriculum towards an approach that includes communication skills.
Collapse
Affiliation(s)
- Isaías Hernández-Torres
- Facultad de Medicina, Subdivisión de Medicina Familiar, Universidad Nacional Autónoma de México, Ciudad de México, México
| | - Octavio N Pons-Álvarez
- Facultad de Medicina, Subdivisión de Medicina Familiar, Universidad Nacional Autónoma de México, Ciudad de México, México
| | - Luisa F Romero-Henríquez
- Facultad de Filosofía y Letras, Posgrado en Pedagogía, Universidad Nacional Autónoma de México, Ciudad de México, México
| | - Geovani López-Ortiz
- Facultad de Medicina, Subdivisión de Medicina Familiar, Universidad Nacional Autónoma de México, Ciudad de México, México
| |
Collapse
|
3
|
Elkhalladi J, Sefrioui A. Teachers' knowledge of soft skills and flipped classrooms: Nursing and health technologies. Heliyon 2024; 10:e35668. [PMID: 39220993 PMCID: PMC11365298 DOI: 10.1016/j.heliyon.2024.e35668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Revised: 06/29/2024] [Accepted: 08/01/2024] [Indexed: 09/04/2024] Open
Abstract
Background Soft skills and flipped classrooms are important in the fields of education, nursing, and health techniques. Aim This study determined nursing teachers' knowledge of soft skills and flipped classrooms. Design This was a descriptive cross-sectional study with an analytical focus involving 100 teachers. Settings The study was conducted at the Higher Institute of Nursing Professions and Health Techniques (ISPITS) at Agadir and its annex in Tiznit. Participants One hundred permanent and temporary teachers (with an equal distribution of male and female teachers) participated in the survey. Methods A five-part questionnaire was used to collect data. The independent variable was the use of a flipped classroom and dependent variable was the development of soft skills. SPSS version 25 software was used to process the data. Chi-square test, Ficher's test, binary logistic regression test, and multivariate logistic regression model were employed for data analysis. Results In total, 80 % participants had knowledge of soft skills, and 75 % knew about flipped classrooms. The most important soft skills were considered to be communication, stress management, teamwork, conflict management, problem-solving, time management, critical thinking, autonomy, adaptability, and decision-making. The five soft skills considered most likely to be developed by flipped classrooms were autonomy, analysis, teamwork, communication, and time management. Furthermore, the development of soft skills through the flipped classrooms was independently associated with soft skills training (p = 0.008) and use of flipped classrooms (p = 0.042). Conclusions Teachers have knowledge of soft skills and flipped classrooms despite a lack of training, and flipped classrooms contribute to the development of soft skills.
Collapse
Affiliation(s)
- Jaouad Elkhalladi
- Faculty of Medicine and Pharmacy, Mohamed 5 University, Rabat, Morocco
| | - Amal Sefrioui
- Faculty of Dentistry, Mohamed 5 University, Rabat, Morocco
| |
Collapse
|
4
|
Claessens F, Seys D, Van der Auwera C, Jans A, Castro EM, Jacobs L, De Ridder D, Bruyneel L, Leenaerts Z, Van Wilder A, Brouwers J, Lachman P, Vanhaecht K. Measuring in-hospital quality multidimensionally by integrating patients', kin's and healthcare professionals' perspectives: development and validation of the FlaQuM-Quickscan. BMC Health Serv Res 2023; 23:1426. [PMID: 38104060 PMCID: PMC10725024 DOI: 10.1186/s12913-023-10349-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 11/20/2023] [Indexed: 12/19/2023] Open
Abstract
BACKGROUND Measuring quality is essential to drive improvement initiatives in hospitals. An instrument that measures healthcare quality multidimensionally and integrates patients', kin's and professionals' perspectives is lacking. We aimed to develop and validate an instrument to measure healthcare quality multidimensionally from a multistakeholder perspective. METHODS A multi-method approach started by establishing content and face validity, followed by a multi-centre study in 17 Flemish (Belgian) hospitals to assess construct validity through confirmatory factor analysis, criterion validity through determining Pearson's correlations and reliability through Cronbach's alpha measurement. The instrument FlaQuM-Quickscan measures 'Healthcare quality for patients and kin' (part 1) and 'Healthcare quality for professionals' (part 2). This bipartite instrument mirrors 15 quality items and 3 general items (the overall quality score, recommendation score and intention-to-stay score). A process evaluation was organised to identify effective strategies in instrument distribution by conducting semi-structured interviews with quality managers. RESULTS By involving experts in the development of quality items and through pilot testing by a multi-stakeholder group, the content and face validity of instrument items was ensured. In total, 13,615 respondents (5,891 Patients/kin and 7,724 Professionals) completed the FlaQuM-Quickscan. Confirmatory factor analyses showed good to very good fit and correlations supported the associations between the quality items and general items for both instrument parts. Cronbach's alphas supported the internal consistency. The process evaluation revealed that supportive technical structures and approaching respondents individually were effective strategies to distribute the instrument. CONCLUSIONS The FlaQuM-Quickscan is a valid instrument to measure healthcare quality experiences multidimensionally from an integrated multistakeholder perspective. This new instrument offers unique and detailed data to design sustainable quality management systems in hospitals. Based on these data, hospital management and policymakers can set quality priorities for patients', kin's and professionals' care. Future research should investigate the transferability to other healthcare systems and examine between-stakeholders and between-hospitals variation.
Collapse
Affiliation(s)
- Fien Claessens
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium.
| | - Deborah Seys
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
| | - Charlotte Van der Auwera
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
| | - Anneke Jans
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- Department of Quality Management, Sint-Trudo Ziekenhuis, Sint-Truiden, Belgium
| | - Eva Marie Castro
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- Department of Quality Management, Regionaal Ziekenhuis Heilig Hart Tienen, Tienen, Belgium
| | - Laura Jacobs
- Department of Quality Management, University Hospitals Leuven, Leuven, Belgium
| | - Dirk De Ridder
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- Department of Quality Management, University Hospitals Leuven, Leuven, Belgium
| | - Luk Bruyneel
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
| | - Zita Leenaerts
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
| | - Astrid Van Wilder
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
| | - Jonas Brouwers
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- Department of Orthopaedics, University Hospitals Leuven, Leuven, Belgium
| | - Peter Lachman
- Lead Faculty Quality Improvement Programme- Royal College of Physicians of Ireland, Dublin, Ireland
| | - Kris Vanhaecht
- Leuven Institute for Healthcare Policy, Department of Public Health and Primary Care, KU Leuven - University of Leuven, Leuven, Belgium
- Department of Quality Management, University Hospitals Leuven, Leuven, Belgium
| |
Collapse
|
5
|
Kolbe M, Goldhahn J, Useini M, Grande B. "Asking for help is a strength"-how to promote undergraduate medical students' teamwork through simulation training and interprofessional faculty. Front Psychol 2023; 14:1214091. [PMID: 37701867 PMCID: PMC10494543 DOI: 10.3389/fpsyg.2023.1214091] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 08/01/2023] [Indexed: 09/14/2023] Open
Abstract
The ability to team up and safely work in any kind of healthcare team is a critical asset and should be taught early on in medical education. Medical students should be given the chance to "walk the talk" of teamwork by training and reflecting in teams. Our goal was to design, implement and evaluate the feasibility of a simulation-based teamwork training (TeamSIM) for undergraduate medical students that puts generic teamwork skills centerstage. We designed TeamSIM to include 12 learning objectives. For this pre-post, mixed-methods feasibility study, third-year medical students, organized in teams of 11-12 students, participated and observed each other in eight simulations of different clinical situation with varying degrees of complexity (e.g., deteriorating patient in ward; trauma; resuscitation). Guided by an interprofessional clinical faculty with simulation-based instructor training, student teams reflected on their shared experience in structured team debriefings. Using published instruments, we measured (a) students' reactions to TeamSIM and their perceptions of psychological safety via self-report, (b) their ongoing reflections via experience sampling, and (c) their teamwork skills via behavior observation. Ninety four students participated. They reported positive reactions to TeamSIM (M = 5.23, SD = 0.5). Their mean initial reported level of psychological safety was M = 3.8 (SD = 0.4) which rose to M = 4.3 (SD = 0.5) toward the end of the course [T(21) = -2.8, 95% CI -0.78 to-0.12, p = 0.011 (two-tailed)]. We obtained n = 314 headline reflections from the students and n = 95 from the faculty. For the students, the most frequent theme assigned to their headlines involved the concepts taught in the course such as "10 s for 10 min." For the faculty, the most frequent theme assigned to their headlines were reflections on how their simulation session worked for the students. The faculty rated students' teamwork skills higher after the last compared to the first debriefing. Undergraduate medical students can learn crucial teamwork skills in simulations supported by an experienced faculty and with a high degree of psychological safety. Both students and faculty appreciate the learning possibilities of simulation. At the same time, this learning can be challenging, intense and overwhelming. It takes a team to teach teamwork.
Collapse
Affiliation(s)
- Michaela Kolbe
- Simulation Centre, University Hospital Zurich, Zurich, Switzerland
- Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
| | - Jörg Goldhahn
- Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Mirdita Useini
- Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Bastian Grande
- Simulation Centre, University Hospital Zurich, Zurich, Switzerland
- Institute of Anaesthesiology, University Hospital Zurich, Zurich, Switzerland
| |
Collapse
|
6
|
Antonacci G, Whitney J, Harris M, Reed JE. How do healthcare providers use national audit data for improvement? BMC Health Serv Res 2023; 23:393. [PMID: 37095495 PMCID: PMC10123973 DOI: 10.1186/s12913-023-09334-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 03/23/2023] [Indexed: 04/26/2023] Open
Abstract
BACKGROUND Substantial resources are invested by Health Departments worldwide in introducing National Clinical Audits (NCAs). Yet, there is variable evidence on the NCAs' effectiveness and little is known on factors underlying the successful use of NCAs to improve local practice. This study will focus on a single NCA (the National Audit of Inpatient Falls -NAIF 2017) to explore: (i) participants' perspectives on the NCA reports, local feedback characteristics and actions undertaken following the feedback underpinning the effective use of the NCA feedback to improve local practice; (ii) reported changes in local practice following the NCA feedback in England and Wales. METHODS Front-line staff perspectives were gathered through interviews. An inductive qualitative approach was used. Eighteen participants were purposefully sampled from 7 of the 85 participating hospitals in England and Wales. Analysis was guided by constant comparative techniques. RESULTS Regarding the NAIF annual report, interviewees valued performance benchmarking with other hospitals, the use of visual representations and the inclusion of case studies and recommendations. Participants stated that feedback should target front-line healthcare professionals, be straightforward and focused, and be delivered through an encouraging and honest discussion. Interviewees highlighted the value of using other relevant data sources alongside NAIF feedback and the importance of continuous data monitoring. Participants reported that engagement of front-line staff in the NAIF and following improvement activities was critical. Leadership, ownership, management support and communication at different organisational levels were perceived as enablers, while staffing level and turnover, and poor quality improvement (QI) skills, were perceived as barriers to improvement. Reported changes in practice included increased awareness and attention to patient safety issues and greater involvement of patients and staff in falls prevention activities. CONCLUSIONS There is scope to improve the use of NCAs by front-line staff. NCAs should not be seen as isolated interventions but should be fully embedded and integrated into the QI strategic and operational plans of NHS trusts. The use of NCAs could be optimised, but knowledge of them is poor and distributed unevenly across different disciplines. More research is needed to provide guidance on key elements to consider throughout the whole improvement process at different organisational levels.
Collapse
Affiliation(s)
- Grazia Antonacci
- Department of Primary Care and Public Health, Imperial College London, National Institute of Health Research (NIHR) Applied Research Collaboration (ARC) Northwest London, London, UK
- Business School, Centre for Health Economics and Policy Innovation (CHEPI), Imperial College London, London, UK
| | - Julie Whitney
- Department of Physiotherapy, King's College London, London, UK
| | - Matthew Harris
- Department of Primary Care and Public Health, Imperial College London, South Kensington, UK
| | - Julie E Reed
- School of Health and Welfare, Halmstad University, Halmstad, Sweden
- Julie Reed Consultancy Ltd, London, UK
| |
Collapse
|
7
|
Naureckas Li C, Leya GA, Mort E, Aaronson E, Gartland RM. Development and Implementation of a Practical Onboarding Curriculum for Physician Quality and Safety Leaders. Am J Med Qual 2023; 38:81-86. [PMID: 36735496 DOI: 10.1097/jmq.0000000000000106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Physicians are increasingly asked to assume quality and safety (Q&S) leadership roles; prior experience varies, and onboarding training is limited. Semistructured interviews were completed with physician Q&S leaders; interview responses were analyzed using 2-step rapid analysis. Interview learnings informed development of a 2-day onboarding training and complementary digital resource repository. Attendees were surveyed to evaluate the training. Thirteen semistructured interviews with physician leaders from 6 academic medical centers demonstrated 61.5% had no formal Q&S training before assuming their role. Respondents identified a range of knowledge gaps. A 2-day virtual onboarding training and complementary digital repository were created. Attendee surveys demonstrated 96% (73/76) believed the training would be "extremely" or "moderately" helpful to others. Subject-matter familiarity across all content areas improved after the training. Using front-line stakeholder input, a pilot onboarding curriculum for Q&S leaders was created. Future work includes ongoing implementation and iterative improvement.
Collapse
Affiliation(s)
- Caitlin Naureckas Li
- Division of Pediatric Infectious Diseases, Boston Children's Hospital, Harvard Medical School, Boston, MA
- Edward P. Lawrence Center for Quality and Safety, Massachusetts General Hospital, Boston, MA
| | - Gregory A Leya
- Edward P. Lawrence Center for Quality and Safety, Massachusetts General Hospital, Boston, MA
- Department of Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Elizabeth Mort
- Edward P. Lawrence Center for Quality and Safety, Massachusetts General Hospital, Boston, MA
- Department of Medicine, Massachusetts General Hospital, and Department of Health Care Policy, Harvard Medical School, Boston, MA
| | - Emily Aaronson
- Edward P. Lawrence Center for Quality and Safety, Massachusetts General Hospital, Boston, MA
- Department of Emergency Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Rajshri M Gartland
- Edward P. Lawrence Center for Quality and Safety, Massachusetts General Hospital, Boston, MA
- Department of Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| |
Collapse
|
8
|
Military Soft Skills Applicable to the ICU. Crit Care Explor 2023; 5:e0871. [PMID: 36844376 PMCID: PMC9945261 DOI: 10.1097/cce.0000000000000871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023] Open
Abstract
To describe how soft skills acquired during military service can be applied to the practice of critical care medicine. DATA SOURCES A systematic search was performed in PubMed. STUDY SELECTION We selected all studies that addressed soft skills in medicine. DATA EXTRACTION Information present in published articles was analyzed by the authors and incorporated in the article if relevant to the practice of critical care medicine. DATA SYNTHESIS Integrative review of 15 articles combined with the authors' clinical experience practicing military medicine in country and overseas while also practicing academic intensive care medicine. CONCLUSIONS Soft skills used in the military have potential applications to modern intensive care medicine. Teaching soft skills in parallel with the technical aspects of intensive care medicine should be an integral part of critical care fellowships.
Collapse
|
9
|
Judd B, Brentnall J, Scanlan JN, Thomson K, Blackstock F, Mandrusiak A, Chipchase L, Phillips A, McAllister S. Evaluating allied health students' readiness for placement learning. BMC MEDICAL EDUCATION 2023; 23:70. [PMID: 36709272 PMCID: PMC9883866 DOI: 10.1186/s12909-023-04005-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Accepted: 01/05/2023] [Indexed: 05/24/2023]
Abstract
BACKGROUND Experiential learning opportunities, such as work integrated learning placements, are often challenging for health professional students. It is therefore imperative that students are adequately prepared before engaging in placement learning. Operationalising 'readiness for learning on placement' as a construct, is necessary for providing quality student feedback and assessment. METHODS An integrative mixed methods approach was adopted for this study, utilising a survey to canvass the perspectives of academics, students, and placement educators around the construct of readiness to inform potential assessment items. An assessment tool measuring student readiness for placement was then developed. Data from occupational therapy, physiotherapy and speech pathology programs were evaluated using Rasch analysis to explore the unidimensionality of this construct. RESULTS The online survey was completed by 64 participants, confirming the importance and measurability of foundational skills integral to readiness for placement learning. These foundational skills were then reflected in a pilot 20-item tool covering domains of professional and learner behaviour, communication, information gathering skills and reasoning. The Rasch analysis of 359 pre-registration student assessments confirmed unidimensionality, suggesting that the skills and attributes (operationalised as assessment items) that are considered part of 'readiness for placement' are components of this construct. Together, these findings provide support that the items on this tool are relevant and representative of the skills and behaviours that indicate readiness for placement learning. Two items regarding documentation and appropriate professional dress demonstrated some lower importance scores and interpretation variance warranting further investigation. CONCLUSION Through the exploration of the construct of readiness for placement learning, we have created and subsequently revised, an innovative assessment tool that measures novice students' pre-placement capabilities. Further research is now needed to explore the psychometric properties of the tool.
Collapse
Affiliation(s)
- Belinda Judd
- Faculty of Medicine and Health, University of Sydney, Camperdown, Australia
| | - Jennie Brentnall
- Faculty of Medicine and Health, University of Sydney, Camperdown, Australia
| | | | - Kate Thomson
- Faculty of Medicine and Health, University of Sydney, Camperdown, Australia
| | - Felicity Blackstock
- School of Health Sciences, Western Sydney University, Campelltown, Australia
| | - Allison Mandrusiak
- School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Australia
| | - Lucy Chipchase
- College of Nursing and Health Sciences, Flinders University, Adelaide, Australia
| | - Anna Phillips
- UniSA Allied Health and Human Performance, University of South Australia, Adelaide, Australia
| | - Sue McAllister
- Faculty of Medicine and Health, University of Sydney, Camperdown, Australia
- College of Nursing and Health Sciences, Flinders University, Adelaide, Australia
| |
Collapse
|
10
|
Bremer AE, van de Pol MHJ, Laan RFJM, Fluit CRMG. An Innovative Undergraduate Medical Curriculum Using Entrustable Professional Activities. JOURNAL OF MEDICAL EDUCATION AND CURRICULAR DEVELOPMENT 2023; 10:23821205231164894. [PMID: 37123076 PMCID: PMC10134152 DOI: 10.1177/23821205231164894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Accepted: 03/02/2023] [Indexed: 05/03/2023]
Abstract
The need to educate medical professionals in changing medical organizations has led to a revision of the Radboudumc's undergraduate medical curriculum. Entrustable professional activities (EPAs) were used as a learning tool to support participation and encourage feedback-seeking behavior, in order to offer students the best opportunities for growth. This paper describes the development of the Radboudumc's EPA-based Master's curriculum and how EPAs can facilitate continuity in learning in the clerkships. Four guiding principles were used to create a curriculum that offers possibilities for the students' development: (1) working with EPAs, (2) establishing entrustment, (3) providing continuity in learning, and (4) organizing smooth transitions. The new curriculum was designed with the implementation of EPAs and an e-portfolio, based on these 4 principles. The authors found that the revised curriculum corresponds to daily practice in clerkships. Students used their e-portfolios throughout all clerkships, which stimulates feedback-seeking behavior. Moreover, EPAs promote continuity in learning while rotating clerkships every 1 to 2 months. This might encourage curriculum developers to use EPAs when aiming for greater continuity in the development of students. Future research needs to focus on the effect of EPAs on transitions across clerkships in order to further improve the undergraduate medical curriculum.
Collapse
Affiliation(s)
- Anne E Bremer
- Radboud Institute for Health Sciences,
Department of Radboudumc Health Academy, Radboud University Medical Center, Nijmegen, the Netherlands
- Anne E Bremer, Radboudumc Health Academy,
Postbus 9101, 6500 HB, Nijmegen, The Netherlands.
| | - Marjolein H J van de Pol
- Department of Primary and Community
Care, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Roland F J M Laan
- Department of Radboudumc Health Academy, Radboud University Medical Center, Nijmegen, the
Netherlands
| | - Cornelia R M G Fluit
- Department of Radboudumc Health Academy, Radboud University Medical Center, Nijmegen, the
Netherlands
| |
Collapse
|
11
|
Spooner R, Stanford V, Parslow-Williams S, Mortimer F, Leedham-Green K. "Concrete ways we can make a difference": A multi-centre, multi-professional evaluation of sustainability in quality improvement education. MEDICAL TEACHER 2022; 44:1116-1124. [PMID: 35543345 DOI: 10.1080/0142159x.2022.2064737] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Quality improvement (QI) projects are a mandatory part of postgraduate medical training in the UK and graduating medical students must be competent in QI theory. We evaluated an educational toolkit that links concepts of sustainable healthcare with established quality improvement methodologies (the SusQI approach, available at www.susqi.org). The SusQI approach was implemented across a range of undergraduate and postgraduate nursing and medical education contexts. Educational strategies included guided online learning, live interactive webinars, small group activities and scaffolded project work. The evaluation strategy was informed by theories of academic motivation, educational value within communities of practice and behaviour change. A simultaneous nested design was tested using a mixed methods survey with input from learners and teachers. 177 survey responses were analysed to quantify and compare self-rated impacts of teaching across different audiences. Qualitative data were inductively coded into themes that were categorised according to above theoretical frameworks. Participants felt that this was 'time well spent' and many described transformative impacts that guided their daily professional practice beyond learning about QI. We suggest that meaningful space is found within both undergraduate and postgraduate healthcare curricula for SusQI, as a way of engaging and motivating learners to contribute to the creation of a sustainable healthcare system.
Collapse
Affiliation(s)
- Rosanna Spooner
- Department of Education, Centre for Sustainable Healthcare, Oxford, UK
- Department of Paediatrics, Gloucestershire Hospitals NHS Foundation Trust, Cheltenham, UK
| | - Victoria Stanford
- Department of Education, Centre for Sustainable Healthcare, Oxford, UK
| | | | - Frances Mortimer
- Department of Education, Centre for Sustainable Healthcare, Oxford, UK
| | | |
Collapse
|
12
|
Vaassen S, Essers BAB, Stammen LA, Walsh K, Kerssens M, Evers SMAA, Heyligers I, Stassen LPS, van Mook WNKA, Noben CYG. Incorporating value-based healthcare projects in residency training: a mixed-methods study on the impact of participation on understanding and competency development. BMJ Open 2022; 12:e060682. [PMID: 35977765 PMCID: PMC9389098 DOI: 10.1136/bmjopen-2021-060682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
OBJECTIVES Stimulating the active participation of residents in projects with societally relevant healthcare themes, such as value-based healthcare (VBHC), can be a strategy to enhance competency development. Canadian Medical Education Directions for Specialists (CanMEDS) competencies such as leader and scholar are important skills for all doctors. In this study, we hypothesise that when residents conduct a VBHC project, CanMEDS competencies are developed. There is the added value of gaining knowledge about VBHC. DESIGN An explorative mixed-methods study assessing residents' self-perceived learning effects of conducting VBHC projects according to three main components: (1) CanMEDS competency development, (2) recognition of VBHC dilemmas in clinical practice, and (3) potential facilitators for and barriers to implementing a VBHC project. We triangulated data resulting from qualitative analyses of: (a) text-based summaries of VBHC projects by residents and (b) semistructured interviews with residents who conducted these projects. SETTING Academic and non-academic hospitals in the Netherlands. PARTICIPANTS Out of 63 text-based summaries from residents, 56 were selected; and out of 19 eligible residents, 11 were selected for semistructured interviews and were included in the final analysis. RESULTS Regarding CanMEDS competency development, the competencies 'leader', 'communicator' and 'collaborator' scored the highest. Opportunities to recognise VBHC dilemmas in practice were mainly stimulated by analysing healthcare practices from different perspectives, and by learning how to define costs and relate them to outcomes. Finally, implementation of VBHC projects is facilitated by a thorough investigation of a VBHC dilemma combined with an in-depth stakeholder analysis. CONCLUSION In medical residency training programmes, competency development through active participation in projects with societally relevant healthcare themes-such as VBHC-was found to be a promising strategy. From a resident's perspective, combining a thorough investigation of the VBHC dilemma with an in-depth stakeholder analysis is key to the successful implementation of a VBHC project.
Collapse
Affiliation(s)
- Sanne Vaassen
- Department of Pediatrics, Maastricht UMC+, Maastricht, The Netherlands
| | - Brigitte A B Essers
- Department of Health Services Research, CAPHRI Care and Public Health Research Institute, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Lorette A Stammen
- School of Health Professions Education, Maastricht University, Maastricht, The Netherlands
| | - Kieran Walsh
- Clinical Director, BMJ Knowledge Centre, London, UK
| | | | - Silvia M A A Evers
- Department of Health Services Research, CAPHRI Care and Public Health Research Institute, Maastricht University Medical Centre, Maastricht, The Netherlands
- Trimbos, Netherlands Institute of Mental Health and Addiction, Utrecht, The Netherlands
| | - Ide Heyligers
- School of Health Professions Education, Maastricht University, Maastricht, The Netherlands
| | - Laurents P S Stassen
- Department of Surgery, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Walther N K A van Mook
- School of Health Professions Education, Maastricht University, Maastricht, The Netherlands
- Department of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
- Academy of Postgraduate Medical Education, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Cindy Y G Noben
- Academy of Postgraduate Medical Education, Maastricht University Medical Centre, Maastricht, The Netherlands
| |
Collapse
|
13
|
Mayo AL, Wong BM. Starting off on the right foot: providing timely feedback to learners in quality improvement education. BMJ Qual Saf 2021; 31:263-266. [PMID: 34551994 DOI: 10.1136/bmjqs-2021-013251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/21/2021] [Indexed: 11/04/2022]
Affiliation(s)
- Amanda L Mayo
- Division of Physical Medicine and Rehabilitation, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.,Centre for Quality Improvement and Patient Safety (CQuIPS), Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Brian M Wong
- Centre for Quality Improvement and Patient Safety (CQuIPS), Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada .,Division of General Internal Medicine, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
14
|
Abumostafa A, Mostafa FA, Al-Kattan K, Alkateb R, Alayesh A, Adem F, Salaas N, Zeitouni OM, Alabdaljabar MS, Chowdhury Z. Assessment of Knowledge About Patient Safety Concepts Among Medical and Pharmacy Students. GLOBAL JOURNAL ON QUALITY AND SAFETY IN HEALTHCARE 2021; 4:53-57. [PMID: 37260790 PMCID: PMC10228988 DOI: 10.36401/jqsh-20-26] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 01/08/2021] [Accepted: 02/17/2021] [Indexed: 06/02/2023]
Abstract
Introduction Patient safety is a central principle of healthcare professional practice that requires a significant consideration within the teaching curricula; however, there is a lack of special courses that focus on patient safety concepts in an integrated way in many countries. This study aims to assess the knowledge of medical and pharmacy students regarding patient safety concepts. Methods A cross-sectional study was conducted at Alfaisal University during the 2018-2019 school year. A survey consisting of 15 questions was designed with the help of the quality and patient safety department at King Faisal Specialist Hospital and Research Centre, Riyadh (KFSHRC). The survey was validated and then electronically distributed to all students enrolled in the College of Medicine and College of Pharmacy. Results A total of 304 (22%) of 1368 students completed the survey. The survey revealed that 51% of students had an acceptable understanding of the types of human error; however, 53% of students had little knowledge about the factors that lead to these errors and 61% did not know how to report an error. Many students (41%) reported being directly involved in an unsafe situation that may cause patient harm, such as a healthcare-related error, adverse event, or inconsistent care. Most students (90%) agreed that hiding errors to avoid further implications is unethical and reporting errors is the responsibility of every healthcare provider. Conclusion Most Alfaisal University students understand the significance of patient safety education and understand the types of human errors, yet the causes of errors and the protocols for reporting them were not well understood by most students.
Collapse
Affiliation(s)
| | - Fadwa Abu Mostafa
- Quality Management Department, King Faisal Specialist Hospital and Research Centre, Madina, Saudi Arabia
| | | | - Rana Alkateb
- Quality Management Department, King Faisal Specialist Hospital and Research Centre, Riyadh, Saudi Arabia
| | - Aljohara Alayesh
- Quality Management Department, King Faisal Specialist Hospital and Research Centre, Riyadh, Saudi Arabia
| | - Fatima Adem
- College of Medicine, Alfaisal University, Riyadh, Saudi Arabia
| | - Nada Salaas
- College of Pharmacy, Alfaisal University, Riyadh, Saudi Arabia
| | | | | | - Zarin Chowdhury
- College of Medicine, Alfaisal University, Riyadh, Saudi Arabia
| |
Collapse
|
15
|
Kataife ED, Said S, Braun J, Roche TR, Rössler J, Kaserer A, Spahn DR, Mileo FG, Tscholl DW. The Haemostasis Traffic Light, a user-centred coagulation management tool for acute bleeding situations: a simulation-based randomised dual-centre trial. Anaesthesia 2020; 76:902-910. [PMID: 33210309 DOI: 10.1111/anae.15314] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/16/2020] [Indexed: 12/14/2022]
Abstract
The Haemostasis Traffic Light is a cognitive aid with a user-centred design to enhance and simplify situation awareness and decision-making during peri-operative bleeding. Its structure helps to prioritise therapeutic interventions according to the pathophysiology and the severity of the bleeding. This investigator-initiated, randomised, prospective, international, dual-centre study aimed to validate the Haemostasis Traffic Light by adapting it to the local coagulation protocols of two university hospitals. Between 9 January and 12 May 2020, we recruited 84 participants at the University Hospital Zurich, Switzerland, and the Italian Hospital of Buenos Aires, Argentina. Each centre included 21 resident and 21 staff anaesthetists. Participants were randomly allocated to either the text-based algorithm or the Haemostasis Traffic Light. All participants managed six bleeding scenarios using the same algorithm. In simulated bleeding scenarios, the design of the Haemostasis Traffic Light algorithm enabled more correctly solved cases, OR (95%CI) 7.23 (3.82-13.68), p < 0.001, and faster therapeutic decisions, HR (95%CI) 1.97 (1.18-3.29, p = 0.010). In addition, the tool improved therapeutic confidence, OR (95%CI) 4.31 (1.67-11.11, p = 0.003), and reduced perceived work-load coefficient (95%CI) -6.1 (-10.98 to -1.22), p = 0.020). This study provides empirical evidence for the importance of user-centred design in the development of haemostatic management protocols.
Collapse
Affiliation(s)
- E D Kataife
- Department of Anaesthesiology, Hospital Italiano de Buenos Aires, Argentina
| | - S Said
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Switzerland
| | - J Braun
- Departments of Epidemiology and Biostatistics, Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Switzerland
| | - T R Roche
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Switzerland
| | - J Rössler
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Switzerland
| | - A Kaserer
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Switzerland
| | - D R Spahn
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Switzerland
| | - F G Mileo
- Department of Anaesthesiology, Hospital Italiano de Buenos Aires, Argentina
| | - D W Tscholl
- Institute of Anaesthesiology, University of Zurich and University Hospital Zurich, Switzerland
| |
Collapse
|
16
|
Said S, Gozdzik M, Roche TR, Braun J, Rössler J, Kaserer A, Spahn DR, Nöthiger CB, Tscholl DW. Validation of the Raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) Questionnaire to Assess Perceived Workload in Patient Monitoring Tasks: Pooled Analysis Study Using Mixed Models. J Med Internet Res 2020; 22:e19472. [PMID: 32780712 PMCID: PMC7506540 DOI: 10.2196/19472] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Revised: 06/29/2020] [Accepted: 08/11/2020] [Indexed: 01/18/2023] Open
Abstract
Background Patient monitoring is indispensable in any operating room to follow the patient’s current health state based on measured physiological parameters. Reducing workload helps to free cognitive resources and thus influences human performance, which ultimately improves the quality of care. Among the many methods available to assess perceived workload, the National Aeronautics and Space Administration Task Load Index (NASA-TLX) provides the most widely accepted tool. However, only few studies have investigated the validity of the NASA-TLX in the health care sector. Objective This study aimed to validate a modified version of the raw NASA-TLX in patient monitoring tasks by investigating its correspondence with expected lower and higher workload situations and its robustness against nonworkload-related covariates. This defines criterion validity. Methods In this pooled analysis, we evaluated raw NASA-TLX scores collected after performing patient monitoring tasks in four different investigator-initiated, computer-based, prospective, multicenter studies. All of them were conducted in three hospitals with a high standard of care in central Europe. In these already published studies, we compared conventional patient monitoring with two newly developed situation awareness–oriented monitoring technologies called Visual Patient and Visual Clot. The participants were resident and staff anesthesia and intensive care physicians, and nurse anesthetists with completed specialization qualification. We analyzed the raw NASA-TLX scores by fitting mixed linear regression models and univariate models with different covariates. Results We assessed a total of 1160 raw NASA-TLX questionnaires after performing specific patient monitoring tasks. Good test performance and higher self-rated diagnostic confidence correlated significantly with lower raw NASA-TLX scores and the subscores (all P<.001). Staff physicians rated significantly lower workload scores than residents (P=.001), whereas nurse anesthetists did not show any difference in the same comparison (P=.83). Standardized distraction resulted in higher rated total raw NASA-TLX scores (P<.001) and subscores. There was no gender difference regarding perceived workload (P=.26). The new visualization technologies Visual Patient and Visual Clot resulted in significantly lower total raw NASA-TLX scores and all subscores, including high self-rated performance, when compared with conventional monitoring (all P<.001). Conclusions This study validated a modified raw NASA-TLX questionnaire for patient monitoring tasks. The scores obtained correctly represented the assumed influences of the examined covariates on the perceived workload. We reported high criterion validity. The NASA-TLX questionnaire appears to be a reliable tool for measuring subjective workload. Further research should focus on its applicability in a clinical setting.
Collapse
Affiliation(s)
- Sadiq Said
- Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
| | - Malgorzata Gozdzik
- Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
| | - Tadzio Raoul Roche
- Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
| | - Julia Braun
- Department of Epidemiology and Biostatistics, University of Zurich, Zurich, Switzerland
| | - Julian Rössler
- Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
| | - Alexander Kaserer
- Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
| | - Donat R Spahn
- Department of Anesthesiology, University Hospital Zurich, Zurich, Switzerland
| | | | | |
Collapse
|