1
|
Horne CA, Hepworth D, Saunders E, Keenan ID. Everyone can draw: An inclusive and transformative activity for conceptualization of topographic anatomy. ANATOMICAL SCIENCES EDUCATION 2024. [PMID: 38825620 DOI: 10.1002/ase.2460] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 03/18/2024] [Accepted: 05/08/2024] [Indexed: 06/04/2024]
Abstract
Anatomical drawing traditionally involves illustration of labeled diagrams on two-dimensional surfaces to represent topographical features. Despite the visual nature of anatomy, many learners perceive that they lack drawing skills and do not engage in art-based learning. Recent advances in the capabilities of technology-enhanced learning have enabled the rapid and inexpensive production of three-dimensional anatomical models. This work describes a "drawing on model" activity in which learners observe and draw specific structures onto three-dimensional models. Sport and exercise sciences (SES, n = 79) and medical (MED, n = 156) students at a United Kingdom medical school completed this activity using heart and femur models, respectively. Learner demographics, their perceptions of anatomy learning approaches, the value of the activity, and their confidence in understanding anatomical features, were obtained via validated questionnaire. Responses to 7-point Likert-type and free-text items were analyzed by descriptive statistics and semi-quantitative content analysis. Learners valued art-based study (SES mean = 5.94 SD ±0.98; MED = 5.92 ± 1.05) and the "drawing on model" activity (SES = 6.33 ± 0.93; MED = 6.21 ± 0.94) and reported enhanced confidence in understanding of cardiac anatomy (5.61 ± 1.11), coronary arteries (6.03 ± 0.83), femur osteology (6.07 ± 1.07), and hip joint muscle actions (5.80 ± 1.20). Perceptions of learners were independent of both their sex and their art-based study preferences (p < 0.05). Themes constructed from free-text responses identified "interactivity," "topography," "transformative," and "visualization," as key elements of the approach, in addition to revealing some limitations. This work will have implications for anatomy educators seeking to engage learners in an inclusive, interactive, and effective learning activity for supporting three-dimensional anatomical understanding.
Collapse
Affiliation(s)
- Carly A Horne
- School of Biomedical, Nutritional and Sport Sciences, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - David Hepworth
- School of Medicine, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Emma Saunders
- School of Medicine, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Iain D Keenan
- School of Medicine, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|
2
|
Gomez K, Edwards HL, Kirby J. Livestreaming clinical experience to remotely located learners: A critical narrative review. MEDICAL EDUCATION 2024. [PMID: 38606897 DOI: 10.1111/medu.15392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 03/04/2024] [Accepted: 03/06/2024] [Indexed: 04/13/2024]
Abstract
CONTEXT Medical education relies on real patient learning (RPL) to provide medical students with essential clinical experience. However, growing demand for clinical placements continues to be a challenge in providing sufficient RPL opportunities. The COVID-19 pandemic forced academic institutions to rethink the delivery of traditional clinical training and innovations in online clinical learning experiences, specifically livestreamed clinical experiences, have emerged which show promise in addressing the capacity limitations of traditional placements. Although previous reviews have explored the use of livestreamed clinical experiences during the pandemic, there is a lack of rigorous theoretical framing to support these innovations. OBJECTIVES The aim of this review is two-fold: to examine the effectiveness of livestreamed clinical experiences through an experience-based learning (ExBL) theory perspective and to provide practical recommendations to optimise and implement these innovations. METHODS A review of literature was conducted to identify journal articles published between September 2019 and January 2023 reporting on innovations relating to livestreamed clinical experiences. The search focused on undergraduate and postgraduate medical education but relevant evidence from other healthcare professions were also included due to a limited evidence base. Strengths and weaknesses were derived from the literature and analysed in relation to ExBL components. RESULTS Principal strengths of livestreamed clinical experiences included expanded access to RPL opportunities and medical specialties, enhanced standardisation of learning experiences and positive perceptions from students regarding convenience. Clinical educators found these innovations enabled teaching at scale. Patients did not perceive such innovations to negatively impact their standard of care. Limitations included the inability to practice physical examination skills, challenges in ensuring learner engagement and connectivity issues. CONCLUSION Livestreamed clinical experiences have the potential to effectively expand placement capacity and provide high-quality educational experiences for medical students. Although certain limitations exist, technological and pedagogical adaptations can help overcome these challenges. The application of theoretical frameworks to future online innovations will be fundamental to ensure effective clinical learning.
Collapse
Affiliation(s)
- Kelvin Gomez
- Leeds Institute of Medical Education, Leeds School of Medicine, University of Leeds, Leeds, UK
| | - Helen L Edwards
- Leeds Institute of Health Sciences, Leeds School of Medicine, University of Leeds, Leeds, UK
| | - Jane Kirby
- Leeds Institute of Health Sciences, Leeds School of Medicine, University of Leeds, Leeds, UK
| |
Collapse
|
3
|
Campion JR, Cantillon P. A corporeal conundrum: Challenges posed by remote consultation for postgraduate medical education. CLINICAL TEACHER 2024; 21:e13672. [PMID: 37811728 DOI: 10.1111/tct.13672] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 09/08/2023] [Indexed: 10/10/2023]
Abstract
BACKGROUND The COVID-19 pandemic accelerated the use of remote consultation in hospital outpatient clinics. Remote consultation alters the clinical environment and the learning environment in ways that are incompletely understood. This research sought to explore how trainees negotiate training and learning in such an environment when it is novel to them. METHODS Purposive sampling was used to recruit eight doctors from the gastroenterology department of an academic teaching hospital. Four consultants and four trainees participated in individual, semi-structured interviews. Interpretative phenomenological analysis of interview transcripts was employed and themes developed from the analysis, to characterise the experience of learning and teaching in remote consultation clinics, as described by participants. RESULTS Participants described how they try to create mental representations of each patient they review by remote consultation. Whilst consultants found this task relatively easy, trainee physicians found remote consultation more challenging and highlighted the importance of the physical presence of the patient to help them form a holistic sense of the patient's condition. Doctors in training also struggled to develop a workable mental model of the patient's condition when physical examination was precluded by remote consultation. CONCLUSIONS This study highlights the place of the patient's physical presence as an essential educational stimulus to facilitate teaching and learning. Further research is needed to characterise the processes clinicians use to formulate mental models of patients who are physically absent from the consultation room.
Collapse
Affiliation(s)
- John R Campion
- School of Medicine, University of Galway, Galway, Ireland
| | - Peter Cantillon
- Discipline of General Practice, University of Galway, Galway, Ireland
| |
Collapse
|
4
|
van der Merwe LJ, van Zyl S, Joubert G. "But This Is the New Reality, and I Will Adapt": Understanding Lecturers' Experiences of COVID-19 Lockdown Online Learning and Teaching. MEDICAL SCIENCE EDUCATOR 2024; 34:89-102. [PMID: 38510388 PMCID: PMC10948629 DOI: 10.1007/s40670-023-01925-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/19/2023] [Indexed: 03/22/2024]
Abstract
Following the 2020 COVID-19 pandemic national lockdown in South Africa, the University of the Free State launched various support initiatives for academic staff and students. Teaching and learning activities and assessments were adapted for emergency remote teaching. Students and academic staff members experienced disruption due to the migration to the online environment. This study aimed to investigate the experiences of academic staff members in an undergraduate medical programme using a mixed-methods approach in the form of a sequential exploratory design in two phases. Quantitative data were obtained through an online questionnaire survey that were triangulated and complemented with qualitative data obtained from responses to open questions in the questionnaire survey and online reflective essays. Quantitative data revealed that although most academic staff members had received training in and used mostly administrative functions in the learning management system (Blackboard) prior to lockdown, its uses almost doubled during the lockdown. Qualitative data analysis gave an in-depth understanding of academic staff members' experiences identified in the themes Teaching and Learning, Assessment, Technology, Communication, and Personal Experience. Concerns were expressed regarding students' access to technology and adaptation to online learning, and training needs and challenges were identified. The lessons learnt through the resilient, transformative responses to this global disruptor can guide future strategies for medical education.
Collapse
Affiliation(s)
- Lynette J. van der Merwe
- Division Health Sciences Education, Office of the Dean, Faculty of Health Sciences, University of the Free State, PO Box 339, Bloemfontein, 9300 South Africa
| | - Sanet van Zyl
- Department of Basic Medical Sciences, Faculty of Health Sciences, University of the Free State, PO Box 339, Bloemfontein, 9300 South Africa
| | - Gina Joubert
- Department of Biostatistics, Faculty of Health Sciences, University of the Free State, PO Box 339, Bloemfontein, 9300 South Africa
| |
Collapse
|
5
|
Patel R, Bannister SL, Degelman E, Sharma T, Beran TN, Lewis M, Novak C. Online Learning in Medical Student Clerkship: A Survey of Student Perceptions and Future Directions. Cureus 2024; 16:e54541. [PMID: 38516469 PMCID: PMC10956628 DOI: 10.7759/cureus.54541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/19/2024] [Indexed: 03/23/2024] Open
Abstract
Background The coronavirus disease 2019 (COVID-19) pandemic had a major impact on medical education with clerkship students abruptly removed from clinical activities in 2020 and hastily immersed in online learning to maintain medical education. In 2022, students returned to in-person clinical experiences, but synchronous learning sessions continued online with extensive use of asynchronous online resources. This change offers a unique opportunity to gather information about students' perspectives regarding the acceptability and effectiveness of online learning strategies. This study aims to explore the clerkship student experience with the integration of online learning and in-person learning into formalized educational sessions in clerkship. Methodology The authors administered an online survey to clerkship students at the Cumming School of Medicine at the University of Calgary, Canada in spring 2022. The survey consisted of primarily Likert-style questions to explore the perceived effectiveness of various online learning strategies. Results are reported as the proportion selecting "quite effective" or "extremely effective." Results A total of 89 students responded to the survey (57.4% of graduating class). For synchronous online learning, case-based learning was perceived as the most effective teaching strategy (61.8%), and audience response systems were the most effective strategy for improving audience engagement (70.1%). For asynchronous online learning, interactive cases (84.9%) and student-developed online study guides (83.6%) were perceived as the most effective. Students held varying perceptions regarding how online learning impacted their well-being. When considering future clerkship curricula, the majority of clerkship students preferred a blend of in-person and online learning. Conclusions This study identified that most clerkship students prefer a hybrid of in-person and online learning and that ideal online learning curricula could include case-based learning, audience response systems, and a variety of asynchronous learning resources. These results can guide curriculum development and design at other medical institutions.
Collapse
Affiliation(s)
- Rina Patel
- Postgraduate Medical Education, University of Calgary, Calgary, CAN
| | | | - Erin Degelman
- Postgraduate Medical Education, University of Calgary, Calgary, CAN
| | - Tejeswin Sharma
- Postgraduate Medical Education, University of Manitoba, Winnipeg, CAN
| | - Tanya N Beran
- Community Health Sciences, University of Calgary, Calgary, CAN
| | | | - Chris Novak
- Pediatrics, University of Calgary, Calgary, CAN
| |
Collapse
|
6
|
Liang JZ, Ng DKW, Raveendran V, Teo MYK, Quah ELY, Chua KZY, Lua JK, Owyong JLJ, Vijayan AV, Abdul Hamid NAB, Yeoh TT, Ong EK, Phua GLG, Mason S, Fong W, Lim C, Woong N, Ong SYK, Krishna LKR. The impact of online education during the Covid-19 pandemic on the professional identity formation of medical students: A systematic scoping review. PLoS One 2024; 19:e0296367. [PMID: 38181035 PMCID: PMC10769105 DOI: 10.1371/journal.pone.0296367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 12/09/2023] [Indexed: 01/07/2024] Open
Abstract
Evolving individual, contextual, organizational, interactional and sociocultural factors have complicated efforts to shape the professional identity formation (PIF) of medical students or how they feel, act and think as professionals. However, an almost exclusive reliance on online learning during the COVID-19 pandemic offers a unique opportunity to study the elemental structures that shape PIF and the environmental factors nurturing it. We propose two independent Systematic Evidence-Based Approach guided systematic scoping reviews (SSR in SEBA)s to map accounts of online learning environment and netiquette that structure online programs. The data accrued was analysed using the clinically evidenced Krishna-Pisupati Model of Professional Identity Formation (KPM) to study the evolving concepts of professional identity. The results of each SSR in SEBA were evaluated separately with the themes and categories identified in the Split Approach combined to create richer and deeper 'themes/categories' using the Jigsaw Perspective. The 'themes/categories' from each review were combined using the Funnelling Process to create domains that guide the discussion. The 'themes/categories' identified from the 141 included full-text articles in the SSR in SEBA of online programs were the content and effects of online programs. The themes/categories identified from the 26 included articles in the SSR in SEBA of netiquette were guidelines, contributing factors, and implications. The Funnelling Process identified online programs (encapsulating the content, approach, structures and the support mechanisms); their effects; and PIF development that framed the domains guiding the discussion. This SSR in SEBA identifies the fundamental elements behind developing PIF including a structured program within a nurturing environment confined with netiquette-guided boundaries akin to a Community of Practice and the elemental aspect of a socialisation process within online programs. These findings ought to be applicable beyond online training and guide the design, support and assessment of efforts to nurture PIF.
Collapse
Affiliation(s)
- Jonathan Zhen Liang
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Donovan Kai Wei Ng
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Vijayprasanth Raveendran
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Mac Yu Kai Teo
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Elaine Li Ying Quah
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Keith Zi Yuan Chua
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | - Jun Kiat Lua
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
| | | | - Andrew Vimal Vijayan
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
| | | | - Ting Ting Yeoh
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Department of Pharmacy, National Cancer Centre Singapore, Singapore, Singapore
| | - Eng Koon Ong
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Assisi Hospice, Singapore, Singapore
| | - Gillian Li Gek Phua
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Lien Centre for Palliative Care, Duke-NUS Medical School, Singapore, Singapore
| | - Stephen Mason
- Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, University of Liverpool, Liverpool, United Kingdom
| | - Warren Fong
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Department of Rheumatology and Immunology, Singapore General Hospital, Singapore, Singapore
| | - Crystal Lim
- Medical Social Services, Singapore General Hospital, Singapore, Singapore
| | - Natalie Woong
- Department of Internal Medicine, Singapore General Hospital, Singapore, Singapore
| | - Simon Yew Kuang Ong
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Division of Medical Oncology, National Cancer Centre Singapore, Singapore, Singapore
| | - Lalit Kumar Radha Krishna
- Yong Loo Lin School of Medicine, National University Singapore, Singapore, Singapore
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore
- Division of Cancer Education, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Palliative Care Institute Liverpool, Academic Palliative & End of Life Care Centre, University of Liverpool, Liverpool, United Kingdom
- PalC, The Palliative Care Centre for Excellence in Research and Education, Singapore, Singapore
| |
Collapse
|
7
|
Wu JF, Abenoza N, Bosco JM, Minshew LM, Beckius A, Kastner M, Hilgeman B, Muntz MD. COVID-19 vaccination telephone outreach: an analysis of the medical student experience. MEDICAL EDUCATION ONLINE 2023; 28:2207249. [PMID: 37104856 PMCID: PMC10142334 DOI: 10.1080/10872981.2023.2207249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 03/30/2023] [Accepted: 04/21/2023] [Indexed: 06/19/2023]
Abstract
INTRODUCTION The COVID-19 pandemic diminished opportunities for medical students to gain clinical confidence and the ability to contribute to patient care. Our study sought out to understand the value of telephone outreach to schedule COVID-19 vaccines on medical student education. MATERIALS AND METHODS Forty students engaged in telephone outreach targeting patients aged 65+ without active patient portals to schedule COVID-19 vaccines. Data consisted of a single administration retrospective pre/post survey inquiring about what students learned, expectations, other health-care processes that would benefit from outreach, and interest in a population health elective. Likert items were analyzed and open response analysis involved inductive coding and generation of thematic summaries by condensing codes into broader themes. Demographic data of patients called and subsequently received the vaccine were also collected. RESULTS There were 33 survery respondents. There was a statistically significant increase in net comfortability for pre-clerkship students for documenting in Epic, providing telehealth care, counseling on common health-care myths, having challenging conversations, cold-calling patients, and developing an initial trusting relationship with patients. The majority called and who received the vaccine were non-Hispanic Black, within the high SVI category, and had Medicare and/or Medicaid. Qualitative data showed that students emphasized communication, the role of trusted messengers, the need to be open minded, and meeting patients where they are. DISCUSSION Engaging students in telephone outreach early in the COVID-19 pandemic provided students the opportunity to develop their skills as physicians-in-training, contribute to combating the ongoing pandemic, and add value to the primary care team. This experience allowed students to practice patience, empathy, and vulnerability to understand why patients had not received the COVID-19 vaccine; this was an invaluable experience that helped students develop the skills to become empathetic and caring physicians, and supports the continued role of telehealth in future medical school curriculum.
Collapse
Affiliation(s)
- James F. Wu
- Department of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Nathalie Abenoza
- Department of Medicine and Psychiatry, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Julia M. Bosco
- School of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Lana M. Minshew
- Robert D. and Patricia Kern Institute for the Transformation of Medical Education, Medical College of Wisconsin, Milwaukee, WI, USA
- School of Pharmacy, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Anna Beckius
- Department of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Mandy Kastner
- Department of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Brian Hilgeman
- Department of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Martin D. Muntz
- Department of Medicine, Medical College of Wisconsin, Milwaukee, WI, USA
- Robert D. and Patricia Kern Institute for the Transformation of Medical Education, Medical College of Wisconsin, Milwaukee, WI, USA
| |
Collapse
|
8
|
Maggio LA, Byington CL, Toner ES, Kanter SL. A Chief Health Security Officer for Every Academic Health Center: Improving Readiness, Response, Recovery, and Resilience. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:1247-1250. [PMID: 37556815 DOI: 10.1097/acm.0000000000005435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/11/2023]
Abstract
Academic health centers (AHCs) require expertise to ensure readiness for health security events, such as cyberattacks, natural disasters, and pandemics, as well as the ability to respond to and recover from these events. However, most AHCs lack an individual to coordinate efforts at an enterprise level across academic and operational units during an emergency; elevate the coordination of individual AHCs with local and state public health entities; and through professional organizations, coordinate the work of AHCs across national and international public health entities. Informed by AHCs' responses to the COVID-19 pandemic and a series of focused meetings in 2021 of the Association of Academic Health Centers President's Council on Health Security, the authors propose creating a new C-suite role to meet these critical needs: the chief health security officer (CHSO). The CHSO would be responsible for the AHC's overall health security and would report to the AHC's chief executive officer or president. The authors describe the role of CHSO in relation to the preparation, response, and recovery phases of public health events necessary for health security. They also propose key duties for this position and encourage institutions to offer training and credentials to facilitate the creation and define the portfolios of CHSO positions at AHCs and beyond.
Collapse
Affiliation(s)
- Lauren A Maggio
- L.A. Maggio is professor of medicine and health professions education, Uniformed Services University of the Health Sciences, Bethesda, Maryland; ORCID: http://orcid.org/0000-0002-2997-6133
| | - Carrie L Byington
- C.L. Byington is executive vice president, University of California Health, Oakland, California; ORCID: https://orcid.org/0000-0002-7350-9495
| | - Eric S Toner
- E.S. Toner is senior associate, Center for Health Security, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland; ORCID: https://orcid.org/0000-0001-5292-9450
| | - Steven L Kanter
- S.L. Kanter is special advisor to the president and CEO, Association of American Medical Colleges, Washington, DC; ORCID: https://orcid.org/0000-0002-0436-1503
| |
Collapse
|
9
|
Harrison M, Hall L, Alberti H. How will the Covid-19 pandemic shape the future of primary care undergraduate teaching? Understanding modifications and developments deployed by UK academic units of primary care, and their implications for the future. BMC MEDICAL EDUCATION 2023; 23:746. [PMID: 37817183 PMCID: PMC10566052 DOI: 10.1186/s12909-023-04710-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 09/21/2023] [Indexed: 10/12/2023]
Abstract
BACKGROUND Primary care has been under-represented in its contribution to the academic literature base on Covid-19 developments. We sought to understand how teaching and learning was modified and developed by primary care academic leaders to support the continuation of primary care-orientated learning during the Covid-19 pandemic; and explore how these changes may shape future educational delivery in primary care. METHODS We adopted a qualitative approach, using semi-structured interviews of seven General Practice Heads of Teaching (GP HoTs) from UK medical schools. We used mixed deductive and inductive coding to analyse interview transcripts. Modifications and developments were coded to four a priori themes (clinical off-site; clinical on-site; synchronous remote; asynchronous remote). We concurrently used inductive coding to identify developments that did not readily fit into these categories. To understand how participants perceived the developments may shape primary care teaching in the future, we carried out an inductive thematic analysis. RESULTS A range of modifications and developments were described. Examples of developments include: GP practices being provided with increased flexibility to support ongoing provision of clinical placements (on-site clinical), examples of initiatives enabling students to consult remotely from their homes (off-site clinical), transfer of face-to-face teaching to remote formats (synchronous remote) and development of new, interactive on-line teaching materials (asynchronous remote). One additional theme arose inductively: collaboration and co-operation. For future implications, five themes arose: the evolution of flexible and hybrid clinical placement models; an increased role for telemedicine; increased networking and collaboration; increased active student involvement in patient care; and opportunities for community-based teaching afforded by the pandemic. CONCLUSION This study highlights how teaching was modified to support the continuation of primary care-based learning during the Covid-19 pandemic, and implications for the future. Collaboration and placement flexibility were notable features in the response. Participants perceived that flexible placement models containing a mixture of clinical on-site with remote synchronous and asynchronous teaching and learning activities, may persist into the post-Covid era. Further research is required to understand which developments become routinely embedded into primary care teaching in the post-Covid era and explain how and why this occurs.
Collapse
Affiliation(s)
- Michael Harrison
- School of Medical Education, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK.
| | - Lauren Hall
- School of Medical Education, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| | - Hugh Alberti
- School of Medical Education, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|
10
|
Mack J, Houchens N. Harness education technology for effective teaching in the modern era. J Hosp Med 2023; 18:953-956. [PMID: 37439114 DOI: 10.1002/jhm.13165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 06/18/2023] [Accepted: 06/22/2023] [Indexed: 07/14/2023]
Affiliation(s)
- Jacob Mack
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Nathan Houchens
- Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, Michigan, USA
- Medicine Service, Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, Michigan, USA
| |
Collapse
|
11
|
Borges do Nascimento IJ, Abdulazeem H, Vasanthan LT, Martinez EZ, Zucoloto ML, Østengaard L, Azzopardi-Muscat N, Zapata T, Novillo-Ortiz D. Barriers and facilitators to utilizing digital health technologies by healthcare professionals. NPJ Digit Med 2023; 6:161. [PMID: 37723240 PMCID: PMC10507089 DOI: 10.1038/s41746-023-00899-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 08/01/2023] [Indexed: 09/20/2023] Open
Abstract
Digital technologies change the healthcare environment, with several studies suggesting barriers and facilitators to using digital interventions by healthcare professionals (HPs). We consolidated the evidence from existing systematic reviews mentioning barriers and facilitators for the use of digital health technologies by HP. Electronic searches were performed in five databases (Cochrane Database of Systematic Reviews, Embase®, Epistemonikos, MEDLINE®, and Scopus) from inception to March 2023. We included reviews that reported barriers or facilitators factors to use technology solutions among HP. We performed data abstraction, methodological assessment, and certainty of the evidence appraisal by at least two authors. Overall, we included 108 reviews involving physicians, pharmacists, and nurses were included. High-quality evidence suggested that infrastructure and technical barriers (Relative Frequency Occurrence [RFO] 6.4% [95% CI 2.9-14.1]), psychological and personal issues (RFO 5.3% [95% CI 2.2-12.7]), and concerns of increasing working hours or workload (RFO 3.9% [95% CI 1.5-10.1]) were common concerns reported by HPs. Likewise, high-quality evidence supports that training/educational programs, multisector incentives, and the perception of technology effectiveness facilitate the adoption of digital technologies by HPs (RFO 3.8% [95% CI 1.8-7.9]). Our findings showed that infrastructure and technical issues, psychological barriers, and workload-related concerns are relevant barriers to comprehensively and holistically adopting digital health technologies by HPs. Conversely, deploying training, evaluating HP's perception of usefulness and willingness to use, and multi-stakeholders incentives are vital enablers to enhance the HP adoption of digital interventions.
Collapse
Affiliation(s)
- Israel Júnior Borges do Nascimento
- Division of Country Health Policies and Systems (CPS), World Health Organization Regional Office for Europe, Copenhagen, 2100, Denmark
- Pathology and Laboratory Medicine, Medical College of Wisconsin, Milwaukee, WI, 53226-3522, USA
| | - Hebatullah Abdulazeem
- Department of Sport and Health Science, Techanische Universität München, Munich, 80333, Germany
| | - Lenny Thinagaran Vasanthan
- Physical Medicine and Rehabilitation Department, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - Edson Zangiacomi Martinez
- Department of Social Medicine and Biostatistics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, 14049-900, Brazil
| | - Miriane Lucindo Zucoloto
- Department of Social Medicine and Biostatistics, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, 14049-900, Brazil
| | - Lasse Østengaard
- Centre for Evidence-Based Medicine Odense (CEBMO) and Cochrane Denmark, Department of Clinical Research, University Library of Southern Denmark, Odense, 5230, Denmark
| | - Natasha Azzopardi-Muscat
- Division of Country Health Policies and Systems (CPS), World Health Organization Regional Office for Europe, Copenhagen, 2100, Denmark
| | - Tomas Zapata
- Division of Country Health Policies and Systems (CPS), World Health Organization Regional Office for Europe, Copenhagen, 2100, Denmark
| | - David Novillo-Ortiz
- Division of Country Health Policies and Systems (CPS), World Health Organization Regional Office for Europe, Copenhagen, 2100, Denmark.
| |
Collapse
|
12
|
Vallo Hult H, Master Östlund C, Pålsson P, Jood K. Designing for digital transformation of residency education - a post-pandemic pedagogical response. BMC MEDICAL EDUCATION 2023; 23:421. [PMID: 37291569 DOI: 10.1186/s12909-023-04390-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Accepted: 05/23/2023] [Indexed: 06/10/2023]
Abstract
BACKGROUND The forced transition to emergency remote teaching (ERT) during the COVID-19 pandemic has significantly impacted health professions education worldwide. In Sweden, the need for alternative solutions for the training of junior doctors became urgent, as many of the mandatory onsite courses required for residents to qualify as specialists were canceled. The purpose of this study was to understand course leaders' perceptions and experiences of using digital technologies, such as video conferencing, to teach medical residents (ST) during the pandemic and beyond. METHODS A qualitative study using semi-structured interviews was conducted with seven course leaders responsible for residency courses during the first year of the pandemic to capture their perceptions and experiences. The interviews were transcribed verbatim and analyzed using thematic analysis, drawing on the technology affordances and constraints theory (TACT) as a framework to explore pedagogical strategies and new teaching practices emerging from the forced use of digital technologies for remote teaching. RESULTS The data analysis revealed affordances of, as well as constraints to, teaching specialist medical training during the pandemic. The findings show that the use of digital conference technologies for ERT can both enable and inhibit social interactions, the interactive learning environment and the utilization of technological features, depending on the individual course leaders' goals of using the technology and the situated context of the teaching. CONCLUSIONS The study reflects the course leaders' pedagogical response to the pandemic, as remote teaching became the only way to provide residency education. Initially, the sudden shift was perceived as constraining, but over time they found new affordances through the enforced use of digital technology that helped them not only to cope with the transition but also to innovate their pedagogical methods. After a rapid, forced shift from on-site to digital courses, it is crucial to utilize experiences to create better preconditions for digital technology to facilitate learning in the future.
Collapse
Affiliation(s)
- Helena Vallo Hult
- School of Business, Economics and IT, University West, Trollhättan, Sweden.
- Department of Planning and Development, NU Hospital Group, Trollhättan, Sweden.
| | | | - Paul Pålsson
- Department of Medical Education, NU Hospital Group, Trollhättan, Sweden
- Department of Clinical Neuroscience, Institute of Neuroscience and Physiology, Sahlgrenska Academy at University of Gothenburg, Gothenburg, Sweden
| | - Katarina Jood
- Department of Clinical Neuroscience, Institute of Neuroscience and Physiology, Sahlgrenska Academy at University of Gothenburg, Gothenburg, Sweden
- Department of Neurology, Sahlgrenska University Hospital, Gothenburg, Sweden
| |
Collapse
|
13
|
Lee J, Choi H, Davis RO, Henning MA. Instructional media selection principles for online medical education and emerging models for the new normal. MEDICAL TEACHER 2023; 45:633-641. [PMID: 36480340 DOI: 10.1080/0142159x.2022.2151884] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
The COVID-19 pandemic, and the resulting need to avoid in-person classes, compelled many faculty members to convert to a completely online instructional format. The literature on selecting media for medical educators, however, provided little assistance for them to make choices that facilitated learning through using alternative online instruction practices. In this study, we addressed the lack of guidance for the use of media to facilitate the effective online medical education. To optimise the transition from face-to-face educational modalities to online learning, we incorporated insights from theories of media synchronicity and learning. We considered the value of existing learning theories in influencing how we could guide entrenched face-to-face educators to online learning practice. Therefore, we employed existing theories and practice to assist in developing an algorithmic approach to guiding these educators. We reassessed the way taxonomies of learning objectives, practice-oriented learning experiences, the social and collaborative features of learning activities, and media synchronicity theory could have augmented face-to-face teaching, and influenced how these could be reconfigured to assist in the transition to online learning. Consequently, we have developed key principles to inform the continuity of design and selection of instructional media in the transition to medical online learning. We have constructed specific criteria for media selection that correspond to the 12 goals of medical learning. We found that the majority of the goals can be more enhanced by synchronous media than asynchronous versions. We discuss the role of instructional media in emergency online medical education as well as emerging models of media selection for the new normal in medical education and future directions for medical education media research.
Collapse
Affiliation(s)
- Jihyun Lee
- Department of Dental Education, School of Dentistry & Dental Research Institute, Seoul National University, Seoul, South Korea
| | - Hyoseon Choi
- Department of Medical Education, Chosun University College of Medicine, Gwangju, South Korea
| | - Robert O Davis
- English Linguistics and Language Technology Department, Hankuk University of Foreign Studies, Seoul, South Korea
| | - Marcus A Henning
- Centre for Medical and Health Sciences Education, Faculty of Medical and Health Sciences, The University of Auckland, Auckland, New Zealand
| |
Collapse
|
14
|
Akselrod S, Collins TE, Hoe C, Seyer J, Tulenko K, Ortenzi F, Berlina D, Sobel H. Building an interdisciplinary workforce for prevention and control of non-communicable diseases: the role of e-learning. BMJ 2023; 381:e071071. [PMID: 37220940 PMCID: PMC10203826 DOI: 10.1136/bmj-2022-071071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Affiliation(s)
| | - Téa E Collins
- Global NCD Platform, World Health Organization, Geneva, Switzerland
| | - Connie Hoe
- Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Julia Seyer
- World Medical Association, Ferney-Voltaire, France
| | - Kate Tulenko
- Global NCD Platform, World Health Organization, Geneva, Switzerland
| | - Flaminia Ortenzi
- Global NCD Platform, World Health Organization, Geneva, Switzerland
| | - Daria Berlina
- Global NCD Platform, World Health Organization, Geneva, Switzerland
| | - Howard Sobel
- Maternal Child Health and Quality Safety, World Health Organization Regional Office for the Western Pacific, Manila, Philippines
| |
Collapse
|
15
|
Shah AP, Walker KA, Walker KG, Hawick L, Cleland J. "It's making me think outside the box at times": a qualitative study of dynamic capabilities in surgical training. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2023; 28:499-518. [PMID: 36287293 PMCID: PMC9607851 DOI: 10.1007/s10459-022-10170-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2022] [Accepted: 09/27/2022] [Indexed: 05/11/2023]
Abstract
Craft specialties such as surgery endured widespread disruption to postgraduate education and training during the pandemic. Despite the expansive literature on rapid adaptations and innovations, generalisability of these descriptions is limited by scarce use of theory-driven methods. In this research, we explored UK surgical trainees' (n = 46) and consultant surgeons' (trainers, n = 25) perceptions of how learning in clinical environments changed during a time of extreme uncertainty (2020/2021). Our ultimate goal was to identify new ideas that could shape post-pandemic surgical training. We conducted semi-structured virtual interviews with participants from a range of working/training environments across thirteen Health Boards in Scotland. Initial analysis of interview transcripts was inductive. Dynamic capabilities theory (how effectively an organisation uses its resources to respond to environmental changes) and its micro-foundations (sensing, seizing, reconfiguring) were used for subsequent theory-driven analysis. Findings demonstrate that surgical training responded dynamically and adapted to external and internal environmental uncertainty. Sensing threats and opportunities in the clinical environment prompted trainers' institutions to seize new ways of working. Learners gained from reconfigured training opportunities (e.g., splitting operative cases between trainees), pan-surgical working (e.g., broader surgical exposure), redeployment (e.g., to medical specialties), collaborative working (working with new colleagues and in new ways) and supervision (shifting to online supervision). Our data foreground the human resource and structural reconfigurations, and technological innovations that effectively maintained surgical training during the pandemic, albeit in different ways. These adaptations and innovations could provide the foundations for enhancing surgical education and training in the post-pandemic era.
Collapse
Affiliation(s)
- Adarsh P Shah
- Centre for Healthcare Education Research and Innovation (CHERI), School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, AB25 2ZD, UK.
| | - Kim A Walker
- Centre for Healthcare Education Research and Innovation (CHERI), School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, AB25 2ZD, UK
| | - Kenneth G Walker
- NHS Education for Scotland, Centre for Health Science, Inverness, UK
| | - Lorraine Hawick
- Centre for Healthcare Education Research and Innovation (CHERI), School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, AB25 2ZD, UK
| | - Jennifer Cleland
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
16
|
Harrison NJ, Schaffer AJ, Brady DW. Comparing and Contrasting the Experiences of U.S. Medical Students During the COVID-19 and 1918 Influenza Pandemics. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:555-562. [PMID: 36538664 PMCID: PMC10121242 DOI: 10.1097/acm.0000000000005125] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
In March 2020, medical students across the United States were pulled from their in-person responsibilities and learning in response to COVID-19. Leaders in the U.S. medical education system then began the arduous task of determining when, and how, to restore their full scope of training. This challenge was complicated by a paucity of readily available historical information about U.S. medical students in pandemics. To fill this knowledge gap, the authors collaborated with a medical history archivist to describe the experience of U.S. medical students during the 1918 influenza pandemic and compare it with the modern day. The experiences and responsibilities of medical students differed tremendously between the 2 pandemics. In 1918, U.S. medical students typically were conscripted into clinical service if they did not volunteer, assuming the roles of physicians, physician assistants, and nurses, often with atypically high levels of autonomy. Medical students were at great risk during the 1918 pandemic; multiple medical schools recorded students dying from influenza. In contrast, during the early COVID-19 pandemic, U.S. medical students were removed from the clinical environment, even if they wanted to volunteer, assuming ancillary roles instead. Upon returning to the clinical environment, most were not permitted to care for COVID-19 patients. The few medical students who recorded personal narratives about 1918 felt that caring for patients with influenza significantly influenced their growth and development as future physicians. One of the few things U.S. medical education had in common between the 1918 and COVID-19 pandemics was a lack of preparedness that impaired readiness and increased confusion among medical students. As U.S. medical education reflects on its response to COVID-19, the authors hope that their findings will provide context for future discussions and decisions about the role of medical students in pandemics.
Collapse
Affiliation(s)
- Noah J. Harrison
- N.J. Harrison is a medical student, Vanderbilt University School of Medicine, Nashville, TennesseeORCID: https://orcid.org/0000-0001-7487-9028
| | - Andrew J. Schaffer
- A.J. Schaffer is a medical student, Vanderbilt University School of Medicine, Nashville, TennesseeORCID: https://orcid.org/0000-0002-7622-0451
| | - Donald W. Brady
- D.W. Brady is senior associate dean, Health Sciences Education, Vanderbilt University School of Medicine, Nashville, TennesseeORCID: https://orcid.org/0000-0002-0955-5278
| |
Collapse
|
17
|
Mohamed Shah MTB, Yeong LC, Cheng LTE, Ang J, Lishan Y, Tan K, Lim CCT. Future Online Radiology Education: The Importance of Curriculum. Korean J Radiol 2023; 24:173-176. [PMID: 36788773 PMCID: PMC9971839 DOI: 10.3348/kjr.2023.0029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 01/12/2023] [Indexed: 02/16/2023] Open
Affiliation(s)
| | - Lim Chee Yeong
- Department of Diagnostic Radiology, Singapore General Hospital, Singapore
| | | | - Jessica Ang
- Educational Development, Office of Medical Education, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Yang Lishan
- Educational Development, Office of Medical Education, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Kevin Tan
- Department of Neurology, National Neuroscience Institute, Singapore.,Duke-NUS Medical School, Singapore
| | - Choie Cheio Tchoyoson Lim
- Duke-NUS Medical School, Singapore.,Department of Neuroradiology, National Neuroscience Institute, Singapore
| |
Collapse
|
18
|
Dedeilia A, Papapanou M, Papadopoulos AN, Karela NR, Androutsou A, Mitsopoulou D, Nikolakea M, Konstantinidis C, Papageorgakopoulou M, Sideris M, Johnson EO, Fitzpatrick S, Cometto G, Campbell J, Sotiropoulos MG. Health worker education during the COVID-19 pandemic: global disruption, responses and lessons for the future-a systematic review and meta-analysis. HUMAN RESOURCES FOR HEALTH 2023; 21:13. [PMID: 36829158 PMCID: PMC9951171 DOI: 10.1186/s12960-023-00799-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 02/01/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND This systematic review and meta-analysis identified early evidence quantifying the disruption to the education of health workers by the COVID-19 pandemic, ensuing policy responses and their outcomes. METHODS Following a pre-registered protocol and PRISMA/AMSTAR-2 guidelines, we systematically screened MEDLINE, EMBASE, Web of Science, CENTRAL, clinicaltrials.gov and Google Scholar from January 2020 to July 2022. We pooled proportion estimates via random-effects meta-analyses and explored subgroup differences by gender, occupational group, training stage, WHO regions/continents, and study end-year. We assessed risk of bias (Newcastle-Ottawa scale for observational studies, RοB2 for randomized controlled trials [RCT]) and rated evidence certainty using GRADE. RESULTS Of the 171 489 publications screened, 2 249 were eligible, incorporating 2 212 observational studies and 37 RCTs, representing feedback from 1 109 818 learners and 22 204 faculty. The sample mostly consisted of undergraduates, medical doctors, and studies from institutions in Asia. Perceived training disruption was estimated at 71.1% (95% confidence interval 67.9-74.2) and learner redeployment at 29.2% (25.3-33.2). About one in three learners screened positive for anxiety (32.3%, 28.5-36.2), depression (32.0%, 27.9-36.2), burnout (38.8%, 33.4-44.3) or insomnia (30.9%, 20.8-41.9). Policy responses included shifting to online learning, innovations in assessment, COVID-19-specific courses, volunteerism, and measures for learner safety. For outcomes of policy responses, most of the literature related to perceptions and preferences. More than two-thirds of learners (75.9%, 74.2-77.7) were satisfied with online learning (postgraduates more than undergraduates), while faculty satisfaction rate was slightly lower (71.8%, 66.7-76.7). Learners preferred an in-person component: blended learning 56.0% (51.2-60.7), face-to-face 48.8% (45.4-52.1), and online-only 32.0% (29.3-34.8). They supported continuation of the virtual format as part of a blended system (68.1%, 64.6-71.5). Subgroup differences provided valuable insights despite not resolving the considerable heterogeneity. All outcomes were assessed as very-low-certainty evidence. CONCLUSION The COVID-19 pandemic has severely disrupted health worker education, inflicting a substantial mental health burden on learners. Its impacts on career choices, volunteerism, pedagogical approaches and mental health of learners have implications for educational design, measures to protect and support learners, faculty and health workers, and workforce planning. Online learning may achieve learner satisfaction as part of a short-term solution or integrated into a blended model in the post-pandemic future.
Collapse
Affiliation(s)
- Aikaterini Dedeilia
- Department of Surgery, Massachusetts General Hospital, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
| | - Michail Papapanou
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
- Society of Junior Doctors (SJD), Athens, Greece
| | - Andreas N Papadopoulos
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- Department of Hygiene, Epidemiology and Medical Statistics, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Nina-Rafailia Karela
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Anastasia Androutsou
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Dimitra Mitsopoulou
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Melina Nikolakea
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, National and Kapodistrian University of Athens, Athens, Greece
| | - Christos Konstantinidis
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Manthia Papageorgakopoulou
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece
- School of Medicine, University of Patras, Patras, Greece
| | - Michail Sideris
- Barts and the London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom
| | | | | | - Giorgio Cometto
- Health Workforce Department, World Health Organization, Geneva, Switzerland
| | - Jim Campbell
- Health Workforce Department, World Health Organization, Geneva, Switzerland
| | - Marinos G Sotiropoulos
- Harvard Medical School, Boston, MA, USA.
- HEALth Workforce Education (HEAL-Edu) Study Group, Athens, Greece.
- Department of Neurology, Brigham and Women's Hospital & Massachusetts General Hospital, 55 Fruit Street, WACC721, Boston, MA, 02114, USA.
| |
Collapse
|
19
|
Houghton N, Williams L, Baptista A, Thakerar V, Dharmarajah A. Digital clinical placements: Student perspectives and preparedness for placements. CLINICAL TEACHER 2023; 20:e13558. [PMID: 36599293 PMCID: PMC10108031 DOI: 10.1111/tct.13558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Accepted: 11/30/2022] [Indexed: 01/06/2023]
Abstract
BACKGROUND In May 2020, first-year students at Imperial College School of Medicine attended a 'digital hospital placement'. Occurring in the early months of the COVID-19 pandemic, this replaced their first planned hospital placement. The authors analysed student experiences to understand how a digital hospital placement impacted self-perceived clinical and professional development and whether it improved preparedness for face-to-face hospital placements. METHODS Three hundred ten students participated in this week-long digital placement, which integrated clinical skills, communication and professional behaviour domains. It aimed to prepare students for safe participation in clinical environments. Resources included self-directed and peer learning, virtual simulations (Oxford Medical Simulation) and staff-led debriefing. Surveys were administered after the digital placement and after students' first face-to-face placement to collect quantitative and qualitative data. A reflexive thematic analysis was conducted. RESULTS Eighty-three and twenty-nine students completed the postdigital and post-face-to-face placement evaluation respectively. Quantitative results indicated a high self-rated achievement of learning objectives and enthusiasm for digital placements; 83% of respondents supported digital simulations as part of regular medical education. Qualitative analysis identified three superordinate themes: (1) domain integration in digital placements helped students feel better prepared; (2) digital experiential learning is ideally suited to early clinical learning; and (3) virtual placements are a compliment, not an alternative, to face-to-face placements. CONCLUSION Digital placements are a promising means of supporting the challenging transition from classroom learner to clinical learner. They provide a feasible and scalable option for building student confidence and improving preparedness.
Collapse
Affiliation(s)
- Natasha Houghton
- Centre for Engagement and Simulation Science, Imperial College London, London, UK
| | - Lucy Williams
- Faculty of Medicine, Imperial College London, London, UK
| | - Ana Baptista
- Medical Education Research Unit, Faculty of Medicine, Imperial College London, London, UK
| | - Viral Thakerar
- Faculty of Medicine, Imperial College London, London, UK
| | | |
Collapse
|
20
|
Campbell MH, Maharaj S, Khan K, Sa B, Adams OP, Majumder MAA. Resilient Coping is More Important Than Previous Virtual Learning Experience: Predicting Pharmacy Student Stress During the COVID-19 Pandemic. ADVANCES IN MEDICAL EDUCATION AND PRACTICE 2023; 14:443-451. [PMID: 37143569 PMCID: PMC10153405 DOI: 10.2147/amep.s402178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 04/20/2023] [Indexed: 05/06/2023]
Abstract
Purpose The COVID-19 pandemic precipitated a swift transition to online learning in medical and health sciences. This study investigated the associations of previous experience with online learning, current confidence with online learning, and resilient coping skills with perceived stress reported by pharmacy students during the emergency transition to online learning. Methods Undergraduate pharmacy students (N=113, response rate = 41%) completed an online, self-report, cross-sectional survey during April-June 2020. Measures included Likert items measuring prior experience and current comfort levels with online learning, the Brief Resilient Coping Scale (BRCS), and the Perceived Stress Scale 10-Item Version (PSS-10). Experience, comfort with online learning, reported scores, and internal consistency for the BRCS and PSS-10 were summarized. A linear regression model examined the associations of prior experience with online education, gender, and resilient coping with perceived stress. Results Of the 113 respondents (78% female, mean age 22.3 years), > 50% had only occasional prior experience with online learning, coursework, and examinations, but 63% expressed confidence with online learning. Mean PSS-10 and BRCS scores were 23.8 and 13.3, respectively, and both scales demonstrated good internal consistency (α > 0.80). BRCS score was the single predictor of the PSS-10 score (r2 = 0.18, p < 0.001). Female gender was not a significant predictor (p = 0.11). A multiple regression model explained moderate variation in perceived stress (adjusted R2 = 0.19). Conclusion PSS-10 and BRCS scores indicated moderate levels of stress and coping skills among students during online teaching. Most students had some prior exposure to online learning, coursework, and examinations. Higher resiliency scores, but not prior online learning experience, predicted lower perceived stress.
Collapse
Affiliation(s)
- Michael H Campbell
- The Faculty of Medical Sciences, The University of the West Indies, Bridgetown, Barbados
| | - Sandeep Maharaj
- The Faculty of Medical Sciences, The University of the West Indies, St Augustine, Trinidad and Tobago
| | - Katija Khan
- The Faculty of Medical Sciences, The University of the West Indies, St Augustine, Trinidad and Tobago
- The Faculty of Social Sciences, The University of the West Indies, St Augustine, Trinidad and Tobago
| | - Bidyadhar Sa
- The Faculty of Medical Sciences, The University of the West Indies, St Augustine, Trinidad and Tobago
| | - O Peter Adams
- The Faculty of Medical Sciences, The University of the West Indies, Bridgetown, Barbados
| | - Md Anwarul Azim Majumder
- The Faculty of Medical Sciences, The University of the West Indies, Bridgetown, Barbados
- Correspondence: Md Anwarul Azim Majumder, Faculty of Medical Sciences, The University of the West Indies, Cave Hill Campus, Bridgetown, Barbados, Tel +1 246 8228160, Email
| |
Collapse
|
21
|
Keenan ID, Green E, Haagensen E, Hancock R, Scotcher KS, Swainson H, Swamy M, Walker S, Woodhouse L. Pandemic-Era Digital Education: Insights from an Undergraduate Medical Programme. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2023; 1397:1-19. [DOI: 10.1007/978-3-031-17135-2_1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
22
|
Donald E, Dulohery K, Khamuani M, Miles H, Nott J, Patten D, Roberts A. Putting the Cart Before the Horse? Developing a Blended Anatomy Curriculum Supplemented by Cadaveric Anatomy. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2023; 1421:15-35. [PMID: 37524982 DOI: 10.1007/978-3-031-30379-1_2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/02/2023]
Abstract
Cadaveric anatomy is frequently described as the gold standard for anatomy education. Increasingly and especially following the COVID-19 pandemic, there is acceptance that a blended approach for anatomy curriculum delivery is optimal for learners.Setting up a new UK Medical School in 2019 necessitated building a new cadaveric anatomy facility. To enable anatomy curriculum delivery during the construction period (2019-2021), a technology-enhanced learning (TEL) anatomy curriculum was developed, as well as an anatomy laboratory suitable for TEL. Development of a TEL anatomy curriculum with the later inclusion of cadaveric anatomy is unusual since the typical model is to supplement cadaveric anatomy with TEL approaches.TEL solutions that provide digital visualisation of anatomy may support learners by reducing cognitive load. Examples include using colour and/or translucency features to highlight and signpost pertinent anatomy and constructing virtual anatomical models in real time, rather than dissection. Radiology and portable ultrasound provide clinically contextualised visualisations of anatomy; the latter offers a haptic learning experience too. A TEL anatomy laboratory can provide interactive learning experiences for engagement and outreach activities for young school children, where cadaveric anatomy is not suitable.
Collapse
Affiliation(s)
- E Donald
- School of Medicine, University of Sunderland, Sunderland, United Kingdom
| | - K Dulohery
- School of Medicine, University of Sunderland, Sunderland, United Kingdom
| | - M Khamuani
- School of Medicine, University of Sunderland, Sunderland, United Kingdom
| | - H Miles
- School of Medicine, University of Sunderland, Sunderland, United Kingdom
| | - J Nott
- School of Medicine, University of Sunderland, Sunderland, United Kingdom
| | - D Patten
- School of Medicine, University of Sunderland, Sunderland, United Kingdom.
| | - A Roberts
- School of Medicine, University of Sunderland, Sunderland, United Kingdom
| |
Collapse
|
23
|
Lin YF, Chen CH, Yang YY, Kuo NR, Li TH, Lirng JF, Hou MC, Huey-Herng Sheu W. A single-center, cross-sectional study of cross-professional faculties' perception to virtual class under different scenarios: A stepwise approach. J Chin Med Assoc 2022; 85:759-766. [PMID: 35648153 DOI: 10.1097/jcma.0000000000000744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
BACKGROUND Virtual teaching in medical education is rising with the increased need caused by the recent pandemic. However, evaluations of the perception of clinical teachers across professions for setting a virtual class in different teaching scenarios are limited. This study aims to identify cross-professional clinical teachers' perception of virtual classes and the acceptability of the virtual class-specific checklist for setting a virtual class. METHODS We conducted a cross-sectional study to investigate clinical teachers' need to set and teach a virtual class and then designed a virtual class-specific checklist with five essential steps and a related training program in July 2021. After the training, 186 participants were randomly enrolled in October 2021 to evaluate their perceptions about setting virtual classes and the acceptability of the virtual class-specific checklist using an online assessment questionnaire. RESULTS In our institution, the number of faculty-led virtual classes has recently been on the increase. Our study revealed that most teachers agreed that virtual classes could break space and time limitations, but that the Internet environment could affect the fluency of the virtual class. They further agreed that the essential five steps in the checklist should vary depending on the type of teaching scenario. Most clinical teachers, with the exception of those who teach in the operating room, considered the operating room as the most difficult scenario for setting virtual classes. CONCLUSION Faculty training for setting virtual classes is essential, and the essential virtual class-specific five steps are suitable for different teachers and teaching scenarios. However, the virtual class-specific checklist should be further adjusted according to the limitations caused by emerging innovative virtual teaching technology.
Collapse
Affiliation(s)
- Yu-Fan Lin
- Department of Medical Education, Medical Innovation and Research Office, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
| | - Chen-Huan Chen
- Department of Medical Education, Medical Innovation and Research Office, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
- College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
| | - Ying-Ying Yang
- Department of Medical Education, Medical Innovation and Research Office, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
- College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
- Clinical Innovation Center, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
| | - Nai-Rong Kuo
- Department of Medical Education, Medical Innovation and Research Office, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
| | - Tzu-Hao Li
- College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
- Division of Allergy, Immunology, and Rheumatology, Department of Internal Medicine, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan, ROC
| | - Jiing-Feng Lirng
- College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
| | - Ming-Chih Hou
- Department of Medical Education, Medical Innovation and Research Office, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
- College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan, ROC
- Clinical Innovation Center, Taipei Veterans General Hospital, Taipei, Taiwan, ROC
| | | |
Collapse
|
24
|
Patterson C, Calvo K, Silverton R, Rodger A. Ward-based learning in a pandemic: an approach to ensuring sustainable medical education for healthcare students. Future Healthc J 2022; 9:200-206. [DOI: 10.7861/fhj.2021-0186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
25
|
Khamees D, Peterson W, Patricio M, Pawlikowska T, Commissaris C, Austin A, Davis M, Spadafore M, Griffith M, Hider A, Pawlik C, Stojan J, Grafton-Clarke C, Uraiby H, Thammasitboon S, Gordon M, Daniel M. Remote learning developments in postgraduate medical education in response to the COVID-19 pandemic - A BEME systematic review: BEME Guide No. 71. MEDICAL TEACHER 2022; 44:466-485. [PMID: 35289242 DOI: 10.1080/0142159x.2022.2040732] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
BACKGROUND Prior reviews investigated medical education developments in response to COVID-19, identifying the pivot to remote learning as a key area for future investigation. This review synthesized online learning developments aimed at replacing previously face-to-face 'classroom' activities for postgraduate learners. METHODS Four online databases (CINAHL, Embase, PsychINFO, and PubMed) and MedEdPublish were searched through 21 December 2020. Two authors independently screened titles, abstracts and full texts, performed data extraction, and assessed risk of bias. The PICRAT technology integration framework was applied to examine how teachers integrated and learners engaged with technology. A descriptive synthesis and outcomes were reported. A thematic analysis explored limitations and lessons learned. RESULTS Fifty-one publications were included. Fifteen collaborations were featured, including international partnerships and national networks of program directors. Thirty-nine developments described pivots of existing educational offerings online and twelve described new developments. Most interventions included synchronous activities (n Fif5). Virtual engagement was promoted through chat, virtual whiteboards, polling, and breakouts. Teacher's use of technology largely replaced traditional practice. Student engagement was largely interactive. Underpinning theories were uncommon. Quality assessments revealed moderate to high risk of bias in study reporting and methodology. Forty-five developments assessed reaction; twenty-five attitudes, knowledge or skills; and two behavior. Outcomes were markedly positive. Eighteen publications reported social media or other outcomes, including reach, engagement, and participation. Limitations included loss of social interactions, lack of hands-on experiences, challenges with technology and issues with study design. Lessons learned highlighted the flexibility of online learning, as well as practical advice to optimize the online environment. CONCLUSIONS This review offers guidance to educators attempting to optimize learning in a post-pandemic world. Future developments would benefit from leveraging collaborations, considering technology integration frameworks, underpinning developments with theory, exploring additional outcomes, and designing and reporting developments in a manner that supports replication.
Collapse
Affiliation(s)
- Deena Khamees
- McGovern Medical School, University of Texas Health Science Center at Houston, Houston, TX, USA
| | - William Peterson
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | | | - Teresa Pawlikowska
- Royal College of Surgeons, University of Medicine and Health Sciences, Dublin, Ireland
| | - Carolyn Commissaris
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Andrea Austin
- San Diego School of Medicine, University of California, San Diego, CA, USA
| | - Mallory Davis
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Maxwell Spadafore
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Max Griffith
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Ahmad Hider
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Cameron Pawlik
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | - Jennifer Stojan
- Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI, USA
| | | | - Hussein Uraiby
- School of Medicine, University of Leicester, Leicester, UK
| | | | - Morris Gordon
- Blackpool Victoria Hospital, Blackpool, UK
- School of Medicine, University of Central Lancashire, Preston, UK
| | - Michelle Daniel
- San Diego School of Medicine, University of California, San Diego, CA, USA
| |
Collapse
|
26
|
Koljonen V, Puolakkainen P, Helenius I. Lessons learned from COVID-19 pandemic in undergraduate surgical education. Scand J Surg 2022; 111:14574969221083138. [PMID: 35384788 DOI: 10.1177/14574969221083138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In this editorial, we review our experience on distance teaching and based on our experiences suggest modifications to undergraduate surgical education.
Collapse
Affiliation(s)
- Virve Koljonen
- Department of Plastic Surgery Helsinki University Hospital Park Hospital P.O. Box 281 Stenbäckinkatu 11 Helsinki 00029 Finland
| | - Pauli Puolakkainen
- Department of Surgery, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| | - Ilkka Helenius
- Department of Surgery, University of Helsinki and Helsinki University Hospital, Helsinki, Finland Department of Orthopaedics and Traumatology, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| |
Collapse
|
27
|
Grafton-Clarke C, Uraiby H, Gordon M, Clarke N, Rees E, Park S, Pammi M, Alston S, Khamees D, Peterson W, Stojan J, Pawlik C, Hider A, Daniel M. Pivot to online learning for adapting or continuing workplace-based clinical learning in medical education following the COVID-19 pandemic: A BEME systematic review: BEME Guide No. 70. MEDICAL TEACHER 2022; 44:227-243. [PMID: 34689692 DOI: 10.1080/0142159x.2021.1992372] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
BACKGROUND The novel coronavirus disease was declared a pandemic in March 2020, which necessitated adaptations to medical education. This systematic review synthesises published reports of medical educational developments and innovations that pivot to online learning from workplace-based clinical learning in response to the pandemic. The objectives were to synthesise what adaptations/innovation were implemented (description), their impact (justification), and 'how' and 'why' these were selected (explanation and rationale). METHODS The authors systematically searched four online databases up to December 21, 2020. Two authors independently screened titles, abstracts and full-texts, performed data extraction, and assessed the risk of bias. Our findings are reported in alignment with the STORIES (STructured apprOach to the Reporting in healthcare education of Evidence Synthesis) statement and BEME guidance. RESULTS Fifty-five articles were included. Most were from North America (n = 40), and nearly 70% focused on undergraduate medical education (UGME). Key developments were rapid shifts from workplace-based learning to virtual spaces, including online electives, telesimulation, telehealth, radiology, and pathology image repositories, live-streaming or pre-recorded videos of surgical procedures, stepping up of medical students to support clinical services, remote adaptations for clinical visits, multidisciplinary team meetings and ward rounds. Challenges included lack of personal interactions, lack of standardised telemedicine curricula and need for faculty time, technical resources, and devices. Assessment of risk of bias revealed poor reporting of underpinning theory, resources, setting, educational methods, and content. CONCLUSIONS This review highlights the response of medical educators in deploying adaptations and innovations. Whilst few are new, the complexity, concomitant use of multiple methods and the specific pragmatic choices of educators offers useful insight to clinical teachers who wish to deploy such methods within their own practice. Future works that offer more specific details to allow replication and understanding of conceptual underpinnings are likely to justify an update to this review.
Collapse
Affiliation(s)
- Ciaran Grafton-Clarke
- School of Medicine, University of East Anglia, Norwich, UK
- School of Medicine, University of Leicester, Leicester, UK
| | - Hussein Uraiby
- School of Medicine, University of Leicester, Leicester, UK
| | - Morris Gordon
- Department of Pediatrics, Blackpool Victoria Hospital, Blackpool, UK
- School of Medicine, University of Central Lancashire, Preston, UK
| | - Nicola Clarke
- Research Department of Medical Education, University College London, London, UK
| | - Eliot Rees
- Research Department of Medical Education, University College London, London, UK
- School of Medicine, Keele University, North Staffordshire, UK
| | - Sophie Park
- School of Medicine, University of East Anglia, Norwich, UK
| | - Mohan Pammi
- Section of Neonatology, Texas Children's Hospital, Houston, TX, USA
| | - Sebastian Alston
- Division of Clinical Sciences, Alabama College of Osteopathic Medicine, Dothan, AL, USA
| | - Deena Khamees
- University of Michigan Medical School, Ann Arbor, MI, USA
| | | | | | - Cameron Pawlik
- University of Michigan Medical School, Ann Arbor, MI, USA
| | - Ahmad Hider
- University of Michigan Medical School, Ann Arbor, MI, USA
| | - Michelle Daniel
- University of Michigan Medical School, Ann Arbor, MI, USA
- San Diego School of Medicine, University of California, La Jolla, CA, USA
| |
Collapse
|
28
|
Telang A. Post-COVID-19: Looking back to move forward in health professions education. ARCHIVES OF MEDICINE AND HEALTH SCIENCES 2022. [DOI: 10.4103/amhs.amhs_114_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
|