Use of Standardized Patient Simulations to Assess Impact of Motivational Interviewing Training on Social⁻Emotional Development

Emotional intelligence evaluation tools used in allied health students: A scoping review

INTRODUCTION

Emotional intelligence (EI) is described as the ability to recognise and understand one's own emotions and the emotions of others, and empathically manage emotional responses. While historically not emphasised in undergraduate allied health sciences training, it is increasingly considered an essential graduate trait. This scoping review synthesises existing research on EI outcomes, specifically in undergraduate allied health professions students.

METHOD

Four databases were searched in February 2024 using keywords relating to EI and empathy to identify studies published in English from 1990. Eligible studies needed to include assessment and reported outcomes using validated EI tools in health professions students.

RESULTS

A total of 163 papers met the inclusion criteria. Many studies employed a cross-sectional design (n = 115). Most studies (n = 135) focused on undergraduate students studying medicine (n = 62), nursing (n = 80) and dentistry (n = 13), with some studies (n = 21) evaluating more than one discipline. Many studies investigated one discipline only (n = 64 for nursing, n = 50 for medicine) using no comparator undergraduate degree. The most common EI models evaluated from this review were ability-based (n = 77), followed by trait-based models (n = 36) and mixed social-emotional competence (n = 35). Ability model evaluations of EI most commonly utilised the Schutte Self-Report Emotional Intelligence Test (SSEIT) (n = 44) and the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) (n = 24).

CONCLUSION

Research on EI among undergraduate allied health fields is limited. Existing literature reveals there is some consensus on the importance of EI in healthcare education, but there is considerable variability in how EI is measured. Studies suggest higher levels of EI may correlate with improved student professional skill development in clinical reasoning, empathy and stress management.

Content Validity and Cognitive Testing in the Development of a Motivational Interviewing Self-Assessment Questionnaire

Aim

To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire to be used in cross-sectional studies involving practitioners conducting the MI-based alcohol screening and brief intervention (ASBI).

Methods

A comprehensive mixed methods approach included a literature review, 3 rounds of expert panel (EP) opinions (n=10), cognitive testing (CT) with 10 MI-based ASBI practitioners, and questionnaire piloting with 31 MI-based ASBI practitioners. Based on the EP opinions in the second round, content validity indices (CVIs) and the modified kappa coefficient (k*) were calculated, focusing on the relevance and understandability of questions and comprehensiveness and meaningfulness of the response options. This analysis was performed in 2020, at the conclusion of the national "Together for a Responsible Attitude Towards Alcohol Consumption" ("Skupaj za odgovoren odnos do pitja alkohola", SOPA) project's pilot implementation.

Results

On a scale level, CVI values based on universal agreement for the entire questionnaire were high for 3/4 categories (S-CVI-UA>0.80), and CVI values based on average agreement were high across all categories (S-CVI-Ave>0.90). At the item level, CVI values (I-CVI) were never <0.50 (automatic item rejection), and the modified kappa value (k*) indicated poor validity for two items in the understandability category (k*=0.33). All problematic parts of the questionnaire were further tested and successfully modified based on the results of CT, and accepted in the third round of testing.

Conclusions

The final version of the questionnaire demonstrated appropriate content validity for use in studies among Slovenian MI-based ASBI practitioners and is now ready for further psychometric testing.

Comparison of Virtual Simulations with Peers versus Actors as Standardized Patients on Virtual OSCE Scores

OBJECTIVE

This study's primary aim is to assess the use of different types of standardized patients (SPs) during formative simulation activities on summative objective structured clinical exams (OSCE) in a PharmD curriculum.

METHODS

Randomized-controlled study with first-year pharmacy students in a Pharmacist Patient Care Lab (PCL) course. Students were randomized into groups with either hired actors or their peers as SPs for virtual simulation activities. All students then completed a virtual teaching OSCE (TOSCE) and virtual OSCE. A mixed effects analysis was done to compare TOSCE and OSCE scores between the two groups.

RESULTS

There were no significant differences between the two groups in their TOSCE or OSCE scores for the analytical and global rubrics.

CONCLUSION

This study demonstrates that peers may be as effective as having hired actors as SPs in preparing students for virtual skills exams.

Evidence and Strategies for Including Emotional Intelligence in Pharmacy Education

Objective. This integrative review summarizes the literature addressing emotional intelligence among health care professionals and students to better define and incorporate it into the pharmacy curricula.Findings. Emotional intelligence is an essential attribute for relationship building, stress management, and self-regulation. Pharmacy students must develop and improve their emotional intelligence to support their development of successful relationships with patients, pharmacy colleagues, and other health care providers. In addition, awareness of one's own biases and emotions can help with behavioral regulation, which can facilitate enhanced communications with others. Increasing evidence suggests that emotional intelligence can influence academic success, the ability to provide compassionate and competent patient care, the ability to lead and influence others, and the ability to manage stress, all of which are important in pharmacy education. Educators can help learners develop emotional intelligence by designing activities that directly identify and target areas of weakness while leveraging areas of strength.Summary. This article discusses key background studies on emotional intelligence in the health professions literature and identifies specific methods and strategies to develop learners' emotional intelligence within the curriculum.

Social and Emotional Development in a Telehealth-Based Ambulatory Care Skills Course

Objective. To determine the impact of telehealth-based simulations on students' social and emotional development.Methods. First-year pharmacy students enrolled in a professional skills course were eligible to participate in the study. Before and after the course, students completed the Personal-Interpersonal Competence Assessment, which codes onto eight subcategories: situation monitoring, inspire others, intimacy, awareness of one's aptitude, initiative to pursue leadership, empathy, sociability, and awareness of one's emotions. Students participated in seven telehealth-based simulations. Prior to each simulation, students watched a role modeling video highlighting social and emotional competence techniques used by a pharmacist during a consultation. Students then participated in simulated consultations that occurred in Zoom breakout rooms. Each student completed one consult while a teaching assistant completed a rubric derived from the Personal-Interpersonal Competence Assessment. Teaching assistants then provided formative feedback related to the student's social and emotional competence. At the semester midpoint, students completed a video log reflecting on their social and emotional development. Statistical analyses compared different time points of students' scores on the Personal-Interpersonal Competence Assessment and scores given by teaching assistants, while qualitative analysis was used for the video logs.Results. At the end of the course, improvement was noted on all factors of the Personal-Interpersonal Competence Assessment. Scores given by teaching assistants showed significant improvement over the semester, with the highest improvement noted on the subcategories inspiration and situation monitoring. On the video log, 80% of students noted improvements in their consideration of others.Conclusion. These findings suggest value in using role modeling, telehealth-based simulations, and teaching assistant feedback on pharmacy students' social and emotional development.

Research Hotspots and Trend Exploration on the Clinical Translational Outcome of Simulation-Based Medical Education: A 10-Year Scientific Bibliometric Analysis From 2011 to 2021

BACKGROUND

In recent decades, an increasing number of studies have focused on the clinical translational effect of simulation-based medical education (SBME). However, few scientific bibliometric studies have analyzed the research hotspots and publication trends. This study aimed to investigate research hotspots and future direction in the clinical translational outcome of SBME via bibliometrics.

METHOD

Relevant publications on the clinical translational outcomes of SBME from 2011 to 2021 were identified and retrieved from the Web of Science Core Collection (WOSCC). Software including VOSviewer (1.6.17) and CiteSpace (5.8R3) and a platform (bibliometric.com) were employed to conduct bibliographic and visualized analysis on the literature.

RESULTS

A total of 1,178 publications were enrolled. An increasing number of publications were observed in the past decades from 48 in 2011 to 175 in 2021. The United States accounted for the largest number of publications (488, 41.4%) and citations (10,432); the University of Toronto and Northwestern University were the leading institutions. Academic Medicine was the most productive journal concerning this field. McGaghie W C and Konge L were the most influential authors in this area. The hot topic of the translational outcome of SBME was divided into 3 stages, laboratory phase, individual skill improvement, and patient outcome involving both technical skills and non-technical skills. Translational research of comprehensive impact and collateral outcomes could be obtained in the future.

CONCLUSION

From the overall trend of 10 years of research, we can see that the research is roughly divided into three phases, from laboratory stage, individual skill improvement to the patient outcomes, and comprehensive impacts such as skill retention and collateral effect as cost-effectiveness is a major trend of future research. More objective evaluation measurement should be designed to assess the diverse impact and further meta-analysis and randomized controlled trials are needed to provide more clinical evidence of SBME as translational science.

Standardized Vaccine-Hesitant Patients in the Assessment of the Effectiveness of Vaccine Communication Training

OBJECTIVES

To determine if training residents in a structured communication method elicits specific behaviors in a laboratory model of interaction with vaccine-hesitant parents.

STUDY DESIGN

Standardized patients portraying vaccine-hesitant parents were used to assess the effectiveness of training in the Announce, Inquire, Mirror, Secure (AIMS) Method for Healthy Conversations. Blinded pediatric residents were pseudorandomized to receive AIMS or control training and underwent pre- and post-training encounters with blinded standardized patients. Encounters were assessed by blinded raters using a novel tool. Participant confidence and standardized patient evaluations of the participants' general communication skills were assessed.

RESULTS

Ratings were available for 27 AIMS and 26 control participants. Statistically significant increases in post-training scores (maximum = 30) were detected in AIMS, but not in control, participants (median, 21.3 [IQR, 19.8-24.8] vs 18.8 [IQR, 16.9-20.9]; P < .001). Elements (maximum score = 6) with significant increases were Inquire (0.67 [IQR, 0-1.76] vs -0.33 [IQR, -0.67 to 0.33]; P < .001); Mirror (1.33 [IQR, 0 to 2] vs -0.33 [IQR, -0.92 to 0]; P < .001) and Secure (0.33 [IQR, 0 to 1.67] vs -0.17 [IQR, -0.67 to 0.33]; P = .017). Self-confidence increased equally in both groups. Standardized patients did not detect a difference in communication skills after training and between groups. Internal consistency and inter-rater reliability of the assessment tool were modest.

CONCLUSIONS

Standardized patients proved useful in studying the effectiveness of structured communication training, but may have been limited in their ability to perceive a difference between groups owing to the predetermined encounter outcome of vaccine refusal. AIMS training should be studied in real-world scenarios to determine if it impacts vaccine acceptance.