How to assess communication skills? Development of the rating scale ComOn Check

[Communication training in otorhinolaryngology education : Comparison of an online and a classroom-based training course]

BACKGROUND

Communication skills are among the most important key qualifications of the medical profession. To what extent these can also be acquired online in medical education in otolaryngology is investigated in this study.

OBJECTIVE

A voluntary online training for the teaching of communication skills was compared with a corresponding face-to-face format. The question of the extent to which acceptance of the two formats and students' self-assessment of their communicative skills differed was investigated.

MATERIALS AND METHODS

In the online training, students were prepared for the topic asynchronously via a video. Thereafter, they were able to conduct consultations with simulation patients online and synchronously. The face-to-face training was comparable in structure and duration and took place in an earlier semester. The acceptance of both seminars was assessed by a questionnaire with 19 items on a five-point Likert scale. Self-assessment of communication skills was measured by a 10-cm visual analog scale pre/post with 16 items.

RESULTS

Both formats achieved high acceptance with an average score (M) of 2.08 (standard deviation, SD = 0.54) for the online format and M = 1.97 (SD = 0.48) for the face-to-face event. Students' self-assessments of communication skills showed a twofold increase in the online group (M = 1.54, SD = 0.94) compared to the face-to-face group (M = 0.75, SD = 0.87).

CONCLUSION

This study shows that teaching communication skills in the online format was well accepted and resulted in significant changes in students' self-assessment of communication skills.

Education modalities for serious illness communication training: A scoping review on the impact on clinician behavior and patient outcomes

BACKGROUND

Several clinician training interventions have been developed in the past decade to address serious illness communication. While numerous studies report on clinician attitudes and confidence, little is reported on individual education modalities and their impact on actual behavior change and patient outcomes.

AIM

To examine what is known about the education modalities used in serious illness communication training and their impact on clinician behaviors and patient outcomes.

DESIGN

A scoping review using the Joanna Briggs Methods Manual for Scoping Reviews was conducted to examine studies measuring clinician behaviors or patient outcomes.

DATA SOURCES

Ovid MEDLINE and EMBASE databases were searched for English-language studies published between January 2011 and March 2023.

RESULTS

The search identified 1317 articles: 76 met inclusion criteria describing 64 unique interventions. Common education modalities used were: single workshop (n = 29), multiple workshops (n = 11), single workshop with coaching (n = 7), and multiple workshops with coaching (n = 5); though they were inconsistently structured. Studies reporting improved clinician skills tended to be in simulation settings with neither clinical practice nor patient outcomes explored. While some studies reported behavior changes or improved patient outcomes, they did not necessarily confirm improvements in clinician skills. As multiple modalities were commonly used and often embedded within quality improvement initiatives, the impact of individual modalities could not be determined.

CONCLUSION

This scoping review of serious illness communication interventions found heterogeneity among education modalities used and limited evidence supporting their effectiveness in impacting patient-centered outcomes and long-term clinician skill acquisition. Well-defined educational modalities and consistent measures of behavior change and standard patient-centered outcomes are needed.

"Patients Are the People Who Teach Me the Most": Exploring the Development of Communication Skills During Internal Medicine Residency

BACKGROUND

Physician-patient communication training is a vital component of medical education, yet physicians do not always achieve the communication expertise expected of them. Despite extensive literature on the efficacy of various training interventions, little is known about how residents believe they learn to communicate.

OBJECTIVE

To understand residents' perspectives on the development of their communication skills.

METHODS

Between November 2020 and January 2021 recruitment emails were sent to all 225 internal medicine residents at the University of Toronto; one-on-one interviews were conducted with 15 residents. Participants were asked to reflect on communication skills development. Interviews were conducted and analyzed using constructivist grounded theory.

RESULTS

Participants credited the majority of their skills development to unsupervised interactions with patients, without explicit guidance from an attending physician. Attendings' contributions were primarily seen through role modeling, with little perceived learning coming from feedback on observed interactions. This was partly explained by residents' proclivity to alter their communication styles when observed, rendering feedback less relevant to their authentic practice, and by receiving generically positive feedback lacking in constructive features. Time constraints led to communication styles that prioritized efficiency at the cost of patient-centeredness.

CONCLUSIONS

These findings suggest that current models of communication training and assessment may fall short due to overreliance on observation by attendings and examiners, which may fail to unearth the authentic and largely self-taught communication behaviors of residents. Further research is required to ascertain the feasibility and potential value of other forms of communication training and assessment, such as through patient feedback.

Developing communication curricula in healthcare education: An evidence-based guide

OBJECTIVE

To present a guide for communication curriculum development in healthcare professions for educators and curriculum planners.

METHODS

We collated a selection of theories, frameworks and approaches to communication curriculum development to provide a roadmap of the main factors to consider when developing or enhancing communication skills curricula.

RESULTS

We present an evidence-based guide for developing and enhancing communication curriculum that can be applied to undergraduate and postgraduate healthcare education. Recommended steps to consider during the communication curricula development process include thoughtful examination of current communication education, needs assessment, focused learning goals and objectives, incorporation of experiential educational strategies allowing for skills practice and feedback and use of formative and summative assessment methods. A longitudinal, developmental and helical implementation approach contributes to reinforcement and sustainment of learners' knowledge and skills.

CONCLUSION AND PRACTICE IMPLICATIONS

Drawing on best practices in developing communication curricula can be helpful in ensuring successful approaches to communication skills training for any level of learner or healthcare profession. This position paper provides a guide and identifies resources for new and established communication curriculum developers to reflect on strengths and opportunities in their own approaches to addressing the communication education needs of their learners.

Simulation-based training in asthma exacerbation for medical students: effect of prior exposure to simulation training on performance

OBJECTIVES

To evaluate the effect of prior exposure to simulation-based training on medical students' performance in simulation-based training in asthma exacerbation.

METHODS

Third-year novice medical students, who had no prior experience in simulation education and completed diagnostics and internal medicine courses, were recruited in this prospective observational study and divided into the pre-exposure and unexposed groups. Each group received a four-hour asthma exacerbation simulation-based training. The pre-exposure group was exposed to a myocardial infarction simulation training two weeks prior to the asthma simulation training. The main outcome was the performance scores in clinical skills and abilities. Performance and task checklist completion were recorded during the training. In addition, the knowledge level was tested before and after the simulation training. Students' satisfaction was evaluated using a feedback questionnaire.

RESULTS

In a class of 203 third-year novice medical students, 101 (49.8%) and 102 (50.2%) were assigned to the unexposed and pre-exposure groups, respectively. Scores were higher in the post-simulation test compared with the pre-simulation test. Checklist completion was greater in the pre-exposure group compared with the unexposed group (p < 0.001). Performances in communication and medical humanistic care were better in the pre-exposure group than in the unexposed group (p < 0.001). There were no differences in medical history taking, physical examination, auxiliary examination interpretation and treatment formulation between the two groups (p > 0.001). Totally 73.21% and 26.13% of students strongly agreed and agreed, respectively, that asthma exacerbation simulation-based training was necessary and valuable.

CONCLUSIONS

Prior exposure to simulation training can improve performance in medical students, including communication skills, medical humanistic care and checklist completion in subsequent asthma exacerbation simulation-based training.

Psychometric Properties of the Korean Version of ComOn Coaching for Oncology Nurses

Objective

Methods

Results

Conclusions

Development and national consensus finding on patient-centred high stakes communication skills assessments for the Swiss Federal Licensing Examination in Medicine

OBJECTIVE

To describe and evaluate a consensus finding and expert validation process for the development of patient-centred communication assessments for a national Licensing Exam in Medicine.

METHODS

A multi-professional team of clinicians and experts in communication, assessment and role-play developed communication assessments for the Swiss Federal Licensing Examination. The six-month process, informed by a preceding national needs-assessment, an expert symposium and a critical literature review covered the application of patient-centred communication frameworks, the development of assessment guides, concrete assessments and pilot-tests. The participants evaluated the process.

RESULTS

The multiple-step consensus process, based on expert validation of the medical and communication content, led to six high-stakes patient-centred communication OSCE-assessments. The process evaluation revealed areas of challenge such as calibrating rating-scales and case difficulty to the graduates' competencies and integrating differing opinions. Main success factors were attributed to the outcome-oriented process and the multi-professional exchange of expertise. A model for developing high stakes patient-centred communication OSCE-assessments was derived.

CONCLUSIONS

Consensus finding was facilitated by using well-established communication frameworks, by ensuring outcome-orientated knowledge exchange among multi-professional experts, and collaborative validation of content through experts.

PRACTICE IMPLICATIONS

We propose developing high-stakes communication assessments in a multi-professional expert consensus and provide a conceptual model.

Characterizing standardized patients and genetic counseling graduate education

Standardized patients (SPs) are laypersons trained to portray patients, family members, and others in a consistent, measurable manner to teach and assess healthcare students, and to provide practice for emotionally and medically challenging cases. SP methodology has been studied with practicing genetic counselors; however, there is minimal empirical evidence characterizing its use in genetic counseling (GC) education. The Accreditation Council for Genetic Counseling (ACGC) Standards of Accreditation for Graduate Programs in Genetic Counseling include SP sessions as one way to achieve up to 20% of the 50 participatory cases required for graduation. The purpose of the current project was to determine the scope, frequency, and timing of SP methodology in ACGC-accredited programs to establish baseline usage, which happened prior to the SARS-CoV-2 pandemic. A 40-item investigator-created survey was developed to document the scope and frequency of SP use among programs. The survey was distributed through the Association of Genetic Counseling Program Directors' (AGCPD) listserv to 43 accredited and 6 programs under development. Surveys were analyzed from 25 accredited programs (response rate = 58%). Seventeen of these programs report inclusion of SP methodology in the curricula (68%), of which 13 report working with an established SP program. SPs are used predominantly for role-plays (70.6%), individualized instruction and remediation (29.4%), and for other reasons such as lecture demonstration, final examinations, practicing skills, and assessing students' goals. Sixteen of the participating programs use SPs to give GC students experience disclosing positive test results. Other details vary among the GC programs including the use of trained SPs, volunteer or paid SPs, actors with and without SP training, or GC students acting as patients. This study demonstrates that GC program SP experiences differ, but are largely viewed as valuable by the programs. Many GC programs report using SP encounters to create multiple opportunities for students to practice and refine clinical skills similar to SPs in medical school.

Standardized Patients or Conventional Lecture for Teaching Communication Skills to Undergraduate Medical Students: A Randomized Controlled Study

OBJECTIVE

The conduct of a medical interview is a challenging skill, even for the most qualified physicians. Since a training is needed to acquire the necessary skills to conduct an interview with a patient, we compared role-play with standardized patients (SP) training and a conventional lecture for the acquisition of communications skills in undergraduate medical students.

METHODS

An entire promotion of third year undergraduate medical students, who never received any lessons about communications skills, were randomized into 4 arms: 1) SP 2 months before the testing of medical communications skills (SP); 2) conventional lecture 2 months before the testing (CL); 3) two control groups (CG) without any intervention, tested either at the beginning of the study or two months later. Students were blindly assessed by trained physicians with a modified 17-items Calgary-Cambridge scale.

RESULTS

388 students (98.7%) participated. SP performed better than CL, with significant statistical differences regarding 5 skills: the use of open and closed questions, encouraging patient responses, inviting the patient to clarify the missing items, encouraging of the patient's emotions, and managing the time and the conduct of the interview. The SP group specifically improved communications skills between the SP training and testing sessions regarding 2 skills: the use of open and closed questions and encouraging patient responses. No improvements in communications skills were observed in CG between the two time points, ruling out a possible time effect.

CONCLUSION

Role-play with standardized patients appears more efficient than conventional lecture to acquire communication skills in undergraduate medical students.

Barriers and Facilitators to Discussing Goals of Care among Nephrology Trainees: A Qualitative Analysis and Novel Educational Intervention

Background: Goals of care (GOC) conversations are critical to advance care planning but occur infrequently in nephrology. National workshops have improved trainee comfort with initiating GOC conversations but lack interface with palliative subspecialists and can incur travel-related costs. We developed an educational intervention focused on GOC conversations for nephrology trainees that incorporated into routine schedules and offered feedback from palliative subspecialists. Objective: To explore barriers and facilitators to discussing GOC and uncover perceptions of GOC-related behavior change post-intervention. Design: Qualitative study. Setting/Subjects: Sixteen nephrology trainees at an academic medical center. Measurements: Analyses of semistructured interviews occurred in phases: (1) isolation of quotes; (2) development of a coding system; and (3) creation of a framework of interrelationships between quotes using an inductive/deductive approach. Results: We captured the following themes: (1) prior knowledge (ability to define GOC, knowledge of communication frameworks and prognostic data, exposure to outpatient GOC conversations; (2) attitudes related to GOC conversations (responsibility, comfort, therapeutic alliance, patient preparedness, partnership with care teams); and (3) potential change in behaviors (increased likelihood to initiate GOC conversations early, more accurate identification of patients appropriate for a GOC conversation). Conclusions: Prior knowledge of, exposure to, and attitudes toward advance care planning were key determinants of a nephrology trainees' ability to initiate timely GOC conversations. After our intervention, trainees reported increased comfort with and likelihood to initiate GOC conversations and an improved ability to identify appropriate candidates. Our intervention may be a novel, feasible way to coach nephrologists to initiate timely GOC conversations.

Development of an empathy and clarity rating scale to measure the effect of medical improv on end-of-first-year OCSE performance: a pilot study

Patients want empathetic physicians who listen and understand. How do you teach and measure empathy? Medical educators, including those inspired by Alan Alda, have turned to theater to teach skills in empathetic communication. Improvisation-informedcurriculum (medical improv) draws upon foundational actors training: deep listening, emotional understanding, connections, authenticity. Arating scale to measure the impact of medical improv on empathetic and clear communication does not exist. Objective: To develop aframework and instrument, the Empathy and Clarity Rating Scale (ECRS), for measuring communication elements used by actors and physicians, and pilot ECRS to test effectiveness of medical improv on first-yearstudents' communication skills. Design: Four medical schools collaborated. USMLE Step 2 Communication and Interpersonal Skills (CIS) domains were used as framework for discussion among three focus groups, each with clinicians, actors, communication experts, and community members with patient experience. Audiotaped discussions were transcribed; open coding procedures located emerging themes. The initial coding scheme was compared with the Consultation and Relational Empathy (CARE) measure. ECRS content was aligned with CARE, CIS and focus group themes. Modified nominal processes were conducted to finalize the scale. We implemented procedures to establish content validity and interrater reliability. Final ECRS was used to study student performance across three levels of experience with medical improv. Results: The final ECRS was comprised of seven five-pointscale items. Narrative comments precede behaviorally anchored ratings: 5=desired, 1=ineffective, 2-4=developing based upon adjustment needed. Rater agreement across all items was 84%. There was asmall correlation between the ECRS and another measure interviewing (r=0.262, p=0.003). Students with advanced medical improv training outperformed those without (F=3.51, p=.042). Conclusion: Acommunication scale enlightened by experiences of actors, clinicians, scholars and patients has been developed. The ECRS has potential to detect the impact of medical improv on development of empathetic and clear communication.

Specific feedback makes medical students better communicators

BACKGROUND

Feedback is regarded a key element in teaching communication skills. However, specific aspects of feedback have not been systematically investigated in this context. Therefore, the aim of this study was to investigate the effectiveness of communication skills training (CST) integrating specific, structured and behavioral feedback.

METHODS

We condensed best practice recommendations for feedback in a CST for undergraduate medical students and compared the effect of specific, structured and behavior-orientated feedback (intervention group CST-behav) to general, experience-orientated feedback (CST- exp. as our control group) in a randomized controlled trial (RCT). We investigated changes on communication skills evaluated by independent raters, and evaluated by standardized patients (SP). To do that, every student was video-recorded in a pre and post assessment.

RESULTS

Sixty-six undergraduate medical students participated voluntarily in our study. Randomization did not result in equally skilled groups at baseline, so valid inter-group comparisons were not possible. Therefore, we analyzed the results of 34 students of our intervention group (CST-behav). Five out of seven domains in communication skills as evaluated by independent raters improved significantly, and there was a significant change in the global evaluation by SP.

CONCLUSIONS

Although we were unable to make between-group comparisons, the results of the within group pre-post evaluation suggest that specific feedback helps improve communication skills.