Assessing the assessment: a comparison of the IPASS and ICCAS to measure change in interprofessional competencies following a large-scale interprofessional forum

Interprofessional communication skills training to improve medical students' and nursing trainees' error communication - quasi-experimental pilot study

BACKGROUND

Interprofessional communication is of extraordinary importance for patient safety. To improve interprofessional communication, joint training of the different healthcare professions is required in order to achieve the goal of effective teamwork and interprofessional care. The aim of this pilot study was to develop and evaluate a joint training concept for nursing trainees and medical students in Germany to improve medication error communication.

METHODS

We used a mixed-methods, quasi-experimental study with a pre-post design and two study arms. This study compares medical students (3rd year) and nursing trainees (2nd year) who received an interprofessional communication skills training with simulation persons (intervention group, IG) with a control group (CG). Both cohorts completed identical pre- and post-training surveys using the German Interprofessional Attitudes Scale (G-IPAS) and a self-developed interprofessional error communication scale. Descriptive statistics, Mann-Whitney-U-test and Wilcoxon-test were performed to explore changes in interprofessional error communication.

RESULTS

A total of 154 were medical students, and 67 were nursing trainees (IG: 66 medical students, 28 nursing trainees / CG: 88 medical students, 39 nursing trainees). After training, there were significant improvements observed in the "interprofessional error communication" scale (p < .001) and the "teamwork, roles, and responsibilities" subscale (p = .012). Median scores of the subscale "patient-centeredness" were similar in both groups and remained unchanged after training (median = 4.0 in IG and CG).

CONCLUSIONS

Future studies are needed to find out whether the training sustainably improves interprofessional teamwork regarding error communication in acute care.

Longitudinal Assessment of Pharmacy Students' Collaborative Practice Abilities

OBJECTIVE

Interprofessional education (IPE) varies across schools/colleges of pharmacy. Long-term impact of IPE on interprofessional collaborative competencies remains uncertain despite available data on singular experiences. This study aimed to evaluate changes in pharmacy students' collaborative abilities over the second and third professional years (PYs).

METHODS

Students completed the Interprofessional Collaborative Competency Attainment Scale - Revised (ICCAS-R) after 2 large-scale interprofessional forums that occurred approximately 8 months apart. Four cohorts of students were used to examine the longitudinal change in collaborative abilities: cohort 1 (2019), cohort 2 (2020), cohort 3 (2021) and cohort 4 (2022). The ICCAS-R was used to capture data from 4 timepoints for each student in each cohort: prior to the Spring Forum in PY2 (T1), after the Spring Forum in PY2 (T2), prior to the Fall Forum in PY3 (T3), and after the Fall Forum in PY3 (T4). Using repeated measures analysis of variance, 4 total mean scores (T1 = pre1, T2 = post1, T3 = pre2, T4 = post2) were compared.

RESULTS

Four cohorts (N = 414) completed the interprofessional forums and 336 (81%) completed the ICCAS-R instrument and were included. In each cohort, total mean scores increased T1 to T2 and T3 to T4, indicating an increase in self-assessed abilities pre/post-forum. Total mean scores decreased between T2 and T3, indicating that collaborative abilities decreased during the period between interprofessional forums.

CONCLUSION

While students' collaborative abilities increased around the time of the forum experiences, these changes decreased in between experiences. These findings suggest that interprofessional competencies should be reinforced at multiple time points to support enduring effects.

Validation of the Interprofessional Collaborative Competency Attainment Survey (ICCAS) retrospective pre-test measures

Establishing the effectiveness of IPE experiences is essential, and current assessment measures may be subject to various types of bias. The Interprofessional Collaborative Competency Attainment Survey (ICCAS) is administered after the learning experience as retrospective pretest and posttest measures of perceived collaborative practice skills. Because the ICCAS does not have an actual pretest, there are potential risks of recall bias and social desirability bias. To address these concerns, Jackson (2017) proposed conducting a true ICCAS pretest before the learning experience and examining the differences between the true and retrospective pretest scores and the differences between these pretest and posttest scores. This study design was implemented for two in-person Interprofessional forums conducted in the Fall (N = 745) and following Spring (N = 599) semesters. Students from 11 (Fall) and 12 (Spring) health professions education programs were included. True ICCAS pretest scores did not significantly differ from the retrospective pretest scores in either sample, although the effect sizes for pretest to posttest gains were slightly smaller for the true pretest scores. These results support and provide confidence for using the standard ICCAS administration methodology by demonstrating the administration methodology is not adversely impacted by recall or social desirability biases.

An Innovation Sprint to Promote Problem-solving and Interprofessional Skills Among Pharmacy and Public Health Students

Objective. Innovation sprints are a novel pedagogy where small groups of students find creative solutions to problems. The purpose of this study was to extend our understanding of innovation sprint pedagogical design by investigating the impact of an innovation sprint on Doctor of Pharmacy (PharmD) students' and Master of Public Health (MPH) students' interprofessional collaboration and problem-solving skills. We hypothesized that the innovation sprint would increase student self-efficacy and that interprofessional collaborative behaviors would be demonstrated by individuals on a team.Methods. MPH and third-year PharmD students were assigned to teams and participated in a required two-hour innovation sprint. Faculty observed student teams and evaluated their interprofessional collaboration skills using a rubric modeled after the Modified McMaster-Ottawa Scale. Students completed a postprogram survey assessing their interprofessional collaborative behaviors and attitudes toward the innovation sprint.Results. Of the 133 students participating in the innovation sprint, 127 completed the postprogram survey (response rate=95%). Faculty determined that 123 students (92%) met the interprofessional collaboration competencies. The mean interprofessional collaborative competencies attainment survey scores increased for both PharmD and MPH students. Qualitative analyses highlighted themes of interprofessional collaboration and problem-solving skills that students valued. Overall, students enjoyed working with each other and engaging in creative problem-solving.Conclusion. An interprofessional innovation sprint involving PharmD and MPH students demonstrated a positive impact on student self-assessed interprofessional collaboration and problem-solving skills. Further, faculty observed a high rate of interprofessional behaviors within student teams. Based on these findings, an innovation sprint may be an effective pedagogical tool to enhance students' skills in these areas.

Evaluating the impact of interprofessional forums on dental medicine students' collaborative practice skill perception

PURPOSE

This study evaluates third-year dental medicine students' perceived competencies related to interprofessional collaborative practice (IPCP) after completing two exposure level experiences with students from other professions across a large academic health center.

METHODS

Two cohorts of D3 dental medicine students (2018-2019 and 2019-2020) completed the Interprofessional Collaborative Competencies Attainment Survey (ICCAS) after participating in in-person 2.5-h Interprofessional (IP) Forums in the Fall and Spring semesters. Self-reported competencies were compared between pre-and post-IP Forum ratings and between Fall and Spring.

RESULTS

Prior to the IP Forums, dental medicine students (n = 185) reported perceived skill in the interprofessional competencies to be from Good to Very Good using the ICCAS. After participation in the Fall IP Forum, students' ICCAS scores increased in all ICCAS subscales with large effect sizes. Students reported a perceived decline in these skills in the four months between Fall and Spring IP Forums and restoration of IP skill levels after participating in a second IP Forum (Spring).

CONCLUSIONS

Participation in IP Forums has a positive impact on students' IPCP skill perception. Our data suggest that perceived skill level requires repeated IP learning experiences. If dental medicine students are expected to embrace collaborative practice to enhance patient outcomes, then dental school educators must provide opportunities for students to engage in collaborative practice experiences at all levels of their training.