A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems

Difference in Physiotherapy Students' Training and Objective Structured Clinical Exam Performance Before and During COVID-19

Purpose

The Objective Structured Clinical Examination (OSCE) and station examinations, in general, have been widely utilized in health professional programmes to evaluate students' clinical performance prior to advancing to a clinical placement. The COVID-19 pandemic impacted student preparation and implementation of our programme's OSCEs. The impact on changes in student OSCE performance due COVID-19 has not been well studied. This non-concurrent cohort study evaluated the difference before and during COVID-19 pandemic on Year 1 physiotherapy students' performances on an in-person OSCE by estimating the mean difference in cohort OSCE scores and safety occurrences.

Methods

Two cohorts of MSc (PT) students were compared: Cohort A (not impacted by COVID-19) and Cohort B (impacted by COVID-19). Cohort scores were summarized as means and 95% CIs.

Results

Overall OSCE scores for Cohort A and B were 77.9 and 81.9, respectively (d ¯ = 4.0, 95% CI: 2.1, 5.8). Cohort B students were approximately 4 times more likely to demonstrate safety occurrences.

Conclusion

The impact of COVID-19 did not adversely affect total OSCE scores; however, it did increase safety infractions.

The effect of objective structured clinical examinations for nursing students

Twenty core nursing skills have been identified by the Korean Accreditation Board of Nursing Education. Proficiency in these skills is essential for all nursing professions, and many educational strategies exist to develop these skills in nursing students, including the Objective Structured Clinical Examination (OSCE). To date, no study on the effects of the OSCE on nursing education has been published. Therefore, we evaluated the effects of the OSCE on the core nursing skills of 207 pre-licensure nursing students in Korea. We measured the nursing students' confidence, skills, and knowledge acquisition and retention. A one-way analysis of variance and Fisher's least significant difference were used for data analysis. Among the four nursing areas (fall, transfusion, pre-operative, and post-operative), students demonstrated the highest confidence level scores in pre-operative nursing. On the OSCE, students scored the highest in transfusion nursing. Significant differences were found between prior knowledge, knowledge acquisition, and retention. Our findings confirm that the OSCE, after lectures and core nursing skill practice, improved the retention of nursing students' knowledge. Therefore, this program can positively influence nursing students' knowledge level, and implementing the OSCE can strengthen students' clinical competency.

Autonomic stress response of physiotherapy student in the different scenarios of an objective structured clinical examination

The aim of the present research was to analyse modifications in the autonomic stress response of Physiotherapy students undergoing a 12-scenario Objective Structured Clinical Evaluation (OSCE). A total of 86 last year students of the Physiotherapy bachelor's degree (27.29 years (SD = 6.66); 36 females and 50 males) randomly assigned were monitored during the complete OSCE to measure heart rate variability (HRV) in temporal, frequency, and non-linear domains. The HRV analysed showed a large anticipatory stress response of students maintained during the entire evaluation. The stress response varied regarding OSCE station complexity and demands and the highest sympathetic response was not found in higher emotional scenarios.The autonomic modulation monitoring allows teachers to design OSCE scenarios more adapted to the students, limiting the effect of the stress response to allow a better performance.

Medical Council of Canada Qualifying Examinations and performance in future practice

The purpose of medical licensing examinations is to protect the public from practitioners who do not have adequate knowledge, skills, and abilities to provide acceptable patient care, and therefore evaluating the validity of these examinations is a matter of accountability. Our objective was to discuss the Medical Council of Canada's Qualifying Examinations (MCCQEs) Part I (QE1) and Part II (QE2) in terms of how well they reflect future performance in practice. We examined the supposition that satisfactory performance on the MCCQEs are important determinants of practice performance and, ultimately, patient outcomes. We examined the literature before the implementation of the QE2 (pre-1992), post QE2 but prior to the implementation of the new Blueprint (1992-2018), and post Blueprint (2018-present). The literature suggests that MCCQE performance is predictive of future physician behaviours, that the relationship between examination performance and outcomes did not attenuate with practice experience, and that associations between examination performance and outcomes made sense clinically. While the evidence suggests the MCC qualifying examinations measure the intended constructs and are predictive of future performance, the validity argument is never complete. As new competency requirements emerge, we will need to develop valid and reliable mechanisms for determining practice readiness in these areas.