The Assessment of Physiotherapy Practice tool provides informative assessments of clinical and professional dimensions of student performance in undergraduate placements: a longitudinal validity and reliability study

The effect of self-assessment on student competence in physiotherapy clinical training: a randomized controlled trial

BACKGROUND

Self-assessment is a method that allows students to reflect on and critically evaluate their performance, increases students' involvement in learning, and improves academic achievement. In physiotherapy (PT) education, clinical training is a crucial component, guided by clinical educators (CEs), who assess and provide feedback, fostering student development. Limited research has investigated the impact of self-assessment on PT clinical training outcomes. This study aims to assess the effect of mid-term self-assessment during PT clinical training on students' competence and on level of agreement between students' self-assessment and CEs' assessment at the end of the training.

METHODS

23 CEs and their 52 undergraduate PT students participated in the study. The students underwent eight weeks of clinical training in outpatient PT clinics in groups of two or three. For each group, one CE performed student assessment at the mid-term and the end of the training using the Assessment of Physiotherapy Practice (APP) form, an assessment tool used to evaluate clinical competence in PT clinical training. One student from each group was randomly assigned to join the intervention group (IG). These students completed a self-assessment process at the mid-term of the training. All students were asked to complete a self-assessment form at the end of the training.

RESULTS

The median CE's evaluation score halfway through the training was 80 [50-96] and 91 [65-100] at the end of the training, with no significant differences between the two groups. The level of agreement between the student and CE's evaluation at the end of the training was not significantly different between the groups (p = 0.05). It noted that students who scored themselves higher than their CEs tended to have lower APP scores than others, based on CEs' assessment. These students were found to have less academic experience. Nevertheless, those from the IG improved significantly, based on the CE's assessment, during the second half of the training, compared to the controls.

CONCLUSION

The main finding of the present study is that student participation in self-assessment during PT clinical training is advantageous, mainly for individuals undergoing their initial clinical training and in the early stages of their academic studies.

Understanding underperformance in a high-stakes clinical-based simulation assessment in physiotherapy: a descriptive analysis

BACKGROUND

High-stakes assessments are often used as a 'gate-keeper' activity for entry into the health professions by ensuring that the minimum core competency thresholds of the profession are met. The aim of the study was to explore if common areas of underperformance existed in international candidates assessed with a high-stakes clinical-based simulation assessment for entry into the physiotherapy profession in Australia.

METHODS

A retrospective mixed methods analysis of the clinical assessments completed by international candidates over a one-month period in 2021 that were deemed as not meeting competency. The clinical assessments were completed in one of the three practice areas: cardiorespiratory, musculoskeletal, or neurological rehabilitation. Each assessment was scored by two independent assessors, who discussed the performance and then completed a moderated assessment form. The assessment form used to score competency included seven domains such as initial assessment, effective treatment, communication skills, and risk management.

RESULTS

Fifty-one clinical assessments graded as not competent were analysed. Across the practice areas, a high failure rate was found in domains related to interpreting assessment findings and developing a treatment plan. This trend was also observed in the qualitative data, suggesting candidates struggled to meet competency in areas of planning and prioritisation, interpretation and implementation of the information gathered, and selection and evaluation of effective treatment.

CONCLUSION

These findings align with published data on the underperformance of Australian physiotherapy students in clinical placement settings, suggesting these issues are not specific to high stakes assessment of overseas physiotherapists, and that education needs to focus on improving these skills within the profession at all levels. With the identified areas of underperformance aligning with the ability to use higher order thinking and skills integral to clinical reasoning, improvements in the education and implementation of clinical reasoning may be a place to start.

Education programmes on performance-based assessment for allied health and nursing clinical educators: A scoping review protocol

Background: Performance-based assessment (PBA) is a complex process undertaken in the workplace by healthcare practitioners known as clinical educators, who assist universities in determining health professional students’ readiness for independent practice. Preparing healthcare professionals for PBA is considered essential to ensuring the quality of the assessment process in the clinical learning environment. A preliminary search of the literature indicated a paucity of research guiding the development of education programmes that support practice educators to understand and implement PBA.  Objective: The aim of this scoping review is to investigate and describe education programmes delivered to allied health and nursing clinical educators, to develop PBA knowledge and skills. Methods: This review will follow the Joanna Briggs Institute (JBI) methodology for conducting scoping reviews. Electronic databases relevant to this research topic will be searched including, EMBASE, ERIC, MEDLINE (Ovid), Web of Science and CINAHL and other targeted databases for grey literature. Studies that include PBA as the main focus or a component of the education programmes, of any format, delivered to clinical educators in allied health and nursing will be included. Studies may report the design and/or implementation and/or evaluation of PBA education programmes. Relevant English language publications will be sought from January 2000 to October 2022. Two reviewers will screen all titles and abstracts against the inclusion/exclusion criteria, and publications deemed relevant will be eligible for full text screening, confirming appropriateness for inclusion in the scoping review. Data will be charted to create a table of the results, supported by narrative summary of findings in line with the review objectives.

Competency-Based Education and Practice in Physical Therapy: It's Time to Act!

Competency-based education (CBE) is a concept, a philosophy, and an approach to educational design where learner progression occurs when competency is demonstrated. It assumes a set of standard defined performance outcomes for any level of professional practice-students, residents, or practicing physical therapists. Those outcomes are based on the health needs of society and guide the curricular design, implementation, and evaluation of health professions education programs. Lack of a CBE framework-with no required demonstration of competence throughout one's career-has the potential to lead to variation in physical therapists' skills and to unwarranted variation in practice, potentially hindering delivery of the highest quality of patient care. CBE requires a framework that includes a commonly understood language; standardized, defined performance outcomes at various stages of learner development; and a process to assess whether competence has been demonstrated. The purpose of this perspective article is to (1) highlight the need for a shared language, (2) provide an overview of CBE and the impetus for the change, (3) propose a shift toward CBE in physical therapy, and (4) discuss the need for the profession to adopt a mindset requiring purposeful practice across one's career to safely and most efficiently practice in a given area. Utilizing a CBE philosophy throughout one's career should ensure high-quality and safe patient care to all-patient care that can adapt to the changing scope of physical therapist practice as well as the health care needs of society. The physical therapy profession is at a point at which we must step up the transition to a competency-based system of physical therapist education.