1
|
Wang J, Zhou G, Guo J, Sun X, Sun L. The influence of perceived formative assessment on the learning autonomy of medical students: the chain mediating role of psychological empowerment and positive academic emotions. Front Public Health 2024; 12:1435432. [PMID: 39416939 PMCID: PMC11479983 DOI: 10.3389/fpubh.2024.1435432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Accepted: 09/10/2024] [Indexed: 10/19/2024] Open
Abstract
INTRODUCTION Medical students' autonomous learning is a cornerstone of their educational journey. Formative assessment is defined as a process to enhance learning and improve academic performance, and the key to the effectiveness of formative assessment is the students' perceptions of it. The present study investigates the impacts of perceived formative assessment on the learning autonomy of medical students, explores the chain mediating role of psychological empowerment and positive academic emotions, and offers strategies for facilitating medical students' autonomous learning. METHODS A cross-sectional investigation was conducted using a convenience sampling method involving 713 medical students (mean age 19.72 ± 1.18 years; 207 male and 506 female students; the proportion of participants is 93.69%) in Shandong Second Medical University. Perceived formative assessment was performed using a self-designed questionnaire of Perceived Formative Evaluation for Medical Students, learning autonomy using the Autonomy in Learning Rating Scale for College Students, positive academic emotions using the General Academic Emotion Questionnaire for College Students, and psychological empowerment of medical students using the Chinese version of Psychological Empowerment Scale (PES). The data were analyzed using descriptive statistics, Pearson's correlation, multiple regression, and mediation analysis using the SPSS26.0 program and PROCESS3.1. RESULTS Perceived formative assessment significantly predicted learning autonomy (β = 0.06, p < 0.05). It also positively predicted psychological empowerment (β = 0.20, p < 0.001), and psychological empowerment positively predicted the learning autonomy of medical students (β = 0.36, p < 0.001). Psychological empowerment also positively predicted positive academic emotions (β = 0.64, p < 0.001), and positive academic emotions positively predicted learning autonomy (β = 0.44, p < 0.001). The direct effect value of perceived formative assessment on learning autonomy was 0.18, while the total indirect effect was 0.43. The mediation effect of psychological empowerment on the relationship between perceived formative assessment and learning autonomy was 0.22, and the chain mediation effect of psychological empowerment and positive academic emotions was 0.18, accounting for 30%, 70%, 36%, and 30% of the total effect, respectively. CONCLUSION Perceived formative assessment directly enhances medical students' learning autonomy. This relationship is partially mediated by psychological empowerment and positive academic emotions. The results suggest that formative evaluation boosts psychological empowerment, which fosters positive academic emotions and further promotes learning autonomy.
Collapse
Affiliation(s)
- Jiali Wang
- School of Psychology, Shandong Second Medical University, Weifang, China
| | - Guorun Zhou
- School of Psychology, Shandong Second Medical University, Weifang, China
| | - Juntang Guo
- School of Basic Medical Science, Shandong Second Medical University, Weifang, China
| | - Xiaodong Sun
- Department of Endocrinology and Metabolism, Affiliated Hospital of Shandong Second Medical University, Weifang, China
| | - Lin Sun
- School of Psychology, Shandong Second Medical University, Weifang, China
| |
Collapse
|
2
|
Richardson S, Dial M, Kneiss J, Somyoo N, Varnado K. Equitable Grading Practices in Physical Therapist Education: A Case Report. Phys Ther 2024; 104:pzae084. [PMID: 38976005 DOI: 10.1093/ptj/pzae084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 02/12/2024] [Accepted: 07/02/2024] [Indexed: 07/09/2024]
Abstract
OBJECTIVE To optimize learning in physical therapist education, learners need opportunities to grow from their unique starting points. Traditional grading practices like A to F grades, zero grades, and grading on timeliness and professionalism hinder content mastery and accurate competency assessment. Grading should focus on mastery of skill and content, using summative assessments for final grades, a no-zero policy, and actionable feedback. Equitable grading supports learners from all backgrounds and identities and promotes academic success. This case study provides guidance and recommendations for implementing equitable grading practices in academic physical therapist programs. METHODS Over a 2-year period, a doctor of physical therapy program began implementing 5 strategies to create more equitable grading practices: (1) eliminating zero grades, (2) allowing late assignment submissions without penalty, (3) using low-stakes formative assessments throughout the semester, (4) weighing end-of-course assessments more heavily than initial ones, and (5) offering a no-stakes anatomy prep course before matriculation. RESULTS Outcomes from implementing equitable grading practices varied. Some learners felt increased stress from fewer points opportunities, while others appreciated the reduced anxiety from low-stakes assessments. Some saw multiple attempts for peers as unfair. Faculty faced higher workloads due to detailed feedback and remediation but believed it benefited learners. Median final grades improved in some courses, remained stable in others, and slightly decreased in one. Overall, the changes had minimal impact on most learners' grades but significantly improved outcomes and retention for struggling learners. CONCLUSION This case report documents the implementation of equitable grading practices in a Doctor of Physical Therapy program, offering valuable insights and recommendations for other institutions aiming to adopt similar practices. IMPACT Inequity in assessment widens the gap between learners entering professional programs. Equitable assessment practices level the playing field, enabling learners from diverse backgrounds and identities to succeed. Increased diversity benefits everyone, especially patients, by reducing health disparities for historically marginalized groups.
Collapse
Affiliation(s)
- Shannon Richardson
- Doctor of Physical Therapy Program, College of Saint Mary, Omaha, Nebraska, USA
| | - Monica Dial
- Doctor of Physical Therapy Program, College of Saint Mary, Omaha, Nebraska, USA
| | - Janet Kneiss
- Doctor of Physical Therapy Program, College of Saint Mary, Omaha, Nebraska, USA
| | - Nipaporn Somyoo
- Doctor of Physical Therapy Program, College of Saint Mary, Omaha, Nebraska, USA
| | - Kimberly Varnado
- Doctor of Physical Therapy Program, College of Saint Mary, Omaha, Nebraska, USA
| |
Collapse
|
3
|
Garcia-Ros R, Ruescas-Nicolau MA, Cezón-Serrano N, Flor-Rufino C, Martin-Valenzuela CS, Sánchez-Sánchez ML. Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy. BMC Psychol 2024; 12:147. [PMID: 38486300 PMCID: PMC10941460 DOI: 10.1186/s40359-024-01643-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 03/05/2024] [Indexed: 03/17/2024] Open
Abstract
BACKGROUND The development of procedural skills is essential in health sciences education. Rubrics can be useful for learning and assessing these skills. To this end, a set of rubrics were developed in case of neurophysiotherapy maneuvers for undergraduates. Although students found the rubrics to be valid and useful in previous courses, the analysis of the practical exam results showed the need to change them in order to improve their validity and reliability, especially when used for summative purposes. After reviewing the rubrics, this paper analyzes their validity and reliability for promoting the learning of neurophysiotherapy maneuvers and assessing the acquisition of the procedural skills they involve. METHODS In this cross-sectional and psychometric study, six experts and 142 undergraduate students of a neurophysiotherapy subject from a Spanish university participated. The rubrics' validity (content and structural) and reliability (inter-rater and internal consistency) were analyzed. The students' scores in the subject practical exam derived from the application of the rubrics, as well as the rubrics' criteria difficulty and discrimination indices were also determined. RESULTS The rubrics´ content validity was found to be adequate (Content Validity Index > 0.90). These showed a unidimensional structure, and an acceptable internal consistency (α = 0.71) and inter-rater reliability (Fleiss' ƙ=0.44, ICC = 0.94). The scores of the subject practical exam practically covered the entire range of possible theoretical scores, showing all the criterion medium-low to medium difficulty indices - except for the one related to the physical therapist position-. All the criterion exhibited adequate discrimination indices (rpbis > 0.39), as did the rubric as a whole (Ferguson's δ = 0.86). Students highlighted the rubrics´ usefulness for learning the maneuvers, as well as their validity and reliability for formative and summative assessment. CONCLUSIONS The changed rubrics constitute a valid and reliable instrument for evaluating the execution quality of neurophysiotherapy maneuvers from a summative evaluation viewpoint. This study facilitates the development of rubrics aimed at promoting different practical skills in health-science education.
Collapse
Affiliation(s)
- Rafael Garcia-Ros
- Department of Developmental and Educational Psychology, Faculty of Psychology, University of Valencia, Blasco Ibáñez Av. no. 21, Valencia, 46010, Spain
- Neurophysiotherapy Teaching Innovation Group, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
| | - Maria-Arantzazu Ruescas-Nicolau
- Neurophysiotherapy Teaching Innovation Group, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain.
- Physiotherapy in Motion. Multispeciality Research Group (PTinMOTION), Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain.
| | - Natalia Cezón-Serrano
- Neurophysiotherapy Teaching Innovation Group, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
- Physiotherapy in Motion. Multispeciality Research Group (PTinMOTION), Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
| | - Cristina Flor-Rufino
- Neurophysiotherapy Teaching Innovation Group, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
- Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
| | - Constanza San Martin-Valenzuela
- Neurophysiotherapy Teaching Innovation Group, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
- Research unit in Clinical biomechanics - UBIC, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
| | - M Luz Sánchez-Sánchez
- Neurophysiotherapy Teaching Innovation Group, Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
- Physiotherapy in Motion. Multispeciality Research Group (PTinMOTION), Department of Physiotherapy, Faculty of Physiotherapy, University of Valencia, Gascó Oliag Street no. 5, Valencia, 46010, Spain
| |
Collapse
|
4
|
Pérez-Guillén S, Carrasco-Uribarren A, Celis CLD, González-Rueda V, Rodríguez-Rubio PR, Cabanillas-Barea S. Students' perceptions, engagement and satisfaction with the use of an e-rubric for the assessment of manual skills in physiotherapy. BMC MEDICAL EDUCATION 2022; 22:623. [PMID: 35978301 PMCID: PMC9382838 DOI: 10.1186/s12909-022-03651-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/19/2022] [Accepted: 07/19/2022] [Indexed: 06/15/2023]
Abstract
INTRODUCTION In recent years, formative assessment has gained importance in health care education to facilitate and enhance learning throughout the training period. Within the frame of active methodologies, rubrics have become an essential instrument for formative assessment. Most rubric-based assessment procedures focus on measuring the effects of rubrics on teachers. However, few studies focus their attention on the perception that students have of the evaluation process through rubrics. METHODS A cross-sectional survey study was carried out with 134 students enrolled in the pre-graduate Physiotherapy education. Assessment of manual skills during a practical examination was performed using an e-rubric tool. Peer-assessment, self-assessment and teacher´s assessment were registered. After completion of the examination process, students' perceptions, satisfaction and engagement were collected. RESULTS Quantitative results related to students' opinion about e-rubric based assessment, students' engagement, perceived benefits and drawbacks of the e-rubric as well as the overall assessment of the learning experience were obtained. 86.6% of the students agreed upon the fact that "the rubric allowed one to know what it is expected from examination" and 83.6% of the students agreed upon the fact that "the rubric allowed one to verify the level of competence acquired". A high rate of agreement (87.3%) was also reached among students concerning feedback. CONCLUSIONS E-rubrics seemed to have the potential to promote learning by making criteria and expectations explicit, facilitating feedback, self-assessment and peer-assessment. The importance of students in their own learning process required their participation in the assessment task, a fact that was globally appreciated by the students. Learning experience was considered interesting, motivating, it promoted participation, cooperative work and peer-assessment. The use of e-rubrics increased engagement levels when attention was focused on their guidance and reflection role.
Collapse
Affiliation(s)
- Silvia Pérez-Guillén
- Department of Physical Therapy, Universitat Internacional de Catalunya, Barcelona, Spain
| | | | - Carlos López-de Celis
- Department of Physical Therapy, Universitat Internacional de Catalunya, Barcelona, Spain
| | - Vanessa González-Rueda
- Department of Physical Therapy, Universitat Internacional de Catalunya, Barcelona, Spain
| | | | - Sara Cabanillas-Barea
- Department of Physical Therapy, Universitat Internacional de Catalunya, Barcelona, Spain
| |
Collapse
|