Integrating students′ reflection-in-learning and examination performance as a method for providing educational feedback

Dental Teacher Feedback and Student Learning: A Qualitative Study

INTRODUCTION

Feedback is essential to improve student learning and motivation and to encourage curriculum development by teachers. This study looked at feedback to and from dental students from a qualitative perspective.

METHODS

Dental teachers were recruited exclusively to this study from the membership of the Association for Dental Education in Europe (ADEE). Delegates from each of the four annual ADEE conferences were invited to attend focus groups to discuss aspects of feedback. Focus groups established an individual theme for the respective conferences: (i) the role of the teacher in delivering feedback; (ii) feedback from the students' perspective; (iii) changes to feedback due to the COVID-19 pandemic; and (iv) integrating feedback with assessments.

RESULTS

Qualitative data collected from the conference delegates were diverse and thought provoking. Delegates reported different styles of feedback varying from individual, personal feedback to no feedback at all. An enforced and mostly positive adaptation to online delivery during the COVID-19 pandemic was reported. A partial return to pre-pandemic practices was described.

CONCLUSIONS

Feedback is well recognized by students and teachers as contributing to learning. A universal approach to delivering feedback as part of the student learning process can be challenging due to a multitude of variables. Many aspects of changes in dental education, teaching, and feedback practices adopted as a result of the COVID-19 pandemic have been retained post-pandemic, thereby accelerating the anticipated progression to online teaching.

PRISM: A Novel Visual Instrument to Facilitate Self-Reflection and Learning Progress in Undergraduate Dental Education

Objectives

PRISM (Pictorial Representation of Illness and Self-Measure) is a simple visual tool that has been successfully used as a visual metaphor in medicine. In this pilot study, PRISM was used for the first time to test its potential to support self-reflection and expectations of learning in dental students.

Methods

Dental student volunteers (25 3^rd year, 10 4^th year, and 10 5^th year) participated. Using both quantitative and qualitative methods, PRISM interviews were compared with a numerical scale in assessing learning objectives concerning theoretical knowledge, practical skills, interest, and training need in the field of conservative dentistry.

Results

Overall, 71% of total student group stated that they would draw personal consequences for their studies due to participating in the PRISM interviews. Compared to the numeric scales, PRISM was rated as more helpful regarding appraisal of students' theoretical knowledge (p = 0.02), practical skills (p < 0.01), training needs (p < 0.01), importance of dental subspecialties (p < 0.01), and facilitating self-reflection (p = 0.02). In focus groups, students commented that PRISM fostered the development of a trusting relationship with their teacher. Strengths of PRISM mentioned by the students included being able to observe and manipulate a visual summary of their individual learning needs and seeing their different learning needs in relation to one another.

Conclusion

In this pilot study, dental students evaluated PRISM to be superior against numeric scales. Furthermore, it ameliorated the communication with teachers. The PRISM task is both simple and brief and warrants further exploration as a useful tool for self-reflection in dental education.

Instruments to measure the ability to self-reflect: A systematic review of evidence from workplace and educational settings including health care

INTRODUCTION

Self-reflection has become recognised as a core skill in dental education, although the ability to self-reflect is valued and measured within several professions. This review appraises the evidence for instruments available to measure the self-reflective ability of adults studying or working within any setting, not just health care.

MATERIALS AND METHODS

A systematic review was conducted of 20 electronic databases (including Medline, ERIC, CINAHL and Business Source Complete) from 1975 to 2017, supplemented by citation searches. Data were extracted from each study and the studies graded against quality indicators by at least two independent reviewers, using a coding sheet. Reviewers completed a utility analysis of the assessment instruments described within included studies, appraising their reported reliability, validity, educational impact, acceptability and cost.

RESULTS

A total of 131 studies met the inclusion criteria. Eighteen were judged to provide higher quality evidence for the review and three broad types of instrument were identified, namely: rubrics (or scoring guides), self-reported scales and observed behaviour.

CONCLUSIONS

Three types of instrument were identified to assess the ability to self-reflect. It was not possible to recommend a single most effective instrument due to under reporting of the criteria necessary for a full utility analysis of each. The use of more than one instrument may therefore be appropriate dependent on the acceptability to the faculty, assessor, student and cost. Future research should report on the utility of assessment instruments and provide guidance on what constitutes thresholds of acceptable or unacceptable ability to self-reflect, and how this should be managed.