Student conceptions of feedback: Impact on self-regulation, self-efficacy, and academic achievement

Promoting new users' online health consultation services usage behavior strategically

Online consultation services have the potential to reduce the workload of healthcare staff, provide timely care to patients, and improve doctor-patient relationships. The COVID-19 pandemic has accelerated the development of these services and platforms, but it remains to be seen whether the general public will continue to use them after the pandemic is under control. This research proposes a framework to examine the factors contributing to UK adults' continued usage of online healthcare consultation services after COVID-19 restrictions have been lifted. A total of 430 new users completed surveys, and the results indicate that expectation confirmation, system quality, and information quality can positively impact users' self-efficacy toward using online consultation services. This, in turn, can influence their continued usage behavior. Furthermore, the results suggest that participants' perception of health risks can moderate the relationship between self-efficacy and continued usage behavior. The strategic implications of these findings are discussed.

Developing a scale to explore self-regulatory approaches to assessment and feedback with academics in higher education

Introduction

Students need to acquire high level self-regulatory skills if they are to be successful within higher education, and academics need support in facilitating this. In this article we explore how the current research gap between knowledge of self-regulatory assessment and feedback (SRAF) practices, and academics' professional training in it can be bridged.

Methods

SRAF tools were used with academics to explore their understandings of and training needs in SRAF; central to this work was the development of a SRAF scale. We consider the value of such tools in supporting academics' professional development needs in SRAF. The reliability and validity of the SRAF scale was tested using exploratory factor analyses (EFA).

Results

Iterative EFA resulted in a 17 item support required SRAF scale (SR). Two underpinning factors: Creating the Conditions for SRAF, and Supporting Students' SRAF Skills Development were identified. The reliability of the instrument supported its primary use as a tool to facilitate academics' professional development in fostering students' self-regulatory skills.

Discussion

Our findings highlight the importance of supporting academics in developing strategies to maximize students' metacognitive skills and motivation in assessment and feedback, contingent on effective assessment design. Such professional development needs to be mindful of individual and contextual factors impacting academics' access to, and confidence and competence in, using SRAF in practice. This research is important in highlighting potential disconnects between where academics' focus their attention in assessment, and what is known to have most impact on student learning success. The SRAF tools have considerable potential in supporting translation of theory into practice as part of sustained professional development for academics in higher education.

Does 'summative' count? The influence of the awarding of study credits on feedback use and test-taking motivation in medical progress testing

Despite the increasing implementation of formative assessment in medical education, its' effect on learning behaviour remains questionable. This effect may depend on how students value formative, and summative assessments differently. Informed by Expectancy Value Theory, we compared test preparation, feedback use, and test-taking motivation of medical students who either took a purely formative progress test (formative PT-group) or a progress test that yielded study credits (summative PT-group). In a mixed-methods study design, we triangulated quantitative questionnaire data (n = 264), logging data of an online PT feedback system (n = 618), and qualitative interview data (n = 21) to compare feedback use, and test-taking motivation between the formative PT-group (n = 316), and the summative PT-group (n = 302). Self-reported, and actual feedback consultation was higher in the summative PT-group. Test preparation, and active feedback use were relatively low and similar in both groups. Both quantitative, and qualitative results showed that the motivation to prepare and consult feedback relates to how students value the assessment. In the interview data, a link could be made with goal orientation theory, as performance-oriented students perceived the formative PT as not important due to the lack of study credits. This led to low test-taking effort, and feedback consultation after the formative PT. In contrast, learning-oriented students valued the formative PT, and used it for self-study or self-assessment to gain feedback. Our results indicate that most students are less motivated to put effort in the test, and use feedback when there are no direct consequences. A supportive assessment environment that emphasizes recognition of the value of formative testing is required to motivate students to use feedback for learning.

Perception of Polish pharmacy students on simulation exercise in pharmaceutical care for diabetes-a pilot study

BACKGROUND

The transformation of a pharmacist's role from that of a drug dispenser to an advisor and patient educator, partially accelerated by the COVID-19 pandemic, requires a thorough change in the pharmacy curriculum. Preparation for the provision of modern pharmaceutical services requires the use of the most advanced teaching methods, such as pharmaceutical simulation. Knowledge alone does not guarantee students' readiness and motivation to take on new challenges in their professional work, but it seems crucial that graduates of medical faculties have the ability to practically apply their knowledge, including in new and nonstandard situations. Therefore, in our study, we proposed an intervention using a simulation method (peer role play) in teaching pharmaceutical care, and we assessed its impact on students' levels of self-perceived confidence and self-efficacy in accordance with Bandura's theory. The aim of the study was to verify whether the introduction of these types of classes could be a useful element of pharmacy curriculum renewal.

METHODS

The questionnaire-based study was conducted during pharmaceutical care peer role-playing classes in a simulation environment with a debriefing session among 85 final-year pharmacy students at Poznan University of Medical Sciences, Poland. The questionnaire consisted of two surveys: the General Self-Efficacy Scale (GSE) and a pre-post self-assessment and self-efficacy questionnaire.

RESULTS

There was a positive correlation between the GSE score and self-efficacy (R = 0.52, p < 0.0001). A statistically significant increase in the post-self-assessment of all the skills and competencies included in the survey in the field of pharmaceutical care of a patient with diabetes compared to the pre-values was also observed (p < 0.001). Additionally, the students' self-efficacy in terms of communicating with patients was greater following the class than before the class (p < 0.001).

CONCLUSIONS

The peer role-play active teaching method was found to be a cost-effective method allowing for an increase in the self-assessment and self-efficacy of pharmacy students in diabetic patient pharmaceutical care. However, further in-depth research is needed to fully confirm the effectiveness of simulation exercises for teaching pharmacy undergraduates.

Navigating Uncertainty: Teachers' Insights on Their Preservice Training and Its Influence on Self-Efficacy during the COVID-19 Pandemic

This quantitative study investigates teachers' perceptions of self-efficacy during the COVID-19 pandemic and explores the correlation between these perceptions and the preservice training they received. The research addresses the cognitive connection between teachers' current self-efficacy, particularly their satisfaction with and appreciation of preservice lecturers. The connection between self-efficacy and "cognitive connection" lies in the intricate interplay of cognitive processes, observational learning, and the formation of beliefs and perceptions. The way individuals cognitively process information, make connections between experiences, and interpret feedback significantly influences their self-efficacy beliefs and behaviors. Utilizing a retrospective lens, the study reveals a significant correlation between teachers' evaluation of their preservice training, especially their appreciation of lecturers, and their present self-efficacy. The findings highlight that teachers, amidst the challenges of the pandemic, evaluated their self-efficacy at a remarkably high level. This underscores their resilience during a period of unprecedented uncertainty demanding substantial personal and professional adaptability. The nuanced interplay observed suggests that teachers' sense of self-efficacy serves as a predictive variable of their mental and professional resilience when confronting uncertainty and navigating rapid and profound changes, as exemplified by the exigencies of the COVID-19 pandemic.

Relationship between learning flow and academic performance among students: a systematic evaluation and meta-analysis

Introduction

The concept of "flow experience," characterized by a state of immersive enjoyment and profound engagement, pertains to individuals' deep involvement in intriguing and pleasant tasks. In the field of study, individuals are in a state of flow when encountering challenging tasks, which matters considerably in completing the tasks. Therefore, learning flow is considered a hotspot in education that may be related to improving academic performance. Nonetheless, there remains contention regarding the extent of learning flow's impact on academic performance. To this end, meta-learning was hereby used to provide evidenced on the relationship between them.

Methods

A systematic review was conducted under the guidance of PRISMA to examine the evidence of learning flow and academic performance, check the potential mechanism and evaluate the current evidence. Clinical research or empirical research on the influence of learning flow on academic achievement was collected by searching four databases. The literature retrieval spanned from each database's inception until June 2023, specifically covering the PubMed (2000-2023.6), Embase (1974-2023.6), Cochrane Library (1993-2023.6), and the Web of Science (1807-2023.6), with particular attention to the period between 2000 and 2023.

Results

Thirteen RCTs were included, the total sample size used in the study was 3,253. Using the NOS evaluation tool of queue study, the average evaluation score of the included literatures was 7.46, indicating that the overall literature was above average. Besides, the data software StataSE was used to test the heterogeneity of the data, and the correlation coefficient and 95% confidence interval effect were found to be 0.43 (0.28, 0.57).

Discussion

Our research indicates a link between learning flow and academic performance, that is, students with high learning flow levels tend to have better academic performance. At the same time, this conclusion needs to be verified by more high-quality literature and larger sample data.

Systematic review registration

https://inplasy.com, identifier INPLASY202360079.

Chinese university students' conceptions of feedback and the relationships with self-regulated learning, self-efficacy, and English language achievement

In China, under the influence of examination-driven culture and teacher-centered ways of learning, students' self-regulated learning (SRL) capabilities, self-efficacy, and actual English proficiency are greatly hindered. Given this situation, the Chinese Ministry of Education has promulgated the use of formative assessment in the College English curriculum at the tertiary level since 2004. Feedback, as an integrated part of formative assessment, takes up the largest proportion of the Chinese College English classroom assessment and intends to facilitate SRL and learning. However, whether feedback could facilitate students' SRL and learning has not been fully investigated in this context in China. Therefore, this study first explored how students self-reported their conceptions of feedback, SRL, and self-efficacy, and second, the relationships among these constructs and their English language achievement in the College English course. A questionnaire was used to collect data on students' conceptions of feedback, SRL, self-efficacy, and self-perceived English language proficiency. Their English test scores as an indicator of English language achievement were also collected. A total of 538 participants from a university in Northern China participated in this study. Data were analyzed using descriptive statistics, exploratory factor analyses, Pearson correlation analyses, and multiple regression analyses. The results found that Chinese students from the College English course reported a high level of conceptions of teacher and peer feedback, SRL, and self-efficacy, yet a low level of Teacher/Peer Feedback Ignored. For the relationships among these variables, students' conceptions of feedback contributed to SRL and self-efficacy. Besides, self-efficacy was found to be the strongest predictor for self-perceived English language proficiency and standardized English test scores, both indicators for English language achievement. From the theoretical perspective, this study addressed the research gap in the literature by examining four constructs together, that is, students' conceptions of feedback, SRL, self-efficacy, and English language achievement within a university context in China. From the pedagogical angle, the results can also support teachers in their feedback practices to facilitate students' SRL, self-efficacy, and learning.

The sense of belonging reduces ingroup favoritism in children

Belonging is an important motive for intergroup behavior. Adults display pronounced ingroup favoritism when the sense of inclusion by an ingroup is decreased or threatened. The present study investigated whether ingroup belonging reduces ingroup favoritism in 6-year-old children in terms of costly sharing. Children were allocated to a novel group in a minimal-group paradigm. In two conditions, children played a brief ball-tossing game and were either included (ingroup-inclusion condition) or excluded (ingroup-exclusion condition) by their ingroup members. Children in a no-interaction condition did not have any interactions with the members of the ingroup. After this manipulation, we tested the extent to which children shared resources with ingroup and outgroup members. We found that children in the ingroup-exclusion and no-interaction conditions shared more resources with their ingroup member than their outgroup member, while children in the ingroup-inclusion condition shared equally with the ingroup and outgroup members. These results could inform interventions aimed at fostering positive intergroup relations.

University students’ strategies and criteria during self-assessment: instructor’s feedback, rubrics, and year level effects

This study explores the effects of feedback type, feedback occasion, and year level on student self-assessments in higher education. In total, 126 university students participated in this randomized experiment under three experimental conditions (i.e., rubric feedback, instructor’s written feedback, and rubric feedback plus instructor’s written feedback). Participants, after random assignment to feedback condition, were video-recorded performing a self-assessment on a writing task both before and after receiving feedback. The quality of self-assessment strategies decreased after feedback of all kinds, but the number of strategies increased for the combined feedback condition. The number of self-assessment criteria increased for rubric and combined conditions, while feedback helped shift criteria use from basic to advanced criteria. Student year level was not systematically related to changes in self-assessment after feedback. In general, the combination of rubric and instructor’s feedback produced the best effects.

Aspects of self-regulated learning and their influence on the mathematics achievement of fifth graders in the context of four different proclaimed curricula

Metacognition is a part of the models of self-regulated learning. The consideration of a broader context resonates with a social cognitive perspective approach to learning which dominates the educational academic field with the theory of self-regulated learning. Metacognition is considered a crucial factor influencing mathematics achievement. Furthermore, the affective field including pupils' self-efficacy, interest and motivation are the phenomena involved in mathematical problem-solving. On the other hand, metacognitive knowledge and metacognitive regulations are not a regular part of mathematics education in the Czech Republic. The main aim of this study was to investigate the relation between pupils' attitude toward mathematics; metacognitive knowledge; self-efficacy and motivation; metacognitive monitoring; and their achievement in solving mathematical problems. All together 1,133 students of Grade 5 from four types of Czech schools participated in the study. There were traditional schools; schools teaching mathematics by genetic constructivism, i.e., Hejný's method; Montessori schools; and Dalton schools were involved. The assessed variables, namely relation to mathematics; metacognitive knowledge; self-efficacy and motivation; metacognitive monitoring; and mathematical achievement were used as an input to regression analysis. Item-response theory was used for assessing the performance of the students and demands of the tasks. The metacognitive monitoring was detected as the most significant predictor of mathematics achievement for higher- and lower-performing students as well as for the item with high and low demands. The study reveals how the different mathematics curricula (un)support the metacognitive processes involved in mathematical problem-solving. The information allows teachers to spend sufficient time with particular types of mathematics problems whose solutions is determined by activation of metacognitive processes. This demonstrates the importance of including the activities for development of metacognitive monitoring in mathematics education.

Reforming the Teaching and Learning of Foundational Mathematics Courses: An Investigation into the Status Quo of Teaching, Feedback Delivery, and Assessment in a First-Year Calculus Course

Several universities are witnessing an increase in students’ enrolment in mathematics-intensive programmes over the last decades. This increase has come with the price of high failure rates in foundational mathematics courses, which poses challenges to mathematics teaching and learning in higher education. It is therefore inevitable, for some universities, to transform the teaching and learning of mathematics to more student-centred approaches that engage the students mathematically and enhance their success rates. We approach this transformative effort by investigating students’ perception of teaching, feedback, and assessment as a first step in reforming the teaching of a first-year mathematics course at a Norwegian university. The results of both quantitative and qualitative analyses of the data generated using a questionnaire from 107 (80 men) engineering students show that the status quo of teachings offers little support for learning. The teaching is dominated by teacher-led instruction, note-taking, and large pieces of proof which make learning difficult for students during class activities. The results also show that the current structure of the course offers limited formative feedback to students and that the assessment tasks require restructuring to capture students’ time and effort. We discuss the implications of these findings and make some recommendations for improvement.

Individual and class-level factors for students' management of homework environment: The self-regulation perspective

The present study investigated the predictive effects of clusters of variables on homework environment management based on the data from 3018 students in Grade 8. These clusters included: background variables, homework characteristics, adult support and monitoring, homework purposes, goal orientations, and contextual control. At the individual level, management of homework environment was significantly related to at least one variable from each of the six clusters. Specifically, it was associated negatively with time spent watching TV, and positively with prior achievement, homework interest, homework quality, family help, teacher feedback, academic purpose, self-regulatory purpose, mastery-approach, and help seeking. Additionally, males managed homework environment less frequently than females. Finally, management of homework environment was positively related to homework quality at the class level.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s12144-021-02596-5.

The Effectiveness of Self-Instructional Video vs. Classroom Teaching Method on Focused Assessment With Sonography in Trauma Among House Officers in University Hospital

Background: The aim of this study was to compare the effectiveness of self-instructional-video (SIV) and classroom training method (CTM) in learning Focus-Assessment with Sonography-in-Trauma (FAST) among house officers (HO).

Method: A randomized controlled study involving house officers working in the university hospital in Malaysia was conducted where participants were randomized into SIV group (intervention) and CTM group (control). Each group had to undergo a 4 h hands-on training. The intervention group has undergone self-training using the video material without any facilitation while the control group received lecture and hands-on training with facilitators. Participants' performance was assessed using a validated Objective Structured Clinical Examination checklist for landmark identification and interpretation of images generated. Learning preference and confidence level were also assessed.

Result: A total of 33 HO were enrolled in this study. Marks obtained in image acquisition by the intervention and control were 25.3 (SD = 5.3) and 25.6 (SD = 2.3) p > 0.05, respectively. While in image interpretation, the mean score for the intervention and control group was 10.3 (SD 1.7) and 9.8 (SD = 1.7) p > 0.05, respectively. Overall performance assessment, showed the intervention group obtained 35.6 (SD = 5.9) compared to control 35.3 (SD = 3.4), p > 0.05. Based on pre-specified determinant these scores difference falls within the 10% of non-inferiority margin. The absolute difference between both groups was 0.3 (CI = −3.75 to 3.21, p = 0.871), which proves non-inferiority but not superiority. In terms of learning preference and confidence to perform FAST, most of the participants preferred the control group approach.

Conclusion: The SIV method is as effective as the CTM for learning FAST among the house officers and served as an alternative to classroom teaching. However, this technique needs improvement in promoting their confidence and preference. Perhaps incorporating a feedback session after going through the SIV would improve the confidence.

Well Done! Effects of Positive Feedback on Perceived Self-Efficacy, Flow and Performance in a Mental Arithmetic Task

Self-efficacy is a well-known psychological resource, being positively associated with increased performance. Furthermore, results from field studies suggest a positive impact of self-efficacy on flow experience, which has not yet been tested experimentally. In this study, we manipulated self-efficacy by means of positive feedback and investigated whether self-efficacy serves as a mediator in the relationship between positive feedback and flow and in the relationship between positive feedback and performance. Our sample consisted of 102 participants (63 female, 39 male). The experimental group received positive feedback after completing 5 min of mental arithmetic tasks on a computer, whereas the control group received no feedback. A second session of a mental arithmetic task was then completed for 5 min. Mediation analyses confirmed that specific self-efficacy mediated a positive effect of positive feedback on flow as well as on both performance measures (quality and quantity) in a subsequent task. However, direct effects of feedback on flow and on performance were not significant, which suggests the presence of other mechanisms that remain to be investigated.

Students tell us what good written feedback looks like

Feedback can be an important element of learning, but only if students engage with it. Students are only likely to engage with feedback that they find useful. This study aimed to identify characteristics of written feedback perceived by students as effective. We used a mixed‐method approach, integrating quantitative and qualitative data that were collected through the analysis of feedback that was identified by students as good, a student questionnaire, as well as interviews and a focus group exploring students’ views on what good feedback looks like. Although the results show that length and composition of ‘good’ feedback can be extremely variable, some common characteristics could be identified, leading to a set of recommendations for staff marking written assessments. According to students, good feedback should be detailed and specific, and it should tell students how they can improve. Students also find it important that feedback is honest and constructive. In addition, positive reinforcement was identified as important by the focus group, although few examples of good written feedback on the assignment contained any direct praise. Surprisingly, feedforward which might help students in other modules did not feature highly in students’ perceptions of good feedback, possibly indicating a focus by students on improving the current assignment rather than on future assignments.