Evaluation of Service-Learning in Project WeCan under COVID-19 in a Chinese Context

Subjective Outcome Evaluation of Instructional Videos in Leadership Education

The aims of this study were to examine the psychometric properties of two subjective outcome evaluation tools measuring students' perceptions of 24 instructional videos and to understand the profiles of students' perceptions of the videos. Online teaching and learning played an important role when school lockdown measures were imposed during the COVID-19 pandemic. To facilitate online teaching in a college-level leadership education subject, we developed and piloted 24 instructional videos, including 15 animated videos and 9 case-based videos, in the 2021/22 academic year. To understand students' perceptions of the videos, we developed two subjective outcome evaluation scales (one for the animated videos and another for the case-based videos) to assess the subjective perceptions of 1308 students. Results showed that the developed tools possessed good psychometric properties, including factorial, convergent and discriminant validity. The findings of this study also revealed the students had positive attitudes towards the developed videos, including positive perceptions of the videos' design and the benefits gained from watching them. The present study suggests teachers can meaningfully use the 24 instructional videos in the context of leadership education in higher education.

Law abidance leadership education for university students in Hong Kong: Post-lecture evaluation

Law abidance is very important for effective leaders. Without law abidance, abuse of power and corruption would easily happen, which would eventually erode organizational health. To promote law abidance leadership in university students in Hong Kong, we developed a law abidance leadership program with 3 h of face-to-face lecture and 7 h of self-study of materials disturbed to students. To understand students' perception of the 3-h lecture, we conducted a post-lecture evaluation study using a 26-item measure (N = 914). Results showed that the scale possessed good reliability and validity. Confirmatory factor analyses showed that the assessment tool has three internally consistent and factorial invariant dimensions: program attributes, appreciation of law abidance, and teacher attributes. Regarding students' perception of the program, students were generally satisfied with the lecture attributes, including design, content, lecture atmosphere, teaching quality, and benefits to students. In particular, students agreed that the lecture helped them understand the importance and value of law abidance and national security; over 95% of the students indicated that they would try their best to serve as law-abiding citizens and socially responsible leaders. Multiple regression analyses showed that program attributes, appreciation of law abidance, and teacher attributes predicted overall satisfaction with the lecture. Qualitative comments of the student echoed the quantitative findings, with most of the comments being positive in nature. The present study replicated the findings reported previously. Local and international contextual factors relevant to the interpretations of the findings are highlighted.

Service Leadership through Serving Minority Adolescents in Rural China Using a Rural Version of a Positive Youth Development Program

With the emerging service economy globally, nurturing university students to be service leaders possessing the leadership qualities of competence, character and care is of great importance. Through service-learning (SL), the academic learning of the students on Service Leadership can be consolidated. In the present study, we piloted a SL subject on Service Leadership in a university in the Southwestern part of China. After learning the basic academic knowledge on Service Leadership, seven students provided service for the Yi minority adolescents in Liangshan using the rural version of the program. To understand the impact of SL on the service recipients, a single group pretest-posttest design was used to assess the changes in Yi minority adolescents (N = 79) before and after they received the service. We also conducted subjective outcome evaluation of the service providers (the university students providing the service) and service recipients (Yi adolescents). Results showed that the service recipients had significant positive changes in the outcome indicators and they had positive perceptions of the program. The qualitative evaluation findings are also encouraging. The findings provide evidence supporting the use of SL in nurturing service leadership qualities in university students in mainland China.

The Effectiveness of a Leadership Subject Using a Hybrid Teaching Mode during the Pandemic: Objective Outcome and Subjective Outcome Evaluation

Positive youth development (PYD) is an innovative approach to protect students from mental health problems and promote their positive and holistic development. Although there are many studies on the beneficial effects of PYD programs on youth in high school and community contexts, it is not clear whether subjects adopting PYD principles can promote positive development for university students. Moreover, it is unclear whether such subjects are effective under COVID-19, where subjects are commonly taught via the "hybrid" mode (i.e., face-to-face plus online teaching). The present study examined students' changes in the PYD, wellbeing, and desired graduate attributes after they had taken a leadership subject utilizing PYD principles taught by the "hybrid" mode (N = 630). Adopting the one-group pre-test and post-test design (i.e., objective outcome evaluation), we found that students showed significant positive improvement in PYD indicators, wellbeing, as well as desired graduate attributes. Additionally, students had high satisfaction with the course design and teaching staff, and perceived many benefits from this subject based on the subjective outcome evaluation conducted at the end of the subject. Results also showed that students' satisfaction with the curriculum significantly and positively predicted their positive change in PYD indicators, indicating the convergence of subjective outcome evaluation and objective outcome evaluation. The results highlight the positive impacts of the hybrid mode leadership subject with PYD principles in higher education.

Who benefits and appreciates more? An evaluation of Online Service-Learning Projects in Mainland China during the COVID-19 pandemic

Previous studies have reported the feasibility and benefits of online service learning, but little is known about who benefits more from online SL and who is more satisfied. This study addressed these questions based on an evaluation of online service learning projects implemented in Xi'an and Chengdu, China, during the COVID-19 pandemic. Pretest-posttest comparison showed significant positive changes in two intended learning outcomes (i.e., positive youth development qualities and service leadership qualities) and life satisfaction before and after the service among participating students in the Xi'an project. Cross-lagged modeling based on Xi'an and Chengdu data revealed that students with better initial positive youth development qualities tended to show increased service leadership qualities and life satisfaction after the service, while initial service leadership qualities did not predict positive youth development qualities and life satisfaction after the service. However, the two-line test indicated that some of these relationships might be curvilinear. Finally, Pearson correlation analyses demonstrated that students who experienced greater changes in positive youth development qualities and service leadership qualities reported better appraisal of course qualities, teacher performance, and course effectiveness, while multiple regression analyses showed the unique effects of change in service leadership qualities (but not change in positive youth development qualities) on the perception of teacher performance and course effectiveness. Altogether, this study not only showcases the potential benefits of online SL, but also provides initial evidence suggesting the variation in (perceived) benefits by students' psychosocial competencies and learning experiences.

Promotion of Meaning in Life and Wellbeing Among University Students During the COVID-19 Pandemic via a Service-Learning Subject

Utilizing the principle of “learning by doing,” service-learning (SL) course provides a platform for university students to apply academic knowledge in serving the community, reflecting on the serving experiences, deepening their understanding of the knowledge, and further improving their competence, responsibility, wellbeing, and meaning in life (MIL). This study reported university students' changes in psychological wellbeing (positive youth development attributes), subjective wellbeing (life satisfaction), and MIL after taking a SL subject during the COVID-19 pandemic through a one-group pretest-posttest design. Based on the data collected from 229 students (mean age = 20.86 ± 1.56 years, 48.0% females), repeated-measures multivariate general linear model (GLM) analyses revealed that students showed significant positive changes in wellbeing and MIL. In addition, pretest MIL scores positively predicted posttest scores of the two wellbeing measures but not vice versa. As predicted, improvement in MIL among students was closely associated with the positive changes in both psychological and subjective wellbeing measures. These findings suggest that SL participation during the pandemic may promote students' life meaning and foster their wellbeing. Furthermore, MIL and wellbeing may improve simultaneously, and MIL enhancement may further contribute to improvement in psychological and subjective wellbeing. The findings further prove that SL is an effective pedagogy in higher education settings in promoting youth positive development.

Moving to e-Service Learning in Higher Education

Service Learning is a methodology in which students achieve academic and transversal competences related to the curriculum of a subject while performing a service for the benefit of the community. With the COVID-19 pandemic, it was necessary to reorganize the Service Learning activities developed in recent years so that they do not lose their pedagogical value and community service. This scenario has been an opportunity to kick-start an e-Service Learning experience. For that purpose, this work shows how different Information and Communication Technology tools are integrated into an online platform to develop both activities and assessment following an e-Service Learning methodology. Since the experience was performed with two collaborating entities serving people with autism and in two schools of the University of A Coruña, the tools are available not only to professors and students, but also to entities. Our experience includes the assessment of both competences and service satisfaction using different resources for virtual collaborative work. The main contribution of our work is that we have greatly simplified our previous project on-site and also the monitoring of the student’s progress, the work of both professors and students, and the analysis of results, providing a virtual service that responds to user needs.

Evaluation of Electronic Service-Learning (e-Service-Learning) Projects in Mainland China under COVID-19

The use of electronic service-learning (e-Service-Learning or e-SL) is valuable under COVID-19 because we can provide the service without physical contact. Unfortunately, evaluation of e-SL is not widespread and there is no known study in different Chinese societies. Besides, there are many methodological limitations of the existing studies in the field. In this paper, we evaluated e-SL projects implemented in summer 2020 and 2021 in three sites in China. First, we examined service providers' changes based on pretest and posttest scores (i.e., objective outcome evaluation) and their perceptions of the e-SL projects (i.e., subjective outcome evaluation based on the service providers). Second, graduate student assessors in Chinese mainland universities and teachers of primary school students (i.e., service recipients) rated the SL program quality, service providers' performance and benefits to the service recipients after program completion (i.e., subjective outcome evaluation of SL projects based on other stakeholders). Third, trained graduate student assessors evaluated service quality during the implementation process (i.e., process evaluation). We found that university students (i.e., service providers) showed higher posttest scores in positive youth development attributes, leadership attributes and life satisfaction relative to pretest scores. Besides, service providers showed positive perceptions of their learning experience, own performance, benefits to the service recipients and themselves in the SL projects. Similarly, other stakeholders also had positive evaluation of the SL projects and related benefits. Finally, trained graduate student assessors had positive assessment of the quality of program implementation. The findings underscore the utility of e-SL involving both online teaching and learning as well as online service, particularly in a Chinese context.

Stand Together by Staying Apart: Extreme Online Service-Learning during the Pandemic

Service-Learning (SL) is an experience that allows students to (a) participate in activities co-designed in partnership by universities and local organizations and (b) reflect on the service activity in such a way as to gain an enhanced sense of responsibility. These experiences represent significant ways to meet and experience real-world contexts for students. The COVID-19 pandemic required Higher Education Institutions to rethink and shift in-presence courses to online platforms. This transition included SL courses as well. This study aimed to explore the responsibility and democratic dimensions elicited by an extreme online Service-Learning (XE-SL) experience and the perceptions of engaging in exclusive online service activities with local communities during the COVID-19 Italian national quarantine. A qualitative driven mixed-method longitudinal approach was chosen to triangulate qualitative (reflexive journal) and quantitative (pre-post questionnaire) data from 20 university students. The findings shed a positive light on the capability of XE-SL to promote a sense of responsibility, civic engagement, and the acquirement of democratic and transferrable competencies, such as perspective-taking, adaptability, cultural background respect, global mindedness, teamwork, leadership, communication, creativity, and organizational competencies. Reflection, connection, and being agents of change for the community were perceived as the major assets of the XE-SL experience, while adapting face-to-face SL experiences to exclusively online activities evoked ambivalent feelings in students. The study suggests a rethinking of the design XE-SL and other forms of eSL with the inclusion of more structured interactive activities within community contexts to favor students’ sense of connection to the community organizations or NGOs.