Development and evaluation of a standardized peer-training in the context of peer review for quality assurance in work capacity evaluation

Interactions with Standardized Patients to Evaluate Students’ Psychotherapy-Competencies

Abstract. The use of standardized patients (SPs) in the training of prospective practitioners is a well-established didactic tool in medical schools. Only recently have simulations of patients in psychotherapy been introduced into the training of psychologists. By integrating psychotherapy training into university-level master’s programs, German law now requires licensing exams for psychotherapists (i. e., Approbationsprüfung) to include an assessment of therapeutic competencies in simulated interactions with SPs. Yet, it has not been examined whether these simulations are useful for a reliable assessment of competencies in psychotherapy trainees. Also, we need to develop standardized instruments to evaluate competencies in entry-level psychotherapists. As part of a university course, we trained master’s-level students from three cohorts in clinical interviewing techniques (course title: Klinisch-psychologische Gesprächsführung). We analyzed videotaped 20-min sequences of N = 104 students while they interviewed one of N = 38 trained SPs. The students’ task was to interview the SP, conduct a brief case history, and use the interviewing skills they had learned in class. Two independent raters evaluated their psychotherapeutic competencies with an adapted version of the German Cognitive Therapy Scale (CTS). Raters evaluated students’ performance on two subscales and the total score with satisfactory interrater agreement (intraclass correlations). In general, students performed well in the interviews: They structured the sessions sufficiently, and their global psychotherapeutic competencies were satisfactory. However, the psychotherapeutic competencies of master’s students fell short of the benchmark derived from experienced psychotherapists. This pilot study provides first evidence that simulated interviews with SPs may be a reliable tool in the assessment of practical competencies in psychotherapy trainees at an early stage of their training. Moreover, we found that the CTS, which has demonstrated validity to quantify competencies of psychotherapists, is applicable and reliable in this training context as well. In sum, this suggests that simulated interviews with SPs may be useful for evaluating psychotherapeutic competencies of psychotherapy trainees.

Development, implementation and evaluation of a management specialization course in oncology using blended learning

BACKGROUND

Identifying effective methods for safeguarding the efficient functioning of the healthcare system contributes significantly towards establishing a successful healthcare organization. Consequently, quality management programs are currently being implemented in healthcare as a vital strategy for patient care. Quality management encompasses protocols and guidelines in decision-making and in the evaluation of processes and treatment flowcharts, data analysis and health indicators, and addresses improvement in the interaction between different health professionals. Qualifying health professionals to perform quality management has represented a barrier to implementing a well-structured management system. Indeed, the pathway to qualifying health managers is often poorly outlined, with clear gaps in the definition of their competencies, training and career plans. Therefore, studies and education-related actions aimed at qualifying health professionals in management are vital if health services of excellence are to be established. The present study aimed to plan, develop, implement and evaluate a management specialization course in oncology using blended learning.

METHODS

Following approval by the institution's internal review board, the study was conducted at the Instituto de Medicina Integral Prof. Fernando Figueira (IMIP). The Analysis, Design, Development, Implementation and Evaluation (ADDIE) model was used to plan, develop, implement and evaluate the course. Data were collected as the course participants who had concluded all the modules evaluated the program.

RESULTS

A management course in oncology, consisting of ten sequential modules, was developed and implemented between March 2018 and February 2019. The course consisted of monthly face-to-face encounters, each with 12 h of activities, and distance education using a virtual learning environment. Each module was presented by a specialist on the subject in question. After the end-of-course conclusion work had already been handed in and evaluated by the tutors, the participants completed a form to assess the course using Kirkpatrick's training evaluation model.

CONCLUSIONS

A management course in oncology was developed using the ADDIE model. A high degree of satisfaction was found among the participants regarding improvements in their management skills and their professional behavior. The expectation is that this initiative will ultimately improve healthcare and reduce costs, as well as encourage further innovative educational actions for health professionals.