Toward competency-based curriculum: Application of workplace-based assessment tools in the National Saudi Arabian Anesthesia Training Program

Family Medicine Resident Experience Toward Workplace-Based Assessment Form in Improving Clinical Teaching: An Exploratory Qualitative Study

Background

Workplace-Based Assessment (WPBA) has been widely utilized for assessing performance in training sites for both formative and summative purposes. Currently, with the recently updated duration of the family medicine (FM) training program in Saudi Arabia from four years to three years, the possible impact of such a change on assessment would need to be investigated. This objective was to explore the experiences of FM residents regarding the usage of WPBA as an assessment tool for improving clinical teaching at King Abdulaziz Hospital (KAH), Al Ahsa, Saudi Arabia.

Methods

The study involves an exploratory qualitative phenomenological approach targeting family medicine resident in KAH was used. Purposive sampling techniques were used. In this descriptive study, data was collected through the utilization of 1:1 semi-structured interviews guided by directive prompts. All recorded interviews were transcribed verbatim. An inductive analytical approach was applied for thematic analysis of transcripts.

Results

Fifteen participants were individually interviewed until data saturation was reached. The themes that emerged were organized into the categories of underlying principles of WPBA, the impact of the learning environment, associated opportunities and challenges, and making WPBA more effective. Participants expressed that the orientation provided by the program was insufficient, although the core principles were clear to them. They valued the senior peers' support and encouragement for the creation of a positive learning environment. However, time limit, workload, and a lack of optimum ideal implementation reduced the educational value and effectiveness of WPBA among senior residents.

Conclusion

The study examined residents' experiences with WPBA and concluded that low levels of satisfaction were attributed to implementation-related problems. Improvements should be made primarily in two areas: better use of available resources and more systematic prior planning. Revision and assignment of the selection process were suggested, in addition to the implementation of the new curriculum. The research will assist stakeholders in selecting and carrying out evaluation techniques that will enhance residents' abilities.

Curriculum Mapping for Curriculum Development: The Notion of "Curriculum Barcoding" in View of the Saudi Medical Education Directives Framework (SaudiMEDs)

Objectives This study aims to map the curriculum of the Faculty of Medicine at Tabuk University to assess its comparability with the SaudiMEDs competency framework. Methodology We developed a checklist based on the essential clinical presentations and skills listed in the SaudiMEDs to map our curriculum and determine the comparability. This cross-sectional descriptive study started on 1 September 2015 until 29 February 2016. The coordinators of the 34 modules completed the checklist and identified whether each clinical presentation or skill is taught in their relevant modules. Results Results showed that our curriculum is lacking in 3.9% of the clinical presentations and 23.9% of the skills deemed necessary by the SaudiMEDs, and require attention. Deficient skills were mainly hospital-based ones. The project yielded a content "expertise" map regarding where the main domains of knowledge and skills in the SaudiMEDs framework are addressed in our curriculum. The "SaudiMEDs barcode" is generated that we hypothesize as a novel method for the description of our program in relation to the national competency framework.  Conclusion Curriculum mapping is a powerful tool for curriculum improvement. Our study elucidated a minor gap in the knowledge domains but a significant one in the essential skills in relation to the SaudiMEDs. We recommend structured training during the internship period as an essential supplement to undergraduate medical qualifications. During our experimentation with curriculum mapping, we articulated the "SaudiMEDs barcode" that we suggest as a novel method for curriculum alignment to the matrix of national competency and, hopefully, to aid in the accreditation projects.

National board governed post-graduate curriculum: Strengths and scope

The National Board of Examinations was established to boost the quality of medical education by laying down exclusive norms, uniform standards and a national level evaluation for the postgraduate medical courses. The content and context of the training curriculum is well updated as per advances in the field and current requirements. Diplomate of National Board (DNB) courses are considered to be at par with the postgraduate and post doctorate degrees for all intents and purposes. The introduction of a formative assessment with objective evaluation pattern has improved the scope of the board. Moving on to a competency-based training with emphasis on novel research can maximise the quality of training to international standards. Training DNB teachers and assessors in the newer teaching and assessment methods can improve the calibre of residents. Stringent monitoring and review of the training can increase the credibility of the courses and the board can be expected to cater for students abroad.

Newer teaching-learning methods and assessment modules in anaesthesia education

The National Medical Commission in its recent guidelines has stated that postgraduate training in anaesthesiology should have clear objectives and be competency based. This means that the existing teaching–learning (TL) methods need a major face-lift. E-learning and blended learning including learning management systems, virtual classrooms, app-based learning, flipped classroom, podcasts, webinars, web-based collaborative education, reflective feedback, problem-based discussions and mentorship are some newer TL methods that can be adopted. Simulation can help teach technical and non-technical skills such as leadership, teamwork and communication. In line with TL methods, newer assessment methods have to be applied to revolutionise postgraduate anaesthesia education. Formative assessment and assessment of clinical skills are important and to do this, workplace-based assessment methods such as mini-clinical evaluation exercise, direct observation of procedural skills, multisource feedback, logbook and E-portfolio can be applied. Objective structured clinical examination, simulation-based assessment and E-assessment are other useful evaluation methods.

Introduction of direct observation of procedural skills (DOPS) as a formative assessment tool during postgraduate training in anaesthesiology: Exploration of perceptions

Background and Aims:

Formative assessment of procedural skills of Anaesthesiology postgraduate (PG) students is not conducted conventionally. Direct observation of procedural skills (DOPS) helps to identify gaps in performance and provides structured feedback. The present study was taken to explore perceptions of PG students and faculty about DOPS.

Methods:

This mixed design interventional study was conducted on 12 PGs and 10 faculty members in Department of Anaesthesiology. After conducting DOPS, a pre-validated questionnaire was given to them about perceptions using 3-point Likert's scale along with open ended questions. Statistical analysis was done using descriptive statistics of perception to calculate percentages and themes were identified for qualitative data.

Results:

Responses of students were positive about skill improvement (83%), time provided (75%), feedback (100%), interaction (83%), motivation (83%), satisfaction (83%), effectiveness (83%) and opportunity creation (92%). Faculty responded positively regarding change in attitude (100%), effectiveness (100%), scope (90%), feasible application (90%), ease (90%), opportunity creation (80%), gap identification (100%), satisfaction (80%). However, 60% felt training was required, 50% thought more time and commitment was required. Themes identified were DOPS is comprehensive, interactive, student-friendly, good teaching-learning tool, identifies gaps, provides focus for learning, provides systematic constructive feedback, improves skills, prepares for future practice, requires planning, may not reflect competence, has assessor variability and can be included in PG curriculum.

Conclusion:

DOPS was perceived as an effective assessment and teaching-learning tool by PG students as well as faculty.

Training future anesthesiologists in obstetric care

PURPOSE OF REVIEW

In order for the obstetric anesthesiologist to become a true perioperative / peripartum physician, a change in formative programs and certification process in anesthesia are needed.

RECENT FINDINGS

Anesthesia training programs are migrating to competency based medical education (CBME) worldwide. The traditional model of attending lectures, grand rounds, reading textbooks and journal papers should be complemented by virtual modalities such as massive open online courses or online teaching tools. The gold standard for assessment of procedural skills in anesthesia consists of a combination of global rating scales and previously validated checklists. Behaviors in the perioperative environment not directly related to the use of drugs, equipment or medical expertise are known as anesthesiologist nontechnical skills and trainees must learn and practice these skills; nontechnical skills can determine 50-80% of adverse events in high-risk professions, including medicine. Regular certification programs are also an important component of the new approach in medical education, in some high-income countries, the specialist anesthesiologist is undertaking regular certification but the impact of these programs on overall outcomes is still unknown.

SUMMARY

The obstetric population is becoming a higher risk population, requiring an obstetric anesthesiologist taking on the role of a perioperative / peripartum physician. It is essential that anesthesia training programs migrate to CBME through simulation-based curriculum that allow the achievement of nontechnical skills and team work competencies. It is also essential that regular certification for specialist anesthesiologists occur throughout their entire career.