Assessment of first-year veterinary students' clinical skills using objective structured clinical examinations

Trained to cut? A literature review of veterinary surgical resident training

A surgical residency trains veterinary graduates to a higher level of expertise in surgical procedures than is possible during veterinary school and prepares a resident to pursue board certification in surgery. The education of veterinary surgical residents has changed minimally since its inception in the twentieth century, and there are insufficient studies to determine if residency programs are producing surgeons with competence in each of the necessary procedural categories. The aims of this review were to report the current theory and methods used to provide surgical education to residents, to discuss the training most likely to create a competent, board-certified surgeon and to review assessment methods used during training. Several literature searches using broad terms such as "veterinary surgery residency," "veterinary surgery resident," and "veterinary surgical training" were performed using PubMed, CAB abstracts, and Google Scholar. Literature pertinent to theory, methods, training, and assessment of veterinary surgical residents was included. The reviewed literature demonstrated the need for research-based learning curves for specific procedures. Simulation training is known to facilitate deliberate practice and should be leveraged where possible to reach competency. The creation of validated assessment methods should be pursued as it enables assessment of competency instead of inferring its development from case logs. Understanding and supporting learner cognition and providing sufficient feedback remain important issues in the field. Surgical educators are urged to continue to search for innovative and evidence-based ways to train competent surgical residents.

A Novel Canine Otoscopy Teaching Model for Veterinary Students

Otoscopic evaluation using an otoscope is an important tool among the diagnostic modalities for otitis externa and is considered a core component of a canine patient's complete physical examination. Traditionally, otoscopic training in veterinary school involves using live dogs (i.e., laboratory dogs or dogs that are patients of the veterinary teaching hospital). While this approach has its advantages, performing otoscopic examination on live dogs presents several challenges: it requires adequate patient restraint, can cause stress to the dog, and can potentially cause trauma and/or injury to the dog's ear canal when performed by an inexperienced individual. Using an alternative teaching tool for otoscopic evaluation could overcome these challenges and improve veterinary students' learning experience. In this study, we investigated student perceptions of a novel canine teaching model for otoscopic evaluation in first-year veterinary students. The Elnady preservation technique was employed to create a realistic, durable, and flexible model for otoscopic training in a dermatology laboratory session in a first-year veterinary course. Student feedback was assessed on a Likert scale, and overall feedback indicated that students felt that the model was beneficial for skill building and removed many of the stressors incurred with using live animals when training in clinical skills. Most students stated that they would like to have additional similar models incorporated into training and would recommend these models to other students.

What's the evidence? A review of current instruction and assessment in veterinary surgical education

Veterinary surgical education is improved by studying the relevant literature. The aim of this literature review was to report the theory and methods used to provide surgical education to veterinary students; to discuss the training most likely to create a competent general practitioner; and to review assessment methods for simulated and live surgeries. The literature reviewed demonstrates that new graduates are expected to perform small animal sterilization, dental extraction, onychectomy, abscess treatment, aural hematoma repair, and mass removal with little or no supervision. Students require repetitive practice to reach competence; some practice can take place in a clinical skills laboratory on models or cadavers. When training novices, distributing practice over a longer time improves retention, but months without practice causes skills to decay. Suturing skills may be taught on models at a ratio of 1 instructor per 10 students. Veterinary students require 6-10 repetitions of each small animal sterilization surgery to reach competence; however, learning curves for other surgeries have not been established. Assessment of surgical skills has been undertaken using objective structured clinical examinations (OSCEs) and observed model and live surgeries. Additional validated rubrics are needed in the field. Surgical educators are urged to continue to search for innovative ways to foster deliberate practice, assess skill, and provide feedback for students.

Evaluating third- and fourth-year veterinary students' communication skills knowledge and performance at Colorado State University

OBJECTIVE

To assess the impact of a communication program on a cohort of veterinary students' knowledge and performance of communication skills.

SAMPLE

Class cohort of veterinary students at Colorado State University.

PROCEDURES

Year 3 students' knowledge of communication skills was evaluated using quizzes, administered before and after the fall 2016 and spring 2017 Clinical Communication Skills-I and II junior practicum. In year 4, student performance of 22 Calgary-Cambridge Guide communication skills was assessed by coding video-recordings of student-client interactions collected during their second and fourth weeks of the Community Practice rotation in the summer and fall of 2017 and spring of 2018. The impact of training, association with demographic factors, and correlation between knowledge and performance of communication skills were investigated.

RESULTS

In year 3, 136 students completed both fall and spring quizzes; in year 4, 65 week-2 and 29 week-4 appointments were video-recorded during Community Practice rotation. Students' knowledge assessed via quizzes containing skill spotting and skill demonstrating questions increased significantly after the fall and spring junior practicums; however, knowledge of communication skills was not associated with performance during year 4 Community Practice rotations. Communication skills most frequently demonstrated by students during the fourth year Community Practice rotation were open-ended questions, closed-ended questions, empathy toward the client and patient, providing "chunks" of information, and signposting. Students received high quality scores for non-verbal behaviors and logical clinical interview structure.

CLINICAL RELEVANCE

Results suggest that experiential learning techniques, including a flipped classroom approach, role-play, and communication laboratories contributed to increased student knowledge of communication skills.

Evaluating validity evidence for 2 instruments developed to assess students' surgical skills in a simulated environment

Objective

To gather and evaluate validity evidence in the form of content and reliability of scores produced by 2 surgical skills assessment instruments, 1) a checklist, and 2) a modified form of the Objective Structured Assessment of Technical Skills (OSATS) global rating scale (GRS).

Study design

Prospective randomized blinded study.

Sample population

Veterinary surgical skills educators (n =10) evaluated content validity. Scores from students in their third preclinical year of veterinary school (n = 16) were used to assess reliability.

Methods

Content validity was assessed using Lawshe's method to calculate the Content Validity Index (CVI) for the checklist and modified OSATS GRS. The importance and relevance of each item was determined in relation to skills needed to successfully perform supervised surgical procedures. The reliability of scores produced by both instruments was determined using generalizability (G) theory.

Results

Based on the results of the content validation, 39 of 40 checklist items were included. The 39‐item checklist CVI was 0.81. One of the 6 OSATS GRS items was included. The 1‐item GRS CVI was 0.80. The G‐coefficients for the 40‐item checklist and 6‐item GRS were 0.85 and 0.79, respectively.

Conclusion

Content validity was very good for the 39‐item checklist and good for the 1‐item OSATS GRS. The reliability of scores from both instruments was acceptable for a moderate stakes examination.

Impact

These results provide evidence to support the use of the checklist described and a modified 1‐item OSAT GRS in moderate stakes examinations when evaluating preclinical third‐year veterinary students' technical surgical skills on low‐fidelity models.

Remote Assessment of Veterinary Clinical Skills Courses During the COVID-19 Pandemic

In spring 2020, the COVID-19 pandemic forced educators to adjust the delivery and assessment of curriculum. While didactic courses moved online, laboratory courses were not amenable to this shift. In particular, assessment of clinical skills courses through common methods including objective structured clinical examinations (OSCEs) became inadvisable. This article describes decisions made for first-, second-, and third-year veterinary students (n = 368) with respect to clinical skills at one US college. This includes the remote completion of a surgical skills curriculum using instructional videos and models and the delaying of laboratory sessions deemed impossible to deliver remotely. First- and third-year students were subsequently assessed using modified remote OSCEs. Second-year students were assessed using the standard surgical skills examination, video-recorded. All first- and third-year students successfully passed their OSCE upon either first attempt or remediation. Two second-year students failed their remediation examination and were offered additional faculty tutoring and another remediation attempt at the start of the fall semester. The remediation rate on the surgical skills examination was not different from that of previous years. One incident of suspected academic dishonesty occurred in the first-year OSCE. Students learned surgical skills successfully at home by practicing on models and receiving feedback of their skills on video recordings. While disappointing, one case of academic dishonesty among the 368 total students tested was not surprising. Remote assessment using modified OSCEs and surgical skills exams appears feasible and fair when in-person testing is not possible.

Video Recording in Veterinary Medicine OSCEs: Feasibility and Inter-rater Agreement between Live Performance Examiners and Video Recording Reviewing Examiners

The Objective Structured Clinical Examination (OSCE) is a valid, reliable assessment of veterinary students' clinical skills that requires significant examiner training and scoring time. This article seeks to investigate the utility of implementing video recording by scoring OSCEs in real-time using live examiners, and afterwards using video examiners from within and outside the learners' home institution. Using checklists, learners (n=33) were assessed by one live examiner and five video examiners on three OSCE stations: suturing, arthrocentesis, and thoracocentesis. When stations were considered collectively, there was no difference between pass/fail outcome between live and video examiners (χ² = 0.37, p = .55). However, when considered individually, stations (χ² = 16.64, p < .001) and interaction between station and type of examiner (χ² = 7.13, p = .03) demonstrated a significant effect on pass/fail outcome. Specifically, learners being assessed on suturing with a video examiner had increased odds of passing the station as compared with their arthrocentesis or thoracocentesis stations. Internal consistency was fair to moderate (0.34-0.45). Inter-rater reliability measures varied but were mostly moderate to strong (0.56-0.82). Video examiners spent longer assessing learners than live raters (mean of 21 min/learner vs. 13 min/learner). Station-specific differences among video examiners may be due to intermittent visibility issues during video capture. Overall, video recording learner performances appears reliable and feasible, although there were time, cost, and technical issues that may limit its routine use.

Comparison of Self-Directed and Instructor-Led Practice Sessions for Teaching Clinical Skills in Food Animal Reproductive Medicine

While the use of simulator-based clinical skill training has become increasingly popular in veterinary education in recent years, little research has been done regarding optimal implementation of such tools to maximize student learning in veterinary curricula. The objective of this study was to compare the effects of supervised and unsupervised deliberate practice on clinical skills development in veterinary medicine students. A total of 150 veterinary students took part in instructor-led practice (supervised) or self-directed practice (unsupervised) at a selection of four learning stations in a veterinary skills laboratory. Each learning station consisted of a teaching simulator, materials required to complete the task, and a standard operating procedure detailing how to execute the task. Students used Likert scales to self-evaluate their clinical skills before and after practice sessions, in addition to evaluating their motivation to practice a given task. An objective structured clinical examination (OSCE) was used to compare participants' clinical skills performance between learning stations. We were able to show that practice had a significant positive effect on OSCE scores at three out of six available learning stations. Motivation ratings varied between learning stations and were positively correlated with an increase in self-perceived clinical skills. At an instructor-to-student ratio of approximately 1:8, supervision had no effect on OSCE scores at four out of six learning stations. At the remaining two learning stations, self-directed practice resulted in better learning outcomes than instructor-led practice.

Development and Validation of a Bovine Castration Model and Rubric

Veterinary students require deliberate practice to reach competence in surgical bovine castration, but animal availability limits opportunities for practice. We sought to create and validate a surgical bovine castration model consisting of a molded silicone scrotum and testicles to allow students to practice this skill without the use of live animals. We sought to validate the model and associated scoring rubric for use in a veterinary clinical skills course. A convenience sample of third-year veterinary students (n = 19) who had never castrated a bovine were randomized into two groups. The traditionally trained (T) group performed castration on a live bull calf after a 50-minute instructional lecture. The model-trained (M) group received the same lecture and a 2-hour clinical skills session practicing bovine castration using the model. All students were subsequently digitally recorded while castrating a live bull calf. Performance recordings were scored by an investigator blinded to group. Survey data were collected from the students and from expert veterinarians testing the model (n = 8). Feedback from both groups was positive. The M group had higher performance scores than the T group (M group, M = 80.6; T group, M = 68.2; p = .005). Reliability of rubric scores was adequate at .74. No difference was found in surgical time (M group, M = 4.5 min; T group, M = 5.5 min; p = .12). Survey feedback indicated that experts and students considered the model useful. Model training improved students' performance scores and provided evidence for validation of the model and rubric.

Effect of a high-intensity one-week training programme and student-level variables on the bovine transrectal palpation and pregnancy diagnosis skills of final-year veterinary students

BACKGROUND

To improve bovine transrectal palpation (TRP) and pregnancy diagnosis (PD) training, the effect of a high-intensity one-week training programme for veterinary elective students (N=59) with an interest in production animal practice was evaluated.

METHODS

Training consisted of exposure to rectal examination simulators, abattoir organs, theory materials and live cow PDs supervised by experienced large animal practitioners. Palpation skills were assessed before and after training using a validated TRP Objective Structured Clinical Examination (OSCE) in non-pregnant cows. Each student then performed PDs (n=12) on cows of known pregnancy status. Students' PD accuracy was measured as sensitivity and specificity, being respectively defined as the proportion of pregnant and non-pregnant cows correctly identified.

RESULTS

Students' scores improved from the first to the second OSCE (P=0.03), mostly as a result of improved ability to identify uterine symmetry/asymmetry and the presence/absence of a corpus luteum on the right ovary (P<0.01 and P=0.03, respectively). Overall student sensitivity and specificity of PD were 89.1 per cent (95 per cent CI 78.1-92.2 per cent) and 67.7 per cent (95 per cent CI 60.1-74.5 per cent), respectively.

CONCLUSION

This prospective cohort study describes a strategy to improve students' TRP skills with the potential to reduce training time and animal use at teaching institutions by outsourcing student training to private practitioners.

Evaluation of communication skills training programs at North American veterinary medical training institutions

OBJECTIVE

To describe how North American veterinary medical teaching institutions (VMTIs) provide communication skills training to students.

SAMPLE

Faculty coordinators of communication skills training programs (CSTPs) at 30 North American VMTIs.

PROCEDURES

An online survey instrument was designed and administered to each respondent followed by a telephone (n = 28) or in-person (2) interview. The survey and interview process were designed to evaluate all aspects of CSTPs, such as communication framework used, program format, number of student-contact hours, staffing models, outcome assessment, faculty background, program priorities, and challenges. Descriptive results were generated, and guidelines for future development of CSTPs were recommended.

RESULTS

27 US and 3 Canadian VMTIs were represented, and communication skills training was required at all. Twenty-five CSTPs used the Calgary-Cambridge Guide framework. Respondents provided a mean of 33 student-contact hours of training, primarily in the first 3 years of the veterinary curriculum in lecture (mean, 12 hours), communication laboratory (13 hours), and self-study (8 hours) formats with formative feedback. Communication skills training was integrated with other disciplines at 27 VMTIs. Most CSTPs were coordinated and taught by 1 faculty member with a < 0.50 full-time equivalent commitment and no administrative support. Stated priorities included acquisition of resources for CSTP faculty, administrative support, and video-equipped facilities; increasing integration of CSTPs into curricula; and assessment of educational outcomes.

CONCLUSIONS AND CLINICAL RELEVANCE

Results suggested that support for CSTPs and recognition of their value continue to grow, but a lack of resources, faculty expertise, validated methods for outcomes assessment, and leadership remain challenges.

Effect of Instructional Format on Veterinary Students' Task Performance and Emotional State during a Simulation-Based Canine Endotracheal Intubation Laboratory: Handout versus Video

Video- versus handout-based instructions may influence student outcomes during simulation training and competency-based assessments. Forty-five third-year veterinary students voluntarily participated in a simulation module on canine endotracheal intubation. A prospective, randomized, double-blinded study investigated the impact of video (n = 23) versus handout (n = 22) instructions on student confidence, anxiety, and task performance. Students self-scored their confidence and anxiety before and after the simulation. During the simulation laboratory, three raters independently evaluated student performance using a 20-item formal assessment tool with a 5-point global rating scale. No significant between- or within-group differences (p > .05) were found for both confidence and anxiety scores. Video-based instructions were associated with significantly higher (p < .05) total formal assessment scores compared with handout-based instructions. The video group had significantly higher scores than the handout group on 3 of the 20 individual skills (items) assessed: placement of tie to the adaptor-endotracheal tube complex (p < .05), using the anesthetic machine (p < .01), and pop-off valve management (p < .001). Inter-rater reliability as assessed by Cronbach's α (.92), and Kendall's W (.89) was excellent and almost perfect, respectively. A two-faceted crossed-design generalizability analysis yielded G coefficients for both the handout (E_p² = .68) and the video (E_p² = .72) groups. Video instructions may be associated with higher performance scores than handout instructions during endotracheal intubation simulation training. Further research into skill retention and learning styles is warranted.

Development and Validation of a Canine Castration Model and Rubric

Veterinary educators use models to allow repetitive practice of surgical skills leading to clinical competence. Canine castration is a commonly performed procedure that is considered a Day One competency for a veterinarian. In this study, we sought to create and evaluate a canine pre-scrotal closed castration model and grading rubric using a validation framework of content evidence, internal structure evidence, and relationship with other variables. Veterinarians (n = 8) and students (n = 32) were recorded while they performed a castration on the model and provided survey feedback. A subset of the students (n = 7) then performed a live canine castration, and their scores were compared with their model scores. One hundred percent of the veterinarians and 91% of the students reported that the model was helpful in training for canine castration. They highlighted several areas for continued improvement. Veterinarians' model performance scores were significantly higher than students', indicating that the model had adequate features to differentiate expert from novice performance. Students' performance on the model strongly correlated with their performance of live castration (r = .82). Surgical time was also strongly correlated (r = .70). The internal consistency of model and live rubric scores were good at .85 and .94, respectively. The framework supported validation of the model and rubric. The canine castration model facilitated cost-efficient practice in a safe environment in which students received instructor feedback and learned through experience without the risk of negatively affecting a patient's well-being. The strong correlation between model and live animal performance scores suggests that the model could be useful for mastery learning.

Ability of a bovine transrectal palpation objective structured clinical examination to predict veterinary students' pregnancy diagnosis accuracy

Bovine pregnancy diagnosis (PD) by transrectal palpation (TRP) is one of the most frequently performed procedures in bovine practice, and an important competency for veterinary graduates. It is currently not known if pre-existing TRP skills on non-pregnant cows can be used to predict students' future PD accuracy. The study objective was to evaluate if TRP objective structured clinical examination (OSCE) scores can predict students' future PD accuracy.Fourth year (of a six-year programme) veterinary students (n=128) received TRP and PD training on Breed'n Betsy (BB) simulators and live cows. Students' TRP skills were assessed using a live cow TRP OSCE after completion of the fourth year training. The same students received additional TRP (BB and live cows) and PD (BB) training sessions in the first semester of their fifth year. PD accuracy was assessed after the additional TRP and PD training, five months after the TRP OSCE assessment and measured as sensitivity and specificity (the ability to correctly identify the presence and absence of pregnancy, respectively). Each student palpated six cows transrectally to diagnose pregnancy status and stage for the PD assessment. The TRP OSCE results were analysed as predictors for students' PD accuracy.Students with 'competent palpation skills' on the TRP OSCE had higher PD specificity. The individual OSCE components that were predictive of higher PD accuracy were students' ability to estimate ovarian size, identify uterine position and exclude intrauterine fluid. It was concluded that a TRP OSCE has the ability to predict students' future PD accuracy.

Assessment Tools for Feedback and Entrustment Decisions in the Clinical Workplace: A Systematic Review

BACKGROUND: Entrustable Professional Activities (EPAs) combine feedback and evaluation with a permission to act under a specified level of supervision and the possibility to schedule learners for clinical service. This literature review aims to identify workplace-based assessment tools that indicate progression toward unsupervised practice, suitable for entrustment decisions and feedback to learners. METHODS: A systematic search was performed in the PubMed, Embase, ERIC, and PsycINFO databases. Based on title/abstract and full text, articles were selected using predetermined inclusion and exclusion criteria. Information on workplace-based assessment tools was extracted using data coding sheets. The methodological quality of studies was assessed using the medical education research study quality instrument (MERSQI). RESULTS: The search yielded 6,371 articles (180 were evaluated in full text). In total, 80 articles were included, identifying 67 assessment tools. Only a few studies explicitly mentioned assessment tools used as a resource for entrustment decisions. Validity evidence was frequently reported, and the MERSQI score was 10.0 on average. CONCLUSIONS: Many workplace-based assessment tools were identified that potentially support learners with feedback on their development and support supervisors with providing feedback. As expected, only few articles referred to entrustment decisions. Nevertheless, the existing tools or the principals could be used for entrustment decisions, supervision level, or autonomy.

A Randomized Trial Comparing Freely Moving and Zonal Instruction of Veterinary Surgical Skills Using Ovariohysterectomy Models

Timely, specific feedback is the most important feature of simulation-based training, but providing adequate instructor supervision is challenging. Students' (n = 76) surgical skills were assessed after training using either the traditional (T) method of large-group teaching by multiple instructors or the alternative method of one instructor assigned (A) to a defined group of students. Instructors rotated to a different group of students for each laboratory session. The instructor-to-student ratio and environment remained identical. No differences were found in raw assessment scores or the number of students requiring remediation, suggesting that students learned in this environment whether they received feedback from one instructor or multiple. Students had no preference between the methods, though 88% of the instructors preferred the assigned method, because they perceived an increased ability to teach and observe individual students. There was no difference in the number of students identified as at-risk of remediation between groups. When both groups were considered together, students identified as at-risk were more likely (40% vs. 10%) to require post-assessment remediation. However, only 22% of students requiring remediation had been identified as at-risk, and A-group instructors were more accurate than T-group instructors at identifying at-risk students. These results suggest that students accept either instructional method, but most instructors prefer to be assigned to a small group of students. Surgical skills were learned similarly well by students in both groups, although assigned instructors were more accurate at identifying at-risk students, which could prove beneficial if early intervention measures can be offered.

A Survey of Established Veterinary Clinical Skills Laboratories from Europe and North America: Present Practices and Recent Developments

Developing competence in clinical skills is important if graduates are to provide entry-level care, but it is dependent on having had sufficient hands-on practice. Clinical skills laboratories provide opportunities for students to learn on simulators and models in a safe environment and to supplement training with animals. Interest in facilities for developing veterinary clinical skills has increased in recent years as many veterinary colleges face challenges in training their students with traditional methods alone. For the present study, we designed a survey to gather information from established veterinary clinical skills laboratories with the aim of assisting others considering opening or expanding their own facility. Data were collated from 16 veterinary colleges in North America and Europe about the uses of their laboratory, the building and associated facilities, and the staffing, budgets, equipment, and supporting learning resources. The findings indicated that having a dedicated veterinary clinical skills laboratory is a relatively new initiative and that colleges have adopted a range of approaches to implementing and running the laboratory, teaching, and assessments. Major strengths were the motivation and positive characteristics of the staff involved, providing open access and supporting self-directed learning. However, respondents widely recognized the increasing demands placed on the facility to provide more space, equipment, and staff. There is no doubt that veterinary clinical skills laboratories are on the increase and provide opportunities to enhance student learning, complement traditional training, and benefit animal welfare.

Development and Evaluation of Two Canine Low-Fidelity Simulation Models

Two self-made low-fidelity models for simulation of canine intubation and canine female urinary catheterization were developed and evaluated. We used a study design that compares acquired skills of two intervention groups and one control group in a practical examination. Fifty-eight second-year veterinary medicine students received a theoretical introduction to intubation and were randomly divided into three groups. Group I (high-fidelity) was then trained on a commercially available Intubation Training Manikin (item #2006, Veteffects), group II (low-fidelity) was trained on our low-fidelity model, and group III (text) read a text describing intubation of the dog. Forty-seven fifth-year veterinary medicine students followed the same procedure for training urinary catheterization using the commercially available Female Urinary Catheter Training Manikin (Paws 2 Claws), our self-made model, and text. Outcomes were assessed in a practical examination on a cadaver using an Objective Structured Clinical Examination (OSCE) checklist. Considering a value of p≤.05 significant, intervention groups performed significantly better than the text groups. Group I (high-fidelity) and group II (low-fidelity) showed no significant differences (p≤.684, intubation; p≤.901, urinary catheterization). We thereby conclude that low-fidelity models can be as effective as high-fidelity models for clinical skills training.

The use of global rating scales for OSCEs in veterinary medicine

OSCEs (Objective Structured Clinical Examinations) are widely used in health professions to assess clinical skills competence. Raters use standardized binary checklists (CL) or multi-dimensional global rating scales (GRS) to score candidates performing specific tasks. This study assessed the reliability of CL and GRS scores in the assessment of veterinary students, and is the first study to demonstrate the reliability of GRS within veterinary medical education. Twelve raters from two different schools (6 from University of Calgary [UCVM] and 6 from Royal (Dick) School of Veterinary Studies [R(D)SVS] were asked to score 12 students (6 from each school). All raters assessed all students (video recordings) during 4 OSCE stations (bovine haltering, gowning and gloving, equine bandaging and skin suturing). Raters scored students using a CL, followed by the GRS. Novice raters (6 R(D)SVS) were assessed independently of expert raters (6 UCVM). Generalizability theory (G theory), analysis of variance (ANOVA) and t-tests were used to determine the reliability of rater scores, assess any between school differences (by student, by rater), and determine if there were differences between CL and GRS scores. There was no significant difference in rater performance with use of the CL or the GRS. Scores from the CL were significantly higher than scores from the GRS. The reliability of checklist scores were .42 and .76 for novice and expert raters respectively. The reliability of the global rating scale scores were .7 and .86 for novice and expert raters respectively. A decision study (D-study) showed that once trained using CL, GRS could be utilized to reliably score clinical skills in veterinary medicine with both novice and experienced raters.

Setting up a veterinary medicine skills lab in Germany

The amendments introduced to the current Veterinary Licensing Ordinance (TAppV) by the Veterinary Licensing Regulation (TAppO) have brought a high degree of skills orientation to fill the gap between academic study and preparing for a wide range of professional skills. In order to improve the veterinary skills of students while conveying fundamental methods in a structured and reproducible way, the University of Veterinary Medicine Hannover, Foundation, has set up the first central veterinary skills lab in Germany. Practical training is provided by means of a three-tier delivery approach. This involves around 40 simulators on an area of approx. 800 m(2) under the guidance of 6-8 staff members, along with supplementary resources such as posters, text instructions and YouTube videos. Since it opened in March 2013, there have been 769 visits to the skills lab and 30,734 hits on YouTube. Initial results show that the skills lab helps to maintain student motivation by teaching them practical skills at an early stage of the basic study-based acquisition of knowledge, whilst reinforcing skills acquisition per se in competence-based teaching. It enables veterinary students to prepare for their first examinations and treatments of live patients in a manner compliant with animal welfare.

Web-based documentation of clinical skills to assess the competency of veterinary students

Kansas State University implemented a Web-based program to assess students' competency to perform technical skills during clinical rotations throughout the fourth year of the veterinary curriculum. The classes of 2009 and 2010 recorded a minimum number of procedures (104 and 103, respectively) from a menu of more than 220 recommended procedures. Procedures were categorized by species (small animal, equine, food animal) and disciplines (imaging, anesthesia, diagnostic medicine/necropsy). Ophthalmology was added as a fourth discipline for the class of 2010. Students recorded procedures into the Web-based system, including information about the patient, procedure performed, supervisor, and a self-assessment of performance. Faculty, staff, and house officers evaluated the procedures electronically by confirming that they witnessed the procedure and providing qualitative and written feedback. The class of 2009 recorded 18,492 procedures (M=171/student) and the class of 2010 recorded 16,935 procedures (M=158/student). Two students from each class (2009 and 2010) did not complete the minimum required skills during clinical rotations and returned to perform procedures immediately before (n=3) or immediately after (n=1) graduation to receive their diploma. The Web-based system captured a large number of assessments of technical competency performed in the clinical setting. The system provided students with formative feedback throughout the clinical year, ensured equitable distribution of procedural opportunities across the student body, and required minimal additional resources.