High fidelity simulation based team training in urology: a preliminary interdisciplinary study of technical and nontechnical skills in laparoscopic complications management

The State of Urotrauma Education Among Residency Programs in the United States: A Systematic Review and Meta-Analysis

PURPOSE OF REVIEW

Management of urotrauma is a crucial part of a urologist's knowledge and training. We therefore sought to understand the state of urotrauma education in the United States.

RECENT FINDINGS

Using themes of "Urotrauma" and "Education," we performed a systematic review and meta-analysis by searching for studies in MEDLINE, all Cochrane libraries, EMBASE, BIOSIS, Scopus, and Web of Science through May 2023. The primary outcome was the pooled rate of urology trainee and program director attitudes toward urotrauma education. Secondary outcomes involved a descriptive summary of existing urotrauma curricula and an assessment of factors affecting urotrauma exposure. Of 12,230 unique records, 11 studies met the final eligibility criteria, and we included 2 in the meta-analysis. The majority of trainees and program directors reported having level 1 trauma center rotations (range 88-89%) and considered urotrauma exposure as an important aspect of residency education (83%, 95% CI 76-88%). Despite possible increases in trainee exposure to Society of Genitourinary Reconstructive Surgeons (GURS) faculty over the preceding decade, nearly a third of trainees and program directors currently felt there remained inadequate exposure to urotrauma during training (32%, 95% CI 19-46%). Factors affecting urotrauma education include the limited exposure to GURS-trained faculty and clinical factors such as case infrequency and non-operative trauma management. Urology resident exposure to urotrauma is inadequate in many training programs, underscoring the potential value of developing a standardized curriculum to improve urotrauma education for trainees. Further investigation is needed to characterize this issue and to understand how it impacts trainee practice readiness.

Simulation-based education in urology - an update

Over the past 30 years surgical training, including urology training, has changed from the Halstedian apprenticeship-based model to a competency-based one. Simulation-based education (SBE) is an effective, competency-based method for acquiring both technical and non-technical surgical skills and has rapidly become an essential component of urological education. This article introduces the key learning theory underpinning surgical education and SBE, discussing the educational concepts of mastery learning, deliberate practice, feedback, fidelity and assessment. These concepts are fundamental aspects of urological education, thus requiring clinical educators to have a detailed understanding of their impact on learning to assist trainees to acquire surgical skills. The article will then address in detail the current and emerging simulation modalities used in urological education, with specific urological examples provided. These modalities are part-task trainers and 3D-printed models for open surgery, laparoscopic bench and virtual reality trainers, robotic surgery simulation, simulated patients and roleplay, scenario-based simulation, hybrid simulation, distributed simulation and digital simulation. This article will particularly focus on recent advancements in several emerging simulation modalities that are being applied in urology training such as operable 3D-printed models, robotic surgery simulation and online simulation. The implementation of simulation into training programmes and our recommendations for the future direction of urological simulation will also be discussed.

Specific steps in the operation determine resident speed: Experience with a live tissue simulation model of laparoscopic nephrectomy

INTRODUCTION

It is increasingly important to identify and eliminate inefficiencies in resident education. We hypothesize that slower performance of specific operative steps in laparoscopic nephrectomy accounts for much of the slower operative speed observed in junior residents vs. their senior colleagues. Therefore, we sought to evaluate the by-step time-differential between experienced senior residents and their junior colleagues in a live-tissue simulation.

MATERIALS AND METHODS

Residents participated in our swine model surgical simulation of laparoscopic radical and partial nephrectomy (LRNx and LPNx). PGY5 and 6 residents were considered senior; junior residents were PGY3 and 4. We defined discrete surgical steps. Residents' post-graduate training levels were tracked and time-to-completion of each operative step was recorded.

RESULTS

Seven live-tissue simulations sessions took place, with 12 residents conducting 22 operations (12 LRNx, 10 LPNx). On average, each resident operated in 2 simulation sessions (range 1-4). The average time required by senior residents for LPNx was 152 min; junior residents required 173 min (p = 0.35). When considering the operative steps, juniors required nearly twice as much time to achieve hilar control (42 min vs. 23 min, p = 0.03). Significant differences in performance time were not seen in the other steps.

DISCUSSION

The performance differential between senior and junior residents conducting nephrectomies was most evident during hilar dissection. Our study suggests that specific efforts should be focused on teaching junior residents the skills required for this step early in their training.

Intraprofessional workplace learning in postgraduate medical education: a scoping review

BACKGROUND

Residents need to be trained across the boundaries of their own specialty to prepare them for collaborative practice. Intraprofessional learning (i.e. between individuals of different disciplines within the same profession) has received little attention in the postgraduate medical education literature, in contrast to the extensive literature on interprofessional learning between individuals of different professions. To address this gap, we performed a scoping review to investigate what and how residents learn from workplace-related intraprofessional activities, and what factors influence learning.

METHODS

The PRISMA guidelines were used to conduct a scoping review of empirical studies on intraprofessional workplace learning in postgraduate medical education published between 1 January 2000 to 16 April 2020 in Pubmed, Embase, PsycINFO, ERIC and Web of Science. This study applied 'best fit' framework-based synthesis to map the existing evidence, using the presage-process-product (3P) model developed by Tynjälä (2013).

RESULTS

Four thousand three hundred thirty records were screened, and 37 articles were included. This review identified influencing (presage) factors that derived from the sociocultural environment, learner and learning context. Studies described that complexity of care can both facilitate and hinder learning. Furthermore, intraprofessional learning is threatened by professional stereotyping and negative perceptions, and awareness of learning opportunities and explicit reflection are critical in intraprofessional workplace learning. Studies described a range of informal and formal intraprofessional activities (process) under the headings of collaboration in clinical practice, rotations or placements, formal educational sessions and simulated workplace training. In general, learners responded well and their attitudes and perceptions improved, learners reported increased knowledge and skills and positive behavioural changes (product). Learning outcomes were reported in the domains of patient-centred care, collaborative attitudes and respect, mutual knowledge and understanding, collaborative decision making, communication, leadership, teamwork and reflexivity.

CONCLUSIONS

This review gives insight into the high learning potential of intraprofessional activities. Many of the included studies relied on self-reported perceptions of change, therefore, future research should focus on generating more robust evidence including objectively examined outcome measures. This review offers a comprehensive overview of the factors that influence intraprofessional workplace learning in postgraduate medical education. Finally, we provide recommendations for enhancing intraprofessional learning in clinical practice.

Current Status of Simulation Training in Urology: A Non-Systematic Review

Simulation has emerged as an effective solution to increasing modern constraints in surgical training. It is recognized that a larger proportion of surgical complications occur during the surgeon's initial learning curve. The simulation takes the learning curve out of the operating theatre and facilitates training in a safe and pressure-free environment whilst focusing on patient safety. The cost of simulation is not insignificant and requires commitment in funding, human resources and logistics. It is therefore important for trainers to have evidence when selecting various simulators or devices. Our non-systematic review aims to provide a comprehensive up-to-date picture on urology simulators and the evidence for their validity. It also discusses emerging technologies and future directions. Urologists should embed evidence-based simulation in training programs to shorten learning curves while maintaining patient safety and work should be directed toward a validated and agreed curriculum.

Interventions to improve team effectiveness within health care: a systematic review of the past decade

BACKGROUND

A high variety of team interventions aims to improve team performance outcomes. In 2008, we conducted a systematic review to provide an overview of the scientific studies focused on these interventions. However, over the past decade, the literature on team interventions has rapidly evolved. An updated overview is therefore required, and it will focus on all possible team interventions without restrictions to a type of intervention, setting, or research design.

OBJECTIVES

To review the literature from the past decade on interventions with the goal of improving team effectiveness within healthcare organizations and identify the "evidence base" levels of the research.

METHODS

Seven major databases were systematically searched for relevant articles published between 2008 and July 2018. Of the original search yield of 6025 studies, 297 studies met the inclusion criteria according to three independent authors and were subsequently included for analysis. The Grading of Recommendations, Assessment, Development, and Evaluation Scale was used to assess the level of empirical evidence.

RESULTS

Three types of interventions were distinguished: (1) Training, which is sub-divided into training that is based on predefined principles (i.e. CRM: crew resource management and TeamSTEPPS: Team Strategies and Tools to Enhance Performance and Patient Safety), on a specific method (i.e. simulation), or on general team training. (2) Tools covers tools that structure (i.e. SBAR: Situation, Background, Assessment, and Recommendation, (de)briefing checklists, and rounds), facilitate (through communication technology), or trigger (through monitoring and feedback) teamwork. (3) Organizational (re)design is about (re)designing structures to stimulate team processes and team functioning. (4) A programme is a combination of the previous types. The majority of studies evaluated a training focused on the (acute) hospital care setting. Most of the evaluated interventions focused on improving non-technical skills and provided evidence of improvements.

CONCLUSION

Over the last decade, the number of studies on team interventions has increased exponentially. At the same time, research tends to focus on certain interventions, settings, and/or outcomes. Principle-based training (i.e. CRM and TeamSTEPPS) and simulation-based training seem to provide the greatest opportunities for reaching the improvement goals in team functioning.

Technical and Nontechnical Skills in Surgery: A Simulated Operating Room Environment Study

STUDY DESIGN

Observational simulation study.

OBJECTIVE

The goal of this study was to investigate the relationship between technical and nontechnical skills (NTS) in a simulated surgical procedure.

SUMMARY OF BACKGROUND DATA

Although surgeons' technical and NTS during surgery are crucial determinants for clinical outcomes, little literature is available in spine surgery. Moreover, evidence regarding how surgeons' technical and NTS are related is limited.

METHODS

A mixed-reality and full-scale simulated operating room environment was employed for the surgical team. Eleven surgeons performed the vertebroplasty procedure (VP). Technical skills (TS) were assessed using Objective Structured Assessment of Technical Skill scores and senior expert-evaluated VP outcome assessment. NTS were assessed with the Observational Teamwork Assessment for Surgery. Kendall-Tau-b tests were performed for correlations. We further controlled the influence of surgeons' experience (based on professional tenure and number of previous VPs performed).

RESULT

Surgeons' NTS correlated significantly with their technical performance (τ = 0.63; P = 0.006) and surgical outcome scores (τ = 0.60; P = 0.007). This association was attenuated when controlling for surgeons' experience.

CONCLUSION

Our results suggest that spine surgeons with higher levels of TS also apply better communication, leadership, and coordination behaviors during the procedure. Yet, the role of surgeons' experience needs further investigation for improving surgeons' intraoperative performance during spine surgery.

LEVEL OF EVIDENCE

3.

Non-technical skills: a review of training and evaluation in urology

PURPOSE

With non-technical skills (NTS) deficits being recognised as a major cause for error in surgery, there is an increasing interest in their training and evaluation. A growing number of training courses are emerging and some NTS curricula have also been created. Many different training methods are described in the literature but there is still uncertainty with regards to their optimum combination within a curriculum.

METHODS

A literature review of the electronic database Medline was performed. All articles published before December 2018 were screened by abstract and included if deemed relevant by the author. The included articles' reference lists were also screened for further relevant studies.

RESULTS

Simulation training is accepted as the most effective way to train NTS. Within simulation training, it is shown that the 'igloo' full immersion/distributed simulation environment is appropriate for teaching NTS in urological scenarios where a designated operating room or space is not available. The use of multiple settings, for example wards and clinics as well as the operating room, is advantageous, as is training in an interprofessional team. Classroom teaching also plays a role in NTS training as an adjunct to simulation, with evidence that it improves some parameters of NTS. All levels, including qualified surgeons, benefit from NTS training; however, adaptation to both trainee level and specialty is important. Although less time consuming, training juniors and seniors together mainly benefits juniors, and training NTS at the same time as technical skills detracts from the quality of teaching. Debriefing is an important part of training and should be well structured; there are many debriefing models in existence, allowing for choice of method based on examiner preference and participant demographic. Furthermore, examiners should be well briefed in their task and trained in NTS assessment.

CONCLUSION

To move forward, studies should combine tried and tested learning techniques into a curriculum covering all training levels, which should then be validated and followed up long term to ensure a positive impact on patient safety.

Psychological aptitude for surgery: The importance of non-technical skills

INTRODUCTION

Psychological aptitude for surgery includes all the non-technical abilities that are necessary for the surgeons. However, differently from the other careers, these skills are not considered in the selection process and their role is definitively underestimated in the field of surgery. We perform a literature review of non-technical skills for surgery to identify their role and to understand how to train and evaluate these abilities among the surgeons.

RESULTS

Different methods have been presented for the evaluation and training of non-technical skills for surgeons; based on the model of aviation and anesthesia a wide range of simulated scenarios have been proposed to practice these aptitudes and abilities. Different behavioral markers systems have been developed for correct identification and definition of these skills, these can be used in the real surgical room and even learned and trained in the simulated operating theatre.

CONCLUSION

This article shows the importance of non-practical abilities in the surgical performance and in defining the aptitude for surgery. Learning these skills and introducing them in surgical education can be useful to improve the surgical performance.

Nontechnical Skills in Surgery: A Systematic Review of Current Training Modalities

BACKGROUND

The complexity of the operating room requires a surgeon to have both technical ability and an array of nontechnical skills. The emphasis on technical skills during surgical training is well established, however it is deficiencies in nontechnical skills that have been identified as the main cause of errors in the operating room.

OBJECTIVE

This systematic review aims to identify current methods used to teach nontechnical skills and how these methods are assessed to determine their validity, evidence, and role in training.

METHODS

MEDLINE and Embase databases were searched for English language articles between 2000 and 2017 for nontechnical surgical skills training. Original research articles were included if they described non-technical surgical skills training modalities and their assessment. Results were assessed for the level of evidence and each modality was awarded a level of recommendation, using a modified educational Oxford Centre for Evidence-Based Medicine classification, as adapted by the European Association of Endoscopic Surgery.

RESULTS

A total of 19 studies were identified pertaining to high fidelity simulation (n = 8), low fidelity simulation (n = 6), didactic teaching (n = 2) and crisis resource management (n = 3). Of the included studies 1 was classified Level 1b, 1 level 2b, 7 level 2b, 2 level 2c, and 8 level 3.

CONCLUSION

With the importance of nontechnical skills being increasingly recognized, it is essential for surgeons to receive adequate training in nontechnical skills. Therefore the most valuable teaching modalities such as high and low fidelity simulation needs to be implemented into surgical training curricula.

Simulation-based training in urology residency programmes in the USA: Results of a nationwide survey

Objective

To evaluate the current usage of simulation in urological education in the USA and the barriers to incorporating a simulation-based educational curriculum, as the shift towards competency-based medical education has necessitated the introduction of simulation for training and assessing both non-technical and technical skills.

Materials and methods

Residency programme directors at Accreditation Council for Graduate Medical Education (ACGME)-accredited urology training programmes in the USA were invited to respond to an anonymous electronic survey. The study evaluated the programme directors’ experiences and opinions for the current usage of existing urology simulators. The survey also elicited receptiveness and the barriers for incorporating simulation-based training curricula within urology training programmes.

Results

In all, 43 completed surveys were received (35% response rate). Amongst responders, 97% (42/43) reported having access to a simulation education centre, and 60% (25/42) have incorporated simulation into their curriculum. A total of 87% (37/43) agreed that there is a role for a standardised simulator training curriculum, and 75% (30/40) agreed that simulators would improve operating room performance. A total of 64% (27/42) agreed that cost was a limiting factor, 12% (5/42) agreed on the cost-effectiveness of simulators, 35% (17/41) agreed there was an increased need for simulator education within work-hour limitations, and 38% (16/42) agreed a simulation programme would reduce patient risks and complications.

Conclusions

The majority of urology programme directors consider that there is a role for incorporating a simulation-based curriculum into urology training. Barriers to implementation include cost burden, need for constant technology updates, need for advanced planning, and willingness of faculty to participate in administration.

Implementing assessments of robot-assisted technical skill in urological education: a systematic review and synthesis of the validity evidence

OBJECTIVES

To systematically review and synthesise the validity evidence supporting intraoperative and simulation-based assessments of technical skill in urological robot-assisted surgery (RAS), and make evidence-based recommendations for the implementation of these assessments in urological training.

MATERIALS AND METHODS

A literature search of the Medline, PsycINFO and Embase databases was performed. Articles using technical skill and simulation-based assessments in RAS were abstracted. Only studies involving urology trainees or faculty were included in the final analysis.

RESULTS

Multiple tools for the assessment of technical robotic skill have been published, with mixed sources of validity evidence to support their use. These evaluations have been used in both the ex vivo and in vivo settings. Performance evaluations range from global rating scales to psychometrics, and assessments are carried out through automation, expert analysts, and crowdsourcing.

CONCLUSION

There have been rapid expansions in approaches to RAS technical skills assessment, both in simulated and clinical settings. Alternative approaches to assessment in RAS, such as crowdsourcing and psychometrics, remain under investigation. Evidence to support the use of these metrics in high-stakes decisions is likely insufficient at present.

Simulation in paediatric urology and surgery, part 2: An overview of simulation modalities and their applications

Surgical training has changed radically in the last few decades. The traditional Halstedian model of time-bound apprenticeship has been replaced with competency-based training. In our previous article, we presented an overview of learning theory relevant to clinical teaching; a summary for the busy paediatric surgeon and urologist. We introduced the concepts underpinning current changes in surgical education and training. In this next article, we give an overview of the various modalities of surgical simulation, the educational principles that underlie them, and potential applications in clinical practice. These modalities include; open surgical models and trainers, laparoscopic bench trainers, virtual reality trainers, simulated patients and role-play, hybrid simulation, scenario-based simulation, distributed simulation, virtual reality, and online simulation. Specific examples of technology that may be used for these modalities are included but this is not a comprehensive review of all available products.

Simulation in urological training: Where are we in 2017?

Traditional Halstedian principles are no longer compatible with modern day urological training. Changing patterns of healthcare provision and the advanced nature of minimally invasive urological surgery have resulted in trainees receiving reduced exposure to independent operative experience. The drive towards consultant-delivered care, coupled with the introduction of the European working time directive, necessitate the urology trainee to meet end-of-training competencies with fewer learning opportunities compared with previous generations. Simulation provides an opportunity to compensate for reduced operative experience by augmenting both technical and non-technical skills development. A variety of simulation models can be used from cadaveric, synthetic and animal models to advanced virtual reality to aid surgical training. Whilst simulation is not without limitations, it has the potential to significantly enhance procedural competency and non-technical skills in a risk-free environment. Clear benefits, including equipment familiarity and trainee confidence have been demonstrated. However, direct transferability of these benefits to an operating-theatre is not clearly evident. Whilst not a substitute for clinical practice, simulation is likely to prove itself as a valuable adjunct to urological training. In this narrative review, we examine the current literature on simulation training in relation to urological surgery.

Training Tools for Nontechnical Skills for Surgeons-A Systematic Review

OBJECTIVE

Development of nontechnical skills for surgeons has been recognized as an important factor in surgical care. Training tools for this specific domain are being created and validated to maximize the surgeon's nontechnical ability. This systematic review aims to outline, address, and recommend these training tools.

DESIGN

A full and comprehensive literature search, using a systematic format, was performed on ScienceDirect and PubMed, with data extraction occurring in line with specified inclusion criteria.

SETTING

Systematic review was performed fully at King's College London.

RESULTS

A total of 84 heterogeneous articles were used in this review. Further, 23 training tools including scoring systems, training programs, and mixtures of the two for a range of specialities were identified in the literature. Most can be applied to surgery overall, although some tools target specific specialities (such as neurosurgery). Interrater reliability, construct, content, and face validation statuses were variable according to the specific tool in question.

CONCLUSIONS

Study results pertaining to nontechnical skill training tools have thus far been universally positive, but further studies are required for those more recently developed and less extensively used tools. Recommendations can be made for individual training tools based on their level of validation and for their target audience. Based on the number of studies performed and their status of validity, NOTSS and Oxford NOTECHS II can be considered the gold standard for individual- and team-based nontechnical skills training, respectively, especially when used in conjunction with a training program.

State of Simulation in Healthcare Education: An Initial Survey in Beijing

Background and Objectives:

In 2013, medical error was the third leading cause of death in the United States.¹ In China, as in the case with the United States, training and assessment are developing as a strategy to reduce the occurrence of such errors. The objective of this study was to assess the current state of the use of simulation-based training in Beijing and to explore the barriers to further development.

Methods:

This study included hospitals in Beijing accredited by the Standardized Residency Training (SRT) program. The questionnaire was designed online and distributed to the SRT management departments by e-mail or instant message.

Results:

Thirty hospitals were invited to participate in this survey, and 15 responses were completed and met the inclusion criteria. Task trainers (15/15), full-scale mannequins (14/15), standardized patients (12/15), and virtual reality workstations (11/15) were the most common types of simulation modalities available for use. Among the given specialties for SRT, the availability of simulation courses was 2/2 for pediatric internal medicine, 1/1 for pediatric surgery, 10/11 for surgery, 11/14 for internal medicine, 7/9 for anesthesiology, 6/8 for emergency medicine, and 3/9 for obstetrics/gynecology. Of the 13 institutions with available simulation curricula, 12/13 had simulation focused on proficiency-based skill training, 11/13 had medical knowledge learning, 10/13 had skill competency assessment. The main targeted trainees in these hospitals were residents (or postgraduate residents) and medical students (or interns). The top 2 barriers were the shortage of sustainable financial resources (12/15) and advocacy from their institutional authorities (7/15).

Conclusion:

It is evident that there is a need for more development of training facilities, and for training the “trainers” and administrators. Financial funding, curricular design, and research seem to be crucial for building a long-term, sustainable, effective program.

Comprehensive simulation-enhanced training curriculum for an advanced minimally invasive procedure: a randomized controlled trial

BACKGROUND

There is no comprehensive simulation-enhanced training curriculum to address cognitive, psychomotor, and nontechnical skills for an advanced minimally invasive procedure.

OBJECTIVES

1) To develop and provide evidence of validity for a comprehensive simulation-enhanced training (SET) curriculum for an advanced minimally invasive procedure; (2) to demonstrate transfer of acquired psychomotor skills from a simulation laboratory to live porcine model; and (3) to compare training outcomes of SET curriculum group and chief resident group.

SETTING

University.

METHODS

This prospective single-blinded, randomized, controlled trial allocated 20 intermediate-level surgery residents to receive either conventional training (control) or SET curriculum training (intervention). The SET curriculum consisted of cognitive, psychomotor, and nontechnical training modules. Psychomotor skills in a live anesthetized porcine model in the OR was the primary outcome. Knowledge of advanced minimally invasive and bariatric surgery and nontechnical skills in a simulated OR crisis scenario were the secondary outcomes. Residents in the SET curriculum group went on to perform a laparoscopic jejunojejunostomy in the OR. Cognitive, psychomotor, and nontechnical skills of SET curriculum group were also compared to a group of 12 chief surgery residents.

RESULTS

SET curriculum group demonstrated superior psychomotor skills in a live porcine model (56 [47-62] versus 44 [38-53], P<.05) and superior nontechnical skills (41 [38-45] versus 31 [24-40], P<.01) compared with conventional training group. SET curriculum group and conventional training group demonstrated equivalent knowledge (14 [12-15] versus 13 [11-15], P = 0.47). SET curriculum group demonstrated equivalent psychomotor skills in the live porcine model and in the OR in a human patient (56 [47-62] versus 63 [61-68]; P = .21). SET curriculum group demonstrated inferior knowledge (13 [11-15] versus 16 [14-16]; P<.05), equivalent psychomotor skill (63 [61-68] versus 68 [62-74]; P = .50), and superior nontechnical skills (41 [38-45] versus 34 [27-35], P<.01) compared with chief resident group.

CONCLUSION

Completion of the SET curriculum resulted in superior training outcomes, compared with conventional surgery training. Implementation of the SET curriculum can standardize training for an advanced minimally invasive procedure and can ensure that comprehensive proficiency milestones are met before exposure to patient care.

Addressing the Interprofessional Collaboration Competencies of the Association of American Medical Colleges: A Systematic Review of Assessment Instruments in Undergraduate Medical Education

PURPOSE

To summarize characteristics and validity evidence of tools that assess teamwork in undergraduate medical education (UME), and provide recommendations for addressing the interprofessional collaboration competencies of the Association of American Medical Colleges (AAMC).

METHOD

The authors conducted a systematic review, searching MEDLINE, MEDLINE In-process, CINAHL, and PsycINFO from January 1, 1979, through April 1, 2014; they searched reference lists and national meeting abstracts. They included original research reports that described a quantitative tool used to assess teamwork in UME. They abstracted characteristics and validity evidence for the tools, plus study quality, according to established frameworks. Two authors independently abstracted 25% of articles and calculated agreement. Authors then applied predefined criteria to identify tools best suited to address the AAMC's teamwork competencies.

RESULTS

Of 13,549 citations, 70 articles describing 64 teamwork assessment tools were included. Of these 64 tools, 27 (42%) assessed teamwork in classroom, 31 (48%) in simulation, and only 7 (11%) in actual clinical settings. The majority (47; 73%) of tools assessed medical students' teamwork in interprofessional teams. On the basis of content concordance, strength of validity evidence, generalizability of scores, and level of outcomes, four published tools were recommended to assess the AAMC's teamwork competencies: the Collaborative Healthcare Interdisciplinary Relationship Planning Scale, Readiness for Interprofessional Learning Scale, Communication and Teamwork Skills assessment, and Teamwork Mini-Clinical Evaluation Exercise.

CONCLUSIONS

Substantial validity evidence supports the use of several UME teamwork assessments. Four tools have been appropriately designed and sufficiently studied to constitute appropriate assessments of the AAMC's teamwork competencies.

Stratification of Expert vs Novice Laparoscopists Using the Basic Laparoscopic Urologic Surgery (BLUS) Curriculum at a Single Institution

PURPOSE

To assess determinants of performance applying the tasks of the Basic Laparoscopic Urologic Surgery (BLUS) skills curriculum administered at a single institution.

METHODS

After obtaining institutional review board approval, fourth-year medical students, urology residents (postgraduate year 1-5), and staff attending surgeons from an academic institution were recruited. Participants were grouped by level of experience and evaluated on 4 different BLUS modules testing fundamental laparoscopic techniques from September 2012 to September 2013. Task completion time (TCT) and missed objectives were compared with previous laparoscopic experience, amount of endourological training, and scores obtained through the EDGE simulator.

RESULTS

TCTs among the participants were slower and accrued greater errors in the novice group (n = 10) than in the intermediate-level (n = 9) and expert-level (n = 9) groups. Completion times on the peg transfer were 213.4, 128.1, and 108.7 seconds (p < 0.05); on the circle cutting were 182.4, 128.3, and 97.2 seconds (p < 0.05); on the clip application were 44.4, 43.2, and 38.1 seconds (p = 0.08); and on the suturing were 286.1, 177.3, and 123.6 seconds (p < 0.05) for novice, intermediate, and expert groups, respectively. When past laparoscopic numbers of participants were compared with TCTs, a positive correlation of R(2) = 0.39 was seen, signifying a relationship between number of laparoscopic cases and TCT outcomes.

CONCLUSION

Performance on the EDGE simulator device during the BLUS modules significantly correlated with the amount of laparoscopic experience. Increase in the years of experience and number of laparoscopic cases led to faster and more accurate TCTs.

The current role of simulation in urological training

Introduction

Simulation is becoming an increasingly popular educational tool in numerous surgical specialities, including urology. This article reviews the current role of urological simulators; discussing their need, availability, incorporation and current limitations.

Material and methods

A literature review of the electronic databases Medline, Embase and Google Scholar was performed.

Results

For increasingly limited urological training programs, simulation can act as a valuable adjunct to clinical training. Evidence suggests that simulation enables the trainee to bypass the early, error-prone part of the surgical learning curve. It should be incorporated into proficiency-based curricula, with junior trainees initially beginning with low fidelity simulators to grasp basic surgical skills before moving onto full-procedural simulation as they progress through their training. A wide variety of simulators of differing fidelity are currently available, teaching both technical (eg. cystoscopy) and non-technical (eg. communication) urological surgical skills. Whist numerous studies have assessed the face, content and construct validity of various urological simulators, further work needs to be undertaken to determine whether the skills learnt actually improve trainee performance in the operating room. Then, educators will be able to make informed decisions about whether these resource demanding (financially and in terms of demands on faculty) simulators are a worthwhile educational tool.

Conclusions

Although further investigation is required, urological simulators appear to have a considerable role for developing both technical and non-technical urological skills in an increasingly restricted educational environment in modern urogynecology.

Novel Transparent Urinary Tract Simulator Improves Teaching of Urological Operation Skills at a Single Institution

OBJECTIVE

This randomized controlled study compared a novel transparent urinary tract simulator with the traditional opaque urinary tract simulator as an aid for efficiently teaching urological surgical procedures.

METHODS

Senior medical students were tested on their understanding of urological theory before and after lectures concerning urinary system disease. The students received operative training using the transparent urinary tract simulator (experimental group, n = 80) or the J3311 opaque plastic urinary tract simulator (control, n = 80), specifically in catheterization and retrograde double-J stent implantation. The operative training was followed by a skills test and student satisfaction survey.

RESULTS

The test scores for theory were similar between the two groups, before and after training. Students in the experimental group performed significantly better than those in the control group on the procedural skills test, and also had significantly better self-directed learning skills, analytical skills, and greater motivation to learn.

CONCLUSION

During the initial step of training, the novel transparent urinary tract simulator significantly improved the efficiency of teaching urological procedural skills compared with the traditional opaque device.

Teamwork assessment in internal medicine: a systematic review of validity evidence and outcomes

OBJECTIVE

Valid teamwork assessment is imperative to determine physician competency and optimize patient outcomes. We systematically reviewed published instruments assessing teamwork in undergraduate, graduate, and continuing medical education in general internal medicine and all medical subspecialties.

DATA SOURCES

We searched MEDLINE, MEDLINE In-process, CINAHL and PsycINFO from January 1979 through October 2012, references of included articles, and abstracts from four professional meetings. Two content experts were queried for additional studies.

STUDY ELIGIBILITY

Included studies described quantitative tools measuring teamwork among medical students, residents, fellows, and practicing physicians on single or multi-professional (interprofessional) teams.

STUDY APPRAISAL AND SYNTHESIS METHODS

Instrument validity and study quality were extracted using established frameworks with existing validity evidence. Two authors independently abstracted 30 % of articles and agreement was calculated.

RESULTS

Of 12,922 citations, 178 articles describing 73 unique teamwork assessment tools met inclusion criteria. Interrater agreement was intraclass correlation coefficient 0.73 (95 % CI 0.63-0.81). Studies involved practicing physicians (142, 80 %), residents/fellows (70, 39 %), and medical students (11, 6 %). The majority (152, 85 %) assessed interprofessional teams. Studies were conducted in inpatient (77, 43 %), outpatient (42, 24 %), simulation (37, 21 %), and classroom (13, 7 %) settings. Validity evidence for the 73 tools included content (54, 74 %), internal structure (51, 70 %), relationships to other variables (25, 34 %), and response process (12, 16 %). Attitudes and opinions were the most frequently assessed outcomes. Relationships between teamwork scores and patient outcomes were directly examined for 13 (18 %) of tools. Scores from the Safety Attitudes Questionnaire and Team Climate Inventory have substantial validity evidence and have been associated with improved patient outcomes.

LIMITATIONS

Review is limited to quantitative assessments of teamwork in internal medicine.

CONCLUSIONS

There is strong validity evidence for several published tools assessing teamwork in internal medicine. However, few teamwork assessments have been directly linked to patient outcomes.

Multidisciplinary team simulation for the operating theatre: a review of the literature

INTRODUCTION

Analyses of adverse events inside the operating theatre has demonstrated that many errors are caused by failure in non-technical skills and teamwork. While simulation has been used successfully for teaching and improving technical skills, more recently, multidisciplinary simulation has been used for training team skills. We hypothesized that this type of training is feasible and improves team skills in the operating theatre.

METHODS

A systematic search of the literature for studies describing true multidisciplinary operating theatre team simulation was conducted in November and December 2012. We looked at the characteristics and outcomes of the team simulation programmes.

RESULTS

1636 articles were initially retrieved. Utilizing a stepwise evaluation process, 26 articles were included in the review. The studies reveal that multidisciplinary operating theatre simulation has been used to provide training in technical and non-technical skills, to help implement new techniques and technologies, and to identify latent weaknesses within a health system. Most of the studies included are descriptions of training programmes with a low level of evidence. No randomized control trial was identified. Participants' reactions to the training programme were positive in all studies; however, none of them could objectively demonstrate that skills acquired from simulation are transferred to the operating theatre or show a demonstrable benefit in patient outcomes.

CONCLUSION

Multidisciplinary operating room team simulation is feasible and widely accepted by participants. More studies are required to assess the impact of this type of training on operative performance and patient safety.

Robotic surgical simulation

Robotic surgery has undergone exponential growth and has ever developing utilization. The explosion of new technologies and regulation have led to challenges in training surgeons who desire this skill set. We review the current state of robotic simulation and incorporation of simulation into surgical training curricula. In addition to the literature review, results of a questionnaire survey study of 21 expert and novice surgeons attending a Urologic Robotic Oncology conference using 3 different robotic skill simulation devices are discussed. An increasing number of robotic surgery simulators have had some degree of validation study of their use in surgical education curricula and proficiency testing. Although simulators are advantageous, confirmation of construct and predictive validity of robotic simulators and their reliability as a training tool will be necessary before they are integrated into the surgical credentialing process.

High-fidelity simulation-based team training in urology: evaluation of technical and nontechnical skills of urology residents during laparoscopic partial nephrectomy

INTRODUCTION

The use of low-risk simulation training for resident education is rapidly expanding as teaching centers integrate simulation-based team training (SBTT) sessions into their education curriculum. SBTT is a valuable tool in technical and communication skills training and assessment for residents. We created a unique SBTT scenario for urology residents involving a laparoscopic partial nephrectomy procedure.

MATERIALS AND METHODS

Urology residents were randomly paired with a certified registered nurse anesthetists or an anesthesia resident. The scenario incorporated a laparoscopic right partial nephrectomy utilizing a unique polyvinyl alcohol kidney model with an embedded 3cm lower pole exophytic tumor and the high-fidelity SimMan3G mannequin. The Urology residents were instructed to pay particular attention to the patient's identifying information provided at the beginning of the case. Two scripted events occurred, the patient had an anaphylactic reaction to a drug and, after tumor specimen was sent for a frozen section, the confederate pathologist called into the operating room (OR) twice, first with the wrong patient name and subsequently with the wrong specimen. After the scenario was complete, technical performance and nontechnical performance were evaluated and assessed. A debriefing session followed the scenario to discuss and assess technical performance and interdisciplinary nontechnical communication between the team.

RESULTS

All Urology residents (n = 9) rated the SBTT scenario as a useful tool in developing communication skills among the OR team and 88% rated the model as useful for technical skills training. Despite cuing to note patient identification, only 3 of 9 (33%) participants identified that the wrong patient information was presented when the confederate "pathologist" called in to report pathology results.

CONCLUSION

All urology residents rated SBTT sessions as useful for the development of communication skills between different team members and making residents aware of unlikely but potential critical errors in the OR. We will continue to use SBTT as a useful method to develop resident technical and nontechnical skills outside of the high-risk operating environment.

Simulation experience enhances physical therapist student confidence in managing a patient in the critical care environment

BACKGROUND

Rehabilitation of patients in critical care environments improves functional outcomes. This finding has led to increased implementation of intensive care unit (ICU) rehabilitation programs, including early mobility, and an associated increased demand for physical therapists practicing in ICUs. Unfortunately, many physical therapists report being inadequately prepared to work in this high-risk environment. Simulation provides focused, deliberate practice in safe, controlled learning environments and may be a method to initiate academic preparation of physical therapists for ICU practice.

OBJECTIVE

The purpose of this study was to examine the effect of participation in simulation-based management of a patient with critical illness in an ICU setting on levels of confidence and satisfaction in physical therapist students.

DESIGN

A one-group, pretest-posttest, quasi-experimental design was used.

METHODS

Physical therapist students (N=43) participated in a critical care simulation experience requiring technical (assessing bed mobility and pulmonary status), behavioral (patient and interprofessional communication), and cognitive (recognizing a patient status change and initiating appropriate responses) skill performance. Student confidence and satisfaction were surveyed before and after the simulation experience.

RESULTS

Students' confidence in their technical, behavioral, and cognitive skill performance increased from "somewhat confident" to "confident" following the critical care simulation experience. Student satisfaction was highly positive, with strong agreement the simulation experience was valuable, reinforced course content, and was a useful educational tool.

LIMITATIONS

Limitations of the study were the small sample from one university and a control group was not included.

CONCLUSIONS

Incorporating a simulated, interprofessional critical care experience into a required clinical course improved physical therapist student confidence in technical, behavioral, and cognitive performance measures and was associated with high student satisfaction. Using simulation, students were introduced to the critical care environment, which may increase interest in working in this practice area.