1
|
Lee A, Goodman S, Chen CM, Landau R, Chatterji M. Electronic Feedback Alone Versus Electronic Feedback Plus in-Person Debriefing for a Serious Game Designed to Teach Novice Anesthesiology Residents to Perform General Anesthesia for Cesarean Delivery: Randomized Controlled Trial. JMIR Serious Games 2024; 12:e59047. [PMID: 39622704 PMCID: PMC11611795 DOI: 10.2196/59047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Revised: 09/12/2024] [Accepted: 09/17/2024] [Indexed: 09/19/2024] Open
Abstract
Background EmergenCSim is a novel researcher-developed serious game (SG) with an embedded scoring and feedback tool that reproduces an obstetric operating room environment. The learner must perform general anesthesia for emergent cesarean delivery for umbilical cord prolapse. The game was developed as an alternative teaching tool because of diminishing real-world exposure of anesthesiology trainees to this clinical scenario. Traditional debriefing (facilitator-guided reflection) is considered to be integral to experiential learning but requires the participation of an instructor. The optimal debriefing methods for SGs have not been well studied. Electronic feedback is commonly provided at the conclusion of SGs, so we aimed to compare the effectiveness of learning when an in-person debrief is added to electronic feedback compared with using electronic feedback alone. Objective We hypothesized that an in-person debriefing in addition to the SG-embedded electronic feedback will provide superior learning than electronic feedback alone. Methods Novice first-year anesthesiology residents (CA-1; n=51) (1) watched a recorded lecture on general anesthesia for emergent cesarean delivery, (2) took a 26-item multiple-choice question pretest, and (3) played EmergenCSim (maximum score of 196.5). They were randomized to either the control group that experienced the electronic feedback alone (group EF, n=26) or the intervention group that experienced the SG-embedded electronic feedback and an in-person debriefing (group IPD+EF, n=25). All participants played the SG a second time, with instructions to try to increase their score, and then they took a 26-item multiple-choice question posttest. Pre- and posttests (maximum score of 26 points each) were validated parallel forms. Results For groups EF and IPD+EF, respectively, mean pretest scores were 18.6 (SD 2.5) and 19.4 (SD 2.3), and mean posttest scores were 22.6 (SD 2.2) and 22.1 (SD 1.6; F1,49=1.8, P=.19). SG scores for groups EF and IPD+EF, respectively, were-mean first play SG scores of 135 (SE 4.4) and 141 (SE 4.5), and mean second play SG scores of 163.1 (SE 2.9) and 173.3 (SE 2.9; F1,49=137.7, P<.001). Conclusions Adding an in-person debriefing experience led to greater improvement in SG scores, emphasizing the learning benefits of this practice. Improved SG performance in both groups suggests that SGs have a role as independent, less resource-intensive educational tools.
Collapse
Affiliation(s)
- Allison Lee
- Department of Anesthesiology and Critical Care, University of Pennsylvania, 3400 Spruce St, 680 Dulles, Philadelphia, PA, 19104, United States, 1 3055826077
| | - Stephanie Goodman
- Department of Anesthesiology, Columbia University, New York, NY, United States
| | - Chen Miao Chen
- Teachers College, Columbia University, New York, NY, United States
| | - Ruth Landau
- Department of Anesthesiology, Columbia University, New York, NY, United States
| | | |
Collapse
|
2
|
Lee AJ, Goodman SR, Bauer MEB, Minehart RD, Banks S, Chen Y, Landau RL, Chatterji M. Validating Parallel-Forms Tests for Assessing Anesthesia Resident Knowledge. JOURNAL OF MEDICAL EDUCATION AND CURRICULAR DEVELOPMENT 2024; 11:23821205241229778. [PMID: 38357687 PMCID: PMC10865962 DOI: 10.1177/23821205241229778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 01/12/2024] [Indexed: 02/16/2024]
Abstract
We created a serious game to teach first year anesthesiology (CA-1) residents to perform general anesthesia for cesarean delivery. We aimed to investigate resident knowledge gains after playing the game and having received one of 2 modalities of debriefing. We report on the development and validation of scores from parallel test forms for criterion-referenced interpretations of resident knowledge. The test forms were intended for use as pre- and posttests for the experiment. Validation of instruments measuring the study's primary outcome was considered essential for adding rigor to the planned experiment, to be able to trust the study's results. Parallel, multiple-choice test forms development steps included: (1) assessment purpose and population specification; (2) content domain specification and writing/selection of items; (3) content validation by experts of paired items by topic and cognitive level; and (4) empirical validation of scores from the parallel test forms using Classical Test Theory (CTT) techniques. Field testing involved online administration of 52 shuffled items from both test forms to 24 CA-1's, 21 second-year anesthesiology (CA-2) residents, 2 fellows, 1 attending anesthesiologist, and 1 of unknown rank at 3 US institutions. Items from each form yielded near-normal score distributions, with similar medians, ranges, and standard deviations. Evaluations of CTT item difficulty (item p values) and discrimination (D) indices indicated that most items met assumptions of criterion-referenced test design, separating experienced from novice residents. Experienced residents performed better on overall domain scores than novices (P < .05). Kuder-Richardson Formula 20 (KR-20) reliability estimates of both test forms were above the acceptability cut of .70, and parallel forms reliability estimate was high at .86, indicating results were consistent with theoretical expectations. Total scores of parallel test forms demonstrated item-level validity, strong internal consistency and parallel forms reliability, suggesting sufficient robustness for knowledge outcomes assessments of CA-1 residents.
Collapse
Affiliation(s)
- Allison J. Lee
- Department of Anesthesiology, Columbia University, New York, NY, USA
| | | | | | - Rebecca D. Minehart
- Department of Anesthesia, Critical Care and Pain Medicine, Harvard University, Boston, MA, USA
| | - Shawn Banks
- Department of Anesthesiology, Perioperative Medicine and Pain Management, University of Miami, Miami, FL, USA
| | - Yi Chen
- Teachers College, Columbia University, New York, NY, USA
| | - Ruth L. Landau
- Department of Anesthesiology, Columbia University, New York, NY, USA
| | | |
Collapse
|
3
|
Fernandes NL, Lilaonitkul M, Subedi A, Owen MD. Global obstetric anaesthesia: bridging the gap in maternal health care inequities through partnership in education. Int J Obstet Anesth 2023; 55:103646. [PMID: 37211512 DOI: 10.1016/j.ijoa.2023.103646] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 02/20/2023] [Indexed: 05/23/2023]
Abstract
Maternal mortality rates are unacceptably high globally. Low- and middle-income countries (LMICs) face challenges of an inadequate anaesthesia workforce, under-resourced healthcare systems and sub-optimal access to labour and delivery care, all of which negatively impact maternal and neonatal outcomes. In order to effect the changes in surgical-obstetric-anaesthesia workforce numbers advocated by the Lancet Commission on Global Surgery to support the UN sustainable development goals, mass training and upskilling of both physician and non-physician anaesthetists is imperative. The implementation of outreach programmes and partnerships across organisations and countries has already been shown to improve the provision of safe care to mothers and their babies, and these efforts should be continued. Short subspecialty courses and simulation training are two cornerstones of modern obstetric anaesthesia training in poorly resourced environments. This review discusses the challenges to accessing quality maternal healthcare in LMICs and the use of education, outreach, partnership and research to protect the most vulnerable women from coming to harm in the peripartum period.
Collapse
Affiliation(s)
- N L Fernandes
- Department of Anaesthesia and Perioperative Medicine, Groote Schuur Hospital, University of Cape Town, Cape Town, South Africa.
| | - M Lilaonitkul
- Department of Anesthesia and Perioperative Care, University of California San Francisco, San Francisco, CA, USA
| | - A Subedi
- Department of Anesthesiology and Critical Care, BP Koirala Institute of Health Sciences, Dharan, Nepal
| | - M D Owen
- Department of Anesthesiology, Wake Forest School of Medicine, Winston-Salem, NC, USA
| |
Collapse
|
4
|
Ffrench-O'Carroll R, Sunderani Z, Preston R, Mayer U, Albert A, Chau A. Enhancing knowledge, skills, and comfort in providing anesthesia assistance during obstetric general anesthesia for operating room nurses: a prospective observational study. Can J Anaesth 2022; 69:1220-1229. [PMID: 35750971 DOI: 10.1007/s12630-022-02277-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 02/20/2022] [Accepted: 02/23/2022] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND Due to a nationwide shortage of anesthesia assistants, operating room nurses are often recruited to assist with the induction of obstetric general anesthesia (GA). We developed and administered a training program and hypothesized there would be significant improvements in knowledge and skills in anesthesia assistance during obstetric GA by operating room nurses following training with adequate retention at six months. METHODS Following informed consent, all operating room nurses at our institution were invited to participate in the study. Baseline knowledge of participants was assessed using a 14-item multiple choice questionnaire (MCQ), and skills were assessed using a 12-item checklist scored by direct observation during simulated induction of GA. Next, a 20-min didactic lecture followed by a ten-minute hands-on skills station were delivered. Knowledge and skills were immediately reassessed after training, and again at six weeks and six months. The primary outcomes of this study were adequate knowledge and skills retention at six months, defined as achieving ≥ 80% in MCQ and ≥ 80% in skills checklist scores and analyzed using longitudinal mixed-effects linear regression. RESULTS A total of 34 nurses completed the study at six months. The mean MCQ score at baseline was 8.9 (95% confidence interval [CI], 8.5 to 9.4) out of 14. The mean skills checklist score was 5.5 (95% CI, 4.9 to 6.1) out of 12. The mean comfort scores for assisting elective and emergency Cesarean deliveries were 3.6 (95% CI, 3.2 to 3.9) and 3.1 (95% CI, 2.7 to 3.5) out of 5, respectively. There was a significant difference in the mean MCQ and skills checklist scores across the different study periods (overall P value < 0.001). Post hoc pairwise tests suggested that, compared with baseline, there were significantly higher mean MCQ scores at all time points after the training program at six weeks (11.9; 95% CI, 11.4 to 12.4; P < 0.001) and at six months (12.0; 95% CI, 11.5 to 12.4; P < 0.001). DISCUSSION The knowledge and skills of operating room nurses in providing anesthesia assistance during obstetric GA at our institution were low at baseline. Following a single 30-min in-house, anesthesiologist-led, structured training program, scores in both dimensions significantly improved. Although knowledge improvements were adequately retained for up to six months, skills improvements decayed rapidly, suggesting that sessions should be repeated at six-week intervals, at least initially.
Collapse
Affiliation(s)
| | - Zahid Sunderani
- Department of Anesthesia, Rockyview General Hospital, Calgary, AB, Canada.,Department of Anesthesiology, Perioperative and Pain Medicine, University of Calgary, Calgary, AB, Canada
| | - Roanne Preston
- Department of Anesthesia, BC Women's Hospital, Vancouver, BC, Canada.,Department of Anesthesiology, Pharmacology & Therapeutics, The University of British Columbia, Vancouver, BC, Canada
| | - Ulrike Mayer
- Women's Health Research Institute, BC Women's Hospital, Vancouver, BC, Canada
| | - Arianne Albert
- Women's Health Research Institute, BC Women's Hospital, Vancouver, BC, Canada
| | - Anthony Chau
- Department of Anesthesia, BC Women's Hospital, Vancouver, BC, Canada. .,Department of Anesthesiology, Pharmacology & Therapeutics, The University of British Columbia, Vancouver, BC, Canada.
| |
Collapse
|
5
|
Hunt JA, Gilley RS, Spangler D, Pulliam T, Anderson S. Retention of basic surgical skills in veterinary students. Vet Surg 2022; 51:1240-1246. [PMID: 36117254 DOI: 10.1111/vsu.13891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Revised: 07/06/2022] [Accepted: 08/27/2022] [Indexed: 11/29/2022]
Abstract
OBJECTIVE To quantify veterinary students' retention of surgical skills after a 5-month period without practice. STUDY DESIGN Prospective longitudinal descriptive study. SAMPLE POPULATION Convenience sample of second year veterinary students (n = 57). METHODS Students practiced ovariohysterectomy (OVH) on a model during 4 clinical skills laboratories during spring 2021. Students were assessed performing OVH on their model using a validated 22-item rubric. Students not meeting expectations repeated their assessment 2 weeks later. All students had a 5-month period, including summer break, without skills practice. Students were again assessed performing OVH on their model in the fall. Students' rubric scores and pass rates were compared before and after summer break. RESULTS Students scored lower on their retention test in fall (median = 43) than at the spring assessment (median = 56, P < .001). No difference was detected between lower and higher performing students. Five students (9%) did not meet expectations on their first assessment; more students (17/57, 30%) failed to meet expectations on their retention test (P = .004). CONCLUSION Students experienced a decay in the surgical skills required to perform OVH after a 5-month period without practice, regardless of the quality of their initial performance. CLINICAL SIGNIFICANCE Veterinary educators should emphasize the importance of continual practice to maintain skills and should consider assisting students in regaining skills during review sessions on models to improve surgical skill retention after a prolonged break.
Collapse
Affiliation(s)
- Julie A Hunt
- Lincoln Memorial University, College of Veterinary Medicine, Harrogate, Tennessee, USA
| | - Robert S Gilley
- Lincoln Memorial University, College of Veterinary Medicine, Harrogate, Tennessee, USA
| | - Dawn Spangler
- Lincoln Memorial University, College of Veterinary Medicine, Harrogate, Tennessee, USA
| | - Tiffany Pulliam
- Lincoln Memorial University, College of Veterinary Medicine, Harrogate, Tennessee, USA
| | - Stacy Anderson
- Lincoln Memorial University, College of Veterinary Medicine, Harrogate, Tennessee, USA
| |
Collapse
|
6
|
Abstract
Simulation has played a critical role in medicine for decades as a pedagogical and assessment tool. The labor and delivery unit provides an ideal setting for the use of simulation technology. Prior reviews of this topic have focused on simulation for individual and team training and assessment. The COVID-19 pandemic has provided an opportunity for educators and leaders in obstetric anesthesiology to rapidly train health care providers and develop new protocols for patient care with simulation. This review surveys new developments in simulation for obstetric anesthesiology with an emphasis on simulation use during the COVID-19 pandemic.
Collapse
|
7
|
General anesthesia for emergency cesarean delivery: simulation-based evaluation of residents. Braz J Anesthesiol 2021; 71:254-258. [PMID: 33940059 PMCID: PMC9373071 DOI: 10.1016/j.bjane.2021.02.059] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2020] [Revised: 02/01/2021] [Accepted: 02/12/2021] [Indexed: 11/25/2022] Open
Abstract
Introduction Decreased rates of General Anesthesia (GA) for Cesarean Section (C-section) create a learning problem for anesthesia trainees. In this context, training the management of GA for C-section using simulation techniques allows a safe environment for exposure, learning, performance improvement, and capability retention. Objective Analyze anesthesia residents’ performance regarding a simulated clinical case of GA for emergency C-section and identify specific deficits in skill acquisition. Methods Between 2015 and 2018, we evaluated the performance of 25 anesthesiology residents challenged by a simulated clinical case of GA for emergency C-section after the conclusion of the obstetric anesthesia rotation. Each resident performed the clinical case once followed by the assessment of their performance. Final scores were given according to the completion rate of 14-tasks, going from 0% to 100%. Two study groups were considered according to residency year for subsequent comparison of results (Group 1, second and third residency years and Group 2, fourth and fifth residency years). Results and discussion Mean score was 64.29% ± 13.62. Comparatively, Group 1 obtained a higher score than Group 2 (70.63% ± 14.02 vs. 60.27% ± 11.94), although with no statistically significant difference (p = 0.063). The tasks most frequently accomplished were opioid administration (100%), rapid sequence technique (100%), pre-oxygenation (92%), gastric content aspiration prophylaxis (84%), and previous clinical history (84%). Conversely, the tasks less frequently accomplished were confirming presence of pediatrician (64%), oxytocin administration (56%), PONV prophylaxis (56%), and preoperative airway assessment (48%). Conclusion The performance of the residents observed in this study was comparable to results previously published. The final score did not depend on the residency year.
Collapse
|
8
|
Gisriel C, Dalley CB, Walker A. Supplementing Pharmacologic Didactic Lectures with High Fidelity Simulation: A Pilot Study. Clin Simul Nurs 2021. [DOI: 10.1016/j.ecns.2020.10.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
9
|
Ring L, Landau R, Delgado C. The Current Role of General Anesthesia for Cesarean Delivery. CURRENT ANESTHESIOLOGY REPORTS 2021; 11:18-27. [PMID: 33642943 PMCID: PMC7902754 DOI: 10.1007/s40140-021-00437-6] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/02/2021] [Indexed: 12/20/2022]
Abstract
PURPOSE OF THE REVIEW The use of general anesthesia for cesarean delivery has declined in the last decades due to the widespread utilization of neuraxial techniques and the understanding that neuraxial anesthesia can be provided even in urgent circumstances. In fact, the role of general anesthesia for cesarean delivery has been revisited, because despite recent devices facilitating endotracheal intubation and clinical algorithms, guiding anesthesiologists facing challenging scenarios, risks, and complications of general anesthesia at the time of delivery for both mother and neonate(s) remain significant. In this review, we will discuss clinical scenarios and risk factors associated with general anesthesia for cesarean delivery and address reasons why anesthesiologists should apply strategies to minimize its use. RECENT FINDINGS Unnecessary general anesthesia for cesarean delivery is associated with maternal complications, including serious anesthesia-related complications, surgical site infection, and venous thromboembolic events. Racial and socioeconomic disparities and low-resource settings are major contributing factors in the use of general anesthesia for cesarean delivery, with both maternal and perinatal mortality increasing when general anesthesia is provided. In addition, more significant maternal pain and higher rates of postpartum depression requiring hospitalization are associated with general anesthesia for cesarean delivery. SUMMARY Rates of general anesthesia for cesarean delivery have overall decreased, and while general anesthesia no longer is a contributing factor to anesthesia-related maternal deaths, further opportunities to reduce its use should be emphasized. Raising awareness in identifying situations and patients at risk to help avoid unnecessary general anesthesia remains crucial.
Collapse
Affiliation(s)
- Laurence Ring
- Department of Anesthesiology, Columbia University Irving Medical Center, New York, NY USA
| | - Ruth Landau
- Department of Anesthesiology, Columbia University Irving Medical Center, New York, NY USA
| | - Carlos Delgado
- Department of Anesthesiology and Pain Medicine, University of Washington, Seattle, WA USA
| |
Collapse
|
10
|
E J SK, Purva M, Chander M S, Parameswari A. Impact of repeated simulation on learning curve characteristics of residents exposed to rare life threatening situations. BMJ SIMULATION & TECHNOLOGY ENHANCED LEARNING 2020; 6:351-355. [DOI: 10.1136/bmjstel-2019-000496] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 12/04/2019] [Indexed: 11/03/2022]
Abstract
BackgroundLittle is known about the learning curve characteristics of residents undertaking simulation-based education. It is important to understand the time for acquisition and decay of knowledge and skills needed to manage rare and difficult clinical situations.MethodTen anaesthesiology residents underwent simulation-based education to manage a cannot intubate cannot ventilate scenario during general anaesthesia for caesarean section. Their performance was measured using an assessment tool and debriefed by two experienced anaesthesiologists. The parameters against which the performance was judged were grouped into preoperative assessment, preoperative patient care, equipment availability, induction sequence, communication and adherence to airway algorithm protocol. The scenario was repeated at 6 and 12 months thereafter. The residents’ acquisition of knowledge, technical and non-technical skills were assessed and compared at baseline, 6 months and end of 12 months.ResultThe skills of preoperative assessment, preoperative care and communication quickly improved but the specific skill of managing a difficult airway as measured by adherence to an airway algorithm required more than 6 months (CI at 6 vs 12 months: −3.4 to –0.81, p=0.016). The skills of preoperative assessment and preoperative care improved to a higher level quickly and were retained at this improved level. Communication (CI at 0 vs 6 months: −3.78 to −0.22, p=0.045 and at 6 vs 12 months : −3.39 to −1.49, p=0.007) and difficult airway management skill were slower to improve but continued to do so over the 12 months. The compliance to machine check was more gradual and showed an improvement at 12 months.ConclusionOur study is unique in analysing the learning curve characteristics of different components of a failed obstetric airway management skill. Repeated simulations over a longer period of time help in better reinforcement, retention of knowledge, recapitulation and implementation of technical and non-technical skills.
Collapse
|
11
|
Patel S, Wali A. Airway Management of the Obstetric Patient. CURRENT ANESTHESIOLOGY REPORTS 2020. [DOI: 10.1007/s40140-020-00422-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
12
|
Ende HB, Lumbreras-Marquez MI, Farber MK, Fields KG, Tsen LC. A cluster quasi-randomized controlled trial of an interactive, monthly obstetric anesthesiology curriculum: impact on resident satisfaction and knowledge retention. Int J Obstet Anesth 2020; 45:124-129. [PMID: 33121886 DOI: 10.1016/j.ijoa.2020.09.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Revised: 08/18/2020] [Accepted: 09/06/2020] [Indexed: 11/26/2022]
Abstract
BACKGROUND Increasingly, evidence supports the use of educational paradigms that focus on teacher-learner interaction and learner engagement. We redesigned our monthly obstetric anesthesia resident didactics from a lecture-based curriculum to an interactive format including problem-based learning, case discussion, question/answer sessions, and simulation. We hypothesized that the new curriculum would improve resident satisfaction with the educational experience, satisfaction with the rotation, and knowledge retention. METHODS Fifty-three anesthesiology residents were prospectively recruited and quasi-randomized through an alternating-month pattern to attend either interactive sessions or traditional lectures. Residents completed a daily satisfaction survey about quality of teaching sessions and a comprehensive satisfaction survey at the conclusion of the rotation. Knowledge retention was assessed with a knowledge test completed on the final day. The primary outcome was daily satisfaction with the curriculum, and secondary outcomes included overall satisfaction with the curriculum, overall rotation satisfaction, and within-resident difference between pre- and post-knowledge test scores. RESULTS No differences were observed in daily resident satisfaction after interactive sessions vs traditional lectures. Furthermore, no differences were observed between the interactive sessions and traditional lecture groups in overall satisfaction with the curriculum, overall satisfaction with the entire rotation or within-resident difference between pre- and post-knowledge test scores. CONCLUSIONS Our study failed to demonstrate improvement in resident satisfaction or knowledge retention following implementation of an interactive curriculum on a month-long obstetric anesthesia rotation. Reasons may include misalignment of the intervention with measured study outcomes, lack of sensitivity of the survey tools, and inadequate training of faculty presenters.
Collapse
Affiliation(s)
- H B Ende
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA.
| | - M I Lumbreras-Marquez
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - M K Farber
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - K G Fields
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - L C Tsen
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham & Women's Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
13
|
Chan JJ, Goy RW, Ithnin F, Sng BL. Difficult obstetric airway training: Current strategies, challenges and future innovations. TRENDS IN ANAESTHESIA AND CRITICAL CARE 2020. [DOI: 10.1016/j.tacc.2019.11.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
14
|
Fleming M, McMullen M, Beesley T, Egan R, Field S. Simulation-based evaluation of anaesthesia residents: optimising resource use in a competency-based assessment framework. BMJ SIMULATION & TECHNOLOGY ENHANCED LEARNING 2019; 6:339-343. [DOI: 10.1136/bmjstel-2019-000504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/15/2019] [Indexed: 11/03/2022]
Abstract
IntroductionSimulation training in anaesthesiology bridges the gap between theory and practice by allowing trainees to engage in high-stakes clinical training without jeopardising patient safety. However, implementing simulation-based assessments within an academic programme is highly resource intensive, and the optimal number of scenarios and faculty required for accurate competency-based assessment remains to be determined. Using a generalisability study methodology, we examine the structure of simulation-based assessment in regard to the minimal number of scenarios and faculty assessors required for optimal competency-based assessments.MethodsSeventeen anaesthesiology residents each performed four simulations which were assessed by two expert raters. Generalisability analysis (G-analysis) was used to estimate the extent of variance attributable to (1) the scenarios, (2) the assessors and (3) the participants. The D-coefficient and the G-coefficient were used to determine accuracy targets and to predict the impact of adjusting the number of scenarios or faculty assessors.ResultsWe showed that multivariate G-analysis can be used to estimate the number of simulations and raters required to optimise assessment. In this study, the optimal balance was obtained when four scenarios were assessed by two simulation experts.ConclusionSimulation-based assessment is becoming an increasingly important tool for assessing the competency of medical residents in conjunction with other assessment methods. G-analysis can be used to assist in planning for optimal resource use and cost-efficacy.
Collapse
|
15
|
Abstract
Cesarean section (CS) is a common surgical procedure worldwide. The anesthesiologist is responsible, together with obstetrician and neonatologist, for safe perioperative management. A continuum of risk exists for urgent CS. The decision-to-delivery interval is an important audit tool, to ensure international standards are upheld and good outcomes for mother and neonate are achieved. Urgent CS may be performed under either GA or RA, with benefits and risks attributable to each. Specific clinical scenarios require an individualized approach to anesthesia, including hemorrhage, hypertensive disorders, cardiac disease, the difficult airway and fetal compromise. Ongoing training is integral to the provision of safe anesthesia.
Collapse
Affiliation(s)
- Nicole L Fernandes
- Department of Anaesthesia and Perioperative Medicine, University of Cape Town, Groote Schuur Hospital, D23 Groote Schuur Hospital, Anzio Road, Observatory, Cape Town 7925, South Africa
| | - Robert A Dyer
- Department of Anaesthesia and Perioperative Medicine, University of Cape Town, Groote Schuur Hospital, D23 Groote Schuur Hospital, Anzio Road, Observatory, Cape Town 7925, South Africa.
| |
Collapse
|
16
|
Ameh CA, Mdegela M, White S, van den Broek N. The effectiveness of training in emergency obstetric care: a systematic literature review. Health Policy Plan 2019; 34:257-270. [PMID: 31056670 PMCID: PMC6661541 DOI: 10.1093/heapol/czz028] [Citation(s) in RCA: 68] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/01/2019] [Indexed: 12/19/2022] Open
Abstract
Providing quality emergency obstetric care (EmOC) reduces the risk of maternal and newborn mortality and morbidity. There is evidence that over 50% of maternal health programmes that result in improving access to EmOC and reduce maternal mortality have an EmOC training component. The objective was to review the evidence for the effectiveness of training in EmOC. Eleven databases and websites were searched for publications describing EmOC training evaluations between 1997 and 2017. Effectiveness was assessed at four levels: (1) participant reaction, (2) knowledge and skills, (3) change in behaviour and clinical practice and (4) availability of EmOC and health outcomes. Weighted means for change in knowledge and skills obtained, narrative synthesis of results for other levels. One hundred and one studies including before-after studies (n = 44) and randomized controlled trials (RCTs) (n = 15). Level 1 and/or 2 was assessed in 68 studies; Level 3 in 51, Level 4 in 21 studies. Only three studies assessed effectiveness at all four levels. Weighted mean scores pre-training, and change after training were 67.0% and 10.6% for knowledge (7750 participants) and 53.1% and 29.8% for skills (6054 participants; 13 studies). There is strong evidence for improved clinical practice (adherence to protocols, resuscitation technique, communication and team work) and improved neonatal outcomes (reduced trauma after shoulder dystocia, reduced number of babies with hypothermia and hypoxia). Evidence for a reduction in the number of cases of post-partum haemorrhage, case fatality rates, stillbirths and institutional maternal mortality is less strong. Short competency-based training in EmOC results in significant improvements in healthcare provider knowledge/skills and change in clinical practice. There is emerging evidence that this results in improved health outcomes.
Collapse
Affiliation(s)
- Charles A Ameh
- Centre for Maternal and Newborn Health, Department of International Public Health, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, UK
| | - Mselenge Mdegela
- Centre for Maternal and Newborn Health, Department of International Public Health, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, UK
| | - Sarah White
- Centre for Maternal and Newborn Health, Department of International Public Health, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, UK
| | - Nynke van den Broek
- Centre for Maternal and Newborn Health, Department of International Public Health, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool, UK
| |
Collapse
|
17
|
Blanié A, Gorse S, Roulleau P, Figueiredo S, Benhamou D. Impact of learners’ role (active participant-observer or observer only) on learning outcomes during high-fidelity simulation sessions in anaesthesia: A single center, prospective and randomised study. Anaesth Crit Care Pain Med 2018; 37:417-422. [DOI: 10.1016/j.accpm.2017.11.016] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2017] [Revised: 10/23/2017] [Accepted: 11/06/2017] [Indexed: 12/28/2022]
|
18
|
Pessin YJ, Tang-Simmons J. Sonography Simulators: Use and Opportunities in CAAHEP-Accredited Programs. JOURNAL OF DIAGNOSTIC MEDICAL SONOGRAPHY 2018. [DOI: 10.1177/8756479318799347] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Concern for patient safety and increased demands on health professionals have resulted in challenges for the clinical training of sonography students. The purpose of this study was to examine simulation use in Commission on Accreditation of Allied Health Education Programs (CAAHEP)–accredited sonography programs. A prospective cross-sectional study was conducted. Program directors were sent a survey that addressed the use of simulation and the perception of simulation’s educational value. Of the 230 sonography programs identified, 137 responded, for a response rate of 60%. Of the respondents, 75% indicated they used simulation and 89% reported that it was a good teaching tool. The programs indicated that 81% recorded a positive student experience using simulation. Simulation was rated most useful for improved anatomic identification (55%) and transducer manipulation (64%). Simulation is commonly used for educational training in CAAHEP-accredited sonography programs and is perceived as a positive tool to enhance education of students. More research is needed to establish best use and educational practice.
Collapse
Affiliation(s)
- Yosefa J. Pessin
- Department of Diagnostic Medical Imaging, SUNY Downstate Medical Center, Brooklyn, NY, USA
| | - Jason Tang-Simmons
- Department of Diagnostic Medical Imaging, SUNY Downstate Medical Center, Brooklyn, NY, USA
| |
Collapse
|
19
|
Bisgaard CH, Rubak SLM, Rodt SA, Petersen JAK, Musaeus P. The effects of graduate competency-based education and mastery learning on patient care and return on investment: a narrative review of basic anesthetic procedures. BMC MEDICAL EDUCATION 2018; 18:154. [PMID: 29954376 PMCID: PMC6025802 DOI: 10.1186/s12909-018-1262-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/22/2017] [Accepted: 06/19/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND Despite the widespread implementation of competency-based education, evidence of ensuing enhanced patient care and cost-benefit remains scarce. This narrative review uses the Kirkpatrick/Phillips model to investigate the patient-related and organizational effects of graduate competency-based medical education for five basic anesthetic procedures. METHODS The MEDLINE, ERIC, CINAHL, and Embase databases were searched for papers reporting results in Kirkpatrick/Phillips levels 3-5 from graduate competency-based education for five basic anesthetic procedures. A gray literature search was conducted by reference search in Google Scholar. RESULTS In all, 38 studies were included, predominantly concerning central venous catheterization. Three studies reported significant cost-effectiveness by reducing infection rates for central venous catheterization. Furthermore, the procedural competency, retention of skills and patient care as evaluated by fewer complications improved in 20 of the reported studies. CONCLUSION Evidence suggests that competency-based education with procedural central venous catheterization courses have positive effects on patient care and are both cost-effective. However, more rigorously controlled and reproducible studies are needed. Specifically, future studies could focus on organizational effects and the possibility of transferability to other medical specialties and the broader healthcare system.
Collapse
Affiliation(s)
- Claus Hedebo Bisgaard
- Centre for Health Sciences Education, Faculty of Health, Aarhus University, Palle Juul Jensens Boulevard 82, Building B, DK-8200 Aarhus N, Denmark
| | - Sune Leisgaard Mørck Rubak
- Department of Paediatrics and Adolescent Medicine, Aarhus University Hospital, Palle Juul Jensens Boulevard 99, DK-8200 Aarhus N, Denmark
| | - Svein Aage Rodt
- Department of Anaesthesiology and Intensive Care, South Section, Aarhus University Hospital, Tage-Hansens Gade 2, 8000 Aarhus C, Denmark
| | - Jens Aage Kølsen Petersen
- Department of Anesthesiology and Intensive Care, North Section, Aarhus University Hospital, Nørrebrogade 44, 8000 Aarhus C, Denmark
| | - Peter Musaeus
- Centre for Health Sciences Education, Faculty of Health, Aarhus University, Palle Juul Jensens Boulevard 82, Building B, DK-8200 Aarhus N, Denmark
| |
Collapse
|
20
|
Abstract
PURPOSE OF REVIEW Simulation training in obstetric anesthesia has become widespread in recent years. Simulations are used to train staff and trainees, assess and improve team performance, and evaluate the work environment. This review summarizes current research in these categories. RECENT FINDINGS Simulation to improve individual technical skills has focused on induction of general anesthesia for emergent cesarean delivery, an infrequently encountered scenario by anesthesia trainees. Low- and high-fidelity simulation devices for the learning and practicing neuraxial and non-neuraxial procedures have been described, and both are equally effective. The use of checklists in obstetric emergencies has become common as and post-scenario debriefing techniques have improved. Although participant task performance improves, whether participants retain learned skills or whether simulation improves patient outcomes has not yet been established. Tools to assess teamwork during simulation have been developed, but none have been rigorously validated. In-situ vs. offsite simulations do not differ in effectiveness. SUMMARY Simulation allows for practice of tasks and teamwork in a controlled manner. There is little data whether simulation improves patient outcomes and metrics to predict the long-term retention of skills by simulation participants have not been developed.
Collapse
|
21
|
|
22
|
Chima AM, Koka R, Lee B, Tran T, Ogbuagu OU, Nelson-Williams H, Rosen M, Koroma M, Sampson JB. Medical Simulation as a Vital Adjunct to Identifying Clinical Life-Threatening Gaps in Austere Environments. J Natl Med Assoc 2018; 110:117-123. [PMID: 29580444 DOI: 10.1016/j.jnma.2017.12.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2017] [Revised: 12/13/2017] [Accepted: 12/20/2017] [Indexed: 11/18/2022]
Abstract
BACKGROUND Maternal mortality and morbidity are major causes of death in low-resource countries, especially those in Sub-Saharan Africa. Healthcare workforce scarcities present in these locations result in poor perioperative care access and quality. These scarcities also limit the capacity for progressive development and enhancement of workforce training, and skills through continuing medical education. Newly available low-cost, in-situ simulation systems make it possible for a small cadre of trainers to use simulation to identify areas needing improvement and to rehearse best practice approaches, relevant to the context of target environments. METHODS Nurse anesthetists were recruited throughout Sierra Leone to participate in simulation-based obstetric anesthesia scenarios at the country's national referral maternity hospital. All subjects participated in a detailed computer assisted training program to familiarize themselves with the Universal Anesthesia Machine (UAM). An expert panel rated the morbidity/mortality risk of pre-identified critical incidents within the scenario via the Delphi process. Participant responses to critical incidents were observed during these scenarios. Participants had an obstetric anesthesia pretest and post-test as well as debrief sessions focused on reviewing the significance of critical incident responses observed during the scenario. RESULTS 21 nurse anesthetists, (20% of anesthesia providers nationally) participated. Median age was 41 years and median experience practicing anesthesia was 3.5 years. Most participants (57.1%) were female, two-thirds (66.7%) performed obstetrics anesthesia daily but 57.1% had no experience using the UAM. During the simulation, participants were observed and assessed on critical incident responses for case preparation with a median score of 7 out of 13 points, anesthesia management with a median score of 10 out of 20 points and rapid sequence intubation with a median score of 3 out of 10 points. CONCLUSION This study identified substantial risks to patient care and provides evidence to support the feasibility and value of in-situ simulation-based performance assessment for identifying critical gaps in safe anesthesia care in the low-resource settings. Further investigations may validate the impact and sustainability of simulation based training on skills transfer and retention among anesthesia providers low resource environments.
Collapse
Affiliation(s)
- Adaora M Chima
- Department of Anesthesiology and Perioperative Medicine, University of Rochester School of Medicine, Rochester, NY, USA
| | - Rahul Koka
- Anesthesiology and Critical Care Medicine-Global Alliance of Perioperative Professionals, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Benjamin Lee
- Department of Anesthesiology, Texas Children's Hospital, Houston, TX, USA
| | - Tina Tran
- Anesthesiology and Critical Care Medicine-Global Alliance of Perioperative Professionals, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Onyebuchi U Ogbuagu
- Department of General Surgery, University of Maryland, School of Medicine, Baltimore, MD, USA
| | - Howard Nelson-Williams
- Anesthesiology and Critical Care Medicine-Global Alliance of Perioperative Professionals, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Michael Rosen
- Anesthesiology and Critical Care Medicine-Global Alliance of Perioperative Professionals, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Michael Koroma
- Department of Anaesthesiology, Princess Christian Maternity Hospital, Freetown, Sierra Leone
| | - John B Sampson
- Anesthesiology and Critical Care Medicine-Global Alliance of Perioperative Professionals, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
23
|
Abstract
Simulation-based surgical skills training has become essential in orthopaedic practice because of concerns about patient safety and an increase in technically challenging procedures. Surgical skills training in specifically designed simulation laboratories allows practice of procedures in a risk-free environment before they are performed in the operating room. The transferability of acquired skills to performance with patients is the most effective measure of the predictive validity of simulation-based training. Retention of the skills transferred to clinical situations is also critical. However, evidence of simulation-based skill retention in the orthopaedic literature is limited, and concerns about sustainability exist. Solutions for skill decay include repeated practice of the tasks learned on simulators and reinforcement of areas that are sensitive to decline. Further research is required to determine the retention rates of surgical skills acquired in simulation-based training as well as the success of proposed solutions for skill decay.
Collapse
|
24
|
|
25
|
Improving Patient Safety through Simulation Training in Anesthesiology: Where Are We? Anesthesiol Res Pract 2016; 2016:4237523. [PMID: 26949389 PMCID: PMC4753320 DOI: 10.1155/2016/4237523] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2015] [Revised: 12/28/2015] [Accepted: 01/03/2016] [Indexed: 12/21/2022] Open
Abstract
There have been colossal technological advances in the use of simulation in anesthesiology in the past 2 decades. Over the years, the use of simulation has gone from low fidelity to high fidelity models that mimic human responses in a startlingly realistic manner, extremely life-like mannequin that breathes, generates E.K.G, and has pulses, heart sounds, and an airway that can be programmed for different degrees of obstruction. Simulation in anesthesiology is no longer a research fascination but an integral part of resident education and one of ACGME requirements for resident graduation. Simulation training has been objectively shown to increase the skill-set of anesthesiologists. Anesthesiology is leading the movement in patient safety. It is rational to assume a relationship between simulation training and patient safety. Nevertheless there has not been a demonstrable improvement in patient outcomes with simulation training. Larger prospective studies that evaluate the improvement in patient outcomes are needed to justify the integration of simulation training in resident education but ample number of studies in the past 5 years do show a definite benefit of using simulation in anesthesiology training. This paper gives a brief overview of the history and evolution of use of simulation in anesthesiology and highlights some of the more recent studies that have advanced simulation-based training.
Collapse
|