Pediatric Critical Care Medicine Fellowship Simulation Use Survey

Pediatric Critical Care Fellow Perception of Learning through Virtual Reality Bronchoscopy

Background

Virtual reality (VR) simulators have revolutionized training in bronchoscopy, offering unrestricted availability in a low-stakes learning environment and frequent assessments represented by automatic scoring. The VR assessments can be used to monitor and support learners' progression. How trainees perceive these assessments needs to be clarified.

Objective

The objective of this study was to examine what assessments learners select to document and receive feedback on and what influences their decisions.

Methods

We used a sequential explanatory mixed methods strategy. All participants were pediatric critical care medicine trainees requiring competency in bronchoscopy skills. During independent simulation practice, we collected the number of learning-focused practice attempts (scores not recorded), assessment-focused practice (scores recorded and reviewed by the instructor for feedback), and the amount of time each attempt lasted. After simulation training, we conducted interviews to explore learners' perceptions of assessment.

Results

There was no significant difference in the number of attempts for each practice type. The average time per learning-focused attempt was almost three times longer than the assessment-focused attempt (mean [standard deviation] 16 ± 1 min vs. 6 ± 3 min, respectively; P < 0.05). Learners perceived documentation of their scores as high stakes and only recorded their better scores. Learners felt safer experimenting if their assessments were not recorded.

Conclusion

During independent practice, learners took advantage of automatic assessments generated by the VR simulator to monitor their progression. However, the recording of scores from the simulation program to document learners' trajectory to a set goal was perceived as high stakes, discouraging learners from seeking supervisor feedback.

Process evaluation of paediatric fellowship training programs at a University Hospital in Pakistan

BACKGROUND

Fellowship programs offer training in a subspecialty focusing on distinct and advanced clinical/academic skills. This advanced postgraduate training allows physicians, who desire a more specialized practice, to further develop clinical, academic, research, and leadership/administrative skills. The Aga Khan University (AKU) is one of the few institutes offering paediatric sub-specialty training in Pakistan. We aimed to evaluate the current Paediatric fellowship programs at AKU.

METHODS

Process evaluation of six paediatric fellowship programs (cardiology, neurology, endocrinology, critical care medicine, neonatology, and infectious disease) was conducted from September 2020 to April 2021 by senior clinicians and medical educationists. Evidence was collected through document review (using existing postgraduate medical education program information form), observation of teaching and learning support, and focused group discussions/interviews with program faculty and fellows were conducted. A review of the evaluation report was done as part of this study. This study received an exemption from the ethical review committee. The quantitative data were analyzed using SPSS (22.0) while the reports of discussion with fellows and friends underwent content analysis.

RESULTS

All fellowship programs met the criteria for having a robust competency-based fellowship curriculum as per the institutional and national guidelines. Formative assessment in the form of continuous evaluation was found to be integrated into all the fellowship programs, however, most of the programs were found to lack a summative assessment plan. Fellows in training and program faculty were satisfied with the opportunities for mentorship, teaching, and learning. Thematic analysis of the discussion reports with faculty and fellows revealed three key themes including, program aspects translating into strengthening the training, gaps in the training program in delivering the expectations, and making ways to reach par excellence.

CONCLUSIONS

The process evaluation of paediatric fellowship programs provided an opportunity to holistically review the current strengths and quality of the training in individual programs along with the unmet needs of the trainees. This will help the program stakeholders to prioritize, align and allocate the resources to further enhance the quality of training and outcome of individual fellowship programs to ensure wider impacts at a regional, national, and international health system level.

Taking the Pulse of the Current State of Simulation

Simulation in health-care professions has grown in the last few decades. We provide an overview of the history of simulation in other fields, the trajectory of simulation in health professions education, and research in medical education, including the learning theories and tools to assess and evaluate simulation programs. We also propose future directions for simulation and research in health professions education.

Simulation-Based Outreach Program Improves Rural Hospitals’ Team Confidence in Neonatal Resuscitation

Introduction: Neonatal resuscitation is a high acuity, low occurrence event (HALO), and in rural community hospitals, low birth rates prevent providers from regular opportunities to maintain essential resuscitation skills. Simulation is an effective training modality for medical education, although resources for simulation are often limited in rural hospitals. Our primary objective was to test the hypothesis that in situ neonatal resuscitation simulation training improves rural hospitals' delivery room team confidence in performing key Neonatal Resuscitation Program^® (NRP^®) skills. Our secondary objective was to compare confidence to performance as measured by adherence to NRP® guidelines.

Methods: We conducted a quasi-experimental pre-training survey and post-training survey of delivery room team confidence in NRP^® skills at five level one delivery hospitals before and after an in situ simulation training program. Participants included rural hospitals’ usual delivery room team members. Participants rated their confidence on a five-point Likert scale. Simulations were analyzed using an adapted version of a validated scoring tool for NRP^® adherence and presented as overall percentage scores.

Results: Our data demonstrate a significant improvement in self-assessed confidence levels pre- and post-simulation training in key areas of neonatal resuscitation. Participants reported higher confidence in airway management (4 vs. 3, p=0.003), emergency intravenous access (3 vs. 2, p=0.007), and the ability to manage a code in the delivery room (4 vs. 3, p=0.013) and the operating room (4 vs. 3, p=0.028). Improvements were also noted in their team member’s knowledge and skills to perform neonatal resuscitation. While improvements were appreciated in confidence, the performance of skills (NRP^® adherence scores) was often in the sub-optimal performance range.

Conclusions: An in situ-based neonatal resuscitation outreach simulation program improves self-confidence among rural delivery room teams. Additional research is needed to understand how to translate improved confidence into actual improved performance. 

Education in the Pediatric Intensive Care Unit

This article addresses the latest data and ideas related to education in the pediatric intensive care unit, including traditional education methods with newer and technology-based methods. A review of adult learning theory is included with discussions regarding medical decision making and error prevention, bedside teaching, medical simulation, and electronic methods of education.

Declining Procedures in Pediatric Critical Care Medicine Using a National Database

Supplemental Digital Content is available in the text.

Objectives:

To investigate the change in rate of invasive procedures (endotracheal intubation, central venous catheters, arterial catheters, and peripheral inserted central venous catheters) performed in PICUs per admission over time. Secondarily, to investigate the change in type of respiratory support over time.

Design:

Retrospective study of prospectively collected data using the Virtual Pediatric Systems (VPS; LLC, Los Angeles, CA) database.

Setting:

North American PICUs.

Patients:

Patients admitted from January 2009 to December 2017.

Interventions:

None.

Measurements and Main Results:

There were 902,624 admissions from 161 PICUs included in the analysis. Since 2009, there has been a decrease in rate of endotracheal intubations, central venous catheters placed, and arterial catheters placed and an increase in the rate of peripheral inserted central venous catheter insertion per admission over time after controlling for severity of illness and unit level effects. As compared to 2009, the incident rate ratio for 2017 for endotracheal intubation was 0.90 (95% CI, 0.83–0.98; p = 0.017), for central venous line placement 0.69 (0.63–0.74; p < 0.001), for arterial catheter insertion 0.85 (0.79–0.92; p < 0.001), and for peripheral inserted central venous catheter placement 1.14 (1.03–1.26; p = 0.013). Over this time period, in a subgroup with available data, there was a decrease in the rate of invasive mechanical ventilation and an increase in the rate of noninvasive respiratory support (bilevel positive airway pressure/continuous positive airway pressure and high-flow nasal oxygen) per admission.

Conclusions:

Over 9 years across multiple North American PICUs, the rate of endotracheal intubations, central catheter, and arterial catheter insertions per admission has decreased. The use of invasive mechanical ventilation has decreased with an increase in noninvasive respiratory support. These data support efforts to improve exposure to invasive procedures in training and structured systems to evaluate continued competency.