Simulation-based Remediation in Emergency Medicine Residency Training: A Consensus Study

Remediation in clinical practice for student nurses - A scoping review

BACKGROUND

Clinical practice provides an opportunity for undergraduate nursing students to develop the professional attitudes, knowledge and skills required for the delivery of safe competent care. Some students, however, are challenged to consolidate learning in clinical practice and are therefore at risk of failing courses or programmes. Supporting these students requires remediation strategies specific to clinical practice. This is challenging, however, as remediation approaches frequently centre on supporting students in theoretical components of courses/programmes, rather than clinical practice.

OBJECTIVES

A scoping review was conducted to explore and summarise literature in undergraduate nurse education related to remediation support for clinical practice.

METHODS

The research question was developed using the Population/Concept/Context model. Following the identification of keywords, five databases (CINHAL Plus, MEDLINE, ProQuest, Scopus and Informit) were searched. Abstracts and full-text articles were independently screened by two authors. Data from included studies was extracted and then thematically analysed.

RESULTS

Twenty papers met inclusion/exclusion criteria (five literature reviews, one concept analysis, six commentary papers and eight original research studies). Research studies used qualitative, quantitative, or mixed methods research designs. Populations included nurse academics, mentors/preceptors, health professional students (including nursing students) and nursing students exclusively. Three themes were identified: pre-placement remediation strategies; on-placement remediation strategies and post-placement remediation strategies. All authors highlighted the importance of remediation for at-risk students in clinical practice.

CONCLUSIONS

This review identified several remediation strategies that may support undergraduate nursing students in clinical practice. Few, however, were well-defined or rigorously evaluated, highlighting the need for additional research on nursing student remediation in clinical practice. A partnership-based approach to remediation that engages students, educators, and healthcare providers and is underpinned by clear processes may be of further benefit to nursing students in clinical practice.

Interventions for undergraduate and postgraduate medical learners with academic difficulties: A BEME systematic review update: BEME Guide No. 85

BACKGROUND

Clinical teachers often struggle to record trainee underperformance due to lacking evidence-based remediation options.

OBJECTIVES

To provide updated evidence-based recommendations for addressing academic difficulties among undergraduate and postgraduate medical learners.

METHODS

A systematic review searched databases including MEDLINE, CINAHL, EMBASE, ERIC, Education Source, and PsycINFO (2016-2021), replicating the original Best Evidence Medical Education 56 review strategy. Original research/innovation reports describing intervention(s) for medical learners with academic difficulties were included. Data extraction used Michie's Behaviour Change Techniques (BCT) Taxonomy and program evaluation models from Stufflebeam and Kirkpatrick. Quality appraised used the Mixed Methods Appraisal Tool (MMAT). Authors synthesized extracted evidence by adapting GRADE approach to formulate recommendations.

RESULTS

Eighteen articles met the inclusion criteria, primarily addressing knowledge (66.7%), skills (66.7%), attitudinal problems (50%) and learner's personal challenges (27.8%). Feedback and monitoring was the most frequently employed BCT. Study quality varied (MMAT 0-100%). We identified nineteen interventions (UG: n = 9, PG: n = 12), introducing twelve new thematic content. Newly thematic content addressed contemporary learning challenges such as academic procrastination, and use of technology-enhanced learning resources. Combined with previous interventions, the review offers a total dataset of 121 interventions.

CONCLUSION

This review offers additional evidence-based interventions for learners with academic difficulties, supporting teaching, learning, faculty development, and research efforts.

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Medical simulations have led to extensive developments in emergency medicine. Apart from the growing number of applications and research efforts in patient safety, few studies have focused on modalities, research methods, and professions via a synthesis of simulation studies with a focus on non-technical skills training. Intersections between medical simulation, non-technical skills training, and emergency medicine merit a synthesis of progress over the first two decades of the 21st century. Drawing on research from the Web of Science Core Collection's Science Citation Index Expanded and Social Science Citation Index editions, results showed that medical simulations were found to be effective, practical, and highly motivating. More importantly, simulation-based education should be a teaching approach, and many simulations are utilised to substitute high-risk, rare, and complex circumstances in technical or situational simulations. (1) Publications were grouped by specific categories of non-technical skills, teamwork, communication, diagnosis, resuscitation, airway management, anaesthesia, simulation, and medical education. (2) Although mixed-method and quantitative approaches were prominent during the time period, further exploration of qualitative data would greatly contribute to the interpretation of experience. (3) High-fidelity dummy was the most suitable instrument, but the tendency of simulators without explicitly stating the vendor selection calls for a standardised training process. The literature study concludes with a ring model as the integrated framework of presently known best practices and a broad range of underexplored research areas to be investigated in detail.

Differences in faculty feedback for high, expected, and below-expected clinically performing emergency medicine residents

Objectives

A lifelong pursuit such as medicine is frequently paired with a framework of "deliberate practice" for improvement. It is unclear whether the quality of feedback varies across different learner levels. Our study aims to assess whether a difference exists in the quality of feedback delivered to high-, expected-, and below-expected performer emergency medicine (EM) residents based on their attending-identified performance level.

Methods

We conducted a retrospective review of written EM resident feedback collected between November 2018 and March 2021. Clinical performance level was subjectively determined by attending faculty in their feedback. Feedback was coded on a scale from 0-5 based on the presence (1) or absence (0) of the items modified from the Ende's SMART criteria: Specific (S), Measurable (M), Achievable (A), Relevant (R), and Time-bound (T). The primary outcome was any total modified SMART criteria score difference concerning performance level using logistic regression with Generalized Estimating Equations (GEE). Secondary outcomes were differences for individual criteria.

Results

We analyzed 1284 evaluations (311 high performers, 930 expected performers, and 43 below-expected performers) of 94 unique residents from 66 different evaluators. Mean total modified SMART scores were significantly higher in high and below-expected performers than those designated as expected performers by faculty evaluators. Achievable and Relevant written feedback was provided to high performers in a significantly larger proportion than expected and below-expected performers. Only 278 out of 1284 evaluations met criteria for Specific.

Conclusions

Mean total modified SMART feedback scores were significantly greater in high performers and below-expected performers when compared to expected performers. Achievable and Relevant feedback was provided in greater proportions to high performer residents compared to expected and below-expected performers. These findings are a challenge to academic faculty to engage in quality feedback delivery for residents at all performance levels.

Specialists' approach to tracheal collapse: survey-based opinions on diagnostics, medical management, and comorbid diseases

OBJECTIVE

To describe the current standard of care among specialists for the routine diagnostic evaluation and medical management of stable tracheal collapse in dogs, identifying gaps between practice and scientific evidence to facilitate the development of future prospective studies. A secondary objective was to describe the perceived incidence of selected comorbid disorders in dogs with tracheal collapse and the diagnostic tests performed to evaluate for those disorders.

SAMPLE

180 veterinary specialists in 22 countries.

PROCEDURES

An electronic survey was sent to 4 specialty listservs to target diplomates. Respondents completed multiple-choice and free-response questions related to the diagnostic evaluation and treatment of a theoretical stable dog with suspected tracheal collapse.

RESULTS

Most respondents routinely utilized radiography, tracheobronchoscopy, and fluoroscopy to diagnose tracheal collapse and performed airway sampling, sedated airway examination, and echocardiograms to rule out comorbidities. The most frequently perceived comorbid disorders included chronic bronchitis, bronchomalacia, and myxomatous mitral valve disease. Respondents most often prescribed opioid antitussives, glucocorticoids, anxiolytics, and antibiotics as treatments. Less frequently, they utilized bronchodilators and nonopioid medications for cough.

CLINICAL RELEVANCE

Despite a lack of published guidelines, specialists have similar approaches in their diagnostic and therapeutic approach to a stable dog with suspected tracheal collapse and believe evaluating for comorbid disorders is important. A description of a typical diagnostic approach and knowledge of realistic treatment goals will assist the general practitioner managing dogs with stable tracheal collapse. Additionally, gaps between current practices established via this survey and data supporting those practices exist, specifically concerning the use of antibiotics and nonopioid medications for cough, representing areas for further study.

French national survey on simulation-based neonatology education of pediatric residents

The French Society of Neonatology (SFN) conducted a national questionnaire survey on the simulation-based education neonatal curriculum for pediatric residents. The response rate was 93% for the pediatric curriculum coordinators and 97% for the neonatal intensive care unit medical directors and neonatal transport teams. The average hourly volume during the curriculum was 21 ± 17 h. Overall, 89% of regional pediatric curricula offered at least one simulation session. Each simulation program involved newborn resuscitation in the delivery room but often lacked a formalized program. Additionally, half of the neonatology departments provided simulation-based education. Simulation education is now common for training pediatric residents in neonatology in France but it is heterogeneous in the French territory.

Strangers in a strange land: The experience of physicians undergoing remediation

INTRODUCTION

The experience of remediation in practising physicians has not been widely studied. Remediatees frequently present negative emotions, but observers can only infer the underlying reasons behind these. Understanding remediatees' perspectives may help those mandating and organising remediation to structure the process in ways that improve the experience for all concerned parties and maximise chances of a successful outcome for remediatees.

METHODS

Seventeen physicians who had undergone remediation for clinical competence concerns were interviewed via telephone. Participant data were first iteratively analysed thematically and then reanalysed using a narrative mode of analysis for each participant in order to understand the stories as wholes. Figured worlds (FW) theory was used as a lens for analysing the data for this constructivist research study.

RESULTS

Participants entering the FW of remediation perceived that their position as a 'good doctor' was threatened. Lacking experience with this world and with little available support to help them navigate it, participants used their agency to draw on various discursive threads within the FW to construct a narrative account of their remediation. In their narratives, participants tended to position themselves either as victims of regulatory bodies or as resilient individuals who could make the best of a difficult situation. In both cases, the chosen discursive threads enabled them to maintain their self-identity as 'good doctor'.

CONCLUSION

Remediation poses a threat to a physician's professional and personal identity. Focusing mainly on the educational aspect of remediation-that is, the improvement in knowledge and skills-risks missing its impact on physician identity. We need to ensure not only that we support physicians in dealing with this identity threat but that our assessment and remediation processes do not inadvertently encourage remediatees to draw on discursive threads that lead them to see themselves as victims.

Post graduate remediation programs in medicine: a scoping review

BACKGROUND

Recognizing that physicians may struggle to achieve knowledge, skills, attitudes and or conduct at one or more stages during their training has highlighted the importance of the 'deliberate practice of improving performance through practising beyond one's comfort level under guidance'. However, variations in physician, program, contextual and healthcare and educational systems complicate efforts to create a consistent approach to remediation. Balancing the inevitable disparities in approaches and settings with the need for continuity and effective oversight of the remediation process, as well as the context and population specific nature of remediation, this review will scrutinise the remediation of physicians in training to better guide the design, structuring and oversight of new remediation programs.

METHODS

Krishna's Systematic Evidence Based Approach is adopted to guide this Systematic Scoping Review (SSR in SEBA) to enhance the transparency and reproducibility of this review. A structured search for articles on remediation programs for licenced physicians who have completed their pre-registration postings and who are in training positions published between 1st January 1990 and 31st December 2021 in PubMed, Scopus, ERIC, Google Scholar, PsycINFO, ASSIA, HMIC, DARE and Web of Science databases was carried out. The included articles were concurrently thematically and content analysed using SEBA's Split Approach. Similarities in the identified themes and categories were combined in the Jigsaw Perspective and compared with the tabulated summaries of included articles in the Funnelling Process to create the domains that will guide discussions.

RESULTS

The research team retrieved 5512 abstracts, reviewed 304 full-text articles and included 101 articles. The domains identified were characteristics, indications, frameworks, domains, enablers and barriers and unique features of remediation in licenced physicians in training programs.

CONCLUSION

Building upon our findings and guided by Hauer et al. approach to remediation and Taylor and Hamdy's Multi-theories Model, we proffer a theoretically grounded 7-stage evidence-based remediation framework to enhance understanding of remediation in licenced physicians in training programs. We believe this framework can guide program design and reframe remediation's role as an integral part of training programs and a source of support and professional, academic, research, interprofessional and personal development.

Characterization of Clinical Skills Remediation: A National Survey of Medical Schools

OBJECTIVES

Clinical skills instruction is a standard part of medical school curricula, but how institutions address learners who struggle in this area is less clear. Although recommendations for the remediation of clinical skills at an institutional level have been published, how these recommendations are being implemented on a national scale is unknown. In this descriptive study, we characterize current clinical skills remediation practices at US medical schools and US-accredited Caribbean medical schools.

METHODS

We conducted a cross-sectional survey of medical educators who work with struggling students. From March 24, 2020 to April 9, 2020, the Directors of Clinical Skills Remediation Working Group conducted an e-mail survey incorporating four aspects of remediation program design and function: identification, assessment, active remediation, and ongoing evaluation.

RESULTS

In total, 92 individuals representing 45 institutions provided descriptive information about their respective remediation programs. The majority of respondents have a formal process of identifying (75%) and assessing (86%) students who are identified as struggling with clinical skills, but lack a standardized method of categorizing deficits. Fewer institutions have a standardized approach to active remediation and ongoing evaluation of struggling learners. Fifty-two percent of institutions provide training to faculty involved in the remediation process.

CONCLUSIONS

Although most institutions are able to identify struggling students, they lack a standardized approach to intervene. Remediation effectiveness is limited by a lack of student buy-in and institutional time, expertise, and resources. These findings highlight the need for more formalized structure and standardization in remediation program design and implementation.

The feasibility of simulation-based high-stakes assessment in emergency medicine settings: A scoping review

Using simulation in high-stakes assessments has been evolving as a method to improve the assessment process. There is a concurrent need to address challenges and establish best practices to ensure the best quality when implementing high-stakes evaluations. The aim of this study is to provide an insight for stakeholders about using multiple modalities of simulation in high-stakes evaluations by presenting challenges, best practices, and future directions described in the relevant literature. A scoping review of original studies (from the year 1994-2021) including the use of common modalities (standardized patients, high-fidelity mannequins, part-task trainers, virtual simulation, and hybrid simulation) was conducted. The search covered the common databases: PubMed, Education Resource Information Center, Cumulative Index to Nursing and Allied Health Literature, and the Cochrane library. Initial screening in the databases resulted in 111,253 articles. After the application of a refining search strategy, 47 articles were included for comprehensive evaluation. Most articles were about credentialing/licensure purposes of assessment. Many articles were specialty-specific, especially focusing on anesthesia. Most challenges described were related to the validity of the assessment that should be considered in the planning phase. Best practices were mostly related to planning for measures to assure the validity of the assessment tools and process. The use of multimodality simulation for high-stakes assessment is growing despite challenges; this growth is associated with the accumulation of experience shared in literature. This growth will help to improve planning, practices, and goals achievement from such an application.

Ethical Development of Digital Phenotyping Tools for Mental Health Applications: Delphi Study

BACKGROUND

Digital phenotyping (also known as personal sensing, intelligent sensing, or body computing) involves the collection of biometric and personal data in situ from digital devices, such as smartphones, wearables, or social media, to measure behavior or other health indicators. The collected data are analyzed to generate moment-by-moment quantification of a person's mental state and potentially predict future mental states. Digital phenotyping projects incorporate data from multiple sources, such as electronic health records, biometric scans, or genetic testing. As digital phenotyping tools can be used to study and predict behavior, they are of increasing interest for a range of consumer, government, and health care applications. In clinical care, digital phenotyping is expected to improve mental health diagnoses and treatment. At the same time, mental health applications of digital phenotyping present significant areas of ethical concern, particularly in terms of privacy and data protection, consent, bias, and accountability.

OBJECTIVE

This study aims to develop consensus statements regarding key areas of ethical guidance for mental health applications of digital phenotyping in the United States.

METHODS

We used a modified Delphi technique to identify the emerging ethical challenges posed by digital phenotyping for mental health applications and to formulate guidance for addressing these challenges. Experts in digital phenotyping, data science, mental health, law, and ethics participated as panelists in the study. The panel arrived at consensus recommendations through an iterative process involving interviews and surveys. The panelists focused primarily on clinical applications for digital phenotyping for mental health but also included recommendations regarding transparency and data protection to address potential areas of misuse of digital phenotyping data outside of the health care domain.

RESULTS

The findings of this study showed strong agreement related to these ethical issues in the development of mental health applications of digital phenotyping: privacy, transparency, consent, accountability, and fairness. Consensus regarding the recommendation statements was strongest when the guidance was stated broadly enough to accommodate a range of potential applications. The privacy and data protection issues that the Delphi participants found particularly critical to address related to the perceived inadequacies of current regulations and frameworks for protecting sensitive personal information and the potential for sale and analysis of personal data outside of health systems.

CONCLUSIONS

The Delphi study found agreement on a number of ethical issues to prioritize in the development of digital phenotyping for mental health applications. The Delphi consensus statements identified general recommendations and principles regarding the ethical application of digital phenotyping to mental health. As digital phenotyping for mental health is implemented in clinical care, there remains a need for empirical research and consultation with relevant stakeholders to further understand and address relevant ethical issues.