Cognitive load predicts point-of-care ultrasound simulator performance

Predicting and Explaining Cognitive Load, Attention, and Working Memory in Virtual Multitasking

As VR technology advances, the demand for multitasking within virtual environments escalates. Negotiating multiple tasks within the immersive virtual setting presents cognitive challenges, where users experience difficulty executing multiple concurrent tasks. This phenomenon highlights the importance of cognitive functions like attention and working memory, which are vital for navigating intricate virtual environments effectively. In addition to attention and working memory, assessing the extent of physical and mental strain induced by the virtual environment and the concurrent tasks performed by the participant is key. While previous research has focused on investigating factors influencing attention and working memory in virtual reality, more comprehensive approaches addressing the prediction of physical and mental strain alongside these cognitive aspects remain. This gap inspired our investigation, where we utilized an open dataset - VRWalking, which included eye and head tracking and physiological measures like heart rate(HR) and galvanic skin response(GSR). The VRwalking dataset has timestamped labeled data for physical and mental load, working memory, and attention metrics. In our investigation, we employed straightforward deep learning models to predict these labels, achieving noteworthy performance with 91%, 96%, 93%, and 91% accuracy in predicting physical load, mental load, working memory, and attention, respectively. Additionally, we conducted SHAP (SHapley Additive exPlanations) analysis to identify the most critical features driving these predictions. Our findings contribute to understanding the overall cognitive state of a participant and effective data collection practices for future researchers, as well as provide insights for virtual reality developers. Developers can utilize these predictive approaches to adaptively optimize user experience in real-time and minimize cognitive strain, ultimately enhancing the effectiveness and usability of virtual reality applications.

Experienced cognitive load in the emergency department. A prospective study

BACKGROUND AND IMPORTANCE

The emergency department (ED) is a hectic place, where many critically ill patients are treated. For residents working in the ED, this environment may be demanding.

OBJECTIVES

The aim of this study was to investigate the [1] cognitive load experienced by residents working in the ED, and [2] differences in cognitive load during the day.

METHODS

In this multicentre, prospective study in three EDs in the Netherlands, the experienced cognitive load was graded by residents on three scales, agreed upon during Delphi meetings: the complexity (low-high: 1-3), mental effort (low-high: 1-9) and comfortability scale (low-high: 0-100%). We applied the scores per decision, 1-hour and 2-hour intervals, patient and shift.

MAIN RESULTS

We observed 14 residents and analysed 74 1-hour and 45 2-hour intervals, 79 patients, 24 shifts and 592 separate decisions. The experienced cognitive load per decision was low. In contrast, the cognitive load was higher per 2-hour interval (mental effort: median 4.0 (IQR 4.0) and comfortability 80% (IQR 20)) and per shift (mental effort: median 5.5 (IQR 4.0) and comfortability 80% (IQR 20). Complexity was low for all measurements. Mental effort rose from 17h onwards higher values, whereas a decrease in comfortability was seen from 21h onwards.

CONCLUSION

From 17h onwards, residents working in the ED experienced rather high mental effort and reported feeling not optimally comfortable when making decisions. The mental effort was highest between 21-23h. This was found when cognitive load was measured per 2-hour interval and per shift, but not per decision. This study may provide an insights to optimise cognitive load by reorganisation of the ED.

Self-assessment and learning motivation in emergency point-of-care ultrasound: an online pilot investigation in German physicians

INTRODUCTION

Learning motivation is essential to obtain and maintain ultrasound competencies in emergency medicine. One's competencies herein and the need for ongoing training are best evaluated by self-assessment. This may be flawed by overconfidence effects - the belief to be better than others or better than tests reveal. This study aims to clarify the underinvestigated interaction of learning motivation and self-assessment in emergency point-of-care-ultrasound (POCUS).

METHODS

In this cross-sectional multicenter project, physicians assessed their own and others' competence and learning motivation using the Situational Motivation Scale comprising intrinsic motivation, external and identified regulation, and amotivation. In addition, we presented eight ultrasound loops of different pathologies to emergency physicians of various specialties.

RESULTS

Overall, the motivation to learn was high, while self-assessment showed no significant overconfidence in POCUS. The rate of correct diagnoses based on the loops was relatively low. As a result, we did not detect overconfidence effects in participants who completed questions (n = 86) and tests (n = 56). Overplacing oneself above peers negatively correlated with intrinsic learning motivation and identified regulation and positively correlated to amotivation. Further analyses indicated that learning motivation was associated with the interactions of the physicians' risk perception, speciality, and self-assessment.

DISCUSSION

The absence of overconfidence effects, the complexity of learning motivation and their interaction show that prior findings in other contexts may not be easily transferable to POCUS and could be highly context-sensitive. In conclusion, this study highlights high levels of learning motivation but relatively low diagnostic accuracy in POCUS, which suggests the need for ongoing education and assessment. Ensuring that physicians continue to receive objective feedback and opportunities to refine their skills is critical for maintaining high standards of care. Despite the small sample size and other limitations of the study, the results primarily served to generate hypotheses for future research on emergency ultrasound education.

How to enhance the novices' learning in ultrasound-guided procedures utilizing handmade phantoms?

INTRODUCTION

This prospective study aims to evaluate the learning effect of US-guided thoracocentesis and pericardiocentesis in novices through simulation training using handmade phantoms.

METHODS

The novices included undergraduate-year (UGY) students and first postgraduate-year (PGY-1) residents. Handmade phantoms were utilized for training and immediate assessment. Novices were re-evaluated using high-fidelity phantoms three months after training, while experienced PGY-3 emergency medicine residents were recruited and evaluated with high-fidelity phantoms simultaneously. Data on their performance, puncture time, and number of attempts were collected.

RESULTS

Thirty-six novices (18 PGY-1 and 18 UGYs) and 12 PGY-3 emergency medicine residents were recruited. Alongside clinical observation, novices demonstrated improved skill retention and performance at the 3-month assessment compared to the immediate assessment [5 (4-5) vs. 3.5 (3-4), p = 0.0005] in thoracocentesis, achieving a comparable level of proficiency with the PGY-3 emergency medicine residents [5 (4-5) vs. 5 (5), p = 0.105]. Without clinical observation, novices exhibited a decline in skill proficiency in pericardiocentesis at the 3-month assessment [3 (3-4) vs. 4 (4-4.5), p = 0.015]. The puncture time was comparable between novices and PGY-3 emergency medicine residents for both thoracocentesis and pericardiocentesis. However, novices required a greater number of puncture attempts for pericardiocentesis.

CONCLUSIONS

Novices showed superior performance in thoracocentesis but experienced skill decay in pericardiocentesis at the 3-month assessment following training with handmade phantoms. This decline may be attributed to the very low frequency of pericardiocentesis cases encountered by novices after training, as well as the higher-stakes nature of the procedure. Further investigation is needed to evaluate the long-term effects of training, skill retention, and transfer of skills to actual patient care. Additionally, research should focus on determining optimal retraining intervals for pericardiocentesis and evaluating the use of standardized pericardiocentesis videos as an alternative to clinical observation.

TRIAL REGISTRATION

Registered at ClinicalTrials.gov (NCT04792203) on March 7, 2021.

Augmented reality visualization for ultrasound-guided interventions: a pilot randomized crossover trial to assess trainee performance and cognitive load

BACKGROUND

Augmented reality (AR) technology involving head-mounted displays (HMD) represents a significant innovation in medical education, particularly for training in guided invasive procedures. Novice physicians often face challenges in simultaneously identifying anatomical landmarks and performing procedures when learning point-of-care ultrasound (POCUS). Our primary objective was to determine the effectiveness of AR in enhancing physician training for ultrasound-guided interventions using AR visual overlays. The secondary objective was to compare cognitive load between traditional ultrasound training settings and AR-assisted training settings.

METHODS

This randomized crossover study, conducted from 2021 to 2022, compared performance and cognitive load of trainees attempting accurate central venous catheter (CVC) placement using an AR-HMD to display ultrasound images (AR-US), compared with standard ultrasound without visual overlay (S-US). We enrolled 47 trainees, including 22 final-year undergraduate medical students and 25 postgraduate physicians (years 1-4) from three hospitals in Taiwan. All participants had basic training in US-guided CVC placement but lacked AR-US experience. Performance and cognitive load were assessed using time measurements and NASA Task Load Index (NASA-TLX), covering the dimensions of Mental-, Physical- and Temporal Demand, and Performance, Effort and Frustration.

RESULTS

We found AR technology reduced the time required for critical steps in CVC placement, while minimizing users' neck strain. Female and junior trainees using AR-US identified anatomy and localized veins faster than those using S-US. Using AR-US, female trainees significantly outperformed males in anatomical identification [mean difference (MD): -10.79 s (95% CI: -2.37 to -19.21)]. The NASA-TLX cognitive load assessment showed mental workload trending lower in all dimensions except performance while using AR-US, compared to S-US. Similarly, junior trainees' effort- and frustration scores were lower [MD: -2.73 (95% CI: -5.04 to -0.41) and -2.41 (95% CI: -4.51 to -0.31), respectively], as were female trainees' effort scores [MD: -3.07 (95% CI: -6.10 to -0.03)] when using AR-US, compared to S-US, whereby these differences were statistically significant.

CONCLUSIONS

AR technology helped improve trainee performance and reduced cognitive load during ultrasound-guided CVC placement. These findings support the application of AR technology to enhance physician training in ultrasound-guided interventional procedures, suggesting that AR-HMDs could be a valuable tool in medical education.

TRIAL REGISTRATION

The trial was registered with Clinicaltrials.gov on 20/09/2023 as a clinical trial, under the identifier NCT06055400.

The role of implementing instructional design principles on learner experience with training in current good manufacturing practices (cGMP)

INTRODUCTION

The objective of the study was to assess if improvement of the learner experience could be achieved through the use of instructional design strategies in current Good Manufacturing Practices (cGMP) training. This is a novel application in a topic that is known to be boring but is critical to ensuring patient safety.

METHODS

An experimental randomized controlled repeated measures cross-over design was utilized in a sample of pharmacy students to determine the effect of an intervention training strategy (which utilized a mix of strategies including weeding, signaling, use of multimedia, and optimized space and type) on the learner experience (Evaluation, Overall Satisfaction, Perceived Knowledge, and Future Recommendation) compared with a control.

RESULTS

The sample of 52 pharmacy students that participated evaluated the intervention training strategy with higher scores than the control, with better overall satisfaction, perceived knowledge, and future recommendation scores than the control training strategy. Thus, an apparent effect which resulted from the use of instructional design strategies was seen for all learner experience variables (p < .01).

CONCLUSION

Improvement in the learner experience can be achieved by using instructional design strategies in cGMP training. This indicates that similar results could be obtained in other topics where such techniques have not yet been applied.

Impact of delirium intervention on cognitive load among nurses in the intensive care unit: A multi-centre cluster randomized controlled trial

BACKGROUND

High cognitive load in nurses is a common problem in the intensive care unit (ICU). However, it remains unclear what different types of cognitive load the ICU nurses have experienced during the implementation of delirium interventions.

AIM

To describe the characteristics and explore the effect of implementing a delirium intervention on the cognitive load of nurses working in the ICU.

METHODS

A cluster-randomized controlled clinical trial was conducted. Six ICUs were randomized in a 1:1 ratio, and eligible nurses from these units provided either a delirium bundle intervention in addition to usual care (27 nurses) or usual care alone. An instrument was used to measure different types of cognitive load (MDT-CL), assessing intrinsic, extraneous and germane cognitive load. The repeated measures analysis of variance was used to detect between-group differences.

RESULTS

Among these nurses, significant between-group differences were identified in terms of their overall (P < 0.001), intrinsic (P < 0.001) and extraneous (P < 0.001) cognitive load. There was no significant change observed in the germane cognitive load (P = 0.489) in the delirium intervention group.

CONCLUSION

It is important to understand how the implementation of a delirium intervention affects different types of cognitive load in nurses, in order that tailored strategies can be applied to reduce cognitive load in ICU nurses.

Neurocognitive Correlates of Clinical Decision Making: A Pilot Study Using Electroencephalography

The development of sound clinical reasoning, while essential for optimal patient care, can be quite an elusive process. Researchers typically rely on a self-report or observational measures to study decision making, but clinicians' reasoning processes may not be apparent to themselves or outside observers. This study explored electroencephalography (EEG) to examine neurocognitive correlates of clinical decision making during a simulated American Board of Anesthesiology-style standardized oral exam. Eight novice anesthesiology residents and eight fellows who had recently passed their board exams were included in the study. Measures included EEG recordings from each participant, demographic information, self-reported cognitive load, and observed performance. To examine neurocognitive correlates of clinical decision making, power spectral density (PSD) and functional connectivity between pairs of EEG channels were analyzed. Although both groups reported similar cognitive load (p = 0.840), fellows outperformed novices based on performance scores (p < 0.001). PSD showed no significant differences between the groups. Several coherence features showed significant differences between fellows and residents, mostly related to the channels within the frontal, between the frontal and parietal, and between the frontal and temporal areas. The functional connectivity patterns found in this study could provide some clues for future hypothesis-driven studies in examining the underlying cognitive processes that lead to better clinical reasoning.

The Effects of Reflective Pauses on Performance in Simulation Training

INTRODUCTION

The reflective pause, taking a pause during performance to reflect, is an important practice in simulation-based learning. However, for novice learners, it is a highly complex self-regulatory skill that cannot stand alone without guidance. Using educational theories, we propose how to design cognitive and metacognitive aids to guide learners with the reflective pause and investigate its effects on performance in a simulation training environment.

METHODS

These effects are examined in four aspects of performance: cognitive load, primary performance, secondary performance, and encapsulation. Medical students ( N = 72) performed tasks in simulation training for emergency medicine, under 2 conditions: reflection condition ( n = 36) where reflection was prompted and guided, and control condition ( n = 36) without such reflection.

RESULTS

The effects of reflective pauses emerged for 2 aspects of performance: cognitive load decreased and secondary performance improved. However, primary performance and encapsulation did not show significant difference.

CONCLUSIONS

The results demonstrate that reflective pauses with cognitive and metacognitive aids implemented can enhance some aspects of performance. We suggest that to secure these effects, feedback during reflection and an adaptation period should be provided.

Using Task-Evoked Pupillary Response to Predict Clinical Performance during a Simulation Training

Training in healthcare skills can be affected by trainees' workload when completing a task. Due to cognitive processing demands being negatively correlated to clinical performance, assessing mental workload through objective measures is crucial. This study aimed to investigate task-evoked changes in pupil size as reliable markers of mental workload and clinical performance. A sample of 49 nursing students participated in a cardiac arrest simulation-based practice. Measurements of cognitive demands (NASA-Task Load Index), physiological parameters (blood pressure, oxygen saturation, and heart rate), and pupil responses (minimum, maximum, and difference diameters) throughout revealed statistically significant differences according to performance scores. The analysis of a multiple regression model produced a statistically significant pattern between pupil diameter differences and heart rate, systolic blood pressure, workload, and performance (R² = 0.280; F (6, 41) = 2.660; p < 0.028; d = 2.042). Findings suggest that pupil variations are promising markers to complement physiological metrics for predicting mental workload and clinical performance in medical practice.

Using electroencephalography to explore neurocognitive correlates of procedural proficiency: A pilot study to compare experts and novices during simulated endotracheal intubation

The objective of this study was to explore the use of EEG as a measure of neurocognitive engagement during a procedural task. In this observational study, self-reported cognitive load, observed performance, and EEG signatures in experts and novices were compared during simulated endotracheal intubation. Twelve medical students (novices) and eight senior anesthesiology trainees (experts) were included in the study. Experts reported significantly lower cognitive load (P < 0.001) and outperformed novices based on the observational checklist (P < 0.001). EEG signatures differed significantly between the experts and novices. Experts showed a greater increase in delta and theta band amplitudes, especially in temporal and frontal locations and in right occipital areas for delta. A machine learning algorithm showed 83.3 % accuracy for expert-novice skill classification using the selected EEG features. Performance scores were positively correlated (P < 0.05) with event-related amplitudes for delta and theta bands at locations where experts and novices showed significant differences. Increased delta and frontal/midline theta oscillations on EEG suggested that experts had better attentional control than novices. This pilot study provides initial evidence that EEG may be a useful, noninvasive measure of neurocognitive engagement in operational settings and that it has the potential to complement traditional clinical skills assessment.

Telemedicine in Anesthesiology: Using Simulation to Teach Remote Preoperative Assessment

BACKGROUND

The move toward telemedicine has markedly accelerated with the COVID-19 pandemic. Anesthesia residents must learn to provide preoperative assessments on a virtual platform. We created a pilot telemedicine curriculum for postgraduate year-2 (PGY2) anesthesiology.

METHODS

The curriculum included a virtual didactic session and a simulated virtual preoperative assessment with a standardized patient (SP). A faculty member and the SP provided feedback using a checklist based on the American Medical Association Telehealth Visit Etiquette Checklist and the American Board of Anesthesiology Applied Examination Objective Structured Clinical Examination content outline. Residents completed surveys assessing their perceptions of the effectiveness and helpfulness of the didactic session and simulated encounter, as well as the cognitive workload of the encounter.

RESULTS

A total of 12 PGY2 anesthesiology residents in their first month of clinical anesthesia residency training participated in this study. Whereas most (11/12) residents felt confident, very confident, or extremely confident in being able to conduct a telemedicine preoperative assessment after the didactic session, only 42% ensured adequate lighting and only 33% ensured patient privacy before conducting the visit. Postencounter survey comments indicated that the SP encounter was of greater value (more effective and helpful) than the didactic session. Residents perceived the encounter as demanding, but they felt successful in accomplishing it and did not feel rushed. Faculty and SP indicated that the checklist guided them in providing clear and useful formative feedback.

CONCLUSIONS

A virtual SP encounter can augment didactics to help residents learn and practice essential telemedicine skills for virtual preoperative assessments.

Cognitive load in academic clinical simulation activities. Cross-sectional study

Introduction: Cognitive load determines working memory ability to store and retain information in long-term memory, thus conditioning learning. Objective: To compare cognitive loads among different simulation activities, including anesthesia and surgery simulation workshops in medical students. Methods: Cross-sectional analytical observational study. Two cognitive load measurement scales (Paas and NASA-TLX) were given to the students after each simulation workshop. Comparisons were made based on the scores derived from the scales. Results: Relevant differences were found in terms of the mental effort assessed by means of the Paas scale, as relates to student rotation order in the airway management workshop, with a greater effort being found in the group that rotated initially in surgery (6.19 vs. 5.53; p = 0.029). The workshop with the highest associated rate of frustration was the airway management workshop. Higher scores were obtained for this workshop in all the items of the NASA-TLX scale, reflecting a higher cognitive load when compared to the others. Conclusion: It was not possible to determine whether higher scores in some of the activities were associated with the inherent difficulty of airway management or the specific workshop design. Consequently, further studies are required to distinguish between those components in order to improve the way learning activities are designed.

"Fun slipping into the doctor's role"-The relationship between sonoanatomy teaching and professional identity formation before and during the Covid-19 pandemic

The various psychological dimensions of professional identity formation (PIF) are an important aspect of the study course for undergraduate medical students. Anatomical learning environments have been repeatedly shown to play a critical role in forming such an identity; however, relevance of PIF during sonoanatomical training remains underexplored. At the end of their basic anatomy studies, third-semester medical students took part in a four-day block course on anatomy and imaging. Anatomical content was revised in small groups using peer teaching and imaging methods, including one hour of hands-on sonoanatomy sessions each day. On-site sonoanatomy was identified as an excellent format to support students' transition from the pre-clinical to clinical phase as medical experts-to-be. Students enjoyed practical exercises and the clinical input, which increased their interest in the medical profession and their academic studies. This study further examined the effects of the transition into an online-only format, necessitated by the current Covid-19 pandemic. A comparison was made between the quantitative and qualitative evaluation data, and the written results of examinations of several on-site (n = 1096, mean age = 22.4 years ± 2.18), and online-only cohorts (n = 230, mean age = 22.6 years ± 2.21). The online-only transition led to a reduction of all PIF-related variables measured, losing identity-related variables, increasing students' stress levels, and reducing their long-term academic performance. Together, this study demonstrates presence of PIF in undergraduate sonoanatomy teaching, and cautions against the uncritical online-only substitution of hands-on learning environments.

Effectiveness of simulation-based training for obstetric internal medicine: Impact of cognitive load and emotions on knowledge acquisition and retention

Background

Simulation-based training’s impact on learning outcomes may be related to cognitive load or emotions during training. We evaluated the association of validated measures of cognitive load and emotion with learning outcomes in simulation-based obstetric internal medicine cases.

Methods

All internal medicine learners (n = 15) who completed the knowledge test pre-training, post-training (knowledge acquisition), and at 3–6 months (knowledge retention) for all three simulation cases were included.

Results

Mean knowledge scores differed over time in all three cases (p < 0.0001 for all). Knowledge retention scores were significantly higher only for cases 1 and 3. Cognitive load associated with frustration was positively associated with knowledge acquisition for case 2 (beta = 5.18, P = 0.007), while excitement was negatively associated with knowledge retention in case 1 (beta = –33.07, p = 0.04).

Conclusion

Simulation-based education for obstetric internal medicine can be effective in select cases. Attention to cognitive load and emotion may optimize learning outcomes.

Anxiety is associated with extraneous cognitive load during teaching using high-fidelity clinical simulation

High-fidelity clinical simulation is currently a well-established teaching tool. However, high-fidelity representations of patients in critical conditions have the potential to elicit emotions among learners and impact their cognitive load (CL). Teaching with clinical simulation may induce both emotional and cognitive overloads. The relationship between anxiety and CL during clinical simulation was studied. Forty-one undergraduate medical students participated in this study; 19 males and 22 females. The state-anxiety component of State-Trait Anxiety Inventory was administered during clinical simulation teaching sessions at time points: pre-scenario, post-scenario and post-debriefing. The Cognitive Load Scale (Leppink et al.) questionnaire was also completed post-scenario. This assessed the three components of CL: intrinsic cognitive load (ICL), extraneous cognitive load (ECL) and self-perceived learning (SPL). Median CL scores for ICL, ECL and SPL were compared between groups of low-anxiety and high-anxiety participants using a Mann-Whitney U test. State-anxiety scores were high for both the pre-scenario and post-scenario time points with a significant reduction following post-debriefing. The median (interquartile range) state-anxiety scores were 41.0 (33.0-50.0), 46.0 (33.0-52.0) and 31.0 (23.0-39.0) for the pre-scenario, post-scenario and post-debriefing time points respectively. Students with high state-anxiety had higher ECL scores (median = 2.0) than students with low state-anxiety (median = 0.9) at the post scenario time point (U = 220, p = 0.043). No statistical relation was seen with state-anxiety for either ICL or SPL. State-anxiety immediately after the simulation scenario is associated with ECL but not ICL or SPL.

Exploring a new paradigm for the fetal anomaly ultrasound scan: Artificial intelligence in real time

OBJECTIVE

Advances in artificial intelligence (AI) have demonstrated potential to improve medical diagnosis. We piloted the end-to-end automation of the mid-trimester screening ultrasound scan using AI-enabled tools.

METHODS

A prospective method comparison study was conducted. Participants had both standard and AI-assisted US scans performed. The AI tools automated image acquisition, biometric measurement, and report production. A feedback survey captured the sonographers' perceptions of scanning.

RESULTS

Twenty-three subjects were studied. The average time saving per scan was 7.62 min (34.7%) with the AI-assisted method (p < 0.0001). There was no difference in reporting time. There were no clinically significant differences in biometric measurements between the two methods. The AI tools saved a satisfactory view in 93% of the cases (four core views only), and 73% for the full 13 views, compared to 98% for both using the manual scan. Survey responses suggest that the AI tools helped sonographers to concentrate on image interpretation by removing disruptive tasks.

CONCLUSION

Separating freehand scanning from image capture and measurement resulted in a faster scan and altered workflow. Removing repetitive tasks may allow more attention to be directed identifying fetal malformation. Further work is required to improve the image plane detection algorithm for use in real time.

The Validity of Physiological Measures to Identify Differences in Intrinsic Cognitive Load

A sample of 33 experiments was extracted from the Web-of-Science database over a 5-year period (2016-2020) that used physiological measures to measure intrinsic cognitive load. Only studies that required participants to solve tasks of varying complexities using a within-subjects design were included. The sample identified a number of different physiological measures obtained by recording signals from four main body categories (heart and lungs, eyes, skin, and brain), as well as subjective measures. The overall validity of the measures was assessed by examining construct validity and sensitivity. It was found that the vast majority of physiological measures had some level of validity, but varied considerably in sensitivity to detect subtle changes in intrinsic cognitive load. Validity was also influenced by the type of task. Eye-measures were found to be the most sensitive followed by the heart and lungs, skin, and brain. However, subjective measures had the highest levels of validity. It is concluded that a combination of physiological and subjective measures is most effective in detecting changes in intrinsic cognitive load.

Effect of Psychophysiological Stress and Socio-Emotional Competencies on the Clinical Performance of Nursing Students during a Simulation Practice

Psychophysiological stress can affect the cognitive response and effective learning of students during medical simulation practices. This study aimed to explore the effect of psychophysiological stress and socio-emotional competencies on clinical performance during a simulation experience. A pre-test/post-test design was used to assess physiological (blood pressure, heart rate and blood oxygen saturation) and psychological parameters (stress and anxiety) as well as socio-emotional skills (cognitive load, self-efficacy and motivation) in nursing students (n = 40) before and after the simulation of a cardiopulmonary resuscitation practice. Physiological responses showed statistically significant differences between pre-test and post-test conditions for blood pressure and heart rate (p < 0.0001). Moderate and significant correlations were also observed when comparing self-efficacy with stress (r = −0.445, p = 0.004), anxiety (r = −0.467, p = 0.002) and motivation (r = −0.406, p = 0.009) measures. Similarly, cognitive-load dimensions were significantly associated with either physiological (r = −0.335, p = 0.034) or psychological (r = −0.448, p = 0.004) indicators. The analysis of multiple regression models revealed a relationship between the effectiveness of the simulated experience, post-test blood oxygen saturation, heart rate, workload and self-efficacy (R² = 0.490; F (3, 39) = 8.305; p < 0.0001; d = 1.663). Therefore, the evaluation of psychophysiological parameters and socio-emotional skills seems to provide a promising framework for predicting the quality of simulated clinical practices.

Simulation as a Training Method for Electricity Workers' Safety

Background: Simulation is a useful method to improve learning and increase the safety of work operations, both for technical and non-technical skills. However, the observation, assessment, and feedback about these skills is particularly complex, because the process needs expert observers, and the feedback could be judgmental and ineffective. Therefore, a structured process to develop effective simulation scenarios and tools for the observation and feedback about performance is crucial. To this aim, in the present research, we developed a training model for electricity distribution workers, based on high fidelity simulation. Methods: We designed simulation scenarios based on real cases, developed, and tested a set of observation and rating forms for the non-technical skills behavioral markers, and we tracked behaviors based on non-verbal cues (physiological and head orientation parameters). Results: The training methodology proved to be highly appreciated by the participants and effective in fostering reflexivity. An in-depth analysis of physiological indexes and behaviors compliant to safety procedures revealed that breath rate and heart rate patterns commonly related with mindful and relaxed states were correlated with compliant behaviors, and patterns typical of stress and anxiety were correlated with non-compliant behaviors. Conclusions: a new training method based on high fidelity simulation, addressing both technical and non-technical skills is now available for fostering self-reflection and safety for electricity distribution workers. Future research should assess the long-term effectiveness of high-fidelity simulation for electricity workers, and should investigate non-invasive and real-time methods for tracking physiological parameters.

Evaluation of 3 Cognitive Load Measures During Repeated Simulation Exercises for Novice Anesthesiology Residents

INTRODUCTION

Maintaining an appropriate level of cognitive load during simulations is crucial to optimize learning. We evaluated 3 subjective measures of cognitive load in a simulated operating room (OR) context across multiple scenarios of varying complexity.

METHODS

This observational study of 25 first-year anesthesiology residents took place during a 5-day simulation "Boot Camp." Each day, participants completed 2 different high-fidelity scenarios in a fully equipped simulated OR. After each simulation, participants completed 3 cognitive load measures: the Paas scale, NASA Task Load Index (TLX), and Cognitive Load Component (CLC) questionnaire. Two-way repeated-measures and mixed-design analyses of variance, with the cognitive load measures and scenarios as independent factors, were used to determine the effect of using different measures to report cognitive load.

RESULTS

Cognitive load scores reported by all measures correlated significantly with one another (P < 0.01): TLX and Paas (r = 0.65); Paas and CLC (r = 0.63); and TLX and CLC (r = 0.61). The CLC subscale scores (intrinsic, extraneous, germane) also correlated significantly with composite TLX and Paas scores (P < 0.01). Scenarios and measures displayed significant interaction: F(10, 210) = 3.01, P = 0.001. Participants reported highest overall cognitive load using the Paas scale.

CONCLUSIONS

All cognitive load measures were sensitive to scenario variability and showed similar fluctuation patterns across the 10 scenarios. The findings suggest that cognitive load measures can help create benchmarks based on learner perceptions of cognitive burden for different simulation scenarios.

Impact of Simulation-Based Training on Radiation Therapists' Workload, Situation Awareness, and Performance

Purpose

This study aimed to assess the impact of simulation-based training intervention on radiation therapy therapist (RTT) mental workload, situation awareness, and performance during routine quality assurance (QA) and treatment delivery tasks.

Methods and Materials

As part of a prospective institutional review board-approved study, 32 RTTs completed routine QA and treatment delivery tasks on clinical scenarios in a simulation laboratory. Participants, randomized to receive (n = 16) versus not receive (n = 16) simulation-based training had pre- and postintervention assessments of mental workload, situation awareness, and performance. We used linear regression models to compare the postassessment scores between the study groups while controlling for baseline scores. Mental workload was quantified subjectively using the NASA Task Load Index. Situation awareness was quantified subjectively using the situation awareness rating technique and objectively using the situation awareness global assessment technique. Performance was quantified based on procedural compliance (adherence to preset/standard QA timeout tasks) and error detection (detection and correction of embedded treatment planning errors).

Results

Simulation-based training intervention was associated with significant improvements in overall performance (P < .01), but had no significant impact on mental workload or subjective/objective quantifications of situation awareness.

Conclusions

Simulation-based training might be an effective tool to improve RTT performance of QA-related tasks.

Effect of Simulation-Based Training and Neurofeedback Interventions on Radiation Technologists' Workload, Situation Awareness, and Performance

PURPOSE

Our purpose was to assess the effect of a combined intervention - simulation-based training supported by neurofeedback sessions - on radiation technologists' (RTs') workload, situation awareness, and performance during routine quality assurance and treatment delivery tasks.

METHODS AND MATERIALS

As part of a prospective institutional review board approved study, 32 RTs previously randomized to receive versus not receive simulation-based training focused on patient safety were again randomized to receive versus not receive a 3-week neurofeedback intervention (8 sessions of alpha-theta protocol) focused on stress reduction as well as conscious precision, strong focus, and ability to solve arising problems. Perceived workload was quantified using the NASA Task Load Index. Situation awareness was quantified using the situation awareness rating technique. Performance score was calculated using procedural compliance with time-out components and error detection.

RESULTS

RTs randomized to simulation-based training followed by neurofeedback sessions demonstrated no significant changes in perceived workload or situation awareness scores, but did have better performance compared with other study groups (P < .01).

CONCLUSIONS

This finding is encouraging and provides basis for using neurofeedback as means to possibly augment performance improvements gained during simulation-based training.

Psychometric properties of the Chinese version of the instrument for measuring different types of cognitive load (MDT‐CL)

Aim

Background

Methods

Results

Conclusions

Implications for nursing management

Failure affects subjective estimates of cognitive load through a negative carry-over effect in virtual reality simulation of hip fracture surgery

BACKGROUND

Cognitive overload can impair learning, and different factors might affect cognitive load during simulation-based training. In this study, we investigate the role of failure in repeated practice of virtual reality (VR) simulation of hip fracture surgery on cognitive load (CL) estimated by secondary-task reaction time test and two questionnaires.

METHODS

The VR simulation training program consisted of three competency levels of increasing complexity starting with the placement of a Kirschner wire in a fractured hip of one patient, adding clinical variability at the intermediate level, and performing the entire dynamic hip screw procedure in 24 different patients at the highest level. Thirteen consecutive passed simulations were required to advance to the next level. Performance was measured as passing/failing a procedure and the number of failed procedures within the latest three and five simulations. CL was measured objectively using reaction time testing during simulation and subjectively using the NASA-TLX and PAAS questionnaires. The study was carried out at a simulation center from November 2016 to March 2019. Forty-two first-year orthopedic surgery residents from the Central Denmark Region and the North Denmark Region participated in the training program.

RESULTS

A failing performance in the simulated procedure was associated with a higher CL than passing a procedure. The subjective CL estimates were affected by the number of failures during last three and five procedures with a higher number of failures being associated with a higher CL. In contrast, relative reaction time estimates of CL were not affected by previous failures.

CONCLUSIONS

Questionnaires for estimation of CL seem to be affected by participant frustration after failure-a meta-cognitive "carry-over" effect. This could be a general limitation of the subjective questionnaire approach to estimate CL. Reducing CL through instructional design and handling of participant frustration might improve the learning outcome of simulation training programs.

Comparing cognitive load levels among family members of the critically ill exposed to electronic decision aids

Cognitive load predicts one's ability to process information and learn from decision support interventions. The present study compared intrinsic and extraneous cognitive load levels resulting from exposure to two different electronic decision aids. A convenience sample of ninety-seven surrogate decision makers for critically ill patients were randomly assigned to receive either a single dose of a video-based or avatar-based decision aid. Intrinsic and extraneous cognitive load levels among recipients of the video-based decision support resource were lower than recipients of the avatar-based decision support resource. After controlling for age, the observed differences in intrinsic cognitive load were not significantly different, whereas the observed differences in extraneous cognitive load remained. Extraneous cognitive load is a modifiable factor to consider for future developers of decision support interventions that may determine the efficacy of efforts to support patients and family members with decision making.

The effect of autostereoscopic holograms on anatomical knowledge: a randomised trial

CONTEXT

Three-dimensional (3-D) visualisation in anatomical education has been shown to be broadly beneficial for students. However, there is limited research on the relative efficacy of 3-D modalities. This study compares knowledge performance, mental effort and instructional efficiency between autostereoscopic 3-D visualisation (holograms), monoscopic 3-D visualisation (3-DPDFs) and a control (2-D printed images).

METHODS

A cardiac anatomy model was used to generate holograms, 3-DPDFs and 2-D printed images. Nursing student participants (n = 179) were randomised into three groups: holograms (n = 60), 3-DPDFs (n = 60) and printed images (n = 59). Participants completed a pre-test followed by a self-study period using the anatomical visualisation. Afterwards, participants completed the NASA-Task Load Index (NASA-TLX) cognitive load instrument and a knowledge post-test.

RESULTS

Post-test results showed participants studying with holograms (median = 80.0, interquartile range [IQR] = 66.7-86.7) performed significantly better regarding cardiac anatomy knowledge than participants using 3-DPDF (median = 66.7, IQR = 53.3-80.0, p = 0.008) or printed images (median = 66.7, IQR = 53.3-80.0, p = 0.007). Mental effort scores, on a scale from 1 to 20, showed hologram (mean = 4.9, standard deviation [SD] = 3.56) and 3-DPDF participants (mean = 4.9, SD = 3.79) reported significantly lower cognitive load than printed images (mean = 7.5, SD = 4.9, p < 0.005). Instructional efficiency (E) of holograms (E = 0.35) was significantly higher than printed images (E = -0.36, p < 0.001), although not significantly higher than 3-DPDF (E = 0.03, p = 0.097).

CONCLUSIONS

Participants using holograms demonstrated significant knowledge improvement over printed images and monoscopic 3-DPDF models, suggesting additional depth cues from holographic visualisation provide benefit in understanding spatial anatomy. Mental effort scores and instructional efficiency of holograms indicate holograms are a cognitively efficient instructional medium. These findings highlight the need for further study of novel 3-D technologies and learning performance.

Measuring cognitive load

None