Does medical students' diagnostic performance improve by observing examples of self-explanation provided by peers or experts?

AI-powered standardised patients: evaluating ChatGPT-4o's impact on clinical case management in intern physicians

BACKGROUND

Artificial Intelligence is currently being applied in healthcare for diagnosis, decision-making and education. ChatGPT-4o, with its advanced language and problem-solving capabilities, offers an innovative alternative as a virtual standardised patient in clinical training. Intern physicians are expected to develop clinical case management skills such as problem-solving, clinical reasoning and crisis management. In this study, ChatGPT-4o's served as virtual standardised patient and medical interns as physicians on clinical case management. This study aimed to evaluate intern physicians' competencies in clinical case management; problem-solving, clinical reasoning, crisis management and explore the impact and potential of ChatGPT-4o as a viable tool for assessing these competencies.

METHODS

This study used a simultaneous triangulation design, integrating quantitative and qualitative data. Conducted at Aydın Adnan Menderes University, with 21 sixth-year medical students, ChatGPT-4o simulated realistic patient interactions requiring competencies in clinical case management; problem-solving, clinical reasoning, crisis management. Data were gathered through self-assessment survey, semi-structured interviews, observations of the students and ChatGPT-4o during the process. Analyses included Pearson correlation, Chi-square, and Kruskal-Wallis tests, with content analysis conducted on qualitative data using MAXQDA software for coding.

RESULTS

According to the findings, observation and self-assessment survey scores of intern physicians' clinical case management skills were positively correlated. There was a significant gap between participants' self-assessment and actual performance, indicating discrepancies in self-perceived versus real clinical competence. Participants reported feeling inadequate in their problem-solving and clinical reasoning competencies and experienced time pressure. They were satisfied with the Artificial Intelligence-powered standardised patient process and were willing to continue similar practices. Participants engaged with a uniform patient experience. Although participants were satisfied, the application process was sometimes negatively affected due to disconnection problems and language processing challenges.

CONCLUSIONS

ChatGPT-4o successfully simulated patient interactions, providing a controlled environment without risking harm to real patients for practicing clinical case management. Although some of the technological challenges limited effectiveness, it was useful, cost-effective and accessible. It is thought that intern physicians will be better supported in acquiring clinical management skills through varied clinical scenarios using this method.

CLINICAL TRIAL NUMBER

Not applicable.

J. P. Rikers R, Pourahmadi M, Soltani Arabshahi SK, Keshtkar A, Dargahi H, Yaghmaei M, Monajemi A. Teaching and learning clinical reasoning skill in undergraduate medical students: A scoping review

BACKGROUND

Clinical reasoning involves the application of knowledge and skills to collect and integrate information, typically to arrive at a diagnosis, implement appropriate interventions, solve clinical problems, and improve the quality of health care and patient outcomes. It is a vital competency that medical students must acquire, as it is considered the heart of medicine.

PURPOSE

This scoping review aimed to identify and summarize the existing literature on learning and teaching strategies for improving clinical reasoning skill in undergraduate medical education.

METHODS

We conducted electronic searches in Scopus, PubMed/Medline (NLM), Web of Science (WOS), and ERIC to retrieve articles published between January 1, 2010, and March 23, 2024. We also performed hand searches by scanning the reference lists of included studies and similar reviews and searching three key journals. After removing duplicates, two reviewers independently extracted data from primary articles using a standard data extraction form. The authors used Arksey and O'Malley's framework.

RESULTS

Among the 46581 retrieved records, 54 full-text articles were included in the present review. We categorized the educational strategies based on their aspects, focus, and purpose. Included studies used various educational strategies for improving clinical reasoning skill in undergraduate medical education by serial cue or whole clinical cases that presented as process-oriented or knowledge-oriented.

CONCLUSION

This scoping review investigated various dimensions of educational intervention for improving clinical reasoning skill in undergraduate medical education. There is a need for more precision studies with larger sample sizes, designing studies according to randomized controlled trials standards, determining MCID, or performing meta-analyses to acquire robust and conclusive results.

Exploring medical students' use of principles of self-explanation and structured reflection during clerkship

Background

While educators observe gaps in clerkship students' clinical reasoning (CR) skills, students report few opportunities to develop them. This study aims at exploring how students who used self-explanation (SE) and structured reflection (SR) for CR learning during preclinical training, applied these learning strategies during clerkship.

Methods

We conducted an explanatory sequential mixed-methods study involving medical students. With a questionnaire, we asked students how frequently they adopted behaviours related to SE and SR during clerkship. Next, we conducted a focus group with students to explore why they adopted these behaviours.

Results

Fifty-two of 198 students answered the questionnaire and five participated in a focus group. Specific behaviours adopted varied from 50% to 98%. We identified three themes about why students used these strategies: as "just in time" learning strategies; to deepen their understanding and identify gaps in knowledge; to develop a practical approach to diagnosis. A fourth theme related to the balance between learning and assessment and its consequence on adopting SE behaviours.

Conclusions

Students having experienced SE and SR regularly in preclinical training tend to transpose these strategies into the clerkship providing them with a practical way to reflect deliberately and capture learning opportunities of the unpredictable clinical context.

Simulation-based bronchoscopy training: Randomized trial comparing worked example to video introduction

INTRODUCTION

Learning the complex skill of bronchoscopy involves the integration of cognitive domains and motor skills. The development of simulators has opened up new possibilities in bronchoscopy training. This study aimed at evaluating how effective the modeling example methodology is in training this skill and assessed its effect on cognitive load in learning.

METHODS

Forty-seven medical students participating in a simulator-based bronchoscopy training program were randomly allocated to a control group, receiving a video lesson, and the modeling example group. They were evaluated by the simulator's metrics at different time points: pre-, posttest, and 15 days and 12 months after training. Cognitive load was assessed with the modified Paas scale.

RESULTS

Simulation-based training was effective for both groups, based on simulator metrics (p < .05). The modeling example group outperformed the control group in all measures at posttest and after 15 days (p < .001). After 12 months, there was a decline in skill in both groups, but the modeling example group performed better (p < .001). Simulation-based training reduced cognitive load, more strongly so in the modeling example group (p < .001).

CONCLUSION

The modeling example group showed substantial benefits over the control group, both in reducing the cognitive load in learning and in retaining knowledge and skill after 15 days and 12 months.

Implementation of three knowledge-oriented instructional strategies to teach clinical reasoning: Self-explanation, a concept mapping exercise, and deliberate reflection: AMEE Guide No. 150

The teaching of clinical reasoning is essential in medical education. This guide has been written to provide educators with practical advice on the design, development, and implementation of three knowledge-oriented instructional strategies for the teaching of clinical reasoning to medical students: Self-explanation (SE), a Clinical Reasoning Mapping Exercise (CREsME), and Deliberate Reflection (DR). We first synthesize the theoretical tenets that support the use of these strategies, including knowledge organization, and development of illness scripts. We then provide a detailed description of the key components of each strategy, emphasizing the practical applications of each one by sharing specific examples. We also explore the potential for a combined application of these strategies in a longitudinal and developmental approach to teaching clinical reasoning at the undergraduate level. Finally, we discuss enablers and barriers in the implementation and integration of these teaching strategies while taking into consideration curricular needs, context, and resources. We are aware that many strategies exist and are not arguing that SE, CReSME, and DR are the most effective ones or the only ones to be adopted. Nevertheless, we selected these strategies because of overarching theoretical principles, empirical evidence supporting their use, and our own experience with them. We are hoping to provide practical advice on the implementation of these strategies to practicing educators who aim at developing an integrated approach to the teaching of clinical reasoning to medical students at different stages of their development.

Teaching Students How to Think: A Longitudinal Qualitative Study of Preclerkship Clinical Reasoning Instruction

INTRODUCTION

An objective of undergraduate medical education is to teach students how to think like physicians through a process called clinical reasoning. Currently, clerkship directors often feel that students enter their clinical years with a marginal comprehension of clinical reasoning concepts; instruction in this area could be improved. Although there have been previous educational studies assessing curricular interventions to improve the instruction of clinical reasoning, it is not yet known what happens at an individual level between an instructor and a small group of students in the teaching of clinical reasoning. This research will identify how clinical reasoning is being taught in a longitudinal clinical reasoning course.

METHODS

The Introduction to Clinical Reasoning course is a 15-month-long case-based course held in the preclinical curriculum of the USU. Individual sessions involve small-group learning with approximately seven students per group. Throughout the academic year of 2018-2019, 10 of these sessions were videotaped and transcribed. All participants provided informed consent. A thematic analysis was performed using a constant comparative approach. Transcripts were analyzed until thematic sufficiency was reached.

RESULTS

Over 300 pages of text were analyzed; new themes ceased to be identified after the eighth session. Topics included obstetrics, general pediatric issues, jaundice, and chest pain; these sessions were taught either by attendings, fellows, or fourth-year medical students with attending supervision. The thematic analysis revealed themes associated with clinical reasoning processes, themes associated with knowledge organization, and a theme associated with clinical reasoning in the military. The clinical reasoning process themes included problem list construction and refinement, differential diagnosis, naming and defending a leading diagnosis, and clinical reasoning heuristics. The knowledge organization themes included illness script development and refinement and semantic competence. The final theme was military relevant care.

CONCLUSIONS

In individual teaching sessions, preceptors emphasized problem lists, differential diagnoses, and leading diagnoses in a course designed to strengthen diagnostic reasoning in preclerkship medical students. The use of illness scripts was more often implicitly used rather than explicitly stated, and students used these sessions to use and apply new vocabularies related to a clinical presentation. Instruction in clinical reasoning could be improved by encouraging faculty to provide further context to their thinking, by encouraging the comparing and contrasting of illness scripts, and by using a shared vocabulary for clinical reasoning. Limitations of this study include that it was done in the context of a clinical reasoning course and that it was done at a military medical school, which may limit generalizability. Future studies could determine if faculty development could improve the frequency of references to the clinical reasoning processes that could improve student readiness for clerkship.

Methods to Improve Diagnostic Reasoning in Undergraduate Medical Education in the Clinical Setting: a Systematic Review

BACKGROUND

In recent years, there have been numerous studies exploring different teaching methods for improving diagnostic reasoning in undergraduate medical students. This systematic review examines and summarizes the evidence for the effectiveness of these teaching methods during clinical training.

METHODS

PubMed, Embase, Scopus, and ERIC were searched. The inclusion criteria for the review consist of articles describing (1) methods to enhance diagnostic reasoning, (2) in a clinical setting (3) on medical students. Articles describing original research using qualitative, quantitative, or mixed study designs and published within the last 10 years (1 April 2009-2019) were included. Results were screened and evaluated for eligibility. Relevant data were then extracted from the studies that met the inclusion criteria.

RESULTS

Sixty-seven full-text articles were first identified. Seventeen articles were included in this review. There were 13 randomized controlled studies and four quasi-experimental studies. Of the randomized controlled studies, six discussed structured reflection, four self-explanation, and three prompts for generating differential diagnoses. Of the remaining four studies, two employed the SNAPPS¹ technique for case presentation. Two other studies explored schema-based instruction and using illness scripts. Twelve out of 17 studies reported improvement in clinical reasoning after the intervention. All studies ranked level two on the New World Kirkpatrick model.

DISCUSSION

The authors posit a framework to teach diagnostic reasoning in the clinical setting. The framework targets specific deficiencies in the students' reasoning process. There remains a lack of studies comparing the effectiveness of different methods. More comparative studies with standardized assessment and evaluation of long-term effectiveness of these methods are recommended.

A layered analysis of self-explanation and structured reflection to support clinical reasoning in medical students

Self-explanation and structured reflection have been studied independently with results suggesting that both learning interventions can effectively support medical students' clinical reasoning development. Given this evidence, medical schools may want/begin to implement these interventions in their curricula. Implementing educational interventions requires educators to maintain the core philosophy and principles of the interventions intact while adjusting implementation techniques to the specificities of individual learning contexts. Educational scholars have yet to explicitly articulate the philosophy, principles and techniques of self-explanation and structured reflection. Without such descriptions, educators risk failing to realize self-explanation's and structured reflection's effect to support students' clinical reasoning skill development in their implementations. Relying on the layered analysis approach, we articulate the philosophy, principles and techniques of self-explanation and structured reflection. This description is framed within the context of an actual implementation to illustrate the philosophies underpinning self-explanation and structured reflection, the principles that realize those philosophies, and the techniques that can be used to enact those principles. Building on the similarities between self-explanation and structured reflection, while also harnessing their differences, we identify why and how these interventions can be combined in a single implementation, while preserving their philosophies and principles. The layered analysis of self-explanation and structured reflection offers essential insights into the underpinnings of these interventions. They are articulated in this manuscript in hopes that other scholars will continue to refine these descriptions thereby facilitating effective use of self-explanation and structured reflection for clinical reasoning development.

Ways that nurse practitioner students self-explain during diagnostic reasoning

OBJECTIVES

An important step in mitigating the burden of diagnostic errors is strengthening diagnostic reasoning among health care providers. A promising way forward is through self-explanation, the purposeful technique of generating self-directed explanations to process novel information while problem-solving. Self-explanation actively improves knowledge structures within learners' memories, facilitating problem-solving accuracy and acquisition of knowledge. When students self-explain, they make sense of information in a variety of unique ways, ranging from simple restatements to multidimensional thoughts. Successful problem-solvers frequently use specific, high-quality self-explanation types. The unique types of self-explanation present among nurse practitioner (NP) student diagnosticians have yet to be explored. This study explores the question: How do NP students self-explain during diagnostic reasoning?

METHODS

Thirty-seven Family NP students enrolled in the Doctor of Nursing Practice program at a large, Midwestern U.S. university diagnosed three written case studies while self-explaining. Dual methodology content analyses facilitated both deductive and qualitative descriptive analysis.

RESULTS

Categories emerged describing the unique ways that NP student diagnosticians self-explain. Nine categories of inference self-explanations included clinical and biological foci. Eight categories of non-inference self-explanations monitored students' understanding of clinical data and reflect shallow information processing.

CONCLUSIONS

Findings extend the understanding of self-explanation use during diagnostic reasoning by affording a glimpse into fine-grained knowledge structures of NP students. NP students apply both clinical and biological knowledge, actively improving immature knowledge structures. Future research should examine relationships between categories of self-explanation and markers of diagnostic success, a step in developing prompted self-explanation learning interventions.

Diagnostic reasoning: relationships among expertise, accuracy, and ways that nurse practitioner students self-explain

OBJECTIVES

To improve diagnostic ability, educators should employ multifocal strategies. One promising strategy is self-explanation, the purposeful technique of generating self-directed explanations during problem-solving. Students self-explain information in ways that range from simple restatements to multidimensional thoughts. Successful problem-solvers frequently use specific, high-quality self-explanation types. In a previous phase of research, unique ways that family nurse practitioner (NP) students self-explain during diagnostic reasoning were identified and described. This study aims to (a) explore relationships between ways of self-explaining and diagnostic accuracy levels and (b) compare differences between students of varying expertise in terms of ways of self-explaining and diagnostic accuracy levels. Identifying high-quality diagnostic reasoning self-explanation types may facilitate development of more refined self-explanation educational strategies.

METHODS

Thirty-seven family NP students enrolled in the Doctor of Nursing Practice program at a large, Midwestern university diagnosed three written case studies while self-explaining. During the quantitative phase of a content analysis, associational and comparative data analysis techniques were applied.

RESULTS

Expert students voiced significantly more clinical and biological inference self-explanations than did novice students. Diagnostic accuracy scores were significantly associated with biological inference scores. Clinical and biological inference scores accounted for 27% of the variance in diagnostic accuracy scores, with biological inference scores significantly influencing diagnostic accuracy scores.

CONCLUSIONS

Not only were biologically focused self-explanations associated with diagnostic accuracy, but also their spoken frequency influenced levels of diagnostic accuracy. Educational curricula should support students to view patient presentations in terms of underlying biology from the onset of their education.

How cognitive psychology changed the face of medical education research

In this article, the contributions of cognitive psychology to research and development of medical education are assessed. The cognitive psychology of learning consists of activation of prior knowledge while processing new information and elaboration on the resulting new knowledge to facilitate storing in long-term memory. This process is limited by the size of working memory. Six interventions based on cognitive theory that facilitate learning and expertise development are discussed: (1) Fostering self-explanation, (2) elaborative discussion, and (3) distributed practice; (4) help with decreasing cognitive load, (5) promoting retrieval practice, and (6) supporting interleaving practice. These interventions contribute in different measure to various instructional methods in use in medical education: problem-based learning, team-based learning, worked examples, mixed practice, serial-cue presentation, and deliberate reflection. The article concludes that systematic research into the applicability of these ideas to the practice of medical education presently is limited and should be intensified.

Education initiatives in cognitive debiasing to improve diagnostic accuracy in student providers: A scoping review

BACKGROUND

The high prevalence of diagnostic errors by health care providers has prompted medical educators to examine cognitive biases and debiasing strategies in an effort to prevent these errors. The National Academy of Medicine hypothesized that explicit diagnostic reasoning education of all health care professionals can improve diagnostic accuracy.

OBJECTIVES

The purpose of this scoping review is to identify, analyze, and summarize the existing literature on student health care providers' use of cognitive debiasing strategies to reduce diagnostic error.

DATA SOURCES

The review was guided by the Joanna Briggs Institute methodology for scoping reviews. A systematic search of PubMed, CINAHL, PsychINFO, and Scopus databases for debiasing strategies in student provider education yielded 33 studies.

CONCLUSIONS

The 33 studies included in this review represent four categories of debiasing strategies: increased medical knowledge or experience (seven studies), guided reflection (eight studies), self-explanation of reasoning (nine studies), and checklists to expand diagnosis considerations (seven studies). The studies were inclusive of medical students and residents; no studies included nurse practitioner (NP) students. Guided reflection, the most clearly defined and implemented strategy, showed the most promise for improvement of diagnostic accuracy. Educational interventions were wide ranging in content and delivery but did yield a path for future research.

IMPLICATIONS FOR PRACTICE

There are myriad debiasing strategies student providers may use to mitigate cognitive bias. Structured reflection and education initiatives demonstrated the most consistent improvements in diagnostic accuracy. Future studies on debiasing strategies must include NP students to understand their response to these initiatives.

The student is key: A realist review of educational interventions to develop analytical and non-analytical clinical reasoning ability

OBJECTIVES

Clinical reasoning refers to the cognitive processes used by individuals as they formulate a diagnosis or treatment plan. Clinical reasoning is dependent on formal and experiential knowledge. Developing the ability to acquire and recall knowledge effectively for both analytical and non-analytical cognitive processing has patient safety implications. This realist review examines the way educational interventions develop analytical and non-analytical reasoning ability in undergraduate education. A realist review is theory-driven, seeking not only to identify if an intervention works, but also understand the reasons why, for whom, and in what circumstances. The aim of this study is to develop understanding about the way educational interventions develop effective analytical and non-analytical clinical reasoning ability, when they do, for whom and in what circumstances.

METHODS

Literature from a scoping search, combined with expert opinion and researcher experience was synthesised to generate an initial programme theory (IPT). Four databases were searched and articles relevant to the developing theory were selected as appropriate. Factors affecting educational outcomes at the individual student, teacher and wider organisational levels were investigated in order to further refine the IPT.

RESULTS

A total of 28 papers contributed to the overall programme theory. The review predominantly identified evidence of mechanisms for interventions at the individual student level. Key student level factors influencing the effectiveness of interventions included an individual's self-confidence, self-efficacy and pre-existing level of knowledge. These contexts influenced a variety of educational interventions, impacting both positively and negatively on educational outcomes.

CONCLUSIONS

Development of analytical and non-analytical clinical reasoning ability requires activities that enhance knowledge acquisition and recall alongside the accumulation of clinical experience and opportunities to practise reasoning in real or simulated clinical environments. However, factors such as pre-existing knowledge and self-confidence influence their effectiveness, especially amongst individuals with 'low knowledge.' Promoting non-analytical reasoning once novices acquire more clinical knowledge is important for the development of clinical reasoning in undergraduate education.

Medical Decision-Making in the Physician Hierarchy: A Pilot Pedagogical Evaluation

PURPOSE

Recently, the American College of Graduate Medical Education included medical decision-making as a core competency in several specialties. To date, the ability to demonstrate and measure a pedagogical evolution of medical judgment in a medical education program has been limited. In this study, we aim to examine differences in medical decision-making of physician groups in distinctly different stages of their postgraduate career.

METHODS

The study recruited physicians with a wide spectrum of disciplines and levels of experience to take part in 4 medical simulations divided into 2 categories, abdominal pain (biliary colic [BC] and renal colic [RC]) or chest pain (cardiac ischemia with ST-segment elevation myocardial infarction [STEMI] and pneumothorax [PTX]). Evaluation of medical decision-making used the Medical Judgment Metric (MJM). The targeted selection criteria for the physician groups are administrative physicians (APs), representing those with the most experience but whose current duties are largely administrative; resident physicians (RPs), those enrolled in postgraduate medical or surgical training; and mastery level physicians (MPs), those deemed to have mastery level experience. The study measured participant demographics, physiological responses, medical judgment scores, and simulation time to case resolution. Outcome differences were analyzed using Fisher exact tests with post hoc Bonferroni-adjusted z tests and single-factor analysis of variance F tests with post hoc Tukey honestly significant difference, as appropriate. The significance threshold was set at P < .05. Effect sizes were determined and reported to inform future studies.

RESULTS

A total of n = 30 physicians were recruited for the study with n = 10 participants in each physician group. No significant differences were found in baseline demographics between groups. Analysis of simulations showed a significant (P = .002) interaction for total simulation time between groups RP: 6.2 minutes (±1.58); MP: 8.7 minutes (±2.46); and AP: 10.3 minutes (±2.78). The AP MJM scores, 12.3 (±2.66), for the RC simulation were significantly (P = .010) lower than the RP 14.7 (±1.15) and MP 14.7 (±1.15) MJM scores. Analysis of simulated patient outcomes showed that the AP group was significantly less likely to stabilize the participant in the RC simulation than MP and RP groups (P = .040). While not significant, all MJM scores for the AP group were lower in the BC, STEMI, and PTX simulations compared with the RP and MP groups.

CONCLUSIONS

Physicians in distinctly different stages of their respective postgraduate career differed in several domains when assessed through a consistent high-fidelity medical simulation program. Further studies are warranted to accurately assess pedagogical differences over the medical judgment lifespan of a physician.

Does providing the correct diagnosis as feedback after self-explanation improve medical students diagnostic performance?

BACKGROUND

Self-explanation without feedback has been shown to improve medical students' diagnostic reasoning. While feedback is generally seen as beneficial for learning, available evidence of the value of its combination with self-explanation is conflicting. This study investigated the effect on medical students' diagnostic performance of adding immediate or delayed content-feedback to self-explanation while solving cases.

METHODS

Ninety-four 3rd-year students from a Canadian medical school were randomly assigned to three experimental conditions (immediate-feedback, delayed-feedback, control). In the learning phase, all students solved four clinical cases by giving i) the most likely diagnosis, ii) two main arguments supporting this diagnosis, and iii) two plausible alternative diagnoses, while using self-explanation. The immediate-feedback group was given the correct diagnosis after each case; delayed-feedback group received the correct diagnoses only after the four cases; control group received no feedback. One week later, all students solved four near-transfer (i.e., same final diagnosis as the learning cases but different scenarios) and four far-transfer cases (i.e., different final diagnosis from the learning cases and different scenarios) by answering the same three questions. Students' diagnostic accuracy (score for the response to the first question only) and diagnostic performance (combined score of responses to the three questions) scores were assessed in each phase. Four one-way ANOVAs were performed on each of the two scores for near and far-transfer cases.

RESULTS

There was a significant effect of experimental condition on diagnostic accuracy on near-transfer cases (p < .05). The immediate-feedback and delayed-feedback groups performed equally well, both better than control (respectively, mean = 90.73, standard deviation =10.69; mean = 89.92, standard deviation = 13.85; mean = 82.03, standard deviation = 17.66). The experimental conditions did not significantly differ on far-transfer cases.

CONCLUSIONS

Providing feedback to students in the form of the correct diagnosis after using self-explanation with clinical cases is potentially beneficial to improve their diagnostic accuracy but this effect is limited to similar cases. Further studies should explore how more elaborated feedback combined with self-explanation may impact students' diagnostic performance on different cases.

Fostering medical students' clinical reasoning by learning from errors in clinical case vignettes: effects and conditions of additional prompting procedures to foster self-explanations

The present study aims at fostering undergraduate medical students' clinical reasoning by learning from errors. By fostering the acquisition of "negative knowledge" about typical cognitive errors in the medical reasoning process, we support learners in avoiding future erroneous decisions and actions in similar situations. Since learning from errors is based on self-explanation activities, we provided additional prompting procedures to foster the effectiveness of the error-based instructional approach. The extent of instructional support in a web-based learning environment with erroneous clinical case examples was varied in a one-factorial design with three groups by either presenting the cases as (a) unsupported worked examples or by providing the participants with (b) closed prompts in the form of multiple-choice tasks or (c) with open reflection prompts during the learning process. Despite significant learning progress in all conditions, neither prompting procedure improved the learning outcomes beyond the level of the unsupported worked example condition. In contrast to our hypotheses, the unsupported worked example condition was the most effective with respect to fostering clinical reasoning performance. The effects of the learning conditions on clinical reasoning performance was mediated by cognitive load, and moderated by the students' self-efficacy. Both prompting procedures increased extraneous cognitive load. For learners with low self-efficacy, the prompting procedures interfered with effective learning from errors. Although our error-based instructional approach substantially improved clinical reasoning, additional instructional measures intended to support error-based learning processes may overtax learners in an early phase of clinical expertise development and should therefore only be used in moderation.

Clinical Reasoning in Physical Therapy: A Concept Analysis

BACKGROUND

Physical therapy, along with most health professions, struggles to describe clinical reasoning, despite it being a vital skill in effective patient care. This lack of a unified conceptualization of clinical reasoning leads to variable and inconsistent teaching, assessment, and research.

OBJECTIVE

The objective was to conceptualize a broad description of physical therapists' clinical reasoning grounded in the published literature and to unify understanding for future work related to teaching, assessment, and research.

DESIGN/METHODS

The design included a systematic concept analysis using Rodgers' evolutionary methodology. A concept analysis is a research methodology in which a concept's characteristics and the relation between features of the concept are clarified.

RESULTS

Based on findings in the literature, clinical reasoning in physical therapy was conceptualized as integrating cognitive, psychomotor, and affective skills. It is contextual in nature and involves both therapist and client perspectives. It is adaptive, iterative, and collaborative with the intended outcome being a biopsychosocial approach to patient/client management.

LIMITATIONS

Although a comprehensive approach was intended, it is possible that the search methods or reduction of the literature were incomplete or key sources were mistakenly excluded.

CONCLUSIONS

A description of clinical reasoning in physical therapy was conceptualized, as it currently exists in representative literature. The intent is for it to contribute to the unification of an understanding of how clinical reasoning has been conceptualized to date by practitioners, academicians, and clinical educators. Substantial work remains to further develop the concept of clinical reasoning for physical therapy, including the role of movement in our reasoning in practice.

Teaching Diagnostic Reasoning: A Review of Evidence-Based Interventions

Problem/Background: The ability to accurately diagnose patients based on symptom profiles is a vital yet challenging skill that Nurse Practitioners (NPs) undertake frequently.

PURPOSE

This integrative literature review highlights a variety of evidence based, practical educational strategies that foster the development of diagnostic reasoning.

METHODS

An integrative literature review was conducted in order to identify original research focusing on diagnostic reasoning educational interventions.

RESULTS

Eighteen primary sources met inclusion and exclusion criteria. Results are synthesized in terms of sample and setting, methodological features, interventions, and outcomes. Interventions broadly fit into five educational themes: testing strategies, cognitive biases, simulation programs, course formats, and instructional approaches.

DISCUSSION

Interventions are simple and can be implemented in multiple educational settings. Future research should occur in populations of NP students. Validated, easy-to-use measurement tools as well as more precise diagnostic reasoning concept development should occur.

Teaching clinical reasoning through hypothetico-deduction is (slightly) better than self-explanation in tutorial groups: An experimental study

BACKGROUND

Self-explanation while individually diagnosing clinical cases has proved to be an effective instructional approach for teaching clinical reasoning. The present study compared the effects on diagnostic performance of self-explanation in small groups with the more commonly used hypothetico-deductive approach.

METHODS

Second-year students from a six-year medical school in Saudi Arabia (39 males; 49 females) worked in small groups on seven clinical vignettes (four criterion cases representing cardiovascular diseases and three 'fillers', i.e. cases of other unrelated diagnoses). The students followed different approaches to work on each case depending on the experimental condition to which they had been randomly assigned. Under the self-explanation condition, students provided a diagnosis and a suitable pathophysiological explanation for the clinical findings whereas in the hypothetico-deduction condition students hypothesized about plausible diagnoses for signs and symptoms that were presented sequentially. One week later, all students diagnosed eight vignettes, four of which represented cardiovascular diseases. A mean diagnostic accuracy score (range: 0-1) was computed for the criterion cases. One-way ANOVA with experimental condition as between-subjects factor was performed on the mean diagnostic accuracy scores.

RESULTS

Students in the hypothetico-deduction condition outperformed those in the self-explanation condition (mean = 0.22, standard deviation = 0.14, mean = 0.17; standard deviation = 0.12; F(1, 88) = 4.90, p = 0.03, partial η² = 0.06, respectively).

CONCLUSIONS

Students in the hypothetico-deduction condition performed slightly better on a follow-up test involving similar cases, possibly because they were allowed to formulate more than one hypothesis per case during the learning phase.

The effect of self-explanation of pathophysiological mechanisms of diseases on medical students' diagnostic performance

Self-explanation while diagnosing clinical cases fosters medical students' diagnostic performance. In previous studies on self-explanation, students were free to self-explain any aspect of the case, and mostly clinical knowledge was used. Elaboration on knowledge of pathophysiological mechanisms of diseases has been largely unexplored in studies of strategies for teaching clinical reasoning. The purpose of this two-phase experiment was to investigate the effect of self-explanation of pathophysiology during practice with clinical cases on students' diagnostic performance. In the training phase, 39 4th-year medical students were randomly assigned to solve 6 criterion cases (3 of jaundice; 3 of chest pain), either self-explaining the pathophysiological mechanisms of the findings (n = 20) or without self-explaining (n = 19). One-week later, in the assessment phase, all students solved 6 new cases of the same syndromes. A repeated-measures analysis of variance on the mean diagnostic accuracy scores showed no significant main effects of study phase (p = 0.34) and experimental condition (p = 0.10) and no interaction effect (p = 0.42). A post hoc analysis found a significant interaction (p = 0.022) between study phase and syndrome type. Despite equal familiarity with jaundice and chest pain, the performance of the self-explanation group (but not of the non-self-explanation group) on jaundice cases significantly improved between training and assessment phases (p = 0.035) whereas no differences between phases emerged on chest pain cases. Self-explanation of pathophysiology did not improve students' diagnostic performance for all diseases. Apparently, the positive effect of this form of self-explanation on performance depends on the studied diseases sharing similar pathophysiological mechanisms, such as in the jaundice cases.

Examining the effect of self-explanation on cognitive integration of basic and clinical sciences in novices

Several studies have shown that cognitive integration of basic and clinical sciences supports diagnostic reasoning in novices; however, there has been limited exploration of the ways in which educators can translate this model of mental activity into sound instructional strategies. The use of self-explanation during learning has the potential to promote and support the development of integrated knowledge by encouraging novices to elaborate on the causal relationship between clinical features and basic science mechanisms. To explore the effect of this strategy, we compared diagnostic efficacy of teaching students (n = 71) the clinical features of four musculoskeletal pathologies using either (1) integrated causal basic science descriptions (BaSci group); (2) integrated causal basic science descriptions combined with self-explanation prompts (SE group); (3) basic science mechanisms segregated from the clinical features (SG group). All participants completed a diagnostic accuracy test immediately after learning and 1-week later. The results showed that the BaSci group performed significantly better compared to the SE (p = 0.019) and SG groups (p = 0.004); however, no difference was observed between the SE and SG groups (p = 0.91). We hypothesize that the structure of the self-explanation task may not have supported the development of a holistic conceptual understanding of each disease. These findings suggest that integration strategies need to be carefully structured and applied in ways that support the holistic story created by integrated basic science instruction in order to foster conceptual coherence and to capitalize on the benefits of cognition integration.

Development, Validation, and Implementation of a Medical Judgment Metric

Background: Medical decision making is a critical, yet understudied, aspect of medical education. Aims: To develop the Medical Judgment Metric (MJM), a numerical rubric to quantify good decisions in practice in simulated environments; and to obtain initial preliminary evidence of reliability and validity of the tool. Methods: The individual MJM items, domains, and sections of the MJM were built based on existing standardized frameworks. Content validity was determined by a convenient sample of eight experts. The MJM instrument was pilot tested in four medical simulations with a team of three medical raters assessing 40 participants with four levels of medical experience and skill. Results: Raters were highly consistent in their MJM scores in each scenario (intraclass correlation coefficient 0.965 to 0.987) as well as their evaluation of the expected patient outcome (Fleiss’s Kappa 0.791 to 0.906). For each simulation scenario, average rater cut-scores significantly predicted expected loss of life or stabilization (Cohen’s Kappa 0.851 to 0.880). Discussion: The MJM demonstrated preliminary evidence of reliability and validity.

The Educational Psychology of Clinical Training

Clinical training is paramount to the educational experience of learners, and the purpose of this training can be categorized into the following 4 categories of learning taxonomies: socialization, clinical reasoning, medical management of patient care and attitudinal change. This article investigates the educational psychology that provides the foundation of the categories of learning that take place in the clinical environment. Understanding this is critically important to create an opportunity for learners to activate their knowledge repertoire at the precise time of appropriate application.