A functional neuroimaging study of the clinical reasoning of medical students

Physical and biophysical markers of assessment in medical training: A scoping review of the literature

PURPOSE

Assessment in medical education has changed over time to measure the evolving skills required of current medical practice. Physical and biophysical markers of assessment attempt to use technology to gain insight into medical trainees' knowledge, skills, and attitudes. The authors conducted a scoping review to map the literature on the use of physical and biophysical markers of assessment in medical training.

MATERIALS AND METHODS

The authors searched seven databases on 1 August 2022, for publications that utilized physical or biophysical markers in the assessment of medical trainees (medical students, residents, fellows, and synonymous terms used in other countries). Physical or biophysical markers included: heart rate and heart rate variability, visual tracking and attention, pupillometry, hand motion analysis, skin conductivity, salivary cortisol, functional magnetic resonance imaging (fMRI), and functional near-infrared spectroscopy (fNIRS). The authors mapped the relevant literature using Bloom's taxonomy of knowledge, skills, and attitudes and extracted additional data including study design, study environment, and novice vs. expert differentiation from February to June 2023.

RESULTS

Of 6,069 unique articles, 443 met inclusion criteria. The majority of studies assessed trainees using heart rate variability (n = 160, 36%) followed by visual attention (n = 143, 32%), hand motion analysis (n = 67, 15%), salivary cortisol (n = 67, 15%), fMRI (n = 29, 7%), skin conductivity (n = 26, 6%), fNIRs (n = 19, 4%), and pupillometry (n = 16, 4%). The majority of studies (n = 167, 38%) analyzed non-technical skills, followed by studies that analyzed technical skills (n = 155, 35%), knowledge (n = 114, 26%), and attitudinal skills (n = 61, 14%). 169 studies (38%) attempted to use physical or biophysical markers to differentiate between novice and expert.

CONCLUSION

This review provides a comprehensive description of the current use of physical and biophysical markers in medical education training, including the current technology and skills assessed. Additionally, while physical and biophysical markers have the potential to augment current assessment in medical education, there remains significant gaps in research surrounding reliability, validity, cost, practicality, and educational impact of implementing these markers of assessment.

A scoping review of therapeutic reasoning process research

Therapeutic reasoning is when the purpose, task, or goal for engaging in reasoning is to determine the patient's management plan. As the field's understanding of the process of therapeutic reasoning is less well understood, we focused on studies that collected data on the process of therapeutic reasoning. To synthesize previous studies of therapeutic reasoning characteristics, methodological approaches, theoretical underpinnings, and results. We conducted a scoping review with systematic searching for English language articles with no date limits. Databases included MEDLINE, CINAHL Plus, Scopus, Embase, Proquest Dissertations and Theses Global, and ERIC. Search terms captured therapeutic reasoning in health professions education research. Initial search yielded 5450 articles. The title and abstract screening yielded 180 articles. After full-text review, 87 studies were included in this review. Articles were excluded if they were outside health professions education, did not collect data on the process of therapeutic reasoning, were not empirical studies, or not focused on therapeutic reasoning. We analyzed the included articles according to scoping questions using qualitative content analysis. 87 articles dated from 1987 to 2019 were included. Several study designs were employed including think-aloud protocol, interview and written documentation. More than half of the articles analyzed the data using qualitative coding. Authors often utilized several middle-range theories to explain therapeutic reasoning processes. The hypothetico-deductive model was most frequently mentioned. The included articles rarely built off the results from previous studies. Six key result categories were found: identifying themes, characterizing and testing previous local theory, exploring factors, developing new local theory, testing tools, and testing hypothesis. Despite the cast body of therapeutic reasoning research, individual study results remain isolated from previous studies. Our future recommendations include synthesizing pre-existing models, developing novel methodologies, and investigating other aspects of therapeutic reasoning.

Use of neuroimaging to measure neurocognitive engagement in health professions education: a scoping review

PURPOSE

To map the current literature on functional neuroimaging use in medical education research as a novel measurement modality for neurocognitive engagement, learning, and expertise development.

METHOD

We searched PubMed, Embase, Cochrane, ERIC, and Web of Science, and hand-searched reference lists of relevant articles on April 4, 2019, and updated the search on July 7, 2020. Two authors screened the abstracts and then full-text articles for eligibility based on inclusion criteria. The data were then charted, synthesized, and analyzed descriptively.

RESULTS

Sixty-seven articles published between 2007 and 2020 were included in this scoping review. These studies used three main neuroimaging modalities: functional magnetic resonance imaging, functional near-infrared spectroscopy, and electroencephalography. Most of the publications (90%, n = 60) were from the last 10 years (2011-2020). Although these studies were conducted in 16 countries, 68.7% (n = 46) were from three countries: the USA (n = 21), UK (n = 15), and Canada (n = 10). These studies were mainly non-experimental (74.6%, n = 50). Most used neuroimaging techniques to examine psychomotor skill development (57%, n = 38), but several investigated neurocognitive correlates of clinical reasoning skills (22%, n = 15).

CONCLUSION

This scoping review maps the available literature on functional neuroimaging use in medical education. Despite the heterogeneity in research questions, study designs, and outcome measures, we identified a few common themes. Included studies are encouraging of the potential for neuroimaging to complement commonly used measures in education research and may help validate/challenge established theoretical assumptions and provide insight into training methods. This review highlighted several areas for further research. The use of these emerging technologies appears ripe for developing precision education, establishing viable study protocols for realistic operational settings, examining team dynamics, and exploring applications for real-time monitoring/intervention during critical clinical tasks.

Learning to diagnose X-rays: a neuroscientific study of practice-related activation changes in the prefrontal cortex

OBJECTIVES

Medical expertise manifests itself by the ability of a physician to rapidly diagnose patients. How this expertise develops from a neural-activation perspective is not well understood. The objective of the present study was to investigate practice-related activation changes in the prefrontal cortex (PFC) as medical students learn to diagnose chest X-rays.

METHODS

The experimental paradigm consisted of a learning and a test phase. During the learning phase, 26 medical students were trained to diagnose four out of eight chest X-rays. These four cases were presented repeatedly and corrective feedback was provided. During the test phase, all eight cases were presented together with near- and far-transfer cases to examine whether participants' diagnostic learning went beyond simple rote recognition of the trained X-rays. During both phases, participants' PFC was scanned using functional near-infrared spectroscopy. Response time and diagnostic accuracy were recorded as behavioural indicators. One-way repeated measures ANOVA were conducted to analyse the data.

RESULTS

Results revealed that participants' diagnostic accuracy significantly increased during the learning phase (F=6.72, p<0.01), whereas their response time significantly decreased (F=16.69, p<0.001). Learning to diagnose chest X-rays was associated with a significant decrease in PFC activity (F=33.21, p<0.001) in the left dorsolateral prefrontal cortex, the orbitofrontal area, the frontopolar area and the frontal eye field. Further, the results of the test phase indicated that participants' diagnostic accuracy was significantly higher for the four trained cases, second highest for the near-transfer, third highest for the far-transfer cases and lowest for the untrained cases (F=167.20, p<0.001) and response time was lowest for the trained cases, second lowest for the near-transfer, third lowest for the far-transfer cases and highest for the untrained cases (F=9.72, p<0.001). In addition, PFC activity was lowest for the trained and near-transfer cases, followed by the far-transfer cases and highest for the untrained cases (F=282.38, p<0.001).

CONCLUSIONS

The results suggest that learning to diagnose X-rays is associated with a significant decrease in PFC activity. In terms of dual-process theory, these findings support the notion that students initially rely more on slow analytical system-2 reasoning. As expertise develops, system-2 reasoning transitions into faster and automatic system-1 reasoning.

Thinking fast or slow? Functional magnetic resonance imaging reveals stronger connectivity when experienced neurologists diagnose ambiguous cases

For ∼40 years, thinking about reasoning has been dominated by dual-process theories. This model, consisting of two distinct types of human reasoning, one fast and effortless and the other slow and deliberate, has also been applied to medical diagnosis. Medical experts are trained to diagnose patients based on their symptoms. When symptoms are prototypical for a certain diagnosis, practitioners may rely on fast, recognition-based reasoning. However, if they are confronted with ambiguous clinical information slower, analytical reasoning is required. To examine the neural underpinnings of these two hypothesized forms of reasoning, 16 highly experienced clinical neurologists were asked to diagnose two types of medical cases, straightforward and ambiguous cases, while functional magnetic resonance imaging was being recorded. Compared with reading control sentences, diagnosing cases resulted in increased activation in brain areas typically found to be active during reasoning such as the caudate nucleus and frontal and parietal cortical regions. In addition, we found vast increased activity in the cerebellum. Regarding the activation differences between the two types of reasoning, no pronounced differences were observed in terms of regional activation. Notable differences were observed, though, in functional connectivity: cases containing ambiguous information showed stronger connectivity between specific regions in the frontal, parietal and temporal cortex in addition to the cerebellum. Based on these results, we propose that the higher demands in terms of controlled cognitive processing during analytical medical reasoning may be subserved by stronger communication between key regions for detecting and resolving uncertainty.