Racial Implicit Bias and Communication Among Physicians in a Simulated Environment

Importance

Racial implicit bias can contribute to health disparities through its negative influence on physician communication with Black patients. Interventions for physicians to address racial implicit bias in their clinical encounters are limited by a lack of high-fidelity (realistic) simulations to provide opportunities for skill development and practice.

Objective

To describe the development and initial evaluation of a high-fidelity simulation of conditions under which physicians might be influenced by implicit racial bias.

Design, Setting, and Participants

This cross-sectional study, performed on an online platform from March 1 to September 30, 2022, recruited a convenience sample of physician volunteers to pilot an educational simulation.

Exposures

In the simulation exercise, physicians saw a 52-year-old male standardized patient (SP) (presenting as Black or White) seeking urgent care for epigastric pain, nausea, and vomiting. The case included cognitive stressors common to clinical environments, including clinical ambiguity, stress, time constraints, and interruptions. Physicians explained their diagnosis and treatment plan to the SP, wrote an assessment and management plan, completed surveys, and took the Race Implicit Association Test (IAT) and Race Medical Cooperativeness IAT. The SPs, blinded to the purpose of the study, assessed each physician's communication using skills checklists and global rating scales.

Main Outcomes and Measures

Association between physicians' IAT scores and SP race with SP ratings of communication skills.

Results

In 60 physicians (23 [38.3%] Asian, 4 [6.7%] Black, 23 [38.3%] White, and 10 [16.7%] other, including Latina/o/x, Middle Eastern, and multiracial; 31 [51.7%] female, 27 [45.0%] male, and 2 [3.3%] other), the interaction of physicians' Race IAT score and SP race was significant for overall communication (mean [SD] β = -1.29 [0.41]), all subdomains of communication (mean [SD] β = -1.17 [0.52] to -1.43 [0.59]), and overall global ratings (mean [SD] β = -1.09 [0.39]). Black SPs rated physicians lower on communication skills for a given pro-White Race IAT score than White SPs; White SP ratings increased as physicians' pro-White bias increased.

Conclusions and Relevance

In this cross-sectional study, a high-fidelity simulation calibrated with cognitive stressors common to clinical environments elicited the expected influence of racial implicit bias on physicians' communication skills. The outlined process and preliminary results can inform the development and evaluation of interventions that seek to address racial implicit bias in clinical encounters and improve physician communication with Black patients.

Viewing Readiness-for-Residency through Binoculars: Mapping Competency-Based Assessments to the AAMC's 13 Core Entrustable Professional Activities (EPAs)

Construct: The construct being assessed is readiness-for-residency of graduating medical students, as measured through two assessment frameworks. Background: Readiness-for-residency of near-graduate medical students should be but is not consistently assessed. To address this, the Association of American Medical Colleges (AAMC), in 2014, identified and described 13 core Entrustable Professional Activities (EPAs), which are tasks that all residents should be able to perform unsupervised upon entering residency. However, the AAMC did not initially provide measurement guidelines or propose standardized assessments. We designed Night-onCall (NOC), an immersive simulation for our near-graduating medical students to assess and address their readiness-for-residency, framed around tasks suggested by the AAMC's core EPAs. In adopting this EPA assessment framework, we began by building upon an established program of competency-based clinical skills assessments, repurposing competency-based checklists to measure components of the EPAs where possible, and designing new checklists, when necessary. This resulted in a blended suite of 14 checklists, which theoretically provide substantive assessment of all 13 core EPAs. In this paper, we describe the consensus-based mapping process conducted to ensure we understood the relationship between competency and EPA-based assessment lenses and could therefore report meaningful feedback on both to transitioning students in the NOC exercise. Approach: Between January-November 2017, five clinician and two non-clinician health professions educators at NYU Grossman School of Medicine conducted a rigorous consensus-based mapping process, which included each rater mapping each of the 310 NOC competency-based checklist items to lists of entrustable behaviors expected of learners according to the AAMC 13 core EPAs. Findings: All EPAs were captured to varying degrees by the 14 NOC checklists (overall Intraclass Correlation Coefficient (ICC) = 0.77). Consensus meetings resolved discrepancies and improved ICC values for three (EPA-9, EPA-10, EPA-12) of the four EPAs that initially showed poor reliability. Conclusions: Findings suggest that with some limitations (e.g., EPA-7 "form clinical questions/retrieve evidence") established competency-based assessments can be repurposed to measure readiness-for-residency through an EPA lens and both can be reported to learners and faculty.

REACH: A Required Curriculum to Foster the Well-Being of Medical Students

PROBLEM

The extent of medical student unwellness is well documented. Learner distress may impact patient care, workforce adequacy, and learners' performance and personal health. The authors describe the philosophy, structure, and content of the novel REACH (Recognize, Empathize, Allow, Care, Hold each other up) curriculum and provide a preliminary evaluation.

APPROACH

The REACH curriculum is a mandatory, longitudinal well-being curriculum for first- and second-year medical students at the Medical College of Wisconsin (MCW) designed to prepare them for the emotional life of being a physician. The curriculum uses a framework, core concepts, and skills from the field of trauma stewardship. It builds on effective medical student well-being interventions (e.g., mindfulness-based training) and the sharing of personal stories by instructors during didactic and small-group sessions that are integrated into the regular MCW curriculum. During the first 2 years of implementation (2018-2019 and 2019-2020), the curriculum was evaluated using mid- and postcurriculum student surveys.

OUTCOMES

Over 700 students have completed the REACH curriculum as of March 2022. Overall, most students who responded to the surveys in 2018-2020 reported that they felt the REACH curriculum material was important, that the curriculum met their expectations for a quality medical school course, and that they would recommend other schools incorporate a similar curriculum. Respondents to the 2019-2020 postcurriculum survey indicated the REACH curriculum helped them develop self-care (84% [85/101]), mindfulness (76% [76/101]), and help-seeking (71% [72/101]) skills.

NEXT STEPS

The initial outcomes show that integrating a mandatory well-being curriculum is feasible and acceptable to medical students. The authors plan to examine the relationships between student-reported well-being metrics, academic and clinical performance data, and professional identity formation. They are also prototyping electronic dashboards that will allow students to interact with their well-being data to promote timely help-seeking and behavior change.

From Stigma to Validation: A Qualitative Assessment of a Novel National Program to Improve Retention of Physician-Scientists with Caregiving Responsibilities

Background: Research is needed to improve understanding of work-life integration issues in academic medicine and to guide the implementation of the Doris Duke Charitable Foundation's Fund to Retain Clinical Scientists (FRCS), a national initiative offering financial support to physician-scientists facing caregiving challenges. Materials and Methods: In 2018, as part of a prospective program evaluation, the authors conducted a qualitative study to examine FRCS program participants' initial impressions, solicit descriptions of their career and caregiving experiences, and inquire how such factors might influence their professional advancement. The authors invited all 33 awardees who had been granted FRCS funding in the first year of the program to participate in the study, of whom 28 agreed to complete an interview. Analysts evaluated de-identified transcripts and explicated the data using a thematic analysis approach. Results: While participants described aspects of a culture that harbor stigma against caregivers and impede satisfactory work-life integration, they also perceived an optimistic cultural shift taking place as a result of programs like the FRCS. Their comments indicated that the FRCS has the potential to influence culture if institutional leadership simultaneously fosters a community that validates individuals both as caregivers and as scientists. Conclusions: Insights garnered from this qualitative study suggest that there is a pressing need for institutional leaders to implement programs that can foster awareness and normalization of caregiving challenges. In addition to providing funding and other tangible resources, interventions should strive to reinforce a broader culture that affirms the presence of work-life integration challenges and openly embraces solutions.

Defining and Adopting Clinical Performance Measures in Graduate Medical Education: Where Are We Now and Where Are We Going?

Assessment and evaluation of trainees' clinical performance measures is needed to ensure safe, high-quality patient care. These measures also aid in the development of reflective, high-performing clinicians and hold graduate medical education (GME) accountable to the public. Although clinical performance measures hold great potential, challenges of defining, extracting, and measuring clinical performance in this way hinder their use for educational and quality improvement purposes. This article provides a way forward by identifying and articulating how clinical performance measures can be used to enhance GME by linking educational objectives with relevant clinical outcomes. The authors explore four key challenges: defining as well as measuring clinical performance measures, using electronic health record and clinical registry data to capture clinical performance, and bridging silos of medical education and health care quality improvement. The authors also propose solutions to showcase the value of clinical performance measures and conclude with a research and implementation agenda. Developing a common taxonomy of uniform specialty-specific clinical performance measures, linking these measures to large-scale GME databases, and applying both quantitative and qualitative methods to create a rich understanding of how GME affects quality of care and patient outcomes is important, the authors argue. The focus of this article is primarily GME, yet similar challenges and solutions will be applicable to other areas of medical and health professions education as well.

Situating Remediation: Accommodating Success and Failure in Medical Education Systems

There has been a widespread shift to competency-based medical education (CBME) in the United States and Canada. Much of the CBME discourse has focused on the successful learner, with relatively little attention paid to what happens in CBME systems when learners stumble or fail. Emerging issues, such as the well-documented problem of "failure to fail" and concerns about litigious learners, have highlighted a need for well-defined and integrated frameworks to support and guide strategic approaches to the remediation of struggling medical learners.This Perspective sets out a conceptual review of current practices and an argument for a holistic approach to remediation in the context of their parent medical education systems. The authors propose parameters for integrating remediation into CBME and describe a model based on five zones of practice along with the rules of engagement associated with each zone. The zones are "normal" curriculum, corrective action, remediation, probation, and exclusion.The authors argue that, by linking and integrating theory and practice in remediation with CBME, a more integrated systems-level response to differing degrees of learner difficulty and failure can be developed. The proposed model demonstrates how educational practice in different zones is based on different rules, roles, responsibilities, and thresholds for moving between zones. A model such as this can help medical educators and medical education leaders take a more integrated approach to learners' failures as well as their successes by being more explicit about the rules of engagement that apply in different circumstances across the competency continuum.

Military service and other socioecological factors influencing weight and health behavior change in overweight and obese Veterans: a qualitative study to inform intervention development within primary care at the United States Veterans Health Administration

BACKGROUND

Obesity affects 37 % of patients at Veterans Health Administration (VHA) medical centers. The VHA offers an intensive weight management program (MOVE!) but less than 10 % of eligible patients ever attend. However, VHA patients see their primary care provider about 3.6 times per year, supporting the development of primary care-based weight management interventions. To address gaps in the literature regarding Veterans' experiences with weight management and determine whether and how to develop a primary care-based weight management intervention to both improve obesity counseling and increase attendance to MOVE!, we conducted a qualitative study to assess: 1) Veterans' personal experiences with healthy weight-related behavior change (including barriers and facilitators to behavior change and experiences with primary care providers, staff, and the MOVE! program), and 2) potential new approaches to improve weight management within primary care at the VHA including goal setting and technology.

METHODS

Overweight/obese VHA patients (aged 18-75, BMI greater than 30 or greater than 25 with at least 1 co-morbidity) were recruited for focus group sessions stratified by gender, MOVE! referral, and attendance. Each session was facilitated by a trained moderator, audio-recorded, and professionally transcribed. Using an iterative coding approach, two coders separately reviewed and coded transcripts, and met frequently to negotiate codes and synthesize emerging themes.

RESULTS

Of 161 eligible patients, 54 attended one of 6 focus groups (2 female, 4 male, 9-11 participants per session): 63 % were male, 46 % identified as African-American, 32 % White/Caucasian, 74 % were college-educated or higher, and 61 % reported having attended MOVE!. We identified two major themes: Impact of Military Service and Promotion and Sustainability of Healthy Behaviors. After service in a highly structured military environment, Veterans had difficulty maintaining weight on their own. They perceived physical activity as having more impact than diet, but chronic pain was a barrier. We identified individual/interpersonal-, community/environment-, and healthcare system-related factors affecting healthy behaviors. We also received input about Veteran's preferences and experiences with technology and setting health goals.

CONCLUSIONS

Unique factors influence weight management in Veterans. Findings will inform development of a technology-assisted weight management intervention with tailored counseling and goal-setting within primary care at the VHA.

Barriers and facilitators to providing primary care-based weight management services in a patient centered medical home for Veterans: a qualitative study

Background

Obesity is highly prevalent among Veterans. In the United States, the Veterans Health Administration (VHA) offers a comprehensive weight management program called MOVE!. Yet, fewer than 10 % of eligible patients ever attend one MOVE! visit. The VHA has a patient-centered medical home (PCMH) model of primary care (PC) called Patient-Aligned Care Teams (PACT) at all Veterans Affairs (VA) Medical Centers. PACT teamlets conduct obesity screening, weight management counseling, and refer to MOVE!. As part of a needs assessment to improve delivery of weight management services, the purpose of this study was to assess PACT teamlet and MOVE! staff: 1) current attitudes and perceptions regarding obesity care; 2) obesity-related counseling practices 3) experiences with the MOVE! program; and 4) targets for interventions to improve implementation of obesity care in the PC setting.

Methods

We recruited 25 PACT teamlet members from a single VA study site—11 PC physicians, 5 registered nurses, 5 licensed practical nurses, 1 clerical assistant, and 3 MOVE! staff (2 dietitians, 1 psychologist)—for individual interviews using a combination of convenience and snowball sampling. Audio recorded interviews were professionally transcribed and iteratively coded by two independent reviewers. The analytic process was guided by discourse analysis in order to discover how the participants perceived and provided weight management care and what specific attitudes affected their practices, all as bounded within the organization.

Results

Emerging themes included: 1) role perceptions, 2) anticipated outcomes of weight management counseling and programs, and 3) communication and information dissemination. Perceived role among PCPs was influenced by training, whereas personal experience with their own weight management impacted role perception among LPNs/RNs. Attitudes about whether or not they could impact patients’ weight outcomes via counseling or referral to MOVE! varied. System-level communication about VHA priorities through electronic health records and time allocation influenced teams to prioritize referral to MOVE! over weight management counseling.

Conclusion

We found a diversity of attitudes, and practices within PACT, and identified factors that can enhance the MOVE! program and inform interventions to improve weight management within primary care. Although findings are site-specific, many are supported in the literature and applicable to other VA and non-VA sites with PCMH models of care.

Twelve tips for improving the effectiveness of web-based multimedia instruction for clinical learners

Using educational technology does not necessarily make medical education more effective. There are many different kinds of technology available to the contemporary medical teacher and what constitutes effective use may depend on the technology, the learning situation and many other factors. Web-based multimedia instruction (WBMI) provides learners with self-directed independent learning opportunities based on didactic material enhanced with multimedia features such as video and animations. WBMI may be used to replace other didactic events (e.g. lectures) or it may be provided in addition to other learning opportunities. Clinical educators looking to use WBMI need to make sure that it will meet both their learners' needs and the program's needs, and it has to align to the contexts in which it is used. The following 12 tips have been developed to help guide faculty through some of the key features of the effective use of WBMI in clinical teaching programs. These tips are based on more than a decade developing, using and appraising WBMI in support of surgical clerkship education across the USA and beyond and they are intended both to inform individual uses of WBMI in clinical training and to guide the strategic use of WBMI in clinical clerkship curricula.

Context matters: emergent variability in an effectiveness trial of online teaching modules

CONTEXT

Conducting research in real life settings (effectiveness studies) can introduce many confounding factors. Efficacy studies seek to control for researcher bias and data quality rather than considering how the efficacy of an intervention is changed by the contexts in which it is used. Relatively little is known about the impact of context on educational interventions, in particular on multimedia learning.

METHODS

An effectiveness study to understand implementation variance of online educational modules in surgery clerkships was conducted in six US medical schools participating in an efficacy trial of different multimedia designs. Student and teacher experiences were captured through focus groups and one-to-one interviews with trial participants and their teachers. Audio-recordings of these sessions were transcribed and analysed using grounded theory techniques.

RESULTS

Differences were identified in student and teacher perceptions of how the educational intervention had been implemented and how its uptake had been influenced by context-dependent factors: (i) the intervention was implemented in different ways to suit different educational contexts and this influenced how students and teachers responded to it; (ii) the ways students and teachers interacted with, and behaved around, the intervention influenced its uptake; (iii) the way the intervention was perceived by students and teachers influenced its uptake; and (iv) the medium and design of the intervention had a directing influence on its uptake.

CONCLUSIONS

It was observed that each institutional context formed a complex educational ecology. The intervention became interwoven with different educational ecologies so that it could no longer be considered a stable variable across the study. We suggest that researchers should conduct implementation-profiling studies in advance of any intervention-based research to account for the constructing nature of educational ecologies on their interventions and in doing so to more clearly differentiate between efficacy and effectiveness studies.

The cognitive impact of interactive design features for learning complex materials in medical education

To identify the most effective way for medical students to interact with a browser-based learning module on the symptoms and neurological underpinnings of stroke syndromes, this study manipulated the way in which subjects interacted with a graphical model of the brain and examined the impact of functional changes on learning outcomes. It was hypothesized that behavioral interactions that were behaviorally more engaging and which required deeper consideration of the model would result in heightened cognitive interaction and better learning than those whose manipulation required less deliberate behavioral and cognitive processing. One hundred forty four students were randomly assigned to four conditions whose model controls incorporated features that required different levels of behavioral and cognitive interaction: Movie (low behavioral/low cognitive, n = 40), Slider (high behavioral/low cognitive, n = 36), Click (low behavioral/high cognitive, n = 30), and Drag (high behavioral/high cognitive, n = 38). Analysis of Covariates (ANCOVA) showed that students who received the treatments associated with lower cognitive interactivity (Movie and Slider) performed better on a transfer task than those receiving the module associated with high cognitive interactivity (Click and Drag, partial eta squared = .03). In addition, the students in the high cognitive interactivity conditions spent significantly more time on the stroke locator activity than other conditions (partial eta squared = .36). The results suggest that interaction with controls that were tightly coupled with the model and whose manipulation required deliberate consideration of the model's features may have overtaxed subjects' cognitive resources. Cognitive effort that facilitated manipulation of content, though directed at the model, may have resulted in extraneous cognitive load, impeding subjects in recognizing the deeper, global relationships in the materials. Instructional designers must, therefore, keep in mind that the way in which functional affordances are integrated with the content can shape both behavioral and cognitive processing, and has significant cognitive load implications.

When surgeons decide to become surgeons: new opportunities for surgical education

BACKGROUND

When surgeons decide to become surgeons has important implications. If the decision is made prior to or early in medical school, surgical education can be more focused on surgical diseases and resident skills.

METHODS

To determine when surgeons - compared with their nonsurgical colleagues - decide on their medical path, residents in surgery, internal medicine, obstetrics and gynecology, pediatrics, psychiatry, and emergency medicine were surveyed. Timing of residency choice, demographic data, personal goals, and reason for residency choice were queried.

RESULTS

A total of 234 residents responded (53 surgical residents). Sixty-two percent of surgeons reported that they were "fairly certain" of surgery before medical school, 13% decided during their preclinical years, and 25% decided during their clerkship years. This compares with an aggregate 40%, 7%, and 54%, respectively, for the other 5 residency specialties. These differences were statistically significant (P = .001). When the 234 residents were asked about their primary motivation for choosing their field, 51% pointed to expected job satisfaction and 44% to intellectual curiosity, and only 3% mentioned lifestyle, prestige, or income.

CONCLUSIONS

General surgery residents decide on surgery earlier than residents in other programs. This may be advantageous, resulting in fast-tracking of these medical students in acquiring surgical knowledge, undertaking surgical research, and early identification for surgical residency programs. Surgical training in the era of the 80-hour work week could be enhanced if medical students bring much deeper knowledge of surgery to their first day of residency.

Medical students as human subjects in educational research

INTRODUCTION

Special concerns often arise when medical students are themselves the subjects of education research. A recently completed large, multi-center randomized controlled trial of computer-assisted learning modules for surgical clerks provided the opportunity to explore the perceived level of risk of studies where medical students serve as human subjects by reporting on: 1) the response of Institutional Review Boards (IRBs) at seven institutions to the same study protocol; and 2) the thoughts and feelings of students across study sites about being research subjects.

METHODS

From July 2009 to August 2010, all third-year medical students at seven collaborating institutions were eligible to participate. Patterns of IRB review of the same protocol were compared. Participation burden was calculated in terms of the time spent interacting with the modules. Focus groups were conducted with medical students at each site. Transcripts were coded by three independent reviewers and analyzed using Atlas.ti.

RESULTS

The IRBs at the seven participating institutions granted full (n=1), expedited (n=4), or exempt (n=2) review of the WISE Trial protocol. 995 (73% of those eligible) consented to participate, and 207 (20%) of these students completed all outcome measures. The average time to complete the computer modules and associated measures was 175 min. Common themes in focus groups with participant students included the desire to contribute to medical education research, the absence of coercion to consent, and the low-risk nature of the research.

DISCUSSION

Our findings demonstrate that risk assessment and the extent of review utilized for medical education research vary among IRBs. Despite variability in the perception of risk implied by differing IRB requirements, students themselves felt education research was low risk and did not consider themselves to be vulnerable. The vast majority of eligible medical students were willing to participate as research subjects. Participants acknowledged the time demands of their participation and were readily able to withdraw when those burdens became unsustainable.

The impact of primary care resident physician training on patient weight loss at 12 months

OBJECTIVE

It is unclear whether training physicians to counsel obese patients leads to weight loss. This study assessed whether a 5-h multimodal longitudinal obesity curriculum for residents on the basis of the 5As (assess, advise, agree, assist, and arrange) was associated with weight loss in their obese patients.

DESIGN AND METHODS

Twenty-three primary care internal medicine residents were assigned by rotation schedule to intervention (curriculum) or control groups. We then conducted follow-up chart reviews to determine weight change at up to 12 months following the index visit. 158 obese patients (76 in the intervention group and 82 in the control group) completed exit interviews; 22 patients who presented for acute care at the index visit were excluded. Chart reviews were conducted on the 46 patients in the intervention group and 41 patients in the control group who were seen again within 12 months of the index visit and had follow-up weight measurements.

RESULTS

The main outcome of interest was mean change in weight at 12 months compared between the intervention and control groups. Patients of residents in the intervention group had a mean weight loss of -1.53 kg (s.d. = 3.72) although the patients of those in the control group had a mean weight gain of 0.30 kg (s.d. = 3.60), P = 0.03. Six (15.8%) patients in the intervention group and 2 (5.4%) patients in the control group lost >5% body weight (P = 0.14).

CONCLUSIONS

Although the magnitude of weight loss was small, this study shows that training physicians to counsel patients can produce measurable patient outcomes.

Engaging health professional students in substance abuse research: development and early evaluation of the SARET program

OBJECTIVE

There is a need to build the ranks of health care professionals engaged in substance abuse (SA)-focused clinical research. The authors simultaneously developed and evaluated SARET, the Substance Abuse Research Education and Training program. The fundamental goal of this interprofessional program is to stimulate medical, dental, and nursing student interest and experience in SA research. Evaluation aims to understand program feasibility and acceptability and to assess short-term impact.

METHODS

SARET comprises 2 main components: stipend-supported research mentorships and a Web-based module series, consisting of 6, interactive, multimedia modules addressing core SA research topics, delivered via course curricula and in the research mentorships. Authors assessed program feasibility and impact on student interest in conducting SA research by tracking participation and conducting participant focus groups and online surveys.

RESULTS

Thirty early health care professional students completed mentorships (25 summer, 5 yearlong) and 1324 completed at least 1 Web-module. SARET was considered attractive for the opportunity to conduct clinically oriented research and to work with health care professionals across disciplines. Mentorship students reported positive impact on their vision of SA-related clinical care, more positive attitudes about research, and, in some cases, change in career plans. Web-based modules were associated with enhanced interest in SA (35% increase, P = 0.005, in those somewhat/very interested for neurobiology module) and SA research (+38%, P < 0.001 for activation, +45%, P < 0.001 for personal impact, +7%, P = 0.089 for neurobiology).

CONCLUSIONS

The SARET program stimulates SA clinical and research interest among students of nursing, medicine, and dentistry and may lend itself to dissemination.

Just enough, but not too much interactivity leads to better clinical skills performance after a computer assisted learning module

BACKGROUND

Well-designed computer-assisted instruction (CAI) can potentially transform medical education. Yet little is known about whether specific design features such as direct manipulation of the content yield meaningful gains in clinical learning. We designed three versions of a multimedia module on the abdominal exam incorporating different types of interactivity.

METHODS

As part of their physical diagnosis course, 162 second-year medical students were randomly assigned (1:1:1) to Watch, Click or Drag versions of the abdominal exam module. First, students' prior knowledge, spatial ability, and prior experience with abdominal exams were assessed. After using the module, students took a posttest; demonstrated the abdominal exam on a standardized patient; and wrote structured notes of their findings.

RESULTS

Data from 143 students were analyzed. Baseline measures showed no differences among groups regarding prior knowledge, experience, or spatial ability. Overall there was no difference in knowledge across groups. However, physical exam scores were significantly higher for students in the Click group.

CONCLUSIONS

A mid-range level of behavioral interactivity was associated with small to moderate improvements in performance of clinical skills. These improvements were likely mediated by enhanced engagement with the material, within the bounds of learners' cognitive capacity. These findings have implications for the design of CAI materials to teach procedural skills.

Perspective: Malpractice in an academic medical center: a frequently overlooked aspect of professionalism education

Understanding how medical malpractice occurs and is resolved is important to improving patient safety and preserving the viability of a physician's career in academic medicine. Every physician is likely to be sued by a patient, and how the physician responds can change his or her professional life. However, the principles of medical malpractice are rarely taught or addressed during residency training. In fact, many faculty at academic medical centers know little about malpractice.In this article, the authors propose that information about the inciting causes of malpractice claims and their resolution should be incorporated into residency professionalism curricula both to improve patient safety and to decrease physician anxiety about a crucial aspect of medicine that is not well understood. The authors provide information on national trends in malpractice litigation and residents' understanding of malpractice, then share the results of their in-depth review of surgical malpractice claims filed during 2001-2008 against their academic medical center. The authors incorporated those data into an evidence-driven curriculum for residents, which they propose as a model for helping residents better understand the events that lead to malpractice litigation, as well as its process and prevention.

Assessing medical students' self-regulation as aptitude in computer-based learning

We developed a Self-Regulation Measure for Computer-based learning (SRMC) tailored toward medical students, by modifying Zimmerman's Self-Regulated Learning Interview Schedule (SRLIS) for K-12 learners. The SRMC's reliability and validity were examined in 2 studies. In Study 1, 109 first-year medical students were asked to complete the SRMC. Bivariate correlation analysis results indicated that the SRMC scores had a moderate degree of correlation with student achievement in a teacher-developed test. In Study 2, 58 third-year clerkship students completed the SRMC. Regression analysis results indicated that the frequency of medical students' usage of self-regulation strategies was associated with their general clinical knowledge measured by a nationally standardized licensing exam. These two studies provided evidence for the reliability and concurrent validity of the SRMC to assess medical students' self-regulation as aptitude. Future work should provide evidence to guide and improve instructional design as well as inform educational policy.

Undergraduate medical education in substance abuse: a review of the quality of the literature

PURPOSE

To prepare to develop a medical school curriculum on substance abuse disorders (SADs), the authors conducted a review of the quality of the sparse published literature.

METHOD

The authors searched MEDLINE (1950 through December 2008) using OVID, PsycINFO, and PubMed to identify all studies of SAD interventions targeted toward undergraduate medical students. Of the 1,084 studies identified initially, 31 reported sufficient data to allow the authors to evaluate quality using Medical Education Research Study Quality Instrument (MERSQI) scores. The authors also determined the impact of the studies by considering three-year citation rate and journal impact factor. A detailed review of the literature provided data on contact hours and intervention content.

RESULTS

The three-rater intraclass correlation coefficient for total MERSQI score was 0.82 (95% confidence interval: 0.70-0.90). The mean MERSQI score was 10.42 of a possible 18 (SD 2.59; range: 6.33-14.83). MERSQI scores were higher for more recently published studies and correlated with three-year citation rate but not impact factor. The mean contact time for 26 studies was 29.25 hours (range: 0.83-200 hours).

CONCLUSIONS

The literature provides a variety of educational methods to train medical students in SAD detection and intervention skills. This literature is of variable quality and provides limited guidance for development of curricula and medical education policy. Better methods of curriculum evaluation and publication guidelines would help ensure that this literature has a positive impact on educational practice and public health.

New measures to establish the evidence base for medical education: identifying educationally sensitive patient outcomes

Researchers lack the rich evidence base and benchmark patient outcomes needed to evaluate the effectiveness of medical education practice and guide policy. The authors offer a framework for medical education research that focuses on physician-influenced patient outcomes that are potentially sensitive to medical education. Adapting the concept of ambulatory care sensitive conditions, which provided traction to health services research by defining benchmark patient outcomes to measure health system performance, the authors introduce the concept and propose the adoption of educationally sensitive patient outcomes and suggest two measures: patient activation and clinical microsystem activation. They assert that the ultimate goal of medical education is to ensure that measurement of future physicians' competence and skills is based not only on biomedical knowledge and critical clinical skills but also on the ability to translate these competencies into effective patient- and systems-level outcomes. The authors consider methodological approaches and challenges to measuring such outcomes and argue for large, multiinstitutional, prospective cohort studies and the development of a national Database for Research in Education in Academic Medicine to provide the needed infrastructure. They advocate taking the next steps to establish an educational evidence base to guide the academic medical centers of the 21st century in aligning medical education practice with health care delivery that meets the needs of individuals and populations.

Two decades of Title VII support of a primary care residency: process and outcomes

PURPOSE

To assess 23 years of Health Resources and Services Administration (HRSA) Title VII Training in Primary Care Medicine and Dentistry funding to the New York University School of Medicine/Bellevue Primary Care Internal Medicine Residency Program. The program, begun in 1983 within a traditional, inner-city, subspecialty-oriented internal medicine program, evolved into a crucible of systematic innovation, catalyzed and made feasible by initiatives funded by the HRSA. The curriculum stressed three pillars of generalism: psychosocial medicine, clinical epidemiology, and health policy. It developed tight, objectives-driven, effective, nonmedical specialty blocks and five weekly primary care activities that created a paradigm-driven, community-based, role-modeling matrix. Innovation was built in. Every block and activity was evaluated immediately and in an annual, program-wide retreat. Evaluation evolved from behavioral checklists of taped interviews to performance-based, systematic, annual objective structured clinical examinations.

METHOD

The authors reviewed eight grant proposals, project reports, and curriculum and program evaluations. They also quantitatively and qualitatively surveyed the 122 reachable graduates from the first 20 graduating classes of the program.

RESULTS

Analysis of program documents revealed recurring emphases on the use of proven educational models, strategic innovation, and assessment and evaluation to design and refine the program. There were 104 respondents (85%) to the survey. A total of 87% of the graduates practice as primary care physicians, 83% teach, and 90% work with the underserved; 54% do research, 36% actively advocate on health issues for their patients, programs, and other constituencies, and 30% publish. Graduates cited work in the community and faculty excitement and energy as essential elements of the program's impact; overall, graduates reported high personal and career satisfaction and low burnout.

CONCLUSIONS

With HRSA support, a focused, innovative program evolved which has already met each of the six recommendations for future innovation of the Alliance for Academic Internal Medicine Education Redesign Task Force. This article is part of a theme issue of Academic Medicine on the Title VII health professions training programs.

Proposed standards for medical education submissions to the Journal of General Internal Medicine

To help authors design rigorous studies and prepare clear and informative manuscripts, improve the transparency of editorial decisions, and raise the bar on educational scholarship, the Deputy Editors of the Journal of General Internal Medicine articulate standards for medical education submissions to the Journal. General standards include: (1) quality questions, (2) quality methods to match the questions, (3) insightful interpretation of findings, (4) transparent, unbiased reporting, and (5) attention to human subjects' protection and ethical research conduct. Additional standards for specific study types are described. We hope these proposed standards will generate discussion that will foster their continued evolution.

What do resident physicians know about nutrition? An evaluation of attitudes, self-perceived proficiency and knowledge

OBJECTIVE

Despite the increased emphasis on obesity and diet-related diseases, nutrition education remains lacking in many internal medicine training programs. We evaluated the attitudes, self-perceived proficiency, and knowledge related to clinical nutrition among a cohort of internal medicine interns.

METHODS

Nutrition attitudes and self-perceived proficiency were measured using previously validated questionnaires. Knowledge was assessed with a multiple-choice quiz. Subjects were asked whether they had prior nutrition training.

RESULTS

Of the 114 participants, 61 (54%) completed the survey. Although 77% agreed that nutrition assessment should be included in routine primary care visits, and 94% agreed that it was their obligation to discuss nutrition with patients, only 14% felt physicians were adequately trained to provide nutrition counseling. There was no correlation among attitudes, self-perceived proficiency, or knowledge. Interns previously exposed to nutrition education reported more negative attitudes toward physician self-efficacy (p = 0.03).

CONCLUSIONS

Internal medicine interns' perceive nutrition counseling as a priority, but lack the confidence and knowledge to effectively provide adequate nutrition education.

Using Bedside Rounds to Teach Communication Skills in the Internal Medicine Clerkship

BACKGROUND

Physicians' communication skills, which are linked to important patient outcomes, are rarely explicitly taught during the clinical years of medical school. This paper describes the development, implementation, and evaluation of a communication skills curriculum during the third-year Internal Medicine Clerkship.

METHODS

In four two-hour structured bedside rounds with trained Internal Medicine faculty facilitators, students learned core communication skills in the context of common challenging clinical situations. In an end-of-clerkship survey students evaluated the curriculum's educational effectiveness.

RESULTS

Over the course of a year, 160 third-year students and 15 faculty participated. Of the 75/160 (47%) of students who completed the post-clerkship survey, almost all reported improvement in their communication skills and their ability to deal with specific communication challenges.

CONCLUSIONS

The curriculum appears to be a successful way to reinforce core communication skills and practice common challenging situations students encounter during the Internal Medicine Clerkship.

Promoting professionalism through an online professional development portfolio: successes, joys, and frustrations

Medical educators strive to promote the development of a sound professional identity in learners, yet it is challenging to design, implement, and sustain fair and meaningful assessments of professionalism to accomplish this goal. The authors developed and implemented a program built around a Web-based Professional Development Portfolio (PDP) to assess and document professional development in medical students at New York University School of Medicine. This program requires students to regularly document their professional development through written reflections on curricular activities spanning preclinical and clinical years. Students post reflections, along with other documents that chronicle their professional growth, to their online PDP. Students meet annually with a faculty mentor to review their portfolios, assess their professional development based on predetermined criteria, and establish goals for the coming year. In this article, the authors describe the development of the PDP and share four years of experience with its implementation. We describe the experiences and attitudes of the first students to participate in this program as reported in an annual student survey. Students' experiences of and satisfaction with the PDP was varied. The PDP has been a catalyst for honest and lively debate concerning the meaning and behavioral manifestations of professionalism. A Web-based PDP promoted self-regulation on an individual level because it facilitated narrative reflection, self-assessment, and goal setting, and it structured mentorship. Therefore, the PDP may prepare students for the self-regulation of the medical profession--a privilege and obligation under the physician's social contract with society.

Preliminary evaluation of the Web Initiative for Surgical Education (WISE-MD)

BACKGROUND

Major changes in health care delivery and financing have negatively impacted students' experience during the surgery clerkship, particularly their exposure to physicians' decision-making processes and to the continuity of patient care. In response to these dilemmas in surgical education, we have developed the Web Initiative for Surgical Education (WISE-MD), a comprehensive surgery clerkship curriculum delivered through multimedia teaching modules and designed to enhance exposure to surgical disease and clinical reasoning.

METHODS

As part of the process of creating WISE-MD, we conducted preliminary studies to assess the impact of this computer-assisted approach on students' knowledge, clinical reasoning, and satisfaction.

RESULTS

Compared to students who did not view the modules, early data show a trend toward improved knowledge and an improvement in clinical reasoning for students who used the WISE-MD modules. This effect was specific to the clinical content area addressed in the module seen by the students. Most students felt the module was superior to traditional teaching methods and enhanced their understanding of surgical technique and anatomy.

CONCLUSIONS

WISE-MD, a theory-driven example of a concerted technology-based approach to surgical education, has the potential to address the myriad problems of today's clinical learning environment.

Medical training in school-based health centers: a collaboration among five medical schools

School-based health centers (SBHCs) have tremendous untapped potential as models for learning about systems-based care of vulnerable children. SBHCs aim to provide comprehensive, community-based primary health care to primary and secondary schoolchildren who might not otherwise have ready access to that care. The staffing at SBHCs is multidisciplinary, including various combinations of nurse practitioners, physicians, dentists, nutritionists, and mental health providers. Although this unique environment provides obvious advantages to children and their families, medical students and residents receive little or no preparation for this type of practice. To address these deficiencies in medical education, five downstate New York state medical schools, funded by the New York State Department of Health, collaborated to define, develop, implement, and evaluate curricula that expose health professions students and residents to SBHCs. The schools identified core competencies and developed a comprehensive training model for the project, including clinical experiences, didactic sessions, and community service opportunities, and they developed goals, objectives, and learning materials for each competency for all types and levels of learners. Each school has implemented a wide range of learning activities based on the competencies. In this paper, the authors describe the development of the collaboration and illustrate the process undertaken to implement new curricula, including considerations made to address institutional needs, curricula development, and incorporation into existing curricula. In addition, they discuss the lessons learned from conducting this collaborative effort among medical schools, with the goal of providing guidance to establish effective cross-disciplinary curricula that address newly defined competencies.

Defining, navigating, and negotiating success: the experiences of mid-career Robert Wood Johnson Clinical Scholar women

BACKGROUND

We studied female graduates of the Robert Wood Johnson Clinical Scholars Program (CSP, Class of 1984 to 1989) to explore and describe the complexity of creating balance in the life of mid-career academic woman physicians.

METHODS

We conducted and qualitatively analyzed (kappa 0.35 to 1.0 for theme identification among rater pairs) data from a semi-structured survey of 21 women and obtained their curricula vitae to quantify publications and grant support, measures of academic productivity.

RESULTS

Sixteen of 21 (76%) women completed the survey. Mean age was 48 (range: 45 to 56). Three were full professors, 10 were associate professors, and 3 had left academic medicine. Eleven women had had children (mean 2.4; range: 1 to 3) and 3 worked part-time. From these data, the conceptual model expands on 3 key themes: (1) defining, navigating, and negotiating success, (2) making life work, and (3) making work work. The women who described themselves as satisfied with their careers (10/16) had clarity of values and goals and a sense of control over their time. Those less satisfied with their careers (6/16) emphasized the personal and professional costs of the struggle to balance their lives and described explicit institutional barriers to fulfillment of their potential.

CONCLUSION

For this group of fellowship-prepared academic women physicians satisfaction is achieving professional and personal balance.

A randomized trial of teaching clinical skills using virtual and live standardized patients

BACKGROUND

We developed computer-based virtual patient (VP) cases to complement an interactive continuing medical education (CME) course that emphasizes skills practice using standardized patients (SP). Virtual patient simulations have the significant advantages of requiring fewer personnel and resources, being accessible at any time, and being highly standardized. Little is known about the educational effectiveness of these new resources. We conducted a randomized trial to assess the educational effectiveness of VPs and SPs in teaching clinical skills.

OBJECTIVE

To determine the effectiveness of VP cases when compared with live SP cases in improving clinical skills and knowledge.

DESIGN

Randomized trial.

PARTICIPANTS

Fifty-five health care providers (registered nurses 45%, physicians 15%, other provider types 40%) who attended a CME program.

INTERVENTIONS

Participants were randomized to receive either 4 live cases (n=32) or 2 live and 2 virtual cases (n=23). Other aspects of the course were identical for both groups.

RESULTS

Participants in both groups were equivalent with respect to pre-post workshop improvement in comfort level (P=.66) and preparedness to respond (P=.61), to screen (P=.79), and to care (P=.055) for patients using the skills taught. There was no difference in subjective ratings of effectiveness of the VPs and SPs by participants who experienced both (P=.79). Improvement in diagnostic abilities were equivalent in groups who experienced cases either live or virtually.

CONCLUSIONS

Improvements in performance and diagnostic ability were equivalent between the groups and participants rated VP and SP cases equally. Including well-designed VPs has a potentially powerful and efficient place in clinical skills training for practicing health care workers.

Teaching Communication Skills on the Surgery Clerkship

BACKGROUND

Physician communication skills, linked to important patient outcomes, are rarely formally addressed after the pre-clinical years of medical school. We implemented a new communication skills curriculum during the third year Surgery Clerkship which was part of a larger curriculum revision found in a controlled trial to significantly improve students' overall communication competence.

DESCRIPTION

In three 2 hour workshops students, learned to address common communication challenges in surgery: patient education, shared decision-making, and delivering bad news. Each 2 hour, surgeon facilitated session was comprised of a 30 minute introductory lecture, a 15 minute checklist driven video critique, a 15 minute group discussion, a 45 minute standardized patient (SP) exercise with feedback from the SP, peers, and faculty member, and a 15 minute closing summary. To date, over 25 surgery faculty have been trained to conduct these sessions. In an end-of-clerkship survey, students reported on skill changes and assessed the curriculum's educational effectiveness.

EVALUATION

A survey was completed by 120 of the 160 (76%) third year students who participated in the curriculum. Fifty-five percent of students reported improvement in their communication skills and ability to address specific communication challenges. Students were satisfied with the amount and quality of teaching.

CONCLUSIONS

Communication skills teaching can be implemented in the surgery clerkship, and surgeons are particularly well suited to teach about patient education, discussing informed consent and shared decision making, and delivering bad news. Structured case-based sessions are acceptable to, and improve the self-assessed skills of, surgery clerkship students. Faculty development geared toward such sessions has added benefits to educational activities in a clinical department overall.

Can a web-based curriculum improve students' knowledge of, and attitudes about, the interpreted medical interview?

OBJECTIVES

To develop and evaluate a web-based curriculum to introduce first year medical students to the knowledge and attitudes necessary for working with limited English proficient (LEP) patients through interpreters.

METHOD

Six hundred and forty first year medical students over 4 consecutive years took this curriculum as part of their Patient Physician and Society course. They viewed 6 patient-physician-interpreter video vignettes, gave open text analyses of each vignette, and compared their responses to those generated by experts, thereby receiving immediate formative feedback. They listened to video commentaries by a cultural expert, lawyer, and ethicist about working with LEP patients, completed pre- and postmodule questionnaires, which tested relevant knowledge and attitudes, and were provided a summative assessment at the end of the module. Students completed an optional survey assessing the educational value of, and providing open text commentary about, the module.

RESULTS

Seventy-one percent (n=456) of first year students who completed the module consented to have their data included in this evaluation. Mean knowledge (19 items) scores improved (46% pre- to 62% postmodule, P<.001), reflecting improvements in knowledge about best interpreter practices and immigration demographics and legal issues. Mean scores on 4 of 5 attitude items improved, reflecting attitudes more consistent with culturally sensitive care of LEP patients. Mean satisfaction with the educational value of the module for 155 students who completed the postmodule survey was 2.9 on a scale of 1 to 4.

CONCLUSION

Our web-curriculum resulted in short-term improvement in the knowledge and attitudes necessary to interact with LEP patients and interpreters. The interactive format allowed students to receive immediate formative feedback and be cognizant of the challenges and effective strategies in language discordant medical encounters. This is important because studies suggest that the use of these skills in patient encounters leads to greater patient and provider satisfaction and improved health outcomes.

Meeting requirements and changing culture. The development of a web-based clinical skills evaluation system

The Accreditation Council of Graduate Medical Education (ACGME) and the Residency Review Committee require a competency-based, accessible evaluation system. The paper system at our institution did not meet these demands and suffered from low compliance. A diverse committee of internal medicine faculty, program directors, and house staff designed a new clinical evaluation strategy based on ACGME competencies and utilizing a modular web-based system called ResEval. ResEval more effectively met requirements and provided useful data for program and curriculum development. The system is paperless, allows for evaluations at any time, and produces customized evaluation reports, dramatically improving our ability to analyze evaluation data. The use of this novel system and the inclusion of a robust technology infrastructure, repeated training and e-mail reminders, and program leadership commitment resulted in an increase in clinical skills evaluations performed and a rapid change in the workflow and culture of evaluation at our residency program.

Referral patterns of primary care physicians for eye care

BACKGROUND

There is very little data regarding the referral rates of primary care physicians for eye care. We studied the extent to which primary care physicians follow guidelines and standards that have been set by professional organizations within eye care.

METHODS

Forty-eight patients over age 40 years seen during one day in the Primary Care Department of a large, metropolitan hospital were reviewed.

RESULTS

Only 12.5 percent of patients seen were referred for eye care. Only 8 percent of those who were diabetic and 13 percent of those with hypertension were referred for eye care, while of each group respectively, 25 percent and 34.8 percent had been seen for eye care in the previous year. Referrals tended to be for acute problems, not for routine monitoring of ocular signs associated with hypertension or diabetes. Only 33.3 percent of the patients had an ocular assessment in the physician's records within the year. In addition, most patients did not have ophthalmoscopy, glaucoma testing, or any other form of vision care during the year.

CONCLUSIONS

In this study, referrals for eye care seemed to be driven by acute, symptomatic problems, and to a lesser extent by a known ocular condition. The importance of routine eye care was not reflected in the referral patterns observed in this study.

Diabetic ketoacidosis in prisoners without access to insulin

OBJECTIVE

To assess the cause and clinical severity of diabetic ketoacidosis in male prisoners hospitalized in New York City.

DESIGN

Retrospective chart review.

SETTING

A municipal hospital in New York City.

PATIENTS

Forty-nine adult male prisoners with a total of 54 hospital admissions for diabetic ketoacidosis between January 1, 1989, and June 30, 1991.

MAIN OUTCOME MEASURES

Charts were reviewed for diabetic and medical history, time from arrest until hospitalization, cause of diabetic ketoacidosis, admission laboratory data, and hospital course.

RESULTS

Thirty-eight (70%) of the 54 admissions for diabetic ketoacidosis among prisoners occurred because prisoners had not received insulin during the period immediately following arrest (mean number of days from arrest until hospitalization was 2.5). All of these individuals had a history of insulin-dependent diabetes and were reportedly compliant with their insulin regimen at the time of arrest. Admission laboratory data for this group of prisoners included a mean serum glucose level of 27.4 mmol/L (495 mg/dL) and a mean serum bicarbonate level of 14.4 mmol/L. Mean number of days in the hospital was 3.4 including a mean of 1 day in an intensive care unit.

CONCLUSIONS

Inadequate access to medication results in serious sequelae for recently arrested prisoners in New York City with insulin-dependent diabetes. Access to health care for recently arrested prisoners needs to be improved.