Eye on the Prize: Patient Outcomes Research in Medical Education

The overarching goal of medical education is to train clinicians who achieve and maintain competence in patient care. Although the field of medical education research has acknowledged the importance of education on clinical practices and outcomes, most research endeavors continue to focus on learner-centered outcomes, such as knowledge and attitudes. The absence of clinical and patient-centered outcomes in pulmonary and critical care medicine medical education research has been attributed to barriers at multiple levels, including financial, methodological, and practical considerations. This Perspective explores clinical outcomes relevant to pulmonary and critical care medicine educational research and offers strategies and solutions that educators can use to accomplish what many consider the "prize" of medical education research: an understanding of how our educational initiatives impact the health of patients.

Build It and They Shall Come: Medical Education Communities of Practice

Background

Producing scholarship in education is essential to the career development of a clinician-educator. Challenges to scholarly production include a lack of resources, time, expertise, and collaborators.

Objective

To develop communities of practice for education scholarship through an international society to increase community and academic productivity.

Methods

We developed multi-institutional scholarship pods within the American Thoracic Society through the creation of a working group (2017-2019). Pods met virtually, and meetings were goal focused to advance education scholarship within their area of interest. To understand the impact of these scholarship pods, we surveyed pod leaders and members in 2021 and analyzed the academic productivity of each pod via a survey of pod leaders and a review of the PubMed index.

Results

Nine pods were created, each with an assigned educational topic. The survey had a response rate of 76.6%. The perceived benefits were the opportunity to meet colleagues with similar interests at other institutions, production of scholarly work, and engagement in new experiences. The main challenges were difficulty finding times to meet because of competing clinical demands and aligning times among pod members. Regarding academic productivity, eight publications, four conference presentations, and one webinar/podcast were produced by six of the nine pods.

Conclusion

The development of communities of practice resulted in increased multi-site collaboration, with boosted academic productivity as well as an enhanced sense of belonging. Multiple challenges remain but can likely be overcome with accountability, early discussion of roles and expectations, and clear delegation of tasks and authorship.

Wellness and Coping of Physicians Who Worked in ICUs During the Pandemic: A Multicenter Cross-Sectional North American Survey

OBJECTIVES

Few surveys have focused on physician moral distress, burnout, and professional fulfilment. We assessed physician wellness and coping during the COVID-19 pandemic.

DESIGN

Cross-sectional survey using four validated instruments.

SETTING

Sixty-two sites in Canada and the United States.

SUBJECTS

Attending physicians (adult, pediatric; intensivist, nonintensivist) who worked in North American ICUs.

INTERVENTION

None.

MEASUREMENTS AND MAIN RESULTS

We analysed 431 questionnaires (43.3% response rate) from 25 states and eight provinces. Respondents were predominantly male (229 [55.6%]) and in practice for 11.8 ± 9.8 years. Compared with prepandemic, respondents reported significant intrapandemic increases in days worked/mo, ICU bed occupancy, and self-reported moral distress (240 [56.9%]) and burnout (259 [63.8%]). Of the 10 top-ranked items that incited moral distress, most pertained to regulatory/organizational ( n = 6) or local/institutional ( n = 2) issues or both ( n = 2). Average moral distress (95.6 ± 66.9), professional fulfilment (6.5 ± 2.1), and burnout scores (3.6 ± 2.0) were moderate with 227 physicians (54.6%) meeting burnout criteria. A significant dose-response existed between COVID-19 patient volume and moral distress scores. Physicians who worked more days/mo and more scheduled in-house nightshifts, especially combined with more unscheduled in-house nightshifts, experienced significantly more moral distress. One in five physicians used at least one maladaptive coping strategy. We identified four coping profiles (active/social, avoidant, mixed/ambivalent, infrequent) that were associated with significant differences across all wellness measures.

CONCLUSIONS

Despite moderate intrapandemic moral distress and burnout, physicians experienced moderate professional fulfilment. However, one in five physicians used at least one maladaptive coping strategy. We highlight potentially modifiable factors at individual, institutional, and regulatory levels to enhance physician wellness.

Learning in the Time of COVID-19: Key Lessons From the Pandemic for Medical Trainees

The COVID-19 pandemic has changed the face of education for undergraduate and graduate medical trainees. Lectures, clinical clerkships, and testing have all been impacted significantly because of patient care needs and concern for the health and safety of trainees. While traditional teaching strategies have been upended, the challenges posed by the pandemic have also created unique opportunities for trainees. In this article, the authors summarize lessons trainees can learn from the ongoing pandemic in the following areas: public health, disaster preparedness, and resource allocation; reinventing professional and personal roles to meet the needs of the health care system; flexibility in navigating testing, licensure, and certification; appraising scientific evidence quickly and accurately; balancing a physician's call to duty with fear for personal safety; combating moral injury; interprofessional collaboration; and advocating for oneself and one's colleagues. Focusing on these lessons can help educators steer their efforts to better prepare future physicians for unforeseen challenges that may come up in their personal and professional lives as well as in society as a whole.

Longitudinal Milestone Assessment Extending Through Subspecialty Training: The Relationship Between ACGME Internal Medicine Residency Milestones and Subsequent Pulmonary and Critical Care Fellowship Milestones

PURPOSE

Accreditation Council for Graduate Medical Education (ACGME) milestones were implemented across medical subspecialties in 2015. Although milestones were proposed as a longitudinal assessment tool potentially providing opportunities for early implementation of individualized fellowship learning plans, the association of subspecialty fellowship ratings with prior residency ratings remains unclear. This study aimed to assess the relationship between internal medicine (IM) residency milestones and pulmonary and critical care medicine (PCCM) fellowship milestones.

METHOD

A multicenter retrospective cohort analysis was conducted for all PCCM trainees in ACGME-accredited PCCM fellowship programs, 2017-2018, who had complete prior IM milestone ratings from 2014 to 2017. Only professionalism and interpersonal and communication skills (ICS) were included based on shared anchors between IM and PCCM milestones. Using a generalized estimating equations model, the association of PCCM milestones ≤ 2.5 during the first fellowship year with corresponding IM subcompetencies was assessed at each time point, nested by program. Statistical significance was determined using logistic regression.

RESULTS

The study included 354 unique PCCM fellows. For ICS and professionalism subcompetencies, fellows with higher IM ratings were less likely to obtain PCCM ratings ≤ 2.5 during the first fellowship year. Each ICS subcompetency was significantly associated with future lapses in fellowship (ICS01: β = -0.67, P = .003; ICS02: β = -0.70, P = .001; ICS03: β = -0.60, P = .004) at various residency time points. Similar associations were noted for PROF03 (β = -0.57, P = .007).

CONCLUSIONS

Findings demonstrated an association between IM milestone ratings and low milestone ratings during PCCM fellowship. IM trainees with low ratings in several professionalism and ICS subcompetencies were more likely to be rated ≤ 2.5 during the first PCCM fellowship year. This highlights a potential use of longitudinal milestones to target educational gaps at the beginning of PCCM fellowship.

Comparing the Digital Footprint of Pulmonary and Critical Care Conferences on Twitter

Background: Pulmonary and critical care societies, including the American Thoracic Society, the American College of Chest Physicians, and the Society of Critical Care Medicine have large memberships that gather at academic conference events, attracting thousands of attendees. Objective: With the growth of social media use among pulmonary and critical care clinicians, our goal was to examine the Twitter presence and digital footprint of these three major medical society conferences. Methods: We used Symplur Signals (Symplur, LLC) to track the tweets and most active participants of the 2017-2019 annual conferences of American Thoracic Society, American College of Chest Physicians, and the Society of Critical Care Medicine. Attendance records of participants were obtained from each society. Results: During the study period, there was growth in the number of tweets, participants, and impressions for all three society conferences. Across all conferences, the amount of original content generated was less than the retweets, which comprised 50-72% of all tweets. Individuals physically attending each conference were more likely to post original content than those not in attendance (53-68% vs. 32-47%). For each society and at each meeting, clinicians made up the largest group of participants (44-60%), and most (59-82%) were physicians. A small cohort of participants was responsible for a large share of the tweets, with more than half of the participants at each conference for each society tweeting only once and only between 5-8% of participants tweeting more than 10 times. Seventy-eight individuals tweeted more than 100 times at one or more of the conferences. There was significant overlap in this group, with 32 of these individual participants tweeting more than 100 times at two or more of these conferences. Conclusion: Growth in conference digital footprints is largely due to increased activity by a small group of prolific participants that attend conferences by multiple academic societies. Original content makes up the smallest proportion of posts, suggesting that amplification of content is more prevalent than posting of original content. In a postpandemic environment, engagement of users producing original content may be even more important for medical societies.

Understanding the "Social" in "Social Media". An Analysis of Twitter Engagement of Pulmonary and Critical Care Fellowship Programs

Background: Social media is ubiquitous as a tool for collaboration, networking, and dissemination. However, little is known about use of social media platforms by pulmonary and critical care medicine fellowship programs.

Objective: We identify and characterize pulmonary and critical care fellowship programs using Twitter and Instagram, as well as the posting behaviors of their social media accounts.

Methods: We identified all adult and pediatric pulmonary, critical care medicine (CCM), and combined pulmonary and critical care medicine (PCCM) programs in the United States using the Electronic Residency Application Service. We searched for Twitter profiles for each program between January 1, 2018, and September 30, 2018. Tweets and Twitter interactions were classified into the following three types: social, clinical, or medical education (MedEd) related. We collected data about content enhancements of tweets, including the use of pictures, graphics interchange format or videos, hashtags, links, and tagging other accounts. The types of tweets, content enhancement characteristics, and measures of engagement were analyzed for association with number of followers.

Results: We assessed 341 programs, including 163 PCCM, 36 adult CCM, 20 adult pulmonary, 67 pediatric CCM, and 55 pediatric pulmonary programs. Thirty-three (10%) programs had Twitter accounts. Of 1,903 tweets by 33 of the 341 programs with Twitter accounts, 476 (25%) were MedEd related, 733 (39%) were clinical, and 694 (36%) were social. The median rate of tweets per month was 1.65 (interquartile range [IQR], 0.4-6.65), with 55% programs tweeting more than monthly. Accounts tweeting more often had significantly more followers than those tweeting less frequently (median, 240 followers; 25-75% IQR, 164-388 vs. median, 107 followers; 25-75% IQR, 13-188; P = 0.006). Higher engagement with clinical and social Twitter interactions (tweets, retweets, likes, and comments) was associated with more followers but not for the MedEd-related Twitter interactions. All types of content enhancements (pictures, graphics interchange format/videos, links, and tagging) were associated with a higher number of followers, except for hashtags.

Conclusion: Despite the steadily increasing use of social media in medicine, only 10% of the pulmonary and critical care fellowship programs in the United States have Twitter accounts. Social and clinical content appears to gain traction online; however, additional evaluation is needed on how to effectively engage audiences with MedEd content.

A call for collaboration and consensus on training for endotracheal intubation in the medical intensive care unit

Endotracheal intubation (EI) is a potentially lifesaving but high-risk procedure in critically ill patients. While the ACGME mandates that trainees in pulmonary and critical care medicine (PCCM) achieve competence in this procedure, there is wide variation in EI training across the USA. One study suggests that 40% of the US PCCM trainees feel they would not be proficient in EI upon graduation. This article presents a review of the EI training literature; the recommendations of a national group of PCCM, anesthesiology, emergency medicine, and pediatric experts; and a call for further research, collaboration, and consensus guidelines.

Communication Training in Adult and Pediatric Critical Care Medicine. A Systematic Review

Background: Interpersonal and communication skills are essential for physicians practicing in critical care settings. Accordingly, demonstration of these skills has been a core competency of the Accreditation Council for Graduate Medical Education since 2014. However, current practices regarding communication skills training in adult and pediatric critical care fellowships are not well described. Objective: To describe the current state of communication curricula and training methods in adult and pediatric critical care training programs as demonstrated by the published literature. Methods: We performed a systematic review of the published literature using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist. Three authors reviewed a comprehensive set of databases and independently selected articles on the basis of a predefined set of inclusion and exclusion criteria. Data were independently extracted from the selected articles. Results: The 23 publications meeting inclusion criteria fell into the following study classifications: intervention (n = 15), cross-sectional survey (n = 5), and instrument validation (n = 3). Most interventional studies assessed short-term and self-reported outcomes (e.g., learner attitudes and perspectives) only. Fifteen of 22 publications represented pediatric subspecialty programs. Conclusion: Opportunities exist to evaluate the influence of communication training programs on important outcomes, including measured learner behavior and patient and family outcomes, and the durability of skill retention.

Limitation of Life-Sustaining Care in the Critically Ill: A Systematic Review of the Literature

When life-sustaining treatments (LST) are no longer effective or consistent with patient preferences, limitations may be set so that LSTs are withdrawn or withheld from the patient. Many studies have examined the frequency of limitations of LST in intensive care unit (ICU) settings in the past 30 years. This systematic review describes variation and patient characteristics associated with limitations of LST in critically ill patients in all types of ICUs in the United States. A comprehensive search of the literature was performed by a medical librarian between December 2014 and April 2017. A total of 1,882 unique titles and abstracts were reviewed, 113 were selected for article review, and 36 studies were fully reviewed. Patient factors associated with an increased likelihood of limiting LST included white race, older age, female sex, poor preadmission functional status, multiple comorbidities, and worse illness severity score. Based on several large, multicenter studies, there was a trend toward a higher frequency of limitation of LST over time. However, there is large variability between ICUs in the proportion of patients with limitations and on the proportion of deaths preceded by a limitation. Increases in the frequency of limitations of LST over time suggests changing attitudes about aggressive end-of-life-care. Limitations are more common for patients with worse premorbid health and greater ICU illness severity. While some differences in the frequency of limitations of LST may be explained by personal factors such as race, there is unexplained wide variability between units.

A pilot study: a teaching electronic medical record for educating and assessing residents in the care of patients

OBJECTIVE

We tested a novel, web-based teaching electronic medical record to teach and assess residents' ability to enter appropriate admission orders for patients admitted to the intensive care unit. The primary objective was to determine if this tool could improve the learners' ability to enter an evidence-based, comprehensive initial care plan for critically ill patients.

METHODS

The authors created three modules using de-identifed real patient data from selected patients that were admitted to the intensive care unit. All senior residents (113 total) were invited to participate in a dedicated two-hour educational session to complete the modules. Learner performance was graded against gold standard admission order sets created by study investigators based on the latest evidence-based medicine and guidelines.

RESULTS

The session was attended by 39 residents (34.5% of invitees). There was an average improvement of at least 20% in users' scores across the three modules (Module 3-Module 1 mean difference 22.5%; p = 0.001 and Module 3-Module 2 mean difference 20.3%; p = 0.001). Diagnostic acumen improved in successive modules. Almost 90% of the residents reported the technology was an effective form of teaching and would use it autonomously if more modules were provided.

CONCLUSIONS

In this pilot project, using a novel educational tool, users' patient care performance scores improved with a high level of user satisfaction. These results identify a realistic and well-received way to supplement residents' training and assessment on core clinical care and patient management in the face of duty hour restrictions.

Implementation of a point-of-care ultrasound skills practicum for hospitalists

Introduction

Point-of-care ultrasound is recognized as a safe and valuable diagnostic tool for patient evaluation. Hospitalists are prime candidates for advancing the point-of-care ultrasound field given their crucial role in inpatient medicine. Despite this, there is a notable lack of evidence-based ultrasound training for hospitalists. Most research focuses on diagnostic accuracy rather than the training required to achieve it. This study aims to improve hospitalists' point-of-care ultrasound knowledge and skills through a hands-on skills practicum.

Methods

Four skill practicums were conducted with pre-course, post-course, and six-month evaluations and knowledge assessments.

Results

The mean pre- vs. post-course knowledge assessment scores significantly improved, 41.7% vs. 75.9% (SD 16.1% and 12.7%, respectively, p < 0.0001). The mean ultrasound skills confidence ratings on a 10-point Likert scale significantly increased post-course (2.60 ± 1.66 vs. 6.33 ± 1.63, p < 0.0001), but decreased at six months (6.33 ± 1.63 vs. 4.10 ± 2.22, p < 0.0001). The greatest limitations to usage pre-course and at six months were knowledge/skills and lack of machine access. While knowledge/skills decreased from pre-course (82.0%) as compared to six-months (64.3%), lack of machine access increased from pre-course (15.8%) to six-months (28.6%) (p = 0.28).

Conclusion

Hospitalists agree that point-of-care ultrasound has utility in the diagnostic and therapeutic management of patients, though the lack of training is a significant limitation. Our study demonstrated that a brief skills practicum significantly improves hospitalists' confidence and knowledge regarding ultrasound image acquisition and interpretation in the short term. Long-term confidence and usage wanes, which appears to be due to the lack of machine access.

The influence of the residency application process on the online social networking behavior of medical students: a single institutional study

PURPOSE

To evaluate medical students' behavior regarding online social networks (OSNs) in preparation for the residency matching process. The specific aims were to quantify the use of OSNs by students to determine whether and how these students were changing OSN profiles in preparation for the residency application process, and to determine attitudes toward residency directors using OSNs as a screening method to evaluate potential candidates.

METHOD

An e-mail survey was sent to 618 third- and fourth-year medical students at Indiana University School of Medicine over a three-week period in 2012. Statistical analysis was completed using nonparametric statistical tests.

RESULTS

Of the 30.1% (183/608) who responded to the survey, 98.9% (181/183) of students reported using OSNs. More than half, or 60.1% (110/183), reported that they would (or did) alter their OSN profile before residency matching. Respondents' opinions regarding the appropriateness of OSN screening by residency directors were mixed; however, most respondents did not feel that their online OSN profiles should be used in the residency application process.

CONCLUSIONS

The majority of respondents planned to (or did) alter their OSN profile in preparation for the residency match process. The majority believed that residency directors are screening OSN profiles during the matching process, although most did not believe their OSN profiles should be used in the residency application process. This study implies that the more medical students perceive that residency directors use social media in application screening processes, the more they will alter their online profiles to adapt to protect their professional persona.

The human metapneumovirus: a case series and review of the literature

Human metapneumovirus (hMPV) is an emerging human pulmonary pathogen that is genetically related to respiratory syncytial virus. It has been increasingly associated with respiratory illnesses over the last few decades. Immunocompromised patients are particularly susceptible with resultant morbidity and mortality. We describe our experience with 9 immunocompromised patients diagnosed with pneumonia secondary to hMPV, 2 of whom were successfully treated with aerosolized and oral ribavirin along with intravenous immunoglobulin (IVIG). We suggest that hMPV should be considered in the differential diagnosis of immunocompromised patients with acute respiratory illness. Ribavirin (oral and aerosolized) with IVIG is potentially an effective treatment option for those with severe disease.

Blastomycosis in indiana: digging up more cases

BACKGROUND

The endemic region of blastomycosis historically has included the state of Indiana. However, few published reports of blastomycosis exist to substantiate this distinction. A surge of patients with blastomycosis in central Indiana (Indianapolis and surrounding counties) beginning in 2005 prompted us to review our local experience. We propose that this surge was related to major highway construction around Indianapolis.

METHODS

We reviewed all microbiologically confirmed cases from four hospitals serving central Indiana. Chart review was completed for adult patients, and data were collected on clinical presentations, methods of diagnosis, comorbidities, radiologic findings, treatment, and outcomes. We plotted patient residence addresses with sites of highway construction.

RESULTS

Fifty-nine patients were identified from laboratory results and physician referral. Interestingly, a surge of blastomycosis incidence occurred in 34 patients between 2005 and 2008 during which time major highway projects were under way around the Indianapolis metropolitan area. The majority of these patients presented acutely and with pulmonary involvement. Fungal culture and antigen testing were the most sensitive means to diagnosis. Antifungal therapy was highly effective.

CONCLUSIONS

This urban outbreak of blastomycosis in Indianapolis should prompt clinicians to consider blastomycosis in this highly endemic area of histoplasmosis.