Socio-culturally responsive medical professionalism and ethics education: A curriculum co-creation approach

Medical professionalism and ethics (MPE) are critical components influencing how medical practitioners provide patients with the highest standard of care. As a result, a structured attempt has been undertaken to enhance the content and teaching delivery of the medical professionalism and ethics education (MPEE) in the undergraduate medical curriculum. Guided by Vygotsky's sociocultural learning theory, Harre and Van Langenhove's positioning theory and Taba's principles of curriculum development, a curriculum co-creation project was organized with the aim of developing a socio-culturally responsive MPEE. A total of fifteen medical students agreed to participate in the project where they co-created MPE curriculum with a medical educator over the course of three months. Upon completion of the project, a co-created, socio-culturally responsive MPE curriculum was presented. The thematic analysis revealed positive changes in the participants' attitudes, skills, and behaviors towards co-creating the MPE curriculum. They also reported feeling a sense of fulfilment after having a transformative experience as curriculum co-creators and after receiving positive feedback from the faculty, staff, and other students on the co-created MPE curriculum. The project's success demonstrates the importance of curriculum co-creation as a strategy to promote co-creation efforts among students and educators in developing a socio-culturally responsive curriculum. The project's framework and practical recommendations can be adopted by other medical educators and faculties to encourage students' participation and their role on curriculum development using the co-creation approach.

Toward Professionalism of Biobanking in China: A Survey on Working Status, Career Development, Challenges, and Prospects of Biobankers

Biobanking has become an increasingly important activity to provide resources for medical research support. In China, establishing and maintaining a biobank have been the latest trend in a research hospital. However, biobanking is still an emerging young field in terms of professionalization and professionalism. The development of professionalization in biobanking faces many challenges involving the development of skills, identities, norms, and values associated with becoming part of a professional group. Biobanking professionals (i.e., biobankers) are the most important factor and driving force toward professionalization in biobanking. To better understand biobankers' performance, needs, concerns, and career development, we conducted two comprehensive surveys among biobankers in China in 2019 and 2021, respectively. The questionnaires covered four major areas: (1) basic information and the status of biobankers; (2) job performance evaluation, salary, recognitions, rewards, and so on; (3) occupational training and career development; and (4) challenges and prospects and so on. The surveys revealed that most biobankers in China have positive working attitudes and a high desire for their future career development, but due to the uncertain evaluation mechanisms and promotion routes, etc., the participants were more optimistic about biobanking development compared to the biobanker's career development (77.0% and 57.4% respectively in 2021, p < 0.05). The biobankers expected more training opportunities and salary packages. Because biobankers are an integral factor and driving force to ensure the successful biobanking operation and advancement, the survey data analysis revealed interesting findings and references for the development of professionalism in biobanking. This survey will provide first-hand information to governments, biobank management teams, and the general public to further support, promote, or optimize (1) biobanking operation and sustainability, (2) biobankers' career development, (3) biobank management and quality control, and (4) strategic plans and approaches to establish a higher quality professional team of biobankers.

Development of a Medical Social Media Ethics Scale and Assessment of #IRad, #CardioTwitter, and #MedTwitter Posts: Mixed Methods Study

BACKGROUND

Social media posts by clinicians are not bound by the same rules as peer-reviewed publications, raising ethical concerns that have not been extensively characterized or quantified.

OBJECTIVE

We aim to develop a scale to assess ethical issues on medical social media (SoMe) and use it to determine the prevalence of these issues among posts with 3 different hashtags: #MedTwitter, #IRad, and #CardioTwitter.

METHODS

A scale was developed based on previous descriptions of professionalism and validated via semistructured cognitive interviewing with a sample of 11 clinicians and trainees, interrater agreement, and correlation of 100 posts. The final scale assessed social media posts in 6 domains. This was used to analyze 1500 Twitter posts, 500 each from the 3 hashtags. Analysis of posts was limited to original Twitter posts in English made by health care professionals in North America. The prevalence of potential issues was determined using descriptive statistics and compared across hashtags using the Fisher exact and χ2 tests with Yates correction.

RESULTS

The final scale was considered reflective of potential ethical issues of SoMe by participants. There was good interrater agreement (Cohen κ=0.620, P<.01) and moderate to strong positive interrater correlation (=0.602, P<.001). The 6 scale domains showed minimal to no interrelation (Cronbach α=0.206). Ethical concerns across all hashtags had a prevalence of 1.5% or less except the conflict of interest concerns on #IRad, which had a prevalence of 3.6% (n=18). Compared to #MedTwitter, posts with specialty-specific hashtags had more patient privacy and conflict of interest concerns.

CONCLUSIONS

The SoMe professionalism scale we developed reliably reflects potential ethical issues. Ethical issues on SoMe are rare but important and vary in prevalence across medical communities.

Development and validation of self-assessment instrument to measure the digital professionalism of healthcare professionals using social media

BACKGROUND

The use of social media across the globe has risen incrementally. During the COVID-19 pandemic, these sites undeniably provided new avenues for professional networking but also led to a surge in cases of online misconduct. Professionalism instruments and scales do not assess the digital attitude and behaviour of healthcare professionals (HCPs). The purpose of this study was to identify the domains and items of digital professionalism related to social media use and to validate a self-assessment instrument to assess the digital professionalism of HCPs using social media.

METHODS

An instrument development multiphase mixed method study (exploratory sequential) was conducted in two phases: item development and qualitative content validation followed by validation of the instrument. Feedback was taken from 15 experts for qualitative content validation in phase 1. In phase 2, content validity was established through three rounds of modified Delphi. Validity evidence was collected for the content (content validity index), response process (cognitive interviews), internal structure (confirmatory factor analysis), and internal consistency (Cronbach's alpha).

RESULTS

The 48-item preliminary instrument was reduced to a 28-item instrument with eight domains: self-anonymity, privacy settings, maintenance of boundaries and confidentiality, conflict of interest, accountability, respect for colleagues, and ethics. The content validity index of the scale was 0.91. The reliability and construct validity of the instrument was established by responses from 500 healthcare professionals from multiple hospitals. Confirmatory factor analysis showed a model with a goodness-of-fit index of 0.86, root mean square error of approximation of 0.06, and observed normed χ2 of 2.7. The internal consistency through Cronbach's alpha α was 0.96.

CONCLUSION

The digital professionalism self-assessment instrument (DP-SAI) has an appropriate level of content and measures the construct reliably. It can be used by medical doctors, dental clinicians, nurses, physiotherapists, and clinical pharmacists to self-assess and reflect on their social media practices. This will help to address these issues to enhance the quality of online communication through various social media platforms.

Preparedness and competency of New Zealand graduates for general dental practice - perceptions from the workforce

BACKGROUND

Dental graduates need to demonstrate clinical competency. This mixed-methods study explored the perceptions of clinicians who employ or work with new graduates from the University of Otago, New Zealand, and identified themes reflecting graduates' preparedness for independent practice.

METHODS

An online survey using a semantic differential scale and open-ended questions collected opinions and experiences from the workforce. Quantitative data were analysed using SPSS software, and qualitative data were analysed thematically.

RESULTS

A representative sample of the workforce was obtained with a response rate of 35% (N = 83). Most clinicians engage new graduates to support the profession and/or rural communities. They perceived that graduates were well prepared in most areas, could translate theory to clinical practice and demonstrate professionalism. Graduates were reportedly stronger in basic dentistry, communication, ethics, and record keeping however were less strong in complex treatment planning, molar endodontics, fixed prosthodontics and exodontia. Clinical exposure during dental training was perceived as more limited, and mentoring and guidance in the transition to practice were deemed to be important.

CONCLUSIONS

New Zealand dental graduates appear prepared for independent practice; however, maximising clinical opportunities during training, mentoring and early professional development in advanced areas of practice is essential to enhance competency and confidence.

Organisational challenges to wellbeing in nuclear medicine technologists: Professionalism, burnout and pragmatic growth

INTRODUCTION

Occupational risk for burnout in nuclear medicine technologists globally, and particularly during disaster demands on the profession, is poorly researched. This idiographic study explored the lived experience of nuclear medicine technologists during COVID-19 in a regional city in Australia.

METHODS

Data was collected from five participants using semi-structured interviews and transcribed and analysed according to the protocols of Interpretative Phenomenological Analysis (IPA).

RESULTS

Four group experiential themes were identified: Systemic Contraindications, Professional Strengths and Limitations, Pragmatic Growth, and Covid Rollercoaster. For these participants a dichotomous health care system, impacted by COVID-19, risked career longevity and burnout. Through empathic connection with vulnerable patients, they redefined their priorities, re-engaged in supportive connections with colleagues, and sought new pathways.

CONCLUSION

Multiple workplace stressors compounded by COVID-19, risked mental wellbeing, in these participants. Nevertheless, these challenges provided opportunities for reflection around career trajectory and longevity precipitating personal growth, job satisfaction and work-life balance.

IMPLICATIONS FOR PRACTICE

This study provided a lens on the risk factors inherent for nuclear medicine technologists in Australia, exacerbated by the COVID-19 pandemic. Current, and disaster protective practices, to ensure wellbeing and prevent burnout risk are recommended for future research.

A Scoping Review of Professionalism in Neurosurgery

BACKGROUND AND OBJECTIVES

The Accreditation Council for Graduate Medical Education's Milestones provides a foundation for professionalism in residency training. Specific professionalism concepts from neurosurgery could augment and expand milestones for the specialty. We reviewed the current literature and identified professionalism concepts within the context of neurosurgical practice and training.

METHODS

We used a scoping review methodology to search PubMed/MEDLINE and Scopus and identify English-language articles with the search terms "professionalism" and "neurosurgery." We excluded articles that were not in English, not relevant to professionalism within neurosurgery, or could not be accessed. Non-peer-reviewed and qualitative publications, such as commentaries, were included in the review.

RESULTS

A total of 193 articles were included in the review. We identified 6 professionalism themes among these results: professional identity (n = 53), burnout and wellness (n = 51), professional development (n = 34), ethics and conflicts of interest (n = 27), diversity and gender (n = 19), and misconduct (n = 9).

CONCLUSION

These 6 concepts illustrate concerns that neurosurgeons have concerning professionalism. Diversity and gender, professional identity, and misconduct are not specifically addressed in the Accreditation Council for Graduate Medical Education's Milestones. This review could be used to aid the development of organizational policy statements on professionalism.

Analyzing the characteristics of mission statements in Korean medical schools based on the Korean Doctor's Role framework

PURPOSE

This study assessed the alignment between Korean medical schools' mission statements (MSs) and Korean Doctor's Role (KDR) domains, considering school characteristics.

METHODS

We analyzed the South Korean medical school's MS characteristics using a mixed-methods approach. Quantitative analysis preprocessed MS text data to identify concept words, while qualitative content analysis categorized information into predefined KDR domains and extracted themes from other parts.

RESULTS

At the KDR domain level, "social accountability" was the most frequent, followed by "education and research" and "patient care," while "professionalism" had the least frequency. At the competency level, the most frequent domains were "involvement in public and global health initiatives," while "self-regulation based on professional leadership" and "professionalism and self-management" were not present.

CONCLUSION

The study found that the majority of MSs had a homogeneous pattern and included traditional themes. Medical schools should evaluate and incorporate missing elements in their MSs to reflect the institution's own purpose and current societal needs.

Teaching medical ethics and medical professionalism in Saudi public and private medical schools

Medical ethics and professionalism are two essential parts of building up the identity of a competent physician. This study was conducted to determine the nature, content, and methods of medical ethics and professionalism education in Saudi public and private medical schools. It also sought to identify the challenges and obstacles in teaching and assessing medical ethics and professionalism and suggest appropriate changes. A cross-sectional study was carried out in Saudi private and public medical schools. To achieve the study's aim, an assessment tool in the form of a novel self-administered questionnaire was developed, piloted, and then used. A representative from each of the 28 Saudi medical schools participated in the study. Twenty-four (82.1%) responding medical schools have no medical ethics department. Most of the medical schools (64.2%) have 25% or less of their faculty staff who teach ethics holding a qualification in medical ethics. Most schools have a specific course for medical ethics and professionalism (85.7% and 57.1%, respectively). Multiple-choice questioning is the most popular assessment method in medical ethics and professionalism courses (89.3% and 60.7%, respectively). The need for more qualified staff and clear guidelines/resources is a significant drawback to the teaching of medical ethics. Therefore, the study recommends developing national guidelines dedicated to the undergraduate teaching curriculum from which courses would be designed to enhance medical ethics and medical professionalism.

Exploring changes in the perception of e-professionalism among medical and dental students: a quantitative cross-sectional study

AIM

To compare e-professionalism perceptions between medical and dental students, focusing on their awareness and understanding of guidelines for developing e-professionalism.

METHODS

A cross-sectional quantitative study was conducted at the University of Zagreb School of Medicine (UZSM) and School of Dental Medicine (UZSDM) in 2022/2023. Data were gathered through a questionnaire designed specifically for the survey.

RESULTS

Of the 646 questionnaires collected, 626 were analyzed, with a response rate of 33.95% for UZSM and 37.83% for UZSDM. Most respondents (71.4%) were female, with a median age of 21. Medical students significantly more frequently considered it unprofessional to publish posts containing photos of patients/clients (96.5% vs 75.1%), endorsements of health products without conflict-of-interest disclosures (60.6% vs 33.0%), and posts describing patient interactions without revealing identifying information (51.7% vs 27.4%). In contrast, dental medicine students more frequently considered it unprofessional to publish posts with swearing or foul language (81.2% vs 67.4%), critical comments about lecturers (68.0% vs 46.9%), and criticisms of course material or the institution (52.3% vs 36.4%). Only 23.2% of students were aware of e-professionalism guidelines, with 37.9% of those familiar with their content.

CONCLUSION

While medical and dental students recognize the importance of e-professionalism, their perceptions have substantial differences. The need for promoting existing guidelines and integrating e-professionalism into curricula is evident. Continuous monitoring and research in this domain are essential to ensure future health care professionals maintain high standards of online professionalism.

Raising professionalism concerns as a medical student: damned if they do, damned if they don't?

BACKGROUND

Understanding professionalism is an essential component of becoming a doctor in order to ensure the trust of patients and wider society. Integrally linked to the concept of professionalism is the importance of identifying and raising concerns to ensure high quality, safe patient care. It is recognised that medical students are uniquely placed to identify and report concerns given their frequent rotations through multiple clinical placements and their peer relationships and, in so doing, develop and enact their own medical professionalism. Although there is existing literature exploring medical students' willingness to raise concerns about observed professionalism lapses, this has largely been in the context of clinical interactions. Medical students will however undoubtedly encounter concerning behaviours or attitudes in their fellow students, an area that has not specifically been reported upon. This study therefore set out to explore medical students' willingness to report professionalism concerns they encounter both within and away from the clinical setting, particularly focusing on peer-related concerns.

METHODS

10 medical students, in later clinical years of a large UK medical school, volunteered to take part in in-depth semi-structured interviews. Interviews were recorded, transcribed and then analysed thematically to generate themes and subthemes to represent central organising concepts.

RESULTS

Three broad themes were generated from the data. Hidden curricular effects including role models, hierarchical structures and the operational systems in place to raise concerns subconsciously influenced students' decisions to raise concerns. Secondly, students offered a range of justifications to defend not taking action, including considering their own vulnerabilities and values alongside demonstrating empathy for perceived mitigating circumstances. The third theme highlighted the complex interplay of influencing factors that students considered when encountering professionalism issues in their peers including wider peer cohort effects and a desire to maintain individual peer-relationships.

CONCLUSIONS

Medical students will inevitably encounter situations where the professionalism of others is brought into question. However, despite clear curricular expectations to report such concerns, these findings demonstrate that students undergo a complex decision-making process in determining the threshold for reporting a concern through navigating a range of identified influencing factors. This study highlights the important role medical schools play in helping reduce the inner conflict experienced by medical students when raising concerns and in ensuring they provide supportive processes to empower their students to raise concerns as part their own developing professionalism.

Paying attention to attention: a program evaluation of faculty-delivered mindfulness-based attention training to optimize wellness and professionalism in medical students

BACKGROUND

As physician distress rises, medical schools must provide programs to counter such distress at the earliest stages of training. Mindfulness training (MT) is one intervention that can alleviate stress during medical school. However, framing MT around wellness alone misses the opportunity to connect core cognitive and psychological capacities strengthened by MT to professional goals and skill acquisition inherent to successful medical training. Here, we highlight how the attentional components of MT align with students' goals of becoming attending physicians while promoting academic, psychological, and interpersonal flourishing. MT courses that focus on strengthening attentional capacities can intuitively link academic and professional development with wellness, appealing to a wide array of students.

METHODS

We iteratively recontextualized an existing short-form mindfulness training program for high-stress pre-professionals, known as Mindfulness Based Attention Training (MBAT), to the medical school context (MBAT-Rx). MBAT-Rx was offered by physician trainers to first-year medical students at Warren Alpert Medical School of Brown University as a tool for improving study habits and focus in addition to the development of both self-care and patient care strategies. MBAT-Rx consists of weekly, two-hour sessions over four weeks, with 10-15 min of daily mindfulness practice between sessions. At the end of the four weeks, students submitted voluntary program evaluation responses detailing their experience of the program.

RESULTS

Optional program evaluation responses (n = 67) highlight that students found the program to be useful for their academic success and ability to pay attention, their interpersonal relationships, and their psychological health. By framing MT as an opportunity to boost core attentional capacities and connecting this to professional and academic goals in addition to wellness, MBAT-Rx appealed to a wide variety of students.

CONCLUSIONS

Our ongoing work suggests that framing MT as both a professional development and wellness promotion tool, taught by physicians themselves, and structured around students' time demands, may be a successful model for medical schools looking to increase the impact of their mindfulness offerings. Such programs are needed to equip medical students to navigate the demands of a challenging healthcare training landscape.

Unprofessional behaviour of GP residents leading to a dismissal dispute: characteristics and outcomes of those who appeal

BACKGROUND

Recognition of poor performance in General Practice trainees is important because underperformance compromises patients' health and safety. However, in General Practice, research on persistent underperformance while in training and its ultimate consequences is almost completely lacking. We aim to explore the unprofessional behaviours of residents in General Practice who were dismissed from training and who litigated against dismissal.

METHODS

We performed a structured analysis using open-source data from all General Practice cases before the Conciliation Board of the Royal Dutch Medical Association between 2011 and 2020. Anonymised law cases about residents from all Dutch GP training programmes were analysed in terms of the quantitative and qualitative aspects related to performance.

RESULTS

Between 2011 and 2020, 24 residents who were dismissed from training challenged their programme director's decision. Dismissed residents performed poorly in several competencies, including communication, medical expertise and most prominently, professionalism. Over 90% of dismissed residents failed on professionalism. Most lacked self-awareness and/or failed to profit from feedback. Approximately 80% failed on communication, and about 60% on medical expertise as well. A large majority (more than 80%) of dismissed residents had previously participated in some form of remediation.

CONCLUSIONS

Deficiencies in both professionalism and communication were the most prevalent findings among the dismissed General Practice residents. These two deficiencies overlapped considerably. Dismissed residents who challenged their programme director's decision were considered to lack self-awareness, which requires introspection and the appreciation of feedback from others.

"Will I be able to be myself? Or will I be forced to lie all the time?": How Trans and Non-Binary Students Balance Professionalism, Authenticity, and Safety in Canadian Medical Programs

Introduction

Promoting the inclusion of trans and non-binary (TNB) medical trainees is a key step in building an inclusive health workforce well-positioned to provide high-quality healthcare to all patients. Existing data on the experiences of TNB physicians and trainees describe widespread challenges related to prejudice and discrimination, with most trainees concealing their gender identity for fear of discrimination. We aimed to understand how TNB medical students have experienced professionalism and professional identity formation.

Methods

This was a secondary analysis of data gathered in a constructivist grounded theory study. The authors conducted semi-structured qualitative interviews in 2017 with seven current or recently graduated TNB Canadian medical students.

Results and Discussion

From medical school application to graduation, TNB medical students reported feeling tensions between meeting expectations of professionalism, being their authentic selves, and seeking to avoid conscious and implicit biases. These tensions played out around issues of disclosure, foregrounding identity through impression management, and responding to identity exemplars. The tension between TNB trainees' desire to bring their whole selves to the practice of medicine and feeling pressured to de-emphasize their gender is ironic when considering the increased call for medical trainees from equity-seeking communities. The most commonly used behavioural frameworks of professionalism were inherited from prior generations and restrict students whose experiences and community-based knowledge are most needed. Demands of professionalism that are incompatible with authentic professional identity development place an inordinate burden on trainees whose identities have been excluded from normative concepts of the professional, including TNB trainees.

The hidden hurdles of clinical clerkship: unraveling the types and distribution of professionalism dilemmas among South Korean medical students

BACKGROUND

To improve the medical professionalism of medical students, it is essential to understand the dilemmas they face in various situations. This study explored the types and distribution of dilemmas Korean medical students encounter during their clinical clerkships. It then compared these with previous dilemma frameworks and identified the types and distribution of "complexity dilemmas," wherein two dilemma themes emerge in a single clinical situation.

METHODS

The researchers organized and recorded a group discussion with 106 third-year medical students who had completed their clinical clerkships. These students participated in the discussion as part of an assignment, focusing on the dilemmas they encountered during their clerkships. For data analysis and visualization, the researchers employed the MAXQDA software program and utilized the template analysis method, a qualitative research methodology.

RESULTS

A total of seven dilemma themes and sixteen sub-themes were identified. The identity-related dilemma concerning student-doctors had the highest frequency. The themes "mismatch" and "Nun-chi" emerged as new additions not found in previous dilemma frameworks. The complexity dilemmas appeared in the sequence of "identity-dignity," "identity-abuse," and "identity-consent".

CONCLUSIONS

To navigate the unique dilemmas present within South Korea's clinical culture, several key issues need consideration: elevating the role of student-doctors, balancing the primary emphasis of educational hospitals on delivering medical services, and understanding interpersonal strategies, such as "Nun-chi".

Professionalism-training in undergraduate medical education in a multi-cultural, multi-ethnic setting in the Gulf Region: an exploration of reflective essays

BACKGROUND

Despite the established need to prioritize professionalism-training in developing future physicians, very few medical programs in the Gulf Region embed in their curricula discrete contextualized courses aimed at developing the corresponding competencies, while fostering self-directed learning. This study aims at exploring the perception of undergraduate medical students in a multi-cultural, multi-ethnic setting regarding their understanding of, and personal experience with professionalism through their engagement with the content of an innovative curriculum-based professionalism course, offered at a Medical School in Dubai, United Arab Emirates.

METHODS

The study used a qualitative phenomenological research design. Out of 33 students, 29 students had submitted reflective essays. The content of these essays was inductively analyzed following a six-step framework for conducting thematic analysis. The framework's steps include familiarizing oneself with the data, generating initial codes, searching for themes, reviewing themes, defining and naming themes, and producing the report.

FINDINGS

The inductive qualitative analysis generated the Professionalism Learning Journey model. This conceptual model includes four interconnected themes: Awareness, Acknowledgement, Realization, and Application. The generated model depicts the trajectory that the learners appear to experience while they are engaging with the content of the course.

CONCLUSION

Integrating a professionalism-training course into an undergraduate medical curriculum is likely to be positively appraised by the learners. It raises their awareness, enables them to value the subject matter and the sophistication of its application, and empowers them to put into practice the taught principles, on an individual basis and collectively. This is especially true when the course is entrenched in constructivism experiential learning theory and designed to foster self-directed learning. The introduced conceptual model, in conjunction with the innovative professionalism-training course curriculum, can serve as a template for other competencies and other schools.

Hybridity enabled: A research synthesis of the enabling conditions for hybrid professionalism in healthcare

Hybrid professionals in healthcare organizations play a critical role, the characteristics, processes and implications of which have been thoroughly studied by scholars in the field. However, not as much attention has been paid to the conditions under which such roles might be taken by professionals entering the ground of management. This gap results into a lack of conceptual clarity and eventually ends being an obstacle in framing and ameliorating the tools needed to act such a role in its different phases. This is a research area worthy of a finer-grained understanding: the ability of organizations to effectively support role hybridization, in fact, is a requisite for professionals-managers' willingness to stay in the role and cope with the complexity that such a two-fold position entails, no matter what. Based on the results of a scoping literature review, this paper presents the enabling conditions for hybrid professionalism in healthcare, and proposes a classification of them into categories corresponding to different facets of hybrid role-taking: opportunities for interaction with management, tools supporting sense-making, and provision of delegation and autonomy. For each of these categories, organizational and management tools discussed in the literature are presented. The results of the study provide a road-map of the enabling conditions for hybrid professionalism that aims to be of practical convenience for managers and policy-makers in health care. Eventually, suggestions for organizational design and personnel management, as well as directions for further research, are highlighted.

Moving Beyond the Dichotomous Assessment of Professionalism in the Internal Medicine Clerkship: Results of a National Survey of Clerkship Directors

PURPOSE

This study examines how internal medicine clerkship faculty and leadership conceptualize professionalism and professional behaviors and attitudes, identifies whether and how faculty use metrics to assess professionalism and factor it into clerkship grades, and describes barriers that prevent faculty from feeling prepared to support the development of professional behaviors in students.

METHOD

The Clerkship Directors in Internal Medicine opened a call for thematic survey section proposals to its physician-faculty members, blind-reviewed all submissions, and selected 4 based on internal medicine clinical clerkship training experience relevance. The survey launched on October 5 and closed on December 7, 2021. Data were analyzed using descriptive statistics.

RESULTS

Of 137 core clerkship directors (CDs) at Liaison Committee on Medical Education-accredited medical schools, 103 (75.2%) responded to the survey. Of 102 respondents (1 nonrespondent), 84 (82.4%) identified professional behavior lapses in involvement and 60 (58.8%) identified introspection lapses. Of 103 respondents, 97 (94.2%) reported that their clerkships ask clinical faculty and residents to formally evaluate professionalism, and 64 (62.1%) reported that they factor professionalism assessments into final clerkship grades. CDs reported multiple barriers to addressing professionalism directly with students, including logistical barriers, professionalism assessment subjectivity concerns, and the possible adverse effect of an unprofessional label for students.

CONCLUSIONS

Professionalism assessment and remediation in medical education currently center on a deficit model that seeks to identify and remediate professionalism lapses, rather than a developmental model that seeks to nurture growth. This dichotomous characterization of behaviors as professional or unprofessional limits assessment and can adversely affect the learning environment. The authors propose a shift to a developmental model that considers professionalism as a continuous process parallel to the acquisition of clinical skills and medical knowledge.

Experiences of Physicians Investigated for Professionalism Concerns: a Narrative Review

Growing attention is being paid to physician health and behavior, including the occurrence of mental health issues and burnout in medical providers, physician impairment, and alleged disruptive behavior in physicians. In any of these areas, a physician may become the subject of an investigation. Studying the experience of investigated physicians is important to identify and mitigate any potential adverse personal and practice impacts, which in turn can hinder patient care. The purpose of this review is to (1) summarize the published scientific literature to date regarding the experiences of physicians who have been investigated, and (2) based on these findings consider strategies to mitigate any adverse effects of the investigatory process for physicians. A search of the databases PubMed and Ovid MEDLINE was conducted in June 2023 using relevant search terms. After reviewing titles, abstracts, full-length articles, and reference lists, 16 articles were identified and reviewed. Physicians in multiple countries who had been investigated commonly described short-term (feelings of anger, depression, anxiety, shame, powerlessness, isolation, being betrayed, less confidence in clinical decision-making) and long-term (increase in defensive practice, retiring early) impacts of the investigatory process. Physicians found the most difficult aspects of the investigation process to be the length of time involved, lack of transparency/communication regarding the process, feelings of isolation, and dealing with vexatious complaints. While complaints about physicians have the potential to portend constructive individual practice and systemic changes, research suggests that the investigatory process for physicians is associated with negative short- and long-term emotional and practice impacts. Strategies to mitigate the unintended adverse effects of investigatory processes are proposed. Further research is warranted to clarify the investigation experience for physicians, including physicians underrepresented in medicine, and to systematically assess the effectiveness of strategies to mitigate unhealthy or disruptive components of the investigatory process.

Impact of a longitudinal course on medical professionalism on the empathy of medical students

OBJECTIVE

Medical education should enhance empathy. We examined, using self-assessment instruments and standardized patients (SPs), the impact on empathy, of a multi-year intervention (years 4-6 of medical training) that uses reflective learning approaches.

METHODS

241 final-year medical students participated; 110 from the 2018 graduation class (non-intervention group) and 131 from the 2019 graduation class (intervention group). Participants completed two self-reported empathy questionnaires - the Jefferson Scale of Empathy-Students (JSE-S) and the Interpersonal Reactivity Index (IRI) - and a personality questionnaire, the NEO Five-Factor Inventory. Additionally, SPs in a simulated station assessed participants' empathy with two patient-reported instruments: the Consultation and Relational Empathy (CARE) scale and the Jefferson Scale of Patient Perceptions of Physician Empathy (JSPPPE).

RESULTS

Empathy scores were significantly higher in the intervention group compared to the non-intervention group when assessed by the SP (p < 0.001). No differences were found in self-reported questionnaires between the two groups.

CONCLUSION

A longitudinal, multi-year reflection-based intervention enhanced empathy amongst medical students as assessed by SPs, but not when assessed by student self-reported measures.

PRACTICE IMPLICATIONS

Multi-year reflective learning interventions during clinical training nurture empathy in medical students. Assessments completed by SPs or patients may enhance the evaluation of empathy.

A systematic review and quality appraisal of interprofessional behavioral assessment instruments for nursing education

Instruments to assess interprofessional behaviors in prelicensure interprofessional education (IPE) lack validity and reliability data. No individual behavioral assessment instrument met all standards of the Quality Appraisal of Interprofessional Learning Scales (QuAILS) checklist (Oates & Davidson, 2015). The IPA and iSOFT instruments provided the most substantial validity and reliability evidence. Future validation research studies of interprofessional education (IPE) behavioral instruments that evaluate interprofessional professionalism (IPP) domains are needed in nursing education.

Discursive constructions of student midwives' professional identities: A discourse analysis

BACKGROUND

The construction and performance of professional identity is significant to broader socio-cultural understandings of who 'professionals' are and what they do. Importantly, it is also implicated in the development and enactment of policy, regulation, education, and professional practice. Professional identity is linked to self-esteem, self-efficacy, professional value, confidence and success. The salience of this in relation to midwifery practice is highly significant; aspects of autonomy, confidence, competence, responsibility, and accountability are all implicated in the provision of safe and effective care.

AIM

To explore how student midwives are constructed in the discourses of policy, professionalism, and learning, to provide new perspectives to inform, policy, education, and practice.

METHODS

An adapted critical discourse analysis of the United Kingdom (UK) Nursing and Midwifery Council's 2009 Standards for pre-registration midwifery education, using a three-step process: exploring discourse at the level of (1) discursive practice (2) linguistic features of the text, and (3) social practice.

FINDINGS/ DISCUSSION

The discourses that relate to midwifery education and practice emerge within socio-political and historical contexts. Constructions of identity are articulated through a rule-bound framework which includes competence, confidence and 'good health and good character'. There is a requirement for midwives to 'be' responsible, accountable, autonomous, professional, competent, and confident. Regulatory power is reinforced through medico-legal discourses, with the status of midwifery discursively presented as inferior to medicine.

CONCLUSION

According to the Standards, midwives must be a lot of things in their role and function. The Standards' discourses are authoritative, legislative and controlling, creating an ideology about professional status and agency which constructs an 'imaginary autonomy'; becoming a midwife is more automatic (with the perception of control), than agentic. All of which has significance for the social practice of midwifery.

TWEETABLE ABSTRACT

'How are midwives made? Discursive constructions of student midwives' professional identities: a discourse analysis.

Perception of dental students and faculty regarding the practice of professionalism in dentistry using the Professionalism Mini Evaluation Exercise (P-MEX)

BACKGROUND

Professionalism is one of the fundamental traits which includes behaviors, commitments, standards, and goals that helps define a profession.

OBJECTIVE

This study aimed to assess the attitude of dental students and graduates regarding the practice of professionalism in dentistry using the Professionalism Mini Evaluation Exercise (P-MEX) questionnaire.

METHOD

This cross-sectional study was conducted amongst the dental undergraduates, lecturers and postgraduate faculty. Views regarding professionalism were assessed using the P-MEX. The 24-questions based survey form is comprised of questions related to doctor and patient relationship skills, reflective abilities, time management, and lastly, interprofessional relationship expertise. Data was analyzed using SPSS version 23. Descriptive statistics were done using mean and SD, whilst associations between responses were assessed using Mann-Whitney U and Kruskal-Wallis tests. P value less than 0.05 was considered significant.

RESULTS

From a total of 201 participants, 95 (47.3%) were males and 106 (52.7%) were females. Statistically significant association was seen between time management, reflective skills, and interpersonal skills with gender, as well as the domains of P-MEX and years of education.

CONCLUSION

The use of P-MEX provides a valid confirmation for the assessment and awareness of professionalism amongst the dental faculty and students. Females demonstrated higher traits of professionalism as compared to males. The findings from the current study identify that students and faculty members had sufficient awareness regarding professionalism and the practice of professionalism was routinely followed.

Prediction, prognosis, and professionalism in perioperative medicine

Guidelines provide a framework to take better care of our patients. They are published by different professional groups and are based on all the research done for us by hardworking colleagues. Compiling a guideline is an enormous amount of work and is generally done with the utmost care. However, recommendations often require a subjective interpretation of published research, where personal and academic interests can influence the outcome. We discuss two recently published guidelines on perioperative cardiovascular assessment that led to different conclusions on some important areas of patient care.

Workforce Diversity, Equity, and Inclusion: A Crucial Component of Professionalism in Psychiatry

Documented disparities have profoundly impacted the training and careers of physicians from socially and historically marginalized groups, including women, people with disabilities, people who identify with racial and ethnic minority groups, and the lesbian, gay, bisexual, transgender, and queer or questioning+ community. Professionalism is a core component of medical training and practice, yet a focus on workforce diversity, equity, and inclusion is often absent. This report aims to encourage the adoption of workforce diversity, equity, and inclusion as a crucial component of professionalism, with an emphasis on the field of psychiatry.

The professionalism of clinical teachers in clinical education

BACKGROUND

Professionalism has long been recognised as a core competency for clinical teachers as role models and educators. The present study aimed to evaluate the adherence to professionalism of clinical teachers from the perspectives of resident doctors and undergraduate medical students.

METHODS

This is a descriptive and cross-sectional study. All learners, including undergraduate medical students and residents who were studying in the medical school and teaching hospitals affiliated with Shahid Sadoughi University, were entered into this study as evaluators (n = 311). Of these, 151 clinical teachers were assessed by the learners. The students were asked to assess the two clinical teachers with whom they had interacted during the previous month in the clinical department. The Faculty Professionalism Evaluation Questionnaire was used in this study.

RESULTS

The results of the confirmatory factor analysis (CFA) confirmed the adequacy of the model. The total mean score was 1.98 (standard deviation=0.36, range = 0.96 to 2.82). In addition, the total mean score of the adherence to professionalism among clinical teachers was reported at the level of "met expectations". The results showed that the teachers' scores in the domains of "doctor-patient relationship" and "doctor-student relationship" were reported under the "met expectations" level. Their scores in the "inter-professional relationship" and "doctor-self relationship" domains were reported as "below expectations". The results showed the scores of teachers' professionalism were significantly lower from the viewpoints of residents than in the perceptions of medical students (p=0.0001).

CONCLUSION

The professionalism scores of clinical teachers were evaluated as "below expectations" from the learners' perspectives.

Professionalism and Safety of DPT Students in First, Full-Time Clinical Experiences: Accelerated Hybrid versus Traditional Programs

PURPOSE

Doctor of Physical Therapy (DPT) education continues to progress with contemporary content and innovative teaching methods. The purpose of this study was to examine clinical assessment data from the Physical Therapist Clinical Performance Instrument (PT-CPI) focused on professionalism and safety in an initial clinical experience between an accelerated-hybrid and traditional DPT program.

METHODS

A retrospective analysis was performed on mid-term and final Safety, Professional Behavior, and Communication PT-CPI scores of each program's first clinical experience. The traditional program served as a control group. A total 186 students were examined: 100 from the traditional program and 86 from the accelerated-hybrid program.

RESULTS

There was a significant effect of learning environment on final test scores while controlling for midterm scores in Safety (p < 0.001), Professional Behavior (p < 0.001), and Communication (p < 0.001) with students in the accelerated-hybrid program scoring higher. Each program showed improvements from midterm to final PT-CPI, outperforming the set benchmark score with the accelerated-hybrid program showing larger growth in Communication and Safety.

CONCLUSION

Students in both DPT programs display acceptable levels of professionalism and safety according to program benchmarks and demonstrate growth in these areas throughout the clinical experiences despite differences in program design.

The Development and Implementation of a Model to Facilitate Self-Awareness of Professionalism for Enrolled Nurses

Within the South African context, the nursing profession comprises different nursing cadres. The enrolled nurse is considered a sub-category of nursing and therefore does not carry the title of 'professional' as in a professional nurse. The purpose of the study was to develop, describe, implement, and evaluate a model for the facilitation of self-awareness for the professionalism of enrolled nurses at a specific nursing agency in Gauteng. A theory generating, qualitative, exploratory, descriptive and contextual design was used and was conducted following Chinn and Kramer's four stages of model development. The model can benefit nursing education because it relates to an essential aspect of growth and maturity in one's career. Ultimately, the facilitation of self-awareness for professionalism can advance one's career, or the lack of self-awareness may impede one's career. Developing, describing, implementing and evaluating this model to facilitate self-awareness for the professionalism of enrolled nurses at a specific nursing agency in Gauteng provides an original contribution to the theory in nursing professionalism and ethos. This model can be utilised as a tool to facilitate self-awareness for the professionalism of enrolled nurses at a nursing agency.

Understanding medical professionalism using express team-based learning; a qualitative case-based study

Medical Professionalism (MP) defined as values, behaviours and attitudes that promote professional relationships, public trust and patient safety is a vital competency in health profession education. MP has a distinctive uniqueness due to cultural, contextual, conceptual, and generational variations. There is no standard instructional strategy to probe the understanding of MP in a cohesive, structured, interactive manner. This study aimed to investigate undergraduate medical students' understanding of MP using express team-based learning (e-TBL) at both campuses of Royal College of Surgeons Ireland (RCSI). Using the key principles of a sociocultural theoretical lens in adult learning theory, we designed e-TBL as a context-learning-based educational strategy. We conducted three e-TBL sessions on cross-cultural communication and health disparities, a reflective report on clinical encounters, and professionalism in practice. We collected, collated, and analyzed the student experiences qualitatively using data gathered from team-based case discussions during e-TBL sessions. A dedicated working group developed very short-answer questions for the individual readiness assurance test (IRAT) and MP-based case scenarios for team discussions. In this adapted 4-step e-TBL session, pre-class material was administered, IRAT was undertaken, and team-based discussions were facilitated, followed by facilitator feedback. A qualitative inductive thematic analysis was performed, which generated subthemes and themes illustrated in excerpts. Our thematic analysis of data from 172 students (101 from Bahrain and 71 from Dublin) yielded four unique themes: incoming professional attitudes, transformative experiences, sociological understanding of professionalism, and new professional identity formation. This qualitative study provides a deeper understanding of medical students' perceptions of medical professionalism. The generated themes resonated with divergent and evolving elements of MP in an era of socioeconomic and cultural diversity, transformative experiences, and professional identity formation. The core elements of these themes can be integrated into the teaching of MP to prepare fit-to-practice future doctors.

A scoping review on the relationship between mental wellbeing and medical professionalism

BACKGROUND

Mental wellbeing issues among medical students are common, and their relationship to medical professionalism is debated. Few studies have attempted to link such issues with undergraduate medical education. This review aimed to advance the knowledge on this matter by exploring the relationship between mental wellbeing and medical professionalism in undergraduate medical education.

METHODS

We collected the literature about mental wellbeing and medical professionalism (published from 1 January 1986 to 31 March 2021) from the Web of Science, PubMed, Scopus and ScienceDirect databases using the search terms 'mental wellbeing' and 'medical professionalism'.We included all peer-reviewed articles in which mental wellbeing and medical professionalism in the undergraduate medical education context were the central topics regardless of the age range, nationality, race and gender of the participants.

RESULTS

From the 13,076 Iinitially found articles, 16 were included. These 16 articles were from nine countries in four different continents, which all together helped us find answer to our research question using extracted points relating to the main study themes (mental wellbeing and medical professionalism). Under theme 1 (mental wellbeing), six subthemes emerged: burnout, stress, depression, disappointment, depersonalisation and conscientiousness. Theme 2 (medical professionalism), on the other hand, had five subthemes: empathy, academic performance, compassion, unprofessional behaviour and professionalism. A significant inverse association was found between empathy and burnout. Academic performance was also related to burnout. At the same time, empathy was found to have a varied association with stress. Moreover, compassion was found to alleviate burnout and nurture professional gratification.

CONCLUSION

The medical professionalism attributes were found to deteriorate as the mental wellbeing issues grow. This can harm medical students' overall health, current learning abilities and future attitudes towards their patients. Explicit primary research is thus required to examine and intervene in the cause-effect relationship between medical professionalism and mental wellbeing.

Professionalism in Physician Assistant Education as a Predictor of Future Licensing Board Disciplinary Actions

PURPOSE

The purpose of this study was to evaluate associations between postgraduate disciplinary actions (PGDA) by state licensing boards and physician assistant (PA) school documented professionalism violations (DPV) and academic probation.

METHODS

This was a retrospective cohort study comprising PA graduates from 2001 to 2011 at 3 institutions (n = 1364) who were evaluated for the main outcome of PGDA and independent variable of DPV and academic probation. Random-effects multiple logistic regression and accelerated failure time parametric survival analysis were used to investigate the association of PGDA with DPV and academic probation.

RESULTS

Postgraduate disciplinary action was statistically significant and positively associated with DPV when unadjusted (odds ratio [OR] = 5.15; 95% CI: 1.62-16.31; P = .01) and when adjusting for age, sex, overall PA program GPA (GPA), and Physician Assistant National Certifying Exam Score (OR = 5.39; 95% CI: 1.54-18.85; P = .01) (fully adjusted). Academic probation increased odds to 8.43 times (95% CI: 2.85-24.92; P < .001) and 9.52 times (95% CI: 2.38-38.01; P < .001) when fully adjusted.

CONCLUSION

Students with professionalism violation or academic probation while in the PA school had significant higher odds of receiving licensing board disciplinary action compared with those who did not. Academic probation had a greater magnitude of effect and could represent an intersection of professionalism and academic performance.

Cross-cultural adaptation and psychometric evaluation of the "Modification of Hall's professionalism scale for use with pharmacists"

BACKGROUND

Professionalism is the demonstration of behaviors that guide the actions of health professionals. In Pharmacy, its implementation is possible through assessment instruments for pharmacists, such as the "Modification of Hall's Professionalism Scale for Use with Pharmacists".

OBJECTIVE

To translate the "Modification of Hall's Professionalism Scale for Use with Pharmacists" into a Brazilian Portuguese version and evaluate its psychometric properties for pharmacists.

METHOD

The methodological process of this study took place in three stages: translation and cross-cultural adaptation of the instrument original version into a Brazilian Portuguese version; validation of the scale content through consensus among geographically distinct experts and, finally; examination of the scale psychometric measurement properties through a convenience sample of 600 Brazilian pharmacists. At this stage, construct validity was verified using Exploratory Factor Analysis (EFA) and reliability was examined by calculating the composite reliability.

RESULTS

The adapted instrument to a Brazilian Portuguese version demonstrated content validity with coefficients considered acceptable, above 0.8. The EFA demonstrated a structure supported by six factors and 39 items. The H index suggested high stability for all factors as well as composite reliability.

CONCLUSION

The Brazilian Portuguese version of the instrument presented appropriate content validity coefficients and psychometric properties. This measure may be useful for future studies on professionalism regarding teaching strategies and assessment of this construct among pharmacists.

Contradictions and Opportunities: Reconciling Professional Identity Formation and Competency-Based Medical Education

The widespread adoption of Competency-Based Medical Education (CBME) has resulted in a more explicit focus on learners' abilities to effectively demonstrate achievement of the competencies required for safe and unsupervised practice. While CBME implementation has yielded many benefits, by focusing explicitly on what learners are doing, curricula may be unintentionally overlooking who learners are becoming (i.e., the formation of their professional identities). Integrating professional identity formation (PIF) into curricula has the potential to positively influence professionalism, well-being, and inclusivity; however, issues related to the definition, assessment, and operationalization of PIF have made it difficult to embed this curricular imperative into CBME. This paper aims to outline a path towards the reconciliation of PIF and CBME to better support the development of physicians that are best suited to meet the needs of society. To begin to reconcile CBME and PIF, this paper defines three contradictions that must and can be resolved, namely: (1) CBME attends to behavioral outcomes whereas PIF attends to developmental processes; (2) CBME emphasizes standardization whereas PIF emphasizes individualization; (3) CBME organizes assessment around observed competence whereas the assessment of PIF is inherently more holistic. Subsequently, the authors identify curricular opportunities to address these contradictions, such as incorporating process-based outcomes into curricula, recognizing the individualized and contextualized nature of competence, and incorporating guided self-assessment into coaching and mentorship programs. In addition, the authors highlight future research directions related to each contradiction with the goal of reconciling 'doing' and 'being' in medical education.

Perceptions of nursing students and faculty members towards academic integrity and professionalism in Saudi Arabia: A cross-sectional study

BACKGROUND

Maintaining and nourishing academic integrity along with professionalism in nursing education is integral and imperative to the development of the nursing profession. However, evidence shows that academic dishonesty and incompetency exist and are raising problems among college students of all disciplines including nursing. To date, limited studies have been conducted in this area in Saudi Arabia.

OBJECTIVES

To determine the perceptions of nursing students and faculty members towards academic integrity and professionalism.

DESIGN

A cross-sectional design.

SETTINGS AND PARTICIPANTS

A convenience sample of undergraduate students enrolled in government universities in Saudi Arabia, and their faculty members.

METHODS

342 Saudi nursing students and 113 nursing faculty members were surveyed with a valid and reliable questionnaire modified to the study setting.

RESULTS

Findings revealed that the majority of nursing students and faculty members were aware of the nature of academic dishonesty and unprofessionalism. Less 40 % of students and teachers reported academic dishonesty and unprofessionalism as frequent. The majority of respondents in both groups revealed there were no existing policies in their colleges relevant to academic integrity/dishonesty. For those who reported the presence of a policy, the highest percentage of the respondents expressed just occasional implementation. There was no significant difference between the perceptions of students and faculty in all scenarios regarding academic integrity and professionalism. Lastly, the level of education and affiliated nursing college was associated with the respondents' perceptions.

CONCLUSIONS

Nursing students and faculty members have considerable cognizance of the concept of academic integrity and professionalism. However, the occurrence of academic dishonesty and unprofessionalism was observed at both universities. The lack of established policies is a particular challenge for management. Hence, it is essential that educational institutions formulate clear academic policies that cultivate academic integrity, prevent academic dishonesty, and enhance the level of professionalism.

Student experiences of professionalism and role models in an oral and maxillofacial surgery internship: A qualitative study

INTRODUCTION

Dental students have a clear concept of professionalism and the importance of role models. Our aim was to determine how dental students experience their first oral and maxillofacial surgery internship in terms of their concept of professionalism and their perception of role models.

METHODS

From June to August 2020, semi-structured telephone interviews were conducted with 22 dental students in their eighth and ninth semesters at the Medical Faculty of the University of Ulm. The interviews were transcribed and evaluated by qualitative content analysis according to Mayring.

RESULTS

The students' concept of dental professionalism was shaped by the elements of a good approach to patients, professional competence, and manual skills. This perception was not changed by the internship. Having a role model was seen as an important learning strategy, and role models were perceived in both positive and negative ways. Role models were perceived as positive if they corresponded to the student's concept of professionalism and as negative if they did not correspond to this concept, especially with regard to social interaction or the approach to patients. Students' reactions to discrepancies between their own moral values and the role models' behaviour were characterised by passivity and withdrawal. With regard to potential future careers, positive internship experiences supported student goals, whereas negative experiences raised doubts about them.

CONCLUSION

Supervising dentists may still underestimate the considerable impact of internships, and their awareness of this impact needs to be increased. Students' reactions to conflicts between reality and their own values do not appear to be constructive. One approach to solving this problem may be to include discussions of professional development in curricula.

Validation Of An Assessment Tool For Professionalism In Medical Students: A Mixed Method Study

Objectives

To develop and validate a tool for the assessment of professionalism in medical students during clerkship.

METHODS

The mixed-method study was conducted from February to September 2018 at the Islamic International Medical College, Riphah University, Islamabad, Pakistan. A preliminary focus group discussion was followed by two rounds of Delphi technique to validate micro-scenarios for the relevance of each item of the instrument alongside its content validity. For content and construct validation of the tool, content validity, cognitive validity, cognitive pretesting, confirmatory factor analysis and reliability assessment was done. Piloting was done on medical students doing clerkship. Data was analysed using SPSS 21 and AMOS 21.

RESULTS

A 35-item preliminary tool from micro-scenarios generated after focus group discussion was developed for the first Delphi round. For the second round, a 29-item tool was resent to the experts for validation. After the second round, the content validity scale was 0.94. Removal of 1 item produced a 28-item tool. Pre-cognitive testing of the 28 items resulted in rephrasing of 4, modification of 2, and deletion of 1 and a tool with 27 items. Piloting was carried out and after CFA resulted in a reduced 21 item tool. Cronbach's alpha value was 0.96. A good to excellent model fit was produced after performing confirmatory factor analysis.

CONCLUSIONS

A tool comprising of 21 items scored on a 5-point Likert scale that had acceptable construct validity and good content validity was developed. It can be used to evaluate the level of professionalism of local medical students doing clerkship.

Using Natural Language Processing and Machine Learning to Identify Internal Medicine-Pediatrics Residency Values in Applications

PROBLEM

Although holistic review has been used successfully in some residency programs to decrease bias, such review is time-consuming and unsustainable for many programs without initial prescreening. The unstructured qualitative data in residency applications, including notable experiences, letters of recommendation, personal statement, and medical student performance evaluations, require extensive time, resources, and metrics to evaluate; therefore, previous applicant screening relied heavily on quantitative metrics, which can be socioeconomically and racially biased.

APPROACH

Using residency applications to the University of Utah internal medicine-pediatrics program from 2015 to 2019, the authors extracted relevant snippets of text from the narrative sections of applications. Expert reviewers annotated these snippets into specific values (academic strength; intellectual curiosity; compassion; communication; work ethic; teamwork; leadership; self-awareness; diversity, equity, and inclusion; professionalism; and adaptability) previously identified as associated with resident success. The authors prospectively applied a machine learning model (MLM) to snippets from applications from 2023, and output was compared with a manual holistic review performed without knowledge of MLM results.

OUTCOMES

Overall, the MLM had a sensitivity of 0.64, specificity of 0.97, positive predictive value of 0.62, negative predictive value of 0.97, and F1 score of 0.63. The mean (SD) total number of annotations per application was significantly correlated with invited for interview status (invited: 208.6 [59.1]; not invited: 145.2 [57.2]; P < .001). In addition, 8 of the 10 individual values were significantly predictive of an applicant's invited for interview status.

NEXT STEPS

The authors created an MLM that can identify several values important for resident success in internal medicine-pediatrics programs with moderate sensitivity and high specificity. The authors will continue to refine the MLM by increasing the number of annotations, exploring parameter tuning and feature engineering options, and identifying which application sections have the highest correlation with invited for interview status.