Reflective Practice: Assessing Its Effectiveness to Teach Professionalism in a Radiology Residency

A modified Delphi approach to nurturing professionalism in postgraduate medical education in Singapore

INTRODUCTION

Nurturing professional identities instils behavioural standards of physicians, and this in turn facilitates consistent professional attitudes, practice and patient care. Identities are socioculturally constructed efforts; therefore, we must account for the social, cultural and local healthcare factors that shape physicians' roles, responsibilities and expectations. This study aimed to forward a programme to nurture professionalism among physicians in Singapore.

METHODS

A three-phase, evidenced-based approach was used. First, a systematic scoping review (SSR) was conducted to identify professionalism elements. Second, a questionnaire was created based on the findings of the SSR. Third, a modified Delphi approach, which involved local experts to identify socioculturally appropriate elements to nurture professionalism, was used.

RESULTS

A total of 124 articles were identified from the SSR; these articles revealed definitions, knowledge, skills and approaches to nurturing professionalism. Through the modified Delphi approach, we identified professional traits, virtues, communication, ethical, self-care, teaching and assessment methods, and support mechanisms.

CONCLUSION

The results of this study formed the basis for a holistic and longitudinal programme focused on instilling professional traits and competencies over time through personalised and holistic support of physicians. The findings will be of interest to medical communities in the region and beyond.

How does guided group reflection work to support professional identity formation in postgraduate medical education: A scoping review

PURPOSE

In postgraduate medical education, guided group reflection is often applied to support professional identity formation. However, little is known about how guided group reflection is shaped and how it works. Our scoping review synthesizes existing evidence about various approaches for guided group reflection, their aims, components and potential working mechanisms.

METHODS

We conducted a scoping review using JBI (Joanna Briggs Institute) guidelines for conducting scoping reviews. We searched PubMed, PsycINFO, EMBASE and ERIC databases for all research articles published in English or Dutch in an iterative team approach. The articles were extracted and summarized quantitatively and qualitatively.

RESULTS

We included 71 papers (45 primary research papers and 26 non-empirical papers including program descriptions, theoretical concepts and personal experiences). We identified a diversity of approaches for guided group reflection (e.g. Balint groups, supervised collaborative reflection and exchange of experiences), applied in a variety of didactic formats and aims. We distilled potential working mechanisms relating to engagement in reflection, group learning and the supervisor's role.

CONCLUSIONS

There are significant knowledge gaps about the aims and underlying mechanisms of guided group reflection. Future systematic research on these topics is needed to understand the effectiveness of educational methods, that can help facilitate learning conditions to best shape professional identity formation (PIF) in educational curricula.

Strengthening the Clinical Learning Environment by Mandate-Implementing the ACGME Common Program Requirements

RATIONALE

Three years ago, the Accreditation Council for Graduate Medical Education (ACGME) introduced updated Common Program Requirements in recognition of the need to further promote resident and faculty member well-being and patient safety. The ACGME acknowledged residencies would need time to comply with new requirements. This grace period, however, concluded as of July 1, 2019, and programs now risk citations for failure to implement new requirements.

METHODS AND RESULTS

The authors, members of the Association of Program Directors in Radiology Common Program Requirements Ad Hoc committee, developed downloadable resources provided in the Appendix delineating the 2019 Common Program Requirements and offering sample resources as compliant solutions.

CONCLUSION

The resources offer a national standardized approach to educating trainees in these essential skills and should be especially helpful to programs with access to fewer resources. In addition to achieving compliance, incorporation of these resources into residency training will ensure the next generation of radiologists are equipped to add value while remaining physically and emotionally healthy.

Dual and duelling purposes: An exploration of educators' perspectives on the use of reflective writing to remediate professionalism in residency

CONTEXT

Professionalism lapses have high stakes for learners and educators. Problems with professionalism, unless appropriately and effectively remediated, may portend serious problems in practice. Yet, remediation for unprofessional behaviour is particularly challenging-and understudied. Increasingly, educators are turning to reflective writing as a remediation strategy in residency, yet little is known about what educators expect reflective writing to accomplish, how they choose reflective writing tasks, why they use reflective writing, or how they evaluate whether a learner has met expectations. We aimed to understand why and how postgraduate medical educators use reflective writing as an educational intervention to remediate professionalism.

METHOD

In this constructivist grounded theory study, we interviewed 13 medical education professionals with experience using reflective writing to remediate professionalism across five Canadian medical schools. Data collection and analysis occurred iteratively using constant comparison to identify themes and to understand the relationships among them.

RESULTS

Medical educators reported using reflective writing as a learning tool to develop insight and as an assessment tool to unearth evidence of insight. The goal of learning may compete with the goal of assessment, creating tension that leads to uncertainty about the sincerity, quality and effectiveness of reflective writing as well as concerns about learner safety. Educators reported uncertainty about whether learners write to pass or to introspect and about how to judge the effectiveness of reflective writing as a learning tool. They expressed concern about creating a safe environment for learners-one that enables the genuine reflection required for insight development-while meeting requirements of remediation.

CONCLUSIONS

Educators express ambivalence about using reflective writing to remediate professionalism in residency. Understanding the potential and pitfalls of reflective writing may inform more tailored and effective approaches to remediate professionalism.

International survey on residency programs in radiology: similarities and differences among 17 countries

OBJECTIVE

With the initiative of the ACR International Economics Committee, a multinational survey was conducted to evaluate radiology residency programs around the world.

METHODS

A 31-question survey was developed. It included: economic issues, program size and length, resident's activities during daytime and call, academic aspects including syllabus and examinations. Data was tabulated using the forementioned thematic framework and was qualitatively analyzed.

RESULTS

Responses were received from all 17 countries that were invited to participate (France, Netherlands, Israel, UK, Russia, USA, Japan, India, Germany, Canada, Turkey, Croatia, Serbia, Italy, Ireland, Hungary, and Greece). Residency length varied between 2 and 5 years. The certificate of residency completion is provided by a local hospital [4/17 (23%)], University [6/17 (36%)], National Board [6/17 (36%)], and Ministry of Health [1/17 (6%)]. There was variability among the number of residency programs and residents per program ranging from 15 to 300 programs per nation with a 1-700 residents in each one respectively. Salaries varied significantly and ranged from 8000 to 75,000 USD equivalent. Exams are an integral part of training in all surveyed countries. Length of call varied between 5 and 26 h and the number of monthly calls ranged from 3 to 6. The future of radiology was judged as growing in [12/17 (70%)] countries and stagnant in [5/17 (30%)] countries.

DISCUSSION

Radiology residency programs worldwide have many similarities. The differences are in the structure of the residency programs. Stagnation and uncertainties need to be addressed to ensure the continued development of the next generation of radiologists.

SUMMARY STATEMENT

There are many similarities in the academic aims and approach to education and training of radiology residency programs worldwide. The differences are in the structure of the residency programs and payments to individual residents.

Teaching Professionalism in Postgraduate Medical Education: A Systematic Review

PURPOSE

This systematic review sought to summarize published professionalism curricula in postgraduate medical education (PGME) and identify best practices for teaching professionalism.

METHOD

Three databases (MEDLINE, Embase, ERIC) were searched for articles published from 1980 through September 7, 2017. English-language articles were included if they (1) described an educational intervention addressing professionalism, (2) included postgraduate medical trainees, and (3) evaluated professionalism outcomes.

RESULTS

Of 3,383 articles identified, 50 were included in the review. The majority evaluated pre- and posttests for a single group (24, 48%). Three (6%) were randomized controlled trials. The most common teaching modality was small-group discussions (28, 56%); other methods included didactics, reflection, and simulations. Half (25, 50%) used multiple modalities. The professionalism topics most commonly addressed were professional values/behavior (42, 84%) and physician well-being (23, 46%). Most studies measured self-reported outcomes (attitude and behavior change) (27, 54%). Eight (16%) evaluated observed behavior and 3 (6%) evaluated patient outcomes. Of 35 studies that evaluated statistical significance, 20 (57%) reported statistically significant positive effects. Interventions targeting improvements in knowledge were most often effective (8/12, 67%). Curriculum duration was not associated with effectiveness. The 45 quantitative studies were of moderate quality (Medical Education Research Study Quality Instrument mean score = 10.3).

CONCLUSIONS

Many published curricula addressing professionalism in PGME are effective. Significant heterogeneity in curricular design and outcomes assessed made it difficult to synthesize results to identify best practices. Future work should build upon these curricula to improve the quality and validity of professionalism teaching tools.

Teaching and Assessing Professionalism in Radiology: Resources and Scholarly Opportunities to Contribute to Required Expectations

Teaching and assessing trainees' professionalism now represents an explicit expectation for Accreditation Council Graduate Medical Education-accredited radiology programs. Challenges to meeting this expectation include variability in defining the construct of professionalism; limits of traditional teaching and assessment methods, used for competencies historically more prominent in medical education, for professionalism; and emerging expectations for credible and feasible professionalism teaching and assessment practices in the current context of health-care training and practice. This article identifies promising teaching resources and methods that can be used strategically to augment traditional teaching of the cognitive basis for professionalism, including role modeling, case-based scenarios, debriefing, simulations, narrative medicine (storytelling), guided discussions, peer-assisted learning, and reflective practice. This article also summarizes assessment practices intended to promote learning, as well as to inform how and when to assess trainees as their professional identities develop over time, settings, and autonomous practice, particularly in terms of measurable behaviors. This includes assessment tools (including mini observations, critical incident reports, and appreciative inquiry) for authentic assessment in the workplace; engaging multiple sources (self-, peer, other health professionals, and patients) in assessment; and intentional practices for trainees to take responsibility for seeking our actionable feedback and reflection. This article examines the emerging evidence of the feasibility and value added of assessment of medical competency milestones, including professionalism, coordinated by the Accreditation Council Graduate Medical Education in radiology and other medical specialties. Radiology has a strategic opportunity to contribute to scholarship and inform policies in professionalism teaching and assessment practices.

Reflection as a Learning Tool in Graduate Medical Education: A Systematic Review

BACKGROUND

Graduate medical education programs employ reflection to advance a range of outcomes for physicians in training. However, the most effective applications of this tool have not been fully explored.

OBJECTIVE

A systematic review of the literature examined interventions reporting the use of reflection in graduate medical education.

METHODS

The authors searched Medline/PubMed, Embase, Cochrane CENTRAL, and ERIC for studies of reflection as a teaching tool to develop medical trainees' capacities. Key words and subject headings included reflection, narrative, residents/GME, and education/teaching/learning. No language or date limits were applied. The search yielded 1308 citations between inception for each database and June 15, 2015. A total of 16 studies, encompassing 477 residents and fellows, met eligibility criteria. Study quality was assessed using the Critical Appraisal Skills Programme Qualitative Checklist. The authors conducted a thematic analysis of the 16 articles.

RESULTS

Outcomes studied encompassed the impact of reflection on empathy, comfort with learning in complex situations, and engagement in the learning process. Reflection increased learning of complex subjects and deepened professional values. It appears to be an effective tool for improving attitudes and comfort when exploring difficult material. Limitations include that most studies had small samples, used volunteers, and did not measure behavioral outcomes.

CONCLUSIONS

Critical reflection is a tool that can amplify learning in residents and fellows. Added research is needed to understand how reflection can influence growth in professional capacities and patient-level outcomes in ways that can be measured.

Current Practices in Assessing Professionalism in United States and Canadian Allopathic Medical Students and Residents

Professionalism is a critically important competency that must be evaluated in medical trainees but is a complex construct that is hard to assess. A systematic review was undertaken to give insight into the current best practices for assessment of professionalism in medical trainees and to identify new research priorities in the field. A search was conducted on PubMed for behavioral assessments of medical students and residents among the United States and Canadian allopathic schools in the last 15 years. An initial search yielded 594 results, 28 of which met our inclusion criteria. Our analysis indicated that there are robust generic definitions of the major attributes of medical professionalism. The most commonly used assessment tools are survey instruments that use Likert scales tied to attributes of professionalism. While significant progress has been made in this field in recent years, several opportunities for system-wide improvement were identified that require further research. These include a paucity of information about assessment reliability, the need for rater training, a need to better define competency in professionalism according to learner level (preclinical, clerkship, resident etc.) and ways to remediate lapses in professionalism. Student acceptance of assessment of professionalism may be increased if assessment tools are shifted to better incorporate feedback. Tackling the impact of the hidden curriculum in which students may observe lapses in professionalism by faculty and other health care providers is another priority for further study.

Teaching and Assessing Professionalism in Radiology Resident Education

Radiologists in teaching hospitals and in practices with residents rotating through are involved in the education of their residents. The Accreditation Council for Graduate Medical Education requires evidence that trainees are taught and demonstrate competency not only in medical knowledge and in patient care-the historic focus of radiology education-but also in the so-called non-interpretative core competencies, which include professionalism and interpersonal skills. In addition to accreditation agencies, the prominent assessment practices represented by the American Board of Radiology core and certifying examinations for trainees, as well as Maintenance of Certification for practitioners, are planning to feature more non-interpretative competency assessment, including professionalism to a greater extent. Because professionalism was incorporated as a required competency in medical education as a whole, more clarity about the justification and expected content for teaching about competence in professionalism, as well as greater understanding and evidence about appropriate and effective teaching and assessment methods, have emerged. This article summarizes justifications and expectations for teaching and assessing professionalism in radiology residents and best practices on how to teach and evaluate professionalism that can be used by busy radiology faculty in their everyday practice supervising radiology residents.

Teaching Principles of Patient-Centered Care During Radiology Residency

RATIONALE AND OBJECTIVES

Patient-centered healthcare delivery has become increasingly established as a cornerstone of quality medical care, but teaching these principles in a radiology residency setting is often difficult and ineffective in a traditional lecture format. We developed a novel educational session in which actual patient letters about a healthcare provider are used to facilitate a case-based discussion of key principles of patient-centered care.

MATERIALS AND METHODS

A novel patient letter-facilitated, case-based session was conducted at two different university-based teaching institutions. Prior to the educational session, patient letters introducing the principles of patient-centered care were distributed to residents for review. During the session, radiology-specific cases were discussed in the context of the principles introduced by the letters. A post-session survey was administered to evaluate the efficacy and usefulness of the session.

RESULTS

Forty-six of the 61 session attendees (75%) completed the post session survey. Most respondents (93%) preferred this case-based, interactive session to a typical didactic session. A majority of the residents indicated that both the patient letters (64%) and radiology specific cases (73%) helped them think differently about how they interact with patients. They indicated that the session enhanced their understanding of professionalism (3.7 out of 5.0 [95% CI 3.4-4.0]) and increased their motivation to become more patient-centered (3.0 out of 4.0 [95% CI 2.8-3.3]).

CONCLUSIONS

Our findings suggest that patient letter-facilitated, case-based sessions may influence resident attitudes regarding the principles of patient-centered care and may help to increase resident motivation to become more patient-centered in their own practice.

The Desired Concept Maps and Goal Setting for Assessing Professionalism in Medicine

Due to the multi-dimensional characteristics of professionalism, no single assessment modality has shown to reliably assess professionalism. This review aims to describe some of the popular assessment tools that are being used to assess professionalism with a view to formulate a framework of assessment of professionalism in medicine. In December 2015, the online research databases of MEDLINE, the Educational Resources Information Center (ERIC), Elton Bryson Stephens Company (EBSCO), SCOPUS, OVID and PsychINFO were searched for full-text English language articles published during 2000 to 2015. MeSH terms "professionalism" AND "duty" AND "assessment" OR "professionalism behavioural" AND "professionalism-cognitive" were used. The research articles that assessed professionalism across medical fields along with other areas of competencies were included. A final list of 35 articles were selected for this review. Several assessment tools are available for assessing professionalism that includes, but not limited to, mini clinical evaluation exercise, standardised direct observation of procedural skills, professionalism mini-evaluation exercise, multi-source feedback and 360 degree evaluation, and case based discussions. Because professionalism is a complex construct, it is less likely that a single assessment strategy will adequately measure it. Since every single assessment tool has its own weaknesses, triangulation involving multiple tools can compensate the shortcomings associated with any single approach. Assessment of professionalism necessitates a combination of modalities at individual, interpersonal, societal, and institutional levels and should be accompanied by feedback and motivational reflection that will, in turn, lead to behaviour and identity formation. The assessment of professionalism in medicine should meet the criteria of validity, reliability, feasibility and acceptability. Educators are urged to enhance the depth and quality of assessment instruments in the existing medical curricula for ensuring validity and reliability of assessment tools for professionalism.