Utilisation of an electronic portfolio to engage rehabilitation professionals in continuing professional development: results of a provincial survey

A scoping review of mentorship in allied health: Attributes, programs and outcomes

BACKGROUND

Mentorship is a mutually beneficial voluntary relationship between mentor and mentee. In principle, the mentee trusts in the mentor for guiding career development and acquiring new knowledge and skills while the mentor finds giving back to the profession rewarding. Mentorship is beneficial at every career stage, but little is known about current programs and processes.

OBJECTIVE

To review the literature about mentorship in allied health to inform programs and practices in occupational therapy. Scoping focused on barriers, facilitators and reported outcomes of programs and attributes of mentors and mentees.

DATA SOURCES

A search was applied to six databases on 8 February 2022 in Ovid MEDLINE, Ovid Embase, Scopus, PUBMED and CINAHL Complete. Search terms were developed in consultation with an academic librarian and using the population, concept and context mnemonic.

METHODS

We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) and the JBI Manual for Evidence Synthesis. Data extraction forms were piloted with two reviewers and dual extraction occurred with a portion of papers. Where conflicts arose, discussion occurred until a consensus was reached.

FINDINGS

Sixty-two papers were included from eleven countries. The papers arose from ten allied health disciplines, with five in occupational therapy. One-on-one mentoring was most common followed by groups and the use of online platforms. Structured approaches were often used, with the support of professional associations. Trust and willingness to share expertise were required attributes of mentors. Mentees appreciate self-selecting their mentor and having protected time for mentorship.

CONCLUSION AND SIGNIFICANCE

This synthesis provides a description of the available literature on mentorship in allied health. Benefits of mentorship were recorded with the acquisition of skills and knowledge being the most prominent. This synthesis provides ideas for future development and refinement of mentorship in occupational therapy.

Competency-based faculty development: applying transformations from lessons learned in competency-based medical education

Faculty development in medical education is often delivered in an ad hoc manner instead of being a deliberately sequenced program matched to data-informed individual needs. In this article, the authors, all with extensive experience in Faculty Development (FD), present a competency-based faculty development (CBFD) framework envisioned to enhance the impact of FD. Steps and principles in the CBFD framework reflect the lessons learned from competency-based medical education (CBME) with its foundational goal to better train physicians to meet societal needs. The authors see CBFD as a similar framework, this one to better train faculty to meet educational needs. CBFD core elements include articulated competencies for the varied educational roles faculty fulfill, deliberately designed curricula structured to build those competencies, and an assessment program and process to support individualized faculty learning and professional growth. The framework incorporates ideas about where and how CBFD should be delivered, the use of coaching to promote reflection and identity formation and the creation of communities of learning. As with CBME, the CBFD framework has included the important considerations of change management, including broad stakeholder engagement, continuous quality improvement and scholarship. The authors have provided examples from the literature as well as challenges and considerations for each step.

How does portfolio use support self-regulated learning during general practitioner specialty training? A qualitative focus group study

OBJECTIVES

Portfolios are used to support self-regulated learning (SRL), but the research literature is still inconclusive on their effectiveness. This study explored experiences with portfolio use among different stakeholders, to answer the research question: How does portfolio use support SRL during general practitioner (GP) specialty training?

DESIGN

We used a qualitative research design, based on phenomenology.

SETTING

Three of the eight training institutes of Dutch GP specialty training participated in this study.

PARTICIPANTS

The three stakeholder groups that use the portfolio were included in nine homogenous focus groups: trainees (n=16), supervisors (n=16) and faculty (n=17). All participants had at least 6-month experience with portfolio use.

RESULTS

Three themes were identified: SRL with(out) the portfolio, stakeholder dynamics and ambiguities. Respondents were doubtful about the learning benefits of portfolio use, as most trainees used their portfolio to 'check off' what was considered required. Stakeholder dynamics contributed to checking off behaviour in two ways. First, trainees experienced documenting learning activities to be superfluous, since the close relationship with their supervisor already supported SRL sufficiently. Second, faculty often (unintentionally) took portfolio ownership away from trainees, as they instructed trainees to deliver portfolio content that was valuable for assessment. Without ownership, trainees struggled to use the portfolio for SRL. Besides, ambiguities related to portfolio use amplified checking off behaviour.

CONCLUSIONS

Portfolio use did not support SRL in our setting. The multipurpose use of the portfolio (for the support of SRL and assessment) was identified as the primary obstacle. Underlying is a conflict that is often present in current medical curricula: agency versus accountability. If the support of SRL is considered a valuable and attainable purpose of portfolio use, it is important to realise that deliberate attention for this purpose is required during the design, guidance, assessment and evaluation of the portfolio.

How does portfolio use affect self-regulated learning in clinical workplace learning: What works, for whom, and in what contexts?

INTRODUCTION

Portfolio use to support self-regulated learning (SRL) during clinical workplace learning is widespread, but much is still unknown regarding its effectiveness. This review aimed to gain insight in the extent to which portfolio use supports SRL and under what circumstances.

METHODS

A realist review was conducted in two phases. First, stakeholder interviews and a scoping search were used to formulate a program theory that explains how portfolio use could support SRL. Second, an in-depth literature search was conducted. The included papers were coded to extract context-mechanism-outcome configurations (CMOs). These were synthesized to answer the research question.

RESULTS

Sixteen papers were included (four fulfilled all qualitative rigor criteria). Two primary portfolio mechanisms were established: documenting as a moment of contemplation (learners analyze experiences while writing portfolio reports) and documentation as a reminder of past events (previous portfolio reports aid recall). These mechanisms may explain the positive relationship between portfolio use and self-assessment, reflection, and feedback. However, other SRL outcomes were only supported to a limited extent: formulation of learning objectives and plans, and monitoring. The partial support of the program theory can be explained by interference of contextual factors (e.g., system of assessment) and portfolio-related mechanisms (e.g., mentoring).

DISCUSSION

Portfolio research is falling short both theoretically-in defining and conceptualizing SRL-and methodologically. Nevertheless, this review indicates that portfolio use has potential to support SRL. However, the working mechanisms of portfolio use are easily disrupted. These disruptions seem to relate to tensions between different portfolio purposes, which may undermine learners' motivation.

The role of ePortfolios in supporting learning in eight healthcare disciplines: A scoping review

AIM

This scoping review aims at providing a summary of available knowledge about the role of ePortfolios in scaffolding learning in eight healthcare disciplines to identify main concepts, best practices, and knowledge gaps.

BACKGROUND

ePortfolios are well established in scaffolding learning in many healthcare disciplines. Yet, an overview of the ePortfolio literature in the context of healthcare education doesn't exist.

DESIGN AND METHODS

A scoping review of ePortfolio use in the following healthcare disciplines was conducted: audiology, dental hygiene, midwifery, nursing (associate degree and bachelor), occupational therapy, podiatry, and speech therapy. Eight databases were systematically searched. By structuring the data, five themes were identified: (1) contexts, (2) research populations and samples, (3) ePortfolio platforms used and objectives, (4) benefits and challenges in the use of ePortfolios, and (5) recommendations derived from literature in the use of ePortfolios. The themes were further specified with sub-themes. The themes help meeting the aim of the scoping review to develop a structured overview of ePortfolio use and research.

RESULTS

Thirty-seven articles were included. Samples predominantly involved students and fewer mentors, educators, and graduates. ePortfolios were used to support learning in the context of healthcare workplaces (n = 17), educational institutions (n = 14), or both (n = 6). Different objectives of ePortfolio use were derived from literature and categorized into eight themes: (1) to document and evidence competency, (2) reflection, (3) feedback and assessment, (4) (inter)professional collaboration, (5) support Continuous Professional Development, (6) bridging the gap between theory and practice, (7) employment, and (8) certification. These objectives were in turn coupled to two identified types of ePortfolio platforms: "store and communicate" and "work and learn" ePortfolios. The description of benefits and challenges formed a substantial part of the literature and data were mapped into five themes to structure the data: (1) technology, (2) collaboration, (3) competency development (before and after graduation), (4) employment, and (5) quality of patient care. Although the benefits outweighed the challenges, important challenges were identified, e.g., the high time investment required when working with an ePortfolio, low digital literacy, lack of internet access.

CONCLUSIONS

Studies mainly focused on perceptions (n = 32). Only a few studies explored measurable outcomes (i.e., competencies or behavioral indicators). Because ePortfolios are used by different ePortfolio users, in different contexts, and with different objectives, new research directions are needed to investigate how specific features, such as collaboration tools, feedback tools, or assessment tools can improve the role of ePortfolios in supporting healthcare education.

TWEETABLE ABSTRACT

This scoping review presents an overview of the knowledge about the role of ePortfolios in scaffolding learning in eight healthcare disciplines.

Portfolios with Evidence of Reflective Practice Required by Regulatory Bodies: An Integrative Review

Purpose: Regulatory bodies impose continuing professional development (CPD) requirements on health care professionals (HCPs) as a condition for license revalidation. Many regulatory bodies require annual evidence of CPD activities that are informed by reflective practices, guided by learning plans, and compiled into a portfolio. The purpose of this integrative review is to summarize the literature discussing how regulatory bodies use portfolios with evidence of reflection for licensure renewal. Method: We reviewed English-language articles published until May 2020 discussing evidence of CPD and reflective practice in portfolios in the context of licensure renewal. Results: We located 17 articles for the review. None reported or measured outcomes beyond submission of reflective evidence. Sixteen articles (93%) included information about passive learning resources that regulatory bodies provided to help guide HCPs’ reflective learning activities. HCPs’ feedback about using reflective learning activities indicated mixed opinions about their utility. Conclusions: Few publications reported how jurisdictions expected HCPs to provide evidence of reflective practices for licensure renewal. None of the regulatory bodies required evidence regarding the impact of reflective practice on patient or organizational outcomes. HCPs reported both benefits and challenges of a mandated reflective process.

A Systematic Scoping Review on Portfolios of Medical Educators

BACKGROUND

Heralded as a teaching, assessment and reflective tool, and increasingly as a longitudinal and holistic perspective of the educator's development, medical educator's portfolios (MEP)s are increasingly employed to evaluate progress, assess for promotions and career switches, used as a reflective tool and as a means of curating educational activities. However, despite its blossoming role, there is significant dissonance in the content and structure of MEPs. As such, a systematic scoping review (SSR) is proposed to identify what is known of MEPs and its contents.

METHODS

Krishna's Systematic Evidenced Based Approach (SEBA) was adopted to structure this SSR in SEBA of MEPs. SEBA's constructivist approach and relativist lens allow data from a variety of sources to be considered to paint a holistic picture of available information on MEPs.

RESULTS

From the 12 360 abstracts reviewed, 768 full text articles were evaluated, and 79 articles were included. Concurrent thematic and content analysis revealed similar themes and categories including: (1) Definition and Functions of MEPs, (2) Implementing and Assessing MEPs, (3) Strengths and limitations of MEPs and (4) electronic MEPs.

DISCUSSION

This SSR in SEBA proffers a novel 5-staged evidence-based approach to constructing MEPs which allows for consistent application and assessment of MEPs. This 5-stage approach pivots on assessing and verifying the achievement of developmental milestones or 'micro-competencies' that facilitate micro-credentialling and effective evaluation of a medical educator's development and entrust-ability. This allows MEPs to be used as a reflective and collaborative tool and a basis for career planning.

How is self-regulated learning documented in e-portfolios of trainees? A content analysis

BACKGROUND

It is assumed that portfolios contribute to self-regulated learning (SRL). Presence of these SRL processes within the documentation kept in portfolios is presupposed in common educational practices, such as the assessment of reflective entries. However, questions can be asked considering the presence of SRL within portfolios. The aim of this study was to gain insight into the documentation of SRL processes within the electronic (e)-portfolio content of medical trainees. SRL consists of numerous processes, for this study the focus was on self-assessment via reflection and feedback, goal-setting and planning, and monitoring, as these are the processes that health professions education research mentions to be supported by portfolios.

METHODS

A database containing 1022 anonymous e-portfolios from General Practitioner trainees was used to provide descriptive statistics of the various available e-portfolio forms. This was followed by a quantitative content analysis of 90 e-portfolios, for which, a codebook was constructed to rate the documentation of the included SRL processes.

RESULTS

The numbers of forms in the e-portfolios varied to a great extent. Content analysis showed a limited documentation of reflective entries, and available entries mainly described events and experiences without explanations and context. Feedback was generally limited to comments on what went well and lacked specificity, context and suggestions for future action. Learning goals and plans were short of specificity, but did contain challenging topics and different goals were compatible with each other. 75% of the e-portfolios showed (limited) signs of monitoring.

CONCLUSIONS

The e-portfolio content showed limited documentation of SRL processes. As documentation of SRL requires time and asks for a high level of introspection and writing skills, one cannot expect documentation of SRL processes to appear in e-portfolio content without efforts.

Effectiveness of the spaced education pedagogy for clinicians' continuing professional development: a systematic review

CONTEXT

Ensuring clinical practice reflects current evidence is challenging given the rapid proliferation of new knowledge. Changing entrenched clinical behaviours and facilitating the adoption of best practice evidence requires a range of strategies, including affordable, scalable and effective continuing professional development (CPD). Yet, identifying the CPD delivery method most likely to effectively change and improve patient outcomes is difficult given the variability in the evidence for different learning approaches. Although there is moderate level evidence for outreach education, audit and feedback, and face-to-face or online learning, little is known about the capacity of spaced education to change ineffective clinical practice(s). Spaced education harnesses the power of spacing, repetition and testing learning content to increase topic-specific knowledge. Although spaced education is widely used in undergraduate and postgraduate medical programmes, its effectiveness as a CPD delivery method that improves patient outcomes is less certain.

AIM

To determine the effectiveness of the spaced education CPD programmes to change targeted clinical knowledge and practice(s) to improve patient outcomes.

METHOD

A systematic review, appraising the spaced education CPD evidence generated from searching six specialist medical and psychosocial databases. Studies published in English peer-reviewed journals from 1 January, 2000 to 31 August, 2018 were eligible for inclusion. A modified Kirkpatrick four levels of evaluation framework assisted with appraising the effect of spaced education CPD interventions on clinicians and patients.

RESULTS

Of the 2396 studies identified, 17 met the inclusion criteria, involving 2701 practising clinicians from multiple disciplines and specialties. Five randomised controlled trials generated level II evidence, with the remaining 12 studies generating lower levels of evidence. The majority of studies (n = 14) involved the delivery of online spaced education. All studies were evaluated using the modified Kirkpatrick four levels of evaluation framework with: 10 studies demonstrating significant increases in participants' knowledge; seven studies reporting significant changes in clinician behaviour; four studies showing significant increases in clinician confidence; and three studies identifying significant and sustained increases in participants' clinical skills. Only two studies reported positive improvements in patient outcomes.

CONCLUSION

Spaced education via an online platform offers a scalable CPD format that can increase clinical knowledge and change practice. However, further adequately powered randomised controlled trials are required to confirm that spaced education CPD can impact positively on patients' reported outcomes.

Coaching by design: exploring a new approach to faculty development in a competency-based medical education curriculum

As curricula move from a time-based system to a competency-based medical education system, faculty development will be required. Faculty will be asked to engage in the observation, assessment and feedback of tasks in the form of educational coaching. Faculty development in coaching is necessary, as the processes and tools for coaching learners toward competence are evolving with a novel assessment system. Here, we provide a scoping review of coaching in medical education. Techniques and content that could be included in the curricular design of faculty development programming for coaching (faculty as coach) are discussed based on current educational theory. A novel model of coaching for faculty (faculty as coachee) has been developed and is described by the authors. Its use is proposed for continuing professional development.