An e-portfolio in health professional education

A Systematic Scoping Review on Portfolios of Medical Educators

BACKGROUND

Heralded as a teaching, assessment and reflective tool, and increasingly as a longitudinal and holistic perspective of the educator's development, medical educator's portfolios (MEP)s are increasingly employed to evaluate progress, assess for promotions and career switches, used as a reflective tool and as a means of curating educational activities. However, despite its blossoming role, there is significant dissonance in the content and structure of MEPs. As such, a systematic scoping review (SSR) is proposed to identify what is known of MEPs and its contents.

METHODS

Krishna's Systematic Evidenced Based Approach (SEBA) was adopted to structure this SSR in SEBA of MEPs. SEBA's constructivist approach and relativist lens allow data from a variety of sources to be considered to paint a holistic picture of available information on MEPs.

RESULTS

From the 12 360 abstracts reviewed, 768 full text articles were evaluated, and 79 articles were included. Concurrent thematic and content analysis revealed similar themes and categories including: (1) Definition and Functions of MEPs, (2) Implementing and Assessing MEPs, (3) Strengths and limitations of MEPs and (4) electronic MEPs.

DISCUSSION

This SSR in SEBA proffers a novel 5-staged evidence-based approach to constructing MEPs which allows for consistent application and assessment of MEPs. This 5-stage approach pivots on assessing and verifying the achievement of developmental milestones or 'micro-competencies' that facilitate micro-credentialling and effective evaluation of a medical educator's development and entrust-ability. This allows MEPs to be used as a reflective and collaborative tool and a basis for career planning.

First year specialist trainees' engagement with reflective practice in the e-portfolio

Doctors in specialist training posts in the Mersey Deanery are expected to reflect on their clinical practice and to document their learning experiences in an e-portfolio. This study aims specifically to explore how they have engaged in reflection on their practice and how they utilise their learning portfolio to document evidence of this. A modified Delphi technique was used to develop a grading system to identify the level of reflection recorded by participants in the e-portfolio. Transcripts of the reflective accounts were then analysed using a qualitative approach which involved coding and categorising the data. This study demonstrated a wide variation in both the quantity and quality of reflection. Of particular note in the qualitative data analysis were themes relating to clinical knowledge and skills, learning in practice, communication, feelings, types of learning experience reflected on and wider aspects of medical practice. Findings indicate there is variation is the extent to which doctors both engage in and document evidence of reflection. Further research is needed to explore factors that enable or inhibit the use of the e-portfolio for reflection and whether recorded reflection is a true picture of the cognitive process involved.

Portfolios for assessment and learning: AMEE Guide no. 45

In 1990, Miller wrote that no tools were available for assessment of what a learner does when functioning independently at the clinical workplace (Miller 1990 ). Since then portfolios have filled this gap and found their way into medical education, not only as tools for assessment of performance in the workplace, but also as tools to stimulate learning from experience. We give an overview of the content and structure of various types of portfolios, describe the potential of electronic portfolios, present techniques and strategies for using portfolios as tools for stimulating learning and for assessment, and discuss factors that influence the success of the introduction. We conclude that portfolios have a lot of potential but that their introduction also often leads to disappointment, because they require a new perspective on education from mentors and learners and a significant investment of time and energy.

Development of a web database portfolio system with PACS connectivity for undergraduate health education and continuing professional development

Increasingly, the use of web database portfolio systems is noted in medical and health education, and for continuing professional development (CPD). However, the functions of existing systems are not always aligned with the corresponding pedagogy and hence reflection is often lost. This paper presents the development of a tailored web database portfolio system with Picture Archiving and Communication System (PACS) connectivity, which is based on the portfolio pedagogy. Following a pre-determined portfolio framework, a system model with the components of web, database and mail servers, server side scripts, and a Query/Retrieve (Q/R) broker for conversion between Hypertext Transfer Protocol (HTTP) requests and Q/R service class of Digital Imaging and Communication in Medicine (DICOM) standard, is proposed. The system was piloted with seventy-seven volunteers. A tailored web database portfolio system (http://radep.hti.polyu.edu.hk) was developed. Technological arrangements for reinforcing portfolio pedagogy include popup windows (reminders) with guidelines and probing questions of 'collect', 'select' and 'reflect' on evidence of development/experience, limitation in the number of files (evidence) to be uploaded, the 'Evidence Insertion' functionality to link the individual uploaded artifacts with reflective writing, capability to accommodate diversity of contents and convenient interfaces for reviewing portfolios and communication. Evidence to date suggests the system supports users to build their portfolios with sound hypertext reflection under a facilitator's guidance, and with reviewers to monitor students' progress providing feedback and comments online in a programme-wide situation.

The use of tablet PCs to access an electronic portfolio in the clinical setting: a pilot study using undergraduate nursing students

BACKGROUND

In 2006, a digitalised clinical portfolio was introduced into an undergraduate nursing program. The use of a tablet personal computer (PC) with wireless broadband access could overcome issues around computer access in the clinical setting enhancing authenticity and timeliness of assessment.

METHODS

In July 2007, a Hewlett-Packard TC 4400 tablet PC was issued to three participating students. A focus group utilising a semi-structured interview and a survey collected data from the students at the end of the trial to determine the effectiveness of the strategy.

RESULTS

Participants used tablet PCs to access their portfolios. However, lack of space, busy wards and concerns about the security of the PCs limited their use in the clinical setting. The majority of their journal entries were made at home and within similar time frames to those prior to access to tablet PCs. Participants also used the PCs to provide education to other students and staff but were reluctant to use them in front of patients.

CONCLUSION

Barriers limiting the use of tablet PCs in the clinical setting may be overcome with greater proficiency in their utility and increased portability of the technology. Tablet PCs offer advantages related to and beyond portfolio use in the clinical setting.

Web- or paper-based portfolios: is there a difference?

OBJECTIVE

To determine the differential effects of a paper-based versus a web-based portfolio in terms of portfolio quality, user-friendliness and student motivation.

METHODS

An experimental design was used to compare Year 1 medical students' reflective portfolios. The portfolios differed in presentation medium only (i.e. web-based versus paper-based). Content analysis, a student questionnaire and mentor interviews were used to evaluate portfolio quality, user-friendliness and student motivation. A total of 92 portfolios were scored independently by 2 raters using a portfolio quality-rating instrument.

RESULTS

Portfolio structure, quality of reflection and quality of evidence showed no significant effects of presentation medium. Multi-level analysis showed a significant effect for student motivation: web-based portfolios scored 0.39 more than paper-based portfolios (P < 0.05; effect size 0.76). The mentors reported no differences in portfolio quality, except that there were more visuals in web-based portfolios. Students spent significantly more time preparing the web-based than the paper-based portfolios (15.4 hours versus 12.2 hours; t = 2.1, P < 0.05; effect size 0.46). The 2 student groups did not differ significantly in terms of their satisfaction with the portfolio. The mentors perceived the web-based portfolios as more user-friendly.

CONCLUSIONS

The web-based portfolios were found to enhance students' motivation, were more user-friendly for mentors, and delivered the same content quality compared with paper-based portfolios. This suggests that web-based presentation may promote acceptance of portfolios by students and teachers alike.