Impact of online education on intern behaviour around joint commission national patient safety goals: a randomised trial

Pilot study to explore the use of mobile spaced learning as a digital learning platform when teaching symptom management to undergraduate nursing students: SPLENdidS study

Background

The management of patients’ holistic symptom needs are often complex and challenging. The education needs of undergraduate nursing students must be optimally addressed to have a significant positive impact on patient care. Mobile spaced learning has been recognised as a form of online education which can provide a novel approach to delivering effective evidence based healthcare education to undergraduate students.

Objective

The objective of this pilot study was to explore the experiences of undergraduate nursing students in a university setting, of using mobile spaced learning as a digital platform for symptom management education.

Method

This pilot study used a mixed methods approach. Online spaced learning material, which utilised both case based scenarios and multiple choice questions, was delivered to first year undergraduate nursing students over a period of 2 weeks. Participants were then invited to participate in an online survey related to the usability of mobile spaced learning. A focus group was conducted to further explore the participants’ views.

Result

Findings conveyed that students viewed mobile spaced learning as an acceptable platform that enhanced both their learning and their ability to transfer knowledge into clinical practice.

Conclusion

Implementation of a digital spaced learning intervention would be acceptable to undergraduate nursing students learning about holistic symptom management. Further research is needed to explore the feasibility of implementing this intervention within the undergraduate nursing curriculum, and also to explore the impact on long-term knowledge retention.

Theory in quality improvement and patient safety education: A scoping review

INTRODUCTION

Theory plays an important role in education programming and research. However, its use in quality improvement and patient safety education has yet to be fully characterized. The authors undertook a scoping review to examine the use of theory in quality improvement and patient safety education.

METHODS

Eligible articles used theory to inform the design or study of a quality improvement or patient safety curriculum. The authors followed scoping review methodology and searched articles referenced in 20 systematic reviews of quality improvement and patient safety education, or articles citing one of these reviews, and hand searched eligible article references. Data analysis involved descriptive and interpretive summaries of theories used and the perspectives the theories offered.

RESULTS

Eligibility criteria were met by 28 articles, and 102 articles made superficial mention of theory. Eligible articles varied in professional group, learning stage and journal type. Theories fell into two broad categories: learning theories (n = 20) and social science theories (n = 11). Theory was used in the design (n = 12) or study (n = 17) of quality improvement and patient safety education. The range of theories shows the opportunity afforded by using more than one type of theory.

DISCUSSION

Theory can guide decisions regarding quality improvement and patient safety education practices or play a role in selecting a methodology or lens through which to study educational processes and outcomes. Educators and researchers should make deliberate choices around the use of theory that relates to aspects of an educational program that they seek to illuminate.

Spaced Education With ABSITE Quest Resulting in Improved American Board of Surgery In-Training Examination Performance

OBJECTIVE

The American Board of Surgery In-Training Examination (ABSITE) is an annual exam taken by general surgery residents as a cognitive assessment of the knowledge gained throughout each year of training. Several question banks are available for ABSITE preparation. However, ABSITE Quest (AQ) utilizes a method called spaced education which has been demonstrated to help with retaining information longer and improve exam performance. This study hypothesizes that using this method will help residents improve their ABSITE performance.

DESIGN

Retrospective survey data was collected from residents who participated in AQ, including postgraduate year (PGY) level, as well as 2019 and 2020 ABSITE percentiles. AQ user data was used to match respondent's total number of questions completed and daily engagement level to the survey data. Paired, single-tailed student's t test was used to evaluate the significance of ABSITE percentile change between 2019 and 2020 among AQ users.

SETTING

ChristianaCare, Newark, DE, United States. Nonclinical.

PARTICIPANTS

All ABSITE Quest users were surveyed (n = 390), of which 104 responded. 21 responses were from PGY1 residents and were excluded, resulting in a total of 83 responses.

RESULTS

The mean percentile difference of AQ users from 2019 to 2020 was +15.8 (p < 0.00001). When categorizing by the total number of questions completed, high users demonstrated a mean percentile difference of +15.3 (p = 0.00002), average users had a difference of +19.1 (p = 0.00029), and low users showed a percentile difference of +1.2 (p = 0.45244). When categorizing by daily engagement level, high users demonstrated a mean percentile difference of +17.9 (p < 0.00001), low users had a mean percentile difference of +15.3 (p = 0.00124), and minimal users showed a mean percentile change of -5.7.

CONCLUSIONS

The use of the spaced education method with ABSITE Quest, especially in users with a greater number of questions completed and high levels of daily engagement, correlated with a significant improvement on ABSITE performance.

Conceptualising spaced learning in health professions education: A scoping review

OBJECTIVES

To investigate the definitions and applications of 'spaced learning' and to propose future directions for advancing its study and practice in health professions education.

METHOD

The authors searched five online databases for articles published on spaced learning in health professions education prior to February 2018. Two researchers independently screened articles for eligibility with set inclusion criteria. They extracted and analysed key data using both quantitative and qualitative methods.

RESULTS

Of the 2972 records retrieved, 120 articles were included in the review. More than 90% of these articles were published in the last 10 years. The definition of spaced learning varied widely and was often not theoretically grounded. Spaced learning was applied in distinct contexts, including online learning, simulation training and classroom settings. There was a large variety of spacing formats, ranging from dispersion of information or practice on a single day, to intervals lasting several months. Generally, spaced learning was implemented in practice or testing phases and rarely during teaching.

CONCLUSIONS

Spaced learning is infrequently and poorly defined in the health professions education literature. We propose a comprehensive definition of spaced learning and emphasise that detailed descriptions of spacing formats are needed in future research to facilitate the operationalisation of spaced learning research and practice in health professions education.

Infectious diseases and antimicrobial prescribing: Online spaced education for junior doctors

BACKGROUND

Inappropriate antimicrobial prescribing may harm patients and drive antimicrobial resistance. Junior doctors' knowledge of infectious diseases and antimicrobial prescribing is inadequate. Online spaced case-based learning can improve knowledge.

OBJECTIVE

To develop infectious diseases and antimicrobial prescribing course content for online spaced education and assess its effectiveness and feasibility for junior doctors.

METHODS

Infectious diseases and antimicrobial course content was developed for an online spaced education platform (Qstream Inc., Burlington, MA). Junior doctors (postgraduate years 1-3) at two tertiary teaching hospitals in Sydney participated in the study. Course content was provided with Qstream at one hospital and at the other hospital via two face-to-face (FTF) tutorials from August to October 2017. Knowledge and self-confidence were compared before and after training within and between both cohorts.

RESULTS

Participation in the course was higher in the Qstream cohort with 48/127 (37.8%) completing the course compared with 44/110 (40%) attending one or both FTF sessions, of whom 22/110 (20%) attended both. Improvement in mean knowledge score from 69.7% to 81.5% in the Qstream cohort was significantly greater than the FTF cohort's minimal improvement from 67.6% to 67.9% (95% CI 2.79-20.33; P=0.01). In the Qstream cohort mean confidence rating (0-10) improvement from 5.14 to 6.55 was greater than the FTF group improvement from 5.37 to 5.85 (95% CI 0.132-1.171; P=0.02). Qstream feedback was very positive.

CONCLUSIONS

Online spaced education in infectious diseases and antimicrobial prescribing was feasible, acceptable and effective for junior doctors. It has potential to reduce inappropriate antimicrobial prescribing and warrants further investigation.

Pediatrician Perspectives on Learning and Practice Change in the MOCA-Peds 2017 Pilot

BACKGROUND AND OBJECTIVES

This article is the second of a 2-part series examining results regarding self-reported learning and practice change from the American Board of Pediatrics 2017 pilot of an alternative to the proctored, continuing certification examination, termed the Maintenance of Certification Assessment for Pediatrics (MOCA-Peds). Because of its design, MOCA-Peds has several learning advantages compared with the proctored examination.

METHODS

Quantitative and qualitative analyses with 5081 eligible pediatricians who registered to participate in the 2017 pilot; 81.4% (n = 4016) completed a quarter 4 survey and/or the end-of-year survey (January 2018) and compose the analytic sample.

RESULTS

Nearly all (97.6%) participating pediatricians said they had learned, refreshed, or enhanced their medical knowledge, and of those, 62.0% had made a practice change related to pilot participation. Differences were noted on the basis of subspecialty status, with 68.9% of general pediatricians having made a practice change compared with 41.4% of subspecialists. Within the 1456 open-ended responses about participants' most significant practice change, responses ranged widely, including both medical care content (eg, "care for corneal abrasions altered," "better inform patients about. . .flu vaccine") and nonspecific content (eg, providing better patient education, using evidence-based medicine, increased use of resources in regular practice).

CONCLUSIONS

As a proctored examination alternative, MOCA-Peds positively influenced self-reported learning and practice change. In future evaluation of MOCA-Peds and other medical longitudinal assessments, researchers should study ways to further encourage learning and practice change and sustainability.

E-learning on risk management. An opportunity for sharing knowledge and experiences in patient safety

QUALITY PROBLEM

E-learning methodology is a good alternative to more traditional methods when economical restrictions and geographical dispersion are important. However, there is still little knowledge about its utility in the development of patient safety (PS) improvement projects.

INITIAL ASSESSMENT

Evaluation of the acceptability and utility of an e-learning risk management (RM) course for healthcare professionals to develop PS improvement projects in different clinical settings.

CHOICE OF SOLUTION

E-course offered, in Spanish and English, to facilitate the design of PS improvement projects using RM tools under the continuous support of PS experts.

IMPLEMENTATION

The evaluation of the course was based on the reaction, learning and healthcare professional behavior. A free online database was created to disseminate and share the projects developed during the course.

EVALUATION

A total of 1426 professionals have completed the course (84.2%), of which 86.7% (1236) were from Spain, 8.3% (118) from Latin America and 5% (72) from other European and Eastern Mediterranean countries. More than 80% of the students were very satisfied with the e-course and 98% would recommend it to their colleagues. Learning and developing improvement projects through teamwork was highlighted as a very positive aspect. A total of 70.3% of the 387 PSIP were developed in hospitals. The most frequent topic was medication.

LESSON LEARNED

Team learning based on real cases was one of the most positive aspects of the e-course. The improvement projects developed are transferable examples of good practices that facilitate the application of RM tools in different clinical settings.

Effectiveness of the spaced education pedagogy for clinicians' continuing professional development: a systematic review

CONTEXT

Ensuring clinical practice reflects current evidence is challenging given the rapid proliferation of new knowledge. Changing entrenched clinical behaviours and facilitating the adoption of best practice evidence requires a range of strategies, including affordable, scalable and effective continuing professional development (CPD). Yet, identifying the CPD delivery method most likely to effectively change and improve patient outcomes is difficult given the variability in the evidence for different learning approaches. Although there is moderate level evidence for outreach education, audit and feedback, and face-to-face or online learning, little is known about the capacity of spaced education to change ineffective clinical practice(s). Spaced education harnesses the power of spacing, repetition and testing learning content to increase topic-specific knowledge. Although spaced education is widely used in undergraduate and postgraduate medical programmes, its effectiveness as a CPD delivery method that improves patient outcomes is less certain.

AIM

To determine the effectiveness of the spaced education CPD programmes to change targeted clinical knowledge and practice(s) to improve patient outcomes.

METHOD

A systematic review, appraising the spaced education CPD evidence generated from searching six specialist medical and psychosocial databases. Studies published in English peer-reviewed journals from 1 January, 2000 to 31 August, 2018 were eligible for inclusion. A modified Kirkpatrick four levels of evaluation framework assisted with appraising the effect of spaced education CPD interventions on clinicians and patients.

RESULTS

Of the 2396 studies identified, 17 met the inclusion criteria, involving 2701 practising clinicians from multiple disciplines and specialties. Five randomised controlled trials generated level II evidence, with the remaining 12 studies generating lower levels of evidence. The majority of studies (n = 14) involved the delivery of online spaced education. All studies were evaluated using the modified Kirkpatrick four levels of evaluation framework with: 10 studies demonstrating significant increases in participants' knowledge; seven studies reporting significant changes in clinician behaviour; four studies showing significant increases in clinician confidence; and three studies identifying significant and sustained increases in participants' clinical skills. Only two studies reported positive improvements in patient outcomes.

CONCLUSION

Spaced education via an online platform offers a scalable CPD format that can increase clinical knowledge and change practice. However, further adequately powered randomised controlled trials are required to confirm that spaced education CPD can impact positively on patients' reported outcomes.

Online Digital Education for Postregistration Training of Medical Doctors: Systematic Review by the Digital Health Education Collaboration

Background

Globally, online and local area network–based (LAN) digital education (ODE) has grown in popularity. Blended learning is used by ODE along with traditional learning. Studies have shown the increasing potential of these technologies in training medical doctors; however, the evidence for its effectiveness and cost-effectiveness is unclear.

Objective

This systematic review evaluated the effectiveness of online and LAN-based ODE in improving practicing medical doctors’ knowledge, skills, attitude, satisfaction (primary outcomes), practice or behavior change, patient outcomes, and cost-effectiveness (secondary outcomes).

Methods

We searched seven electronic databased for randomized controlled trials, cluster-randomized trials, and quasi-randomized trials from January 1990 to March 2017. Two review authors independently extracted data and assessed the risk of bias. We have presented the findings narratively. We mainly compared ODE with self-directed/face-to-face learning and blended learning with self-directed/face-to-face learning.

Results

A total of 93 studies (N=16,895) were included, of which 76 compared ODE (including blended) and self-directed/face-to-face learning. Overall, the effect of ODE (including blended) on postintervention knowledge, skills, attitude, satisfaction, practice or behavior change, and patient outcomes was inconsistent and ranged mostly from no difference between the groups to higher postintervention score in the intervention group (small to large effect size, very low to low quality evidence). Twenty-one studies reported higher knowledge scores (small to large effect size and very low quality) for the intervention, while 20 studies reported no difference in knowledge between the groups. Seven studies reported higher skill score in the intervention (large effect size and low quality), while 13 studies reported no difference in the skill scores between the groups. One study reported a higher attitude score for the intervention (very low quality), while four studies reported no difference in the attitude score between the groups. Four studies reported higher postintervention physician satisfaction with the intervention (large effect size and low quality), while six studies reported no difference in satisfaction between the groups. Eight studies reported higher postintervention practice or behavior change for the ODE group (small to moderate effect size and low quality), while five studies reported no difference in practice or behavior change between the groups. One study reported higher improvement in patient outcome, while three others reported no difference in patient outcome between the groups. None of the included studies reported any unintended/adverse effects or cost-effectiveness of the interventions.

Conclusions

Empiric evidence showed that ODE and blended learning may be equivalent to self-directed/face-to-face learning for training practicing physicians. Few other studies demonstrated that ODE and blended learning may significantly improve learning outcomes compared to self-directed/face-to-face learning. The quality of the evidence in these studies was found to be very low for knowledge. Further high-quality randomized controlled trials are required to confirm these findings.

A phase III wait-listed randomised controlled trial of novel targeted inter-professional clinical education intervention to improve cancer patients' reported pain outcomes (The Cancer Pain Assessment (CPAS) Trial): study protocol

Background

Variations in care models contribute to cancer pain being under-recognised and under-treated in half of all patients with cancer. International and national cancer pain management guidelines are achievable with minimal investment but require practice changes. While much of the cancer pain research over the preceding decades has focused on management interventions, little attention has been given to achieving better adherence to recommended cancer pain guideline screening and assessment practices. This trial aims to reduce unrelieved cancer pain by improving cancer and palliative doctors’ and nurses’ (‘clinicians’) pain assessment capabilities through a targeted inter-professional clinical education intervention delivered to participants’ mobile devices (‘mHealth’).

Methods

A wait-listed, randomised control trial design. Cancer and/or palliative care physicians and nurses employed at one of the six participating sites across Australia will be eligible to participate in this trial and, on enrolment, will be allocated to the active or wait-listed arm. Participants allocated to the active arm will be invited to complete the mHealth cancer pain assessment intervention. In this trial, mHealth is defined as medical or public health practice supported by mobile devices (i.e. phones, patient monitoring devices, personal digital assistants and other wireless devices). This mHealth intervention integrates three evidence-based elements, namely: the COM-B theoretical framework; spaced learning pedagogy; and audit and feedback. This intervention will be delivered via the QStream online platform to participants’ mobile devices over four weeks. The trial will determine if a tailored mHealth intervention, targeting clinicians’ cancer pain assessment capabilities, is effective in reducing self-reported cancer pain scores, as measured by a Numerical Rating Scale (NRS).

Discussion

If this mHealth intervention is found to be effective, in addition to improving cancer pain assessment practices, it will provide a readily transferable evidence-based framework that could readily be applied to other evidence practice gaps and a scalable intervention that could be administered simultaneously to multiple clinicians across diverse geographical locations. Moreover, if found to be cost-effective, it will help transform clinical continuing professional development. In summary, this mHealth intervention will provide health services with an opportunity to offer an evidence-based, pedagogically robust, cost-effective, scalable training alternative.

Trial registration

Australian New Zealand Clinical Trials Registry (ANZCTR), ACTRN12618001103257. Registered on 3 July 2018.

Electronic supplementary material

The online version of this article (10.1186/s13063-018-3152-z) contains supplementary material, which is available to authorized users.

Effectiveness of an educational intervention to improve the safety culture in primary care: a randomized trial

Background

Fostering a culture of safety is an essential step in ensuring patient safety and quality in primary care. We aimed to evaluate the effectiveness of an educational intervention to improve the safety culture in the family and community medicine teaching units in an Atlantic European Region.

Methods

Randomized study conducted in family and community medicine teaching units in Galicia (Spain). Participants were all fourth-year residents and their tutors (N = 138). Those who agreed to participate were randomized into one of two groups (27 tutors/26 residents in the intervention group, 23 tutors/ 23 residents in the control one).All were sent the Survey on Patient Safety Culture. After that, the intervention group received specific training in safety; they also recorded incidents over 15 days, documented them following a structured approach, and had feedback on their performance. The control group did not receive any action. All participants completed the same survey four months later. Outcome measures were the changes in safety culture as quantified by the results variables of the Survey: Patient Safety Grade and Number of events reported.

We conducted bivariate and adjusted analyses for the outcome measures. To explore the influence of participants’ demographic characteristics and their evaluation of the 12 dimensions of the safety culture, we fitted a multivariate model for each outcome.

Results

Trial followed published protocol. There were 19 drop outs. The groups were comparable in outcome and independent variables at start. The experiment did not have any effect on Patient safety grade (− 0.040) in bivariate analysis. The odds of reporting one to two events increased by 1.14 (0.39–3.35), and by 13.75 (2.41–354.37) the odds of reporting 3 or more events. Different dimensions had significant independent effects on each outcome variable.

Conclusion

A educational intervention in family and community medicine teaching units may improve the incidents reported. The associations observed among organizational dimensions and outcomes evidence the complexity of patient safety culture measurement and, also, show the paths for improvement. In the future, it would be worthwhile to replicate this study in teaching units from different settings and with different health professionals engaged.

Trial registration

It was retrospectively registered with (ISRCTN41911128, 31/12/2010).

Electronic supplementary material

The online version of this article (10.1186/s12875-018-0901-8) contains supplementary material, which is available to authorized users.

Reducing Redundant Anaerobic Therapy Through Spaced Education and Antimicrobial Stewardship Interventions

BACKGROUND

Decreasing the use of redundant anaerobic therapy is a key target for antimicrobial stewardship. Education techniques that optimize knowledge retention could be an important component of reducing these regimens.

METHODS

We implemented a quality improvement project that incorporated spaced education to reduce the use of redundant anaerobic therapy. The initial interventions (November through December 2015) included education in a hospital-wide newsletter and review of redundant anaerobic regimens by the antimicrobial stewardship program. A spaced education module was then developed with the gastroenterology (GI) service, which had a relatively high rate of redundant anaerobic therapy use. Ten questions with teaching points were delivered to GI physicians at spaced intervals over 2 to 4 weeks (February through March 2016). Knowledge scores were compared at initial and final question presentation using generalized estimating equations. Interrupted time-series analysis was used to compare the rates of redundant-metronidazole-days per 1000 patient-days among patients in the patients admitted to the GI service and those in the non-GI group before and after the intervention.

RESULTS

Of 66 GI physicians, 56 (85%) participated in the spaced education activity. After the intervention, their knowledge scores on all the questions improved, and their mean knowledge score increased from 57% to 86% (P < .001). Nearly all (91%) of the participants were very or generally satisfied with the activity. In the GI group, the rate of redundant-metronidazole-days decreased from 26.2 to 13.0 per 1000 patient-days (relative risk [RR], 0.45 [95% confidence interval (CI), 0.27-0.73]; P = .001). This rate in the non-GI group also decreased from 5.47 to 2.18 per 1000 patient-days (RR, 0.47 [95% CI, 0.36-0.60]; P < .001) after our interventions.

CONCLUSIONS

Spaced education is an effective approach for teaching antimicrobial stewardship topics. Focused provider education was associated with a sustained reduction in the use of redundant anaerobic therapy.

Formulation, implementation and evaluation of a distance course for accreditation in patient safety

Objective

To formulate and to implement a virtual learning environment course in patient safety, and to propose ways to estimate the impact of the course in patient safety outcomes.

Methods

The course was part of an accreditation process and involved all employees of a public hospital in Brazil. The whole hospital staff was enrolled in the course. The accreditation team defined the syllabus. The education guidelines were divided into 12 modules related to quality, patient safety and required organizational practices. The assessment was performed at the end of each module through multiple-choice tests. The results were estimated according to occurrence of adverse events. Data were collected after the course, and employees’ attitude was surveyed.

Results

More than 80% of participants reached up to 70% success on tests after the course; the event-reporting rate increased from 714 (16,264 patients) to 1,401 (10,180 patients).

Conclusion

Virtual learning environment was a successful tool data. Data on course evaluation is consistent with increase in identification and reporting of adverse events. Although the report increment is not positive per si, it indicates changes in patient safety culture.

New Approaches to Continuing Medical Education: a QStream (spaced education) Program for Research Translation in Ovarian Cancer

Continuing medical education (CME) is challenging and often has limited impact on clinician behavior or patient outcomes. This study examined the impact of an online Qstream education program on senior clinicians to determine its utility for increasing clinician knowledge about the latest guidelines regarding genetic assessment and consideration of genetic testing for women with particular types of ovarian, fallopian tube and primary peritoneal cancer. Participants were recruited into a pilot study that involved responding to case-based scenarios at spaced and repeated intervals. At the completion of the program, semi-structured interviews were conducted to ascertain the impact on their knowledge and referral behavior. Findings from interviews were subject to thematic analysis that involved the identification of categories and themes. Twenty-one participants commenced the program, seventeen completed and twelve participated in semi-structured interviews. Thematic analysis yielded several themes including knowledge change, curriculum and format and changes in referral patterns. A majority of participants (n = 10) agreed the program had helped update their knowledge about referring women, and eight agreed they would now change their referral patterns. The use of QStream as an approach to CME has significant advantages when working with busy clinicians. QStream has a well accepted format and most participants indicated it is very appropriate for disseminating updates to clinical guidelines and protocols. It is important to supplement CME programs with other implementation techniques, such as audit and feedback as multifaceted approaches are more likely to result in behavior change.

A Team-Based Online Game Improves Blood Glucose Control in Veterans With Type 2 Diabetes: A Randomized Controlled Trial

OBJECTIVE

Rigorous evidence is lacking whether online games can improve patients' longer-term health outcomes. We investigated whether an online team-based game delivering diabetes self-management education (DSME) to patients via e-mail or mobile application (app) can generate longer-term improvements in hemoglobin A_1c (HbA_1c).

RESEARCH DESIGN AND METHODS

Patients (n = 456) on oral diabetes medications with HbA_1c ≥58 mmol/mol were randomly assigned between a DSME game (with a civics booklet) and a civics game (with a DSME booklet). The 6-month games sent two questions twice weekly via e-mail or mobile app. Participants accrued points based on performance, with scores posted on leaderboards. Winning teams and individuals received modest financial rewards. Our primary outcome measure was HbA_1c change over 12 months.

RESULTS

DSME game patients had significantly greater HbA_1c reductions over 12 months than civics game patients (-8 mmol/mol [95% CI -10 to -7] and -5 mmol/mol [95% CI -7 to -3], respectively; P = 0.048). HbA_1c reductions were greater among patients with baseline HbA_1c >75 mmol/mol: -16 mmol/mol [95% CI -21 to -12] and -9 mmol/mol [95% CI -14 to -5] for DSME and civics game patients, respectively; P = 0.031.

CONCLUSIONS

Patients with diabetes who were randomized to an online game delivering DSME demonstrated sustained and meaningful HbA_1c improvements. Among patients with poorly controlled diabetes, the DSME game reduced HbA_1c by a magnitude comparable to starting a new diabetes medication. Online games may be a scalable approach to improve outcomes among geographically dispersed patients with diabetes and other chronic diseases.

How Should Surgical Residents Be Educated About Patient Safety: A Pilot Randomized Controlled Trial

INTRODUCTION

The Accreditation Council for Graduate Medical Education mandates patient safety education without specific curricular guidelines. We hypothesized that a dedicated, adjunctive resident safety workshop (SW) led by surgical faculty compared with an online curriculum (OC) for hospital personnel alone would improve residents' patient safety perceptions and behaviors.

MATERIALS AND METHODS

A pilot randomized controlled trial was performed from 2014 to 2015 within a university-based general surgery residency. Control and intervention groups, stratified by postgraduate year, participated in a hospital-based OC; the intervention group participated in an additional SW. Primary outcomes were perceptions of safety culture, teamwork, and speaking up as per the validated safety attitudes questionnaire (SAQ) at 6 and 12 months postintervention. Secondary outcomes included behavioral scores from blinded surgical faculty using the Oxford NonTechnical Skills scale.

RESULTS

A total of 51 residents were enrolled (control = 25, intervention = 26). SAQ response rates were 100%, 100%, and 76% at baseline, 6 months, and 12 months, respectively. SAQ scores were similar at baseline between groups and did not change significantly at 6 or 12 months, independent of postgraduate year (PGY) level. Overall NonTechnical Skills scores were similar between groups, but senior residents (≥PGY 4) in the OC + SW group scored significantly higher in teamwork, decision-making, and situation awareness (all p < 0.05).

CONCLUSION

An adjunctive, dedicated resident SW compared with a hospital-based OC alone did not significantly improve overall perceptions of patient safety. However, senior residents participating in the SW demonstrated improved patient safety perceptions and had significantly better intraoperative safety behaviors than senior residents in the OC group. Future curricular enhancements should include PGY-level specific education, iterative reviews, and increased faculty involvement. A larger randomized trial may be warranted.

Workplace training for senior trainees: a systematic review and narrative synthesis of current approaches to promote patient safety

BACKGROUND

Preventable harm is one of the top six health problems in the developed world. Developing patient safety skills and knowledge among advanced trainee doctors is critical. Clinical supervision is the main form of training for advanced trainees. The use of supervision to develop patient safety competence has not been established.

OBJECTIVE

To establish the use of clinical supervision and other workplace training to develop non-technical patient safety competency in advanced trainee doctors.

DATA SOURCES

Keywords, synonyms and subject headings were used to search eight electronic databases in addition to hand-searching of relevant journals up to 1 March 2014.

METHOD

Titles and abstracts of retrieved publications were screened by two reviewers and checked by a third. Full-text articles were screened against the eligibility criteria. Data on design, methods and key findings were extracted. Clinical supervision documents were assessed against components common to established patient safety frameworks. Findings from the reviewed articles and document analysis were collated in a narrative synthesis.

RESULTS

Clinical supervision is not identified as an avenue for embedding patient safety skills in the workplace and is consequently not evaluated as a method to teach trainees these skills. Workplace training in non-technical patient safety skills is limited, but one-off training courses are sometimes used.

CONCLUSIONS

Clinical supervision is the primary avenue for learning in postgraduate medical education but the most overlooked in the context of patient safety learning. The widespread implementation of short courses is not matched by evidence of rigorous evaluation. Supporting supervisors to identify teaching moments during supervision and to give weight to non-technical skills and technical skills equally is critical.

The outcomes of recent patient safety education interventions for trainee physicians and medical students: a systematic review

OBJECTIVE

To systematically review the latest evidence for patient safety education for physicians in training and medical students, updating, extending and improving on a previous systematic review on this topic.

DESIGN

A systematic review.

DATA SOURCES

Embase, Ovid Medline and PsycINFO databases.

STUDY SELECTION

Studies including an evaluation of patient safety training interventions delivered to trainees/residents and medical students published between January 2009 and May 2014.

DATA EXTRACTION

The review was performed using a structured data capture tool. Thematic analysis also identified factors influencing successful implementation of interventions.

RESULTS

We identified 26 studies reporting patient safety interventions: 11 involving students and 15 involving trainees/residents. Common educational content included a general overview of patient safety, root cause/systems-based analysis, communication and teamwork skills, and quality improvement principles and methodologies. The majority of courses were well received by learners, and improved patient safety knowledge, skills and attitudes. Moreover, some interventions were shown to result in positive behaviours, notably subsequent engagement in quality improvement projects. No studies demonstrated patient benefit. Availability of expert faculty, competing curricular/service demands and institutional culture were important factors affecting implementation.

CONCLUSIONS

There is an increasing trend for developing educational interventions in patient safety delivered to trainees/residents and medical students. However, significant methodological shortcomings remain and additional evidence of impact on patient outcomes is needed. While there is some evidence of enhanced efforts to promote sustainability of such interventions, further work is needed to encourage their wider adoption and spread.

Using the Knowledge, Process, Practice (KPP) model for driving the design and development of online postgraduate medical education

BACKGROUND

Online learning is a primary delivery method for continuing health education programs. It is critical that programs have curricula objectives linked to educational models that support learning. Using a proven educational modelling process ensures that curricula objectives are met and a solid basis for learning and assessment is achieved.

AIM

To develop an educational design model that produces an educationally sound program development plan for use by anyone involved in online course development.

METHODS

We have described the development of a generic educational model designed for continuing health education programs. The Knowledge, Process, Practice (KPP) model is founded on recognised educational theory and online education practice. This paper presents a step-by-step guide on using this model for program development that encases reliable learning and evaluation.

RESULTS

The model supports a three-step approach, KPP, based on learning outcomes and supporting appropriate assessment activities. It provides a program structure for online or blended learning that is explicit, educationally defensible, and supports multiple assessment points for health professionals.

CONCLUSION

The KPP model is based on best practice educational design using a structure that can be adapted for a variety of online or flexibly delivered postgraduate medical education programs.

Online patient safety education programme for junior doctors: is it worthwhile?

BACKGROUND

Increasing demand exists for blended approaches to the development of professionalism. Trainees of the Royal College of Physicians of Ireland participated in an online patient safety programme.

AIMS

Study aims were: (1) to determine whether the programme improved junior doctors' knowledge, attitudes and skills relating to error reporting, open communication and care for the second victim and (2) to establish whether the methodology facilitated participants' learning.

METHODS

208 junior doctors who completed the programme completed a pre-online questionnaire. Measures were "patient safety knowledge and attitudes", "medical safety climate" and "experience of learning". Sixty-two completed the post-questionnaire, representing a 30 % matched response rate.

RESULTS

Participating in the programme resulted in immediate (p < 0.01) improvement in skills such as knowing when and how to complete incident forms and disclosing errors to patients, in self-rated knowledge (p < 0.01) and attitudes towards error reporting (p < 0.01). Sixty-three per cent disagreed that doctors routinely report medical errors and 42 % disagreed that doctors routinely share information about medical errors and what caused them. Participants rated interactive features as the most positive elements of the programme.

CONCLUSIONS

An online training programme on medical error improved self-rated knowledge, attitudes and skills in junior doctors and was deemed an effective learning tool. Perceptions of work issues such as a poor culture of error reporting among doctors may prevent improved attitudes being realised in practice. Online patient safety education has a role in practice-based initiatives aimed at developing professionalism and improving safety.

Impact of a novel online learning module on specialist palliative care nurses' pain assessment competencies and patients' reports of pain: Results from a quasi-experimental pilot study

BACKGROUND

Pain is a complex multidimensional phenomenon moderated by consumer, provider and health system factors. Effective pain management cuts across professional boundaries, with failure to screen and assess contributing to the burden of unrelieved pain.

AIM

To test the impact of an online pain assessment learning module on specialist palliative care nurses' pain assessment competencies, and to determine whether this education impacted positively on palliative care patients' reported pain ratings.

DESIGN

A quasi-experimental pain assessment education pilot study utilising 'Qstream^©', an online methodology to deliver 11 case-based pain assessment learning scenarios, developed by an interdisciplinary expert panel and delivered to participants' work emails over a 28-day period in mid-2012. The 'Self-Perceived Pain Assessment Competencies' survey and chart audit data, including patient-reported pain intensity ratings, were collected pre-intervention (T1) and post-intervention (T2) and analysed using inferential statistics to determine key outcomes.

SETTING/PARTICIPANTS

Nurses working at two Australian inpatient specialist palliative care services in 2012.

RESULTS

The results reported conform to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Guidelines. Participants who completed the education intervention ( n = 34) increased their pain assessment knowledge, assessment tool knowledge and confidence to undertake a pain assessment ( p < 0.001). Participants were more likely to document pain intensity scores in patients' medical records than non-participants (95% confidence interval = 7.3%-22.7%, p = 0.021). There was also a significant reduction in the mean patient-reported pain ratings between the admission and audit date at post-test of 1.5 (95% confidence interval = 0.7-2.3) units in pain score.

CONCLUSION

This pilot confers confidence of the education interventions capacity to improve specialist palliative care nurses' pain assessment practices and to reduce patient-rated pain intensity scores.