Emergency medicine residents' beliefs about contributing to a Google Docs presentation: a survey protocol

Intention to Use Wiki-Based Knowledge Tools: Survey of Quebec Emergency Health Professionals

BACKGROUND

Clinical decision support systems are information technologies that assist clinicians in making better decisions. Their adoption has been limited because their content is difficult to adapt to local contexts and slow to adapt to emerging evidence. Collaborative writing applications such as wikis have the potential to increase access to existing and emerging evidence-based knowledge at the point of care, standardize emergency clinical decision making, and quickly adapt this knowledge to local contexts. However, little is known about the factors influencing health professionals' use of wiki-based knowledge tools.

OBJECTIVE

This study aims to measure emergency physicians' (EPs) and other acute care health professionals' (ACHPs) intentions to use wiki-based knowledge tools in trauma care and identify determinants of this intention that can be used in future theory-based interventions for promoting the use of wiki-based knowledge tools in trauma care.

METHODS

In total, 266 EPs and 907 ACHPs (nurses, respiratory therapists, and pharmacists) from 12 Quebec trauma centers were asked to answer a survey based on the theory of planned behavior (TPB). The TPB constructs were measured using a 7-point Likert scale. Descriptive statistics and Pearson correlations between the TPB constructs and intention were calculated. Multiple linear regression analysis was conducted to identify the salient beliefs.

RESULTS

Among the eligible participants, 57.1% (152/266) of EPs and 31.9% (290/907) of ACHPs completed the questionnaire. For EPs, we found that attitude, perceived behavioral control (PBC), and subjective norm (SN) were significant determinants of the intention to use wiki-based knowledge tools and explained 62% of its variance. None of the sociodemographic variables were related to EPs' intentions to use wiki-based knowledge tools. The regression model identified two normative beliefs ("approval by physicians" and "approval by patients") and two behavioral beliefs ("refreshes my memory" and "reduces errors"). For ACHPs, attitude, PBC, SN, and two sociodemographic variables (profession and the previous personal use of a wiki) were significantly related to the intention to use wiki-based knowledge tools and explained 60% of the variance in behavioral intention. The final regression model for ACHPs included two normative beliefs ("approval by the hospital trauma team" and "people less comfortable with information technology"), one control belief ("time constraints"), and one behavioral belief ("access to evidence").

CONCLUSIONS

The intentions of EPs and ACHPs to use wiki-based knowledge tools to promote best practices in trauma care can be predicted in part by attitude, SN, and PBC. We also identified salient beliefs that future theory-based interventions should promote for the use of wiki-based knowledge tools in trauma care. These interventions will address the barriers to using wiki-based knowledge tools, find ways to ensure the quality of their content, foster contributions, and support the exploration of wiki-based knowledge tools as potential effective knowledge translation tools in trauma care.

Information behaviour of the millennial generation: a scoping review of medical residents and their use of social media

BACKGROUND

Medical residents can offer ideas for new information services, as most of them are 'digital natives', although reviews of the use of social media in health care settings do not provide data on their information behaviour.

OBJECTIVE

A scoping review aimed at providing a research map for the information behaviour of medical residents and their use of social media, listing the aspects of the information behaviour studied and the theories and methods used.

METHODS

A search was carried out in pubmed, embase, cinahl and lisa in April of 2018, with the results limited to the period from 2010 onwards.

RESULTS

Thirty-nine relevant articles from 38 different studies were identified. The presence and use of social media was the most researched aspect, followed by information sharing, the relationships established and, finally, the search for and use of information. These aspects are researched mainly from the point of view of doctor-patient interactions. Only one study incorporated a theory of its design. Surveys were the most frequently used method.

CONCLUSION

Research does not delve into medical residents' information behaviour on social media, despite the residents themselves using these media (in the context of everyday life, at least). More research is required.

Ascertaining top evidence in emergency medicine: A modified Delphi study

OBJECTIVES

The application of evidence-informed practice in emergency medicine (EM) is critical to improve the quality of patient care. EM is a specialty with a broad knowledge base making it daunting for a junior resident to know where to begin the acquisition of evidence-based knowledge. Our study's objective was to formulate a list of "top papers" in the field of EM using a Delphi approach to achieve an expert consensus.

METHODS

Participants were recruited from all 14 specialty EM programs across Canada by a nomination process by the program directors. The modified Delphi survey consisted of three study rounds, each round sent out via email. The study tool was piloted first with McMaster University's specialty EM residents. During the first round, participants individually listed top papers relevant to EM. During the two subsequent rounds, participants ranked the papers listed in the first round, with a chance to adjust ranking based on group responses.

RESULTS

A total of eight EM specialty programs responded with 30 responses across the three rounds. There were 119 studies suggested in the first round, and, by the third round, a consensus of>70% agreement was reached to generate the final list of 29 studies.

CONCLUSIONS

We produced, via an expert consensus, a list of top studies relevant for Canadian EM physicians in training. It can be used as an educational resource for junior residents as they transition into practice.

Collaborative writing applications in healthcare: effects on professional practice and healthcare outcomes

BACKGROUND

Collaborative writing applications (CWAs), such as wikis and Google Documents, hold the potential to improve the use of evidence in both public health and healthcare. Although a growing body of literature indicates that CWAs could have positive effects on healthcare, such as improved collaboration, behavioural change, learning, knowledge management, and adaptation of knowledge to local context, this has never been assessed systematically. Moreover, several questions regarding safety, reliability, and legal aspects exist.

OBJECTIVES

The objectives of this review were to (1) assess the effects of the use of CWAs on process (including the behaviour of healthcare professionals) and patient outcomes, (2) critically appraise and summarise current evidence on the use of resources, costs, and cost-effectiveness associated with CWAs to improve professional practices and patient outcomes, and (3) explore the effects of different CWA features (e.g. open versus closed) and different implementation factors (e.g. the presence of a moderator) on process and patient outcomes.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, and 11 other electronic databases. We searched the grey literature, two trial registries, CWA websites, individual journals, and conference proceedings. We also contacted authors and experts in the field. We did not apply date or language limits. We searched for published literature to August 2016, and grey literature to September 2015.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised controlled trials (NRCTs), controlled before-and-after (CBA) studies, interrupted time series (ITS) studies, and repeated measures studies (RMS), in which CWAs were used as an intervention to improve the process of care, patient outcomes, or healthcare costs.

DATA COLLECTION AND ANALYSIS

Teams of two review authors independently assessed the eligibility of studies. Disagreements were resolved by discussion, and when consensus was not reached, a third review author was consulted.

MAIN RESULTS

We screened 11,993 studies identified from the electronic database searches and 346 studies from grey literature sources. We analysed the full text of 99 studies. None of the studies met the eligibility criteria; two potentially relevant studies are ongoing.

AUTHORS' CONCLUSIONS

While there is a high number of published studies about CWAs, indicating that this is an active field of research, additional studies using rigorous experimental designs are needed to assess their impact and cost-effectiveness on process and patient outcomes.

Impact of Implementing a Wiki to Develop Structured Electronic Order Sets on Physicians' Intention to Use Wiki-Based Order Sets

BACKGROUND

Wikis have the potential to promote best practices in health systems by sharing order sets with a broad community of stakeholders. However, little is known about the impact of using a wiki on clinicians' intention to use wiki-based order sets.

OBJECTIVE

The aims of this study were: (1) to describe the use of a wiki to create structured order sets for a single emergency department; (2) to evaluate whether the use of this wiki changed emergency physicians' future intention to use wiki-based order sets; and (3) to understand the impact of using the wiki on the behavioral determinants for using wiki-based order sets.

METHODS

This was a pre/post-intervention mixed-methods study conducted in one hospital in Lévis, Quebec. The intervention was comprised of receiving access to and being motivated by the department head to use a wiki for 6 months to create electronic order sets designed to be used in a computer physician order entry system. Before and after our intervention, we asked participants to complete a previously validated questionnaire based on the Theory of Planned Behavior. Our primary outcome was the intention to use wiki-based order sets in clinical practice. We also assessed participants' attitude, perceived behavioral control, and subjective norm to use wiki-based order sets. Paired pre- and post-Likert scores were compared using Wilcoxon signed-rank tests. The post-questionnaire also included open-ended questions concerning participants' comments about the wiki, which were then classified into themes using an existing taxonomy.

RESULTS

Twenty-eight emergency physicians were enrolled in the study (response rate: 100%). Physicians' mean intention to use a wiki-based reminder was 5.42 (SD 1.04) before the intervention, and increased to 5.81 (SD 1.25) on a 7-point Likert scale (P =.03) after the intervention. Participants' attitude towards using a wiki-based order set also increased from 5.07 (SD 0.90) to 5.57 (SD 0.88) (P =.003). Perceived behavioral control and subjective norm did not change. Easier information sharing was the most frequently positive impact raised. In order of frequency, the three most important facilitators reported were: ease of use, support from colleagues, and promotion by the departmental head. Although participants did not mention any perceived negative impacts, they raised the following barriers in order of frequency: poor organization of information, slow computers, and difficult wiki access.

CONCLUSIONS

Emergency physicians' intention and attitude to use wiki-based order sets increased after having access to and being motivated to use a wiki for 6 months. Future studies need to explore if this increased intention will translate into sustained actual use and improve patient care. Certain barriers need to be addressed before implementing a wiki for use on a larger scale.

Implementation and Evaluation of a Wiki Involving Multiple Stakeholders Including Patients in the Promotion of Best Practices in Trauma Care: The WikiTrauma Interrupted Time Series Protocol

Background

Trauma is the most common cause of mortality among people between the ages of 1 and 45 years, costing Canadians 19.8 billion dollars a year (2004 data), yet half of all patients with major traumatic injuries do not receive evidence-based care, and significant regional variation in the quality of care across Canada exists. Accordingly, our goal is to lead a research project in which stakeholders themselves will adapt evidence-based trauma care knowledge tools to their own varied institutional contexts and cultures. We will do this by developing and assessing the combined impact of WikiTrauma, a free collaborative database of clinical decision support tools, and Wiki101, a training course teaching participants how to use WikiTrauma. WikiTrauma has the potential to ensure that all stakeholders (eg, patients, clinicians, and decision makers) can all contribute to, and benefit from, evidence-based clinical knowledge about trauma care that is tailored to their own needs and clinical setting.

Objective

Our main objective will be to study the combined effect of WikiTrauma and Wiki101 on the quality of care in four trauma centers in Quebec.

Methods

First, we will pilot-test the wiki with potential users to create a version ready to test in practice. A rapid, iterative prototyping process with 15 health professionals from nonparticipating centers will allow us to identify and resolve usability issues prior to finalizing the definitive version for the interrupted time series. Second, we will conduct an interrupted time series to measure the impact of our combined intervention on the quality of care in four trauma centers that will be selected—one level I, one level II, and two level III centers. Participants will be health care professionals working in the selected trauma centers. Also, five patient representatives will be recruited to participate in the creation of knowledge tools destined for their use (eg, handouts). All participants will be invited to complete the Wiki101 training and then use, and contribute to, WikiTrauma for 12 months. The primary outcome will be the change over time of a validated, composite, performance indicator score based on 15 process performance indicators found in the Quebec Trauma Registry.

Results

This project was funded in November 2014 by the Canadian Medical Protective Association. We expect to start this trial in early 2015 and preliminary results should be available in June 2016. Two trauma centers have already agreed to participate and two more will be recruited in the next months.

Conclusions

We expect that this study will add important and unique evidence about the effectiveness, safety, and cost savings of using collaborative platforms to adapt knowledge implementation tools across jurisdictions.

Development and validation of questionnaires exploring health care professionals' intention to use wiki-based reminders to promote best practices in trauma

BACKGROUND

Little is known about factors influencing professionals' use of wikis.

OBJECTIVE

We developed and validated two questionnaires to assess health care professionals' intention to use wiki-based reminders for the management of trauma patients.

METHODS

We developed questionnaires for emergency physicians (EPs) and allied health professions (AHPs) based on the Theory of Planned Behavior and adapted them to the salient beliefs of each, identified in an earlier study. Items measured demographics and direct and indirect theoretical constructs. We piloted the questionnaires with 2 focus groups (5 EPs and 5 AHPs) to identify problems of wording and length. Based on feedback, we adjusted the wording and combined certain items. A new convenience sample of 25 EPs and 26 AHPs then performed a test-retest of the questionnaires at a 2-week interval. We assessed internal consistency using Cronbach alpha coefficients and temporal stability of items with an agreement intraclass correlation coefficient (ICC).

RESULTS

Five EPs and 5 AHPs (3 nurses, 1 respiratory therapist, and 1 pharmacist) formed 2 focus groups; 25 EPs and 26 AHPs (12 nurses, 7 respiratory therapists, and 7 pharmacists) completed the test and retest. The EP questionnaire test-retest scores for consistency (Cronbach alpha) and stability (ICC) were intention (test: Cronbach alpha=.94; retest: Cronbach alpha=.98; ICC=.89), attitude (.74, .72, .70), subjective norm (.79, .78, .75), perceived behavioral control (.67, .65, .66), attitudinal beliefs (.94, .86, .60), normative beliefs (.83, .87, .79), and control beliefs barriers (.58, .67, .78) and facilitators (.97, .85, .30). The AHP questionnaire scores for consistency and stability were: intention (test Cronbach alpha=.69, retest Cronbach alpha=.81, ICC=.48), attitude (.85, .87, .83), subjective norm (.47, .82, .62), perceived behavioral control (.55, .62, .60), attitudinal beliefs (.92, .91, .82), normative beliefs (.85, .90, .74), and control beliefs barriers (.58, .55, .66) and facilitators (.72, .94, -.05). To improve the psychometric properties of both questionnaires, we reformulated poorly consistent or unstable items.

CONCLUSIONS

Our new theory-based questionnaires to measure health care professionals' intention to use wiki-based reminders have adequate validity and reliability for use in large surveys. In the long run, they can be used to develop a theory-based implementation intervention for a wiki promoting best practices in trauma care.

Wikis and collaborative writing applications in health care: a scoping review

Background

Collaborative writing applications (eg, wikis and Google Documents) hold the potential to improve the use of evidence in both public health and health care. The rapid rise in their use has created the need for a systematic synthesis of the evidence of their impact as knowledge translation (KT) tools in the health care sector and for an inventory of the factors that affect their use.

Objective

Through the Levac six-stage methodology, a scoping review was undertaken to explore the depth and breadth of evidence about the effective, safe, and ethical use of wikis and collaborative writing applications (CWAs) in health care.

Methods

Multiple strategies were used to locate studies. Seven scientific databases and 6 grey literature sources were queried for articles on wikis and CWAs published between 2001 and September 16, 2011. In total, 4436 citations and 1921 grey literature items were screened. Two reviewers independently reviewed citations, selected eligible studies, and extracted data using a standardized form. We included any paper presenting qualitative or quantitative empirical evidence concerning health care and CWAs. We defined a CWA as any technology that enables the joint and simultaneous editing of a webpage or an online document by many end users. We performed qualitative content analysis to identify the factors that affect the use of CWAs using the Gagnon framework and their effects on health care using the Donabedian framework.

Results

Of the 111 studies included, 4 were experimental, 5 quasi-experimental, 5 observational, 52 case studies, 23 surveys about wiki use, and 22 descriptive studies about the quality of information in wikis. We classified them by theme: patterns of use of CWAs (n=26), quality of information in existing CWAs (n=25), and CWAs as KT tools (n=73). A high prevalence of CWA use (ie, more than 50%) is reported in 58% (7/12) of surveys conducted with health care professionals and students. However, we found only one longitudinal study showing that CWA use is increasing in health care. Moreover, contribution rates remain low and the quality of information contained in different CWAs needs improvement. We identified 48 barriers and 91 facilitators in 4 major themes (factors related to the CWA, users’ knowledge and attitude towards CWAs, human environment, and organizational environment). We also found 57 positive and 23 negative effects that we classified into processes and outcomes.

Conclusions

Although we found some experimental and quasi-experimental studies of the effectiveness and safety of CWAs as educational and KT interventions, the vast majority of included studies were observational case studies about CWAs being used by health professionals and patients. More primary research is needed to find ways to address the different barriers to their use and to make these applications more useful for different stakeholders.