A usability study to improve a clinical decision support system for the prescription of antibiotic drugs

Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit

OBJECTIVE

 Our objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals.

METHODS

 We conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized.

RESULTS

 Fifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80-95), with over 96% rating the tool's usability as "good" or "excellent." Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows.

CONCLUSION

 The PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.

Physicians' Perspectives on AI in Clinical Decision Support Systems: Interview Study of the CURATE.AI Personalized Dose Optimization Platform

BACKGROUND

Physicians play a key role in integrating new clinical technology into care practices through user feedback and growth propositions to developers of the technology. As physicians are stakeholders involved through the technology iteration process, understanding their roles as users can provide nuanced insights into the workings of these technologies that are being explored. Therefore, understanding physicians' perceptions can be critical toward clinical validation, implementation, and downstream adoption. Given the increasing prevalence of clinical decision support systems (CDSSs), there remains a need to gain an in-depth understanding of physicians' perceptions and expectations toward their downstream implementation. This paper explores physicians' perceptions of integrating CURATE.AI, a novel artificial intelligence (AI)-based and clinical stage personalized dosing CDSSs, into clinical practice.

OBJECTIVE

This study aims to understand physicians' perspectives of integrating CURATE.AI for clinical work and to gather insights on considerations of the implementation of AI-based CDSS tools.

METHODS

A total of 12 participants completed semistructured interviews examining their knowledge, experience, attitudes, risks, and future course of the personalized combination therapy dosing platform, CURATE.AI. Interviews were audio recorded, transcribed verbatim, and coded manually. The data were thematically analyzed.

RESULTS

Overall, 3 broad themes and 9 subthemes were identified through thematic analysis. The themes covered considerations that physicians perceived as significant across various stages of new technology development, including trial, clinical implementation, and mass adoption.

CONCLUSIONS

The study laid out the various ways physicians interpreted an AI-based personalized dosing CDSS, CURATE.AI, for their clinical practice. The research pointed out that physicians' expectations during the different stages of technology exploration can be nuanced and layered with expectations of implementation that are relevant for technology developers and researchers.

A case-based reasoning system for neonatal survival and LOS prediction in neonatal intensive care units: a development and validation study

Early prediction of neonates' survival and Length of Stay (LOS) in Neonatal Intensive Care Units (NICU) is effective in decision-making. We developed an intelligent system to predict neonatal survival and LOS using the "Case-Based Reasoning" (CBR) method. We developed a web-based CBR system based on K-Nearest Neighborhood (KNN) on 1682 neonates and 17 variables for mortality and 13 variables for LOS and evaluated the system with 336 retrospectively collected data. We implemented the system in a NICU to externally validate the system and evaluate the system prediction acceptability and usability. Our internal validation on the balanced case base showed high accuracy (97.02%), and F-score (0.984) for survival prediction. The root Mean Square Error (RMSE) for LOS was 4.78 days. External validation on the balanced case base indicated high accuracy (98.91%), and F-score (0.993) to predict survival. RMSE for LOS was 3.27 days. Usability evaluation showed that more than half of the issues identified were related to appearance and rated as a low priority to be fixed. Acceptability assessment showed a high acceptance and confidence in responses. The usability score (80.71) indicated high system usability for neonatologists. This system is available at http://neonatalcdss.ir/ . Positive results of our system in terms of performance, acceptability, and usability indicated this system can be used to improve neonatal care.

Human factors and safety analysis methods used in the design and redesign of electronic medication management systems: A systematic review

INTRODUCTION

Poorly designed electronic medication management systems (EMMS) or computerized physician order entry (CPOE) systems in hospital settings can result in usability issues and in turn, patient safety risks. As a safety science, human factors and safety analysis methods have potential to support the safe and usable design of EMMS.

OBJECTIVE

To identify and describe human factors and safety analysis methods that have been used in the design or redesign of EMMS used in hospital settings.

MATERIALS AND METHODS

A systematic review, following PRISMA guidelines, was conducted by searching online databases and relevant journals from January 2011 to May 2022. Studies were included if they described the practical application of human factors and safety analysis methods to support the design or redesign of a clinician-facing EMMS, or its components. Methods used were extracted and mapped to human centered design (HCD) activities: understanding context of use; specifying user requirements; producing design solutions; and evaluating the design.

RESULTS

Twenty-one papers met the inclusion criteria. Overall, 21 human factors and safety analysis methods were used in the design or redesign of EMMS with prototyping, usability testing, participant surveys/questionnaires and interviews the most frequent. Human factors and safety analysis methods were most frequently used to evaluate the design of a system (n = 67; 56.3%). Nineteen of 21 (90%) methods used aimed to identify usability issues and/or support iterative design; only one paper utilized a safety-oriented method and one, a mental workload assessment method.

DISCUSSION AND CONCLUSION

While the review identified 21 methods, EMMS design primarily utilized a subset of available methods, and rarely a method focused on safety. Given the high-risk nature of medication management in complex hospital environments, and the potential for harm due to poorly designed EMMS, there is significant potential to apply more safety-oriented human factors and safety analysis methods to support EMMS design.

Factors influencing the implementation of decision support systems for antibiotic prescription in hospitals: a systematic review

BACKGROUND

Antibiotic resistance is a major health threat. Inappropriate antibiotic use has been shown to be an important determinant of the emergence of antibiotic resistance. Decision support systems for antimicrobial management can support clinicians to optimize antibiotic prescription.

OBJECTIVE

The aim of this systematic review is to identify factors influencing the implementation of decision support systems for antibiotic prescription in hospitals.

METHODS

A systematic search of factors impeding or facilitating successful implementation of decision support systems for antibiotic prescription was performed in January 2022 in the databases PubMed, Web of Science and The Cochrane Library. Only studies were included which comprised decision support systems in hospitals for prescribing antibiotic therapy, published in English with a qualitative, quantitative or mixed-methods study design and between 2011 and 2021. Factors influencing the implementation were identified through text analysis by two reviewers.

RESULTS

A total of 14 publications were identified matching the inclusion criteria. The majority of factors relate to technological and organizational aspects of decision support system implementation. Some factors include the integration of the decision support systems into existing systems, system design, consideration of potential end-users as well as training and support for end-users. In addition, user-related factors, like user attitude towards the system, computer literacy and prior experience with the system seem to be important for successful implementation of decision support systems for antibiotic prescription in hospitals.

CONCLUSION

The results indicate a broad spectrum of factors of decision support system implementation for antibiotic prescription and contributes to the literature by identifying important organizational as well as user-related factors. Wider organizational dimensions as well as the interaction between user and technology appear important for supporting implementation.

User-centred design of a clinical decision support system for palliative care: Insights from healthcare professionals

Objective

Although clinical decision support systems (CDSS) have many benefits for clinical practice, they also have several barriers to their acceptance by professionals. Our objective in this study was to design and validate The Aleph palliative care (PC) CDSS through a user-centred method, considering the predictions of the artificial intelligence (AI) core, usability and user experience (UX).

Methods

We performed two rounds of individual evaluation sessions with potential users. Each session included a model evaluation, a task test and a usability and UX assessment.

Results

The machine learning (ML) predictive models outperformed the participants in the three predictive tasks. System Usability Scale (SUS) reported 62.7  ±  14.1 and 65  ±  26.2 on a 100-point rating scale for both rounds, respectively, while User Experience Questionnaire - Short Version (UEQ-S) scores were 1.42 and 1.5 on the -3 to 3 scale.

Conclusions

The think-aloud method and including the UX dimension helped us to identify most of the workflow implementation issues. The system has good UX hedonic qualities; participants were interested in the tool and responded positively to it. Performance regarding usability was modest but acceptable.

Usability of the IDDEAS prototype in child and adolescent mental health services: A qualitative study for clinical decision support system development

INTRODUCTION

Child and adolescent mental health services (CAMHS) clinical decision support system (CDSS) provides clinicians with real-time support as they assess and treat patients. CDSS can integrate diverse clinical data for identifying child and adolescent mental health needs earlier and more comprehensively. Individualized Digital Decision Assist System (IDDEAS) has the potential to improve quality of care with enhanced efficiency and effectiveness.

METHODS

We examined IDDEAS usability and functionality in a prototype for attention deficit hyperactivity disorder (ADHD), using a user-centered design process and qualitative methods with child and adolescent psychiatrists and clinical psychologists. Participants were recruited from Norwegian CAMHS and were randomly assigned patient case vignettes for clinical evaluation, with and without IDDEAS. Semi-structured interviews were conducted as one part of testing the usability of the prototype following a five-question interview guide. All interviews were recorded, transcribed, and analyzed following qualitative content analysis.

RESULTS

Participants were the first 20 individuals from the larger IDDEAS prototype usability study. Seven participants explicitly stated a need for integration with the patient electronic health record system. Three participants commended the step-by-step guidance as potentially helpful for novice clinicians. One participant did not like the aesthetics of the IDDEAS at this stage. All participants were pleased about the display of the patient information along with guidelines and suggested that wider guideline coverage will make IDDEAS much more useful. Overall, participants emphasized the importance of maintaining the clinician as the decision-maker in the clinical process, and the overall potential utility of IDDEAS within Norwegian CAMHS.

CONCLUSION

Child and adolescent mental health services psychiatrists and psychologists expressed strong support for the IDDEAS clinical decision support system if better integrated in daily workflow. Further usability assessments and identification of additional IDDEAS requirements are necessary. A fully functioning, integrated version of IDDEAS has the potential to be an important support for clinicians in the early identification of risks for youth mental disorders and contribute to improved assessment and treatment of children and adolescents.

Towards effective clinical decision support systems: A systematic review

Background

Clinical Decision Support Systems (CDSS) are used to assist the decision-making process in the healthcare field. Developing an effective CDSS is an arduous task that can take advantage from prior assessment of the most promising theories, techniques and methods used at the present time.

Objective

To identify the features of Clinical Decision Support Systems and provide an analysis of their effectiveness. Thus, two research questions were formulated: RQ1—What are the most common trend characteristics in a CDSS? RQ2—What is the maturity level of the CDSS based on the decision-making theory proposed by Simon?

Methods

AIS e-library, Decision Support Systems journal, Nature, PlosOne and PubMed were selected as information sources to conduct this systematic literature review. Studies from 2000 to 2020 were chosen covering search terms in CDSS, selected according to defined eligibility criteria. The data were extracted and managed in a worksheet, based on the defined criteria. PRISMA statements were used to report the systematic review.

Results

The outcomes showed that rule-based module was the most used approach regarding knowledge management and representation. The most common technological feature adopted by the CDSS were the recommendations and suggestions. 19,23% of studies adopt the type of system as a web-based application, and 51,92% are standalone CDSS. Temporal evolution was also possible to visualize. This study contributed to the development of a Maturity Staging Model, where it was possible to verify that most CDSS do not exceed level 2 of maturity.

Conclusion

The trend characteristics addressed in the revised CDSS were identified, compared to the four predefined groups. A maturity stage model was developed based on Simon’s decision-making theory, allowing to assess the level of maturity of the most common features of the CDSS. With the application of the model, it was noticed that the phases of choice and implementation are underrepresented. This constitutes the main gap in the development of an effective CDSS.

The development and implementation of a guideline-based clinical decision support system to improve empirical antibiotic prescribing

Background

To describe and evaluate a clinical decision support system (CDSS) for empirical antibiotic therapy using a systematic framework.

Methods

A reporting framework for behavior change intervention implementation was used, which includes several domains: development, evaluation and implementation. Within the development domain a description is given of the engagement of stakeholders, a rationale for how the CDSS may influence antibiotic prescribing and a detailed outline of how the system was developed. Within the evaluation domain a technical validation is performed and the interaction between potential users and the CDSS is analyzed. Within the domain of implementation a description is given on how the CDSS was tested in the real world and the strategies that were used for implementation and adoption of the CDSS.

Results

Development: a CDSS was developed, with the involvement of stakeholders, to assist empirical antibiotic prescribing by physicians. Evaluation: Technical problems were determined during the validation process and corrected in a new CDSS version. A usability study was performed to assess problems in the system-user interaction. Implementation: In 114 patients the antibiotic advice that was generated by the CDSS was followed. For 54 patients the recommendations were not adhered to.

Conclusions

This study describes the development and validation of a CDSS for empirical antibiotic therapy and shows the usefulness of the systematic framework for reporting CDSS interventions. In addition it shows that CDSS recommendations are not always adhered to which is associated with incorrect use of the system.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01860-3.

In search of lost time: A timing evaluation of antimicrobial prescribing with and without a computerized decision support system using clinical vignettes

BACKGROUND

We implemented a computerized decision support system (CDSS) integrated in the in-house computerized physician order entry (CPOE) system to assist physicians with antimicrobial prescribing decisions in the context of the multicenter cluster-randomized COMPASS trial (NCT03120975). Some physicians in the intervention wards complained about the perceived extra-time associated with the use of the CDSS compared with routine prescribing through CPOE. The aim of this study was to compare the time needed to prescribe antimicrobials with and without the CDSS.

METHODS

Physicians with and without previous experience with the COMPASS CDSS working at our hospital in Geneva, Switzerland, were recruited to prescribe antimicrobials using clinical vignettes. Physicians without experience received a brief explanation of the CDSS. Each physician received 2 groups of 5-7 clinical vignettes randomly selected from a pool of 28. Each group of vignettes included prescriptions with different levels of complexity (empiric versus targeted or pre-defined treatment, dose adjustment for renal function, oral switch, treatments for which COMPASS does not provide recommendations or where a deviation was necessary). Prescriptions were completed using the standard CPOE (first set), then using COMPASS (second set). A print version of the local antimicrobial guidelines was available for consultation. Time to complete each prescription was recorded (including time needed to consult paper guidelines). The Mann-Whitney test was used for comparisons. Consultation of guidelines booklet and concordance with local guidelines were assessed.

RESULTS

Twenty-five physicians were recruited. Thirteen (52%) had previously used COMPASS. Among them, 11 (85%) estimated the extra-time being above 1 min. We evaluated a total of 296 vignettes. Overall, the median time to complete a prescription was 55.5 s (IQR 38-86) using COMPASS and 50 s (IQR 31-88) using the standard CPOE (p = 0.24). Concordance of prescriptions with local guidelines was similar with the 2 systems (127/148, 85.8% for both), but consultation of paper guidelines was more frequent when prescribing without the CDSS (49.3% (73/148) vs 22.3% (33/148)).

CONCLUSIONS

The increased time required for prescribing using COMPASS is overestimated by end-users. Information collected in the study will be used to streamline the prescribing process via COMPASS and increase acceptance.

The impact of monitoring software on antimicrobial management in a pediatric intensive care unit

INTRODUCTION

Antimicrobial stewardship programs are necessary practices to combat resistance in hospital infections. However, studies frequently cite the scarcity of technological resources as an obstacle to the comprehensive development of ASPs.

OBJECTIVES

The aim of the study was to assess the impact of monitoring software on reducing antibiotic consumption and reducing resistance in a pediatric intensive care unit.

METHODS

We conducted an analytical longitudinal study during the period January 1, 2007, to December 31, 2018, in the pediatric intensive care unit of a high-complexity tertiary general hospital in Brazil.

RESULTS

In the period after the implementation of software, we observed decreases in total antimicrobial consumption (P = .037). Regarding Enterobacterales, we observed a decrease in the proportion of antimicrobial resistance of first and second-generation cephalosporin classes (P = .041) and third and fourth-generation cephalosporins (P = .028). There was a decrease in the proportion of resistance of nonfermenting gram-negative bacilli to aminoglycoside scans (P = .016). We also observed evidence of a decrease in the proportion of resistance of Staphylococcus aureus agents to oxacillin (P < .001).

CONCLUSIONS

The monitoring software reduced the total consumption of antimicrobials and decreased the proportion of resistance, therefore demonstrating its importance in controlling the development of multidrug-resistant bacteria.

A Mobile Health Salt Reduction Intervention for People With Hypertension: Results of a Feasibility Randomized Controlled Trial

BACKGROUND

A high-salt diet is a risk factor for hypertension and cardiovascular disease; therefore, reducing dietary salt intake is a key part of prevention strategies. There are few effective salt reduction interventions suitable for delivery in the primary care setting, where the majority of the management and diagnosis of hypertension occurs.

OBJECTIVE

The aim of this study is to assess the feasibility of a complex behavioral intervention to lower salt intake in people with elevated blood pressure and test the trial procedures for a randomized controlled trial to investigate the intervention's effectiveness.

METHODS

This feasibility study was an unblinded, randomized controlled trial of a mobile health intervention for salt reduction versus an advice leaflet (control). The intervention was developed using the Behavior Change Wheel and comprised individualized, brief advice from a health care professional with the use of the SaltSwap app. Participants with an elevated blood pressure recorded in the clinic were recruited through primary care practices in the United Kingdom. Primary outcomes assessed the feasibility of progression to a larger trial, including follow-up attendance, fidelity of intervention delivery, and app use. Secondary outcomes were objectively assessed using changes in salt intake (measured via 24-hour urine collection), salt content of purchased foods, and blood pressure. Qualitative outcomes were assessed using the think-aloud method, and the process outcomes were evaluated.

RESULTS

A total of 47 participants were randomized. All progression criteria were met: follow-up attendance (45/47, 96%), intervention fidelity (25/31, 81%), and app use (27/31, 87%). There was no evidence that the intervention significantly reduced the salt content of purchased foods, salt intake, or blood pressure; however, this feasibility study was not powered to detect changes in secondary outcomes. Process and qualitative outcomes demonstrated that the trial design was feasible and the intervention was acceptable to both individuals and practitioners and positively influenced salt intake behaviors.

CONCLUSIONS

The intervention was acceptable and feasible to deliver within primary care; the trial procedures were practicable, and there was sufficient signal of potential efficacy to change salt intake. With some improvements to the intervention app, a larger trial to assess intervention effectiveness for reducing salt intake and blood pressure is warranted.

TRIAL REGISTRATION

International Standard Randomized Controlled Trial Number (ISRCTN): 20910962; https://www.isrctn.com/ISRCTN20910962.

The effectiveness of Check of Medication Appropriateness for antimicrobial stewardship: an interrupted time series analysis

OBJECTIVES

Inappropriate prescribing of antimicrobials in hospitals contributes to the emergence of resistance and adverse drug events. To support antimicrobial stewardship (AMS), clinical decision rules focusing on antimicrobial therapy were implemented in the 'Check of Medication Appropriateness' (CMA). The CMA is a hospital-wide pharmacist-led medication review service consisting of a clinical rule-based screening for potentially inappropriate prescriptions (PIPs). We aimed to investigate the impact of the CMA on antimicrobial prescribing.

METHODS

An interrupted time series study was performed at the University Hospitals Leuven. The pre-implementation cohort was exposed to standard-of-care AMS. Afterwards, an AMS-focused CMA comprising 41 specific clinical rules, targeting six AMS objectives, was implemented in the post-implementation period. A regression model was used to assess the impact of the intervention on the number of AMS-related residual PIPs between both periods. The total number of recommendations and acceptance rate was recorded for the 2 year post-implementation period.

RESULTS

Pre-implementation, a median proportion of 75% (range: 33%-100%) residual PIPs per day was observed. After the CMA intervention, the proportion was reduced to 8% (range: 0%-33%) per day. Use of clinical rules resulted in an immediate relative reduction of 86.70% (P < 0.0001) in AMS-related residual PIPs. No significant underlying time trends were observed during the study period. Post-implementation, 2790 recommendations were provided of which 81.32% were accepted.

CONCLUSIONS

We proved that the CMA approach reduced the number of AMS-related residual PIPs in a highly significant and sustained manner, with the potential to further expand the service to other AMS objectives.

Development, validation and evaluation of the Goal-directed Medication review Electronic Decision Support System (G-MEDSS)©

OBJECTIVES

1) To understand and investigate the experiences of accredited clinical pharmacists (ACP) using computerised clinical decision support systems (CCDSS) during medication reviews for older people, including those living with dementia; 2) To design, develop, validate, and evaluate a CCDSS that incorporates pharmacological and other deprescribing tools to aid person-centred management of high-risk medications in older adults living with and without dementia.

METHODS

This study consisted of three phases and was designed on scenario-based methodology: a) the development phase, which included an exploratory survey and prototype building; b) the validation phase, which included qualitative data collection and usability testing with ACPs, general practitioners (GPs) and carers for people living with dementia; and c) the evaluation phase, using mixed-methods analyses.

RESULTS

The exploratory survey found that ACPs required a flexible, and reliable CCDSS to support them with clinical decisions regarding high-risk medication use in older adults. The Goal-directed Medication review Electronic Decision Support System (G-MEDSS)© was developed and validated using quantitative and qualitative feedback received from ACPs, GPs and carers for people with dementia. The mean (SD) System Usability Scale score was 69.0 (12.9), which indicated fair-good usability.

DISCUSSION AND CONCLUSIONS

Involving end-users in the design process refined and improved the design of G-MEDSS, allowing for a person-centred and goal-directed delivery of pharmaceutical care. G-MEDSS allows healthcare practitioners conducting medication reviews for older adults living with and without dementia to tailor pharmaceutical care to meet their goals and preferences. Future studies may explore integration of G-MEDSS with prescribing or dispensing software.

A Web Interface for Antibiotic Prescription Recommendations in Primary Care: User-Centered Design Approach

BACKGROUND

Antibiotic misuse is a serious public health problem worldwide. National health authorities release clinical practice guidelines (CPGs) to guide general practitioners (GPs) in their choice of antibiotics. However, despite the large-scale dissemination of CPGs, GPs continue to prescribe antibiotics that are not recommended as first-line treatments. This nonadherence to recommendations may be due to GPs misunderstanding the CPGs. A web interface displaying antibiotic prescription recommendations and their justifications could help to improve the comprehensibility and readability of CPGs, thereby increasing the adoption of recommendations regarding antibiotic treatment.

OBJECTIVE

This study aims to design and evaluate a web interface for antibiotic prescription displaying both the recommended antibiotics and their justifications in the form of antibiotic properties.

METHODS

A web interface was designed according to the same principles as e-commerce interfaces and was assessed by 117 GPs. These GPs were asked to answer 17 questions relating to the usefulness, user-friendliness, and comprehensibility and readability of the interface, and their satisfaction with it. Responses were recorded on a 4-point Likert scale (ranging from "absolutely disagree" to "absolutely agree"). At the end of the evaluation, the GPs were allowed to provide optional, additional free comments.

RESULTS

The antibiotic prescription web interface consists of three main sections: a clinical summary section, a filter section, and a recommended antibiotics section. The majority of GPs appreciated the clinical summary (90/117, 76.9%) and filter (98/117, 83.8%) sections, whereas 48.7% (57/117) of them reported difficulty reading some of the icons in the recommended antibiotics section. Overall, 82.9% (97/117) of GPs found the display of drug properties useful, and 65.8% (77/117) reported that the web interface improved their understanding of CPG recommendations.

CONCLUSIONS

The web interface displaying antibiotic recommendations and their properties can help doctors understand the rationale underlying CPG recommendations regarding antibiotic treatment, but further improvements are required before its implementation into a clinical decision support system.

Impact of a computerised clinical decision support system on vancomycin loading and the risk of nephrotoxicity

BACKGROUND

A vancomycin loading dose is recommended for the treatment of serious methicillin-resistant Staphylococcus aureus (MRSA) infections. However, clinicians often do not adhere to these recommendations, mainly due to nephrotoxicity risk, unfamiliarity with the guideline, or complexity of calculating an individual dose. Therefore, we introduced a computerised clinical decision support system (CDSS) for vancomycin loading (hereafter Vancomycin CDSS) to promote the use of vancomycin loading dose.

METHODS

We describe a quasi-experimental study spanning 6 months before and 18 months after the deployment of a Vancomycin CDSS. The Vancomycin CDSS was integrated into the hospital's electronic medical record system in the form of a vancomycin order set. Our primary endpoint was the incidence of nephrotoxicity; the secondary endpoint was mean initial vancomycin trough levels. We also conducted a survey to evaluate the reasons why clinicians opted not to utilise a vancomycin loading dose.

RESULTS

After implementation of Vancomycin CDSS, 363 out of 746 patients (49 %) who were first administered vancomycin received a loading dose. We did not find significant differences in nephrotoxicity between the pre- and post-intervention groups, nor between the loading- and non-loading groups. In the pre-intervention group, the mean initial vancomycin trough level was 7.10 mg/L, which was significantly lower than that in the post-intervention group of 11.11 mg/L. In the vancomycin loading group, the mean initial trough level was 11.95 mg/L, compared to 7.55 mg/L in the non-loading group. The main reason stated for not prescribing a vancomycin loading dose was concern about nephrotoxicity.

CONCLUSION

Introduction of the Vancomycin CDSS did not increase nephrotoxicity and increased the mean initial dose and trough level of vancomycin.