1
|
Carlos Ferreira J, Elvas LB, Correia R, Mascarenhas M. Enhancing EHR Interoperability and Security through Distributed Ledger Technology: A Review. Healthcare (Basel) 2024; 12:1967. [PMID: 39408147 PMCID: PMC11477175 DOI: 10.3390/healthcare12191967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Revised: 09/21/2024] [Accepted: 09/26/2024] [Indexed: 10/20/2024] Open
Abstract
The management and exchange of electronic health records (EHRs) remain critical challenges in healthcare, with fragmented systems, varied standards, and security concerns hindering seamless interoperability. These challenges compromise patient care and operational efficiency. This paper proposes a novel solution to address these issues by leveraging distributed ledger technology (DLT), including blockchain, to enhance data security, integrity, and transparency in healthcare systems. The decentralized and immutable nature of DLT enables more efficient and secure information exchange across platforms, improving decision-making and coordination of care. This paper outlines a strategic implementation approach, detailing timelines, resource requirements, and stakeholder involvement while addressing crucial privacy and security concerns like encryption and access control. In addition, it explores standards and protocols necessary for achieving interoperability, offering case studies that demonstrate the framework's effectiveness. This work contributes by introducing a DLT-based solution to the persistent issue of EHR interoperability, providing a novel pathway to secure and efficient health data exchanges. It also identifies the standards and protocols essential for integrating DLT with existing health information systems, thereby facilitating a smoother transition toward enhanced interoperability.
Collapse
Affiliation(s)
- João Carlos Ferreira
- Faculty of Logistics, Molde University College, NO-6410 Molde, Norway; (J.C.F.); (L.B.E.)
- Center for Research of Technologies and Architecture, Instituto Universitario de Lisboa ISCTE-IUL, ISTAR, 1649-026 Lisboa, Portugal
- INESC INOV-Lab, 1000-029 Lisbon, Portugal
| | - Luís B. Elvas
- Faculty of Logistics, Molde University College, NO-6410 Molde, Norway; (J.C.F.); (L.B.E.)
- Center for Research of Technologies and Architecture, Instituto Universitario de Lisboa ISCTE-IUL, ISTAR, 1649-026 Lisboa, Portugal
- INESC INOV-Lab, 1000-029 Lisbon, Portugal
| | | | - Miguel Mascarenhas
- BioGHP, 1000-260 Lisboa, Portugal;
- Department of Community Medicine, Information and Health Decision Sciences (MEDCIDS), Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| |
Collapse
|
2
|
Lampe D, Grosser J, Grothe D, Aufenberg B, Gensorowsky D, Witte J, Greiner W. How intervention studies measure the effectiveness of medication safety-related clinical decision support systems in primary and long-term care: a systematic review. BMC Med Inform Decis Mak 2024; 24:188. [PMID: 38965569 PMCID: PMC11225126 DOI: 10.1186/s12911-024-02596-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Accepted: 07/01/2024] [Indexed: 07/06/2024] Open
Abstract
BACKGROUND Medication errors and associated adverse drug events (ADE) are a major cause of morbidity and mortality worldwide. In recent years, the prevention of medication errors has become a high priority in healthcare systems. In order to improve medication safety, computerized Clinical Decision Support Systems (CDSS) are increasingly being integrated into the medication process. Accordingly, a growing number of studies have investigated the medication safety-related effectiveness of CDSS. However, the outcome measures used are heterogeneous, leading to unclear evidence. The primary aim of this study is to summarize and categorize the outcomes used in interventional studies evaluating the effects of CDSS on medication safety in primary and long-term care. METHODS We systematically searched PubMed, Embase, CINAHL, and Cochrane Library for interventional studies evaluating the effects of CDSS targeting medication safety and patient-related outcomes. We extracted methodological characteristics, outcomes and empirical findings from the included studies. Outcomes were assigned to three main categories: process-related, harm-related, and cost-related. Risk of bias was assessed using the Evidence Project risk of bias tool. RESULTS Thirty-two studies met the inclusion criteria. Almost all studies (n = 31) used process-related outcomes, followed by harm-related outcomes (n = 11). Only three studies used cost-related outcomes. Most studies used outcomes from only one category and no study used outcomes from all three categories. The definition and operationalization of outcomes varied widely between the included studies, even within outcome categories. Overall, evidence on CDSS effectiveness was mixed. A significant intervention effect was demonstrated by nine of fifteen studies with process-related primary outcomes (60%) but only one out of five studies with harm-related primary outcomes (20%). The included studies faced a number of methodological problems that limit the comparability and generalizability of their results. CONCLUSIONS Evidence on the effectiveness of CDSS is currently inconclusive due in part to inconsistent outcome definitions and methodological problems in the literature. Additional high-quality studies are therefore needed to provide a comprehensive account of CDSS effectiveness. These studies should follow established methodological guidelines and recommendations and use a comprehensive set of harm-, process- and cost-related outcomes with agreed-upon and consistent definitions. PROSPERO REGISTRATION CRD42023464746.
Collapse
Affiliation(s)
- David Lampe
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany.
| | - John Grosser
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| | - Dennis Grothe
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| | - Birthe Aufenberg
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| | | | | | - Wolfgang Greiner
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| |
Collapse
|
3
|
Sperl-Hillen JM, Haapala JL, Dehmer SP, Chumba LN, Ekstrom HL, Truitt AR, Asche SE, Werner AM, Rehrauer DJ, Pankonin MA, Pawloski PA, O'Connor PJ. Protocol of a patient randomized clinical trial to improve medication adherence in primary care. Contemp Clin Trials 2024; 136:107385. [PMID: 37956792 PMCID: PMC10922408 DOI: 10.1016/j.cct.2023.107385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 09/25/2023] [Accepted: 11/03/2023] [Indexed: 11/15/2023]
Abstract
BACKGROUND Enhanced awareness of poor medication adherence could improve patient care. This article describes the original and adapted protocols of a randomized trial to improve medication adherence for cardiometabolic conditions. METHODS The original protocol entailed a cluster randomized trial of 28 primary care clinics allocated to either (i) medication adherence enhanced chronic disease care clinical decision support (eCDC-CDS) integrated within the electronic health record (EHR) or (ii) usual care (non-enhanced CDC-CDS). Enhancements comprised (a) electronic interfaces printed for patients and clinicians at primary care encounters that encouraged discussion about specific medication adherence issues that were identified, and (b) pharmacist phone outreach. Study subjects were individuals who at an index visit were aged 18-74 years and not at evidence-based care goals for hypertension (HTN), diabetes mellitus (DM), or lipid management, along with low medication adherence (proportion of days covered [PDC] <80%) for a corresponding medication. The primary study outcomes were improved medication adherence and clinical outcomes (BP and A1C) at 12 months. Protocol adaptation became imperative in response to major implementation challenges: (a) the availability of EHR system-wide PDC calculations that superseded our ability to limit PDC adherence information solely to intervention clinics; (b) the unforeseen closure of pharmacies committed to conducting the pharmacist outreach; and (c) disruptions and clinic closures due to the Covid-19 pandemic. CONCLUSION This manuscript details the protocol of a study to assess whether enhanced awareness of medication adherence issues in primary care settings could improve patient outcomes. The need for protocol adaptation arose in response to multiple implementation challenges.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Ann M Werner
- HealthPartners Institute, Bloomington, MN, United States
| | - Dan J Rehrauer
- HealthPartners Health Plan, Bloomington, MN, United States; HealthPartners Medical Group, Bloomington, MN, United States
| | | | | | | |
Collapse
|
4
|
Alshehri N, Alanazi A. Pharmacists' Perceptions on Safety Alerts of the Drug Utilization Review (DUR) in Electronic Health Records in a Tertiary Healthcare Hospital. PHARMACY 2023; 11:119. [PMID: 37489350 PMCID: PMC10366836 DOI: 10.3390/pharmacy11040119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Revised: 07/14/2023] [Accepted: 07/18/2023] [Indexed: 07/26/2023] Open
Abstract
Electronic Drug Alarms and Drug Utilization Reviews (DURs) are crucial in improving patient safety by reducing the dispensing of contraindicated medications and minimizing adverse drug events. The DUR system often generates low-level alerts, making it challenging for pharmacists and doctors to discern more critical alerts. This can result in alert fatigue, causing burnout and jeopardizing patient safety. A cross-sectional study was conducted in a tertiary hospital to explore pharmacists' perspectives and experience with the DUR system. This study aimed to identify their responses to alerts indicating a need to change the original prescription and the difficulties encountered. Out of all the participants, 85% had prior experience with DUR alerts. However, 40% of them expressed dissatisfaction with the alerts. Moreover, 88% of the participants received highly frequent DUR alerts, but only 40% believed that DUR alerts could identify rare adverse drug reactions. Additionally, only 27% of the participants altered their prescriptions based on alerts for the MAOI/serotonin modulator. The survey showed that 66% of participants believe improvements are necessary for the DUR system. Specifically, 77% of participants felt that more information is needed on overlapping prescriptions, 82% on patients with chronic diseases, and 82% on potential reactions caused by co-administration. At the same time, 75% raised concern about the need for backup for any server breakdown. Positive perceptions about DUR lead to changing the prescription in response to an alert. Therefore, improving the DUR system is crucial to prevent pharmacists from missing important alerts and to increase their awareness of clinically significant alarm signals. By doing so, we can optimize patient safety and contribute to providing high-quality healthcare services.
Collapse
Affiliation(s)
- Nouf Alshehri
- Department of Health Informatics, College of Public Health and Health Informatics, King Saud Ibn Abdulaziz University for Health Sciences, Riyadh 11481, Saudi Arabia
- King Abdullah International Medical Research Center, Riyadh 14611, Saudi Arabia
| | - Abdullah Alanazi
- Department of Health Informatics, College of Public Health and Health Informatics, King Saud Ibn Abdulaziz University for Health Sciences, Riyadh 11481, Saudi Arabia
| |
Collapse
|
5
|
Noticing Acute Changes in Health in Long-Term Care Residents. Rehabil Nurs 2023; 48:47-55. [PMID: 36792958 DOI: 10.1097/rnj.0000000000000405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/17/2023]
Abstract
PURPOSE Early signs of acute conditions and increased fall risk often go unrecognized in patients in long-term care facilities. The aim of this study was to examine how healthcare staff identify and act on changes in health status in this patient population. DESIGN A qualitative study design was used for this study. METHODS Six focus groups across two Department of Veterans Affairs long-term care facilities were conducted with 26 interdisciplinary healthcare staff members. Using thematic content analysis, the team preliminarily coded based on interview questions, reviewed and discussed emerging themes, and agreed on the resultant coding scheme for each category with additional independent scientist review. RESULTS Themes included describing and explaining how "normal" or expected behavior is identified by staff, noticing changes in a resident, determining the significance of the change, hypothesizing reasons for an observed change, response to an observed change, and resolution of the clinical change. CONCLUSIONS Despite limited training in formal assessment methods, long-term care staff have developed methods to conduct ongoing assessments of the residents. This technique, individual phenotyping, often identifies acute changes; however, the lack of formal methods, language, or tools to communicate the changes means that these assessments are not often formalized in a manner that informs the residents' changing care needs. CLINICAL RELEVANCE TO THE PRACTICE OF REHABILITATION NURSING More formal objective measures of health change are needed to assist long-term care staff in expressing and interpreting the subjective phenotype changes into objective, easily communicated health status changes. This is particularly important for acute health changes and impending falls, both of which are associated with acute hospitalization.
Collapse
|
6
|
Yusuff KB, Mustafa M, Al-Qahtani NH. Prevalence, types and severity of medication errors associated with the use of automated medication use systems in ambulatory and institutionalized care settings: A systematic review protocol. PLoS One 2021; 16:e0260992. [PMID: 34860852 PMCID: PMC8641865 DOI: 10.1371/journal.pone.0260992] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/05/2021] [Indexed: 11/19/2022] Open
Abstract
The use of automated systems within the medication use process has significantly reduce the occurrence of medication errors and the associated clinical and financial burden. However, automated systems lull into a false sense of security and increase the risk of medication errors that are often associated with socio-technical interactions, automation bias, workarounds and overrides. The objective of the systematic review is to determine the prevalence, types and severity of medication errors that are associated the use of automated systems in ambulatory and institutionalized care settings. The search strategy will be guided by PRISMA framework. Selected databases and relevant gray literature were searched and screening was done independently by two researchers between 01 April and 29 June 2021. These covered all relevant articles published from the inception of the use of automation in the medication use process (2000) until 2020. De-duplication and screening of all studies were done independently by two researchers with a clear inclusion / exclusion criteria. Data extraction and synthesis are currently on going (started on 06 July 2021) and being conducted independently but the validity and completeness of the processes will be confirmed by the third researcher. The Cochrane Risk of Bias tool and the Hoy et al's quality assessment checklist will be used for the assessment of methodological bias while the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system will be used for the quality of evidence assessment. Detailed qualitative synthesis of key findings will be done with thematic and descriptive analyses. If the number and types of included studies permit, fixed or random effect model meta-analysis will be conducted based on the degree of homogeneity in the sampling frame used in the included studies. Heterogeneity will be assessed with I2 statistics and I2 > 50% will be considered a high statistical heterogeneity. The systematic review may provide new perspective especially from developing settings about the prevalence, types and severity of medication errors associated with the use of automated systems at all the stages of medication use process, and in all categories of patients. This may add to global knowledge in the research area. Systematic review registration: The systematic review was registered and published by PROSPERO (CRD42020212900).
Collapse
Affiliation(s)
- Kazeem Babatunde Yusuff
- Department of Clinical Pharmacy and Practice, College of Pharmacy, QU Health, Qatar University, Doha, Qatar
| | - Mariam Mustafa
- Department of Clinical Pharmacy and Practice, College of Pharmacy, QU Health, Qatar University, Doha, Qatar
| | - Najla Hezam Al-Qahtani
- Department of Clinical Pharmacy and Practice, College of Pharmacy, QU Health, Qatar University, Doha, Qatar
| |
Collapse
|
7
|
Gates PJ, Hardie RA, Raban MZ, Li L, Westbrook JI. How effective are electronic medication systems in reducing medication error rates and associated harm among hospital inpatients? A systematic review and meta-analysis. J Am Med Inform Assoc 2021; 28:167-176. [PMID: 33164058 PMCID: PMC7810459 DOI: 10.1093/jamia/ocaa230] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Accepted: 09/07/2020] [Indexed: 12/27/2022] Open
Abstract
OBJECTIVE To conduct a systematic review and meta-analysis to assess: 1) changes in medication error rates and associated patient harm following electronic medication system (EMS) implementation; and 2) evidence of system-related medication errors facilitated by the use of an EMS. MATERIALS AND METHODS We searched Medline, Scopus, Embase, and CINAHL for studies published between January 2005 and March 2019, comparing medication errors rates with or without assessments of related harm (actual or potential) before and after EMS implementation. EMS was defined as a computer-based system enabling the prescribing, supply, and/or administration of medicines. Study quality was assessed. RESULTS There was substantial heterogeneity in outcomes of the 18 included studies. Only 2 were strong quality. Meta-analysis of 5 studies reporting change in actual harm post-EMS showed no reduced risk (RR: 1.22, 95% CI: 0.18-8.38, P = .8) and meta-analysis of 3 studies reporting change in administration errors found a significant reduction in error rates (RR: 0.77, 95% CI: 0.72-0.83, P = .004). Of 10 studies of prescribing error rates, 9 reported a reduction but variable denominators precluded meta-analysis. Twelve studies provided specific examples of system-related medication errors; 5 quantified their occurrence. DISCUSSION AND CONCLUSION Despite the wide-scale adoption of EMS in hospitals around the world, the quality of evidence about their effectiveness in medication error and associated harm reduction is variable. Some confidence can be placed in the ability of systems to reduce prescribing error rates. However, much is still unknown about mechanisms which may be most effective in improving medication safety and design features which facilitate new error risks.
Collapse
Affiliation(s)
- Peter J Gates
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia
| | - Rae-Anne Hardie
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia
| | - Magdalena Z Raban
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia
| | - Ling Li
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia
| | - Johanna I Westbrook
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, North Ryde, New South Wales, Australia
| |
Collapse
|
8
|
Siqueira M, Coube M, Millett C, Rocha R, Hone T. The impacts of health systems financing fragmentation in low- and middle-income countries: a systematic review protocol. Syst Rev 2021; 10:164. [PMID: 34078460 PMCID: PMC8170990 DOI: 10.1186/s13643-021-01714-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Accepted: 05/19/2021] [Indexed: 01/11/2023] Open
Abstract
BACKGROUND Health systems are often fragmented in low- and middle-income countries (LMICs). This can increase inefficiencies and restrict progress towards universal health coverage. The objective of the systematic review described in this protocol will be to evaluate and synthesize the evidence concerning the impacts of health systems financing fragmentation in LMICs. METHODS Literature searches will be conducted in multiple electronic databases, from their inception onwards, including MEDLINE, EMBASE, LILACS, CINAHL, Scopus, ScienceDirect, Scielo, Cochrane Library, EconLit, and JSTOR. Gray literature will be also targeted through searching OpenSIGLE, Google Scholar, and institutional websites (e.g., HMIC, The World Bank, WHO, PAHO, OECD). The search strings will include keywords related to LMICs, health system financing fragmentation, and health system goals. Experimental, quasi-experimental, and observational studies conducted in LMICs and examining health financing fragmentation across any relevant metric (e.g., the presence of different health funders/insurers, risk pooling mechanisms, eligibility categories, benefits packages, premiums) will be included. Studies will be eligible if they compare financing fragmentation in alternative settings or at least two-time points. The primary outcomes will be health system-related goals such as health outcomes (e.g., mortality, morbidity, patient-reported outcome measures) and indicators of access, services utilization, equity, and financial risk protection. Additional outcomes will include intermediate health system objectives (e.g., indicators of efficiency and quality). Two reviewers will independently screen all citations, abstract data, and full-text articles. Potential conflicts will be resolved through discussion and, when necessary, resolved by a third reviewer. The methodological quality (or risk of bias) of selected studies will be appraised using established checklists. Data extraction categories will include the studies' objective and design, the fragmentation measurement and domains, and health outcomes linked to the fragmentation. A narrative synthesis will be used to describe the results and characteristics of all included studies and to explore relationships and findings both within and between the studies. DISCUSSION Evidence on the impacts of health system fragmentation in LMICs is key for identifying evidence gaps and priority areas for intervention. This knowledge will be valuable to health system policymakers aiming to strengthen health systems in LMICs. SYSTEMATIC REVIEW REGISTRATION PROSPERO CRD42020201467.
Collapse
Affiliation(s)
- Marina Siqueira
- Institute for Health Policy Studies, IEPS, Itapeva St 286, Conjunto 81-84, Bela Vista, São Paulo, SP, 01332-000, Brazil.
| | - Maíra Coube
- Institute for Health Policy Studies, IEPS, Itapeva St 286, Conjunto 81-84, Bela Vista, São Paulo, SP, 01332-000, Brazil
| | - Christopher Millett
- Public Health Policy Evaluation Unit, Department of Primary Care and Public Health, School of Public Health, Imperial College London, Exhibition Rd, South Kensington, London, SW7 2BU, UK
| | - Rudi Rocha
- Institute for Health Policy Studies, IEPS, Itapeva St 286, Conjunto 81-84, Bela Vista, São Paulo, SP, 01332-000, Brazil
| | - Thomas Hone
- Public Health Policy Evaluation Unit, Department of Primary Care and Public Health, School of Public Health, Imperial College London, Exhibition Rd, South Kensington, London, SW7 2BU, UK
| |
Collapse
|
9
|
Shahmoradi L, Safdari R, Ahmadi H, Zahmatkeshan M. Clinical decision support systems-based interventions to improve medication outcomes: A systematic literature review on features and effects. Med J Islam Repub Iran 2021; 35:27. [PMID: 34169039 PMCID: PMC8214039 DOI: 10.47176/mjiri.35.27] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2019] [Indexed: 01/24/2023] Open
Abstract
Background: Clinical decision support systems (CDSSs) interventions were used to improve the life quality and safety in patients and also to improve practitioner performance, especially in the field of medication. Therefore, the aim of the paper was to summarize the available evidence on the impact, outcomes and significant factors on the implementation of CDSS in the field of medicine. Methods: This study is a systematic literature review. PubMed, Cochrane Library, Web of Science, Scopus, EMBASE, and ProQuest were investigated by 15 February 2017. The inclusion requirements were met by 98 papers, from which 13 had described important factors in the implementation of CDSS, and 86 were medicated-related. We categorized the system in terms of its correlation with medication in which a system was implemented, and our intended results were examined. In this study, the process outcomes (such as; prescription, drug-drug interaction, drug adherence, etc.), patient outcomes, and significant factors affecting the implementation of CDSS were reviewed. Results: We found evidence that the use of medication-related CDSS improves clinical outcomes. Also, significant results were obtained regarding the reduction of prescription errors, and the improvement in quality and safety of medication prescribed. Conclusion: The results of this study show that, although computer systems such as CDSS may cause errors, in most cases, it has helped to improve prescribing, reduce side effects and drug interactions, and improve patient safety. Although these systems have improved the performance of practitioners and processes, there has not been much research on the impact of these systems on patient outcomes.
Collapse
Affiliation(s)
- Leila Shahmoradi
- Health Information Management Department, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran
| | - Reza Safdari
- Health Information Management Department, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran
| | - Hossein Ahmadi
- OIM Department, Aston Business School, Aston University, Birmingham B4 7ET, United Kingdom
| | - Maryam Zahmatkeshan
- Noncommunicable Diseases Research Center, School of Medicine, Fasa University of Medical Sciences, Fasa, Iran
| |
Collapse
|
10
|
Huter K, Krick T, Domhoff D, Seibert K, Wolf-Ostermann K, Rothgang H. Effectiveness of Digital Technologies to Support Nursing Care: Results of a Scoping Review. J Multidiscip Healthc 2020; 13:1905-1926. [PMID: 33328736 PMCID: PMC7734078 DOI: 10.2147/jmdh.s286193] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 11/05/2020] [Indexed: 12/19/2022] Open
Abstract
BACKGROUND The field of digital technologies being developed or applied to support nursing care is extensive. The aim of this scoping review is to provide an overview on technologies for which results on positive or negative effects on persons in need of care, caregivers or care institutions are available and to appraise the reliability of these results. METHODS A scoping review design has been used to identify studies focussing on the effectiveness of digital technologies in nursing care for persons in need of care, caregivers or care institutions. The screening process included 19,510 scientific publications from 9 databases. RESULTS A total of 123 single studies and 31 reviews were subjected to the analysis. The included technologies comprise nursing and health information technologies, such as assistive devices, information and communication technologies, sensors and robotics. The results show that there are many studies that demonstrate positive effects, but the level of evidence is mostly low and study sizes are often small. Hardly any technology has been researched intensively enough to produce conclusive results. Studies on a high level of evidence (RCTs) lack for most technological areas. Heterogeneous results in some areas indicate that effects may depend strongly on the mode and specific context into which the technologies are introduced. CONCLUSION Due to the limited evidence on effectiveness of digital technologies in nursing care, it is not surprising that care institutions are reluctant to put innovative technologies into practice. The scoping review indicates technology areas that should be subject to future research with higher quality studies. Research on outpatient, informal and cross-sectoral care should be intensified to further exploit the potential of digital technologies with a view to improving independence of care-recipients and unburdening formal and informal carers.
Collapse
Affiliation(s)
- Kai Huter
- University of Bremen, SOCIUM Research Center on Inequality and Social Policy, Bremen, Germany
- University of Bremen, High-Profile Area of Health Sciences, Bremen, Germany
| | - Tobias Krick
- University of Bremen, SOCIUM Research Center on Inequality and Social Policy, Bremen, Germany
- University of Bremen, High-Profile Area of Health Sciences, Bremen, Germany
| | - Dominik Domhoff
- University of Bremen, High-Profile Area of Health Sciences, Bremen, Germany
- University of Bremen, Institute for Public Health and Nursing Research, Bremen, Germany
| | - Kathrin Seibert
- University of Bremen, High-Profile Area of Health Sciences, Bremen, Germany
- University of Bremen, Institute for Public Health and Nursing Research, Bremen, Germany
| | - Karin Wolf-Ostermann
- University of Bremen, High-Profile Area of Health Sciences, Bremen, Germany
- University of Bremen, Institute for Public Health and Nursing Research, Bremen, Germany
| | - Heinz Rothgang
- University of Bremen, SOCIUM Research Center on Inequality and Social Policy, Bremen, Germany
- University of Bremen, High-Profile Area of Health Sciences, Bremen, Germany
| |
Collapse
|
11
|
Dellinger JK, Pitzer S, Schaffler-Schaden D, Schreier MM, Fährmann LS, Hempel G, Likar R, Osterbrink J, Flamm M. Improving medication appropriateness in nursing homes via structured interprofessional medication-review supported by health information technology: a non-randomized controlled study. BMC Geriatr 2020; 20:506. [PMID: 33243145 PMCID: PMC7690110 DOI: 10.1186/s12877-020-01895-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Accepted: 11/12/2020] [Indexed: 11/10/2022] Open
Abstract
Background In nursing home residents (NHRs), polypharmacy is widespread, accompanied by elevated risks of medication related complications. Managing medication in NHRs is a priority, but prone to several challenges, including interprofessional cooperation. Against this background, we implemented and tested an interprofessional intervention aimed to improve medication appropriateness for NHRs. Methods A non-randomized controlled study (SiMbA; “Sicherheit der Medikamentherapie bei AltenheimbewohnerInnen”, Safety of medication therapy in NHRs) was conducted in six nursing homes in Austria (2016–2018). Educational training, introduction of tailored health information technology (HIT) and a therapy check process were combined in an intervention aimed at healthcare professionals. Medication appropriateness was assessed using the Medication Appropriateness Index (MAI). Data was collected before (t0), during (t1, month 12) and after (t2, month 18) intervention via self-administered assessments and electronic health records. Results We included 6 NHs, 17 GPs (52.94% female) and 240 NHRs (68.75% female; mean age 85.0). Data of 159 NHRs could be included in the analysis. Mean MAI-change was − 3.35 (IG) vs. − 1.45 (CG). In the subgroup of NHRs with mean MAI ≥23, MAI-change was − 10.31 (IG) vs. −3.52 (CG). The intervention was a significant predictor of improvement in MAI when controlled for in a multivariable regression model. Conclusions Improvement of medication appropriateness was clearest in residents with inappropriate baseline MAI-scores. This improvement was independent of variances in certain covariates between the intervention and the control group. We conclude that our intervention is a feasible approach to improve NHRs’ medication appropriateness. Trial registration DRKS Data Management, ID: DRKS00012246. Registered 16.05.2017 – Retrospectively registered.
Collapse
Affiliation(s)
| | - Stefan Pitzer
- Institute of Nursing Science and Practice, Paracelsus Medical University, Salzburg, Austria
| | - Dagmar Schaffler-Schaden
- Institute of General Practice, Family Medicine and Preventive Medicine, Paracelsus Medical University, Salzburg, Austria
| | | | - Laura Sandre Fährmann
- Institute of Pharmaceutic and Medical Chemistry, University of Münster, Münster, Germany
| | - Georg Hempel
- Institute of Pharmaceutic and Medical Chemistry, University of Münster, Münster, Germany
| | - Rudolf Likar
- Klinikum Klagenfurt am Wörthersee, Klagenfurt am Wörthersee, Austria
| | - Jürgen Osterbrink
- Institute of Nursing Science and Practice, Paracelsus Medical University, Salzburg, Austria
| | - Maria Flamm
- Institute of General Practice, Family Medicine and Preventive Medicine, Paracelsus Medical University, Salzburg, Austria
| |
Collapse
|
12
|
Hagen B, Griebenow R. Prescription Rates for Antiplatelet Therapy (APT) in Coronary Artery Disease (CAD) - What Benchmark are We Aiming at in Continuing Medical Education (CME)? J Eur CME 2020; 9:1836866. [PMID: 33224627 PMCID: PMC7655043 DOI: 10.1080/21614083.2020.1836866] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 10/08/2020] [Accepted: 10/09/2020] [Indexed: 11/09/2022] Open
Abstract
Physicians always aim to improve their patients' health. CME should be designed not only to provide knowledge transfer, but also to influence clinical decision-making and to close performance gaps. In aretrospective study we analysed prescription rates for APT in 254,932 CAD patients (male: 64.4%), treated in atotal of 3,405 practices in 2019 in aDMP in the region of North Rhine, Germany. Analyses were run for the whole study population stratified by sex as well as for subgroups of patients suffering from myocardial infarction/acute coronary syndrome, or who have been treated with percutaneous coronary intervention or bypass surgery. Patients mean age was 72.7 ± 11.2 years (mean ± 1SD), mean duration of DMP participation was 7.2 ± 4.7 years, and mean cumulative number of DMP visits was 27 ± 17. APT prescription rates were 85.0% in male and 78.8% in female CAD patients. In subgroups of male CAD patients APT prescription rates were between 89.7% and 92.8%, in the same subgroups of female CAD patients the corresponding rates were between 87.8% and 92.0%. Rates for amissing APT prescription per practice were between .0044% and .0062% for male and female CAD patients, respectively. Rates for amissing APT prescription per practice and DMP visit were .0002% for both sexes. These results suggest that a DMP can achieve high attainment rates for APT in CAD. To further improve attainment rates, consideration of absolute numbers of eligible patients per practice or physician is probably more appropriate than expression of performance as percentage values. This is especially true if attainment rates show substantial variations between subgroups, if subgroups show substantial variation in size, if attainment rates are already in the magnitude of 80% or higher, and if there are disparities in the evidence base underlying treatment recommendations related to subgroups.
Collapse
Affiliation(s)
- Bernd Hagen
- Department of Evaluation and Quality Assurance, Central Institute for Statutory Health Care in Germany, Cologne/Berlin, Germany
| | - Reinhard Griebenow
- Praxis Rheingalerie, Cologne, Academic Teaching Practice, University of Cologne, Cologne, Germany
| |
Collapse
|
13
|
Hammar T, Hellström L, Ericson L. The Use of a Decision Support System in Swedish Pharmacies to Identify Potential Drug-Related Problems-Effects of a National Intervention Focused on Reviewing Elderly Patients' Prescriptions. PHARMACY 2020; 8:pharmacy8030118. [PMID: 32668586 PMCID: PMC7558108 DOI: 10.3390/pharmacy8030118] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 07/02/2020] [Accepted: 07/05/2020] [Indexed: 02/01/2023] Open
Abstract
In pharmacies in Sweden, a clinical decision support system called Electronic Expert Support (EES) is available to analyse patients' prescriptions for potential drug-related problems. A nationwide intervention was performed in 2018 among all Swedish pharmacy chains to increase the use of EES among patients 75 years or older. The aim of this research was to study the use of EES in connection with the national intervention in order to describe any effects of the intervention, to understand how pharmacists use EES and to identify any barriers and facilitators for the use of EES by pharmacists for elderly patients. Data on the number and categories of EES analyses, alerts, resolved alerts and active pharmacies was provided by the Swedish eHealth Agency. The effects of the intervention were analysed using interrupted time series regression. A web-based questionnaire comprising 20 questions was sent to 1500 pharmacists randomly selected from all pharmacies in Sweden. The study shows that pharmacists use and appreciate EES and that the national intervention had a clear effect during the week of the intervention and seems to have contributed to a faster increase in pharmacists' use of EES during the year to follow. The study also identified several issues or barriers for using EES.
Collapse
Affiliation(s)
- Tora Hammar
- The eHealth Institute, Department of Medicine and Optometry, Linnaeus University, 391 82 Kalmar, Sweden;
- Correspondence: ; Tel.: +46-480-497176
| | - Lina Hellström
- The eHealth Institute, Department of Medicine and Optometry, Linnaeus University, 391 82 Kalmar, Sweden;
- Pharmaceutical Department, Region Kalmar County, 391 85 Kalmar, Sweden
| | - Lisa Ericson
- The Swedish eHealth Agency, 391 29 Kalmar, Sweden;
| |
Collapse
|
14
|
Rispoli M, Perrotta F, Buono S, Corcione A. Role of a digital tool in preoperative lung resection surgery assessment. Digit Health 2019; 5:2055207619885783. [PMID: 31723435 PMCID: PMC6836304 DOI: 10.1177/2055207619885783] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2019] [Accepted: 10/07/2019] [Indexed: 12/25/2022] Open
Abstract
The assessment of patients likely to undergo lung resection surgery is a multidisciplinary approach involving pulmonologists, surgeons and anaesthesiologists. In thoracic surgery, medical operability is also a calculation of postoperative lung function. A mobile application – PreParAPP MSD – to calculate postoperative lung function has been developed with the endorsement of the Italian Society of Anaesthesia, Analgesia and Intensive Care and with the unconditional support of MSD Italia. Thanks to a simple graphic interface, the calculation becomes fast and intuitive, while the possibility of storing and sharing data in an analytical and computerised way with other clinicians might help with the full assessment of patients without forcing them to undergo several medical examinations. These simple calculated parameters are performed by a minority of clinicians, generally anaesthesiologists. In our facility, there is a team involved in the perioperative evaluation of lung resection surgery (13 pulmonologists, 9 surgeons and 5 anaesthesiologists). In order to evaluate the possible Awareness towards postoperative lung function calculation better, we organised an internal survey with 27 clinicians who are members of such a team before and after the introduction of the PreParAPP MSD. It was found that after the introduction of PreParAPP MSD, the percentage of clinicians involved in postoperative lung function calculation rose from 18% to 70%. The implementation of a digital tool may help to improve guideline adherence, in accordance with other experiences in which such tools represented the start for various quality improvement purposes throughout the medical field.
Collapse
Affiliation(s)
- Marco Rispoli
- Anaesthesia and Intensive Care Unit, Vincenzo Monaldi Hospital, Italy
| | - Fabio Perrotta
- Department of Medicine and Health Sciences 'V. Tiberio', University of Molise, Italy
| | - Salvatore Buono
- Anaesthesia and Intensive Care Unit, Vincenzo Monaldi Hospital, Italy
| | - Antonio Corcione
- Anaesthesia and Intensive Care Unit, Vincenzo Monaldi Hospital, Italy
| |
Collapse
|
15
|
Abstract
PURPOSE OF REVIEW Coordination of glucose monitoring, mealtimes, and insulin delivery in the hospital is complex, involving interactions between multiple key agents and overlapping workflows. The purpose of this review is to evaluate the scope of the problem as well as to assess evidence for interventions. RECENT FINDINGS In recent years, there has been an emphasis on systems-based approaches which address multiple contributing components of the problem at once in an effort to more seamlessly integrate workflows. Technological advances, such as decision support systems and advances in automated insulin delivery, and strategies that minimize the need for complex insulin regimens hold promise for future study. Evaluation of the coordination of insulin delivery is limited by a lack of standardized metrics and systematically collected mealtimes. Nevertheless, successful efforts include system-wide multicomponent interventions, though advances in therapeutic approaches may be of value.
Collapse
Affiliation(s)
- Kathleen Dungan
- Division of Endocrinology, Diabetes and Metabolism, The Ohio State University, Columbus, OH, 43210, USA.
| |
Collapse
|
16
|
Mekhail AM, Peasley M, Lewis B, Taylor J, Charters C. Designing digital prescribing: A new approach with branch diagrams. Comput Biol Med 2019; 113:103388. [DOI: 10.1016/j.compbiomed.2019.103388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 08/13/2019] [Accepted: 08/13/2019] [Indexed: 11/16/2022]
|
17
|
Mahlknecht A, Krisch L, Nestler N, Bauer U, Letz N, Zenz D, Schuler J, Fährmann L, Hempel G, Flamm M, Osterbrink J. Impact of training and structured medication review on medication appropriateness and patient-related outcomes in nursing homes: results from the interventional study InTherAKT. BMC Geriatr 2019; 19:257. [PMID: 31533630 PMCID: PMC6749664 DOI: 10.1186/s12877-019-1263-3] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Accepted: 08/29/2019] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Uncoordinated interprofessional communication in nursing homes increases the risk of polypharmacy and inappropriate medication use. This may lead to augmented frequency of adverse drug events, hospitalizations and mortality. The aims of this study were (1) to improve interprofessional communication and medication safety using a combined intervention and thus, (2) to improve medication appropriateness and health-related outcomes of the included residents. METHODS The single-arm interventional study (2014-2017) was conducted in Muenster, Germany and involved healthcare professionals and residents of nursing homes. The intervention consisted of systematic education of participating healthcare professionals and of a structured interprofessional medication review which was performed via an online communication platform. The primary endpoint was assessed using the Medication Appropriateness Index MAI. Secondary endpoints were: cognitive performance, delirium, agitation, mobility, number of drugs, number of severe drug-drug interactions and appropriateness of analgesics. Outcomes were measured before, during and after the intervention. Data were analyzed using descriptive and inference-statistical methods. RESULTS Fourteen general practitioners, 11 pharmacists, 9 nursing homes and 120 residents (n = 83 at all testing times) participated. Overall MAI sum-score decreased significantly over time (mean reduction: -7.1, CI95% -11.4 - - 2.8; median = - 3.0; dCohen = 0.39), especially in cases with baseline sum-score ≥ 24 points (mean reduction: -17.4, CI95% -27.6 - - 7.2; median = - 15.0; dCohen = 0.86). MAI sum-score of analgesics also decreased (dCohen = 0.45). Mean number of severe drug-drug interactions rose slightly over time (dCohen = 0.17). The proportion of residents showing agitated behavior diminished from 83.9 to 67.8%. Remaining secondary outcomes were without substantial change. CONCLUSION Medication appropriateness increased particularly in residents with high baseline MAI sum-scores. Cognitive decline of participating residents was seemingly decelerated when compared with epidemiologic studies. A controlled trial is required to confirm these effects. Interprofessional interaction was structured and performance of medication reviews was facilitated as the online communication platform provided unlimited and consistent access to all relevant and updated information. TRIAL REGISTRATION DRKS Data Management, ID: DRKS00007900 , date of registration: 2015-09-02 (retrospectively registered i.e. 6 weeks after commencement of the first data collection).
Collapse
Affiliation(s)
- Angelika Mahlknecht
- Institute of General Practice, Family Medicine and Preventive Medicine, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Laura Krisch
- Institute of Nursing Science and Practice, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Nadja Nestler
- Institute of Nursing Science and Practice, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Ulrike Bauer
- Institute of Nursing Science and Practice, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Nina Letz
- Institute of Nursing Science and Practice, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Daniel Zenz
- smart-Q Softwaresysteme GmbH, BioMedizinZentrum Bochum, Universitätsstraße 136, 44799 Bochum, Germany
| | - Jochen Schuler
- Institute of General Practice, Family Medicine and Preventive Medicine, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Laura Fährmann
- Department of Pharmaceutical and Medical Chemistry - Clinical Pharmacy, Westfaelische Wilhelms-University, Corrensstraße 48, 48149 Muenster, Germany
| | - Georg Hempel
- Department of Pharmaceutical and Medical Chemistry - Clinical Pharmacy, Westfaelische Wilhelms-University, Corrensstraße 48, 48149 Muenster, Germany
| | - Maria Flamm
- Institute of General Practice, Family Medicine and Preventive Medicine, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| | - Jürgen Osterbrink
- Institute of Nursing Science and Practice, Paracelsus Medical University, Strubergasse 21, 5020 Salzburg, Austria
| |
Collapse
|
18
|
Vélez-Díaz-Pallarés M, Pérez-Menéndez-Conde C, Bermejo-Vicedo T. Systematic review of computerized prescriber order entry and clinical decision support. Am J Health Syst Pharm 2019; 75:1909-1921. [PMID: 30463867 DOI: 10.2146/ajhp170870] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
PURPOSE Results of a systematic review of published data on the effect of computerized prescriber order entry (CPOE) with clinical decision support on medication error (ME) and adverse drug event (ADE) rates are presented. METHODS Literature searches of MEDLINE, Embase, and other databases were conducted to identify English- and Spanish-language articles on selected CPOE outcomes published from 1995 through 2016; in addition, 5 specific journals were searched for pertinent articles published during the period 2010-16. Publications on controlled prospective studies and before-and-after studies that assessed MEs and/or ADEs as main outcomes were selected for inclusion in the review. RESULTS Nineteen studies met the inclusion criteria. Data on MEs and ADEs could not be pooled, mainly due to heterogeneity in outcome definitions and study methodologies. The reviewed evidence indicated that CPOE implementation led to an overall reduction in errors at the prescription stage of the medication-use process (relative risk reduction, 0.29 [95% confidence interval, 0.10-0.85]; I 2 = 99%) and reductions in most types of prescription errors, but CPOE also resulted in the emergence of other types of errors. CONCLUSION CPOE reduces the overall ME rate in the prescription process, as well as specific types of errors, such as wrong dose or strength, wrong drug, frequency, administration route, and drug-drug interaction errors. The implementation of CPOE can lead to new errors, such as wrong drug selection from drop-down menus.
Collapse
|
19
|
Abstract
This article discusses eHealth evaluation leadership in terms of the need, key characteristics, and means to cultivate this leadership. It is well known that health leaders with technical informatics skills and prior eHealth adoption experience are more likely to commit to a long-term eHealth vision, are highly motivated, and can navigate through complex adoption issues. However, much less attention is paid to leadership when it comes to electronic health evaluation. The aim here is to engage the eHealth and broader health leadership communities in a dialogue about eHealth evaluation leadership in terms of its importance, the issues involved, and ways to build capacity in Canada and abroad.
Collapse
Affiliation(s)
- Francis Lau
- 1 University of Victoria, Victoria, British Columbia, Canada
| |
Collapse
|
20
|
Pellegrin K, Chan F, Pagoria N, Jolson-Oakes S, Uyeno R, Levin A. A Statewide Medication Management System: Health Information Exchange to Support Drug Therapy Optimization by Pharmacists across the Continuum of Care. Appl Clin Inform 2018; 9:1-10. [PMID: 29298450 PMCID: PMC5801897 DOI: 10.1055/s-0037-1620262] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
Background
While evidence generally supports the use of medication management technology, systems are typically implemented and evaluated piecemeal rather than as part of a comprehensive model for medication management. Systems to support drug therapy optimization, increasingly a key role of pharmacists in our healthcare system, have not yet been reported.
Objective
Our objective is to describe the design, implementation, and use of health information technology to support the hospital and community pharmacists' management of medications for high-risk patients statewide in the “Pharm2Pharm” model of care. Our aims were to make it easier for the pharmacists to access information needed to identify and resolve drug therapy problems using best practices for medication management and communicate with other members of the care team.
Methods
The pharmacist's roles and the medication management processes guided the design of the supporting technology, which was implemented after the Pharm2Pharm model was launched and the pharmacists' technology needs were assessed. Priorities for technology included sending care transition documents from hospital to community pharmacist securely and efficiently, access to medical records, including medications and laboratory results, documentation, and patient tracking. Implementation and use of the technology were documented.
Results
Communications, medication management, and population management solutions were implemented to support the Pharm2Pharm model. The pharmacists delivering services through this model adopted and meaningfully used this technology to support their work.
Conclusion
Implementing technology with value outside of the Pharm2Pharm model was a strategic approach to investment. This work emphasizes the importance of shifting the focus of technology from supporting a specific piece of the medication management process to supporting the goal of optimizing medication regimens. Health information exchange systems can provide important technology needed to integrate pharmacists into care teams as they are deployed to improve patient outcomes.
Collapse
|
21
|
Reis WC, Bonetti AF, Bottacin WE, Reis AS, Souza TT, Pontarolo R, Correr CJ, Fernandez-Llimos F. Impact on process results of clinical decision support systems (CDSSs) applied to medication use: overview of systematic reviews. Pharm Pract (Granada) 2017; 15:1036. [PMID: 29317919 PMCID: PMC5741996 DOI: 10.18549/pharmpract.2017.04.1036] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2017] [Accepted: 11/27/2017] [Indexed: 02/04/2023] Open
Abstract
Objective The purpose of this overview (systematic review of systematic reviews) is to evaluate the impact of clinical decision support systems (CDSS) applied to medication use in the care process. Methods A search for systematic reviews that address CDSS was performed on Medline following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) and Cochrane recommendations. Terms related to CDSS and systematic reviews were used in combination with Boolean operators and search field tags to build the electronic search strategy. There was no limitation of date or language for inclusion. We included revisions that investigated, as a main or secondary objective, changes in process outcomes. The Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) score was used to evaluate the quality of the studies. Results The search retrieved 954 articles. Five articles were added through manual search, totaling an initial sample of 959 articles. After screening and reading in full, 44 systematic reviews met the inclusion criteria. In the medication-use processes where CDSS was used, the most common stages were prescribing (n=38 (86.36%) and administering (n=12 (27.27%)). Most of the systematic reviews demonstrated improvement in the health care process (30/44 - 68.2%). The main positive results were related to improvement of the quality of prescription by the physicians (14/30 - 46.6%) and reduction of errors in prescribing (5/30 - 16.6%). However, the quality of the studies was poor, according to the score used. Conclusion CDSSs represent a promising technology to optimize the medication-use process, especially related to improvement in the quality of prescriptions and reduction of prescribing errors, although higher quality studies are needed to establish the predictors of success in these systems.
Collapse
Affiliation(s)
- Wálleri C Reis
- Department of Pharmacy, Federal University of Paraiba, João Pessoa (Brazil).
| | - Aline F Bonetti
- Postgraduate Program in Pharmaceutical Sciences, Federal University of Parana. Curitiba (Brazil).
| | - Wallace E Bottacin
- Postgraduate Program in Pharmaceutical Sciences, Federal University of Parana. Curitiba (Brazil).
| | - Alcindo S Reis
- Specialist-Postgraduate Program in Pharmaceutical Sciences, Federal University of Parana. Curitiba (Brazil).
| | - Thaís T Souza
- Postgraduate Program in Pharmaceutical Sciences, Federal University of Parana, Curitiba (Brazil).
| | - Roberto Pontarolo
- Professor, Postgraduate Program in Pharmaceutical Sciences, Department of Pharmacy, Federal University of Parana. Curitiba (Brazil).
| | - Cassyano J Correr
- PhD - Professor, Postgraduate Program in Pharmaceutical Sciences, Department of Pharmacy, Federal University of Parana. Curitiba (Brazil).
| | - Fernando Fernandez-Llimos
- Institute for Medicines Research (iMed.ULisboa), Department of Social Pharmacy, Faculty of Pharmacy, University of Lisbon. Lisbon (Portugal).
| |
Collapse
|
22
|
Jheeta S, Franklin BD. The impact of a hospital electronic prescribing and medication administration system on medication administration safety: an observational study. BMC Health Serv Res 2017; 17:547. [PMID: 28793906 PMCID: PMC5549345 DOI: 10.1186/s12913-017-2462-2] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2016] [Accepted: 07/19/2017] [Indexed: 11/18/2022] Open
Abstract
Background The aim of the study was to explore the impact of the implementation of an electronic prescribing and medication administration system (ePA) on the safety of medication administration in an inpatient hospital setting. Objectives were to compare the prevalence and types of: 1) medication administration errors, and 2) documentation discrepancies, between a paper and an ePA system. Additionally, we wanted to describe any observed changes to medication administration practices. Methods The study was based on an elderly medicine ward in an English hospital. From December 2014 to June 2015, nurses’ medication administration rounds were observed every 5 days before and after ePA implementation using an interrupted time-series approach. Medication administration error and documentation discrepancy rates pre- versus post-ePA were analysed descriptively and chi-squared tests used to test for any difference; segmented regression analysis was used to determine changes in longitudinal trend. Results Observations were made at 15 pre- and 15 post-ePA implementation time-points. Pre-ePA on paper, there were 18 medication administration errors in 428 opportunities for error (4.2%; 95% confidence interval 2.3–6.1%), and with ePA there were 18 in 528 (3.4%; 95% confidence interval 1.9–5.0%; p = 0.64). Regarding documentation, pre-ePA on paper there were 5 discrepancies in 460 observed documentations (1.1%; 95% confidence interval 0.1–2.0%); with ePA there were 18 in 557 (3.2%; 95% confidence interval 1.8–4.7%; p = 0.04). The most common electronic documentation discrepancy was documentation that a dose had been administered when it had not. Segmented regression analysis was unable to detect any significant longitudinal changes. Changes to working practices post-ePA were observed, such as nurses demonstrating less-consistent self-checking when preparing and administering medications. Conclusions Findings suggest no change in medication error rate, although ePA encourages certain types of errors and mitigates others. There was a statistically significant increase in documentation discrepancies which is likely to be due to adoption of new working practices with ePA. Electronic supplementary material The online version of this article (doi:10.1186/s12913-017-2462-2) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Seetal Jheeta
- Centre for Medication Safety and Service Quality, Imperial College Healthcare NHS Trust, London, UK.
| | - Bryony Dean Franklin
- Centre for Medication Safety and Service Quality, Imperial College Healthcare NHS Trust, London, UK.,Research Department of Practice and Policy, UCL School of Pharmacy, London, UK
| |
Collapse
|
23
|
|
24
|
Gellert GA, Catzoela L, Patel L, Bruner K, Friedman F, Ramirez R, Saucedo L, Webster SL, Gillean JA. The Impact of Order Source Misattribution on Computerized Provider Order Entry (CPOE) Performance Metrics. PERSPECTIVES IN HEALTH INFORMATION MANAGEMENT 2017; 14:1e. [PMID: 28566988 PMCID: PMC5430133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
BACKGROUND One strategy to foster adoption of computerized provider order entry (CPOE) by physicians is the monthly distribution of a list identifying the number and use rate percentage of orders entered electronically versus on paper by each physician in the facility. Physicians care about CPOE use rate reports because they support the patient safety and quality improvement objectives of CPOE implementation. Certain physician groups are also motivated because they participate in contracted financial and performance arrangements that include incentive payments or financial penalties for meeting (or failing to meet) a specified CPOE use rate target. Misattribution of order sources can hinder accurate measurement of individual physician CPOE use and can thereby undermine providers' confidence in their reported performance, as well as their motivation to utilize CPOE. Misattribution of order sources also has significant patient safety, quality, and medicolegal implications. OBJECTIVE This analysis sought to evaluate the magnitude and sources of misattribution among hospitalists with high CPOE use and, if misattribution was found, to formulate strategies to prevent and reduce its recurrence, thereby ensuring the integrity and credibility of individual and facility CPOE use rate reporting. METHODS A detailed manual order source review and validation of all orders issued by one hospitalist group at a midsize community hospital was conducted for a one-month study period. RESULTS We found that a small but not dismissible percentage of orders issued by hospitalists-up to 4.18 percent (95 percent confidence interval, 3.84-4.56 percent) per month-were attributed inaccurately. Sources of misattribution by department or function were as follows: nursing, 42 percent; pharmacy, 38 percent; laboratory, 15 percent; unit clerk, 3 percent; and radiology, 2 percent. Order management and protocol were the most common correct order sources that were incorrectly attributed. CONCLUSION Order source misattribution can negatively affect reported provider CPOE use rates and should be investigated if providers perceive discrepancies between reported rates and their actual performance. Preventive education and communication efforts across departments can help prevent and reduce misattribution.
Collapse
Affiliation(s)
- George A Gellert
- Department of Health Informatics at CHRISTUS Health in San Antonio, TX
| | | | - Lajja Patel
- MedCede Physician Services in San Antonio, TX
| | | | | | | | | | | | | |
Collapse
|
25
|
Nabovati E, Vakili-Arki H, Taherzadeh Z, Saberi MR, Medlock S, Abu-Hanna A, Eslami S. Information Technology-Based Interventions to Improve Drug-Drug Interaction Outcomes: A Systematic Review on Features and Effects. J Med Syst 2016; 41:12. [PMID: 27889873 DOI: 10.1007/s10916-016-0649-4] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2016] [Accepted: 10/24/2016] [Indexed: 11/29/2022]
Abstract
The purpose of this systematic review was to identify features and effects of information technology (IT)-based interventions on outcomes related to drug-drug interactions (DDI outcomes). A literature search was conducted in Medline, EMBASE, and the Cochrane Library for published English-language studies. Studies were included if a main outcome was related to DDIs, the intervention involved an IT-based system, and the study design was experimental or observational with controls. Study characteristics, including features and effects of IT-based interventions, were extracted. Nineteen studies comprising five randomized controlled trials (RCT), five non-randomized controlled trials (NRCT) and nine observational studies with controls (OWC) were included. Sixty-four percent of prescriber-directed interventions, and all non-prescriber interventions, were effective. Each of the following characteristics corresponded to groups of studies of which a majority were effective: automatic provision of recommendations within the providers' workflow, intervention at the time of decision-making, integration into other systems, and requiring the reason for not following the recommendations. Only two studies measured clinical outcomes: an RCT that showed no significant improvement and an OWC that showed improvement, but did not statistically assess the effect. Most studies that measured surrogate outcomes (e.g. potential DDIs) and other outcomes (e.g. adherence to alerts) showed improvements. IT-based interventions improve surrogate clinical outcomes and adherence to DDI alerts. However, there is lack of robust evidence about their effectiveness on clinical outcomes. It is recommended that researchers consider the identified features of effective interventions in the design of interventions and evaluate the effectiveness on DDI outcomes, particularly clinical outcomes.
Collapse
Affiliation(s)
- Ehsan Nabovati
- Health Information Management Research Center, Kashan University of Medical Sciences, Kashan, Iran
| | - Hasan Vakili-Arki
- Student Research Committee, Department of Medical Informatics, Faculty of Medicine, Mashhad University of Medical Sciences , Mashhad, Iran
| | - Zhila Taherzadeh
- Targeted Drug Delivery Research Center and Neurogenic Inflammation Research Center, School of Pharmacy, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Mohammad Reza Saberi
- Medical Chemistry Department, School of Pharmacy, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Stephanie Medlock
- Department of Medical Informatics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Ameen Abu-Hanna
- Department of Medical Informatics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Saeid Eslami
- Targeted Drug Delivery Research Center and Neurogenic Inflammation Research Center, School of Pharmacy, Mashhad University of Medical Sciences, Mashhad, Iran. .,Department of Medical Informatics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands. .,Department of Medical Informatics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran. .,Pharmaceutical Research Center, School of Pharmacy, Mashhad University of Medical Sciences, Mashhad, Iran.
| |
Collapse
|
26
|
Kuziemsky CE, Peyton L. A framework for understanding process interoperability and health information technology. HEALTH POLICY AND TECHNOLOGY 2016. [DOI: 10.1016/j.hlpt.2016.02.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
27
|
O'Connor PJ, Sperl-Hillen JM, Fazio CJ, Averbeck BM, Rank BH, Margolis KL. Outpatient diabetes clinical decision support: current status and future directions. Diabet Med 2016; 33:734-41. [PMID: 27194173 PMCID: PMC5642968 DOI: 10.1111/dme.13090] [Citation(s) in RCA: 42] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/03/2016] [Indexed: 12/13/2022]
Abstract
Outpatient clinical decision support systems have had an inconsistent impact on key aspects of diabetes care. A principal barrier to success has been low use rates in many settings. Here, we identify key aspects of clinical decision support system design, content and implementation that are related to sustained high use rates and positive impacts on glucose, blood pressure and lipid management. Current diabetes clinical decision support systems may be improved by prioritizing care recommendations, improving communication of treatment-relevant information to patients, using such systems for care coordination and case management and integrating patient-reported information and data from remote devices into clinical decision algorithms and interfaces.
Collapse
Affiliation(s)
- P J O'Connor
- Center for Chronic Care Innovation, Minneapolis, MN, USA
- HealthPartners Institute, Minneapolis, MN, USA
| | - J M Sperl-Hillen
- Center for Chronic Care Innovation, Minneapolis, MN, USA
- HealthPartners Institute, Minneapolis, MN, USA
| | - C J Fazio
- HealthPartners, Minneapolis, MN, USA
| | | | - B H Rank
- HealthPartners, Minneapolis, MN, USA
| | - K L Margolis
- Center for Chronic Care Innovation, Minneapolis, MN, USA
- HealthPartners Institute, Minneapolis, MN, USA
| |
Collapse
|
28
|
Jacobi J, Ray S, Danelich I, Dodds Ashley E, Eckel S, Guharoy R, Militello M, O'Donnell P, Sam T, Crist SM, Smidt D. Impact of the Pharmacy Practice Model Initiative on Clinical Pharmacy Specialist Practice. Pharmacotherapy 2016; 36:e40-9. [PMID: 27118546 DOI: 10.1002/phar.1745] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
This paper describes the goals of the American Society of Health-System Pharmacists' Pharmacy Practice Model Initiative (PPMI) and its recommendations for health-system pharmacy practice transformation to meet future patient care needs and elevate the role of pharmacists as patient care providers. PPMI envisions a future in which pharmacists have greater responsibility for medication-related outcomes and technicians assume greater responsibility for product-related activities. Although the PPMI recommendations have elevated the level of practice in many settings, they also potentially affect existing clinical pharmacists, in general, and clinical pharmacy specialists, in particular. Moreover, although more consistent patient care can be achieved with an expanded team of pharmacist providers, the role of clinical pharmacy specialists must not be diminished, especially in the care of complex patients and populations. Specialist practitioners with advanced training and credentials must be available to model and train pharmacists in generalist positions, residents, and students. Indeed, specialist practitioners are often the innovators and practice leaders. Negotiation between hospitals and pharmacy schools is needed to ensure a continuing role for academic clinical pharmacists and their contributions as educators and researchers. Lessons can be applied from disciplines such as nursing and medicine, which have developed new models of care involving effective collaboration between generalists and specialists. Several different pharmacy practice models have been described to meet the PPMI goals, based on available personnel and local goals. Studies measuring the impact of these new practice models are needed.
Collapse
Affiliation(s)
- Judith Jacobi
- Department of Pharmacy, IU Health Methodist Hospital, Indianapolis, Indiana
| | - Shaunta' Ray
- Department of Clinical Pharmacy, University of Tennessee College of Pharmacy, Knoxville, Tennessee
| | | | - Elizabeth Dodds Ashley
- Div. of Infectious Diseases, Department of Medicine, Duke University Medical Center, Durham, North Carolina
| | - Stephen Eckel
- Department of Pharmacy, University of North Carolina Hospitals, Chapel Hill, North Carolina
| | - Roy Guharoy
- Ascension Health and University of Massachusetts Medical School, Worcester, Massachusetts
| | | | - Paul O'Donnell
- Department of Pharmacy Practice, Midwestern University, Downers Grove, Illinois
| | - Teena Sam
- Department of Pharmacy, Baylor University Medical Center, Sunnyvale, Texas
| | | | - Danielle Smidt
- University of California, Davis Medical Center, Sacramento, California
| |
Collapse
|
29
|
Corbel A, Baud D, Chaouch A, Beney J, Csajka C, Panchaud A. Utility of an Algorithm to Increase the Accuracy of Medication History in an Obstetrical Setting. PLoS One 2016; 11:e0151205. [PMID: 26999743 PMCID: PMC4801413 DOI: 10.1371/journal.pone.0151205] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2015] [Accepted: 02/23/2016] [Indexed: 11/24/2022] Open
Abstract
Background In an obstetrical setting, inaccurate medication histories at hospital admission may result in failure to identify potentially harmful treatments for patients and/or their fetus(es). Methods This prospective study was conducted to assess average concordance rates between (1) a medication list obtained with a one-page structured medication history algorithm developed for the obstetrical setting and (2) the medication list reported in medical records and obtained by open-ended questions based on standard procedures. Both lists were converted into concordance rate using a best possible medication history approach as the reference (information obtained by patients, prescribers and community pharmacists’ interviews). Results The algorithm-based method obtained a higher average concordance rate than the standard method, with respectively 90.2% [CI95% 85.8–94.3] versus 24.6% [CI95%15.3–34.4] concordance rates (p<0.01). Conclusion Our algorithm-based method strongly enhanced the accuracy of the medication history in our obstetric population, without using substantial resources. Its implementation is an effective first step to the medication reconciliation process, which has been recognized as a very important component of patients’ drug safety.
Collapse
Affiliation(s)
- Aline Corbel
- School of Pharmaceutical Sciences, University of Geneva and University of Lausanne, Geneva, Switzerland
| | - David Baud
- Department of Gynecology and Obstetrics, University Hospital of Lausanne, Lausanne, Switzerland
| | - Aziz Chaouch
- Institute of Social and Preventive Medicine, University Hospital of Lausanne, Lausanne, Switzerland
| | - Johnny Beney
- Division of Pharmacy, Central Institute of the Valais Hospitals, Sion, Switzerland
| | - Chantal Csajka
- School of Pharmaceutical Sciences, University of Geneva and University of Lausanne, Geneva, Switzerland
- Division of Clinical Pharmacology, University Hospital of Lausanne, Lausanne, Switzerland
| | - Alice Panchaud
- School of Pharmaceutical Sciences, University of Geneva and University of Lausanne, Geneva, Switzerland
- Division of Clinical Pharmacology, University Hospital of Lausanne, Lausanne, Switzerland
- * E-mail:
| |
Collapse
|
30
|
Gellert GA, Hill V, Bruner K, Maciaz G, Saucedo L, Catzoela L, Ramirez R, Jacobs WJ, Nguyen P, Patel L, Webster SL. Successful Implementation of Clinical Information Technology: Seven Key Lessons from CPOE. Appl Clin Inform 2015; 6:698-715. [PMID: 26767065 DOI: 10.4338/aci-2015-06-soa-0067] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2015] [Accepted: 10/08/2015] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVES To identify and describe the most critical strategic and operational contributors to the successful implementation of clinical information technologies, as deployed within a moderate sized system of U.S. community hospitals. BACKGROUND AND SETTING CHRISTUS Health is a multi-state system comprised of more than 350 services and 60 hospitals with over 9 000 physicians. The Santa Rosa region of CHRISTUS Health, located in greater San Antonio, Texas is comprised of three adult community hospital facilities and one Children's hospital each with bed capacities of 142-180. Computerized Patient Order Entry (CPOE) was first implemented in 2012 within a complex market environment. The Santa Rosa region has 2 417 credentialed physicians and 263 mid-level allied health professionals. METHODS This report focuses on the seven most valuable strategies deployed by the Health Informatics team in a large four hospital CHRISTUS region to achieve strong CPOE adoption and critical success lessons learned. The findings are placed within the context of the literature describing best practices in health information technology implementation. RESULTS While the elements described involved discrete de novo process generation to support implementation and operations, collectively they represent the creation of a new customer-centric service culture in our Health Informatics team, which has served as a foundation for ensuring strong clinical information technology adoption beyond CPOE. CONCLUSION The seven success factors described are not limited in their value to and impact on CPOE adoption, but generalize to - and can advance success in - varied other clinical information technology implementations across diverse hospitals. A number of these factors are supported by reports in the literature of other institutions' successful implementations of CPOE and other clinical information technologies, and while not prescriptive to other settings, may be adapted to yield value elsewhere.
Collapse
Affiliation(s)
- G A Gellert
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - V Hill
- Baylor College of Medicine, Pediatrics , San Antonio, TX, United States
| | - K Bruner
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - G Maciaz
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - L Saucedo
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - L Catzoela
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - R Ramirez
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - W J Jacobs
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| | - P Nguyen
- CHRISTUS Santa Rosa Westover Hills Hospital , San Antonio, TX, United States
| | - L Patel
- CHRISTUS Santa Rosa Medical Center , San Antonio, TX, United States
| | - S L Webster
- CHRISTUS Health, Health Informatics , San Antonio, TX, United States
| |
Collapse
|
31
|
Bekhuis T, Tseytlin E, Mitchell KJ. A Prototype for a Hybrid System to Support Systematic Review Teams: A Case Study of Organ Transplantation. PROCEEDINGS. IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE 2015; 2015:940-947. [PMID: 26855824 PMCID: PMC4742277 DOI: 10.1109/bibm.2015.7359810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
We describe a prototype for a hybrid system designed to reduce the number of citations needed to re-screen (NNRS) by systematic reviewers, where citations include titles, abstracts, and metadata. The system obviates the need for screening the entire set of citations a second time, which is typically done to control human error. The reference set is based on a complex review about organ transplantation (N=10,796 citations). Data were split into 50% training and test sets, randomly stratified for percentage eligible citations. The system consists of a rule-based module and a machine-learning (ML) module. The former substantially reduces the number of negative citations passed to the ML module and improves imbalance. Relative to the baseline, the system reduces classification error (5.6% vs 2.9%) thereby reducing NNRS by 47.3% (300 vs 158). We discuss the implications of de-emphasizing sensitivity (recall) in favor of specificity and negative predictive value to reduce screening burden.
Collapse
Affiliation(s)
- Tanja Bekhuis
- Department of Biomedical Informatics, School of Medicine, University
of Pittsburgh, USA
- Department of Dental Public Health, School of Dental Medicine,
University of Pittsburgh, USA
| | - Eugene Tseytlin
- Department of Biomedical Informatics, School of Medicine, University
of Pittsburgh, USA
| | - Kevin J. Mitchell
- Department of Biomedical Informatics, School of Medicine, University
of Pittsburgh, USA
| |
Collapse
|
32
|
Jordan S, Gabe-Walters ME, Watkins A, Humphreys I, Newson L, Snelgrove S, Dennis MS. Nurse-Led Medicines' Monitoring for Patients with Dementia in Care Homes: A Pragmatic Cohort Stepped Wedge Cluster Randomised Trial. PLoS One 2015; 10:e0140203. [PMID: 26461064 PMCID: PMC4603896 DOI: 10.1371/journal.pone.0140203] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2015] [Accepted: 09/21/2015] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND People with dementia are susceptible to adverse drug reactions (ADRs). However, they are not always closely monitored for potential problems relating to their medicines: structured nurse-led ADR Profiles have the potential to address this care gap. We aimed to assess the number and nature of clinical problems identified and addressed and changes in prescribing following introduction of nurse-led medicines' monitoring. DESIGN Pragmatic cohort stepped-wedge cluster Randomised Controlled Trial (RCT) of structured nurse-led medicines' monitoring versus usual care. SETTING Five UK private sector care homes. PARTICIPANTS 41 service users, taking at least one antipsychotic, antidepressant or anti-epileptic medicine. INTERVENTION Nurses completed the West Wales ADR (WWADR) Profile for Mental Health Medicines with each participant according to trial step. OUTCOMES Problems addressed and changes in medicines prescribed. DATA COLLECTION AND ANALYSIS Information was collected from participants' notes before randomisation and after each of five monthly trial steps. The impact of the Profile on problems found, actions taken and reduction in mental health medicines was explored in multivariate analyses, accounting for data collection step and site. RESULTS Five of 10 sites and 43 of 49 service users approached participated. Profile administration increased the number of problems addressed from a mean of 6.02 [SD 2.92] to 9.86 [4.48], effect size 3.84, 95% CI 2.57-4.11, P <0.001. For example, pain was more likely to be treated (adjusted Odds Ratio [aOR] 3.84, 1.78-8.30), and more patients attended dentists and opticians (aOR 52.76 [11.80-235.90] and 5.12 [1.45-18.03] respectively). Profile use was associated with reduction in mental health medicines (aOR 4.45, 1.15-17.22). CONCLUSION The WWADR Profile for Mental Health Medicines can improve the quality and safety of care, and warrants further investigation as a strategy to mitigate the known adverse effects of prescribed medicines. TRIAL REGISTRATION ISRCTN 48133332.
Collapse
Affiliation(s)
- Susan Jordan
- College of Human and Health Sciences, Swansea University, Swansea, Wales
| | | | - Alan Watkins
- College of Medicine, Swansea University, Swansea, Wales
| | - Ioan Humphreys
- College of Human and Health Sciences, Swansea University, Swansea, Wales
| | - Louise Newson
- College of Human and Health Sciences, Swansea University, Swansea, Wales
| | - Sherrill Snelgrove
- College of Human and Health Sciences, Swansea University, Swansea, Wales
| | | |
Collapse
|
33
|
Integrating computerized clinical decision support systems into clinical work: A meta-synthesis of qualitative research. Int J Med Inform 2015; 84:1009-18. [PMID: 26391601 DOI: 10.1016/j.ijmedinf.2015.09.005] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2015] [Revised: 09/04/2015] [Accepted: 09/11/2015] [Indexed: 11/23/2022]
Abstract
PURPOSE Computerized clinical decision support systems (CDSS) are an emerging means for improving healthcare safety, quality and efficiency, but meta-analyses findings are mixed. This meta-synthesis aggregates qualitative research findings as possible explanations for variable quantitative research outcomes. INCLUSION CRITERIA Qualitative studies published between 2000 and 2013 in English, involving physicians, registered and advanced practice nurses' experience of CDSS use in clinical practice were included. SEARCH STRATEGY PubMed and CINAHL databases were searched. Study titles and abstracts were screened against inclusion criteria. Retained studies were appraised against quality criteria. Findings were extracted iteratively from studies in the 4th quartile of quality scores. Two reviewers constructed themes inductively. A third reviewer applied the defined themes deductively achieving 92% agreement. RESULTS 3798 unique records were returned; 56 met inclusion criteria and were reviewed against quality criteria. 9 studies were of sufficiently high quality for synthetic analysis. Five major themes (clinician-patient-system integration; user interface usability; the need for better 'algorithms'; system maturity; patient safety) were defined. CONCLUSIONS Despite ongoing development, CDSS remains an emerging technology. Lack of understanding about and lack of consideration for the interaction between human decision makers and CDSS is a major reason for poor system adoption and use. Further high-quality qualitative research is needed to better understand human-system interaction issues. These issues may continue to confound quantitative study results if not addressed.
Collapse
|
34
|
Kuziemsky CE. Review of Social and Organizational Issues in Health Information Technology. Healthc Inform Res 2015; 21:152-60. [PMID: 26279951 PMCID: PMC4532839 DOI: 10.4258/hir.2015.21.3.152] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2015] [Revised: 06/28/2015] [Accepted: 06/29/2015] [Indexed: 01/10/2023] Open
Abstract
Objectives This paper reviews organizational and social issues (OSIs) in health information technology (HIT). Methods A review and synthesis of the literature on OSIs in HIT was conducted. Results Five overarching themes with respect to OSIs in HIT were identified and discussed: scope and frameworks for defining OSIs in HIT, context matters, process immaturity and complexity, trade-offs will happen and need to be discussed openly, and means of studying OSIs in HIT. Conclusions There is a wide body of literature that provides insight into OSIs in HIT, even if many of the studies are not explicitly labelled as such. The two biggest research needs are more explicit and theoretical studies of OSI in HITs and more research on integrating micro and macro perspectives of HIT use in organizations.
Collapse
|
35
|
Spaulding TJ, Raghu TS. Impact of CPOE usage on medication management process costs and quality outcomes. INQUIRY: The Journal of Health Care Organization, Provision, and Financing 2015; 50:229-47. [PMID: 25117087 DOI: 10.1177/0046958013519303] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
We assess the impact of computerized physician order entry (CPOE) systems usage on cost and process quality in the medication management process. Data are compiled from 1,014 U.S. acute-care hospitals that have already implemented CPOE. Data sources include the American Hospital Association, HIMSS Analytics, and the Centers for Medicare and Medicaid Services. We examine the association of CPOE usage with nursing and pharmacy salary costs, and evidence-based medication process compliance. Empirical findings controlling for endogeneity in usage show that benefits accrue even when 100 percent usage is not achieved. We demonstrate that the relationship of CPOE usage with cost and compliance is non-linear.
Collapse
Affiliation(s)
| | - T S Raghu
- Arizona State University, Tempe, AZ, USA
| |
Collapse
|
36
|
Hammar T, Lidström B, Petersson G, Gustafson Y, Eiermann B. Potential drug-related problems detected by electronic expert support system: physicians' views on clinical relevance. Int J Clin Pharm 2015; 37:941-8. [PMID: 26047943 DOI: 10.1007/s11096-015-0146-8] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2015] [Accepted: 05/27/2015] [Indexed: 01/01/2023]
Abstract
BACKGROUND Drug-related problems cause suffering for patients and substantial costs. Multi-dose drug dispensing is a service in which patients receive their medication packed in bags with one unit for each dose occasion. The electronic expert support system (EES) is a clinical decision support system that provides alerts if potential drug-related problems are detected among a patients' current prescriptions, including drug-drug interactions, therapy duplications, high doses, drug-disease interactions, drug gender warnings, and inappropriate drugs and doses for geriatric or pediatric patients. OBJECTIVE The aim of the study was to explore physicians' views on the clinical relevance of alerts provided by EES. Furthermore we investigated if physicians performed any changes in drug treatment following the alerts and if there were any differences in perceived relevance and performed changes between different types of alerts and drugs. SETTING Two geriatric clinics and three primary care units in Sweden. METHOD Prescribed medications for patients (n = 254) with multi-dose drug dispensing were analyzed for potential drug-related problems using EES. For each alert, a physician assessed clinical relevance and indicated any intended action. A total of 15 physicians took part in the study. Changes in drug treatment following the alerts were later measured. The relationship between variables was analyzed using Chi square test. MAIN OUTCOME MEASURE Physicians' perceived clinical relevance of each alert, and changes in drug treatment following the alerts. RESULTS Physicians perceived 68% (502/740) of EES alerts as clinically relevant and 11% of all alerts were followed by a change in drug treatment. Clinical relevance and likelihood to make changes in drug treatment was related to the alert category and substances involved in the alert. CONCLUSION In most patients with multi-dose drug dispensing, EES detected potential drug-related problems, with the majority of the alerts regarded as clinically relevant and some followed by measurable changes in drug treatment.
Collapse
Affiliation(s)
- Tora Hammar
- Department of Medicine and Optometry, eHealth Institute, Linnaeus University, 391 82, Kalmar, Sweden.
| | | | - Göran Petersson
- Department of Medicine and Optometry, eHealth Institute, Linnaeus University, 391 82, Kalmar, Sweden
| | - Yngve Gustafson
- Division of Geriatric Medicine, Department of Community Medicine and Rehabilitation, Umeå University, Umeå, Sweden
| | - Birgit Eiermann
- Swedish eHealth Agency, Stockholm, Sweden.,Division of Clinical Pharmacology, Department of Laboratory Medicine, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
37
|
Schiff GD, Amato MG, Eguale T, Boehne JJ, Wright A, Koppel R, Rashidee AH, Elson RB, Whitney DL, Thach TT, Bates DW, Seger AC. Computerised physician order entry-related medication errors: analysis of reported errors and vulnerability testing of current systems. BMJ Qual Saf 2015; 24:264-71. [PMID: 25595599 PMCID: PMC4392214 DOI: 10.1136/bmjqs-2014-003555] [Citation(s) in RCA: 91] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
IMPORTANCE Medication computerised provider order entry (CPOE) has been shown to decrease errors and is being widely adopted. However, CPOE also has potential for introducing or contributing to errors. OBJECTIVES The objectives of this study are to (a) analyse medication error reports where CPOE was reported as a 'contributing cause' and (b) develop 'use cases' based on these reports to test vulnerability of current CPOE systems to these errors. METHODS A review of medication errors reported to United States Pharmacopeia MEDMARX reporting system was made, and a taxonomy was developed for CPOE-related errors. For each error we evaluated what went wrong and why and identified potential prevention strategies and recurring error scenarios. These scenarios were then used to test vulnerability of leading CPOE systems, asking typical users to enter these erroneous orders to assess the degree to which these problematic orders could be entered. RESULTS Between 2003 and 2010, 1.04 million medication errors were reported to MEDMARX, of which 63 040 were reported as CPOE related. A review of 10 060 CPOE-related cases was used to derive 101 codes describing what went wrong, 67 codes describing reasons why errors occurred, 73 codes describing potential prevention strategies and 21 codes describing recurring error scenarios. Ability to enter these erroneous order scenarios was tested on 13 CPOE systems at 16 sites. Overall, 298 (79.5%) of the erroneous orders were able to be entered including 100 (28.0%) being 'easily' placed, another 101 (28.3%) with only minor workarounds and no warnings. CONCLUSIONS AND RELEVANCE Medication error reports provide valuable information for understanding CPOE-related errors. Reports were useful for developing taxonomy and identifying recurring errors to which current CPOE systems are vulnerable. Enhanced monitoring, reporting and testing of CPOE systems are important to improve CPOE safety.
Collapse
Affiliation(s)
- G D Schiff
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA Harvard School of Medicine, Boston, Massachusetts, USA
| | - M G Amato
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA MCPHS University, Boston, Massachusetts, USA
| | - T Eguale
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA Harvard School of Medicine, Boston, Massachusetts, USA McGill University, Montreal, Quebec, Canada
| | - J J Boehne
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA
| | - A Wright
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA Harvard School of Medicine, Boston, Massachusetts, USA
| | - R Koppel
- University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | | | - R B Elson
- MetroHealth Center for HealthCare Research and Policy, Cleveland, Ohio, USA
| | - D L Whitney
- Baylor College of Medicine, Houston, Texas, USA
| | - T-T Thach
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA
| | - D W Bates
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA Harvard School of Medicine, Boston, Massachusetts, USA Harvard School of Public Health, Boston, Massachusetts, USA
| | - A C Seger
- Brigham and Women's Hospital Division of General Medicine and Primary Care, Boston, Massachusetts, USA MCPHS University, Boston, Massachusetts, USA
| |
Collapse
|
38
|
Rangachari P. Using social knowledge networking technology to enable meaningful use of electronic health record technology in hospitals and health systems. JOURNAL OF HOSPITAL ADMINISTRATION 2014; 3:66-78. [PMID: 29201263 PMCID: PMC5706772 DOI: 10.5430/jha.v3n6p66] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Despite the federal policy momentum towards "meaningful use" of Electronic Health Records, the healthcare organizational literature remains replete with reports of unintended adverse consequences of implementing Electronic Health Records, including: increased work for clinicians, unfavorable workflow changes, and unexpected changes in communication patterns & practices. In addition to being costly and unsafe, these unintended adverse consequences may pose a formidable barrier to "meaningful use" of Electronic Health Records. Correspondingly, it is essential for hospital administrators to understand and detect the causes of unintended adverse consequences, to ensure successful implementation of Electronic Health Records. The longstanding Technology-in-Practice framework emphasizes the role of human agency in enacting structures of technology use or "technologies-in-practice." Given a set of unintended adverse consequences from health information technology implementation, this framework could help trace them back to specific actions (types of technology-in-practice) and institutional conditions (social structures). On the other hand, the more recent Knowledge-in-Practice framework helps understand how information and communication technologies (e.g., social knowledge networking systems) could be implemented alongside existing technology systems, to create new social structures, generate new knowledge-in-practice, and transform technology-in-practice. Therefore, integrating the two literature streams could serve the dual purpose of understanding and overcoming unintended adverse consequences of Electronic Health Record implementation. This paper seeks to: (1) review the theoretical literatures on technology use & implementation, and identify a framework for understanding & overcoming unintended adverse consequences of implementing Electronic Health Records; (2) outline a broad project proposal to test the applicability of the framework in enabling "meaningful use" of Electronic Health Records in a healthcare context; and (3) identify strategies for successful implementation of Electronic Health Records in hospitals & health systems, based on the literature review and application.
Collapse
Affiliation(s)
- Pavani Rangachari
- Department of Health Management & Informatics, Georgia Regents University, Augusta, United States
| |
Collapse
|
39
|
Tariq A, Lehnbom E, Oliver K, Georgiou A, Rowe C, Osmond T, Westbrook J. Design challenges for electronic medication administration record systems in residential aged care facilities: a formative evaluation. Appl Clin Inform 2014; 5:971-87. [PMID: 25589911 DOI: 10.4338/aci-2014-08-ra-0062] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2014] [Accepted: 11/24/2014] [Indexed: 11/23/2022] Open
Abstract
INTRODUCTION Electronic medication administration record (eMAR) systems are promoted as a potential intervention to enhance medication safety in residential aged care facilities (RACFs). The purpose of this study was to conduct an in-practice evaluation of an eMAR being piloted in one Australian RACF before its roll out, and to provide recommendations for system improvements. METHODS A multidisciplinary team conducted direct observations of workflow (n=34 hours) in the RACF site and the community pharmacy. Semi-structured interviews (n=5) with RACF staff and the community pharmacist were conducted to investigate their views of the eMAR system. Data were analysed using a grounded theory approach to identify challenges associated with the design of the eMAR system. RESULTS The current eMAR system does not offer an end-to-end solution for medication management. Many steps, including prescribing by doctors and communication with the community pharmacist, are still performed manually using paper charts and fax machines. Five major challenges associated with the design of eMAR system were identified: limited interactivity; inadequate flexibility; problems related to information layout and semantics; the lack of relevant decision support; and system maintenance issues. We suggest recommendations to improve the design of the eMAR system and to optimize existing workflows. DISCUSSION Immediate value can be achieved by improving the system interactivity, reducing inconsistencies in data entry design and offering dedicated organisational support to minimise connectivity issues. Longer-term benefits can be achieved by adding decision support features and establishing system interoperability requirements with stakeholder groups (e.g. community pharmacies) prior to system roll out. In-practice evaluations of technologies like eMAR system have great value in identifying design weaknesses which inhibit optimal system use.
Collapse
Affiliation(s)
- A Tariq
- Centre of Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University , New South Wales, Australia
| | - E Lehnbom
- Centre of Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University , New South Wales, Australia
| | - K Oliver
- Centre of Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University , New South Wales, Australia
| | - A Georgiou
- Centre of Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University , New South Wales, Australia
| | - C Rowe
- UnitingCare Ageing , Sydney, New South Wales, Australia
| | - T Osmond
- UnitingCare Ageing , Sydney, New South Wales, Australia
| | - J Westbrook
- Centre of Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University , New South Wales, Australia
| |
Collapse
|
40
|
Implementation of a shared medication list: physicians' views on availability, accuracy and confidentiality. Int J Clin Pharm 2014; 36:933-42. [PMID: 25193264 DOI: 10.1007/s11096-014-0012-0] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2014] [Accepted: 08/21/2014] [Indexed: 10/24/2022]
Abstract
BACKGROUND Physicians, patients and others involved need to have accurate information on patients' current drug prescriptions available, and have that information protected from unauthorized access. During the past decade, many counties in Sweden have implemented regionally shared medication lists within health care. OBJECTIVE The aim of this study was to describe physicians' views on changes in accuracy, availability and confidentiality in the transition from local medication lists to a regionally shared medication list. SETTING Health care units in four different counties of Sweden after the transition from local medication lists to a regionally shared medication list. The shared medication list was an integrated part of the electronic health record system in the respective counties, but the system and implementation process varied. METHODS Physicians (n = 7) with experience of transition from local medication lists to a regionally shared medication list were interviewed in a semi-structured manner. MAIN OUTCOME MEASURE Physicians' views on changes in information risks, focusing on accuracy, availability and confidentiality. Results The transition from local medication lists to a shared medication list increased the availability of information: from being time consuming or not possible to access from other care givers to most information being available in one place. A regionally shared medication list was perceived as having the potential to provide a greater accuracy of information, but not always: the shared medication list was perceived as more complete but with more non-current drugs. On the other hand, a shared medication list implied an increased risk of violating patient privacy, placing greater demands on IT security in order to protect the confidentiality of information. CONCLUSION Physicians perceived a regionally shared medication list to increase the availability of information about current prescriptions and potentially the accuracy but may decrease the confidentiality of information. To implement a shared medication list, we recommend providing clear description of responsibilities and routines for normal activities as well as back-up routines, consider IT-security and data protection early, involve patients to improve the accuracy of the list as well as to monitor and evaluate the implementation.
Collapse
|
41
|
Kato-Lin YC, Krishnamurti L, Padman R, Seltman HJ. Does e-pain plan improve management of sickle cell disease associated vaso-occlusive pain crisis? a mixed methods evaluation. Int J Med Inform 2014; 83:814-24. [PMID: 25179666 DOI: 10.1016/j.ijmedinf.2014.08.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2014] [Revised: 08/01/2014] [Accepted: 08/11/2014] [Indexed: 11/26/2022]
Abstract
PURPOSE There is limited application and evaluation of health information systems in the management of vaso-occlusive pain crises in sickle cell disease (SCD) patients. This study evaluates the impact of digitization of paper-based individualized pain plans on process efficiency and care quality by examining both objective patient data and subjective clinician insights. METHODS Retrospective, before and after, mixed methods evaluation of digitization of paper documents in Children's Hospital of Pittsburgh of UPMC. Subjective perceptions are analyzed using surveys completed by 115 clinicians in emergency department (ED) and inpatient units (IP). Objective effects are evaluated using mixed models with data on 1089 ED visits collected via electronic chart review 28 months before and 22 months after the digitization. RESULTS Surveys indicate that all clinicians perceived the digitization to improve the efficiency and quality of pain management. Physicians overwhelmingly preferred using the digitized plans, but only 44% of the nurses had the same response. Analysis of patient records indicates that adjusted time from analgesic order to administration was significantly reduced from 35.50 to 26.77 min (p<.05). However, time to first dose and some of the objective quality measures (time from administration to relief, relief rate, admission rate, and ED re-visit rate) were not significantly affected. DISCUSSION The relatively simple intervention, high baseline performance, and limited accommodation of nurses' perspectives may account for the marginal improvements in process efficiency and quality outcomes. Additional efforts, particularly improved communication between physicians and nurses, are needed to further enhance quality of pain management. CONCLUSION This study highlights the important role of health information technology (HIT) on vaso-occlusive pain management for pediatric patients with sickle cell disease and the critical challenges in accommodating human factor considerations in implementing and evaluating HIT effects.
Collapse
Affiliation(s)
- Yi-Chin Kato-Lin
- The H. John Heinz III College, Carnegie Mellon University, Pittsburgh, PA, USA.
| | - Lakshmanan Krishnamurti
- Aflac Center for Cancer and Blood Disorders, Children's Healthcare of Atlanta, Atlanta, GA, USA
| | - Rema Padman
- The H. John Heinz III College, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Howard J Seltman
- Department of Statistics, Carnegie Mellon University, Pittsburgh, PA, USA
| |
Collapse
|
42
|
Implementation of information systems at pharmacies - a case study from the re-regulated pharmacy market in Sweden. Res Social Adm Pharm 2014; 11:e85-99. [PMID: 25205612 DOI: 10.1016/j.sapharm.2014.08.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2014] [Revised: 08/04/2014] [Accepted: 08/04/2014] [Indexed: 11/23/2022]
Abstract
BACKGROUND When the Swedish pharmacy market was re-regulated in 2009, Sweden moved from one state-owned pharmacy chain to several private pharmacy companies, and four new dispensing systems emerged to replace the one system that had previously been used at all Swedish pharmacies for more than 20 years. OBJECTIVES The aim of this case study was to explore the implementation of the new information systems for dispensing at pharmacies. METHODS The vendors of the four dispensing systems in Sweden were interviewed, and a questionnaire was sent to the managers of the pharmacy companies. In addition, a questionnaire was sent to 350 pharmacists who used the systems for dispensing prescriptions. RESULTS The implementation of four new dispensing systems followed a strict time frame set by political decisions, involved actors completely new to the market, lacked clear regulation and standards for functionality and quality assurance, was complex and resulted in variations in quality. More than half of the pharmacists (58%) perceived their current dispensing system as supporting safe dispensing of medications, 26% were neutral and 15% did not perceive it to support a safe dispensing. Most pharmacists (80%) had experienced problems with their dispensing system during the previous month. The pharmacists experienced problems included reliability issues, usability issues, and missing functionality. CONCLUSION In this case study exploring the implementation of new information systems for dispensing prescriptions at pharmacies in Sweden, weaknesses related to reliability, functionality and usability were identified and could affect patient safety. The weaknesses of the systems seem to result from the limited time for the development and implementation, the lack of comprehensive and evidence-based requirements for dispensing systems, and the unclear distribution of quality assurance responsibilities among involved stakeholders.
Collapse
|
43
|
Computer-based diagnostic expert systems in rheumatology: where do we stand in 2014? Int J Rheumatol 2014; 2014:672714. [PMID: 25114683 PMCID: PMC4119620 DOI: 10.1155/2014/672714] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2014] [Accepted: 06/20/2014] [Indexed: 01/04/2023] Open
Abstract
Background. The early detection of rheumatic diseases and the treatment to target have become of utmost importance to control the disease and improve its prognosis. However, establishing a diagnosis in early stages is challenging as many diseases initially present with similar symptoms and signs. Expert systems are computer programs designed to support the human decision making and have been developed in almost every field of medicine. Methods. This review focuses on the developments in the field of rheumatology to give a comprehensive insight. Medline, Embase, and Cochrane Library were searched. Results. Reports of 25 expert systems with different design and field of application were found. The performance of 19 of the identified expert systems was evaluated. The proportion of correctly diagnosed cases was between 43.1 and 99.9%. Sensitivity and specificity ranged from 62 to 100 and 88 to 98%, respectively. Conclusions. Promising diagnostic expert systems with moderate to excellent performance were identified. The validation process was in general underappreciated. None of the systems, however, seemed to have succeeded in daily practice. This review identifies optimal characteristics to increase the survival rate of expert systems and may serve as valuable information for future developments in the field.
Collapse
|
44
|
Tora H, Bo H, Bodil L, Göran P, Birgit E. Potential drug related problems detected by electronic expert support system in patients with multi-dose drug dispensing. Int J Clin Pharm 2014; 36:943-52. [PMID: 24974220 DOI: 10.1007/s11096-014-9976-z] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2014] [Accepted: 06/19/2014] [Indexed: 10/25/2022]
Abstract
Background Drug related problems (DRPs) are frequent and cause suffering for patients and substantial costs for society. Multi-dose drug dispensing (MDDD) is a service by which patients receive their medication packed in bags with one unit for each dose occasion. The clinical decision support system (CDSS) electronic expert support (EES) analyses patients' prescriptions in the Swedish national e-prescription repository and provides alerts if potential DRPs are detected, i.e. drug-drug interactions, duplicate therapy, drug-disease contraindications, high dose, gender warnings, geriatric, and paediatric alerts. Objective To analyse potential DRPs in patients with MDDD, detected by means of EES. Setting A register study of all electronically stored prescriptions for patients with MDDD in Sweden (n = 180,059) March 5-June 5, 2013. Method Drug use and potential DRPs detected in the study population during the 3 month study period by EES were analysed. The potential DRPs were analysed in relation to patients' age, gender, number of drugs, and type of medication. Main outcome measure Prevalence of potential DRPs measured as EES alerts. Results The study population was on average 75.8 years of age (± 17.5, range 1-110) and had 10.0 different medications (± 4.7, range 1-53). EES alerted for potential DRPs in 76 % of the population with a mean of 2.2 alerts per patient (± 2.4, range 0-27). The older patients received a lower number of alerts compared to younger patients despite having a higher number of drugs. The most frequent alert categories were drug-drug interactions (37 % of all alerts), duplicate therapy (30 %), and geriatric warnings for high dose or inappropriate drugs (23 %). Psycholeptics, psychoanaleptics, antithrombotic agents, anti-epileptics, renin-angiotensin system agents, and analgesics represented 71 % of all drugs involved in alerts. Conclusions EES detected potential DRPs in the majority of patients with MDDD. The number of potential DRPs was associated with the number of drugs, age, gender, and type of medication. A CDSS such as EES might be a useful tool for physicians and pharmacists to assist in the important task of monitoring patients with MDDD for potential DRPs.
Collapse
Affiliation(s)
- Hammar Tora
- Department of Medicine and Optometry, eHealth Institute, Linnaeus University, 391 82, Kalmar, Sweden,
| | | | | | | | | |
Collapse
|
45
|
Nuckols TK, Smith-Spangler C, Morton SC, Asch SM, Patel VM, Anderson LJ, Deichsel EL, Shekelle PG. The effectiveness of computerized order entry at reducing preventable adverse drug events and medication errors in hospital settings: a systematic review and meta-analysis. Syst Rev 2014; 3:56. [PMID: 24894078 PMCID: PMC4096499 DOI: 10.1186/2046-4053-3-56] [Citation(s) in RCA: 194] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2013] [Accepted: 04/29/2014] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND The Health Information Technology for Economic and Clinical Health (HITECH) Act subsidizes implementation by hospitals of electronic health records with computerized provider order entry (CPOE), which may reduce patient injuries caused by medication errors (preventable adverse drug events, pADEs). Effects on pADEs have not been rigorously quantified, and effects on medication errors have been variable. The objectives of this analysis were to assess the effectiveness of CPOE at reducing pADEs in hospital-related settings, and examine reasons for heterogeneous effects on medication errors. METHODS Articles were identified using MEDLINE, Cochrane Library, Econlit, web-based databases, and bibliographies of previous systematic reviews (September 2013). Eligible studies compared CPOE with paper-order entry in acute care hospitals, and examined diverse pADEs or medication errors. Studies on children or with limited event-detection methods were excluded. Two investigators extracted data on events and factors potentially associated with effectiveness. We used random effects models to pool data. RESULTS Sixteen studies addressing medication errors met pooling criteria; six also addressed pADEs. Thirteen studies used pre-post designs. Compared with paper-order entry, CPOE was associated with half as many pADEs (pooled risk ratio (RR) = 0.47, 95% CI 0.31 to 0.71) and medication errors (RR = 0.46, 95% CI 0.35 to 0.60). Regarding reasons for heterogeneous effects on medication errors, five intervention factors and two contextual factors were sufficiently reported to support subgroup analyses or meta-regression. Differences between commercial versus homegrown systems, presence and sophistication of clinical decision support, hospital-wide versus limited implementation, and US versus non-US studies were not significant, nor was timing of publication. Higher baseline rates of medication errors predicted greater reductions (P < 0.001). Other context and implementation variables were seldom reported. CONCLUSIONS In hospital-related settings, implementing CPOE is associated with a greater than 50% decline in pADEs, although the studies used weak designs. Decreases in medication errors are similar and robust to variations in important aspects of intervention design and context. This suggests that CPOE implementation, as subsidized under the HITECH Act, may benefit public health. More detailed reporting of the context and process of implementation could shed light on factors associated with greater effectiveness.
Collapse
Affiliation(s)
- Teryl K Nuckols
- Division of General Internal Medicine and Health Services Research, David Geffen School of Medicine at the University of California, 911 Broxton Ave, Los Angeles, CA 90024, USA
- RAND Corporation, 1776 Main Street, Santa Monica, CA 90407, USA
| | - Crystal Smith-Spangler
- VA Palo Alto Health Care System, 795 Willow Road, Menlo Park, CA 94025, USA
- Stanford University, Palo Alto, CA 94305, USA
| | - Sally C Morton
- Department of Biostatistics, University of Pittsburgh, Graduate School of Public Health, Pittsburgh, PA 15261, USA
| | - Steven M Asch
- RAND Corporation, 1776 Main Street, Santa Monica, CA 90407, USA
- VA Palo Alto Health Care System, 795 Willow Road, Menlo Park, CA 94025, USA
- Stanford University, Palo Alto, CA 94305, USA
| | - Vaspaan M Patel
- NCQA, 1100 13th street NW, Washington, DC 20005, USA
- UCLA Jonathan and Karin Fielding School of Public Health, Los Angeles, CA 90024, USA
| | - Laura J Anderson
- UCLA Jonathan and Karin Fielding School of Public Health, Los Angeles, CA 90024, USA
| | - Emily L Deichsel
- UCLA Jonathan and Karin Fielding School of Public Health, Los Angeles, CA 90024, USA
| | - Paul G Shekelle
- Division of General Internal Medicine and Health Services Research, David Geffen School of Medicine at the University of California, 911 Broxton Ave, Los Angeles, CA 90024, USA
- RAND Corporation, 1776 Main Street, Santa Monica, CA 90407, USA
- VA Greater Los Angeles Healthcare System, Los Angeles, CA, USA
| |
Collapse
|
46
|
Vermeulen KM, van Doormaal JE, Zaal RJ, Mol PGM, Lenderink AW, Haaijer-Ruskamp FM, Kosterink JGW, van den Bemt PMLA. Cost-effectiveness of an electronic medication ordering system (CPOE/CDSS) in hospitalized patients. Int J Med Inform 2014; 83:572-80. [PMID: 24929633 DOI: 10.1016/j.ijmedinf.2014.05.003] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2013] [Revised: 05/14/2014] [Accepted: 05/14/2014] [Indexed: 11/15/2022]
Abstract
INTRODUCTION Prescribing medication is an important aspect of almost all in-hospital treatment regimes. Besides their obviously beneficial effects, medicines can also cause adverse drug events (ADE), which increase morbidity, mortality and health care costs. Partially, these ADEs arise from medication errors, e.g. at the prescribing stage. ADEs caused by medication errors are preventable ADEs. Until now, medication ordering was primarily a paper-based process and consequently, it was error prone. Computerized Physician Order Entry, combined with basic Clinical Decision Support System (CPOE/CDSS) is considered to enhance patient safety. Limited information is available on the balance between the health gains and the costs that need to be invested in order to achieve these positive effects. Aim of this study was to study the balance between the effects and costs of CPOE/CDSS compared to the traditional paper-based medication ordering. METHODS The economic evaluation was performed alongside a clinical study (interrupted time series design) on the effectiveness of CPOE/CDSS, including a cost minimization and a cost-effectiveness analysis. Data collection took place between 2005 and 2008. Analyses were performed from a hospital perspective. The study was performed in a general teaching hospital and a University Medical Centre on general internal medicine, gastroenterology and geriatric wards. Computerized Physician Order Entry, combined with basic Clinical Decision Support System (CPOE/CDSS) was compared to a traditional paper based system. All costs of both medication ordering systems are based on resources used and time invested. Prices were expressed in Euros (price level 2009). Effectiveness outcomes were medication errors and preventable adverse drug events. RESULTS During the paper-based prescribing period 592 patients were included, and during the CPOE/CDSS period 603. Total costs of the paper-based system and CPOE/CDSS amounted to €12.37 and €14.91 per patient/day respectively. The Incremental Cost-Effectiveness Ratio (ICER) for medication errors was 3.54 and for preventable adverse drug events 322.70, indicating the extra amount (€) that has to be invested in order to prevent one medication error or one pADE. CONCLUSIONS CPOE with basic CDSS contributes to a decreased risk of preventable harm. Overall, the extra costs of CPOE/CDSS needed to prevent one ME or one pADE seem to be acceptable.
Collapse
Affiliation(s)
- K M Vermeulen
- Department of Epidemiology, University Medical Center Groningen and University of Groningen, Groningen, The Netherlands
| | - J E van Doormaal
- Department of Clinical Pharmacy and Pharmacology, University of Groningen and University Medical Center Groningen, Groningen, The Netherlands
| | - R J Zaal
- Department of Hospital Pharmacy, Erasmus University Medical Center, Rotterdam, The Netherlands
| | - P G M Mol
- Department of Clinical Pharmacy and Pharmacology, University of Groningen and University Medical Center Groningen, Groningen, The Netherlands
| | - A W Lenderink
- Department of Clinical Pharmacy, TweeSteden Hospital and St. Elisabeth Hospital, Tilburg, The Netherlands
| | - F M Haaijer-Ruskamp
- Department of Clinical Pharmacy and Pharmacology, University of Groningen and University Medical Center Groningen, Groningen, The Netherlands
| | - J G W Kosterink
- Department of Clinical Pharmacy and Pharmacology, University of Groningen and University Medical Center Groningen, Groningen, The Netherlands
| | - P M L A van den Bemt
- Department of Hospital Pharmacy, Erasmus University Medical Center, Rotterdam, The Netherlands.
| |
Collapse
|
47
|
Medication monitoring in a nurse-led respiratory outpatient clinic: pragmatic randomised trial of the West Wales Adverse Drug Reaction Profile. PLoS One 2014; 9:e96682. [PMID: 24798210 PMCID: PMC4010491 DOI: 10.1371/journal.pone.0096682] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2013] [Accepted: 04/04/2014] [Indexed: 11/29/2022] Open
Abstract
Objective To assess the clinical effect of medication monitoring using the West Wales Adverse Drug Reaction (ADR) Profile for Respiratory Medicine. Design Single-site parallel-arm pragmatic trial using stratified randomisation. Setting Nurse-led respiratory outpatient clinic in general hospital in South Wales. Participants 54 patients with chronic respiratory disease receiving bronchodilators, corticosteroids or leukotriene receptor antagonists. Intervention Following initial observation of usual nursing care, we allocated participants at random to receive at follow up: either the West Wales ADR Profile for Respiratory Medicine in addition to usual care (‘intervention arm’ with 26 participants); or usual care alone (‘control arm’ with 28 participants). Main Outcome Measures Problems reported and actions taken. Results We followed up all randomised participants, and analysed data in accordance with treatment allocated. The increase in numbers of problems per participant identified at follow up was significantly higher in the intervention arm, where the median increase was 20.5 [inter-quartile range (IQR) 13–26], while that in the control arm was −1 [−3 to +2] [Mann-Whitney U test: z = 6.28, p<0.001]. The increase in numbers of actions per participant taken at follow up was also significantly higher in the intervention arm, where the median increase was 2.5 [1]–[4] while that in the control arm was 0 [−1.75 to +1] [Mann-Whitney U test: z = 4.40, p<0.001]. Conclusion When added to usual nursing care, the West Wales ADR Profile identified more problems and prompted more nursing actions. Our ADR Profile warrants further investigation as a strategy to optimise medication management. Trial Registration Controlled-trials.com ISRCTN10386209
Collapse
|
48
|
Deal K, Keshavjee K, Troyan S, Kyba R, Holbrook AM. Physician and patient willingness to pay for electronic cardiovascular disease management. Int J Med Inform 2014; 83:517-28. [PMID: 24862891 DOI: 10.1016/j.ijmedinf.2014.04.007] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2013] [Revised: 03/10/2014] [Accepted: 04/15/2014] [Indexed: 11/30/2022]
Abstract
OBJECTIVES Cardiovascular disease (CVD) is an important target for electronic decision support. We examined the potential sustainability of an electronic CVD management program using a discrete choice experiment (DCE). Our objective was to estimate physician and patient willingness-to-pay (WTP) for the current and enhanced programs. METHODS Focus groups, expert input and literature searches decided the attributes to be evaluated for the physician and patient DCEs, which were carried out using a Web-based program. Hierarchical Bayes analysis estimated preference coefficients for each respondent and latent class analysis segmented each sample. Simulations were used to estimate WTP for each of the attributes individually and for an enhanced vascular management system. RESULTS 144 participants (70 physicians, 74 patients) completed the DCE. Overall, access speed to updated records and monthly payments for a nurse coordinator were the main determinants of physician choices. Two distinctly different segments of physicians were identified - one very sensitive to monthly subscription fee and speed of updating the tracker with new patient data and the other very sensitive to the monthly cost of the nurse coordinator and government billing incentives. Patient choices were most significantly influenced by the yearly subscription cost. The estimated physician WTP was slightly above the estimated threshold for sustainability while the patient WTP was below. CONCLUSION Current willingness to pay for electronic cardiovascular disease management should encourage innovation to provide economies of scale in program development, delivery and maintenance to meet sustainability thresholds.
Collapse
Affiliation(s)
- Ken Deal
- DeGroote School of Business, McMaster University, 1280 Main St. West, Hamilton, ON, Canada L8S 4M4.
| | - Karim Keshavjee
- CEO, InfoClin Inc, 567 College St., Suite 201, Toronto, ON, Canada M6G 3W9.
| | - Sue Troyan
- Division of Clinical Pharmacology & Toxicology, McMaster University, c/o St. Joseph's Healthcare Hamilton, Charlton Ave East, Hamilton, ON, Canada L8N 4A6.
| | - Robert Kyba
- Strategic Global Counsel, 52 Fairfield Road, Toronto, ON, Canada M4P 1T2.
| | - Anne Marie Holbrook
- Division of Clinical Pharmacology & Toxicology, McMaster University, c/o St. Joseph's Healthcare Hamilton, Charlton Ave East, Hamilton, ON, Canada L8N 4A6.
| |
Collapse
|
49
|
Ranji SR, Rennke S, Wachter RM. Computerised provider order entry combined with clinical decision support systems to improve medication safety: a narrative review. BMJ Qual Saf 2014; 23:773-80. [DOI: 10.1136/bmjqs-2013-002165] [Citation(s) in RCA: 97] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
50
|
Bayoumi I, Al Balas M, Handler SM, Dolovich L, Hutchison B, Holbrook A. The effectiveness of computerized drug-lab alerts: a systematic review and meta-analysis. Int J Med Inform 2014; 83:406-15. [PMID: 24793784 DOI: 10.1016/j.ijmedinf.2014.03.003] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2013] [Revised: 03/17/2014] [Accepted: 03/19/2014] [Indexed: 01/18/2023]
Abstract
BACKGROUND Inadequate lab monitoring of drugs is a potential cause of ADEs (adverse drug events) which is remediable. OBJECTIVES To determine the effectiveness of computerized drug-lab alerts to improve medication-related outcomes. DATA SOURCES Citations from the Computerized Clinical Decision Support System Systematic Review (CCDSSR) and MMIT (Medications Management through Health Information Technology) databases, which had searched MEDLINE, EMBASE, CINAHL, Cochrane Database of Systematic Reviews, International Pharmaceutical Abstracts from 1974 to March 27, 2013. STUDY SELECTION Randomized controlled trials (RCTs) of clinician-targeted computerized drug lab alerts conducted in any healthcare setting. Two reviewers performed full text review to determine study eligibility. DATA ABSTRACTION A single reviewer abstracted data and evaluated validity of included studies using Cochrane handbook domains. DATA SYNTHESIS Thirty-six studies met the inclusion criteria (25 single drug studies with 22,504 participants, 14 targeting anticoagulation; 11 multi-drug studies with 56,769 participants). ADEs were reported as an outcome in only four trials, all targeting anticoagulants. Computerized drug-lab alerts did not reduce ADEs (OR 0.89, 95% CI 0.79-1.00, p=0.05), length of hospital stay (SMD 0.00, 95%CI -0.93 to 0.93, p=0.055, 1 study), likelihood of hypoglycemia (OR 1.29, 95% CI 0.31-5.37) or likelihood of bleeding, but were associated with increased likelihood of prescribing changes (OR 1.73, 95% CI 1.21-2.47) or lab monitoring (OR 1.47, 95% confidence interval 1.12-1.94) in accordance with the alert. CONCLUSIONS There is no evidence that computerized drug-lab alerts are associated with important clinical benefits, but there is evidence of improvement in selected clinical surrogate outcomes (time in therapeutic range for vitamin K antagonists), and changes in process outcomes (lab monitoring and prescribing decisions).
Collapse
Affiliation(s)
- Imaan Bayoumi
- Department of Family Medicine, McMaster University, Canada; Kingston Community Health Centres, Canada; Department of Family Medicine, Queen's University, Canada.
| | - Mosab Al Balas
- Department of Pharmacy, St. Joseph's Health Care Hamilton, Hamilton, Canada
| | - Steven M Handler
- Department of Biomedical Informatics, School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States; Division of Geriatric Medicine, Department of Medicine, University of Pittsburgh, Pittsburgh, PA, United States; Geriatric Research Education and Clinical Center (GRECC), Veterans Affairs Pittsburgh Healthcare System (VAPHS), Pittsburgh, PA, United States; Center for Health Equity Research and Promotion (CHERP), VAPHS, Pittsburgh, PA, United States
| | - Lisa Dolovich
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Canada; Department of Family Medicine, McMaster University, Canada; Centre for Evaluation of Medicines, St. Joseph's Healthcare Hamilton, Canada
| | - Brian Hutchison
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Canada; Department of Family Medicine, McMaster University, Canada
| | - Anne Holbrook
- Department of Clinical Epidemiology and Biostatistics, McMaster University, Canada; Division of Clinical Pharmacology & Therapeutics, Department of Medicine, McMaster University, Canada; Centre for Evaluation of Medicines, St. Joseph's Healthcare Hamilton, Canada
| |
Collapse
|