Quality pharmacy services and key performance indicators in Polish NICUs: a Delphi approach

Clinical pharmacy key performance indicators for hospital inpatient setting: a systematic review

BACKGROUND

Key performance indicators (KPIs) are quantifiable measures used to monitor the quality of health services. Implementation guidelines for clinical pharmacy services (CPS) do not specify KPIs.

AIM

To assess the quality of the studies that have developed KPIs for CPS in inpatient hospital settings.

METHOD

A systematic review was conducted by searching in Web of Science, Scopus, and PubMed, supplemented with citation analyses and grey literature searches, to retrieve studies addressing the development of KPIs in CPS for hospital inpatients. Exclusions comprised drug- or disease-specific studies and those not written in English, French, Portuguese, or Spanish. The Appraisal of Indicators through Research and Evaluation (AIRE) instrument assessed methodological quality. Domain scores and an overall score were calculated using an equal-weight principle. KPIs were classified into structure, process, and outcome categories. The protocol is available at https://doi.org/10.17605/OSF.IO/KS2G3 .

RESULTS

We included thirteen studies that collectively developed 225 KPIs. Merely five studies scored over 50% on the AIRE instrument, with domains #3 (scientific evidence) and #4 (formulation and usage) displaying low scores. Among the KPIs, 8.4% were classified as structure, 85.8% as process, and 5.8% as outcome indicators. The overall methodological quality did not exhibit a clear association with a major focus on outcomes. None of the studies provided benchmarking reference values.

CONCLUSION

The KPIs formulated for evaluating CPS in hospital settings primarily comprised process measures, predominantly suggested by pharmacists, with inadequate evidence support, lacked piloting or validation, and consequently, were devoid of benchmarking reference values.

Key performance indicators for pharmaceutical services: A systematic review

Background

Key performance indicators (KPIs) are a set of indicators that improve the quality of services provided by pharmacists. They enable the monitoring and evaluation of result progress and optimize decision-making for stakeholders. Currently, there is no systematic review regarding KPIs for pharmaceutical services.

Objectives

To identify and assess the quality of KPIs developed for pharmaceutical services.

Methods

A systematic review was conducted in PubMed, Scopus, EMBASE, and LILACS from the inception of the database until February 5th, 2024. Studies that developed a set of KPIs for pharmaceutical services were included. The indicators were evaluated using the Appraisal of Indicators through Research and Evaluation (AIRE) instrument. Two independent reviewers performed the study selection, data extraction, and quality assessment.

Results

Fifteen studies were included. The studies were conducted in different regions, most of which were developed for clinical services in hospitals or ambulatory settings, and used similar domains for the development of KPIs such as medication review, patient safety, and patient counseling. Literature review combined with the Delphi technique was the method most used by the studies, with content validity by inter-rater agreement. Regarding methodological quality, most studies described information on the purpose, definition, and stakeholders' involvement in the set of KPIs. However, little information was observed on the strategy for risk adjustment, instructions for presenting and interpreting the indicator results, the detailed description of the numerator and denominator, evidence scientific, and the feasibility of the set of KPIs. Only one study achieved a high methodological quality in all domains of the AIRE tool.

Conclusion

Our findings showed the potential of KPIs to monitor and assess pharmacy practice quality. Future studies should expand KPIs for other settings, explore validity evidence of the existing KPIs, provide detailed descriptions of evidence, formulation, and usage, and test their feasibility in daily practice.

The Impact of Hospital Pharmacy Operation on the Quality of Patient Care

This paper presents the role, tasks, and place of a hospital pharmacy in the structure of the entire facility. The role of hospital drug management and pharmacy seems to be extremely important in providing patients with high-quality care. Particular emphasis was placed on the distribution systems of medicinal products and medical devices in the hospital. The advantages and disadvantages of the classical distribution system and modern systems such as unit-dose and multi-dose-and the most important differences between them-are presented. Difficulties related to implementing modern distribution systems in hospitals were also discussed. The information provided is presented in the context of the legal regulations in Poland.

Development and validation of a pharmaceutical assessment screening tool to prioritise patient care in a tertiary care hospital

BACKGROUND

Clinical pharmacy plays an integral role in optimizing inpatient care. Nevertheless, prioritising patient care remains a critical challenge for pharmacists in a hectic medical ward. In Malaysia, clinical pharmacy practice has a paucity of standardized tools to prioritise patient care.

AIM

Our aim is to develop and validate a pharmaceutical assessment screening tool (PAST) to guide medical ward pharmacists in our local hospitals to effectively prioritise patient care.

METHOD

This study involved 2 major phases; (1) development of PAST through literature review and group discussion, (2) validation of PAST using a three-round Delphi survey. Twenty-four experts were invited by email to participate in the Delphi survey. In each round, experts were required to rate the relevance and completeness of PAST criteria and were given chance for open feedback. The 75% consensus benchmark was set and criteria with achieved consensus were retained in PAST. Experts' suggestions were considered and added into PAST for rating. After each round, experts were provided with anonymised feedback and results from the previous round.

RESULTS

Three Delphi rounds resulted in the final tool (rearranged as mnemonic 'STORIMAP'). STORIMAP consists of 8 main criteria with 29 subcomponents. Marks are allocated for each criteria in STORIMAP which can be combined to a total of 15 marks. Patient acuity level is determined based on the final score and clerking priority is assigned accordingly.

CONCLUSION

STORIMAP potentially serves as a useful tool to guide medical ward pharmacists to prioritise patients effectively, hence establishing acuity-based pharmaceutical care.

Use of the Delphi technique in pharmacy practice research

Consensus research methods are used in health services research to generate evidence through systematic means of measuring collective agreement and developing consensus from experts of a subject matter. Delphi technique is the most commonly reported consensus research method and is a structured, multistage interaction method to determine consensus using repetitive administration of anonymous questionnaires across two or three rounds. The Delphi technique is increasingly being used in pharmacy practice research. Despite its wide use in the development of statements of policies, guidelines, and performance indicators, there is lack of standardized guidelines and criteria to support the Delphi technique study design, conduct, and reporting, leading to inconsistent approaches and methodological difficulties among researchers. In this themed article, we provide the reader with a collation of best practices and highlight key methodological issues and areas of uncertainty of the Delphi method, especially as it pertains to pharmacy practice research.

A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique

Objective:

The Outcomes and Assessment Committee at the Virginia Commonwealth University School of Pharmacy was tasked with refining the school’s key performance indicators (KPIs) to improve programmatic assessment by focusing on the most important measures.

Methods:

Initially, 56 KPIs were tracked, nine of which were university mandated, divided into 10 modules: admissions, community outreach, continuing education, diversity, faculty experience and success, fundraising, graduate program, research and scholarship, staff experience and success, and student experience and success. Using a three-round Delphi consensus technique, KPIs were reviewed by faculty and staff. Each participant responded whether they considered each KPI to be essential or not essential for school quality assessment and improvement. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively.

Results:

Of 109 faculty and staff invited, 49 participated in the first round, 51 in the second, and 42 in the third. At the end of the third round, accumulated consensus was achieved for 35 out of 88 (39.8%) KPIs that were considered essential and 3 out of 88 (3.4%) that were considered non-essential. Consensus percentage per module was: 15.4% (2/13) admissions, 28.6% (2/7) community outreach, 33.3% (3/9) continuing education, 27.3% (3/11) diversity, 62.5% (5/8) faculty experience and success, 55.6% (5/9) fundraising, 40% (4/10) graduate program, 33.3% (3/9) research and scholarship, 57.1% (4/7) staff experience and success, and 66.7% (4/6) student experience and success.

Conclusions:

Ultimately, 35 KPIs achieved consensus as essential to measure achievement of benchmarks for the school, which totals 44 KPIs, including nine university mandated KPIs. The process facilitated faculty and staff involvement in KPI selection and achieved improved focus for programmatic assessment.

Quality Indicators of Pharmaceutical Care for Integrative Healthcare: A Scoping Review of Indicators Developed Using the Delphi Technique

BACKGROUND

Recently, measuring and benchmarking provision of healthcare services has drawn a considerable attention. This scoping review was conducted to identify, describe, and summarize studies in which the Delphi technique was used to develop quality indicators of pharmaceutical care. The study also aimed to identify activities and services that could be used to capture the impact of pharmacist in integrative medicine.

METHODS

Databases were searched from inception to February 2020 using key terms that were combined using Boolean operators. Studies were included if they were relevant to development of quality indicators of pharmaceutical care with regard to medications or complementary and alternative medicine (CAM) modalities. Full text of the selected studies was imported into EndNote. Studies were screened and data were extracted into a standard extraction form.

RESULTS

Data were extracted from 31 studies. Of those, 24 (77.4%) were related to provision of pharmaceutical services relevant to medications and 7 (22.6%) were related to provision of care using CAM modalities. Most of the studies (67.7%) were published in 2010 and beyond. Almost half of the studies (48.4%) originated from the United States, United Kingdom, and Canada. A total of 42 different activities and services that could be used as quality indicators were identified from the studies included in this review. Activities and services were related to history taking, performing reconciliations, identifying and resolving therapy problems, providing collaborative care, designing care plans, optimal performance, and continuing education.

CONCLUSIONS

Although there is an increasing interest in improving healthcare delivery, quality indicators of pharmaceutical services and those relevant to CAM provision in healthcare facilities adopting the integrated healthcare paradigm are still limited. Future studies are needed to develop validated quality indicators that could be successfully used in measuring and benchmarking quality of services in integrated healthcare facilities.

Development of key performance indicators to capture in measuring the impact of pharmacists in caring for patients with epilepsy in primary healthcare: A Delphi consensual study

OBJECTIVE

This study was conducted to develop and achieve formal consensus on a core set of key performance indicators (KPIs) that can be captured in measuring the impact of pharmacists in caring for patients with epilepsy (PWE) visiting epilepsy clinics as outpatients in primary healthcare practice.

METHODS

In this study, a comprehensive literature search and review was conducted to extract candidate KPIs. Interviews with key contacts (6 pharmacists, 2 neurologists, 3 nurses, and 3 PWE) were also conducted to supplement the inventory set of KPI candidates. A three-round Delphi technique was followed among a panel of 40 members to achieve formal consensus on a core list of KPIs. Consensual KPIs were ranked by the ratings of the panelists.

RESULTS

The final consensual core set contained 8 KPIs in the thematic activity areas of pharmaceutical care, medication reconciliation and best possible medication history, patient education/counseling, interprofessional patient care, competence, and performance efficiency/patient satisfaction. The KPIs related to therapy problems identified and resolved by pharmacist and provision of proactive comprehensive direct patient care by a pharmacist received significantly higher (p-value: 0.0001) scores compared to the KPI related to complaints about pharmacists received.

CONCLUSION

Eight consensual KPIs to capture in measuring the impact of pharmacists in caring for PWE visiting epilepsy clinics as outpatients in primary healthcare practice were developed using the Delphi technique. If successfully adopted, implemented, captured, and analyzed, these consensual KPIs might help advance pharmaceutical care of PWE in primary healthcare practice.

Development and validation of key performance indicators for medication management services provided for outpatients

BACKGROUND

One of the elements of quality improvement of medication management services is measuring the quality of care and key performance indicators (KPIs) can be used in this assessment. There has been no publishing yet about a KPI instrument developed for ambulatory setting.

OBJECTIVES

To develop and validate KPI instrument for medication management services provided for outpatients in Brazilian context.

METHODS

A working group established 7 possible KPIs for assessment of the expert panel. For content validity, 16 experts were invited to participate in an internet based 2-round Delphi approach. Expert panel rated 7 possible KPIs using 7 attributes on a 5-point Likert scale for consensus. In order to construct validity and reliability, an internet questionnaire was developed for pharmacists that work in primary care to understand their views. In addition, a comparison between expert and pharmacist views about the indicators relevance was performed.

RESULTS

Eleven (68.8%) experts participated in the Delphi round 1 and nine (81.8%) experts completed the 2 Delphi rounds. A new KPI was develop after expert panel assessment in the first round. Overall, content and construct validity were reached for 6 KPIs: pharmaceutical consultation provided (I₁), pharmacist interventions accepted by the prescriber (I₂), drug therapy problems resolved (I₃), patient clinical status (I₄), patient satisfaction (I₅), and patient quality of life (I₆).

CONCLUSIONS

A set of 6 KPIs was developed for medication management services provided for outpatients. The instrument presented a good reliability and validity evidence. It is expected that these KPIs will improve the quality of medication management services.