How to save costs by reducing unnecessary testing: lean thinking in clinical practice

Explosion of formulaic research articles, including inappropriate study designs and false discoveries, based on the NHANES US national health database

With the growth of artificial intelligence (AI)-ready datasets such as the National Health and Nutrition Examination Survey (NHANES), new opportunities for data-driven research are being created, but also generating risks of data exploitation by paper mills. In this work, we focus on two areas of potential concern for AI-supported research efforts. First, we describe the production of large numbers of formulaic single-factor analyses, relating single predictors to specific health conditions, where multifactorial approaches would be more appropriate. Employing AI-supported single-factor approaches removes context from research, fails to capture interactions, avoids false discovery correction, and is an approach that can easily be adopted by paper mills. Second, we identify risks of selective data usage, such as analyzing limited date ranges or cohort subsets without clear justification, suggestive of data dredging, and post-hoc hypothesis formation. Using a systematic literature search for single-factor analyses, we identified 341 NHANES-derived research papers published over the past decade, each proposing an association between a predictor and a health condition from the wide range contained within NHANES. We found evidence that research failed to take account of multifactorial relationships, that manuscripts did not account for the risks of false discoveries, and that researchers selectively extracted data from NHANES rather than utilizing the full range of data available. Given the explosion of AI-assisted productivity in published manuscripts (the systematic search strategy used here identified an average of 4 papers per annum from 2014 to 2021, but 190 in 2024-9 October alone), we highlight a set of best practices to address these concerns, aimed at researchers, data controllers, publishers, and peer reviewers, to encourage improved statistical practices and mitigate the risks of paper mills using AI-assisted workflows to introduce low-quality manuscripts to the scientific literature.

Comparing sputum, nasopharyngeal swabs, and combined samples for respiratory bacterial detection using multiplex PCR

Respiratory tract infections are major global health issues that require rapid and accurate diagnostic methods. Multiplex quantitative PCR (qPCR) is commonly used for pathogen detection in respiratory samples. However, the optimal specimen selection for detecting bacterial pathogens is not well-explored. We evaluated the detection rates of respiratory bacteria from nasopharyngeal swabs (NPS), sputum, and combined NPS and sputum samples using multiplex qPCR (Allplex PneumoBacter Assay, Seegene). Paired NPS and sputum samples from 219 patients with acute respiratory symptoms admitted to Korea University Anam Hospital were analyzed. qPCR was performed to detect seven respiratory bacteria: Bordetella parapertussis, Bordetella pertussis, Chlamydophila pneumoniae, Haemophilus influenzae, Legionella pneumophila, Mycoplasma pneumoniae, and Streptococcus pneumoniae. Combined NPS and sputum samples (n = 92) were created from 46 pairs of positive and 46 pairs of negative signals for NPS-alone and sputum-alone samples. Sputum samples (44.3%; 97/219) had a significantly higher positivity rate compared to NPS samples (21.0%; 46/219) (P < 0.001). The 92 combined samples identified a total of 65 bacterial nucleic acids. The detection rate for the combined samples was 86.2% (56/65), which was comparable to that of sputum alone (89.2%; 58/65) and higher than that of NPS samples (50.8%; 33/65). Combining NPS and sputum samples for PCR testing may offer an alternative for bacterial pathogen detection, providing rates comparable to those of sputum alone and greater sensitivity than that of NPS alone. This combined approach could be a cost-effective method to maximize diagnostic yield, reduce the need for multiple tests, and improve the management of respiratory infections.

IMPORTANCE

This study offers important insights into refining diagnostic strategies for respiratory bacterial infections using multiplex PCR. This study finds that combining sputum and nasopharyngeal swabs into a single tube could serve as an effective alternative for detecting respiratory bacteria in adults with acute respiratory illness.

Revisiting the Environmental Impact of Inappropriate Clinical Laboratory Testing: A Comprehensive Overview of Sustainability, Economic, and Quality of Care Outcomes

BACKGROUND

The use of laboratory resources has seen a substantial increase in recent years, driven by automation and emerging technologies. However, inappropriate use of laboratory testing, encompassing both overuse and underuse, poses significant challenges.

CONTENT

This review explores the complex interplay between patient safety, economic, and environmental factors-known as the "triple bottom line" or "3Ps" for people, profit, and planet-associated with inappropriate use of laboratory resources. The first part of the review outlines the impact of inappropriate laboratory testing on patient safety and economic outcomes. Then the review examines the available literature on the environmental impact of laboratory activities. Several practical solutions for mitigating the environmental impact of laboratories are discussed. Finally, this review emphasizes how decreasing unnecessary laboratory testing results in cost savings and environmental benefits, as evidenced by interventional studies, without compromising patient safety.

SUMMARY

The implementation of sustainable practices in laboratories can create a virtuous circle in which reduced testing enhances cost-efficiency, reduces the environmental footprint, and ensures patient safety, thereby benefiting the 3Ps. This review highlights the critical need for appropriate laboratory resource utilization in achieving sustainability in healthcare.

Pharmacogenetic Testing or Therapeutic Drug Monitoring: A Quantitative Framework

BACKGROUND

Pharmacogenetic profiling and therapeutic drug monitoring (TDM) have both been proposed to manage inter-individual variability (IIV) in drug exposure. However, determining the most effective approach for estimating exposure for a particular drug remains a challenge. This study aimed to quantitatively assess the circumstances in which pharmacogenetic profiling may outperform TDM in estimating drug exposure, under three sources of variability (IIV, inter-occasion variability [IOV], and residual unexplained variability [RUV]).

METHODS

Pharmacokinetic models were selected from the literature corresponding to drugs for which pharmacogenetic profiling and TDM are both clinically considered approaches for dose individualization. The models were used to simulate relevant drug exposures (trough concentration or area under the curve [AUC]) under varying degrees of IIV, IOV, and RUV.

RESULTS

Six drug cases were selected from the literature. Model-based simulations demonstrated that the percentage of patients for whom pharmacogenetic exposure prediction is superior to TDM differs for each drug case: tacrolimus (11.0%), tamoxifen (12.7%), efavirenz (49.2%), vincristine (49.6%), risperidone (48.1%), and 5-fluorouracil (5-FU) (100%). Generally, in the presence of higher unexplained IIV in combination with lower RUV and IOV, exposure was best estimated by TDM, whereas, under lower unexplained IIV in combination with higher IOV or RUV, pharmacogenetic profiling was preferred.

CONCLUSIONS

For the drugs with relatively low RUV and IOV (e.g., tamoxifen and tacrolimus), TDM estimated true exposure the best. Conversely, for drugs with similar or lower unexplained IIV (e.g., efavirenz or 5-FU, respectively) combined with relatively high RUV, pharmacogenetic profiling provided the most accurate estimate for most patients. However, genotype prevalence and the relative influence of genotypes on the PK, as well as the ability of TDM to accurately estimate AUC with a limited number of samples, had an impact. The results could be used to support clinical decision making when considering other factors, such as the probability for severe side effects.

Managing Resource Utilization Cost of Laboratory Tests for Patients on Chemotherapy in Johns Hopkins Aramco Healthcare

Introduction

Laboratory testing is a fundamental diagnostic and prognostic tool to ensure the quality of healthcare, treatment, and responses. This study aimed to evaluate the cost of laboratory tests performed for patients undergoing chemotherapy treatment in the oncology treatment center at Johns Hopkins Aramco Healthcare in Saudi Arabia. Additionally, we aimed to reduce the cost of unnecessary laboratory tests in a 1-year period.

Methods

This was a quality improvement study with a quasi-experimental design using DMAIC methodology. The intervention strategy involved educating staff about adhering to the British Columbia Cancer Agency (BCCA) guidelines when ordering laboratory tests for chemotherapy patients, then integrating those guidelines into the electronic health record system. Data were collected for 200 randomly selected cases with 10 different chemotherapy protocols before and after the intervention. A paired t test was used to analyze differences in mean cost for all laboratory tests and unnecessary testing before and after the intervention.

Results

A significant cost reduction was achieved for unnecessary laboratory tests (77%, p < 0.01) when following the BCCA guidelines. In addition, the mean cost of all laboratory tests (including necessary and unnecessary) was significantly reduced by 45.5% (p = 0.023).

Conclusion

Lean thinking in clinical practice, realized by integrating a standardized laboratory test guided by BCCA guidelines into the electronic health record, significantly reduced financial costs within 1 year, thereby enhancing efficient resource utilization in the organization. This quality improvement project may serve to increase awareness of further efforts to improve resource utilization for other oncology treatment protocols.

Diarrhea don'ts: Reducing inappropriate stool cultures and ova and parasite testing for nosocomial diarrhea

BACKGROUND

Diarrhea that develops in patients after 72 hours of hospitalization is likely to have a nosocomial or iatrogenic etiology. Testing with stool cultures and stool ova and parasites (O&P) is not recommended. Our goal was to reduce this inappropriate testing within a large, urban safety-net hospital system.

METHODS

This was a quality improvement project. We created a best practice advisory (BPA) within the electronic medical record that fires when a stool culture or O&P order is placed 72 hours after admission for any immunocompetent patient. It states that stool testing is low yield and offers the option to remove the order. We measured weekly counts of stool culture and stool O&P orders pre- and postintervention. We also measured the BPA acceptance rate, the 24-hour stool testing reorder rate, and Clostridioides difficile infection rates. Data were analyzed using Welch tests as well as a quasi-experimental pre- and postintervention interrupted time series regression analysis.

RESULTS

Stool culture orders decreased by 24.4% (P < .001). There was a significant level difference and slope difference with linear regression. Five of the 11 hospitals had a significant reduction in stool culture orders. Stool O&P orders decreased by 18.2% (P < .01). Three of the 11 hospitals had a significant reduction in stool O&P orders.

CONCLUSIONS

Our intervention successfully reduced inappropriate stool testing within a large safety-net hospital system.

Rationalisation of laboratory tests ordering and consumption at Armed Forces Hospital, Jazan

Laboratory testing is one of the major and important component of medical diagnosis. However, unrationalised laboratory test ordering may lead to misdiagnosis of diseases which would delay treatment of the patients. It would also lead to wasting the laboratory resources that adversely impact the hospital budget. The aim of this project was to rationalise laboratory tests ordering and ensure effective utilisation of resources at Armed Forces Hospital Jizan (AFHJ). This study included two major steps: (1) the development and implementation of quality improvement interventions to reduce the unnecessary and abuse of laboratory testing in the AFHJ and (2) evaluation of the effectiveness of these interventions. In order to determine the possible causes of the problem, fishbone diagram was used to structure a brainstorming session. Pareto analysis was used to prioritise the causes so that the emphasis can be laid on most significant one. After interventions implementation, the data analysed and found that there was significant differences between 2019 and 2021 of total patients percentage and distribution that was revealed by box plot, who had a request of Hemoglobin A1c (HbA1c) (p=0.002), Thyroid Stimulating Hormone (TSH) (p=0.002), Free Thyroine (FT4) (p=0.002), Free Triiodothyronine (FT3) (p=0.001), Follicle-Stimulating Hormone (FSH) (p=0.002), Luteinizing Hormone (LH) (p=0.002) and Prolactin (PRL) (p=0.001). We achieved a 33% reduction in total laboratory tests cost and the total laboratory budget decreased from 6 000 000 SR in 2019 to about 4 000 000 Saudi Riyals (SR) in 2021. A change in laboratory resource consumption requires changes in physicians awareness. A modification of the electronic ordering system applied more restrictions to the ordering physicians. Extending these measures to the entire hospital might lead to significant reduction in the healthcare costs.

Feasibility of a rapid diagnosis discussion tool for reducing misdiagnosis of patients presenting to emergency departments with abdominal pain

OBJECTIVES

Providing accurate and timely diagnoses is challenging in ED settings. We evaluated the feasibility and effectiveness of a short, structured rapid diagnosis discussion (RaDD) between a patient's initial doctor and a second doctor for patients presenting to ED with abdominal pain.

METHODS

Controlled pre-post, mixed-methods pilot study in a metropolitan hospital network in Melbourne, Australia. Comparisons were made between an ED using RaDD for a 1-month period (n = 155) and two control EDs within the same hospital network (n = 2227) using standard practices. A short survey of 27 clinicians was also undertaken.

RESULTS

Provisional diagnoses changed in 24.7% (95% confidence interval 19.0, 30.4) of all cases for which a RaDD case report sheet was completed, and clinicians' confidence in their decision-making was significantly higher when using RaDD (r = 0.27). RaDD significantly increased the likelihood that patients would be sent to the short stay unit and have a blood test ordered, and significantly reduced the likelihood that patients would be discharged home from the ED or leave at their own risk. Usage of the RaDD tool was low (25.2% of eligible cases), and qualitative feedback indicated that time limitations inhibited uptake.

CONCLUSIONS

RaDD encouraged clinicians to take a more cautious, risk-averse approach to care and improved confidence in their diagnostic decisions. However, cost effectiveness of these outcomes and possible implementation barriers need to be further considered in subsequent studies.

Improved implementation of medical tests - barriers and opportunities

Applying the concept of a value proposition to medical testing is just one of the many ways to identify and monitor the value of tests. A key part of this concept focusses on processes that should take place after a test is introduced into routine local practice, namely test implementation. This process requires identification of the clinical pathway, the stakeholders and the benefits or disbenefits that accrue to those stakeholders. There are various barriers and challenges to test implementation. Implementation requires the process of clinical audit which involves measurement of outcomes external to the laboratory but this is not widely performed in laboratory medicine. A second key challenge is that implementation requires liaison with stakeholders outside of the laboratory including clinicians and other healthcare professional such as finance managers. Many laboratories are remote from clinical care and other stakeholders making such liaison difficult. The implementation process is based on data which again will be primarily on processes outside of the laboratory. However the recent enthusiasm for so-called real world data and new data mining techniques may represent opportunities that will facilitate better test implementation. A final barrier is that a range of new tools not currently in the education curriculum of the laboratory professional is required for implementation such as those of preparing a business case to support the introduction of a test and health economic analysis. The professional bodies in laboratory medicine could assist with education in these areas.

Interventions to reduce repetitive ordering of low-value inpatient laboratory tests: a systematic review

BACKGROUND

Over-ordering of daily laboratory tests adversely affects patient care through hospital-acquired anaemia, patient discomfort, burden on front-line staff and unnecessary downstream testing. This remains a prevalent issue despite the 2013 Choosing Wisely recommendation to minimise unnecessary daily labs. We conducted a systematic review of the literature to identify interventions targeting unnecessary laboratory testing.

METHODS

We systematically searched MEDLINE, EMBASE, Cochrane Central and SCOPUS databases to identify interventions focused on reducing daily complete blood count, complete metabolic panel and basic metabolic panel labs. We defined interventions as 'effective' if a statistically significant reduction was attained and 'highly effective' if a reduction of ≥25% was attained.

RESULTS

The search yielded 5646 studies with 41 articles that met inclusion criteria. We grouped interventions into one or more categories: audit and feedback, cost display, education, electronic medical record (EMR) change, and policy change. Most interventions lasted less than a year and used a multipronged approach. All five strategies were effective in most studies with EMR change being the most commonly used independent strategy. EMR change and policy change were the strategies most frequently reported as effective. EMR change was the strategy most frequently reported as highly effective.

CONCLUSION

Our analysis identified five categories of interventions targeting daily laboratory testing. All categories were effective in most studies, with EMR change being most frequently highly effective.

PROSPERO REGISTRATION NUMBER

CRD42021254076.

Reducing Unnecessary 'Admission' Chest X-rays: An Initiative to Minimize Low-Value Care

Introduction Internal medicine admission services often request a baseline admission chest X-ray (CXR) for patients already admitted to the emergency department (ED) and who are waiting for inpatient beds, despite rarely providing clinical value. Adverse consequences of such CXRs include unnecessary radiation exposure, cost, time, and false positives, which can trigger a diagnostic cascade. Extraneous CXRs performed on already-admitted ED patients can delay inpatient transfer, thereby increasing boarding and crowding, which in turn may affect mortality and satisfaction. In 2016, our ED and internal medicine hospitalist services implemented guidelines (reflecting those of the American College of Radiology) to reduce unnecessary admission CXRs. All relevant providers were educated on the guideline. The primary aim of this study was to determine if there were changes in the percentage of patients with pre-admission and admission CXRs following guideline implementation. Our secondary aim was to determine which patient characteristics predict getting a CXR. Methods All ED and internal medicine hospitalist providers were educated once about the guideline. We performed a retrospective analysis of pre- vs. post-guideline data. Patients were included if admitted to the internal medicine service during those timeframes with an admission diagnosis unrelated to the cardiac or pulmonary systems. A CXR performed during ED evaluation prior to the admission disposition time was recorded as "pre-admission," and if performed after disposition time it was recorded as "admission." A CXR was "unwarranted" if the admission diagnosis did not suggest a CXR was necessary. The numerator was the number of unnecessary admission CXRs ordered on patients with diagnoses unrelated to the cardiac or pulmonary systems (minus those with a pre-admission CXR); the denominator was the number of such admissions (minus those with a pre-admission CXR). Variables of interest that might influence whether a CXR was ordered were age, gender, respiratory rate ≥20, cardiac- or pulmonary-related chief complaint, ED diagnosis category, or past medical history.  Results Among admitted patients with diagnoses that did not suggest a CXR was warranted, there was no change in the percentage of admission CXRs (21.7% to 25.6%, p = 0.2678), whereas the percentage with pre-admission CXRs decreased (66.6% to 60.7%, p = 0.0152). This decrease was driven by fewer CXRs being performed on patients whose chief complaint did not suggest one was indicated (p = .0121). In multivariate analysis, risk factors for an unwarranted CXR were age >40 (risk ratio (RR) = 2.9) and past medical history of cardiovascular disease (e.g., myocardial infarction, atrial fibrillation), renal disease, or hyperkalemia.  Conclusion This educational initiative was not associated with the intended decrease in ordering unwarranted admission CXRs among ED boarding patients, though there was an unanticipated decrease in pre-admission CXRs. This decrease was driven by fewer CXRs being performed on patients whose chief complaint did not suggest one was indicated. Organizations interested in reducing processes with little clinical value might adopt a similar program while emphasizing the lack of benefit to admitted patients through iterative educational programs on hospital admitting services.

Development of clinical-guideline-based mobile application and its effect on head CT scan utilization in neurology and neurosurgery departments

Background

There is little evidence regarding the adoption and intention of using mobile apps by health care professionals (HCP) and the effectiveness of using mobile apps among physicians is still unclear. To address this challenge, the current study seeks two objectives: developing and implementing a head CT scan appropriateness criteria mobile app (HAC app), and investigating the effect of HAC app on CT scan order.

Methods

A one arm intervention quasi experimental study with before/after analysis was conducted in neurology & neurosurgery (N&N) departments at the academic hospital. We recruited all residents' encounters to N&N departments with head CT scan to examine the effect of HAC app on residents' CT scan utilization. The main outcome measure was CT scan order per patient for seven months at three points, before the intervention, during the intervention, after cessation of the intervention -post-intervention follow-up. Data for CT scan utilization were collected by reviewing medical records and then analyzed using descriptive statistics, Kruskal-Wallis, and Mann-Whitney tests. A focus group discussion with residents was performed to review and digest residents' experiences during interaction with the HAC app.

Results

Sixteen residents participated in this study; a total of 415 N&N encounters with CT scan order, pre-intervention 127 (30.6%), intervention phase 187 (45.1%), and 101 (24.3%) in the post-intervention follow-up phase were included in this study. Although total CT scan utilization was statistically significant during three-time points of the study (P = 0.027), no significant differences were found for CT utilization after cessation of the intervention (P = 1).

Conclusion

The effect of mobile devices on residents' CT scan ordering behavior remains open to debate since the changes were not long-lasting. Further studies based on real interactive experiences with mobile devices is advisable before it can be recommended for widespread use by HCP.

The Hippocratic Oath: Analysis and Contemporary Meaning

The Hippocratic oath is traditionally taken by medical school graduates at the time of their graduation, either in its original form or in a modern variation. It is considered the earliest expression of medical ethics, establishing principles of ethics that remain of paramount significance today. However, it was written in antiquity, whereas medicine has been constantly evolving. This article reviews, analyzes, and interprets each section of the oath to determine to what extent it remains relevant to contemporary medicine. [Orthopedics. 2021;44(5):264-272.].

Implementation of medical tests in a Value-Based healthcare environment: A framework for delivering value

Significant variation in the utilisation of medical tests is known to have an adverse impact on health outcomes and analysis of this variation is an important tool for quality assurance in healthcare. The introduction of a new medical test into a care pathway requires two distinct processes, termed adoption and implementation. One cause of the unwarranted variation in the use of medical tests is poor adoption and implementation. Adoption is the decision to acquire a technology and make it available to the users and is supported with evidence of clinical and cost effectiveness. Implementation is delivering the benefits promised in the business case, based on evidence of the impact of a test on each stakeholder involved in delivering the care pathway. The business case will have identified the benefits delivered to all stakeholders, as set out in a value proposition, and according to the quality domains typically addressed in quality improvement, namely clinical, process and structure (resource utilisation) outcomes. The outcome measures extend beyond those of clinical and cost effectiveness required for adoption. We describe an implementation framework which is designed to document the changes to the care pathway, the resource inputs and the expected outcomes with associated quality metrics.

Evidence-Based Care Reduces Unnecessary Medical Procedures and Healthcare Costs in the Outpatient Setting

OBJECTIVES

The study aimed to examine the number of unnecessary medical procedures and healthcare costs with the use of the educational intervention in Poland.

METHODS

Secondary data were collected between 2014 and 2015. Analysis of events and cost per patient revealed significant variability and overutilization of diagnostics and other services by physicians practicing in a network of private outpatient clinics in Poland. To reduce unjustified referrals and costs, a 2-year educational intervention was carried out, which included printed evidence-based practice recommendations and quarterly verification of the results from each of the 617 participating physicians. We analyzed the effects of the intervention on the number of medical events and costs with 17 diagnoses generating the highest costs.

RESULTS

After 2 years of the intervention, the number of medical events per patient decreased by over 20% compared to baseline, primarily in orthopedics (by 31%-37%). Moreover, the healthcare costs per patient decreased by about 18% at the end of the intervention. Patient satisfaction remained high during the intervention.

CONCLUSIONS

Intervention based on evidence-based practice reduced both the number of unnecessary medical procedures and healthcare costs in the outpatient setting, while not affecting patient satisfaction.

Is There Benefit in Keeping Early Discharge Patients Overnight After Total Joint Arthroplasty?

BACKGROUND

Total joint arthoplasty (TJA) cost containment has been a key focus for the Centers for Medicare and Medicaid Services spawning significant research and programmatic change, including a move toward early discharge and outpatient TJA. TJA outpatients receive few, if any, medical interventions before discharge, but the type and quantity of interventions provided for TJA patients who stay overnight in the hospital is unknown. This study quantified the nature, frequency, and outcome of interventions occurring overnight after primary TJA.

METHODS

1725 consecutive primary unilateral TJAs performed between 2012 and 2017 by a single surgeon in a rapid-discharge program, managed by a perioperative internal medicine specialist, were reviewed. Medical records were examined for diagnostic tests, treatments, and procedures, results of interventions, and readmissions.

RESULTS

759 patients were discharged on postoperative day 1. Eighty-four percent (641 of 759) received no medical interventions during their overnight hospital stay. Twelve (1.6%) received diagnostic tests, 90 (11.9%) received treatments, and 29 (3.8%) received procedures. Ninety-two percent (11 of 12) of diagnostic tests were negative, 66% of 100 treatments in 90 patients were intravenous fluids for oliguria or hypotension, and all procedures were in and out catheterizations for urinary retention. 90-day all-cause readmission rates were similar in patients who received (2.5%) and did not receive (3.3%) a clinical intervention.

CONCLUSION

Most patients received no overnight interventions, suggesting unnecessary costly hospitalization. The most common issues addressed were oliguria, urinary retention, and hypotension. Protocols to prevent these conditions would facilitate outpatient TJA, improve patient safety, and reduce costs.

A deep learning solution to recommend laboratory reduction strategies in ICU

OBJECTIVE

To build a machine-learning model that predicts laboratory test results and provides a promising lab test reduction strategy, using spatial-temporal correlations.

MATERIALS AND METHODS

We developed a global prediction model to treat laboratory testing as a series of decisions by considering contextual information over time and across modalities. We validated our method using a critical care database (MIMIC III), which includes 4,570,709 observations of 12 standard laboratory tests, among 38,773 critical care patients. Our deep-learning model made real-time laboratory reduction recommendations and predicted the properties of lab tests, including values, normal/abnormal (whether labs were within the normal range) and transition (normal to abnormal or abnormal to normal from the latest lab test). We reported area under the receiver operating characteristic curve (AUC) for predicting normal/abnormal, evaluated accuracy and absolute bias on prediction vs. observation against lab test reduction proportion. We compared our model against baseline models and analyzed the impact of variations on the recommended reduction strategy.

RESULTS

Our best model offered a 20.26 % reduction in the number of laboratory tests. By applying the recommended reduction policy on the hold-out dataset (7755 patients), our model predicted normality/abnormality of laboratory tests with a 98.27 % accuracy (AUC, 0.9885; sensitivity, 97.84 %; specificity, 98.80 %; PPV, 99.01 %; NPV, 97.39 %) on 20.26 % reduced lab tests, and recommended 98.10 % of transitions to be checked. Our model performed better than the greedy models, and the recommended reduction strategy was robust.

DISCUSSION

Strong spatial and temporal correlations between laboratory tests can be used to optimize policies for reducing laboratory tests throughout the hospital course. Our method allows for iterative predictions and provides a superior solution for the dynamic decision-making laboratory reduction problem.

CONCLUSION

This work demonstrates a machine-learning model that assists physicians in determining which laboratory tests may be omitted.

What Role Can Process Mining Play in Recurrent Clinical Guidelines Issues? A Position Paper

In the age of Evidence-Based Medicine, Clinical Guidelines (CGs) are recognized to be an indispensable tool to support physicians in their daily clinical practice. Medical Informatics is expected to play a relevant role in facilitating diffusion and adoption of CGs. However, the past pioneering approaches, often fragmented in many disciplines, did not lead to solutions that are actually exploited in hospitals. Process Mining for Healthcare (PM4HC) is an emerging discipline gaining the interest of healthcare experts, and seems able to deal with many important issues in representing CGs. In this position paper, we briefly describe the story and the state-of-the-art of CGs, and the efforts and results of the past approaches of medical informatics. Then, we describe PM4HC, and we answer questions like how can PM4HC cope with this challenge? Which role does PM4HC play and which rules should be employed for the PM4HC scientific community?

A systematic literature review on unnecessary diagnostic testing: The role of ICT use

BACKGROUND

The negative impact of unnecessary diagnostic tests on healthcare systems and patients has been widely recognized. Medical researchers in various countries have been devoting effort to reduce unnecessary diagnostic tests by using different types of interventions, including information and communications technology-based (ICT-based) intervention, educational intervention, audit and feedback, the introduction of guidelines or protocols, and the reward and punishment of staff. We conducted a review of ICT based interventions and a comparative analysis of their relative effectiveness in reducing unnecessary tests.

METHOD

A systematic Boolean search in PubMed, EMBase and EBSCOhost research databases was performed. Keyword search and citation analysis were also conducted. Empirical studies reporting ICT based interventions, and their implications on relative effectiveness in reducing unnecessary diagnostic tests (pathology tests or medical imaging) were evaluated independently by two reviewers based on a rigorously developed coding protocol.

RESULTS

92 research articles from peer-reviewed journals were identified as eligible. 47 studies involved a single-method intervention and 45 involved multi-method interventions. Regardless of the number of interventions involved in the studies, ICT-based interventions were utilized by 71 studies and 59 of them were shown to be effective in reducing unnecessary testing. A clinical decision support (CDS) tool appeared to be the most adopted ICT approach, with 46 out of 71 studies using CDS tools. The CDS tool showed effectiveness in reducing test volume in 38 studies and reducing cost in 24 studies.

CONCLUSIONS

This review investigated five frequently utilized intervention methods, ICT-based, education, introduction of guidelines or protocols, audit and feedback, and reward and punishment. It provides in-depth analysis of the efficacy of different types of interventions and sheds insights about the benefits of ICT based interventions, especially those utilising CDS tools, to reduce unnecessary diagnostic testing. The replicability of the studies is limited due to the heterogeneity of the studies in terms of context, study design, and targeted types of tests.

Evaluation and cost estimation of laboratory test overuse in 43 commonly ordered parameters through a Computerized Clinical Decision Support System (CCDSS) in a large university hospital

BACKGROUND

Computerized Clinical Decision Support Systems (CCDSS) have become increasingly important in ensuring patient safety and supporting all phases of clinical decision making. The aim of this study is to evaluate, through a CCDSS, the rate of the laboratory tests overuse and to estimate the cost of the inappropriate requests in a large university hospital.

METHOD

In this observational study, hospital physicians submitted the examination requests for the inpatients through a Computerized Physician Order Entry. Violations of the rules in tests requests were intercepted and counted by a CCDSS, over a period of 20 months. Descriptive and inferential statistics (Student's t-test and ANOVA) were made. Finally, the monthly comprehensive cost of the laboratory tests was calculated.

RESULTS

During the observation period a total of 5,716,370 requests were analyzed and 809,245 violations were counted. The global rate of overuse was 14.2% ± 3.0%. The most inappropriate exams were Alpha Fetoprotein (85.8% ± 30.5%), Chlamydia trachomatis Nucleic Acid Amplification (48.7% ± 8.8%) and Alkaline Phosphatase (20.3% ± 6.5%). The monthly cost of over-utilization was 56,534€ for basic panel, 14,421€ for coagulation, 4,758€ for microbiology, 432€ for immunology exams. All the exams, generated an estimated avoidable cost of 1,719,337€ (85,967€ per month) for the hospital.

CONCLUSIONS

The study confirms the wide variability in over-utilization rates of laboratory tests. For these reasons, the real impact of inappropriateness is difficult to assess, but the generated costs for patients, hospitals and health systems are certainly high and not negligible. It would be desirable for international medical communities to produce a complete panel of prescriptive rules for all the most common laboratory exams that is useful not only to reduce costs, but also to ensure standardization and high-quality care.

Inappropriate laboratory testing in internal medicine inpatients: Prevalence, causes and interventions

BACKGROUND

To reduce overutilization of laboratory testing many interventions have been tried, but selecting the most effective intervention for a given setting is challenging. To be sustainable, interventions need to align with healthcare providers' needs and daily practices. This study aimed to assess the extent of overutilization and the perspectives of healthcare providers, which may be used to guide the choice of intervention.

METHODS

The extent of inappropriate laboratory testing in internal medicine inpatients was evaluated using a database. Surveys and focus groups were used to investigate healthcare providers' perceptions on its causes and solutions.

RESULTS

On average, patients had 5.7 laboratory orders done during the first week of admission, whereas guidelines advise performing laboratory testing no more than twice per week. Repeat testing of normal test results occurred in up to 85% of patients. The frequency of laboratory testing was underestimated by survey responders, even though the majority of responders (78%) thought that laboratory tests are ordered too frequently. Residents were considered to be most responsible for laboratory test ordering.The primary causes of overutilization discussed were personal factors, such as a lack of awareness and knowledge, as well as feelings of insecurity. Regarding possible solutions, residents generally recommended educational interventions, whereas specialists tended to favour technical solutions such as lockouts.

CONCLUSION

Inappropriate laboratory testing is common in internal medicine. The most important causes are a lack of awareness and knowledge, especially in residents. The intervention most favoured by residents is education, suggesting educational interventions may be most applicable.

Referral decisions and its predictors related to orthopaedic care. A retrospective study in a novel primary care setting

Due to the ageing population, the prevalence of musculoskeletal disorders will continue to rise, as well as healthcare expenditure. To overcome these increasing expenditures, integration of orthopaedic care should be stimulated. The Primary Care Plus (PC+) intervention aimed to achieve this by facilitating collaboration between primary care and the hospital, in which specialised medical care is shifted to a primary care setting. The present study aims to evaluate the referral decision following orthopaedic care in PC+ and in particular to evaluate the influence of diagnostic tests on this decision. Therefore, retrospective monitoring data of patients visiting PC+ for orthopaedic care was used. Data was divided into two periods; P1 and P2. During P2, specialists in PC+ were able to request additional diagnostic tests (such as ultrasounds and MRIs). A total of 2,438 patients visiting PC+ for orthopaedic care were included in the analysis. The primary outcome was the referral decision following PC+ (back to the general practitioner (GP) or referral to outpatient hospital care). Independent variables were consultation- and patient-related predictors. To describe variations in the referral decision, logistic regression modelling was used. Results show that during P2, significantly more patients were referred back to their GP. Moreover, the multivariable analysis show a significant effect of patient age on the referral decision (OR 0.86, 95% CI = 0.81-0.91) and a significant interaction was found between the treating specialist and the period (p = 0.015) and between patient's diagnosis and the period (p ≤ 0.001). Despite the significant impact of the possibility of requesting additional diagnostic tests in PC+, it is important to discuss the extent to which the availability of diagnostic tests fits within the vision of PC+. In addition, selecting appropriate profiles for specialists and patients for PC+ are necessary to further optimise the effectiveness and cost of care.

What Is Lean Management in Health Care? Development of an Operational Definition for a Cochrane Systematic Review

Industrial improvement approaches such as Lean management are increasingly being adopted in health care. Synthesis is necessary to ensure these approaches are evidence based and requires operationalization of concepts to ensure all relevant studies are included. This article outlines the process utilized to develop an operational definition of Lean in health care. The literature search, screening, data extraction, and data synthesis processes followed the recommendations outlined by the Cochrane Collaboration. Development of the operational definition utilized the methods prescribed by Kinsman et al. and Wieland et al. This involved extracting characteristics of Lean, synthesizing similar components to establish an operational definition, applying this definition, and updating the definition to address shortcomings. We identified two defining characteristics of Lean health-care management: (1) Lean philosophy, consisting of Lean principles and continuous improvement, and (2) Lean activities, which include Lean assessment activities and Lean improvement activities. The resulting operational definition requires that an organization or subunit of an organization had integrated Lean philosophy into the organization's mandate, guidelines, or policies and utilized at least one Lean assessment activity or Lean improvement activity. This operational definition of Lean management in health care will act as an objective screening criterion for our systematic review. To our knowledge, this is the first evidence-based operational definition of Lean management in health care.

Association of a Multifaceted Intervention With Ordering of Unnecessary Laboratory Tests Among Caregivers in Internal Medicine Departments

IMPORTANCE

Inappropriate use of laboratory testing is a challenging problem. Estimated overuse rates of approximately 20% have been reported. Effective, sustainable solutions to stimulate optimal use are needed.

OBJECTIVE

To determine the association of a multifaceted intervention with laboratory test volume.

DESIGN, SETTING, AND PARTICIPANTS

A before-after quality improvement study was performed between August 1, 2016, and April 30, 2018, in the internal medicine departments of 4 teaching hospitals in the Netherlands. Data on laboratory order volumes from 19 comparable hospitals were used as controls. The participants were clinicians ordering laboratory tests.

INTERVENTIONS

The intervention included creating awareness through education and feedback, intensified supervision of residents, and changes in order entry systems. Interventions were performed by local project teams and guided by a central project team during a 6-month period. Sustainability was investigated during an 8-month follow-up period.

MAIN OUTCOMES AND MEASURES

The primary outcome was the change in slope for laboratory test volume. Secondary outcomes were change in slope for laboratory expenditure, order volumes and expenditure for other diagnostic procedures, and clinical outcomes. Data were collected on duration of hospital stay, rate of repeated outpatient visits, 30-day readmission rate, and rate of unexpected prolonged duration of hospital stay for patients admitted for pneumonia.

RESULTS

The numbers of internists and residents ordering tests in hospitals 1 to 4 were 16 and 30, 18 and 20, 13 and 17, and 21 and 60, respectively. Statistically significant changes in slope for laboratory test volume per patient contact were found at hospital 1 (change in slope, -1.55; 95% CI, -1.98 to -1.11; P < .001), hospital 3 (change in slope, -0.74; 95% CI, -1.42 to -0.07; P = .03), and hospital 4 (change in slope, -2.18; 95% CI, -3.27 to -1.08; P < .001). At hospital 2, the change in slope was not statistically significant (-0.34; 95% CI, -2.27 to 1.58; P = .73). Laboratory test volume per patient contact decreased by 11.4%, whereas the volume increased by 2.4% in 19 comparable hospitals. Statistically significant changes in slopes for laboratory costs and volumes and costs for other diagnostic procedures were also observed. Clinical outcomes were not associated with negative changes. Important facilitators were education, continuous attention for overuse, feedback, and residents' involvement. Important barriers were difficulties in data retrieval, difficulty in incorporation of principles in daily practice, and high resident turnover.

CONCLUSIONS AND RELEVANCE

A set of interventions aimed at changing caregivers' mindset was associated with a reduction in the laboratory test volume in all departments, whereas the volume increased in comparable hospitals in the Netherlands. This study provides a framework for nationwide implementation of interventions to reduce unnecessary laboratory testing.

The sustainable impact of an educational approach to improve the appropriateness of laboratory test orders in the ICU

INTRODUCTION

Few studies described strategies to improve the use of diagnostic tests in intensive care units (ICU). No study assessed whether their impact was sustained or not. In this study, we assessed whether a multi-faceted intervention for more appropriate use of laboratory testing can decrease the number of tests, is sustainable, is not associated with additional morbidity and represents a potential cost saving.

MATERIAL AND METHODS

An open-label prospective cohort study in two separated units of the same medical intensive care unit (ICU) including respectively 3315 and 2392 consecutive patients. After the observation period (2010), a reduction in ICU A of unnecessary diagnostics tests as part of a program including senior supervisory of juniors' orders, encouragements for orders containment at each everyday round discussions (period 2; 2011). Period 3 (2012) consisted in the prolongation of the protocol as a routine care without supervision; Period 4 (2013) was a new period of observation without intervention. No modification was implemented in ICU B in periods 2-4.

RESULTS

After the intervention, a decrease in the overall number of tests per ICU-patient-days (37.3±5.5 (baseline) to 15.2±3.2 (- 59%); p<0.0001) was observed. The total cost of the tests decreased from 239±41 to 104±28 euros per ICU-patient days; p<0.0001. The effect on laboratory test orders was sustainable in period 3 (-49%) and 4 (-30%). No significant secondary effect of the intervention was observed in period 2. In ICU B, there was no significant change in the overall laboratory test orders in between the periods.

CONCLUSIONS

Laboratory test containment is effective, likely safe and sustainable provided that an educational program is repeatedly promoted, that it makes sense for the whole team, that senior and junior physicians are both committed in the program, and that encouragements for laboratory orders containment at each everyday round discussions.

Reducing Test Utilization in Hospital Settings: A Narrative Review

Background

Studies addressing the appropriateness of laboratory testing have revealed approximately 20% overutilization. We conducted a narrative review to (1) describe current interventions aimed at reducing unnecessary laboratory testing, specifically in hospital settings, and (2) provide estimates of their efficacy in reducing test order volume and improving patient-related clinical outcomes.

Methods

The PubMed, Embase, Scopus, Web of Science, and Canadian Agency for Drugs and Technologies in Health-Health Technology Assessment databases were searched for studies describing the effects of interventions aimed at reducing unnecessary laboratory tests. Data on test order volume and clinical outcomes were extracted by one reviewer, while uncertainties were discussed with two other reviewers. Because of the heterogeneity of interventions and outcomes, no meta-analysis was performed.

Results

Eighty-four studies were included. Interventions were categorized into educational, (computerized) provider order entry [(C)POE], audit and feedback, or other interventions. Nearly all studies reported a reduction in test order volume. Only 15 assessed sustainability up to two years. Patient-related clinical outcomes were reported in 45 studies, two of which found negative effects.

Conclusions

Interventions from all categories have the potential to reduce unnecessary laboratory testing, although long-term sustainability is questionable. Owing to the heterogeneity of the interventions studied, it is difficult to conclude which approach was most successful, and for which tests. Most studies had methodological limitations, such as the absence of a control arm. Therefore, well-designed, controlled trials using clearly described interventions and relevant clinical outcomes are needed.

A Multicenter Before-After Study on Reducing Unnecessary Diagnostics by Changing the Attitude of Caregivers: Protocol for the RODEO Project

Background

Appropriate use of diagnostic laboratory tests is challenging, and estimates of 20% for overutilization and 45% for underutilization have been reported. Introducing effective and sustainable solutions to stimulate optimal use of laboratory testing in clinical practice is a challenge. A recent pilot study from our group, focusing on increasing the awareness about appropriate laboratory testing with the aim of changing the mindset of health care workers, has shown promising results. In this project, we aim to extend this multistep intervention to the internal medicine departments of 4 large Dutch hospitals. We aim to reduce unnecessary laboratory testing by 5%.

Objective

Our primary objective is to determine the effect of our intervention on diagnostic laboratory test order volume. Our secondary objectives are to determine the effect of our intervention on laboratory expenditure and order volumes, expenditures for other diagnostic modalities, and clinical patient outcomes. We will also analyze the barriers and facilitators for deimplementation of unnecessary laboratory testing.

Methods

The main interventions of this before-after study will be an intensified supervision of residents by experienced physicians regarding test ordering, creating awareness through education and monthly feedback on ordering patterns, and changes in (computerized) order entry systems.

Results

At the time of publication of this protocol, the project is in the phase of data collection. We expect to present data on reduction early in the fourth quarter of 2018.

Conclusions

In this project, we aim to reduce the unnecessary diagnostic testing in the internal medicine departments of 4 teaching hospitals. Although the main interventions will be similar, each clinic is given the opportunity to focus on the specific facets of the interventions as deemed useful according to the local situation. If effective, the study provides a framework for a nationwide initiative for reducing inappropriate laboratory testing.

Registered Report Identifier

RR1-10.2106/10473

Lean Management to support Choosing Wisely in healthcare: the first evidence from a systematic literature review

Purpose

Choosing Wisely (CW) is an emergent approach to identify and reduce unnecessary care, such as tests and treatments that do not add value for patients and may even cause harm. The purpose of this paper is to investigate whether and how Lean Healthcare Management (LHM) can support CW objectives, focusing on customer needs and on waste elimination.

Data sources

A systematic literature review has been performed in Scopus, PubMed and Web of Science.

Study selection

Peer reviewed articles published in English language have been selected. Papers were considered if they regarded LHM and its possible support for achieving CW objectives. Data extraction. The links between the LHM purposes of adoption and the pursued CW objectives were investigated. Moreover, LHM tools, practices and interventions to support CW were grasped.

Results of data synthesis

Sixteen articles were included in the analysis. Links between the identified LHM purposes of adoption and CW objectives were discovered: through process understanding, optimization, evaluation and control, LHM contributes to the reduction of overuses in healthcare, but also to the delivery of a more effective and evidence-based care (EBC). Moreover, it provides an objective approach useful for choosing the most cost-effective solution among different alternatives.

Conclusions

Results highlight how LHM, and with which tools and practices, can be adopted to enhance the healthcare appropriateness pursued by CW, paving the way for interesting future research about this emerging topic.

Effectiveness of Practices to Support Appropriate Laboratory Test Utilization: A Laboratory Medicine Best Practices Systematic Review and Meta-Analysis

Objectives

To evaluate the effectiveness of practices used to support appropriate clinical laboratory test utilization.

Methods

This review followed the Centers for Disease Control and Prevention (CDC) Laboratory Medicine Best Practices A6 cycle method. Eligible studies assessed one of the following practices for effect on outcomes relating to over- or underutilization: computerized provider order entry (CPOE), clinical decision support systems/tools (CDSS/CDST), education, feedback, test review, reflex testing, laboratory test utilization (LTU) teams, and any combination of these practices. Eligible outcomes included intermediate, systems outcomes (eg, number of tests ordered/performed and cost of tests), as well as patient-related outcomes (eg, length of hospital stay, readmission rates, morbidity, and mortality).

Results

Eighty-three studies met inclusion criteria. Fifty-one of these studies could be meta-analyzed. Strength of evidence ratings for each practice ranged from high to insufficient.

Conclusion

Practice recommendations are made for CPOE (specifically, modifications to existing CPOE), reflex testing, and combined practices. No recommendation for or against could be made for CDSS/CDST, education, feedback, test review, and LTU. Findings from this review serve to inform guidance for future studies.

Reducing Inappropriate Testing for the Evaluation of Diarrhea Among Hospitalized Patients

BACKGROUND

Diarrhea is one of the most common illnesses in the United States. Evaluation frequently does not follow established guidelines. The objective of this study was to evaluate the effectiveness of a computerized physician order entry-based test guidance algorithm with regard to the clinical, financial, and operational impacts.

METHODS

Our population was patients with diarrheal illness at a tertiary academic medical center. The intervention was a computerized physician order entry-based test guidance algorithm that restricted the use of stool cultures and ova and parasites testing of diarrhea in the adult inpatient location vs nonintervention sites, which were the emergency department, pediatric inpatient and adult and pediatric outpatient locations. We measured stool culture, ova and parasites, and Clostridium difficile testing rates from July 1, 2012 to January 31, 2016. Additionally, we calculated advisor usage, consults generated, accuracy of information, and cost savings.

RESULTS

There was a significant decrease in stool culture and ova and parasites testing rates at the adult inpatient (P = .001 for both), pediatric (P < .001 for both), and adult emergency department (P < .001; P = .009) locations. The decrease at the intervention site was immediate, whereas the other locations showed a delayed but sustained decrease that suggests a collateral impact. A significant increase in the rate of stool culture and ova and parasites testing was observed in the outpatient setting (P = .02 and P = .001). We estimate that $21,931 was saved annually.

CONCLUSIONS

A point-of-order test restriction algorithm for hospitalized adults with diarrhea reduced stool testing. Similar programs should be considered at other institutions and for the evaluation of other conditions.

Influence of Institution-Based Factors on Preoperative Blood Testing Prior to Low-Risk Surgery: A Bayesian Generalized Linear Mixed Approach

To optimize delivery of health care services in clinical practice, the use of unnecessary interventions should be reduced. Although recommendations for this reduction have been accepted worldwide, recent studies have revealed that the use of such procedures continues to increase. We conducted a retrospective cohort study using a nationwide claim-based database to evaluate factors influencing preoperative blood testing prior to low-risk surgery, via a Bayesian generalized linear mixed approach. The study period was set from April 1, 2012, to March 31, 2016, and 69,252 surgeries performed at 9,922 institutions were included in the analysis. Mean patient age was 44.3 ± 11.3 years (57% female). Preoperative blood tests were performed for 59.0% of procedures. Among institutional factors, the number of beds was strongly associated with preoperative blood testing (odds ratio [95% highest posterior density interval (HPD interval)], 2.64 [2.53 to 2.75]). The difference (95% credible interval) in the rate of preoperative blood testing between institutions with <100 beds and ≥100 beds was 0.315 [0.309 to 0.322], and the Bayesian index θ was 1.00. This indicated that preoperative blood tests are strongly influenced by institutional factors, suggesting that specific guidelines should be developed to avoid excessive preoperative testing for low-risk surgery.

Improving the clinic-laboratory-interface in the context of HIV diagnosis, treatment, and monitoring

PURPOSE OF REVIEW

Laboratory support is central to clinical medicine. The present review focuses on the health systems strengthening needs of the clinic-laboratory-interface (CLI) in developing countries within the context of HIV diagnosis, treatment, and monitoring.

RECENT FINDINGS

Although significant improvements have been made in reducing error rates in the analytical phase of pathology services within laboratories, there remain substantial deficits in both the preanalytic and postanalytic phases of the entire value chain that require strengthening. Recent interventions have largely aimed at improving the CLI focus through technological advancements. Although these are important, addressing CLI deficiencies within the context of the World Health Organization's health systems strengthening building blocks has been relatively neglected, and data are very limited in resource-limited countries. Broad health systems strengthening in the CLI is required. The present study reviews the key elements of the CLI associated with poor laboratory functioning, and proposes specific areas for improvement. The present study discuss case studies in South Africa and India, as well as reviewing data supporting interventions in public health clinics to improve the CLI.

SUMMARY

The CLI is a neglected area of the laboratory value chain. Reducing errors and increasing efficiencies will improve the laboratory service to patients.

Practical motives are prominent in test-ordering in the Emergency Department

Background:

Laboratory test ordering under time pressure may impact test-ordering behavior.

Methods:

To investigate the test-ordering behavior of doctors working under such pressure, we designed a questionnaire for trainees and staff in the Emergency Department (ED). This questionnaire addressed topics such as necessity of requested tests, time spent on ordering, costs and availability of tests, and the time of the day. We hypothesized that ordering behavior would be guided predominantly by the medical need of tests and aimed at identifying practical motives that also have an effect.

Results:

Remarkably, two-third of the respondents (67%) admitted that tests were ordered that would not influence treatment policy directly and 48% of the doctors stated that tests were ordered that do not impact treatment at all. The frequency of such orders was “sometimes” and “frequent” in a 50:50 ratio. Interestingly, tests that could prove relevant at a later stage are often ordered simultaneously to reduce burden on the patient. None of the respondents spent more than 3 min on the ordering process and very few (8%) desired more time for ordering. Most respondents (81%) declared to have limited knowledge of the costs of laboratory tests. A random survey covering four tests confirmed this. Generally, turnaround time did influence ordering behavior while time of the day did not.

Conclusions:

In conclusion, doctors in an ED – besides first of all medical motives – heavily exploit practical (non-medical) reasoning for laboratory test ordering, e.g. taking availability of tests into account and ordering non-immediate tests.

Implementing operations strategy through Lean processes within health care

Purpose

The purpose of this paper is to investigate how operations strategy and Lean concepts can be applied within a healthcare organisation and the degree to which both Lean and operations strategy are understood by senior-level National Health Service (NHS) personnel, based on the process of ongoing longitudinal cases studies. Further interviews and data analysis will examine actual performance of Lean capabilities within the NHS.

Design/methodology/approach

For this explanatory multiple-case study project the authors collected data through semi-structured interviews with executives in the NHS to understand how operations strategies are developed in the NHS and implemented in NHS hospitals. The unit of analysis is the hospital. Multiple (22) interviews took place over 12 months with senior-level personnel responsible for implementing change via operations strategy goals, and incorporating Lean initiatives. In addition, to triangulate data, the authors examined healthcare reports and strategy policy documents from each case hospital. This forms stage 1 of a longitudinal study which will examine the actual performance of Lean within the NHS hospitals across a range of operations parameters and explore links between such capabilities and the role and importance of operations strategy in more detail.

Findings

The findings lead to the conclusion that operations strategies were not fully developed within the hospitals. In addition, the ongoing data capture shows that “Best practice” was not being disseminated across the NHS, for either patient experience or organisational effectiveness and the role of operations strategy was not fully clear other than as a rather vague “umbrella” term. Despite Lean’s attraction for healthcare at a micro-level, significant operational and cultural hurdles must be overcome for the full strategic benefits of Lean to be realised. A much more holistic approach in providing a full service for the whole of the patient journey is needed.

Research limitations/implications

The sample provides an initial snapshot. A larger number of hospitals and/or further longitudinal research will be needed to deepen understanding of embedding strategic change to improve overall performance.

Practical implications

Tackling cultural performance and operational issues at a macro-level could help healthcare providers reconcile the perceived conflicting goals of improving patient care (i.e. service delivery) whilst simultaneously reducing costs. The role of explicit operations strategies could be pivotal in designing and implementing such change.

Originality/value

This research builds on and extends the work of Toussaint and Berry (2013), Seddon and O’Donovan (2010) and Carlborg and Kowalkowski (2013). The authors highlight how some of the apparent contradictions in the requirements of the various stakeholders create operational and strategic tensions. The authors highlight the multi-faceted nature of design and delivery of a multi-touchpoint service within the complexity of a large healthcare provider.

An unsupervised learning method to identify reference intervals from a clinical database

Reference intervals are critical for the interpretation of laboratory results. The development of reference intervals using traditional methods is time consuming and costly. An alternative approach, known as an a posteriori method, requires an expert to enumerate diagnoses and procedures that can affect the measurement of interest. We develop a method, LIMIT, to use laboratory test results from a clinical database to identify ICD9 codes that are associated with extreme laboratory results, thus automating the a posteriori method. LIMIT was developed using sodium serum levels, and validated using potassium serum levels, both tests for which harmonized reference intervals already exist. To test LIMIT, reference intervals for total hemoglobin in whole blood were learned, and were compared with the hemoglobin reference intervals found using an existing a posteriori approach. In addition, prescription of iron supplements were used to identify individuals whose hemoglobin levels were low enough for a clinician to choose to take action. This prescription data indicating clinical action was then used to estimate the validity of the hemoglobin reference interval sets. Results show that LIMIT produces usable reference intervals for sodium, potassium and hemoglobin laboratory tests. The hemoglobin intervals produced using the data driven approaches consistently had higher positive predictive value and specificity in predicting an iron supplement prescription than the existing intervals. LIMIT represents a fast and inexpensive solution for calculating reference intervals, and shows that it is possible to use laboratory results and coded diagnoses to learn laboratory test reference intervals from clinical data warehouses.

Improving Hospital Laboratory Performance: Implications for Healthcare Managers

Laboratory services in healthcare delivery systems play a vital role in inpatient care. Studies have shown that laboratory data affects approximately 65% of the most critical decisions on admission, discharge, and medication. Laboratory testing accounts for approximately 10% of hospital billing. Reducing laboratory costs and improving laboratory performance would contribute to reducing total healthcare cost, which is one of the major goals for the U.S. healthcare delivery system. The objective of this paper is to review and analyze the diverse research approaches applied to improve the performance of hospital laboratories in large healthcare delivery systems. The approaches reviewed include: lean, quality control, automation, and simulation modeling. In the conclusion, future research directions are presented, which include additional methods to be investigated to further improve the performance of hospital laboratories.

Applying Task-Technology Fit Model to the Healthcare Sector: a Case Study of Hospitals' Computed Tomography Patient-Referral Mechanism

With the growth in the number of elderly and people with chronic diseases, the number of hospital services will need to increase in the near future. With myriad of information technologies utilized daily and crucial information-sharing tasks performed at hospitals, understanding the relationship between task performance and information system has become a critical topic. This research explored the resource pooling of hospital management and considered a computed tomography (CT) patient-referral mechanism between two hospitals using the information system theory framework of Task-Technology Fit (TTF) model. The TTF model could be used to assess the 'match' between the task and technology characteristics. The patient-referral process involved an integrated information framework consisting of a hospital information system (HIS), radiology information system (RIS), and picture archiving and communication system (PACS). A formal interview was conducted with the director of the case image center on the applicable characteristics of TTF model. Next, the Icam DEFinition (IDEF0) method was utilized to depict the As-Is and To-Be models for CT patient-referral medical operational processes. Further, the study used the 'leagility' concept to remove non-value-added activities and increase the agility of hospitals. The results indicated that hospital information systems could support the CT patient-referral mechanism, increase hospital performance, reduce patient wait time, and enhance the quality of care for patients.

A cost-benefit analysis of twice-daily consultant ward rounds and clinical input on investigation and pharmacy costs in a major teaching hospital in the UK

OBJECTIVES

Misuse of investigations, medications and hospital beds is costing the National Health Service (NHS) billions of pounds with little evidence that approaches centred on reducing overuse are sustainable. Our previous study demonstrated that twice-daily consultant ward rounds reduce inpatient length of stay and suggested a reduction in overuse of investigations and medications. This study aims to assess the impact of daily consultant ward rounds on the use of investigations and medications and estimate the potential cost benefit.

SETTINGS

The study was performed on two medical wards in a major city university teaching hospital in Liverpool, UK, receiving acute admissions from medical assessment and emergency departments.

PARTICIPANTS AND INTERVENTION

The total number of patients admitted, investigations performed and pharmacy costs incurred were collected for 2 years before and following a change in the working practice of consultants from twice-weekly to twice-daily consultant ward rounds on the two medical wards.

OUTCOME MEASURES

We performed a cost-benefit analysis to assess the net amount of money saved by reducing inappropriate investigations and pharmacy drug use following the intervention.

RESULTS

Despite a 70% increase in patient throughput (p<0.01) the investigations and pharmacy, costs per patient reduced by 50% over a 12-month period (p<0.01) and were sustained for the next 12 months. The reduction in investigations and medication use did not have any effect on the readmission or mortality rate (p=NS), whereas, the length of stay was almost halved (p<0.01). Daily senior clinician input resulted in a net cost saving of £336,528 per year following the intervention.

CONCLUSIONS

Daily consultant input has a significant impact on reducing the inappropriate use of investigations and pharmacy costs saving the NHS more than £650K on the two wards over a 2-year period.

Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol)

BACKGROUND

Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer's needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited.

METHODS

This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case-control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form.

DISCUSSION

Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42014008853.

Choosing wisely for syncope: low-value carotid ultrasound use

Background

The United States spends more than $750 billion annually on tests and procedures that do not benefit patients. Although there is no physiological indication for carotid ultrasound in “simple” syncope in the absence of focal neurological signs or symptoms suggestive of stroke, there is concern that this practice remains common for routine syncope workups.

Methods and Results

We used a 5% random‐sample Medicare claims database to evaluate large‐scale national trends in utilization of low‐value carotid ultrasound imaging for simple syncope. We found that 16.5% of all Medicare beneficiaries with simple syncope underwent carotid imaging and 6.5% of all carotid ultrasounds ordered in 2009 were for this low‐value indication. These findings were complemented by a manual chart review of 313 patients at a large academic medical center who underwent carotid ultrasound for simple syncope over a 5‐year period. For the 48 (15.4%) of 313 patients with stenosis ≥50%, carotid ultrasound did not yield a causal diagnosis. Only 2% of the 313 patients imaged experienced a change in medications after a positive study, and <1% of patients underwent a carotid revascularization procedure.

Conclusions

These data suggest that carotid ultrasound for patients with uncomplicated syncope are still commonly ordered and may be an easy target for institutions striving to curtail low‐value care.