Workload and workflow implications associated with the use of electronic clinical decision support tools used by health professionals in general practice: a scoping review

BACKGROUND

Electronic clinical decision support tools (eCDS) are increasingly available to assist General Practitioners (GP) with the diagnosis and management of a range of health conditions. It is unclear whether the use of eCDS tools has an impact on GP workload. This scoping review aimed to identify the available evidence on the use of eCDS tools by health professionals in general practice in relation to their impact on workload and workflow.

METHODS

A scoping review was carried out using the Arksey and O'Malley methodological framework. The search strategy was developed iteratively, with three main aspects: general practice/primary care contexts, risk assessment/decision support tools, and workload-related factors. Three databases were searched in 2019, and updated in 2021, covering articles published since 2009: Medline (Ovid), HMIC (Ovid) and Web of Science (TR). Double screening was completed by two reviewers, and data extracted from included articles were analysed.

RESULTS

The search resulted in 5,594 references, leading to 95 full articles, referring to 87 studies, after screening. Of these, 36 studies were based in the USA, 21 in the UK and 11 in Australia. A further 18 originated from Canada or Europe, with the remaining studies conducted in New Zealand, South Africa and Malaysia. Studies examined the use of eCDS tools and reported some findings related to their impact on workload, including on consultation duration. Most studies were qualitative and exploratory in nature, reporting health professionals' subjective perceptions of consultation duration as opposed to objectively-measured time spent using tools or consultation durations. Other workload-related findings included impacts on cognitive workload, "workflow" and dialogue with patients, and clinicians' experience of "alert fatigue".

CONCLUSIONS

The published literature on the impact of eCDS tools in general practice showed that limited efforts have focused on investigating the impact of such tools on workload and workflow. To gain an understanding of this area, further research, including quantitative measurement of consultation durations, would be useful to inform the future design and implementation of eCDS tools.

Impact of an Electronic Health Record Pain Medication Prescribing Tool on Opioid Prescriptions for Postoperative Pain in Hand, Orthopedic, Plastic, and Spine Surgery Across a Health Care System

PURPOSE

We hypothesized that a pain management prescribing tool embedded in the electronic health record system of a multihospital health care system would decrease prescription opioids for postoperative pain by hand, orthopedic, plastic, and spine surgeons.

METHODS

A prescribing tool for postoperative pain was designed for hand, orthopedic, plastic, and spine surgeons and implemented into electronic discharge order sets in a 10-hospital health care system. Stakeholders were educated on tool use in person and/or by email on 2 occasions. A dashboard was created to monitor opioid pill quantities and morphine milligram equivalents (MMEs) prescribed. Overall compliance with the suggested opioid amounts was assessed for 20 months after tool implementation. A subgroup of 6 hand surgeons, one of whom was instrumental in designing the tool, were evaluated for MMEs prescribed, opioid refills, patient emergency room visits, and patient readmissions within 30 days after discharge. Comparisons in this subgroup were made from 12 months before to 15 months after tool implementation.

RESULTS

The mean system-wide compliance with the suggested opioid pill quantities and MMEs prescribed in all 4 specialties improved by less than 5%. In the subgroup of hand surgeons, 5 of whom championed tool use, prescribed MMEs decreased by 10% during each of the 4 quarters before launching the tool and contracted an additional 26% in the first quarter after tool implementation. Opioid refills held steady at 5%, and there were no emergency room visits or readmissions within 30 days after discharge in this patient subgroup.

CONCLUSIONS

The prescribing tool had a negligible impact on system-wide compliance with suggested prescription opioid pill quantities and MMEs. In a small group of surgeons who championed the use of the tool, there was a significant and sustained decline in MMEs prescribed without adversely impacting patient refills, emergency room visits, or readmissions.

CLINICAL RELEVANCE

An electronic prescribing tool to assist surgeons in lowering opioid prescription pill quantities and MMEs may have a negligible impact on prescribing behavior in a multihospital health care system.

Electronic clinical decision support for children with minor head trauma and intracranial injuries: a sociotechnical analysis

BACKGROUND

Current management of children with minor head trauma (MHT) and intracranial injuries is not evidence-based and may place some children at risk of harm. Evidence-based electronic clinical decision support (CDS) for management of these children may improve patient safety and decrease resource use. To guide these efforts, we evaluated the sociotechnical environment impacting the implementation of electronic CDS, including workflow and communication, institutional culture, and hardware and software infrastructure, among other factors.

METHODS

Between March and May, 2020 semi-structured qualitative focus group interviews were conducted to identify sociotechnical influences on CDS implementation. Physicians from neurosurgery, emergency medicine, critical care, and pediatric general surgery were included, along with information technology specialists. Participants were recruited from nine health centers in the United States. Focus group transcripts were coded and analyzed using thematic analysis. The final themes were then cross-referenced with previously defined sociotechnical dimensions.

RESULTS

We included 28 physicians and four information technology specialists in seven focus groups (median five participants per group). Five physicians were trainees and 10 had administrative leadership positions. Through inductive thematic analysis, we identified five primary themes: (1) clinical impact; (2) stakeholders and users; (3) tool content; (4) clinical practice integration; and (5) post-implementation evaluation measures. Participants generally supported using CDS to determine an appropriate level-of-care for these children. However, some had mixed feelings regarding how the tool could best be used by different specialties (e.g. use by neurosurgeons versus non-neurosurgeons). Feedback from the interviews helped refine the tool content and also highlighted potential technical and workflow barriers to address prior to implementation.

CONCLUSIONS

We identified key factors impacting the implementation of electronic CDS for children with MHT and intracranial injuries. These results have informed our implementation strategy and may also serve as a template for future efforts to implement health information technology in a multidisciplinary, emergency setting.

Determining post-test risk in a national sample of stress nuclear myocardial perfusion imaging reports: Implications for natural language processing tools

BACKGROUND

Reporting standards promote clarity and consistency of stress myocardial perfusion imaging (MPI) reports, but do not require an assessment of post-test risk. Natural Language Processing (NLP) tools could potentially help estimate this risk, yet it is unknown whether reports contain adequate descriptive data to use NLP.

METHODS

Among VA patients who underwent stress MPI and coronary angiography between January 1, 2009 and December 31, 2011, 99 stress test reports were randomly selected for analysis. Two reviewers independently categorized each report for the presence of critical data elements essential to describing post-test ischemic risk.

RESULTS

Few stress MPI reports provided a formal assessment of post-test risk within the impression section (3%) or the entire document (4%). In most cases, risk was determinable by combining critical data elements (74% impression, 98% whole). If ischemic risk was not determinable (25% impression, 2% whole), inadequate description of systolic function (9% impression, 1% whole) and inadequate description of ischemia (5% impression, 1% whole) were most commonly implicated.

CONCLUSIONS

Post-test ischemic risk was determinable but rarely reported in this sample of stress MPI reports. This supports the potential use of NLP to help clarify risk. Further study of NLP in this context is needed.

Evaluating a computer aid for assessing stomach symptoms (ECASS): study protocol for a randomised controlled trial

BACKGROUND

For most cancers, only a minority of patients have symptoms meeting the National Institute for Health and Clinical Excellence guidance for urgent referral. For gastro-oesophageal cancers, the 'alarm' symptoms of dysphagia and weight loss are reported by only 32 and 8 % of patients, respectively, and their presence correlates with advanced-stage disease. Electronic clinical decision-support tools that integrate with clinical computer systems have been developed for general practice, although uncertainty remains concerning their effectiveness. The objectives of this trial are to optimise the intervention and establish the acceptability of both the intervention and randomisation, confirm the suitability and selection of outcome measures, finalise the design for the phase III definitive trial, and obtain preliminary estimates of the intervention effect.

METHODS/DESIGN

This is a two-arm, multi-centre, cluster-randomised, controlled phase II trial design, which will extend over a 16-month period, across 60 general practices within the North East and North Cumbria and the Eastern Local Clinical Research Network areas. Practices will be randomised to receive either the intervention (the electronic clinical decision-support tool) or to act as a control (usual care). From these practices, we will recruit 3000 adults who meet the trial eligibility criteria and present to their GP with symptoms suggestive of gastro-oesophageal cancer. The main measures are the process data, which include the practitioner outcomes, service outcomes, diagnostic intervals, health economic outcomes, and patient outcomes. One-on-one interviews in a sub-sample of 30 patient-GP dyads will be undertaken to understand the impact of the use or non-use of the electronic clinical decision-support tool in the consultation. A further 10-15 GPs will be interviewed to identify and gain an understanding of the facilitators and constraints influencing implementation of the electronic clinical decision-support tool in practice.

DISCUSSION

We aim to generate new knowledge on the process measures regarding the use of electronic clinical decision-support tools in primary care in general and to inform a subsequent definitive phase III trial. Preliminary data on the impact of the support tool on resource utilisation and health care costs will also be collected.

TRIAL REGISTRATION

ISRCTN Registry, ISRCTN12595588 .

Decline in mortality with the Belize Integrated Patient-Centred Country Wide Health Information System (BHIS) with embedded program management

BACKGROUND

Belize deployed a country-wide fully integrated patient centred health information system with eight embedded disease management algorithms and simple analytics in 2007 for $4 (Cad)/citizen.

OBJECTIVES

This study evaluated BHIS uptake by health care workers, and pre and post BHIS deployment mortality in selected areas and public health care expenditures.

METHODS

BHIS encounter data were compared to encounter data from required Ministry of Health reports from licensed health care entities. De-identified vital statistics death data for the eight BHIS protocol disease domains and three non-protocol domains were compared from 2005 to 2011. Belize population data came from the Statistical Institute of Belize (2005-2009) and from Belize census (2010) and estimate (2011). Public health system expenditures were compared by fiscal years (2000-2012).

RESULTS

BHIS captured over 90% healthcare encounters by year one, 95% by year two. Mortality rates decreased in the eight BHIS protocol domains (each 2005 vs. 2011, all p<0.02) vs. an increase or little change in the three domains without protocols. Hypertension related deaths dropped from 1st cause of death in 2003 to 9th by 2010. Public expenditures on healthcare steadily rose until 2009 but then declined slightly for the next 3 years.

CONCLUSION

For modest investment, BHIS was well accepted nationwide and following deployment, mortality in the eight BHIS disease management algorithm domains declined significantly and expenditures on public healthcare stabilized.