Embedding new technologies in practice - a normalization process theory study of point of care testing

Implementation considerations for a point-of-care Neisseria gonorrhoeae rapid diagnostic test at primary healthcare level in South Africa: a qualitative study

BACKGROUND

South Africa maintains an integrated health system where syndromic management of sexually transmitted infections (STI) is the standard of care. An estimated 2 million cases of Neisseria gonorrhoeae (N. gonorrhoeae) occur in South Africa every year. Point-of-care diagnostic tests (POCT) may address existing STI control limitations such as overtreatment and missed cases. Subsequently, a rapid lateral flow assay with fluorescence-based detection (NG-LFA) with a prototype reader was developed for N. gonorrhoeae detection showing excellent performance and high usability; however, a better understanding is needed for device implementation and integration into clinics.

METHODS

A qualitative, time-series assessment using 66 in-depth interviews was conducted among 25 trained healthcare workers involved in the implementation of the NG-LFA. Findings were informed by the Normalization Process Theory (NPT) as per relevant contextual (strategic intentions, adaptive execution, and negotiation capacity) and procedural constructs (coherence, cognitive participation, collective action, reflexive monitoring) to examine device implementation within primary healthcare levels. Interviews were audio-recorded, transcribed, and then analyzed using a thematic approach guided by NPT to interpret results.

RESULTS

Overall, healthcare workers agreed that STI POCT could guide better STI clinical decision-making, with consideration for clinic integration such as space constraints, patient flow, and workload. Perceived NG-LFA benefits included enhanced patient receptivity and STI knowledge. Further, healthcare workers reflected on the suitability of the NG-LFA given current limitations with integrated primary care. Recommendations included sufficient STI education, and appropriate departments for first points of entry for STI screening.

CONCLUSIONS

The collective action and participation by healthcare workers in the implementation of the NG-LFA revealed adaptive execution within the current facility environment including team compositions, facility-staff receptivity, and STI management experiences. User experiences support future clinic service integration, highlighting the importance of further assessing patient-provider communication for STI care, organizational readiness, and identification of relevant departments for STI screening.

'Smart' BLE wearables for digital contact tracing in care homes during the COVID-19 pandemic-a process evaluation of the CONTACT feasibility study

BACKGROUND

Rapid and mass transmission of the SARS-CoV-2 virus amongst vulnerable people led to devastating effects from COVID-19 in care homes. The CONTACT intervention introduced Bluetooth Low Energy 'smart' wearable devices (BLE wearables) as a basis for automated contact tracing in, and feedback on infection risks and patterns to, care homes to try and improve infection prevention and control (IPC). We planned a cluster randomised controlled trial (RCT) of CONTACT. To be feasible, homes had to adopt CONTACT's technology and new ways of working. This paper reports on the process evaluation conducted alongside CONTACT's feasibility study and explains why it lacked the feasibility and acceptability for a definitive RCT.

METHODS

This mixed method process evaluation used Normalisation Process Theory (NPT) qualitative (interviews, field notes, study case report forms and documents, and observation) and quantitative (survey instruments, counts of activity) data to plan, implement, and analyse the mechanisms, effects, and contextual factors that shaped the feasibility and acceptability of the CONTACT intervention.

RESULTS

Thirteen themes within four core NPT constructs explained CONTACT's lack of feasibility. Coherence: the home's varied in the scale and extent of commitment and understanding of the technology and study procedures. Leadership credibility was important but compromised by competing priorities. Management and direct care staff saw CONTACT differently. Work to promote (cognitive participation) and enact (collective action) CONTACT was burdensome and failed to be prioritised over competing COVID-19-related demands on time and scarce human and cognitive resources. Ultimately, staff appraisal of the value of CONTACT-generated information and study procedures (reflexivity) was that any utility for IPC was insufficient to outweigh the perceived burden and complexity involved.

CONCLUSIONS

Despite implementation failure, dismissing BLE wearables' potential for contact tracing is premature. In non-pandemic conditions, with more time, better co-design and integration of theory-driven implementation strategies tailored to care homes' unique contexts, researchers could enhance normalisation in readiness for future pandemic challenges.

TRIAL REGISTRATION

ISRCTN registration: 11,204,126 registered 17/02/2021.

Developing and testing the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide for primary care providers using think-aloud, near-live, and interview procedures

BACKGROUND

Canada's 24-Hour Movement Guidelines for Adults have shifted the focus from considering movement behaviours (i.e., physical activity, sedentary behaviour, and sleep) separately to a 24-h paradigm, which considers how they are integrated. Accordingly, primary care providers (PCPs) have the opportunity to improve their practice to promote all movement behaviours cohesively. However, PCPs have faced barriers to discussing physical activity alone (e.g., time, competing priorities, inadequate training), leading to low frequency of physical activity discussions. Consequently, discussing three movement behaviours may seem challenging. Tools to facilitate primary care discussions about physical activity have been developed and used; however, few have undergone usability testing and none have integrated all movement behaviours. Following a synthesis of physical activity, sedentary behaviour, and sleep tools for PCPs, we developed the Whole Day Matters Tool and User Guide that incorporate all movement behaviours. The present study aimed to explore PCPs' perceptions on the usability, acceptability, and future implementation of the Whole Day Matters Tool and User Guide to improve their relevancy among PCPs.

METHODS

Twenty-six PCPs were observed and audio-video recorded while using the Tool and User Guide in a think-aloud procedure, then in a near-live encounter with a mock service-user. A debriefing interview using a guide informed by Normalization Process Theory followed. Recordings were transcribed verbatim and analysed using content analysis and a critical friend to enhance rigour.

RESULTS

PCPs valued aspects of the Tool and User Guide including their structure, user-friendliness, visual appeal, and multi-behaviour focus and suggested modifications to improve usability and acceptability. Findings are further discussed in the context of Normalization Process Theory and previous literature.

CONCLUSIONS

The Tool and User Guide were revised, including adding plain language, reordering and renaming sections, reducing text, and clarifying instructions. Results also informed the addition of a Preamble and a Handout for adults accessing care (i.e., patients/clients/service-users) to explain the evidence underpinning the 24-Hour Movement Guidelines for Adults and support a person-centered approach. These four resources (i.e., Tool, User Guide, Preamble, Handout) have since undergone a consensus building process to arrive at their final versions before being disseminated into primary care practice.

Perspectives of Patients, Nurses, and Nephrologists About Electronic Symptom Monitoring With Feedback in Hemodialysis Care

RATIONALE & OBJECTIVE

Patients receiving hemodialysis experience high symptom burden and low quality of life (QOL). Electronic patient-reported outcome measures (e-PROMs) monitoring with feedback to clinicians may be an acceptable intervention to improve health-related QOL for patients receiving hemodialysis. This study explored patient and clinician perspectives on e-PROMs monitoring with feedback to clinicians.

STUDY DESIGN

Qualitative study.

SETTING & PARTICIPANTS

41 participants (12 patients, 13 nephrologists, 16 dialysis nurses) who participated in a 6-month feasibility pilot study of adults receiving facility-based hemodialysis across 4 Australian units. The intervention consisted of electronic symptom monitoring with feedback to clinicians, who also received evidence-based symptom management recommendations to improve health-related QOL.

ANALYTICAL APPROACH

Semistructured interviews and focus group discussions explored the feasibility and acceptability of e-PROMs monitoring with feedback to clinicians. We conducted a thematic analysis of transcripts.

RESULTS

We identified 4 themes: enabling efficient, systematic, and multidisciplinary patient-centered care; experiencing limited data and options for symptom management; requiring familiarity with technology and processes; and identifying barriers and competing priorities. While insufficient patient engagement, logistic/technical challenges, and delayed symptom feedback emerged as barriers to implementation, active engagement by nurses in encouraging and supporting patients during survey completion and clinicians' prompt action after symptom feedback were considered to be facilitators to implementation.

LIMITATIONS

Limited generalizability due to inclusion of English-speaking participants only.

CONCLUSIONS

Patients, nurses, and nephrologists considered e-PROMs monitoring with feedback to clinicians feasible for symptom management in hemodialysis. Clinician engagement, patient support, reliable technology, timely symptom feedback, and interventions to address symptom burden are likely to improve its implementation within research and clinical settings.

Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development

Background

Normalisation Process Theory (NPT) is frequently used to inform qualitative research that aims to explain and evaluate processes that shape late-stage translation of innovations in the organisation and delivery of healthcare. A coding manual for qualitative researchers using NPT will facilitate transparent data analysis processes and will also reduce the cognitive and practical burden on researchers.

Objectives

(a) To simplify the theory for the user. (b) To describe the purposes, methods of development, and potential application of a coding manual that translates normalisation process theory (NPT) into an easily usable framework for qualitative analysis. (c) To present an NPT coding manual that is ready for use.

Method

Qualitative content analysis of papers and chapters that developed normalisation process theory, selection and structuring of theory constructs, and testing constructs against interview data and published empirical studies using NPT.

Results

A coding manual for NPT was developed. It consists of 12 primary NPT constructs and conforms to the Context-Mechanism-Outcome configuration of realist evaluation studies. Contexts are defined as settings in which implementation work is done, in which strategic intentions, adaptive execution, negotiating capability, and reframing organisational logics are enacted. Mechanisms are defined as the work that people do when they participate in implementation processes and include coherence-building, cognitive participation, collective action, and reflexive monitoring. Outcomes are defined as effects that make visible how things change as implementation processes proceed and include intervention mobilisation, normative restructuring, relational restructuring, and sustainment.

Conclusion

The coding manual is ready to use and performs three important tasks. It consolidates several iterations of theory development, makes the application of NPT simpler for the user, and links NPT constructs to realist evaluation methods. The coding manual forms the core of a translational framework for implementation research and evaluation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01191-x.

Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development

BACKGROUND

Normalisation Process Theory (NPT) is frequently used to inform qualitative research that aims to explain and evaluate processes that shape late-stage translation of innovations in the organisation and delivery of healthcare. A coding manual for qualitative researchers using NPT will facilitate transparent data analysis processes and will also reduce the cognitive and practical burden on researchers.

OBJECTIVES

(a) To simplify the theory for the user. (b) To describe the purposes, methods of development, and potential application of a coding manual that translates normalisation process theory (NPT) into an easily usable framework for qualitative analysis. (c) To present an NPT coding manual that is ready for use.

METHOD

Qualitative content analysis of papers and chapters that developed normalisation process theory, selection and structuring of theory constructs, and testing constructs against interview data and published empirical studies using NPT.

RESULTS

A coding manual for NPT was developed. It consists of 12 primary NPT constructs and conforms to the Context-Mechanism-Outcome configuration of realist evaluation studies. Contexts are defined as settings in which implementation work is done, in which strategic intentions, adaptive execution, negotiating capability, and reframing organisational logics are enacted. Mechanisms are defined as the work that people do when they participate in implementation processes and include coherence-building, cognitive participation, collective action, and reflexive monitoring. Outcomes are defined as effects that make visible how things change as implementation processes proceed and include intervention mobilisation, normative restructuring, relational restructuring, and sustainment.

CONCLUSION

The coding manual is ready to use and performs three important tasks. It consolidates several iterations of theory development, makes the application of NPT simpler for the user, and links NPT constructs to realist evaluation methods. The coding manual forms the core of a translational framework for implementation research and evaluation.

Clinician perspectives on having point of care tests made available to them during out of hours home visiting

BACKGROUND

Little is known about clinicians' perspectives on the use of point of care (POC) tests in assessment of acute illness during primary care out of hours (OOH) care. During a service improvement project, POC tests (including creatinine, electrolytes, haemoglobin and lactate) were made available to clinicians undertaking OOH home visits, with the clinicians allowed absolute discretion about when and whether they used them.

METHOD

To explore clinicians' perspectives on having POC tests available during OOH home visits, we undertook a qualitative study with clinicians working in Oxfordshire OOH home visiting teams. We conducted 19 Semi-structured interviews with clinicians working in OOH, including those who had and had not used the POC tests available to them. To explore evolving perspectives over time, including experience and exposure to POC tests, we offered clinicians the opportunity to be interviewed twice throughout the study period. Our sample included 7 GPs (4 interviewed once, 3 interviewed twice - earlier and later during the study), 6 emergency practitioners (EPs) including advanced nurse practitioners and paramedics, 1 Healthcare Assistant, and 2 ambulatory care physicians. Interviews were audio-recorded, transcribed verbatim and analysed thematically.

RESULTS

The clinicians reflected on their decision-making to use (or not use) POC tests, including considering which clinical scenarios were "appropriate" and balancing the resources and time taken to do POC tests against what were perceived as likely benefits. The challenges of using the equipment in patients' homes was a potential barrier, though could become easier with familiarity and experience. Clinicians who had used POC tests described benefits, including planning onward care trajectories, and facilitating communication, both between professionals and with patients and their families.

CONCLUSION

Clinicians described a discriminatory approach to using POC tests, considering carefully in which situations they were likely to add value to clinical decision-making.

Point-of-care testing in a high-income country paediatric emergency department: a qualitative study in Sweden

OBJECTIVES

In many resource-limited health systems, point-of-care tests (POCTs) are the only means for clinical patient sample analyses. However, the speed and simplicity of POCTs also makes their use appealing to clinicians in high-income countries (HICs), despite greater laboratory accessibility. Although also part of the clinical routine in HICs, clinician perceptions of the utility of POCTs are relatively unknown in such settings as compared with others. In a Swedish paediatric emergency department (PED) where POCT use is routine, we aimed to characterise healthcare providers' perspectives on the clinical utility of POCTs and explore their implementation in the local setting; to discuss and compare such perspectives, to those reported in other settings; and finally, to gather requests for ideal novel POCTs.

DESIGN

Qualitative focus group discussions study. A data-driven content analysis approach was used for analysis.

SETTING

The PED of a secondary paediatric hospital in Stockholm, Sweden.

PARTICIPANTS

Twenty-four healthcare providers clinically active at the PED were enrolled in six focus groups.

RESULTS

A range of POCTs was routinely used. The emerging theme Utility of our POCT use is double-edged illustrated the perceived utility of POCTs. While POCT services were considered to have clinical and social value, the local routine for their use was named to distract clinicians from the care for patients. Requests were made for ideal POCTs and their implementation.

CONCLUSION

Despite their clinical integration, deficient implementation routines limit the benefits of POCT services to this well-resourced paediatric clinic. As such deficiencies are shared with other settings, it is suggested that some characteristics of POCTs and of their utility are less related to resource level and more to policy deficiency. To address this, we propose the appointment of skilled laboratory personnel as ambassadors to hospital clinics offering POCT services, to ensure higher utility of such services.

Role of point-of-care tests in the management of febrile children: a qualitative study of hospital-based doctors and nurses in England

OBJECTIVES

The use of rapid point-of-care tests (POCTs) has been advocated for improving patient management and outcomes and for optimising antibiotic prescribing. However, few studies have explored healthcare workers' views about their use in febrile children. The aim of this study was to explore the perceptions of hospital-based doctors and nurses regarding the use of POCTs in England.

STUDY DESIGN

Qualitative in-depth interviews with purposively selected hospital doctors and nurses. Data were analysed thematically.

SETTING

Two university teaching hospitals in London and Newcastle.

PARTICIPANTS

24 participants (paediatricians, emergency department doctors, trainee paediatricians and nurses).

RESULTS

There were diverse views about the use of POCTs in febrile children. The reported advantages included their ease of use and the rapid availability of results. They were seen to contribute to faster clinical decision-making; the targeting of antibiotic use; improvements in patient care, flow and monitoring; cohorting (ie, the physical clustering of hospitalised patients with the same infection to limit spread) and enhancing communication with parents. These advantages were less evident when the turnaround for results of laboratory tests was 1-2 hours. Factors such as clinical experience and specialty, as well as the availability of guidelines recommending POCT use, were also perceived as influential. However, in addition to their perceived inaccuracy, participants were concerned about POCTs not resolving diagnostic uncertainty or altering clinical management, leading to a commonly expressed preference for relying on clinical skills rather than test results solely.

CONCLUSION

In this study conducted at two university teaching hospitals in England, participants expressed mixed opinions about the utility of current POCTs in the management of febrile children. Understanding the current clinical decision-making process and the specific needs and preferences of clinicians in different settings will be critical in ensuring the optimal design and deployment of current and future tests.

Mental healthcare clinician engagement with point of care testing; a qualitative study

BACKGROUND

Point of Care Testing (POCT) is being increasingly used to augment the delivery of physical health care in a variety of settings, but their use in mental health has been limited. Research into understanding the barriers faced for successful implementation of POCT in these settings is lacking. We aimed to identify factors affecting engagement and implementation of POCT within mental health teams by exploring the attitudes to POCT, and the perceived impact POCT has on the practice of mental healthcare clinicians.

METHODS

Alongside a study evaluating the impact of a point of care device in Community Mental Health Teams (CMHTs), qualitative interviews were carried out with CMHT clinicians using POCT as part of annual physical checks for patients with severe and enduring mental illness. Data were collected using semi-structured interviews and analysed using thematic analysis.

RESULTS

Fifteen clinicians were interviewed across a range of professional backgrounds. Clinicians identified usability of the technology, positive impact on their patient's experience and improved self-efficacy as drivers for successful implementation of POCT into their clinical practice. Issues with device functioning and the potential for a negative effect on the therapeutic relationship with their patients were identified as barriers. Level of physical heath training was not found to be a barrier by mental health professionals to using POCT.

CONCLUSIONS

Understanding barriers and drivers for engagement is important to allow co-production of POCT and guidelines to facilitate introduction of POCT into routine clinical practice.

Simplified formats of modern biosensors: 60 years of using immunochromatographic test systems in laboratory diagnostics

Immunochromatographic test systems known to foreign laboratory diagnostic experts as lateral flow immunoassay (LFIA) are simplified tape formats of modern biosensors. For 60 years, they have been widely used for the rapid detection of target molecules (ligands) in biosubstrates and the diagnosis of many diseases and conditions. The growing popularity of these test systems for providing medical care or diagnostics in developing countries, medical facilities, in emergency situations, as well as for individual home use by patients while monitoring their health are the main factors contributing to the continuous development and improvement of these methods, the emergence of a new generation of formats. The attractiveness and popularity of these fast, easy-to-use, inexpensive and portable diagnostic tools is associated primarily with their high analytical sensitivity and specificity, as well as the ease of interpretation of the results. These qualities have passed the test of time, and today LFIA test systems are fully consistent with the modern world concept of «point-of-care testing», finding wide application not only in medicine, but also in ecology, veterinary medicine, and agriculture. This review will highlight the modern principles of designing the most widely used formats of immunochromatographic test systems for clinical laboratory diagnostics, summarize the main advantages and disadvantages of the method, as well as current achievements and prospects of LFIA technology. Modern innovations aimed at improving the analytical characteristics of LFIA technology are interesting, promising and can bring additional benefits to immunochromatographic platforms that have gained popularity and attractiveness for six decades.

Feasibility and acceptability of e-PROMs data capture and feedback among patients receiving haemodialysis in the Symptom monitoring WIth Feedback Trial (SWIFT) pilot: protocol for a qualitative study in Australia

INTRODUCTION

People receiving haemodialysis experience a high symptom burden and impaired quality of life. The use of patient-reported outcome measures (PROMs) is increasing in nephrology care, however their acceptability, utility and impacts are not well understood.

METHODS AND ANALYSIS

We describe a protocol for a qualitative study to evaluate the feasibility and acceptability of electronic-PROMs (e-PROMs) data capture and feedback in haemodialysis following the pilot Symptom monitoring WIth Feedback Trial (SWIFT). SWIFT involves linkage of e-PROMs data, including symptoms and health-related quality of life, to the Australia and New Zealand Dialysis and Transplant Registry with feedback to patients' treating nephrologists and nurse unit managers. Focus groups and semistructured interviews will be conducted with nephrologists (n=15), dialysis nurses (n=24) and patients receiving haemodialysis (n=24) from six dialysis units in Australia. Question topics will include the technical and clinical feasibility and acceptability of e-PROMs reporting and feedback (including the barriers and enablers to uptake) and perceived impact on patient care and outcomes. Transcripts will be analysed thematically and guided by Normalisation Process Theory.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the relevant hospital Human Research Ethics Committees (HREC/18/CALHN/481; HREC/MML/54599). The findings from the SWIFT pilot and qualitative evaluation will inform the implementation of the SWIFT main trial, and more broadly, the use of e-PROMs in clinical settings and registries.

TRIAL REGISTRATION NUMBER

ANZCTRN12618001976279.

Six decades of lateral flow immunoassay: from determining metabolic markers to diagnosing COVID-19

Technologies based on lateral flow immunoassay (LFIA), known in some countries of the world as immunochromatographic tests, have been successfully used for the last six decades in diagnostics of many diseases and conditions as they allow rapid detection of molecular ligands in biosubstrates. The popularity of these diagnostic platforms is constantly increasing in healthcare facilities, particularly those facing limited budgets and time, as well as in household use for individual health monitoring. The advantages of these low-cost devices over modern laboratory-based analyzers come from their availability, opportunity of rapid detection, and ease of use. The attractiveness of these portable diagnostic tools is associated primarily with their high analytical sensitivity and specificity, as well as with the easy visual readout of results. These qualities explain the growing popularity of LFIA in developing countries, when applied at small hospitals, in emergency situations where screening and monitoring health condition is crucially important, and as well as for self-testing of patients. These tools have passed the test of time, and now LFIA test systems are fully consistent with the world's modern concept of ‘point-of-care testing’, finding a wide range of applications not only in human medicine, but also in ecology, veterinary medicine, and agriculture. The extensive opportunities provided by LFIA contribute to the continuous development and improvement of this technology and to the creation of new-generation formats. This review will highlight the modern principles of design of the most widely used formats of test-systems for clinical laboratory diagnostics, summarize the main advantages and disadvantages of the method, as well as the current achievements and prospects of the LFIA technology. The latest innovations are aimed at improving the analytical performance of LFIA platforms for the diagnosis of bacterial and viral infections, including COVID-19.

Pre-analytical error for three point of care venous blood testing platforms in acute ambulatory settings: A mixed methods service evaluation

INTRODUCTION

Point of care blood testing to aid diagnosis is becoming increasingly common in acute ambulatory settings and enables timely investigation of a range of diagnostic markers. However, this testing allows scope for errors in the pre-analytical phase, which depends on the operator handling and transferring specimens correctly. The extent and nature of these pre-analytical errors in clinical settings has not been widely reported.

METHODS

We carried out a convergent parallel mixed-methods service evaluation to investigate pre-analytical errors leading to a machine error reports in a large acute hospital trust in the UK. The quantitative component comprised a retrospective analysis of all recorded error codes from Abbott Point of Care i-STAT 1, i-STAT Alinity and Abbott Rapid Diagnostics Afinion devices to summarise the error frequencies and reasons for error, focusing on those attributable to the operator. The qualitative component included a prospective ethnographic study and a secondary analysis of an existing ethnographic dataset, based in hospital-based ambulatory care and community ambulatory care respectively.

RESULTS

The i-STAT had the highest usage (113,266 tests, January 2016-December 2018). As a percentage of all tests attempted, its device-recorded overall error rate was 6.8% (95% confidence interval 6.6% to 6.9%), and in the period when reliable data could be obtained, the operator-attributable error rate was 2.3% (2.2% to 2.4%). Staff identified that the most difficult step was the filling of cartridges, but that this could be improved through practice, with a perception that cartridge wastage through errors was rare.

CONCLUSIONS

In the observed settings, the rate of errors attributable to operators of the primary point of care device was less than 1 in 40. In some cases, errors may lead to a small increase in resource use or time required so adequate staff training is necessary to prevent adverse impact on patient care.

Point-of-care blood tests during home visits by out-of-hours primary care clinicians; a mixed methods evaluation of a service improvement

OBJECTIVES

We aimed to evaluate test usage and patient and clinician experience following the introduction of point-of-care (POC) blood tests into a primary care out-of-hours service.

DESIGN

A mixed methods service evaluation comprising quantitative records of the clinical contexts of tests taken and qualitative interviews with clinicians. Research permissions and governance were obtained for patient interviews.

SETTING

Out-of-hours primary care.

PARTICIPANTS

All patients requiring home visits from the service during the implementation period.

INTERVENTIONS

The i-STAT POC blood test platform was introduced to two bases providing home visits for a period of 8 months. Venous blood samples were used and two cartridges were available. The CHEM8 cartridge measures sodium, potassium, chloride, total carbon dioxide (TCO2), anion gap, ionised calcium, glucose, urea, creatinine, haematocrit and haemoglobin. The CG4 cartridge measures lactate, pH, PaO2 and PCO2, TCO2, bicarbonate, base excess and oxygen saturation.

PRIMARY AND SECONDARY OUTCOME MEASURES

The proportion of home visits where tests were taken, the clinical contexts of those tests, the extent to which clinicians felt the tests had influenced their decisions, time taken to perform the test and problems encountered. Clinician and patient experiences of using POC tests.

RESULTS

i-STAT POC tests were infrequently used, with successful tests taken at just 47 contacts over 8 months of implementation. The patients interviewed felt that testing had been beneficial for their care. Clinician interviews suggested barriers to POC tests, including practical challenges, concerns about time, doubt over whether they would improve clinical decision making and concern about increased medicolegal risk. Suggestions for improving adoption included sharing learning, adopting a whole team approach and developing protocols for usage.

CONCLUSIONS

POC tests were not successfully adopted by an out-of-hours home visiting service in Oxfordshire. While some clinicians felt they could not add value, in other cases they resulted in improved patient experience. Adoption could be promoted by improving technical, team and education factors.

Introducing new point-of-care tests for common infections in publicly funded clinics in South Africa: a qualitative study with primary care clinicians

Broad-spectrum antibiotics are routinely prescribed empirically in the resource-poor settings for suspected acute common infections, which drive antimicrobial resistance. Point-of-care testing (POCT) might increase the appropriateness of decisions about whether and which antibiotic to prescribe, but implementation will be most effective if clinician's perspectives are taken into account.

OBJECTIVES

To explore the perceptions of South African primary care clinicians working in publicly funded clinics about: making antibiotic prescribing decisions for two common infection syndromes (acute cough, urinary tract infection); their experiences of existing POCTs; their perceptions of the barriers and opportunities for introducing (hypothetical) new POCTs.

DESIGN, METHOD, PARTICIPANTS, SETTING

Qualitative semistructured interviews with 23 primary care clinicians (nurses and doctors) at publicly funded clinics in the Western Cape Metro district, South Africa. Data were analysed using thematic analysis.

RESULTS

Clinicians reported that their antibiotic prescribing decisions were influenced by their clinical assessment, patient comorbidities, social factors (eg, access to care) and perceived patient expectations. Their experiences with currently available POCTs were largely positive, and they were optimistic about the potential for new POCTs to: support evidence-based prescribing decisions that might reduce unnecessary antibiotic prescriptions; reduce the need for further investigations; support effective communication with patients, especially when antibiotics were unlikely to be of benefit. Resources and workflow disruption were seen as the main barriers to uptake into routine care.

CONCLUSIONS

Clinicians working in publicly funded clinics in the Western Cape Metro of South Africa saw POCTs as potentially useful for positively addressing both clinical and social drivers of the overprescribing of broad-spectrum antibiotics, but were concerned about the resource implications and disruption of existing patient workflows.

Using normalisation process theory to understand workflow implications of decision support implementation across diverse primary care settings

BACKGROUND

Effective implementation of technologies into clinical workflow is hampered by lack of integration into daily activities. Normalisation process theory (NPT) can be used to describe the kinds of 'work' necessary to implement and embed complex new practices. We determined the suitability of NPT to assess the facilitators, barriers and 'work' of implementation of two clinical decision support (CDS) tools across diverse care settings.

METHODS

We conducted baseline and 6-month follow-up quantitative surveys of clinic leadership at two academic institutions' primary care clinics randomised to the intervention arm of a larger study. The survey was adapted from the NPT toolkit, analysing four implementation domains: sense-making, participation, action, monitoring. Domains were summarised among completed responses (n=60) and examined by role, institution, and time.

RESULTS

The median score for each NPT domain was the same across roles and institutions at baseline, and decreased at 6 months. At 6 months, clinic managers' participation domain (p=0.003), and all domains for medical directors (p<0.003) declined. At 6 months, the action domain decreased among Utah respondents (p=0.03), and all domains decreased among Wisconsin respondents (p≤0.008).

CONCLUSIONS

This study employed NPT to longitudinally assess the implementation barriers of new CDS. The consistency of results across participant roles suggests similarities in the work each role took on during implementation. The decline in engagement over time suggests the need for more frequent contact to maintain momentum. Using NPT to evaluate this implementation provides insight into domains which can be addressed with participants to improve success of new electronic health record technologies.

TRIAL REGISTRATION NUMBER

NCT02534987.

Frequencies and patterns of laboratory test requests from general practice: a service evaluation to inform point-of-care testing

AIMS

The demand for test requests from general practice to laboratory services remains high. Tests performed at the point of care could reduce turnaround time and speed up clinical decision making. Replicating laboratory testing in the community would require panels of tests to be performed simultaneously, which is now approaching technological feasibility. We assessed frequencies and combinations of test requests from community settings to inform the potential future development of multiplex point-of-care panels.

METHODS

We assessed all laboratory test requests made from general practice in Oxfordshire, UK, from January 2014 to March 2017. We summarised test request frequency overall and in combination, using heatmaps and hierarchical cluster analysis. Results are also presented by age/sex subgroups. We further assessed patterns of tests requested within 7 and 14 days after an initial test request.

RESULTS

11 763 473 test requests were made for 413 073 individuals (28% age >65). Of more than 500 test types, 62 were requested at least 5000 times, most commonly renal function tests (approximately 296 000/year), full blood count (278 000/year) and liver function tests (237 000/year). Cluster analysis additionally identified a clear grouping of tests commonly used to investigate anaemia. Follow-up test frequency was much lower than the frequency of multiple tests ordered at initial presentation.

CONCLUSIONS

The current high volume of single and combination test requests highlights an opportunity for reliable multiplex point-of-care panels to cover a core set of frequently requested tests. The impact on test use of introducing such panels to general practice requires additional research.

Understanding the impact of accreditation on quality in healthcare: A grounded theory approach

Objective

To explore how organizations respond to and interact with the accreditation process and the actual and potential mechanisms through which accreditation may influence quality.

Design

Qualitative grounded theory study.

Setting

Organizations who had participated in Accreditation Canada's Qmentum program during January 2014-June 2016.

Participants

Individuals who had coordinated the accreditation process or were involved in managing or promoting quality.

Results

The accreditation process is largely viewed as a quality assurance process, which often feeds in to quality improvement activities if the feedback aligns with organizational priorities. Three key stages are required for accreditation to impact quality: coherence, organizational buy-in and organizational action. These stages map to constructs outlined in Normalization Process Theory. Coherence is established when an organization and its staff perceive that accreditation aligns with the organization's beliefs, context and model of service delivery. Organizational buy-in is established when there is both a conceptual champion and an operational champion, and is influenced by both internal and external contextual factors. Quality improvement action occurs when organizations take purposeful action in response to observations, feedback or self-reflection resulting from the accreditation process.

Conclusions

The accreditation process has the potential to influence quality through a series of three mechanisms: coherence, organizational buy-in and collective quality improvement action. Internal and external contextual factors, including individual characteristics, influence an organization's experience of accreditation.

Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review

BACKGROUND

Normalization Process Theory (NPT) identifies, characterises and explains key mechanisms that promote and inhibit the implementation, embedding and integration of new health techniques, technologies and other complex interventions. A large body of literature that employs NPT to inform feasibility studies and process evaluations of complex healthcare interventions has now emerged. The aims of this review were to review this literature; to identify and characterise the uses and limits of NPT in research on the implementation and integration of healthcare interventions; and to explore NPT's contribution to understanding the dynamics of these processes.

METHODS

A qualitative systematic review was conducted. We searched Web of Science, Scopus and Google Scholar for articles with empirical data in peer-reviewed journals that cited either key papers presenting and developing NPT, or the NPT Online Toolkit ( www.normalizationprocess.org ). We included in the review only articles that used NPT as the primary approach to collection, analysis or reporting of data in studies of the implementation of healthcare techniques, technologies or other interventions. A structured data extraction instrument was used, and data were analysed qualitatively.

RESULTS

Searches revealed 3322 citations. We show that after eliminating 2337 duplicates and broken or junk URLs, 985 were screened as titles and abstracts. Of these, 101 were excluded because they did not fit the inclusion criteria for the review. This left 884 articles for full-text screening. Of these, 754 did not fit the inclusion criteria for the review. This left 130 papers presenting results from 108 identifiable studies to be included in the review. NPT appears to provide researchers and practitioners with a conceptual vocabulary for rigorous studies of implementation processes. It identifies, characterises and explains empirically identifiable mechanisms that motivate and shape implementation processes. Taken together, these mean that analyses using NPT can effectively assist in the explanation of the success or failure of specific implementation projects. Ten percent of papers included critiques of some aspect of NPT, with those that did mainly focusing on its terminology. However, two studies critiqued NPT emphasis on agency, and one study critiqued NPT for its normative focus.

CONCLUSIONS

This review demonstrates that researchers found NPT useful and applied it across a wide range of interventions. It has been effectively used to aid intervention development and implementation planning as well as evaluating and understanding implementation processes themselves. In particular, NPT appears to have offered a valuable set of conceptual tools to aid understanding of implementation as a dynamic process.

Point-of-care Cognitive Support Technology in Emergency Departments: A Scoping Review of Technology Acceptance by Clinicians

OBJECTIVE

Cognitive support technologies that support clinical decisions and practices in the emergency department (ED) have the potential to optimize patient care. However, limited uptake by clinicians can prevent successful implementation. A better understanding of acceptance of these technologies from the clinician perspective is needed. We conducted a scoping review to synthesize diverse, emerging evidence on clinicians' acceptance of point-of-care (POC) cognitive support technology in the ED.

METHOD

We systematically searched 10 electronic databases and gray literature published from January 2006 to December 2016. Studies of any design assessing an ED-based POC cognitive support technology were considered eligible for inclusion. Studies were required to report outcome data for technology acceptance. Two reviewers independently screened studies for relevance and quality. Study quality was assessed using the Mixed-Methods Appraisal Tool. A descriptive analysis of the features of POC cognitive support technology for each study is presented, illustrating trends in technology development and evaluation. A thematic analysis of clinician, technical, patient, and organizational factors associated with technology acceptance is also presented.

RESULTS

Of the 1,563 references screened for eligibility, 24 met the inclusion criteria and were included in the review. Most studies were published from 2011 onward (88%), scored high for methodologic quality (79%), and examined POC technologies that were novel and newly introduced into the study setting (63%). Physician use of POC technology was the most commonly studied (67%). Technology acceptance was frequently conceptualized and measured by factors related to clinician attitudes and beliefs. Experience with the technology, intention to use, and actual use were also more common outcome measures of technology acceptance. Across studies, perceived usefulness was the most noteworthy factor impacting technology acceptance, and clinicians generally had positive perceptions of the use of POC cognitive support technology in the ED. However, the actual use of POC cognitive support technology reported by clinicians was low-use, by proportion of patient cases, ranged from 30% to 59%. Of the 24 studies, only two studies investigated acceptance of POC cognitive support technology currently implemented in the ED, offering "real-world" clinical practice data. All other studies focused on acceptance of novel technologies. Technical aspects such as an unfriendly user interface, presentation of redundant or ambiguous information, and required user effort had a negative impact on acceptance. Patient expectations were also found to have a negative impact, while patient safety implications had a positive impact. Institutional support was also reported to impact technology acceptance.

CONCLUSIONS

Findings from this scoping review suggest that while ED clinicians acknowledge the utility and value of using POC cognitive support technology, actual use of such technology can be low. Further, few studies have evaluated the acceptance and use of POC technologies in routine care. Prospective studies that evaluate how ED clinicians appraise and consider POC technology use in clinical practice are now needed with diverse clinician samples. While this review identified multiple factors contributing to technology acceptance, determining how clinician, technical, patient, and organizational factors mediate or moderate acceptance should also be a priority.

Diagnostic evidence cooperatives: bridging the valley of death in diagnostics development

BACKGROUND

Diagnostic tests' impact on patient outcomes and health processes is potentially large, and proper evaluations before widespread adoption are warranted. Such evaluations are challenged by the fact that tests can have multiple purposes, in different clinical pathways, with different roles.

BODY

The National Institute for Health Research (NIHR) established four Diagnostic Evidence Cooperatives (DEC) in 2013, across England. The aim of these DECs was to facilitate the development and evaluation of clinically relevant in vitro diagnostics, by offering methodological expertise and access to real-life settings for evaluations in patients. In this commentary, we discuss our experience over the past 4 years.

CONCLUSION

The interaction of industry, researchers, and clinicians has proven to be very worthwhile.

Designing medical technology for resilience: integrating health economics and human factors approaches

INTRODUCTION

The slow adoption of innovation into healthcare calls into question the manner of evidence generation for medical technology. This paper identifies potential reasons for this including a lack of attention to human factors, poor evaluation of economic benefits, lack of understanding of the existing healthcare system and a failure to recognise the need to generate resilient products. Areas covered: Recognising a cross-disciplinary need to enhance evidence generation early in a technology's life cycle, the present paper proposes a new approach that integrates human factors and health economic evaluation as part of a wider systems approach to the design of technology. This approach (Human and Economic Resilience Design for Medical Technology or HERD MedTech) supports early stages of product development and is based on the recent experiences of the National Institute for Health Research London Diagnostic Evidence Co-operative in the UK. Expert commentary: HERD MedTech i) proposes a shift from design for usability to design for resilience, ii) aspires to reduce the need for service adaptation to technological constraints iii) ensures value of innovation at the time of product development, and iv) aims to stimulate discussion around the integration of pre- and post-market methods of assessment of medical technology.

How can point-of-care HbA1c testing be integrated into UK primary care consultations? - A feasibility study

AIMS

Point-of-care (POC) HbA1c testing gives a rapid result, allowing testing and treatment decisions to take place in a single appointment. Trials of POC testing have not been shown to improve HbA1c, possibly because of how testing was implemented. This study aimed to identify key components of POC HbA1c testing and determine strategies to optimise implementation in UK primary care.

METHODS

This cohort feasibility study recruited thirty patients with type 2 diabetes and HbA1c>7.5% (58mmol/mol) into three primary care clinics. Patients' clinical care included two POC HbA1c tests over six months. Data were collected on appointment duration, clinical decisions, technical performance and patient behaviour.

RESULTS

Fifty-three POC HbA1c consultations took place during the study; clinical decisions were made in 30 consultations. Five POC consultations with a family doctor lasted on average 11min and 48 consultations with nurses took on average 24min. Five POC study visits did not take place in one clinic. POC results were uploaded to hospital records from two clinics. In total, sixty-three POC tests were performed, and there were 11 cartridge failures. No changes in HbA1c or patient behaviour were observed.

CONCLUSIONS

HbA1c measurement with POC devices can be effectively implemented in primary care. This work has identified when these technologies might work best, as well as potential challenges. The findings can be used to inform the design of a pragmatic trial to implement POC HbA1c testing.