Implementing a digital patient feedback system: an analysis using normalisation process theory

Qualitative study exploring the design of a patient-reported symptom-based risk stratification system for suspected head and neck cancer referrals: protocol for work packages 1 and 2 within the EVEREST-HN programme

INTRODUCTION

Between 2009/2010 and 2019/2020, England witnessed an increase in suspected head and neck cancer (sHNC) referrals from 140 to 404 patients per 100 000 population. 1 in 10 patients are not seen within the 2-week target, contributing to patient anxiety. We will develop a pathway for sHNC referrals, based on the Head and Neck Cancer Risk Calculator. The evolution of a patient-reported symptom-based risk stratification system to redesign the sHNC referral pathway (EVEREST-HN) Programme comprises six work packages (WPs). This protocol describes WP1 and WP2. WP1 will obtain an understanding of language to optimise the SYmptom iNput Clinical (SYNC) system patient-reported symptom questionnaire for sHNC referrals and outline requirements for the SYNC system. WP2 will codesign key elements of the SYNC system, including the SYNC Questionnaire, and accompanying behaviour change materials.

METHODS AND ANALYSIS

WP1 will be conducted at three acute National Health Service (NHS) trusts with variation in service delivery models and ensuring a broad mixture of social, economic and cultural backgrounds of participants. Up to 150 patients with sHNC (n=50 per site) and 15 clinicians (n=5 per site) will be recruited. WP1 will use qualitative methods including interviews, observation and recordings of consultations. Rapid qualitative analysis and inductive thematic analysis will be used to analyse the data. WP2 will recruit lay patient representatives to participate in online focus groups (n=8 per focus group), think-aloud technique and experience-based codesign and will be analysed using qualitative and quantitative approaches.

ETHICS AND DISSEMINATION

The committee for clinical research at The Royal Marsden, a research ethics committee and the Health Research Authority approved this protocol. All participants will give informed consent. Ethical issues of working with patients on an urgent cancer diagnostic pathway have been considered. Findings will be disseminated via journal publications, conference presentations and public engagement activities.

Navigating the Digital Landscape: Embracing Innovation, Addressing Challenges, and Prioritizing Patient-Centric Care

In the digital era, healthcare customer feedback plays a pivotal role in shaping the reputation of healthcare organizations. The study explores how digital advancements are integrated into modern healthcare, offering both transformative insights and addressing the challenges they present. It investigates how technologies such as artificial intelligence (AI), digital platforms, and patient feedback systems impact patient care, operational efficiency, and customer satisfaction in healthcare settings. The study emphasizes the importance of balancing both capitalizing on the opportunities presented by innovations and addressing the inherent difficulties associated with digitalization in healthcare, underlining the need for a comprehensive approach to navigating the opportunities and challenges in healthcare digitalization. AI is recognized for its role in reshaping value creation in healthcare, fostering collaboration among stakeholders, and improving patient care. Additionally, the study identifies key areas of research essential for effectively navigating the digital transformation in healthcare, including operational efficiency, patient-centric strategies, and organizational factors. However, along with the potential benefits come challenges, such as the need for regulatory frameworks to validate new technologies and address privacy concerns surrounding patient data. Managing reputation and customer relationships in the digital sphere also emerges as critical for healthcare organizations. In summary, the study underscores the importance of healthcare institutions prioritizing patient-centric care, adopting digital innovations, and adeptly navigating regulatory and ethical challenges. By doing so, they can enhance patient outcomes, and satisfaction, and drive innovation in today's dynamic healthcare landscape.

Understanding Employee Voice Behavior Through the Use of Digital Voice Channel in Long-Term Care: Protocol for an Embedded Multiple-Case Study

BACKGROUND

Specific challenges in the health care sector, such as hierarchical structures, shortages of nursing staff, and high turnover of nursing staff, can be addressed by a change process of organizational culture into shared governance. Data from business organizations show that the use of digital voice channels provides employee voice. This approach makes concrete the opportunity for employees to raise their voices by answering surveys and making comments in an anonymous forum, which subsequently positively influences staff turnover and sick leave. Since there is no clear understanding of how a digital voice channel can be used in long-term care to address employee voice, a research gap has been identified.

OBJECTIVE

The purpose of ADVICE (Understanding Employee Voice Behavior; the acronym for this study) is to understand how the use of a digital voice channel performs in long-term care (residential long-term care and home care facilities). The aim of this study is to understand how the digital voice channel can support staff in making their voices heard and to see what managers need to use the voice channel to change the work environment.

METHODS

An embedded multiple-case study will be used to explore the experiences of 2 health care providers who have already implemented a digital voice channel. ADVICE is organized into two main phases: (1) a scoping review and (2) an embedded multiple-case study. For this purpose, focus group interviews with employees, discursive-dialogical interviews with managers, meeting protocols, and data from the digital voice channel will be analyzed. First, all units of analysis from every embedded unit will be separately analyzed and then comprehensively analyzed to obtain a case vignette from every embedded unit (within-analysis). In the second stage, the analyzed data from the embedded units will be compared with each other in a comparative analysis (cross-analysis).

RESULTS

The results will provide insight into how digital voice channels can be used in long-term care to address employee voice. We expect to find how the digital voice channel can empower nurses to speak up and, consequently, create a better work environment. Data collection began in August 2023, and from a current perspective, the first results are expected in summer 2024.

CONCLUSIONS

In summary, the results may help to better understand the use of a digital voice channel in the health care sector and its transformative potential for leadership. At the organizational level, research can help to improve the attractiveness of the workplace by understanding how to give employees a voice.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/48601.

Integrating a community-based continuous mass dog vaccination delivery strategy into the veterinary system of Tanzania: A process evaluation using normalization process theory

Abstract

Sustained vaccination coverage of domestic dog populations can interrupt rabies transmission. However, challenges remain including low dog owner participation, high operational costs associated with current (centralized and annually delivered (pulse)) approaches and high dog population turnover. To address these challenges an alternative (community-based continuous mass dog vaccination (CBC-MDV)) approach was designed. We investigated the potential for successful normalization of CBC-MDV into routine practice within the context of local communities and the veterinary system of Tanzania.

Methods

In a process evaluation of a pilot implementation of CBC-MDV, we conducted in-depth interviews with implementers and community leaders (n = 24), focus group discussion with implementers and community members (n = 12), and non-participant observation (n = 157 h) of delivery of the intervention components. We analyzed these data thematically drawing on the normalization process theory, to assess factors affecting implementation and integration.

Main findings

Implementers and community members clearly understood the values and benefits of the CBC-MDV, regarding it as an improvement over the pulse strategy. They had a clear understanding of what was required to enact CBC-MDV and considered their own involvement to be legitimate. The approach fitted well into routine schedules of implementers and the context (infrastructure, skill sets and policy). Implementers and community members positively appraised CBC-MDV in terms of its perceived impact on rabies and recommended its use across the country. Implementers and community members further believed that vaccinating dogs free of charge was critical and made community mobilization easier. However, providing feedback to communities and involving them in evaluating outcomes of vaccination campaigns were reported to have not been done. Local politics was cited as a barrier to collaboration between implementers and community leaders.

Conclusion

This work suggests that CBC-MDV has the potential to be integrated and sustained in the context of Tanzania. Involving communities in design, delivery and monitoring of CBC-MDV activities could contribute to improving and sustaining its outcomes.

Stimulating Employability and Job Crafting Behaviour of Physicians: A Randomized Controlled Trial

The demanding work context of physicians challenges their employability (i.e., their ability and willingness to continue to work). This requires them to proactively manage their working life and employability, for instance, through job crafting behaviour. This randomized controlled intervention study aimed to examine the effects of a personalized feedback report on physicians’ employability and job crafting behaviour. A total of 165 physicians from two hospitals in a large Dutch city were randomly assigned to a waitlist control or intervention group in May 2019. Physicians in the intervention group received access to a personalized feedback report with their employability scores, suggestions to improve these and to engage in job crafting. Participants completed a pre-test and eight weeks later a post-test. RM MANOVAs and RM ANOVAs showed that the intervention enhanced participants’ perceptions of their mental (F (1,130) = 4.57, p < 0.05) and physical (F (1,135) = 16.05, p < 0.001) ability to continue working. There was no effect on their willingness to continue to work. Furthermore, while job crafting behaviour significantly increased over time, the personalized feedback report did not account for this change. This low-investment intervention is relevant for organizations to stimulate employees’ proactivity and create positive perceptions of their ability to continue to work. Moreover, this study contributes to the literature by examining a novel approach of a job crafting intervention that does not require many resources to implement.

Co-designing new tools for collecting, analysing and presenting patient experience data in NHS services: working in partnership with patients and carers

BACKGROUND

The way we collect and use patient experience data is vital to optimise the quality and safety of health services. Yet, some patients and carers do not give feedback because of the limited ways data is collected, analysed and presented. In this study, we worked together with researchers, staff, patient and carer participants, and patient and public involvement and engagement (PPIE) contributors, to co-design new tools for the collection and use of patient experience data in multiple health settings. This paper outlines how the range of PPIE and research activities enabled the co-design of new tools to collect patient experience data.

METHODS

Eight public contributors represented a range of relevant patient and carer experiences in specialist services with varied levels of PPIE experience, and eleven members of Patient and Participation Groups (PPGs) from two general practices formed our PPIE group at the start of the study. Slide sets were used to trigger co-design discussions with staff, patient and carer research participants, and PPIE contributors. Feedback from PPIE contributors alongside verbatim quotes from staff, patient and carer research participants is presented in relation to the themes from the research data.

RESULTS

PPIE insights from four themes: capturing experience data; adopting digital or non-digital tools; ensuring privacy and confidentiality; and co-design of a suite of new tools with guidance, informed joint decisions on the shaping of the tools and how these were implemented. Our PPIE contributors took different roles during co-design and testing of the new tools, which supported co-production of the study.

CONCLUSIONS

Our experiences of developing multiple components of PPIE work for this complex study demonstrates the importance of tailoring PPIE to suit different settings, and to maximise individual strengths and capacity. Our study shows the value of bringing diverse experiences together, putting patients and carers at the heart of improving NHS services, and a shared approach to managing involvement in co-design, with the effects shown through the research process, outcomes and the partnership. We reflect on how we worked together to create a supportive environment when unforeseen challenges emerged (such as, sudden bereavement).

Internet-Based Medical Service Use and Eudaimonic Well-Being of Urban Older Adults: A Peer Support and Technology Acceptance Model

Currently, internet services are developing rapidly, and the relationship between specific types of internet services and the well-being of older adults is still unclear. This study took a total of 353 urban older adults aged 60 years and above as research objects to explore the impact of the use behavior toward internet-based medical services (IBMS) on their well-being through an online questionnaire. This study integrated well-being theory and peer support theory, constructed an extended structural equation model of technology acceptance based on the technology acceptance model (TAM), and analyzed the variable path relationship. The results confirm the proposed model: older adults improved their eudaimonic well-being through using IBMS; perceived usefulness significantly affected the older adults’ attitudes towards IBMS; perceived ease of use significantly affected the use of IBMS through mediation; peer support significantly affected older adults’ attitudes, willingness, actual use, and well-being in the process. This study proposes that facilitating IBMS use for older adults in the development and design of internet technology programs should be considered in order to provide them with benefits. Moreover, paying attention to peer support among older adults plays an important role in the acceptance of new technologies and improving their well-being. The “peer support” of this study expanded and contributed to the research on the impact on older adults’ well-being and the construction of a technology acceptance model. The peer support in this study extended the influence factor of eudaimonic well-being and contributed to the further development of the TAM.

Ensuring patient and public involvement in the transition to AI-assisted mental health care: A systematic scoping review and agenda for design justice

Background

Machine‐learning algorithms and big data analytics, popularly known as ‘artificial intelligence’ (AI), are being developed and taken up globally. Patient and public involvement (PPI) in the transition to AI‐assisted health care is essential for design justice based on diverse patient needs.

Objective

To inform the future development of PPI in AI‐assisted health care by exploring public engagement in the conceptualization, design, development, testing, implementation, use and evaluation of AI technologies for mental health.

Methods

Systematic scoping review drawing on design justice principles, and (i) structured searches of Web of Science (all databases) and Ovid (MEDLINE, PsycINFO, Global Health and Embase); (ii) handsearching (reference and citation tracking); (iii) grey literature; and (iv) inductive thematic analysis, tested at a workshop with health researchers.

Results

The review identified 144 articles that met inclusion criteria. Three main themes reflect the challenges and opportunities associated with PPI in AI‐assisted mental health care: (a) applications of AI technologies in mental health care; (b) ethics of public engagement in AI‐assisted care; and (c) public engagement in the planning, development, implementation, evaluation and diffusion of AI technologies.

Conclusion

The new data‐rich health landscape creates multiple ethical issues and opportunities for the development of PPI in relation to AI technologies. Further research is needed to understand effective modes of public engagement in the context of AI technologies, to examine pressing ethical and safety issues and to develop new methods of PPI at every stage, from concept design to the final review of technology in practice. Principles of design justice can guide this agenda.

The implementation, use and sustainability of a clinical decision support system for medication optimisation in primary care: A qualitative evaluation

Background

The quality and safety of prescribing in general practice is important, Clinical decision support (CDS) systems can be used which present alerts to health professionals when prescribing in order to identify patients at risk of potentially hazardous prescribing. It is known that such computerised alerts may improve the safety of prescribing in hospitals but their implementation and sustainable use in general practice is less well understood. We aimed to understand the factors that influenced the successful implementation and sustained use in primary care of a CDS system.

Methods

Participants were purposively recruited from Clinical Commissioning Groups (CCGs) and general practices in the North West and East Midlands regions of England and from the CDS developers. We conducted face-to-face and telephone-based semi-structured qualitative interviews with staff stakeholders. A selection of participants was interviewed longitudinally to explore the further sustainability 1–2 years after implementation of the CDS system. The analysis, informed by Normalisation Process Theory (NPT), was thematic, iterative and conducted alongside data collection.

Results

Thirty-nine interviews were conducted either individually or in groups, with 33 stakeholders, including 11 follow-up interviews. Eight themes were interpreted in alignment with the four NPT constructs: Coherence (The purpose of the CDS: Enhancing medication safety and improving cost effectiveness; Relationship of users to the technology; Engagement and communication between different stakeholders); Cognitive Participation (Management of the profile of alerts); Collective Action (Prescribing in general practice, patient and population characteristics and engagement with patients; Knowledge);and Reflexive Monitoring (Sustaining the use of the CDS through maintenance and customisation; Learning and behaviour change. Participants saw that the CDS could have a role in enhancing medication safety and in the quality of care. Engagement through communication and support for local primary care providers and management leaders was considered important for successful implementation. Management of prescribing alert profiles for general practices was a dynamic process evolving over time. At regional management levels, work was required to adapt, and modify the system to optimise its use in practice and fulfil local priorities. Contextual factors, including patient and population characteristics, could impact upon the decision-making processes of prescribers influencing the response to alerts. The CDS could operate as a knowledge base allowing prescribers access to evidence-based information that they otherwise would not have.

Conclusions

This qualitative evaluation utilised NPT to understand the implementation, use and sustainability of a widely deployed CDS system offering prescribing alerts in general practice. The system was understood as having a role in medication safety in providing relevant patient specific information to prescribers in a timely manner. Engagement between stakeholders was considered important for the intervention in ensuring prescribers continued to utilise its functionality. Sustained implementation might be enhanced by careful profile management of the suite of alerts in the system. Our findings suggest that the use and sustainability of the CDS was related to prescribers’ perceptions of the relevance of alerts. Shared understanding of the purpose of the CDS between CCGS and general practices particularly in balancing cost saving and safety messages could be beneficial.

Digital methods to enhance the usefulness of patient experience data in services for long-term conditions: the DEPEND mixed-methods study

Background

Collecting NHS patient experience data is critical to ensure the delivery of high-quality services. Data are obtained from multiple sources, including service-specific surveys and widely used generic surveys. There are concerns about the timeliness of feedback, that some groups of patients and carers do not give feedback and that free-text feedback may be useful but is difficult to analyse.

Objective

To understand how to improve the collection and usefulness of patient experience data in services for people with long-term conditions using digital data capture and improved analysis of comments.

Design

The DEPEND study is a mixed-methods study with four parts: qualitative research to explore the perspectives of patients, carers and staff; use of computer science text-analytics methods to analyse comments; co-design of new tools to improve data collection and usefulness; and implementation and process evaluation to assess use of the tools and any impacts.

Setting

Services for people with severe mental illness and musculoskeletal conditions at four sites as exemplars to reflect both mental health and physical long-terms conditions: an acute trust (site A), a mental health trust (site B) and two general practices (sites C1 and C2).

Participants

A total of 100 staff members with diverse roles in patient experience management, clinical practice and information technology; 59 patients and 21 carers participated in the qualitative research components.

Interventions

The tools comprised a digital survey completed using a tablet device (kiosk) or a pen and paper/online version; guidance and information for patients, carers and staff; text-mining programs; reporting templates; and a process for eliciting and recording verbal feedback in community mental health services.

Results

We found a lack of understanding and experience of the process of giving feedback. People wanted more meaningful and informal feedback to suit local contexts. Text mining enabled systematic analysis, although challenges remained, and qualitative analysis provided additional insights. All sites managed to collect feedback digitally; however, there was a perceived need for additional resources, and engagement varied. Observation indicated that patients were apprehensive about using kiosks but often would participate with support. The process for collecting and recording verbal feedback in mental health services made sense to participants, but was not successfully adopted, with staff workload and technical problems often highlighted as barriers. Staff thought that new methods were insightful, but observation did not reveal changes in services during the testing period.

Conclusions

The use of digital methods can produce some improvements in the collection and usefulness of feedback. Context and flexibility are important, and digital methods need to be complemented with alternative methods. Text mining can provide useful analysis for reporting on large data sets within large organisations, but qualitative analysis may be more useful for small data sets and in small organisations.

Limitations

New practices need time and support to be adopted and this study had limited resources and a limited testing time.

Future work

Further research is needed to improve text-analysis methods for routine use in services and to evaluate the impact of methods (digital and non-digital) on service improvement in varied contexts and among diverse patients and carers.

Funding

This project was funded by the NIHR Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 28. See the NIHR Journals Library website for further project information.