Electronic health records implementation: an evaluation of information system impact and contingency factors

A qualitative study exploring electronic health record optimisation activities in English hospitals

BACKGROUND

Hospitals increasingly implement complex electronic health record (EHR) systems to improve quality, safety and efficiency. Whilst many aspects surrounding implementation and adoption processes have been researched, the benefits of such enterprise-wide systems may take decades to materialise. Existing work on optimisation processes has focused on technological, workflow and organisational aspects of optimisation within individual clinical settings, mostly in the United States of America. We here sought to explore how a range of hospitals with different EHR systems have approached the optimisation of EHRs over time and in relation to technology, socio-organisational and health system factors.

METHODS

We conducted an in-depth qualitative interview study with technology leads from purposefully sampled hospitals across the country who had implemented a range of EHRs. We explored reflections on the journey of implementing and optimising systems over time, optimisation activities, and perceived lessons learned. Data were transcribed and analysed with NVivo 14 software, using the Technology, People, Organizations, and Macroenvironmental factors (TPOM) frameworkto facilitate coding.

RESULTS

We interviewed 28 individuals from 21 sites with eight different types of EHRs. We observed various optimisation activities across different technological, social, organisational and health system factors. These included improving usability and information technology infrastructures; process optimisation of clinical and administrative workflows; organisational optimisation strategies and relationships with suppliers; and wider system factors such as the need for overall strategic direction and allocation of associated funding. Optimisation activities within these areas stood in some instances in contrast to one another. For example, national activities inhibited local optimisation efforts and organisational optimisation in some instances impacted adversely on usability.

CONCLUSIONS

This work emphasises that EHRs are not finished solutions but components of broader information systems needing continuous technological and organisational development. Effective optimisation requires a delicate balance between navigating technological affordances and characteristics to improve usability and organisational processes, as well as regional and national integration to achieve larger-scale interoperability.

Impacts on quality of care following electronic health record implementation within a large Canadian community hospital: a qualitative study

OBJECTIVE

This study aimed to describe how healthcare providers perceived the impacts of implementing and using an electronic health record (EHR) on quality, safety and person-centredness of care.

DESIGN

A qualitative descriptive design using semistructured interviews.

SETTING

In October 2020, a large Canadian community hospital implemented a new EHR system (Epic) across three sites, transitioning from a previously fragmented (combination of paper-based and electronic) system.

PARTICIPANTS

Sixty-two healthcare providers and clinical leaders.

RESULTS

Participants shared their experiences regarding the impact of EHR implementation on quality of care, which were analysed into common themes including task efficiency, information management, patient interactions and patient safety. While the system significantly altered their routines and introduced new responsibilities like additional documentation requirements, it also facilitated adherence to clinical guidelines, improved information visibility and enhanced documentation, benefiting overall quality of care and patient safety. Participants reported that EHR implementation led to increased efficiency, freeing up time for patient care and improving communication with patients and other providers.

CONCLUSION

EHRs have the potential to improve quality of care and patient safety, but this depends on their perceived value and how well healthcare providers can integrate their various features into clinical routines.

Development and Rationale for the Consensus Auditory-Perceptual Evaluation of Voice-Revised (CAPE-Vr)

RATIONALE

The Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) has been in circulation for more than 20 years. Over the course of time, issues have arisen that have had an impact on the intended administration and interpretation of this common clinical tool.

PURPOSE

Based on published literature, clinical experience, recent survey data, and practical considerations, and while maintaining the original purpose of the instrument, the authors developed a revised protocol, new rating form, and updated instructions for the CAPE-V, now called the CAPE-V-Revised (CAPE-Vr).

SUMMARY OF MODIFICATIONS

Revisions to the CAPE-V include the following: removal of textual labels indicating regions of severity under each visual analog scale on the rating form, instead displaying terms indicating the direction of the lines; modification of several of the stimuli; revised rating options for pitch, loudness, and resonance, and an added category for nasality; added space to describe inconsistencies according to task; modified options for vocal instabilities and other features; and added space for comments about overall impression. The form also includes sections for documenting recording and rating conditions. Updated instructions are provided to clarify the CAPE-Vr protocol and correspond closely to the rating form.

CONCLUSION

The CAPE-Vr is constructed to avoid common errors and problems identified from previous use of the original CAPE-V. This paper provides a rationale for each modification to the original CAPE-V, an updated form, and an example of a completed form. The CAPE-Vr is intended as a clear and useful assessment tool for documenting the auditory-perceptual evaluation of voice.

25 Years of Electronic Health Record Implementation Processes: Scoping Review

BACKGROUND

Electronic health record (EHR) systems have undergone substantial evolution over the past 25 years, transitioning from rudimentary digital repositories to sophisticated tools that are integral to modern health care delivery. These systems have the potential to increase efficiency and improve patient care. However, for these systems to reach their potential, we need to understand how the process of EHR implementation works.

OBJECTIVE

This scoping review aimed to examine the implementation process of EHRs from 1999 to 2024 and to articulate process-focused recommendations for future EHR implementations that build on this history of EHR research.

METHODS

We conducted a scoping literature review following a systematic methodological framework. A total of 5 databases were selected from the disciplines of medicine and business: EBSCO, PubMed, Embase, IEEE Explore, and Scopus. The search included studies published from 1999 to 2024 that addressed the process of implementing an EHR. Keywords included "EHR," "EHRS," "Electronic Health Record*," "EMR," "EMRS," "Electronic Medical Record*," "implemen*," and "process." The findings were reported in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) checklist. The selected literature was thematically coded using NVivo qualitative analysis software, with the results reported qualitatively.

RESULTS

This review included 90 studies that described the process of EHR implementation in different settings. The studies identified key elements, such as the role of the government and vendors, the importance of communication and relationships, the provision of training and support, and the implementation approach and cost. Four process-related categories emerged from these results: compliance processes, collaboration processes, competence-development processes, and process costs.

CONCLUSIONS

Although EHRs hold immense promise in improving patient care, enhancing research capabilities, and optimizing health care efficiency, there is a pressing need to examine the actual implementation process to understand how to approach implementation. Our findings offer 7 process-focused recommendations for EHR implementation formed from analysis of the selected literature.

Factors influencing clinician performance post-electronic health record implementation: an empirical analysis in Moroccan hospitals

BACKGROUND

In recent years, the Moroccan Ministry of Health and Social Protection has invested considerable resources in implementing electronic health record (EHR) systems to provide citizens with quality healthcare services through efficient structures. However, the rhythm of EHR deployment across the country is very slow, requiring urgent evaluation to remove barriers to successful EHR adoption.

OBJECTIVE

This study aims to investigate the critical factors affecting healthcare providers' performance post-EHR implementation in Moroccan public hospitals.

METHODS

A cross-sectional study was conducted in three hospitals affiliated with Hassan II University Hospital Center in Fez. Data were collected using a questionnaire survey administered to a sample of 368 healthcare providers from March 2021 to July 2021. Clinician performance was assessed using a proposed research model that integrates the Information System Success Model and the Technology-Organization-Environment framework. The final model was analyzed and tested by using structural equation modeling. Statistical analyses were conducted using SPSS version 25 and Amos version 26.

RESULTS

The findings highlighted that the most critical factors influencing clinician performance are clinician satisfaction (β = 0.5, p < 0.001), followed by organization (β = 0.28, p < 0.001), and system quality (β = 0.17, p = 0.01). Additionally, information quality indirectly affects clinician performance (β = 0.19, p < 0.001). However, the environmental factor does not appear to have a significant impact (β = -0.004, p = 0.94).

CONCLUSION

This study, performed for the first time in Morocco, identifies key factors for policymakers and healthcare organizations to enhance the successful implementation of EHR systems. Additionally, it serves as a valuable framework for future studies in this area.

Externally validated and clinically useful machine learning algorithms to support patient-related decision-making in oncology: a scoping review

BACKGROUND

This scoping review systematically maps externally validated machine learning (ML)-based models in cancer patient care, quantifying their performance, and clinical utility, and examining relationships between models, cancer types, and clinical decisions. By synthesizing evidence, this study identifies, strengths, limitations, and areas requiring further research.

METHODS

The review followed the Joanna Briggs Institute's methodology, Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines, and the Population, Concept, and Context mnemonic. Searches were conducted across Embase, IEEE Xplore, PubMed, Scopus, and Web of Science (January 2014-September 2022), targeting English-language quantitative studies in Q1 journals (SciMago Journal and Country Ranking > 1) that used ML to evaluate clinical outcomes for human cancer patients with commonly available data. Eligible models required external validation, clinical utility assessment, and performance metric reporting. Studies involving genetics, synthetic patients, plants, or animals were excluded. Results were presented in tabular, graphical, and descriptive form.

RESULTS

From 4023 deduplicated abstracts and 636 full-text reviews, 56 studies (2018-2022) met the inclusion criteria, covering diverse cancer types and applications. Convolutional neural networks were most prevalent, demonstrating high performance, followed by gradient- and decision tree-based algorithms. Other algorithms, though underrepresented, showed promise. Lung and digestive system cancers were most frequently studied, focusing on diagnosis and outcome predictions. Most studies were retrospective and multi-institutional, primarily using image-based data, followed by text-based and hybrid approaches. Clinical utility assessments involved 499 clinicians and 12 tools, indicating improved clinician performance with AI assistance and superior performance to standard clinical systems.

DISCUSSION

Interest in ML-based clinical decision-making has grown in recent years alongside increased multi-institutional collaboration. However, small sample sizes likely impacted data quality and generalizability. Persistent challenges include limited international validation across ethnicities, inconsistent data sharing, disparities in validation metrics, and insufficient calibration reporting, hindering model comparison reliability.

CONCLUSION

Successful integration of ML in oncology decision-making requires standardized data and methodologies, larger sample sizes, greater transparency, and robust validation and clinical utility assessments.

OTHER

Financed by FCT-Fundação para a Ciência e a Tecnologia (Portugal, project LA/P/0063/2020, grant 2021.09040.BD) as part of CSS's Ph.D. This work was not registered.

The impact of a 5G-based smart nursing information system and associated mobile hardware on clinical nurses' work stress: a randomized controlled study in a Chinese hospital

BACKGROUND

Clinical nurses frequently endure substantial work-related stress, adversely affecting their well-being and potentially compromising patient care quality and safety. The integration of a 5G-based medical private network into smart nursing systems and mobile devices offers a promising solution to reduce this stress. This study evaluates the impact of a Smart Nursing Information System based on a 5G Medical Private Network and its Supporting Mobile Hardware (SNIS-SMH) on mitigating work-related stress among clinical nurses. The goal is to provide a scientific basis for nursing management, reduce error incidents, advance nursing procedures, and enhance productivity.

RESULTS

A total of 226 nurses completed the study. The SNIS-SMH group showed significantly lower total work stress scores (66.16 ± 9.82) compared to the control group (70.65 ± 11.32, P = 0.002). In specific dimensions, the SNIS-SMH group had lower scores for nursing profession and work (14.17 ± 2.37 vs. 15.00 ± 3.06, P = 0.023), workload and time distribution (10.56 ± 2.45 vs. 12.42 ± 2.55, P < 0.001), and patient care (22.55 ± 3.34 vs. 23.70 ± 4.06, P = 0.021). No significant differences were found in the work environment and resource, and management and interpersonal relationships dimensions.

CONCLUSIONS

The SNIS-SMH system significantly alleviated work-related stress among clinical nurses, particularly in nursing duties, workload and time distribution, and patient care.

The impact of informatization development on healthcare services in China

China faces substantial challenges in healthcare access and quality, marked by significant regional disparities. While the potential of informatization to enhance healthcare services is increasingly acknowledged, the specific mechanisms through which it impacts healthcare delivery remain underexplored. By employing provincial panel data and dynamic spatial panel models, we aim to uncover the mechanisms through which informatization impacts healthcare delivery. Our findings reveal notable regional differences, with the Eastern and Central regions leading in service levels, while the Western and Northeastern regions lag behind. Both informatization development and healthcare services demonstrate significant spatial interaction effects, indicating that improvements in informatization can positively influence healthcare services overall. However, the impact varies: while informatization benefits the Northeastern and Western regions, its effect in the Eastern region is not statistically significant, and the Central region experiences a negative impact. Furthermore, advancements in informatization in the Eastern and Central regions have the potential to enhance healthcare services in the Western and Northeastern regions. By providing empirical insights that identify key digital factors to enhance healthcare efficiency and quality, this study can assist policymakers in China and around the world in adopting more effective strategies to reduce the digital divide in healthcare and promote the development of more equitable and efficient healthcare systems.

The mental health care system for children and adolescents in Greece: a review and structure assessment

Background

The mental health system in Greece faces challenges to complete its transition to a community-oriented model, having significant concerns for child and adolescent care due to lower coverage and service gaps. This component of the mental health system has not been comprehensively evaluated.

Methods

We conducted a review of the mental health care system for children and adolescents in Greece. For a field assessment, we directly collected data from mental health services to map availability and distribution. We analyzed the needs of human resources using professional register data and the national census.

Results

The National Health Care Service (ESY, Εθνικό Σύστημα Υγείας) is the public health system in Greece, characterized by public governance but significant private participation. Although ESY aims for universal care, gaps in population coverage and high user fees create barriers to access. Embedded within ESY, the mental health system is shifting towards a community-oriented structure since the psychiatric reform. For children and adolescents, there is a developing framework for regionalization and community services, including day centers, inpatient facilities, outpatient departments, and school-based psychoeducational facilities. However, services lack coordination in a stepped care model. Patient pathways are not established and primary care rarely involves child mental health, leading to direct access to specialists. Services operate in isolation due to the absence of online registers. There is no systematic performance monitoring, yet some assessments indicate that professional practices may lack evidence-based guidelines. Our mapping highlighted a scarcity of public structures, with an unbalanced regional distribution and many underserved areas. Child and adolescent psychiatrists are predominantly affiliated with the private sector, leading to professional gaps in the public system.

Conclusions

Our assessment identifies an established framework for a community-oriented, universally accessible mental health system, yet several barriers impede its full realization. These include an inconsistent primary healthcare system, a shortage of specialists in the public sector, imbalanced service distribution, lack of coordination among providers, underfunding, and absence of quality monitoring. We propose interventions to promote child and adolescent mental health in primary care, coordinate patient pathways, establish standards of care, and monitor performance.

Electronic health record implementation: how to identify and analyze the possible negative impacts

OBJECTIVE

Identify potential negative impacts arising from implementing an electronic medical record system, classify them according to the level of criticality, and analyze method's effectiveness after implementation.

METHODS

The research involved identifying the negative impacts, classifying them according to the criteria for criticality, stratifying them as high, medium, or low severity, and finally, analyzing the effectiveness of the identification and classification methods.

RESULTS

Findings confirmed that 89.20% of identified impacts occurred as predicted, and 88.94% of impacts had a level of criticality compatible with the severity of the problem.

CONCLUSION

Predicting and classifying negative impacts are important stages in implementing electronic health records in hospitals. The method for identification and classification of impacts were, in most cases, considered effective.

Development and pre-evaluation of a "DiagNurse" mobile app to support nurses in clinical diagnosis using the ADDIE model

Healthcare workers are increasingly utilising cutting-edge technology, including mobile apps, to enhance patient health care and ensure efficient professional performance. The aim of this study was to design, develop and evaluate an educational mobile app dedicated towards being employed by nursing students and practicing nurses to support the clinical assessment of a patient's health condition in nursing care. In order to develop the mobile app, the Analysis, Design, Development, Implementation and Evaluation (ADDIE) model was employed. Between 2022 and 2023, a "Diagnostic Nurse" mobile app was developed in the "Android Application Package (APK)." The app's usability was tested in the laboratory by 20 participants. Three methods were employed in the study, that is, an eye-tracking technique, a qualitative evaluation and a quantitative evaluation. According to the System Usability Scale (SUS), the app test score for the nursing student group was assessed as 83.3 ± 8.9, and for the practicing nursing group, this was 84 ± 12.7. These results indicate that the mobile app's is highly usable. The app received high ratings in the "user-friendliness", "ease-of-use", and "user satisfaction" categories. The "DiagNurse" app makes it easier to learn how to conduct a clinical assessment of a patient's condition in nursing care, resulting in better information acquisition, assessment accuracy and speed. Given the low cost of the app development and the ADDIE model on which it is based, the app may be beneficial to nursing students, practicing nurses and other health-care professionals and students.

Uses of private health provider data for governance in low-income and middle-income countries: results from a scoping review

This work grew from an interest in understanding how private data are used for health system governance in low-income and middle-income countries (LMICs).

OBJECTIVE

We conducted a scoping review to understand how the public sector collects routine data from the private health sector and uses it for governance purposes. The private health sector was defined to include both formal and informal, for-profit or non-profit, actors delivering healthcare services.

FINDINGS

We identified 4014 individual English language studies published between 2010 and 2021. We reviewed titles and abstracts of all, with 50% reviewed by two authors to ensure a common application of inclusion criteria. 89 studies were selected for review in full; following this, 26 articles were included in the final selection as they directly report on the use of routine private sector data for governance in LMICs. Only English language studies were included, limiting the scope of possible conclusions.

RESULTS

Data were most commonly collected by the Ministry of Health or a subministerial office, with extraction from District Health Information System 2 specifically cited for three studies. 16 studies collected data on infrastructure and distribution, 15 on service delivery, 12 on health financing, 7 on pharmaceuticals and other consumables, 4 on health workforce, 4 on quality of care and 4 on epidemic surveillance.

CONCLUSION

The studies identified provide examples of the public sector's capacity to collect and use data routinely collected from the private sector to perform essential governance functions. The paucity of studies identified is an indication that more attention is needed to ensure that this key area of health system governance is undertaken and that lessons learnt are shared. This review provides insights to understanding private sector health data collection and use for governance in LMICs, and for guiding activities to assess and improve this according to country context and capacity.

Paper-and-Pencil vs. Electronic Patient Records: Analyzing Time Efficiency, Personnel Requirements, and Usability Impacts on Healthcare Administration

Background: This study investigates the impact of transitioning from paper and pencil (P&P) methods to electronic patient records (EPR) on workflow and usability in surgical ward rounds. Methods: Surgical ward rounds were audited by two independent observers to evaluate the effects of transitioning from P&P to EPR. Key observations included the number of medical personnel and five critical workflow aspects before and after EPR implementation. Additionally, usability was assessed using the System Usability Scale (SUS) and the Post-Study System Usability Questionnaire (PSSUQ). Results: A total of 192 P&P and 160 EPR observations were analyzed. Physicians experienced increased administrative workload with EPR, while nurses adapted more easily. Ward teams typically consisted of two physicians and three or four nurses. Usability scores rated the system as "Not Acceptable" across all professional groups. Conclusions: The EPR system introduced usability challenges, particularly for physicians, despite potential benefits like improved data access. Usability flaws hindered system acceptance, highlighting the need for better workflow integration. Addressing these issues could improve efficiency and reduce administrative strain. As artificial intelligence becomes more integrated into clinical practice, healthcare professionals must critically assess AI-driven tools to ensure safe and effective patient care.

The Impact of Leadership and Management on the Implementation of Electronic Health Record Systems in the Primary Healthcare Centers

BACKGROUND

In the last three decades, Electronic Health Records Systems (EHRSs) have become one of the top priorities of policymakers globally. Nowadays, EHRS reform is fast becoming a priority in developed countries. The introduction of EHRSs in Saudi healthcare organizations is considered one of the highest priorities of policymakers. Saudi Arabian e-health strategy pays reasonable attention to the EHRS implementation project. According to Saudi Vision 2030, the e-health transformation will be on top of IT projects in the country. However, an estimated 50% of EHRS implementations have failed. Project leadership and type of project management have been found to be crucial components of effective EHRS implementation.

AIM OF THE STUDY

To evaluate the role of centralized project management (CPM) in the implementation of large-scale EHRSs in Primary Healthcare Centers (PHCs) in Saudi Arabia (SA).

METHODS

A sequential explanatory mixed-methods approach involving a survey and semi-structured qualitative interview methods were utilized.

RESULTS

A total of 39 (75%) out of 53 policymakers at the Saudi Ministry of Health completed the survey, and 14 project team members were interviewed. Findings from both illustrated that adopting centralized project management approaches to implementation was beneficial in facilitating large-scale EHRS implementation and helped to overcome barriers that may have otherwise led to the failure of the project. EHRS interoperability and software selection were the factors that CPM influenced most positively.

Implementing an artificial intelligence command centre in the NHS: a mixed-methods study

Background

Hospital 'command centres' use digital technologies to collect, analyse and present real-time information that may improve patient flow and patient safety. Bradford Royal Infirmary has trialled this approach and presents an opportunity to evaluate effectiveness to inform future adoption in the United Kingdom.

Objective

To evaluate the impact of the Bradford Command Centre on patient care and organisational processes.

Design

A comparative mixed-methods study. Operational data from a study and control site were collected and analysed. The intervention was observed, and staff at both sites were interviewed. Analysis was grounded in a literature review and the results were synthesised to form conclusions about the intervention.

Setting

The study site was Bradford Royal Infirmary, a large teaching hospital in the city of Bradford, United Kingdom. The control site was Huddersfield Royal Infirmary in the nearby city of Huddersfield.

Participants

Thirty-six staff members were interviewed and/or observed.

Intervention

The implementation of a digitally enabled hospital command centre.

Main outcome measures

Qualitative perspectives on hospital management. Quantitative metrics on patient flow, patient safety, data quality.

Data sources

Anonymised electronic health record data. Ethnographic observations including interviews with hospital staff. Cross-industry review including relevant literature and expert panel interviews.

Results

The Command Centre was implemented successfully and has improved staff confidence of better operational control. Unintended consequences included tensions between localised and centralised decision-making and variable confidence in the quality of data available. The Command Centre supported the hospital through the COVID-19 pandemic, but the direct impact of the Command Centre was difficult to measure as the pandemic forced all hospitals, including the study and control sites, to innovate rapidly. Late in the study we learnt that the control site had visited the study site and replicated some aspects of the command centre themselves; we were unable to explore this in detail. There was no significant difference between pre- and post-intervention periods for the quantitative outcome measures and no conclusive impact on patient flow and data quality. Staff and patients supported the command-centre approaches but patients expressed concern that individual needs might get lost to 'the system'.

Conclusions

Qualitative evidence suggests the Command Centre implementation was successful, but it proved challenging to link quantitative evidence to specific technology interventions. Staff were positive about the benefits and emphasised that these came from the way they adapted to and used the new technology rather than the technology per se.

Limitations

The COVID-19 pandemic disrupted care patterns and forced rapid innovation which reduced our ability to compare study and control sites and data before, during and after the intervention.

Future work

We plan to follow developments at Bradford and in command centres in the National Health Service in order to share learning. Our mixed-methods approach should be of interest to future studies attempting similar evaluation of complex digitally enabled whole-system changes.

Study registration

The study is registered as IRAS No.: 285933.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: NIHR129483) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 41. See the NIHR Funding and Awards website for further award information.

The impact of eHealth use on general practice workload in the pre-COVID-19 era: a systematic review

BACKGROUND

In recent years, eHealth has received much attention as an opportunity to increase efficiency within healthcare organizations. Adoption of eHealth might consequently help to solve perceived health workforce challenges, including labor shortages and increasing workloads among primary care professionals, who serve as the first point of contact for healthcare in many countries. The purpose of this systematic review was to investigate the impact of general eHealth use and specific eHealth services use on general practice workload in the pre-COVID-19 era.

METHODS

The databases of CINAHL, Cochrane, Embase, IEEE Xplore, Medline ALL, PsycINFO, Web of Science, and Google Scholar were searched, using combinations of keywords including 'eHealth', 'workload', and 'general practice'. Data extraction and quality assessment of the included studies were independently performed by at least two reviewers. Publications were included for the period 2010 - 2020, before the start of the COVID-19 pandemic.

RESULTS

In total, 208 studies describing the impact of eHealth services use on general practice workload were identified. We found that two eHealth services were mainly investigated within this context, namely electronic health records and digital communication services, and that the largest share of the included studies used a qualitative study design. Overall, a small majority of the studies found that eHealth led to an increase in general practice workload. However, results differed between the various types of eHealth services, as a large share of the studies also reported a reduction or no change in workload.

CONCLUSIONS

The impact of eHealth services use on general practice workload is ambiguous. While a small majority of the effects indicated that eHealth increased workload in general practice, a large share of the effects also showed that eHealth use reduced workload or had no impact. These results do not imply a definitive conclusion, which underscores the need for further explanatory research. Various factors, including the study setting, system design, and the phase of implementation, may influence this impact and should be taken into account when general practices adopt new eHealth services.

STUDY REGISTRATION NUMBER

PROSPERO (International Prospective Register of Systematic Reviews) CRD42020199897; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=199897 .

"Following the data": perceptions of and willingness to use clinical decision support tools to inform HIV care among Haitian clinicians

Background

Clinical decision support (CDS) tools can support HIV care, including through case tracking, treatment and medication monitoring, and promoting provider compliance with care guidelines. There has been limited research into the technical, organizational, and behavioral factors that impact perceptions of and willingness to use CDS tools at scale in resource-limited settings, including in Haiti.

Methods

Our sample included fifteen purposively chosen Haitian HIV program experts, including active clinicians and HIV program managers. Participants completed structured quantitative surveys and one-on-one qualitative semi-structured interviews.

Results

Study participants had high levels of familiarity and experience with CDS tools. The primary motivator for CDS tool use was a perceived benefit to quality of care, including improved provider time use, efficiency, and decision-making ability, and patient outcomes. Participants highlighted decision-making autonomy and how CDS tools could support provider decision making but should not supplant provider knowledge and experience. Participants highlighted the need for sufficient provider training/sensitization, inclusion of providers in the system design process, and prioritization of tool user-friendliness as key mechanisms to drive tool use and impact. Some participants noted that systemic issues, such as limited laboratory capacity, may reduce the usefulness of CDS alerts, particularly concerning differentiated care and priority viral load testing.

Conclusion

Respondents had largely positive perceptions of EMRs and CDS tools, particularly due to perceived improvements in quality of care. To improve tool use, stakeholders should prioritize tool user-friendliness and provider training. Addressing systemic health system issues is necessary to unlock the full potential of these tools.

Developing and testing a framework for coding general practitioners' free-text diagnoses in electronic medical records - a reliability study for generating training data in natural language processing

BACKGROUND

Diagnoses entered by general practitioners into electronic medical records have great potential for research and practice, but unfortunately, diagnoses are often in uncoded format, making them of little use. Natural language processing (NLP) could assist in coding free-text diagnoses, but NLP models require local training data to unlock their potential. The aim of this study was to develop a framework of research-relevant diagnostic codes, to test the framework using free-text diagnoses from a Swiss primary care database and to generate training data for NLP modelling.

METHODS

The framework of diagnostic codes was developed based on input from local stakeholders and consideration of epidemiological data. After pre-testing, the framework contained 105 diagnostic codes, which were then applied by two raters who independently coded randomly drawn lines of free text (LoFT) from diagnosis lists extracted from the electronic medical records of 3000 patients of 27 general practitioners. Coding frequency and mean occurrence rates (n and %) and inter-rater reliability (IRR) of coding were calculated using Cohen's kappa (Κ).

RESULTS

The sample consisted of 26,980 LoFT and in 56.3% no code could be assigned because it was not a specific diagnosis. The most common diagnostic codes were, 'dorsopathies' (3.9%, a code covering all types of back problems, including non-specific lower back pain, scoliosis, and others) and 'other diseases of the circulatory system' (3.1%). Raters were in almost perfect agreement (Κ ≥ 0.81) for 69 of the 105 diagnostic codes, and 28 codes showed a substantial agreement (K between 0.61 and 0.80). Both high coding frequency and almost perfect agreement were found in 37 codes, including codes that are particularly difficult to identify from components of the electronic medical record, such as musculoskeletal conditions, cancer or tobacco use.

CONCLUSION

The coding framework was characterised by a subset of very frequent and highly reliable diagnostic codes, which will be the most valuable targets for training NLP models for automated disease classification based on free-text diagnoses from Swiss general practice.

Automating incidence and prevalence analysis in open cohorts

MOTIVATION

Data is increasingly used for improvement and research in public health, especially administrative data such as that collected in electronic health records. Patients enter and exit these typically open-cohort datasets non-uniformly; this can render simple questions about incidence and prevalence time-consuming and with unnecessary variation between analyses. We therefore developed methods to automate analysis of incidence and prevalence in open cohort datasets, to improve transparency, productivity and reproducibility of analyses.

IMPLEMENTATION

We provide both a code-free set of rules for incidence and prevalence that can be applied to any open cohort, and a python Command Line Interface implementation of these rules requiring python 3.9 or later.

GENERAL FEATURES

The Command Line Interface is used to calculate incidence and point prevalence time series from open cohort data. The ruleset can be used in developing other implementations or can be rearranged to form other analytical questions such as period prevalence.

AVAILABILITY

The command line interface is freely available from https://github.com/THINKINGGroup/analogy_publication .

Artificial intelligence empowering public health education: prospects and challenges

Artificial Intelligence (AI) is revolutionizing public health education through its capacity for intricate analysis of large-scale health datasets and the tailored dissemination of health-related information and interventions. This article conducts a profound exploration into the integration of AI within public health, accentuating its scientific foundations, prospective progress, and practical application scenarios. It underscores the transformative potential of AI in crafting individualized educational programs, developing sophisticated behavioral models, and informing the creation of health policies. The manuscript strives to thoroughly evaluate the extant landscape of AI applications in public health, scrutinizing critical challenges such as the propensity for data bias and the imperative of safeguarding privacy. By dissecting these issues, the article contributes to the conversation on how AI can be harnessed responsibly and effectively, ensuring that its application in public health education is both ethically grounded and equitable. The paper's significance is multifold: it aims to provide a blueprint for policy formulation, offer actionable insights for public health authorities, and catalyze the progression of health interventions toward increasingly sophisticated and precise approaches. Ultimately, this research anticipates fostering an environment where AI not only augments public health education but also does so with a steadfast commitment to the principles of justice and inclusivity, thereby elevating the standard and reach of health education initiatives globally.

Benefits, facilitators, and barriers of electronic medical records implementation in outpatient settings: A scoping review

This scoping review examined the breadth and depth of evidence on Electronic Medical Record (EMR) implementation benefits in outpatient settings. Following PRISMA guidelines for scoping reviews, five databases were searched, and 24 studies were retained and reviewed. Benefits, facilitators, and barriers to EMR implementation were extracted. Direct benefits included improved communication/reporting, work efficiency, care process, healthcare outcomes, safety, and patient-centredness of care. Indirect benefits were improved financial performance and increased data accessibility, staff satisfaction, and decision-support usage. Barriers included time and financial constraints; design/technical issues; limited information technology resources, skills, and infrastructure capacity; increased workload and reduced efficiency during implementation; incompatibility of existing systems and local regulations; and resistance from healthcare professionals. Facilitators included training, change management, user-friendliness and alignment with workflow, user experience with EMRs, top management support, and sufficient resources. More rigorous, systematic research is needed, using relevant frameworks to inform healthcare policies and guide EMR projects in outpatient areas.

Constructing and implementing a performance evaluation indicator set for artificial intelligence decision support systems in pediatric outpatient clinics: an observational study

Artificial intelligence (AI) decision support systems in pediatric healthcare have a complex application background. As an AI decision support system (AI-DSS) can be costly, once applied, it is crucial to focus on its performance, interpret its success, and then monitor and update it to ensure ongoing success consistently. Therefore, a set of evaluation indicators was explicitly developed for AI-DSS in pediatric healthcare, enabling continuous and systematic performance monitoring. The study unfolded in two stages. The first stage encompassed establishing the evaluation indicator set through a literature review, a focus group interview, and expert consultation using the Delphi method. In the second stage, weight analysis was conducted. Subjective weights were calculated based on expert opinions through analytic hierarchy process, while objective weights were determined using the entropy weight method. Subsequently, subject and object weights were synthesized to form the combined weight. In the two rounds of expert consultation, the authority coefficients were 0.834 and 0.846, Kendall's coordination coefficient was 0.135 in Round 1 and 0.312 in Round 2. The final evaluation indicator set has three first-class indicators, fifteen second-class indicators, and forty-seven third-class indicators. Indicator I-1(Organizational performance) carries the highest weight, followed by Indicator I-2(Societal performance) and Indicator I-3(User experience performance) in the objective and combined weights. Conversely, 'Societal performance' holds the most weight among the subjective weights, followed by 'Organizational performance' and 'User experience performance'. In this study, a comprehensive and specialized set of evaluation indicators for the AI-DSS in the pediatric outpatient clinic was established, and then implemented. Continuous evaluation still requires long-term data collection to optimize the weight proportions of the established indicators.

The role of information systems in emergency department decision-making-a literature review

OBJECTIVES

Healthcare providers employ heuristic and analytical decision-making to navigate the high-stakes environment of the emergency department (ED). Despite the increasing integration of information systems (ISs), research on their efficacy is conflicting. Drawing on related fields, we investigate how timing and mode of delivery influence IS effectiveness. Our objective is to reconcile previous contradictory findings, shedding light on optimal IS design in the ED.

MATERIALS AND METHODS

We conducted a systematic review following PRISMA across PubMed, Scopus, and Web of Science. We coded the ISs' timing as heuristic or analytical, their mode of delivery as active for automatic alerts and passive when requiring user-initiated information retrieval, and their effect on process, economic, and clinical outcomes.

RESULTS

Our analysis included 83 studies. During early heuristic decision-making, most active interventions were ineffective, while passive interventions generally improved outcomes. In the analytical phase, the effects were reversed. Passive interventions that facilitate information extraction consistently improved outcomes.

DISCUSSION

Our findings suggest that the effectiveness of active interventions negatively correlates with the amount of information received during delivery. During early heuristic decision-making, when information overload is high, physicians are unresponsive to alerts and proactively consult passive resources. In the later analytical phases, physicians show increased receptivity to alerts due to decreased diagnostic uncertainty and information quantity. Interventions that limit information lead to positive outcomes, supporting our interpretation.

CONCLUSION

We synthesize our findings into an integrated model that reveals the underlying reasons for conflicting findings from previous reviews and can guide practitioners in designing ISs in the ED.

Researching big IT in the UK National Health Service: A systematic review of theory-based studies

OBJECTIVE

To identify and discuss theory-based studies of large-scale health information technology programs in the UK National Health Service.

MATERIALS AND METHODS

Using the PRISMA systematic review framework, we searched Scopus, PubMed and CINAHL databases from inception to March 2022 for theory-based studies of large-scale health IT implementations. We undertook detailed full-text analyses of papers meeting our inclusion criteria.

RESULTS

Forty-six studies were included after assessment for eligibility, of which twenty-five applied theories from the information systems arena (socio-technical approaches, normalization process theory, user acceptance theories, diffusion of innovation), twelve from sociology (structuration theory, actor-network theory, institutional theory), while nine adopted other theories. Most investigated England's National Program for IT (2002-2011), exploring various technologies among which electronic records predominated. Research themes were categorized into user factors, program factors, process outcomes, clinical impact, technology, and organizational factors. Most research was qualitative, often using a case study strategy with a longitudinal or cross-sectional approach. Data were typically collected through interviews, observation, and document analysis; sampling was generally purposive; and most studies used thematic or related analyses. Theories were generally applied in a superficial or fragmentary manner; and articles frequently lacked detail on how theoretical constructs and relationships aided organization, analysis, and interpretation of data.

CONCLUSION

Theory-based studies of large NHS IT programs are relatively uncommon. As large healthcare programs evolve over a long timeframe in complex and dynamic environments, wider adoption of theory-based methods could strengthen the explanatory and predictive utility of research findings across multiple evaluation studies. Our review has confirmed earlier suggestions for theory selection, and we suggest there is scope for more explicit use of such theoretical constructs to strengthen the conceptual foundations of health informatics research. Additionally, the challenges of large national health informatics programs afford wide-ranging opportunities to test, refine, and adapt sociological and information systems theories.

The individuals' awareness and adoption of electronic health records in China: a questionnaire survey of 1,337 individuals

BACKGROUND

Electronic health records (EHRs) are digital records of individual health information. However, their adoption and utilization remain low. This study explores the factors influencing the implementation of EHRs through a questionnaire survey to enhance individual awareness and adoption of EHRs.

METHODS

A questionnaire and an expert rating scale were developed sequentially, and the consistency of the scores from five experts was calculated using Kendall's W to generate a final questionnaire. A non-parametric test was utilized to analyze differences in continuous data that did not follow a normal distribution. Categorical variables were expressed as percentages (%), the chi-square test was employed for group comparisons, and multiple logistic regression was implemented to assess individuals' awareness and adoption of EHRs.

RESULTS

In total, 1,341 survey questionnaires were distributed between January and December 2022, with 1,337 valid responses (99.7%). The results indicated that the proportion of participants who were aware of EHRs and had a bachelor's degree or higher education, an income of ≥$700 per month, residence in urban areas, possessed self-care abilities, and underwent annual physical examinations was significantly higher than that without awareness of EHRs (P < 0.05), while in hearing problems and walking abilities was markedly lower than that of participants without awareness of EHRs (P < 0.05). Additionally, the proportion of individuals willing to self-manage EHRs was significantly higher than those reluctant to do so (P < 0.05) among participants with a bachelor's degree or higher education, an income of ≥$700 per month, residence in urban areas, possession of self-care abilities, annual physical examinations, hearing problems, and poor walking abilities. Age (Odds Ratio [OR] = 1.104, 95% Confidence Interval [CI] 1.001-1.028, P = 0.033), hearing problems (OR = 0.604, 95% CI 0.377-0.967, P = 0.036), self-care ability (OR = 5.881, 95% CI 1.867-18.529, P = 0.002), and annual physical examinations (OR = 3.167, 95% CI 2.31-4.34, P < 0.001) were independently associated with willingness to self-manage EHRs. Annual physical examination (OR = 2.507, 95%CI 1.585-2.669, P < 0.001) also independently made a difference to the awareness of EHRs.

CONCLUSIONS

Our findings suggest that annual physical examinations, age, hearing problems, and self-care abilities are significant factors in assessing individuals' awareness and adoption of EHRs. Understanding the characteristics of individuals who are aware of or are willing to take advantage of EHRs plays a positive role in promoting their popularization and application.

Impact of a Nationwide Medication History Sharing Program on the Care Process and End-User Experience in a Tertiary Teaching Hospital: Cohort Study and Cross-Sectional Study

Background

Timely and comprehensive collection of a patient's medication history in the emergency department (ED) is crucial for optimizing health care delivery. The implementation of a medication history sharing program, titled "Patient's In-home Medications at a Glance," in a tertiary teaching hospital aimed to efficiently collect and display nationwide medication histories for patients' initial hospital visits.

Objective

As an evaluation was necessary to provide a balanced picture of the program, we aimed to evaluate both care process outcomes and humanistic outcomes encompassing end-user experience of physicians and pharmacists.

Methods

We conducted a cohort study and a cross-sectional study to evaluate both outcomes. To evaluate the care process, we measured the time from the first ED assessment to urgent percutaneous coronary intervention (PCI) initiation from electronic health records. To assess end-user experience, we developed a 22-item questionnaire using a 5-point Likert scale, including 5 domains: information quality, system quality, service quality, user satisfaction, and intention to reuse. This questionnaire was validated and distributed to physicians and pharmacists. The Mann-Whiteny U test was used to analyze the PCI initiation time, and structural equation modeling was used to assess factors affecting end-user experience.

Results

The time from the first ED assessment to urgent PCI initiation at the ED was significantly decreased using the patient medication history program (mean rank 42.14 min vs 28.72 min; Mann-Whitney U=346; P=.03). A total of 112 physicians and pharmacists participated in the survey. Among the 5 domains, "intention to reuse" received the highest score (mean 4.77, SD 0.37), followed by "user satisfaction" (mean 4.56, SD 0.49), while "service quality" received the lowest score (mean 3.87, SD 0.79). "User satisfaction" was significantly associated with "information quality" and "intention to reuse."

Conclusions

Timely and complete retrieval using a medication history-sharing program led to an improved care process by expediting critical decision-making in the ED, thereby contributing to value-based health care delivery in a real-world setting. The experiences of end users, including physicians and pharmacists, indicated satisfaction with the program regarding information quality and their intention to reuse.

Improving healthcare quality by unifying the American electronic medical report system: time for change

BACKGROUND

In recent years, innovation in healthcare technology has significantly improved the efficiency of the healthcare system. Advancements have led to better patient care and more cost-effective services. The electronic medical record (EMR) system, in particular, has enhanced interoperability and collaboration across healthcare departments by facilitating the exchange and utilization of patient data. The COVID-19 pandemic further accelerated this trend, leading to a surge in telemedicine services, which rely on electronic communication to deliver healthcare remotely.

MAIN BODY

Integrating artificial intelligence (AI) and machine learning (ML) in healthcare have been instrumental in analyzing vast data sets, allowing for identifying patterns and trends that can improve care delivery and pinpoint potential issues. The proposal of a unified EMR system in the USA aims to capitalize on these technological advancements. Such a system would streamline the sharing of patient information among healthcare providers, improve the quality and efficiency of care, and minimize the likelihood of errors in patient treatment.

CONCLUSION

A unified electronic medical record system represents a promising avenue for enhancing interoperability within the US healthcare sector. By creating a more connected and accessible network of patient information, it sets the stage for a transformation in healthcare delivery. This change is imperative for maintaining the momentum of progress in healthcare technology and realizing the full potential of recent advancements in patient care and system efficiency.

Electronic health record-supported implementation of an evidence-based pathway for perioperative surgical care

OBJECTIVES

Enhanced recovery pathways (ERPs) are evidence-based approaches to improving perioperative surgical care. However, the role of electronic health records (EHRs) in their implementation is unclear. We examine how EHRs facilitate or hinder ERP implementation.

MATERIALS AND METHODS

We conducted interviews with informaticians and clinicians from US hospitals participating in an ERP implementation collaborative. We used inductive thematic analysis to analyze transcripts and categorized hospitals into 3 groups based on process measure adherence. High performers exhibited a minimum 80% adherence to 6 of 9 metrics, high improvers demonstrated significantly better adherence over 12 months, and strivers included all others. We mapped interrelationships between themes using causal loop diagrams.

RESULTS

We interviewed 168 participants from 8 hospitals and found 3 thematic clusters: (1) "EHR difficulties" with the technology itself and contextual factors related to (2) "EHR enablers," and (3) "EHR barriers" in ERP implementation. Although all hospitals experienced issues, high performers and improvers successfully integrated ERPs into EHRs through a dedicated multidisciplinary team with informatics expertise. Strivers, while enacting some fixes, were unable to overcome individual resistance to EHR-supported ERPs.

DISCUSSION AND CONCLUSION

We add to the literature describing the limitations of EHRs' technological capabilities to facilitate clinical workflows. We illustrate how organizational strategies around engaging motivated clinical teams with informatics training and resources, especially with dedicated technical support, moderate the extent of EHRs' support to ERP implementation, causing downstream effects for hospitals to transform technological challenges into care-improving opportunities. Early and consistent involvement of informatics expertise with frontline EHR clinician users benefited the efficiency and effectiveness of ERP implementation and sustainability.

Investigating allied health professionals' attitudes, perceptions and acceptance of an electronic medical record using the Unified Theory of Acceptance and Use of Technology

Objective This study aimed to investigate allied health professionals' (AHPs') perspectives pre- and post-implementation of an electronic medical record (EMR) in a tertiary health service in Australia and examine factors influencing user acceptance. Methods Data were collected pre- and post-EMR implementation via cross-sectional online surveys based on the Unified Theory of Acceptance and Usage of Technology (UTAUT). All AHPs at a large tertiary hospital were invited to complete the surveys. Data analysis included descriptive analysis, Mann-Whitney U tests for pre-post item- and construct-level comparison and content analysis of free-text responses. The theoretical model was empirically tested using partial least squares structural equation modelling. Results AHPs had positive attitudes toward EMR use both pre- and post-implementation. Compared to pre-implementation, AHPs felt more positive post-implementation about system ease of use and demonstrated decreased anxiety and apprehension regarding EMR use. AHPs felt they had adequate resources and knowledge to use EMR and reported real-time data accessibility as a main advantage. Disadvantages of EMR included an unfriendly user interface, system outages and decreased efficiency. Conclusions As AHPs increase EMR system familiarity, their positivity towards its use increases. An understanding of what influences AHPs when implementing new compulsory technology can inform change management strategies to improve adoption.

Benchmarking usability of patient portals in Estonia, Finland, Norway, and Sweden

INTRODUCTION

Poor usability is a barrier to widespread adoption of electronic health records (EHR). Providing good usability is especially challenging in the health care context, as there is a wide variety of patient users. Usability benchmarking is an approach for improving usability by evaluating and comparing the strength and weaknesses of systems. The main purpose of this study is to benchmark usability of patient portals across countries.

METHODS

A mixed-methods survey approach was applied to benchmark the national patient portals offering patient access to EHR in Estonia, Finland, Norway, and Sweden. These Nordic countries have similar public healthcare systems, and they are pioneers in offering patients access to EHR for several years. In a survey of 29,334 patients, both patients' quantitative ratings of usability and their qualitative descriptions of very positive and very negative peak experiences of portal use were collected.

RESULTS

The usability scores ranged from good to fair level of usability. The narratives of very positive and very negative experiences included the benefits of the patient portals and experienced usability issues. The regression analysis of results showed that very positive and negative experiences of patient portal use explain 19-35% of the variation of usability scores in the four countries. The percentage of patients who reported very positive or very negative experiences in each country was unrelated to the usability scores across countries.

CONCLUSIONS

The survey approach could be used to evaluate usability with a wide variety of users and it supported learning from comparison across the countries. The combination of quantitative and qualitative data provided an approximation of the level of the perceived usability, and identified usability issues to be improved and useful features that patients appreciate. Further work is needed to improve the comparability of the varied samples across countries.

Barriers and facilitators of the electronic medical record adoption among healthcare providers in Addis Ababa, Ethiopia

Introduction

An electronic medical record (EMR) can enhance the quality of care and patient outcomes. Ethiopia started the implementation of EMR in 2013. However, its adoption among healthcare providers has been low. Thus, this study explored the barriers and facilitators of EMR adoption among healthcare providers in Addis Ababa, Ethiopia.

Methods

A descriptive-phenomenological approach was used. Data were collected from one hospital and three health centers from 5-13 June, 2023, that implemented the EMR. A total of 25 EMR users (physicians, health officers, pharmacists, nurses, laboratory technologists, radiology technicians) were included in the key informant interviews. The interviews were audio-recorded, transcribed verbatim, translated to English, and exported to OpenCode 4.03 software for analysis. Thematic analysis was applied to analyze, summarize, and present the data.

Results

Healthcare providers reported barriers operating at three levels: individual, technological, and organizational. Individual barriers included lack of digital literacy, technical knowledge, skill; motivation; and favorable attitude. Technological barriers included lack of infrastructure including computers, networks, and reliable power supply; and software-related challenges such as system downtime, lack of interoperability, comprehensiveness, and decision support systems; and system security and privacy concerns. Organizational barriers included poor quality of training, lack of follow-up, supervision and technical support; poor leadership commitment; lack of incentives and motivation; and staff turnover and workload. Perceived benefits of the system, such as ease of access to quality data, improved quality of care and work efficiency; availability of onsite technical support; presence of information technology supplies; and feedback from supervisors, were identified as facilitators of EMR adoption.

Conclusion

The study identified different barriers and facilitators to the adoption of the EMR. The health system should prioritize strategies to address technological, individual, and organizational factors influencing the successful adoption of the EMR to support the delivery of quality care and improve patient outcomes.

Factors Influencing Electronic Health Record Workflow Integration Among Nurses in Saudi Arabia: Cross-Sectional Study

Introduction

Globally, healthcare organizations have transitioned from paper-based documentation to electronic health records (EHR), including in Saudi Arabia. However, the adoption of EHR at the national level in Saudi Arabia needs more attention. Thus, this study aimed to determine the workflow integration of EHR and associated factors.

Objectives

The specific aims were to examine the level of EHR use and workflow integration among nurses, to determine the differences in EHR use and workflow integration based on nurses' demographic characteristics, and to determine the association between the predictive factors and EHR workflow integration.

Methods

This is a cross-sectional, correlational descriptive study. The data were collected from 293 nurses using the convenience sampling method. The participating nurses completed a questionnaire that included two measures: the Information System Use Survey and the Workflow Integration Survey (WIS). The data were analyzed using descriptive and multivariate statistics with SPSS software.

Results

The nurses had a positive perception of EHR use and workflow. The EHR use scores differed based on workplace (P < .01), education level (P < .05), and area of practice (P < .001). Similarly, the EHR workflow integration scores varied according to workplace (P < .05), education level (P < .05), and area of practice (P < .001). Education level and workplace significantly predicted information system use. Furthermore, education level and information system use significantly predicted the EHR integration into nurses' workflow.

Conclusion

The nurses expressed a greater perceived use of EHR regarding the integrated health information system, which was a predictor of EHR integration into nurses' workflow.

Challenges and successes in implementing an integrated electronic patient record (HIVE) at the Manchester University National Health Service Foundation Trust, England: 1000+ legacy systems, 10 hospitals, one electronic patient record

BACKGROUND

The Manchester University National Health Service (NHS) Foundation Trust (MFT) is one of the largest NHS Trusts in England. Historically, the Trust has had very mixed clinical record keeping, including over 1000 individual information systems. None of these health information technology systems had the full functionality of an integrated electronic patient record (EPR). MFT evolved to its current size and complexity with a vision to improve patient care in Greater Manchester by adopting a Trust-wide EPR. The EPR "Go Live" occurred in September 2022.

AIM

To describe the process of EPR integration as it reflected and impacted upon MFT's health information management (HIM) teams.

METHOD

MFT worked through a 2-year readiness program of work. This included technical readiness, software development and migration planning. Migration of data from the approximately 1000 systems was a major undertaking, during which access to the clinical history and ongoing operational reporting needed to be maintained. Pre-implementation requirements were outlined, a change management program was implemented, and the overall implementation was managed to tight timelines.

DISCUSSION

"Go Live" was achieved for the EPIC EPR product (HIVE) within MFT. Legacy systems are still in the process of being decommissioned and staff are transacting within HIVE. Significant changes in processes and reporting continue to be made, despite some challenges.

CONCLUSION

The Trust delivered the single largest EPIC European "Go live." Lessons learnt continue to be identified. The impact of what the EPR means for the HIM function is described.

The impact of eHealth on relationships and trust in primary care: a review of reviews

BACKGROUND

Given the increasing integration of digital health technologies in team-based primary care, this review aimed at understanding the impact of eHealth on patient-provider and provider-provider relationships.

METHODS

A review of reviews was conducted on three databases to identify papers published in English from 2008 onwards. The impact of different types of eHealth on relationships and trust and the factors influencing the impact were thematically analyzed.

RESULTS

A total of 79 reviews were included. Patient-provider relationships were discussed more frequently as compared to provider-provider relationships. Communication systems like telemedicine were the most discussed type of technology. eHealth was found to have both positive and negative impacts on relationships and/or trust. This impact was influenced by a range of patient-related, provider-related, technology-related, and organizational factors, such as patient sociodemographics, provider communication skills, technology design, and organizational technology implementation, respectively.

CONCLUSIONS

Recommendations are provided for effective and equitable technology selection, application, and training to optimize the impact of eHealth on relationships and trust. The review findings can inform providers' and policymakers' decision-making around the use of eHealth in primary care delivery to facilitate relationship-building.

Configuring a computer-based nursing process form to support nursing diagnosis in rural healthcare clinics in Nigeria

Poor internet infrastructure limits the use of computer-based nursing process forms in rural areas. This study aimed to configure a computer-based nursing process form to support nursing diagnosis and care evaluation in rural healthcare clinics in Africa. This study utilized a methodological design. The design process utilized a three-stage procedure involving planning, configuration, and testing. Seven faculty members volunteered to participate in the laboratory verification process. Each simulation session lasted 45 min and span from patient admission to exit. The experts independently scored the software functionality dichotomously as Not Suitable (score 0) and Suitable (score 1) for nursing practice. The agreement between the faculty volunteers was 0.857. The configuration of a readily available Microsoft Access computer application to support nursing diagnosis without internet service is possible. Health facilities in rural areas without internet connectivity should resort to such local configurations to maximize the benefits of electronic-based documentation.

Development and validity of the expectations of physiotherapists questionnaire on practice management software

Background

Despite the growing trend in the use of digital technologies in physiotherapy, the overall adoption of both, practice management software (PMS) and electronic health records in physiotherapy clinics has been low and slow over time. In order to learn what factors determine the adoption of these technologies by physiotherapists, there is a need to examine the expectations of physiotherapists (EPs) on specific software attributes. The main aims of this study were to develop a questionnaire to measure and describe the EPs towards PMS. The knowledge of these EPs will be useful to guide PMS design in order to improve physiotherapists' satisfaction.

Methods

Instrument development study with validity and reliability testing. The development of this questionnaire was conducted in three phases: identification of attributes to be explored, development of the items, pilot study, and psychometric testing. The questionnaire was distributed to chartered physiotherapists. A total of 272 participants completed the questionnaire.

Results

A series of analysis were conducted to assess item reduction, factor structure of the questionnaire and metric properties of multi-item scales. From the initial 43 attributes, the final version of the questionnaire consisted of 26 items on EPs, grouped in nine scales and two areas (clinical care and administrative activities). As a result, all scores had strong item-scale correlations, excellent item scaling success, and good internal consistency (Cronbach alpha coefficients of >.7). Our study also showed that current EPs were high towards most of the items, only two scales concentrated most of the attributes with the least expectations (monitoring quality of care and digital health interventions). Our study included physiotherapists with and without experience with PMS, and it showed that both groups had a similar pattern of expectations. Our study provides a valuable questionnaire of EP on PMS attributes for clinical care and administrative activities and shows a detailed development process.

The impact of hospital command centre on patient flow and data quality: findings from the UK National Health Service

In the last 6 years, hospitals in developed countries have been trialling the use of command centres for improving organizational efficiency and patient care. However, the impact of these command centres has not been systematically studied in the past. It is a retrospective population-based study. Participants were patients who visited the Bradford Royal Infirmary hospital, Accident and Emergency (A&E) Department, between 1 January 2018 and 31 August 2021. Outcomes were patient flow (measured as A&E waiting time, length of stay, and clinician seen time) and data quality (measured by the proportion of missing treatment and assessment dates and valid transition between A&E care stages). Interrupted time-series segmented regression and process mining were used for analysis. A&E transition time from patient arrival to assessment by a clinician marginally improved during the intervention period; there was a decrease of 0.9 min [95% confidence interval (CI): 0.35-1.4], 3 min (95% CI: 2.4-3.5), 9.7 min (95% CI: 8.4-11.0), and 3.1 min (95% CI: 2.7-3.5) during 'patient flow program', 'command centre display roll-in', 'command centre activation', and 'hospital wide training program', respectively. However, the transition time from patient treatment until the conclusion of consultation showed an increase of 11.5 min (95% CI: 9.2-13.9), 12.3 min (95% CI: 8.7-15.9), 53.4 min (95% CI: 48.1-58.7), and 50.2 min (95% CI: 47.5-52.9) for the respective four post-intervention periods. Furthermore, the length of stay was not significantly impacted; the change was -8.8 h (95% CI: -17.6 to 0.08), -8.9 h (95% CI: -18.6 to 0.65), -1.67 h (95% CI: -10.3 to 6.9), and -0.54 h (95% CI: -13.9 to 12.8) during the four respective post-intervention periods. It was a similar pattern for the waiting and clinician seen times. Data quality as measured by the proportion of missing dates of records was generally poor (treatment date = 42.7% and clinician seen date = 23.4%) and did not significantly improve during the intervention periods. The findings of the study suggest that a command centre package that includes process change and software technology does not appear to have a consistent positive impact on patient safety and data quality based on the indicators and data we used. Therefore, hospitals considering introducing a command centre should not assume there will be benefits in patient flow and data quality.

Disparities of Health Program Information Systems in Indonesia: A Cross-Sectional Indonesian Health Facility Research 2019

Although a recording and reporting format for health centers already exists for Indonesia's standard information system, numerous health applications still need to meet the needs of each program. Therefore, this study aimed to demonstrate the potential disparities in information systems in the application and data collection of health programs among Indonesian community health centers (CHCs) based on provinces and regions. This cross-sectional research used data from 9831 CHCs from the Health Facilities Research 2019 (RIFASKES). Significance was assessed using a chi-square test and analysis of variance (ANOVA). The number of applications was depicted on a map using the spmap command with STATA version 14. It showed that region 2, which represented Java and Bali, was the best, followed by regions 1, which comprised Sumatra Island and its surroundings, and 3, Nusa Tenggara. The highest mean, equaling that of Java, was discovered in three provinces of region 1, namely, Jambi, Lampung, and Bangka Belitung. Furthermore, Papua and West Papua had less than 60% for all types of data-storage programs. Hence, there is a disparity in the health information system in Indonesia by province and region. The results of this analysis recommend future improvement of the CHCs' information systems.

Understanding Healthcare Providers’ Electronic Health Record (EHR) Interface Preferences via Conjoint Analysis

OBJECTIVE

The emergence of Electronic Health Records (EHRs) has been beneficial in processing administrative and clinical data for quality healthcare information. Despite being patient-centered, a number of these technologies have a fractional consideration of the human-computer interaction, which affects the healthcare professionals as end-users. This attempted to surface the healthcare providers' preferences of an ideal EHR system interface in the community setting.

MATERIALS AND METHOD

Using an orthogonal main effect design of conjoint analysis, a select group of healthcare providers (n = 300) were asked to sort choice cards, which contains five (5) attributes of EHR interface with specific level. Data were analyzed using Sawtooth v.18 and SPSS v.21.

RESULTS

High importance was given to color scheme and device platform. Further, the part-worth analysis revealed the preference for an EHR with the following attributes: (a) smartphone device, (b) triadic color, (c) minimalist design, (d) chunked layout and (e) icon-centered menu.

DISCUSSION

Visual interest and technology needs of the community healthcare providers shaped their preferences. These provide substantial perspectives on how to improve usability of EHR interface systems.

CONCLUSION

Findings underscored the expanded roles of the healthcare professionals in the successful development of EHR systems.

Health information communication technology evaluation frameworks for pharmacist prescribing: A systematic scoping review

BACKGROUND

Information communication technology (ICT) is instrumental in pharmacists' current practice and emerging roles. One such role is prescribing, which requires the use of clinical guidelines and documentation of decision-making, commonly via ICT. Development and refinement of ICT should be guided by evaluation frameworks that describe or measure features of ICT and its implementation. In the context of pharmacist prescribing, these evaluation frameworks should be specific to health stakeholders and the pharmacy setting.

OBJECTIVES

To identify ICT evaluation frameworks from health-related literature and review frameworks relevant to the development, implementation, and evaluation of pharmacist prescribing.

METHODS

A database search of CINAHL, Cochrane Library, EMBASE, Medline (Ovid), ProQuest, Scopus, Web of Science and grey literature was conducted, using combinations of keywords relating to 'ICT', 'utilization', 'usability', and 'evaluation framework'. Abstracts and titles were screened according to inclusion criteria. Identified evaluation frameworks were critiqued for relevance to pharmacy practice.

RESULTS

Twenty-two articles were identified, describing the development or application of 20 evaluation frameworks. None of the frameworks was developed specifically for pharmacy practice. The Technology Acceptance Model (TAM), describing use behavior, behavior intention, perceived usefulness, and perceived ease of use, was the most widely utilized framework. The Information System Success (ISS) and Human-Organization and Technology Fit (HOT-fit) are notable evaluation frameworks that address user and organizational influences in health ICT utility, and factors of both can address the limitation of TAM.

CONCLUSIONS

The findings call for development of an agile evaluation framework for the system under review; however, this can prove difficult due to the heterogenicity and complexity of the healthcare system, particularly contemporary pharmacy practice. While the TAM appears useful to evaluate user attitudes and intentions towards ICT, its relevance to ICT in contemporary community pharmacy practice requires exploration.

Predicting length of stay ranges by using novel deep neural networks

Background and aims

Accurately predicting length of stay (LOS) is considered a challenging task for health care systems globally. In previous studies on LOS range prediction, researchers commonly pre-classified the LOS ranges, which were the same for all patients in the same classification, and then utilized a classifier for prediction. In this study, we innovatively aimed to predict the specific LOS range for each patient (the LOS range was different for each patient).

Methods

In the modified deep neural network (DNN), the overall sample error (root mean square error (RMSE) method), the estimated sample error (ERR_pred method), the probability distribution with different loss functions (Dis_pred_Loss1, Dis_pred_Loss2, and Dis_pred_Loss3 method), and the generative adversarial networks (WGAN-GP for LOS method) are used for LOS range prediction. The Medical Information Mart for Intensive Care III (MIMIC-III) database is used to validate these methods.

Results

The RMSE method is convenient for LOS range prediction, but the predicted ranges are all consistent in the same batch of samples. The ERR_pred method can achieve better prediction results in samples with low errors. However, the prediction effect is worse in samples with larger errors. The Dis_pred_Loss1 method encounters a training instability problem. The Dis_pred_Loss2 and Dis_pred_Loss3 methods perform well in making predictions. Although WGAN-GP for LOS method does not show a substantial advantage over other methods, this method might have the potential to improve the predictive performance.

Conclusion

The results show that it is possible to achieve an acceptable accurate LOS range prediction through a reasonable model design, which may help physicians in the clinic.

Mortality prediction among ICU inpatients based on MIMIC-III database results from the conditional medical generative adversarial network

Background and aims

Improved mortality prediction among intensive care unit (ICU) inpatients is a valuable and challenging task. Limited clinical data, especially with appropriate labels, are an important element restricting accurate predictions. Generative adversarial networks (GANs) are excellent generative models and have shown great potential for data simulation. However, there have been no relevant studies using GANs to predict mortality among ICU inpatients. In this study, we aim to evaluate the predictive performance of a variant of GAN called conditional medical GAN (c-med GAN) compared with some baseline models, including simplified acute physiology score II (SAPS II), support vector machine (SVM), and multilayer perceptron (MLP).

Methods

Data from a publicly available intensive care database, the Medical Information Mart for Intensive Care III (MIMIC-III) database (v1.4), were included in this study. The area under the precision-recall curve (PR-AUC), area under the receiver operating characteristic curve (ROC-AUC), and F1 score were used to evaluate the predictive performance. In addition, the size of the dataset was artificially reduced, and the performance of the c-med GAN was compared in different size datasets.

Results

The results showed that c-med GAN achieves the best PR-AUC, ROC-AUC, and F1 score compared with SAPS II, SVM, and MLP when training in the full MIMIC-III dataset. When the size of the dataset was reduced, the prediction performances of both MLP and c-med GAN were affected. However, the c-med GAN still outperformed MLP on smaller datasets and had less degradation.

Conclusion

The prediction of in-hospital mortality based on the c-med GAN for ICU patients showed better performance than the baseline models. Despite some inadequacies, this model may have a promising future in clinical applications which will be explored by further research.

Digital health for all: How digital health could reduce inequality and increase universal health coverage

Digital transformation in health care has a lot of opportunities to improve access and quality of care. However, in reality not all individuals and communities are benefiting equally from these innovations. People in vulnerable conditions, already in need of more care and support, are often not participating in digital health programs. Fortunately, numerous initiatives worldwide are committed to make digital health accessible to all citizens, stimulating the long-cherished global pursuit of universal health coverage. Unfortunately initiatives are not always familiar with each other and miss connection to jointly make a significant positive impact. To reach universal health coverage via digital health it is necessary to facilitate mutual knowledge exchange, both globally and locally, to link initiatives and apply academic knowledge into practice. This will support policymakers, health care providers and other stakeholders to ensure that digital innovations can increase access to care for everyone, leading towards Digital health for all.

The impact financial resources on implementation of large-scale electronic health records in the Saudi Arabia's primary healthcare centers: Mixed methods

Introduction

There is worldwide demand for the implementation of electronic health systems and a transformation to electronic transactions in healthcare organizations. This move to e-health transformation stems from the perceived positive impact that e-health systems have in improving the quality of healthcare and, in turn, reducing expenses. Despite this, more than half of previous Electronic Health Record System (EHRS) implementation projects have failed due to several barriers and challenges such as cost.

Aim of the study

To evaluate the impact of financial resources (FR) on the implementation of the EHRS in PHCs in SA.

Methods

A mixed methods approach was implemented. SPSS and AMOS-SEM are used to test reliability and validity and hypotheses. Thirty-one (59%) out of 51 policy makers at the MoH filled and returned the questionnaire while 13 policymakers were interviewed using semi-structure interviews.

Results

Results revealed that both measurement model and structural models met the threshold. All scales are found reliable and valid. Furthermore financial resources have positive impact on EHRS implementation. Findings from both studies show that financial resources have a very positive impact to facilitate large-scale EHRs implementation and overcome barriers that may lead to the failure of the project.

Exploring facilitators of the implementation of electronic health records in Saudi Arabia

INTRODUCTION

The introduction of information technology was one of the key priorities for policy-makers in health care organisations over the last two decades due to the potential benefits of this technology to improve health care services and quality. However, approximately 50% of those projects failed to achieve their intended aims. This was a result of several factors, including the cost of these projects. The Saudi Ministry of Health (MoH) planned to implement an electronic health record system (EHRS) in approximately 2100 primary health care centres nationwide. It was acknowledged that this project may face hurdles, which might result in the failure of the project if implementation facilitators were not first determined. According to the Saudi MoH, previous electronic health record system implementation in primary health care centres failed as a consequence of several barriers, such as poor infrastructure, lack of connectivity and lack of interoperability. However, the facilitators of successful electronic health record system implementation in Saudi primary health care centres are not understood.

AIM

To determine the facilitators that enhance the success of the implementation of an EHRS in public primary health care centres in SA.

METHOD

A mixed methods approach was used with both qualitative and quantitative methods (qualitative using semistructured interviews and quantitative with a closed survey). The purpose of the utilisation of exploratory mixed methods was to identify a wide range of facilitators that may influence EHRS implementation. The data were obtained from two different perspectives, primary health care centre practitioners and project team members. A total of 351 practitioners from 21 primary health care centres participated in the online survey, and 14 key informants at the Saudi Ministry of Health who were directly involved in the electronic health record system implementation in the primary health care centres agreed to be interviewed face to face.

RESULTS

The findings from both studies revealed several facilitators. Among these facilitators, financial resources were found to be the most influential factor that assisted in overcoming some barriers, such as software selection. The size of the primary health care centres was the second facilitator of successful implementation, despite the scale of the project. Perceived usefulness was another facilitator identified in both the interviews and the survey. More than 90% of the participants thought that the electronic health record system was useful and could contribute to improving the quality of health care services. While a high level of satisfaction was expressed towards the electronic health record system's usability and efficiency, low levels of satisfaction were recorded for organisational factors such as user involvement, training and support. Hence, system usability and efficiency were documented to be other facilitators of successful electronic health record system implementation in Saudi primary health care centres.

CONCLUSION

The findings of the present study suggest that sufficient financial support is essential to enhance the success of electronic health record system implementation despite the scale of the project. Additionally, effective leadership and project management are core factors to overcome many obstacles and ensure the success of large-scale projects.

Antibiotic point prevalence survey at a tertiary healthcare hospital in India: Identifying strategies to improve the antibiotic stewardship program immediately after a COVID-19 wave

Background

The COVID-19 pandemic has substantially affected the antibiotic stewardship activities in most hospitals of India.

Aims

We conducted an antibiotic point prevalence survey (PPS) immediately after the decline of a major COVID-19 wave at a dedicated COVID-19 hospital. By doing so we aimed to identify the antibiotic prescription patterns, identify factors influencing the choice of antibiotics, and identify/develop strategies to improve the antibiotic stewardship program in such setups.

Methods

The PPS was single-centred, cross-sectional, and retrospective in nature. Patients admitted in various wards and intensive care units (ICUs) between September 2021 to October 2021 were included in our PPS.

Results

Of the included 460 patients, 192 were prescribed antibiotics. Of these 192 patients, ICU-admitted patients had the highest number of antibiotics prescribed i.e. 2.09 ± 0.92. Only a minor fraction (7.92 %) of antibiotics prescriptions were on the basis of culture reports. Most of the antibiotics were prescribed empirically by the parenteral route. The most common group of antibiotics prescribed were third-generation cephalosporins. Carbapenems were the most common designated antibiotics prescribed. A large number of patients (22.40 %) were prescribed a double anaerobic coverage.

Conclusion

The strategies that we identified to improve the antibiotic stewardship program at our institute included reviving the culture of sending culture reports to prescribe antibiotics, improving surgical prophylaxis guidelines, training resident doctors to categorize antibiotic prescriptions appropriately, closely monitoring prescriptions providing double anaerobic coverage, and improving the electronic medical record system for improving prescription auditing.

Evaluation of an intervention to improve the safety of medication therapy via HIT-supported interprofessional cooperation in long-term care - a mixed method study

Background

In order to ensure the provision of appropriate and safe medication therapy in long-term care, close interprofessional cooperation and high levels of expertise are required. Online digital documentation and communication technology facilitate this process. The aim of the present study (sub-study 2 of the SiMbA-Study) was to evaluate a three-part health information technology (HIT) driven intervention on medication therapy safety in Austrian nursing homes (NHs) regarding its usefulness, practicability and implementation in routine care.

Methods

A concurrent embedded mixed-methods design was conducted to evaluate the intervention. Data was collected via expert interviews, focus group discussions and quantitative survey of general practitioners, nurses, and pharmacists in 3 NHs. Usefulness and effectiveness of the intervention were investigated through summative evaluation. Formative evaluation was utilized to gain insights regarding features and factors of the implementation process necessary to a successful integration in routine care.

Results

The sample comprised general practitioners, pharmacists, and nurses. 23 participants were interviewed, of which 17 participated in the focus group discussions and completed the quantitative Survey. All components of the intervention were deemed to be useful and effective. Effort and benefit of using health information technology were well balanced. Implementation success was mainly attributed to socio-normative factors.

Conclusions

The implementation of HIT-based measures can be effective but is prone to various pitfalls that are highlighted in the study. A critical challenge for successful implementation is the combination of both, ensuring its prerequisites, while anticipating new problems that arise from HIT-integration on the one hand and changes in interprofessional cooperation on the other.

Trial registration

DRKS Data Management, ID: DRKS00012246. Registered 16.05.2017 – Retrospectively registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08562-6.

Barriers and facilitators to implementing a nursing clinical decision support system in a tertiary hospital setting: A qualitative study using the FITT framework

OBJECTIVE

Clinical decision support systems (CDSSs) have been increasingly introduced to health care settings; however, their adoption is far from ideal. Guided by the FITT framework, this study aims to explore barriers and facilitators to the implementation of a CDSS from the perspective of nurses.

METHODS

A qualitative study with 200 h of participatory observation and 21 semi structured interviews was conducted from February to August 2021 in four medical-surgical wards in a 2000-bed tertiary hospital in Shanghai, China. The field notes were typed and the audio-recorded interviews were transcribed to texts verbatim and were coded with a four-step approach. We used the FITT framework to interpret our findings based on the technology, individual and task attributes and the fit between them.

RESULTS

A total of twelve categories were identified, which were integrated into two themes: barriers and facilitators to system implementation. All categories but one can be mapped to the three attributes of the FITT framework: technology, individual and task. We assumed that management has a vital role to play in the following areas: addressing user resistance, improving system usability, setting standards on practice and, finally, building connectivity between nurses and the technical staff to improve the fit between the technology, individual and task attribute and thus promote system implementation.

CONCLUSION

Barriers and facilitators to CDSS implementation include system-related, user-related and organizational factors which can largely be fit io the FITT framework. There is potential to extend the FITT framework to represent management intervention on inter-disciplinary collaboration. Future empirical studies on facilitating strategies from the management to improve user experience and willingness of CDSS adoption are needed.

The Interplay of Work, Digital Health Usage, and the Perceived Effects of Digitalization on Physicians' Work: Network Analysis Approach

Background

In health care, the benefits of digitalization need to outweigh the risks, but there is limited knowledge about the factors affecting this balance in the work environment of physicians. To achieve the benefits of digitalization, a more comprehensive understanding of this complex phenomenon related to the digitalization of physicians’ work is needed.

Objective

The aim of this study was to examine physicians’ perceptions of the effects of health care digitalization on their work and to analyze how these perceptions are associated with multiple factors related to work and digital health usage.

Methods

A representative sample of 4630 (response rate 24.46%) Finnish physicians (2960/4617, 64.11% women) was used. Statements measuring the perceived effects of digitalization on work included the patients’ active role, preventive work, interprofessional cooperation, decision support, access to patient information, and faster consultations. Network analysis of the perceived effects of digitalization and factors related to work and digital health usage was conducted using mixed graphical modeling. Adjusted and standardized regression coefficients are denoted by b. Centrality statistics were examined to evaluate the relative influence of each variable in terms of node strength.

Results

Nearly half of physicians considered that digitalization has promoted an active role for patients in their own care (2104/4537, 46.37%) and easier access to patient information (1986/4551, 43.64%), but only 1 in 10 (445/4529, 9.82%) felt that the impact has been positive on consultation times with patients. Almost half of the respondents estimated that digitalization has neither increased nor decreased the possibilities for preventive work (2036/4506, 45.18%) and supportiveness of clinical decision support systems (1941/4458, 43.54%). When all variables were integrated into the network, the most influential variables were purpose of using health information systems, employment sector, and specialization status. However, the grade given to the electronic health record (EHR) system that was primarily used had the strongest direct links to faster consultations (b=0.32) and facilitated access to patient information (b=0.28). At least 6 months of use of the main EHR was associated with facilitated access to patient information (b=0.18).

Conclusions

The results highlight the complex interdependence of multiple factors associated with the perceived effects of digitalization on physicians’ work. It seems that a high-quality EHR system is critical for promoting smooth clinical practice. In addition, work-related factors may influence other factors that affect digital health success. These factors should be considered when developing and implementing new digital health technologies or services for physicians’ work. The adoption of digital health is not just a technological project but a project that changes existing work practices.