Evaluation of software maintain ability with open EHR - a comparison of architectures

Assessing the impact of software quality models in healthcare software systems

Health and medical care are safety-critical environments. The development of a safe and reliable healthcare software system is one of the most important processes which may affect the accuracy of clinical decision making and have an impact on determining diagnoses of and treatment for diseases. The aim of this study is to assess if software quality models, such as McCall, can have an impact on healthcare software quality for the purpose of reducing software failures. We have identified the main criticalities of healthcare software systems based on existing literature, software quality models and programming language standards; we have related these criticalities to software characteristics; we have analysed the relationship between the main criticalities of healthcare software systems and their software characteristics. The following criticalities - the risk of changing hard-coded software and the importance of developing maintainable software - must be addressed at the start of the software development process.

Investigating the Impact of Outsourcing on IT Flexibility

Modern healthcare organizations try to leverage their IT infrastructures to enhance the efficiency of processes and the quality of patient services. The flexibility of the IT infrastructure is a critical factor in the process of establishing strategic and operational value. The authors examine how applied principles of Conceptual Independence (CI) in information systems (IS) influence the flexibility of IT infrastructures. Furthermore, it is presumed that IT outsourcing plays a role in IT flexibility. The second question asks whether IT outsourcing configurations change when CI has been applied or not. Quantitative and qualitative data have been collected in 9 mental healthcare organizations. Findings – based on integration of the data with a mixed-method approach - suggest that the healthcare organizations that apply the principles of CI are better equipped to adapt their IT infrastructure to changing demands, requests and needs. Likewise, results suggest that they have changed the government of IT outsourcing thereby increasing IT flexibility even further.

Performance of an openEHR based hospital information system

BACKGROUND

A desirable feature of hospital information systems is interoperability, which is generally quite limited due to the lack of standardization of the data model. This results in high development and maintenance costs for such systems. The openEHR standard addresses this problem. Due to its two-level modelling, it allows the separation of demographic and medical data and the storage of this data so that it can be easily processed and exchanged. However, it introduces an additional software layer that may affect system performance. This article examines the performance of a system based on the openEHR standard and compares it with the performance of a proprietary system developed in a classic way.

METHODS

Two hospital information systems with the same functionality were designed and developed. One was based on an openEHR server, and another was using proprietary data model having both demographic and medical data. Systems were deployed on Azure platform and load tests using JMeter were conducted to calculate statistics of elapsed time of requests as well as throughput of both systems.

RESULTS

Endpoints which fetch only demographic data had the same performance, but when medical data had to be queried, a decrease in performance of the openEHR based system was noticed. The system based on a proprietary data had about 6 times bigger throughput in terms of medical data fetching.

CONCLUSIONS

OpenEHR adds another layer to the architecture of a hospital information system which might result in performance issues. Such a system must be designed to operate on a sufficiently strong architecture if it is intended to serve many users.

A Patient-Screening Tool for Clinical Research Based on Electronic Health Records Using OpenEHR: Development Study

Background

The widespread adoption of electronic health records (EHRs) has facilitated the secondary use of EHR data for clinical research. However, screening eligible patients from EHRs is a challenging task. The concepts in eligibility criteria are not completely matched with EHRs, especially derived concepts. The lack of high-level expression of Structured Query Language (SQL) makes it difficult and time consuming to express them. The openEHR Expression Language (EL) as a domain-specific language based on clinical information models shows promise to represent complex eligibility criteria.

Objective

The study aims to develop a patient-screening tool based on EHRs for clinical research using openEHR to solve concept mismatch and improve query performance.

Methods

A patient-screening tool based on EHRs using openEHR was proposed. It uses the advantages of information models and EL in openEHR to provide high-level expressions and improve query performance. First, openEHR archetypes and templates were chosen to define concepts called simple concepts directly from EHRs. Second, openEHR EL was used to generate derived concepts by combining simple concepts and constraints. Third, a hierarchical index corresponding to archetypes in Elasticsearch (ES) was generated to improve query performance for subqueries and join queries related to the derived concepts. Finally, we realized a patient-screening tool for clinical research.

Results

In total, 500 sentences randomly selected from 4691 eligibility criteria in 389 clinical trials on stroke from the Chinese Clinical Trial Registry (ChiCTR) were evaluated. An openEHR-based clinical data repository (CDR) in a grade A tertiary hospital in China was considered as an experimental environment. Based on these, 589 medical concepts were found in the 500 sentences. Of them, 513 (87.1%) concepts could be represented, while the others could not be, because of a lack of information models and coarse-grained requirements. In addition, our case study on 6 queries demonstrated that our tool shows better query performance among 4 cases (66.67%).

Conclusions

We developed a patient-screening tool using openEHR. It not only helps solve concept mismatch but also improves query performance to reduce the burden on researchers. In addition, we demonstrated a promising solution for secondary use of EHR data using openEHR, which can be referenced by other researchers.

Evaluation of user embracement software with pediatric risk classification

ABSTRACT Objective: to evaluate functional performance and technical quality of user embracement software with pediatric risk classification. Method: descriptive exploratory study developed based on the quality requirements set forth in ISO/IEC 25010. The evaluated characteristics were: functional adequacy, reliability, usability, performance efficiency, compatibility, safety, maintainability and portability. Eight specialists from the area of informatics and 13 from nursing participated in the evaluation. The characteristics were considered adequate when they reached more than 70% of indication as very and/or completely appropriate in the evaluations of each group of specialists. Results: The results obtained from the evaluation of informatics and nursing specialists were: functional adequacy (100.0%, 96.2%), reliability (82.6%, 88.5%), usability (84.9%; 98.7%), performance efficiency (93.4%; 96.2%), compatibility (85.0%, 98.1%), safety (91.7%, 100.0%), and, yet, maintainability (95.0%) and portability (87.5%) evaluated by the first ones. Conclusion: the software was considered adequate regarding technical quality and functional performance.

Modeling EHR with the openEHR approach: an exploratory study in China

BACKGROUND

The openEHR approach can improve the interoperability of electronic health record (EHR) through two-level modeling. Developing archetypes for the complete EHR dataset is essential for implementing a large-scale interoperable EHR system with the openEHR approach. Although the openEHR approach has been applied in different domains, the feasibility of archetyping a complete EHR dataset in a hospital has not been reported in academic literature, especially in a country where using openEHR is still in its infancy stage, like China. This paper presents a case study of modeling an EHR in China aiming to investigate the feasibility and challenges of archetyping a complete EHR dataset with the openEHR approach.

METHODS

We proposed an archetype modeling method including an iterative process of collecting requirements, normalizing data elements, organizing concepts, searching corresponding archetypes, editing archetypes and reviewing archetypes. Two representative EHR systems from Chinese vendors and the existing Chinese EHR standards have been used as resources to identify the requirements of EHR in China, and a case study of modeling EHR in China has been conducted. Based on the models developed in this case study, we have implemented a clinical data repository (CDR) to verify the feasibility of modeling EHR with archetypes.

RESULTS

Sixty four archetypes were developed to represent all requirements of a complete EHR dataset. 59 (91%) archetypes could be found in Clinical Knowledge Manager (CKM), of which 35 could be reused directly without change, and 23 required further development including two revisions, two new versions, 18 extensions and one specialization. Meanwhile, 6 (9%) archetypes were newly developed. The legacy data of the EHR system in hospitals could be integrated into the CDR developed with these archetypes successfully.

CONCLUSIONS

The existing archetypes in CKM can faithfully represent most of the EHR requirements in China except customizations for local hospital management. This case study verified the feasibility of modeling EHR with the openEHR approach and identified the fact that the challenges such as localization, tool support, and an agile publishing process still exist for a broader application of the openEHR approach.

ORBDA: An openEHR benchmark dataset for performance assessment of electronic health record servers

The openEHR specifications are designed to support implementation of flexible and interoperable Electronic Health Record (EHR) systems. Despite the increasing number of solutions based on the openEHR specifications, it is difficult to find publicly available healthcare datasets in the openEHR format that can be used to test, compare and validate different data persistence mechanisms for openEHR. To foster research on openEHR servers, we present the openEHR Benchmark Dataset, ORBDA, a very large healthcare benchmark dataset encoded using the openEHR formalism. To construct ORBDA, we extracted and cleaned a de-identified dataset from the Brazilian National Healthcare System (SUS) containing hospitalisation and high complexity procedures information and formalised it using a set of openEHR archetypes and templates. Then, we implemented a tool to enrich the raw relational data and convert it into the openEHR model using the openEHR Java reference model library. The ORBDA dataset is available in composition, versioned composition and EHR openEHR representations in XML and JSON formats. In total, the dataset contains more than 150 million composition records. We describe the dataset and provide means to access it. Additionally, we demonstrate the usage of ORBDA for evaluating inserting throughput and query latency performances of some NoSQL database management systems. We believe that ORBDA is a valuable asset for assessing storage models for openEHR-based information systems during the software engineering process. It may also be a suitable component in future standardised benchmarking of available openEHR storage platforms.

Applying openEHR's Guideline Definition Language to the SITS international stroke treatment registry: a European retrospective observational study

Background

Interoperability standards intend to standardise health information, clinical practice guidelines intend to standardise care procedures, and patient data registries are vital for monitoring quality of care and for clinical research. This study combines all three: it uses interoperability specifications to model guideline knowledge and applies the result to registry data.

Methods

We applied the openEHR Guideline Definition Language (GDL) to data from 18,400 European patients in the Safe Implementation of Treatments in Stroke (SITS) registry to retrospectively check their compliance with European recommendations for acute stroke treatment.

Results

Comparing compliance rates obtained with GDL to those obtained by conventional statistical data analysis yielded a complete match, suggesting that GDL technology is reliable for guideline compliance checking.

Conclusions

The successful application of a standard guideline formalism to a large patient registry dataset is an important step toward widespread implementation of computer-interpretable guidelines in clinical practice and registry-based research. Application of the methodology gave important results on the evolution of stroke care in Europe, important both for quality of care monitoring and clinical research.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-016-0401-5) contains supplementary material, which is available to authorized users.

Open data models for smart health interconnected applications: the example of openEHR

BACKGROUND

Smart Health is known as a concept that enhances networking, intelligent data processing and combining patient data with other parameters. Open data models can play an important role in creating a framework for providing interoperable data services that support the development of innovative Smart Health applications profiting from data fusion and sharing.

METHODS

This article describes a model-driven engineering approach based on standardized clinical information models and explores its application for the development of interoperable electronic health record systems. The following possible model-driven procedures were considered: provision of data schemes for data exchange, automated generation of artefacts for application development and native platforms that directly execute the models. The applicability of the approach in practice was examined using the openEHR framework as an example.

RESULTS

A comprehensive infrastructure for model-driven engineering of electronic health records is presented using the example of the openEHR framework. It is shown that data schema definitions to be used in common practice software development processes can be derived from domain models. The capabilities for automatic creation of implementation artefacts (e.g., data entry forms) are demonstrated. Complementary programming libraries and frameworks that foster the use of open data models are introduced. Several compatible health data platforms are listed. They provide standard based interfaces for interconnecting with further applications.

CONCLUSION

Open data models help build a framework for interoperable data services that support the development of innovative Smart Health applications. Related tools for model-driven application development foster semantic interoperability and interconnected innovative applications.

Comparing the Performance of NoSQL Approaches for Managing Archetype-Based Electronic Health Record Data

This study provides an experimental performance evaluation on population-based queries of NoSQL databases storing archetype-based Electronic Health Record (EHR) data. There are few published studies regarding the performance of persistence mechanisms for systems that use multilevel modelling approaches, especially when the focus is on population-based queries. A healthcare dataset with 4.2 million records stored in a relational database (MySQL) was used to generate XML and JSON documents based on the openEHR reference model. Six datasets with different sizes were created from these documents and imported into three single machine XML databases (BaseX, eXistdb and Berkeley DB XML) and into a distributed NoSQL database system based on the MapReduce approach, Couchbase, deployed in different cluster configurations of 1, 2, 4, 8 and 12 machines. Population-based queries were submitted to those databases and to the original relational database. Database size and query response times are presented. The XML databases were considerably slower and required much more space than Couchbase. Overall, Couchbase had better response times than MySQL, especially for larger datasets. However, Couchbase requires indexing for each differently formulated query and the indexing time increases with the size of the datasets. The performances of the clusters with 2, 4, 8 and 12 nodes were not better than the single node cluster in relation to the query response time, but the indexing time was reduced proportionally to the number of nodes. The tested XML databases had acceptable performance for openEHR-based data in some querying use cases and small datasets, but were generally much slower than Couchbase. Couchbase also outperformed the response times of the relational database, but required more disk space and had a much longer indexing time. Systems like Couchbase are thus interesting research targets for scalable storage and querying of archetype-based EHR data when population-based use cases are of interest.

Role of OpenEHR as an open source solution for the regional modelling of patient data in obstetrics

This work investigates, whether openEHR with its reference model, archetypes and templates is suitable for the digital representation of demographic as well as clinical data. Moreover, it elaborates openEHR as a tool for modelling Hospital Information Systems on a regional level based on a national logical infrastructure. OpenEHR is a dual model approach developed for the modelling of Hospital Information Systems enabling semantic interoperability. A holistic solution to this represents the use of dual model based Electronic Healthcare Record systems. Modelling data in the field of obstetrics is a challenge, since different regions demand locally specific information for the process of treatment. Smaller health units in developing countries like Brazil or Malaysia, which until recently handled automatable processes like the storage of sensitive patient data in paper form, start organizational reconstruction processes. This archetype proof-of-concept investigation has tried out some elements of the openEHR methodology in cooperation with a health unit in Colombo, Brazil. Two legal forms provided by the Brazilian Ministry of Health have been analyzed and classified into demographic and clinical data. LinkEHR-Ed editor was used to read, edit and create archetypes. Results show that 33 clinical and demographic concepts, which are necessary to cover data demanded by the Unified National Health System, were identified. Out of the concepts 61% were reused and 39% modified to cover domain requirements. The detailed process of reuse, modification and creation of archetypes is shown. We conclude that, although a major part of demographic and clinical patient data were already represented by existing archetypes, a significant part required major modifications. In this study openEHR proved to be a highly suitable tool in the modelling of complex health data. In combination with LinkEHR-Ed software it offers user-friendly and highly applicable tools, although the complexity built by the vast specifications requires expert networks to define generally excepted clinical models. Finally, this project has pointed out main benefits enclosing high coverage of obstetrics data on the Clinical Knowledge Manager, simple modelling, and wide network and support using openEHR. Moreover, barriers described are enclosing the allocation of clinical content to respective archetypes, as well as stagnant adaption of changes on the Clinical Knowledge Manager leading to redundant efforts in data contribution that need to be addressed in future works.