Patient Information Summarization in Clinical Settings: Scoping Review

BACKGROUND

Information overflow, a common problem in the present clinical environment, can be mitigated by summarizing clinical data. Although there are several solutions for clinical summarization, there is a lack of a complete overview of the research relevant to this field.

OBJECTIVE

This study aims to identify state-of-the-art solutions for clinical summarization, to analyze their capabilities, and to identify their properties.

METHODS

A scoping review of articles published between 2005 and 2022 was conducted. With a clinical focus, PubMed and Web of Science were queried to find an initial set of reports, later extended by articles found through a chain of citations. The included reports were analyzed to answer the questions of where, what, and how medical information is summarized; whether summarization conserves temporality, uncertainty, and medical pertinence; and how the propositions are evaluated and deployed. To answer how information is summarized, methods were compared through a new framework "collect-synthesize-communicate" referring to information gathering from data, its synthesis, and communication to the end user.

RESULTS

Overall, 128 articles were included, representing various medical fields. Exclusively structured data were used as input in 46.1% (59/128) of papers, text in 41.4% (53/128) of articles, and both in 10.2% (13/128) of papers. Using the proposed framework, 42.2% (54/128) of the records contributed to information collection, 27.3% (35/128) contributed to information synthesis, and 46.1% (59/128) presented solutions for summary communication. Numerous summarization approaches have been presented, including extractive (n=13) and abstractive summarization (n=19); topic modeling (n=5); summary specification (n=11); concept and relation extraction (n=30); visual design considerations (n=59); and complete pipelines (n=7) using information extraction, synthesis, and communication. Graphical displays (n=53), short texts (n=41), static reports (n=7), and problem-oriented views (n=7) were the most common types in terms of summary communication. Although temporality and uncertainty information were usually not conserved in most studies (74/128, 57.8% and 113/128, 88.3%, respectively), some studies presented solutions to treat this information. Overall, 115 (89.8%) articles showed results of an evaluation, and methods included evaluations with human participants (median 15, IQR 24 participants): measurements in experiments with human participants (n=31), real situations (n=8), and usability studies (n=28). Methods without human involvement included intrinsic evaluation (n=24), performance on a proxy (n=10), or domain-specific tasks (n=11). Overall, 11 (8.6%) reports described a system deployed in clinical settings.

CONCLUSIONS

The scientific literature contains many propositions for summarizing patient information but reports very few comparisons of these proposals. This work proposes to compare these algorithms through how they conserve essential aspects of clinical information and through the "collect-synthesize-communicate" framework. We found that current propositions usually address these 3 steps only partially. Moreover, they conserve and use temporality, uncertainty, and pertinent medical aspects to varying extents, and solutions are often preliminary.

Usability of electronic patient record systems: Instrument validation study conducted for hospitals in Germany

In Germany and elsewhere, few hospital electronic patient record usability surveys are available. Moreover, there seems to be a complete lack of validated instruments in the respective literature. Hence, this study’s purpose is to validate a scale for measuring the usability of hospital electronic patient record systems. The data used for the study’s analyses (n = 949) were originally obtained during the German national initiative ‘Hospital IT User Questionnaire’. In the course of the study, reliability and exploratory factor analyses were conducted and psychometric tests showed a reliable, valid and suitable instrument. Descriptive data analysis suggests a generally low user perception and variances hint at a high potential for future improvements. To our knowledge, this study shows that a general inventory (subscales from the IsoMetrics inventory) can be applied to measuring hospital electronic patient record usability as well. The validated instrument can be used to inform healthcare providers, decision makers and politicians of a given state of usability, discrepancies between different hospitals or systems providers, and serve as a basis for improvements.

Visualization of Medical Data Based on EHR Standards

Background: To organize an efficient interaction between a doctor and an EHR the data has to be presented in the most convenient way. Medical data presentation methods and models must be flexible in order to cover the needs of the users with different backgrounds and requirements. Most visualization methods are doctor oriented, however, there are indications that the involvement of patients can optimize healthcare.

Objectives: The research aims at specifying the state of the art of medical data visualization. The paper analyzes a number of projects and defines requirements for a generic ISO 13606 based data visualization method. In order to do so it starts with a systematic search for studies on EHR user interfaces.

Methods: In order to identify best practices visualization methods were evaluated according to the following criteria: limits of application, customizability, re-usability. The visualization methods were compared by using specified criteria.

Results: The review showed that the analyzed projects can contribute knowledge to the development of a generic visualization method. However, none of them proposed a model that meets all the necessary criteria for a re-usable standard based visualization method. The shortcomings were mostly related to the structure of current medical concept specifications.

Conclusion: The analysis showed that medical data visualization methods use hard-coded GUI, which gives little flexibility. So medical data visualization has to turn from a hardcoded user interface to generic methods. This requires a great effort because current standards are not suitable for organizing the management of visualization data. This contradiction between a generic method and a flexible and user-friendly data layout has to be overcome.

Evaluation Study for an ISO 13606 Archetype Based Medical Data Visualization Method

The objective of this evaluation study is to assess a method for standard based medical data visualization. The method allows flexible and customizable visualization for ISO 13606 archetype based medical data. The chosen evaluation concept is based the Guideline for Good Evaluation Practice in Health Informatics (GEP-HI). The stages of the study were identified. Each stage got a detailed description. We also identified the participants and their required qualifications and responsibilities. The evaluation location was described in details. The evaluation metrics were defined. The questionnaires for doctors, patients and experts were developed to fulfill the requirements of the evaluation study. The study was performed in Tomsk, Russia. 30 patients and 5 doctors participated in the study. The overall performance of the users reached the expert level by the end of the study. Patients as well as medical staff stated in their comments that the usability of the system was high, and they preferred it to the previously used paper-based and computer based systems. This was also shown by the high level of satisfaction measured within our study. The visualization approach, integrated into the electronic health record, was well accepted in our pilot setting with high usability scores from patients and doctors alike. The results showed the efficiency for both modeling and visualization part of the system.

Development, implementation and evaluation of an information model for archetype based user responsive medical data visualization

BACKGROUND

When medical data have been successfully recorded or exchanged between systems there appear a need to present the data consistently to ensure that it is clearly understood and interpreted. A standard based user interface can provide interoperability on the visual level.

OBJECTIVES

The goal of this research was to develop, implement and evaluate an information model for building user interfaces for archetype based medical data.

METHODS

The following types of knowledge were identified as important elements and were included in the information model: medical content related attributes, data type related attributes, user-related attributes, device-related attributes. In order to support flexible and efficient user interfaces an approach that represents different types of knowledge with different models separating the medical concept from a visual concept and interface realization was chosen. We evaluated the developed approach using Guideline for Good Evaluation Practice in Health Informatics (GEP-HI).

RESULTS

We developed a higher level information model to complement the ISO 13606 archetype model. This enabled the specification of the presentation properties at the moment of the archetypes' definition. The model allows realizing different users' perspectives on the data. The approach was implemented and evaluated within a functioning EHR system. The evaluation involved 30 patients of different age and IT experience and 5 doctors. One month of testing showed that the time required reading electronic health records decreased for both doctors (from average 310 to 220s) and patients (from average 95 to 39s). Users reported a high level of satisfaction and motivation to use the presented data visualization approach especially in comparison with their previous experience.

CONCLUSION

The introduced information model allows separating medical knowledge and presentation knowledge. The additional presentation layer will enrich the graphical user interface's flexibility and will allow an optimal presentation of medical data considering the different users' perspectives and different media used for data presentation.

Quality of human-computer interaction--results of a national usability survey of hospital-IT in Germany

Background

Due to the increasing functionality of medical information systems, it is hard to imagine day to day work in hospitals without IT support. Therefore, the design of dialogues between humans and information systems is one of the most important issues to be addressed in health care. This survey presents an analysis of the current quality level of human-computer interaction of healthcare-IT in German hospitals, focused on the users' point of view.

Methods

To evaluate the usability of clinical-IT according to the design principles of EN ISO 9241-10 the IsoMetrics Inventory, an assessment tool, was used. The focus of this paper has been put on suitability for task, training effort and conformity with user expectations, differentiated by information systems. Effectiveness has been evaluated with the focus on interoperability and functionality of different IT systems.

Results

4521 persons from 371 hospitals visited the start page of the study, while 1003 persons from 158 hospitals completed the questionnaire. The results show relevant variations between different information systems.

Conclusions

Specialised information systems with defined functionality received better assessments than clinical information systems in general. This could be attributed to the improved customisation of these specialised systems for specific working environments. The results can be used as reference data for evaluation and benchmarking of human computer engineering in clinical health IT context for future studies.