Evaluation of the effect of information integration in displays for ICU nurses on situation awareness and task completion time: A prospective randomized controlled study

A systematic review of camera monitor system display layout designs: Integration of existing knowledge

Despite the growing interest in mirrorless vehicles equipped with a camera monitor system (CMS), the human factors research findings on CMS display layout design have not been synthesized yet, hindering the application of the knowledge and the identification of future research directions. In an effort to address the 'lack of integration of the existing knowledge', this literature review addresses the following research questions: 1) what CMS display layout designs have been considered/developed by academic researchers and by automakers, respectively?; 2) among possible CMS display layout design alternatives, which ones have not yet been examined through human factors evaluation studies?; and 3) how do the existing human factors studies on the evaluation of different CMS display layout designs vary in the specifics of research? This review provides significant implications for the ergonomic design of CMS display layouts, including some potential design opportunities and future research directions.

Improving Situation Awareness to Advance Patient Outcomes: A Systematic Literature Review

Improving nurses' situation awareness skills would likely improve patient status recognition and prevent adverse events. Technologies such as electronic health record dashboards can be a promising approach to support nurses' situation awareness. However, the effect of these dashboards on this skill is unknown. This systematic literature review explores the evidence around interventions to improve nurses' situation awareness at the point of care. Current research on this subject is limited. Studies that examined the use of electronic health record dashboards as an intervention had weak evidence to support their effectiveness. Other interventions, including communication interventions and structured nursing assessments, may also improve situation awareness, but more research is needed to confirm this. It is important to carefully consider the design and content of situation awareness interventions, as well as the specific outcomes being measured, when designing situation awareness interventions. Overall, there is a need for higher-quality research in this area to determine the most effective interventions for improving nurse situation awareness. Future studies should focus on developing dashboards that follow a theoretical situation awareness model information and represent all situation awareness levels.

Could Spatial Awareness Affect Situation Awareness: A Conceptual Examination

PURPOSE

The purpose of this study was to explore the relationship between situation awareness (SA) and the physical environment in patient rooms through building a conceptual model.

BACKGROUND

Nurses work in very complicated and dynamic environments where having high levels of SA could be critical for their performance. Studies have also shown that nurses' awareness of the physical environment and patient room is a part of their awareness of dynamic situations in which nurses' spatial awareness may play a role in SA. Despite literature outlining the importance of SA, there is a lack of studies exploring the relationship between the two.

METHOD

A literature review was conducted for the study from nursing and psychology databases. Thirty-three articles, books, and dissertations from a scoping review were included for in-depth review.

RESULTS

An in-depth review of the harvested literature indicated that there is in fact a relationship between these two phenomena. Founded on Endsley's model of SA, the literature review in this study offers a conceptual model that articulates a plausible causal pathway between the physical environment and SA.

CONCLUSIONS

There are a lot of studies focusing on SA and various aspects of it related to nursing, but almost none mention the physical environment and its impact on SA. The current inquiry suggests that spatial awareness plays a prominent role in SA.

Usability Evaluation of Dashboards: A Systematic Literature Review of Tools

Introduction

In recent years, the use of dashboards in healthcare has been considered an effective approach for the visual presentation of information to support clinical and administrative decisions. Effective and efficient use of dashboards in clinical and managerial processes requires a framework for the design and development of tools based on usability principles.

Objectives

The present study is aimed at investigating the existing questionnaires used for the usability evaluation framework of dashboards and at presenting more specific usability criteria for evaluating dashboards.

Methods

This systematic review was conducted using PubMed, Web of Science, and Scopus, without any time restrictions. The final search of articles was performed on September 2, 2022. Data collection was performed using a data extraction form, and the content of selected studies was analyzed based on the dashboard usability criteria.

Results

After reviewing the full text of relevant articles, a total of 29 studies were selected according to the inclusion criteria. Regarding the questionnaires used in the selected studies, researcher-made questionnaires were used in five studies, while 25 studies applied previously used questionnaires. The most widely used questionnaires were the System Usability Scale (SUS), Technology Acceptance Model (TAM), Situation Awareness Rating Technique (SART), Questionnaire for User Interaction Satisfaction (QUIS), Unified Theory of Acceptance and Use of Technology (UTAUT), and Health Information Technology Usability Evaluation Scale (Health-ITUES), respectively. Finally, dashboard evaluation criteria, including usefulness, operability, learnability, ease of use, suitability for tasks, improvement of situational awareness, satisfaction, user interface, content, and system capabilities, were suggested.

Conclusion

General questionnaires that were not specifically designed for dashboard evaluation were mainly used in reviewed studies. The current study suggested specific criteria for measuring the usability of dashboards. When selecting the usability evaluation criteria for dashboards, it is important to pay attention to the evaluation objectives, dashboard features and capabilities, and context of use.

Requirements and challenges of hospital dashboards: a systematic literature review

Background

Today, the use of data in administrative and clinical processes is quite challenging due to the large volume of data, data collection from various sources, and lack of data structure. As a data management tool, dashboards play an important role in timely visual display of critical information on key performances.

Objectives

This systematic review aimed to identify functional and non-functional requirements, as well as challenges of using dashboards in hospitals.

Methods

In this systematic review, four databases, including the Web of Science, PubMed, EMBASE, and Scopus, were searched to find relevant articles from 2000 until May 30, 2020. The final search was conducted on May 30, 2020. Data collection was performed using a data extraction form and reviewing the content of relevant studies on the potentials and challenges of dashboard implementation.

Results

Fifty-four out of 1254 retrieved articles were selected for this study based on the inclusion and exclusion criteria. The functional requirements for dashboards included reporting, reminders, customization, tracking, alert creation, and assessment of performance indicators. On the other hand, the non-functional requirements included the dashboard speed, security, ease of use, installation on different devices (e.g., PCs and laptops), integration with other systems, web-based design, inclusion of a data warehouse, being up-to-data, and use of data visualization elements based on the user’s needs. Moreover, the identified challenges were categorized into four groups: data sources, dashboard content, dashboard design, implementation, and integration in other systems at the hospital level.

Conclusion

Dashboards, by providing information in an appropriate manner, can lead to the proper use of information by users. In order for a dashboard to be effective in clinical and managerial processes, particular attention must be paid to its capabilities, and the challenges of its implementation need to be addressed.

Situation awareness and the mitigation of risk associated with patient deterioration: A meta-narrative review of theories and models and their relevance to nursing practice

BACKGROUND

Accurate situation awareness has been identified as a critical component of effective deteriorating patient response systems and an essential patient safety skill for nursing practice. However, situation awareness has been defined and theorised from multiple perspectives to explain how individuals, teams and systems maintain awareness in dynamic task environments.

AIM

Our aim was to critically analyse the different approaches taken to the study of situation awareness in healthcare and explore the implications for nursing practice and research as it relates to clinical deterioration in ward contexts.

METHODS

We undertook a meta-narrative review of the healthcare literature to capture how situation awareness has been defined, theorised and studied in healthcare. Following an initial scoping review, we conducted an extensive search of ten electronic databases and included any theoretical, empirical or critical papers with a primary focus on situation awareness in an inpatient hospital setting. Included papers were collaboratively categorised in accordance with their theoretical framing, research tradition and paradigm with a narrative review presented.

RESULTS

A total of 120 papers were included in this review. Three overarching narratives reflecting philosophical, patient safety and solution focussed framings of situation awareness and seven meta-narratives were identified as follows: individual, team and systems perspectives of situation awareness (meta-narratives 1-3), situation awareness and patient safety (meta-narrative 4), communication tools, technologies and education to support situation awareness (meta-narratives 5-7). We identified a concentration of literature from anaesthesia and operating rooms and a body of research largely located within a cognitive engineering tradition and a positivist research paradigm. Endsley's situation awareness model was applied in over 80% of the papers reviewed. A minority of papers drew on alternative situation awareness theories including constructivist, collaborative and distributed perspectives.

CONCLUSIONS

Nurses have a critical role in identifying and escalating the care of deteriorating patients. There is a need to build on prior studies and reflect on the reality of nurse's work and the constraints imposed on situation awareness by the demands of busy inpatient wards. We suggest that this will require an analysis that complements but goes beyond the dominant cognitive engineering tradition to reflect the complex socio-cultural reality of ward-based teams and to explore how situation awareness emerges in increasingly complex, technologically enabled distributed healthcare systems.

Differing Visual Behavior Between Inexperienced and Experienced Critical Care Nurses While Using a Closed-Loop Ventilation System-A Prospective Observational Study

Introduction: Closed-loop ventilation modes are increasingly being used in intensive care units to ensure more automaticity. Little is known about the visual behavior of health professionals using these ventilation modes. The aim of this study was to analyze gaze patterns of intensive care nurses while ventilating a patient in the closed-loop mode with Intellivent adaptive support ventilation® (I-ASV) and to compare inexperienced with experienced nurses.

Materials and Methods: Intensive care nurses underwent eye-tracking during daily care of a patient ventilated in the closed-loop ventilation mode. Five specific areas of interest were predefined (ventilator settings, ventilation curves, numeric values, oxygenation Intellivent, ventilation Intellivent). The main independent variable and primary outcome was dwell time. Secondary outcomes were revisits, average fixation time, first fixation and fixation count on areas of interest in a targeted tracking-time of 60 min. Gaze patterns were compared between I-ASV inexperienced (n = 12) and experienced (n = 16) nurses.

Results: In total, 28 participants were included. Overall, dwell time was longer for ventilator settings and numeric values compared to the other areas of interest. Similar results could be obtained for the secondary outcomes. Visual fixation of oxygenation Intellivent and ventilation Intellivent was low. However, dwell time, average fixation time and first fixation on oxygenation Intellivent were longer in experienced compared to inexperienced intensive care nurses.

Discussion: Gaze patterns of intensive care nurses were mainly focused on numeric values and settings. Areas of interest related to traditional mechanical ventilation retain high significance for intensive care nurses, despite use of closed-loop mode. More visual attention to oxygenation Intellivent and ventilation Intellivent in experienced nurses implies more routine and familiarity with closed-loop modes in this group. The findings imply the need for constant training and education with new tools in critical care, especially for inexperienced professionals.

Emergency Department Quality Dashboard; a Systematic Review of Performance Indicators, Functionalities, and Challenges

Introduction:

Effective information management in the emergency department (ED) can improve the control and management of ED processes. Dashboards, known as data management tools, efficiently provide information and contribute greatly to control and management of ED. This study aimed to identify performance indicators quality dashboard functionalities, and analyze the challenges associated with dashboard implementation in the ED.

Methods:

This systematic review began with a search in four databases (Web of Science, PubMed, Embase, and Scopus) from 2000 to May 30, 2020, when the final search for papers was conducted. The data were collected using a data extraction form and the contents of the extracted papers were analyzed through ED performance indicators, dashboard functionalities, and implementation challenges.

Results:

Performance indicators reported in the reviewed papers were classified as the quality of care, patient flow, timeliness, costs, and resources. The main dashboard functionalities noted in the papers included reporting, customization, alert creation, resource management, and real-time information display. The dashboard implementation challenges included data sources, data quality, integration with other systems, adaptability of dashboard functionalities to user needs, and selection of appropriate performance indicators.

Conclusions:

Quality dashboards facilitate processes, communication, and situation awareness in the ED; hence, they can improve care provision in this department. To enhance the effectiveness and efficiency of ED dashboards, officials should set performance indicators and consider the conformity of dashboard functionalities with user needs. They should also integrate dashboards with other relevant systems at the departmental and hospital levels.

Impact of a shared decision-making mHealth tool on caregivers' team situational awareness, communication effectiveness, and performance during pediatric cardiopulmonary resuscitation: study protocol of a cluster randomized controlled trial

Background

Effective team communication, coordination, and situational awareness (SA) by team members are critical components to deliver optimal cardiopulmonary resuscitation (CPR). Complexity of care during CPR, involvement of numerous providers, miscommunication, and other exogenous factors can all contribute to negatively influencing patient care, thus jeopardizing survival. We aim to investigate whether an mHealth supportive tool (the Interconnected and Focused Mobile Apps on patient Care Environment [InterFACE]) developed as a collaborative platform to support CPR providers in real-time and share patient-centered information would increase SA during pediatric CPR.

Methods

We will conduct a prospective, cluster randomized controlled trial by groups of 6 participants in a tertiary pediatric emergency department (33,000 consultations/year) with pediatric physicians and nurses. We will compare the impact of the InterFACE tool with conventional communication methods on SA and effective team communication during a standardized pediatric in-hospital cardiac arrest and a polytrauma high-fidelity simulations. Forty-eight participants will be randomized (1:1) to consecutively perform two 20-min video-recorded scenarios using either the mHealth tool or conventional methods. The primary endpoint is the SA score, measured with the Situation Awareness Global Assessment Technique (SAGAT) instrument. Enrollment will start in late 2020 and data analysis in early 2021. We anticipate that the intervention will be completed by early 2021 and study results will be submitted in mid 2021 for publication.

Discussion

This clinical trial will assess the impact of a collaborative mHealth tool on increasing situational awareness and effective team communication during in-hospital pediatric resuscitation. As research in this area is scarce, the results generated by this study may become of paramount importance in improving the care of children receiving in-hospital CPR, in the era of increasing communication technology.

Trial registration

ClinicalTrials.gov NCT04464603. Registered on 9 July 2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05170-3.

Modeling physician variability to prioritize relevant medical record information

OBJECTIVE

Patient information can be retrieved more efficiently in electronic medical record (EMR) systems by using machine learning models that predict which information a physician will seek in a clinical context. However, information-seeking behavior varies across EMR users. To explicitly account for this variability, we derived hierarchical models and compared their performance to nonhierarchical models in identifying relevant patient information in intensive care unit (ICU) cases.

MATERIALS AND METHODS

Critical care physicians reviewed ICU patient cases and selected data items relevant for presenting at morning rounds. Using patient EMR data as predictors, we derived hierarchical logistic regression (HLR) and standard logistic regression (LR) models to predict their relevance.

RESULTS

In 73 pairs of HLR and LR models, the HLR models achieved an area under the receiver operating characteristic curve of 0.81, 95% confidence interval (CI) [0.80-0.82], which was statistically significantly higher than that of LR models (0.75, 95% CI [0.74-0.76]). Further, the HLR models achieved statistically significantly lower expected calibration error (0.07, 95% CI [0.06-0.08]) than LR models (0.16, 95% CI [0.14-0.17]).

DISCUSSION

The physician reviewers demonstrated variability in selecting relevant data. Our results show that HLR models perform significantly better than LR models with respect to both discrimination and calibration. This is likely due to explicitly modeling physician-related variability.

CONCLUSION

Hierarchical models can yield better performance when there is physician-related variability as in the case of identifying relevant information in the EMR.

Novel Interface Designs for Patient Monitoring Applications in Critical Care Medicine: Human Factors Review

Background

The patient monitor (PM) is one of the most commonly used medical devices in hospitals worldwide. PMs are used to monitor patients’ vital signs in a wide variety of patient care settings, especially in critical care settings, such as intensive care units. An interesting observation is that the design of PMs has not significantly changed over the past 2 decades, with the layout and structure of PMs more or less unchanged, with incremental changes in design being made rather than transformational changes. Thus, we believe it well-timed to review the design of novel PM interfaces, with particular reference to usability and human factors.

Objective

This paper aims to review innovations in PM design proposed by researchers and explore how clinicians responded to these design changes.

Methods

A literature search of relevant databases, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, identified 16 related studies. A detailed description of the interface design and an analysis of each novel PM were carried out, including a detailed analysis of the structure of the different user interfaces, to inform future PM design. The test methodologies used to evaluate the different designs are also presented.

Results

Most of the studies included in this review identified some level of improvement in the clinician’s performance when using a novel display in comparison with the traditional PM. For instance, from the 16 reviewed studies, 12 studies identified an improvement in the detection and response times, and 10 studies identified an improvement in the accuracy or treatment efficiency. This indicates that novel displays have the potential to improve the clinical performance of nurses and doctors. However, the outcomes of some of these studies are weakened because of methodological deficiencies. These deficiencies are discussed in detail in this study.

Conclusions

More careful study design is warranted to investigate the user experience and usability of future novel PMs for real time vital sign monitoring, to establish whether or not they could be used successfully in critical care. A series of recommendations on how future novel PM designs and evaluations can be enhanced are provided.

The influence of user interface design on task performance and situation awareness in a 3-player diner's dilemma game

To understand the influence of user interface on task performance and situation awareness, three levels of user interface were designed based on the three-level situation awareness model for the 3-player diner’s dilemma game. The 3-player diner's dilemma is a multiplayer version of the prisoner's dilemma, in which participants play games with two computer players and try to achieve high scores. A total of 117 participants were divided into 3 groups to participate in the experiment. Their task performance (the dining points) was recorded and their situation awareness scores were measured with the Situation Awareness Global Assessment Technique. The results showed that (1) the level-3 interface effectively improved the task performance and situation awareness scores, while the level-2 interface failed to improve them; (2) the practice effect did exist in all three conditions; and (3) the levels of user interface had no effect on the task learning process, implying that the learning rules remained consistent across different conditions.

Critical care information display approaches and design frameworks: A systematic review and meta-analysis

OBJECTIVE

To systematically review original user evaluations of patient information displays relevant to critical care and understand the impact of design frameworks and information presentation approaches on decision-making, efficiency, workload, and preferences of clinicians.

METHODS

We included studies that evaluated information displays designed to support real-time care decisions in critical care or anesthesiology using simulated tasks. We searched PubMed and IEEExplore from 1/1/1990 to 6/30/2018. The search strategy was developed iteratively with calibration against known references. Inclusion screening was completed independently by two authors. Extraction of display features, design processes, and evaluation method was completed by one and verified by a second author.

RESULTS

Fifty-six manuscripts evaluating 32 critical care and 22 anesthesia displays were included. Primary outcome metrics included clinician accuracy and efficiency in recognizing, diagnosing, and treating problems. Implementing user-centered design (UCD) processes, especially iterative evaluation and redesign, resulted in positive impact in outcomes such as accuracy and efficiency. Innovative display approaches that led to improved human-system performance in critical care included: (1) improving the integration and organization of information, (2) improving the representation of trend information, and (3) implementing graphical approaches to make relationships between data visible.

CONCLUSION

Our review affirms the value of key principles of UCD. Improved information presentation can facilitate faster information interpretation and more accurate diagnoses and treatment. Improvements to information organization and support for rapid interpretation of time-based relationships between related quantitative data is warranted. Designers and developers are encouraged to involve users in formal iterative design and evaluation activities in the design of electronic health records (EHRs), clinical informatics applications, and clinical devices.

Do surgeon non-technical skills correlate with teamwork-related outcomes during robot-assisted surgery?

Introduction

To evaluate the impact of non-technical skills (NTS) on team performance, workload and clinical outcomes.

Methods

The operating room (OR) environment of 20 robot-assisted radical prostatectomies performed by three different surgeons was recorded. Trained observers assessed NTS utilising the Non-Technical Skills for Surgeons (NOTSS) questionnaire. Associations between NOTSS scores, teamwork attributes (anticipation and inconveniences), workload (measured by National Aeronautics and Space Administration-Task Load Index (NASA-TLX)) and clinical outcomes (operative time, blood loss and surgical complexity) were determined using logistic regression and Pearson correlation.

Results

1780 requests were observed, 703 (39%) were non-verbal. Utilisation of non-verbal requests differed significantly among surgeons (26%, 36% and 44%, p<0.001). Anticipation was significantly associated with ‘Situational Awareness’ (OR 2.59, 95% CI 1.52 to 4.38, p<0.001), ‘Decision Making’ (OR 0.42, 95% CI 0.33 to 0.55, p<0.001) and ‘Communication and Teamwork’ (OR 0.43, 95% CI 0.25 to 0.74, p=0.002) domains. Inconveniences were significantly associated with ‘Situational Awareness’ (OR 0.21, 95% CI 0.08 to 0.59, p=0.003), ‘Decision Making’ (OR 2.73, 95% CI 1.53 to 4.86, p<0.001), and ‘Leadership’ (OR 0.62, 95% CI 0.41 to 0.94, p=0.03). There was a significant positive correlation between NOTSS scores and perceived physical and mental workload measures of NASA-TLX, as well as self-perceived performance. There was no significant association between NOTSS scores and any of the investigated clinical outcomes.

Conclusion

NTS in the OR were associated with team efficiency, fewer surgical flow disruptions and an improved self-perceived performance.

Research in Integrated Health Care and Publication Trends from the Perspective of Global Informatics

BACKGROUND

Integrated care has gained popularity in recent decades and is advocated by the World Health Organization. This study examined the global progress, current foci, and the future of integrated care.

METHODS

We conducted a scientometric analysis of data exported from the Web of Science database. Publication number and citations, co-authorship between countries and institutions and cluster analysis were calculated and clustered using Histcite12.03.07 and VOS viewer1.6.4.

RESULTS

We retrieved 6127 articles from 1997 to 2016. We found the following. (1) The United States, United Kingdom, and Canada had the most publications, citations, and productive institutions. (2) The top 10 cited papers and journals were crucial for knowledge distribution. (3) The 50 author keywords were clustered into 6 groups: digital medicine and e-health, community health and chronic disease management, primary health care and mental health, healthcare system for infectious diseases, healthcare reform and qualitative research, and social care and health policy services.

CONCLUSIONS

This paper confirmed that integrated care is undergoing rapid development: more categories are involved and collaborative networks are being established. Various research foci have formed, such as economic incentive mechanisms for integration, e-health data mining, and quantitative studies. There is an urgent need to develop performance measurements for policies and models.

The Impact of Head-Worn Displays on Strategic Alarm Management and Situation Awareness

OBJECTIVE

To investigate whether head-worn displays (HWDs) help mobile participants make better alarm management decisions and achieve better situation awareness than alarms alone.

BACKGROUND

Patient alarms occur frequently in hospitals but often do not require clinical intervention. Clinicians may become desensitized to alarms and fail to respond to clinically relevant alarms. HWDs could make patient information continuously accessible, support situation awareness, and help clinicians prioritize alarms.

METHOD

Experiment 1 ( n = 76) tested whether nonclinicians monitoring simulated patients benefited from vital sign information continuously displayed on an HWD while they performed a secondary calculation task. Experiment 2 ( n = 13) tested, across three separate experimental sessions, how effectively nursing trainees monitored simulated patients' vital signs under three different display conditions while they assessed a simulated patient.

RESULTS

In Experiment 1, participants who had access to continuous patient information on an HWD responded to clinically important alarms 25.9% faster and were 6.7 times less likely to miss alarms compared to participants who only heard alarms. In Experiment 2, participants using an HWD answered situation awareness questions 18.9% more accurately overall than when they used alarms only. However, the effect was significant in only two of the three experimental sessions.

CONCLUSION

HWDs may help users maintain continuous awareness of multiple remote processes without affecting their performance on ongoing tasks.

APPLICATION

The outcomes may apply to contexts where access to continuous streams of information from remote locations is useful, such as patient monitoring or clinical supervision.

Association of Data Integration Technologies With Intensive Care Clinician Performance: A Systematic Review and Meta-analysis

IMPORTANCE

Sources of data in the intensive care setting are increasing exponentially, but the benefits of displaying multiparametric, high-frequency data are unknown. Decision making may not benefit from this technology if clinicians remain cognitively overburdened by poorly designed data integration and visualization technologies (DIVTs).

OBJECTIVE

To systematically review and summarize the published evidence on the association of user-centered DIVTs with intensive care clinician performance.

DATA SOURCES

MEDLINE, Embase, Cochrane Central Register of Controlled Trials, PsycINFO, and Web of Science were searched in May 2014 and January 2018.

STUDY SELECTION

Studies had 3 requirements: (1) the study tested a viable DIVT, (2) participants involved were intensive care clinicians, and (3) the study reported quantitative results associated with decision making in an intensive care setting.

DATA EXTRACTION AND SYNTHESIS

Of 252 records screened, 20 studies, published from 2004 to 2016, were included. The human factors framework to assess health technologies was applied to measure study completeness, and the Quality Assessment Instrument was used to assess the quality of the studies. PRISMA guidelines were adapted to conduct the systematic review and meta-analysis.

MAIN OUTCOMES AND MEASURES

Study completeness and quality; clinician performance; physical, mental, and temporal demand; effort; frustration; time to decision; and decision accuracy.

RESULTS

Of the 20 included studies, 16 were experimental studies with 410 intensive care clinician participants and 4 were survey-based studies with 1511 respondents. Scores for study completeness ranged from 27 to 43, with a maximum score of 47, and scores for study quality ranged from 46 to 79, with a maximum score of 90. Of 20 studies, DIVTs were evaluated in clinical settings in 2 studies (10%); time to decision was measured in 14 studies (70%); and decision accuracy was measured in 11 studies (55%). Measures of cognitive workload pooled in the meta-analysis suggested that any DIVT was an improvement over paper-based data in terms of self-reported performance, mental and temporal demand, and effort. With a maximum score of 22, median (IQR) mental demand scores for electronic display were 10 (7-13), tabular display scores were 8 (6.0-11.5), and novel visualization scores were 8 (6-12), compared with 17 (14-19) for paper. The median (IQR) temporal demand scores were also lower for all electronic visualizations compared with paper, with scores of 8 (6-11) for electronic display, 7 (6-11) for tabular and bar displays, 7 (5-11) for novel visualizations, and 16 (14.3-19.0) for paper. The median (IQR) performance scores improved for all electronic visualizations compared with paper (lower score indicates better self-reported performance), with scores of 6 (3-11) for electronic displays, 6 (4-11) for tabular and bar displays, 6 (4-11) for novel visualizations, and 14 (11-16) for paper. Frustration and physical demand domains of cognitive workload did not change, and differences between electronic displays were not significant.

CONCLUSIONS AND RELEVANCE

This review suggests that DIVTs are associated with increased integration and consistency of data. Much work remains to identify which visualizations effectively reduce cognitive workload to enhance decision making based on intensive care data. Standardizing human factors testing by developing a repository of open access benchmarked test protocols, using a set of outcome measures, scenarios, and data sets, may accelerate the design and selection of the most appropriate DIVT.

The Role of the Electronic Medical Record in the Intensive Care Unit Nurse's Detection of Patient Deterioration: A Qualitative Study

Failure to detect patient deterioration signals leads to longer stays in the hospital, worse functional outcomes, and higher hospital mortality rates. Surveillance, including ongoing acquisition, interpretation, and synthesis of patient data by the nurse, is essential for early risk detection. Electronic medical records promote accessibility and retrievability of patient data and can support patient surveillance. A secondary analysis was performed on interview data from 24 intensive care unit nurses, collected in a study that examined factors influencing nurse responses to alarms. Six themes describing nurses' use of electronic medical record information to understand the patients' norm and seven themes describing electronic medical record design issues were identified. Further work is needed on electronic medical record design to integrate documentation and information presentation with the nursing workflow. Organizations should involve bedside nurses in the design of handoff formats that provide key information common to all intensive care unit patient populations, as well as population-specific information.

Development and Implementation of a Situation Awareness Workshop to Advance Safe Practice in Novice Nurses

The current study evaluated the effectiveness of a workshop designed to provide nurses (n= 6) with the means to improve their situation awareness. The nurses participated in a full-day workshop in which their situation awareness performance was measured before and after using the Situation Awareness Global Assessment Technique. Following the workshop, nurses demonstrated improvement in their perception of relevant cues, comprehension of what the combination of cues means, and projection of the patient’s future status. The implications of situation awareness education for health-care professionals are discussed.

The Impact of Visualization Dashboards on Quality of Care and Clinician Satisfaction: Integrative Literature Review

Background

Intensive Care Units (ICUs) in the United States admit more than 5.7 million people each year. The ICU level of care helps people with life-threatening illness or injuries and involves close, constant attention by a team of specially-trained health care providers. Delay between condition onset and implementation of necessary interventions can dramatically impact the prognosis of patients with life-threatening diagnoses. Evidence supports a connection between information overload and medical errors. A tool that improves display and retrieval of key clinical information has great potential to benefit patient outcomes. The purpose of this review is to synthesize research on the use of visualization dashboards in health care.

Objective

The purpose of conducting this literature review is to synthesize previous research on the use of dashboards visualizing electronic health record information for health care providers. A review of the existing literature on this subject can be used to identify gaps in prior research and to inform further research efforts on this topic. Ultimately, this evidence can be used to guide the development, testing, and implementation of a new solution to optimize the visualization of clinical information, reduce clinician cognitive overload, and improve patient outcomes.

Methods

Articles were included if they addressed the development, testing, implementation, or use of a visualization dashboard solution in a health care setting. An initial search was conducted of literature on dashboards only in the intensive care unit setting, but there were not many articles found that met the inclusion criteria. A secondary follow-up search was conducted to broaden the results to any health care setting. The initial and follow-up searches returned a total of 17 articles that were analyzed for this literature review.

Results

Visualization dashboard solutions decrease time spent on data gathering, difficulty of data gathering process, cognitive load, time to task completion, errors, and improve situation awareness, compliance with evidence-based safety guidelines, usability, and navigation.

Conclusions

Researchers can build on the findings, strengths, and limitations of the work identified in this literature review to bolster development, testing, and implementation of novel visualization dashboard solutions. Due to the relatively few studies conducted in this area, there is plenty of room for researchers to test their solutions and add significantly to the field of knowledge on this subject.

Principles of Automation for Patient Safety in Intensive Care: Learning From Aviation

BACKGROUND

The transition away from written documentation and analog methods has opened up the possibility of leveraging data science and analytic techniques to improve health care. In the implementation of data science techniques and methodologies, high-acuity patients in the ICU can particularly benefit. The Principles of Automation for Patient Safety in Intensive Care (PASPIC) framework draws on Billings's principles of human-centered aviation (HCA) automation and helps in identifying the advantages, pitfalls, and unintended consequences of automation in health care.

THE FRAMEWORK AND ITS KEY CHARACTERISTICS

Billings's HCA principles are based on the premise that human operators must remain "in command," so that they are continuously informed and actively involved in all aspects of system operations. In addition, automated systems need to be predictable, simple to train, to learn, and to operate, and must be able to monitor the human operators, and every intelligent system element must know the intent of other intelligent system elements. In applying Billings's HCA principles to the ICU setting, PAPSIC has three key characteristics: (1) integration and better interoperability, (2) multidimensional analysis, and (3) enhanced situation awareness.

RECOMMENDATIONS

PAPSIC suggests that health care professionals reduce overreliance on automation and implement "cooperative automation" and that vendors reduce mode errors and embrace interoperability.

CONCLUSION

Much can be learned from the aviation industry in automating the ICU. Because it combines "smart" technology with the necessary controls to withstand unintended consequences, PAPSIC could help ensure more informed decision making in the ICU and better patient care.

Nurse-Technology Interactions and Patient Safety

Nurses are the end-users of most technology in intensive care units, and the ways in which they interact with technology affect quality of care and patient safety. Nurses' interactions include the processes of ensuring proper input of data into the technology as well as extracting and interpreting the output (clinical data, technical data, alarms). Current challenges in nurse-technology interactions for physiologic monitoring include issues regarding alarm management, workflow interruptions, and monitor surveillance. Patient safety concepts, like high reliability organizations and human factors, can advance efforts to enhance nurse-technology interactions.

Clinician-Driven Design of VitalPAD-An Intelligent Monitoring and Communication Device to Improve Patient Safety in the Intensive Care Unit

The pediatric intensive care unit (ICU) is a complex environment, in which a multidisciplinary team of clinicians (registered nurses, respiratory therapists, and physicians) continually observe and evaluate patient information. Data are provided by multiple, and often physically separated sources, cognitive workload is high, and team communication can be challenging. Our aim is to combine information from multiple monitoring and therapeutic devices in a mobile application, the VitalPAD, to improve the efficiency of clinical decision-making, communication, and thereby patient safety. We observed individual ICU clinicians, multidisciplinary rounds, and handover procedures for 54 h to identify data needs, workflow, and existing cognitive aid use and limitations. A prototype was developed using an iterative participatory design approach; usability testing, including general and task-specific feedback, was obtained from 15 clinicians. Features included map overviews of the ICU showing clinician assignment, patient status, and respiratory support; patient vital signs; a photo-documentation option for arterial blood gas results; and team communication and reminder functions. Clinicians reported the prototype to be an intuitive display of vital parameters and relevant alerts and reminders, as well as a user-friendly communication tool. Future work includes implementation of a prototype, which will be evaluated under simulation and real-world conditions, with the aim of providing ICU staff with a monitoring device that will improve their daily work, communication, and decision-making capacity. Mobile monitoring of vital signs and therapy parameters might help improve patient safety in wards with single-patient rooms and likely has applications in many acute and critical care settings.

Platform for Efficient Switching between Multiple Devices in the Intensive Care Unit

Introduction: This article is part of the Focus Theme of Methods of Information in Medicine on “Managing Interoperability and Complexity in Health Systems”.

Objectives: Handheld computers, such as tablets and smartphones, are becoming more and more accessible in the clinical care setting and in Intensive Care Units (ICUs). By making the most useful and appropriate data available on multiple devices and facilitate the switching between those devices, staff members can efficiently integrate them in their workflow, allowing for faster and more accurate decisions. This paper addresses the design of a platform for the efficient switching between multiple devices in the ICU. The key functionalities of the platform are the integration of the platform into the workflow of the medical staff and providing tailored and dynamic information at the point of care.

Methods: The platform is designed based on a 3-tier architecture with a focus on extensibility, scalability and an optimal user experience. After identification to a device using Near Field Communication (NFC), the appropriate medical information will be shown on the selected device. The visualization of the data is adapted to the type of the device. A web-centric approach was used to enable extensibility and portability.

Results: A prototype of the platform was thoroughly evaluated. The scalability, performance and user experience were evaluated. Performance tests show that the response time of the system scales linearly with the amount of data. Measurements with up to 20 devices have shown no performance loss due to the concurrent use of multiple devices.

Conclusions: The platform provides a scalable and responsive solution to enable the efficient switching between multiple devices. Due to the web-centric approach new devices can easily be integrated. The performance and scalability of the platform have been evaluated and it was shown that the response time and scalability of the platform was within an acceptable range.

Evaluating Situation Awareness: An Integrative Review

Situation awareness (SA) refers to the conscious awareness of the current situation in relation to one’s environment. In nursing, loss or failure to achieve high levels of SA is linked with adverse patient outcomes. The purpose of this integrative review is to examine various instruments and techniques used to measure SA among nurses across academic and clinical settings. Computerized database and ancestry search strategies resulted in 40 empirical research reports. Of the reports included in the review, 24 measured SA among teams that included nurses and 16 measured SA solely in nurses. Methods used to evaluate SA included direct and indirect methods. Direct methods included the Situation Awareness Global Assessment Technique and questionnaires. Indirect methods included observer rating instruments and performance outcome measures. To have a better understanding of how nurses’ make decisions in complex work environments, reliable and valid measures of SA is crucial.

Classifying Alarms: Seeking Durability, Credibility, Consistency, and Simplicity

Alongside the development and testing of new audible alarms intended to support International Electrotechnical Commission 60601-1-8, a global standard concerned with alarm safety, the categories of risk that the standard denotes require further thought and possible updating. In this article, we revisit the origins of the categories covered by the standard. These categories were based on the ways that tissue damage can be caused. We consider these categories from the varied professional perspectives of the authors: human factors, semiotics, clinical practice, and the patient or family (layperson). We conclude that while the categories possess many clinically applicable and defensible features from our range of perspectives, the advances in alarm design now available may allow a more flexible approach. We present a three-tier system with superordinate, basic, and subordinate levels that fit both within the thinking embodied in the current standard and possible new developments.

Clinical Data Visualization: The Current State and Future Needs

The growing volume of clinical data in modern medical practice creates difficulties for clinicians when attempting to come to a full understanding of each patient's overall health status. Many different approaches to computer-based visualizations have been taken in an attempt to alleviate this burden; however, no single approach has been widely adopted. As a step towards optimization and standardization of data visualization in healthcare, this paper presents a diverse set of approaches to visualization for multiple organ systems. To do so we summarize best practices in design and evaluation while proposing usability testing methodology. We then review and illustrate the goals of various clinical data visualization techniques.

A Review of Visual Representations of Physiologic Data

Background

Physiological data is derived from electrodes attached directly to patients. Modern patient monitors are capable of sampling data at frequencies in the range of several million bits every hour. Hence the potential for cognitive threat arising from information overload and diminished situational awareness becomes increasingly relevant. A systematic review was conducted to identify novel visual representations of physiologic data that address cognitive, analytic, and monitoring requirements in critical care environments.

Objective

The aims of this review were to identify knowledge pertaining to (1) support for conveying event information via tri-event parameters; (2) identification of the use of visual variables across all physiologic representations; (3) aspects of effective design principles and methodology; (4) frequency of expert consultations; (5) support for user engagement and identifying heuristics for future developments.

Methods

A review was completed of papers published as of August 2016. Titles were first collected and analyzed using an inclusion criteria. Abstracts resulting from the first pass were then analyzed to produce a final set of full papers. Each full paper was passed through a data extraction form eliciting data for comparative analysis.

Results

In total, 39 full papers met all criteria and were selected for full review. Results revealed great diversity in visual representations of physiological data. Visual representations spanned 4 groups including tabular, graph-based, object-based, and metaphoric displays. The metaphoric display was the most popular (n=19), followed by waveform displays typical to the single-sensor-single-indicator paradigm (n=18), and finally object displays (n=9) that utilized spatiotemporal elements to highlight changes in physiologic status. Results obtained from experiments and evaluations suggest specifics related to the optimal use of visual variables, such as color, shape, size, and texture have not been fully understood. Relationships between outcomes and the users’ involvement in the design process also require further investigation. A very limited subset of visual representations (n=3) support interactive functionality for basic analysis, while only one display allows the user to perform analysis including more than one patient.

Conclusions

Results from the review suggest positive outcomes when visual representations extend beyond the typical waveform displays; however, there remain numerous challenges. In particular, the challenge of extensibility limits their applicability to certain subsets or locations, challenge of interoperability limits its expressiveness beyond physiologic data, and finally the challenge of instantaneity limits the extent of interactive user engagement.

Nurses' perceptions, acceptance, and use of a novel in-room pediatric ICU technology: testing an expanded technology acceptance model

BACKGROUND

The value of health information technology (IT) ultimately depends on end users accepting and appropriately using it for patient care. This study examined pediatric intensive care unit nurses' perceptions, acceptance, and use of a novel health IT, the Large Customizable Interactive Monitor.

METHODS

An expanded technology acceptance model was tested by applying stepwise linear regression to data from a standardized survey of 167 nurses.

RESULTS

Nurses reported low-moderate ratings of the novel IT's ease of use and low to very low ratings of usefulness, social influence, and training. Perceived ease of use, usefulness for patient/family involvement, and usefulness for care delivery were associated with system satisfaction (R2 = 70%). Perceived usefulness for care delivery and patient/family social influence were associated with intention to use the system (R2 = 65%). Satisfaction and intention were associated with actual system use (R2 = 51%).

CONCLUSIONS

The findings have implications for research, design, implementation, and policies for nursing informatics, particularly novel nursing IT. Several changes are recommended to improve the design and implementation of the studied IT.

Toward Designing Information Display to Support Critical Care. A Qualitative Contextual Evaluation and Visioning Effort

OBJECTIVES

Electronic health information overload makes it difficult for providers to quickly find and interpret information to support care decisions. The purpose of this study was to better understand how clinicians use information in critical care to support the design of improved presentation of electronic health information.

METHODS

We conducted a contextual analysis and visioning project. We used an eye-tracker to record 20 clinicians' information use activities in critical care settings. We played video recordings back to clinicians in retrospective cued interviews and queried: 1) context and goals of information use, 2) impacts of current display design on use, and 3) processes related to information use. We analyzed interview transcripts using grounded theory-based content analysis techniques and identified emerging themes. From these, we conducted a visioning activity with a team of subject matter experts and identified key areas for focus of design and research for future display designs.

RESULTS

Analyses revealed four unique critical care information use activities including new patient assessment, known patient status review, specific directed information seeking, and review and prioritization of multiple patients. Emerging themes were primarily related to a need for better representation of dynamic data such as vital signs and laboratory results, usability issues associated with reducing cognitive load and supporting efficient interaction, and processes for managing information. Visions for the future included designs that: 1) provide rapid access to new information, 2) organize by systems or problems as well as by current versus historical patient data, and 3) apply intelligence toward detecting and representing change and urgency.

CONCLUSIONS

The results from this study can be used to guide the design of future acute care electronic health information display. Additional research and collaboration is needed to refine and implement intelligent graphical user interfaces to improve clinical information organization and prioritization to support care decisions.

Provider Use of a Novel EHR display in the Pediatric Intensive Care Unit. Large Customizable Interactive Monitor (LCIM)

OBJECTIVES

The purpose of this study was to explore providers' perspectives on the use of a novel technology, "Large Customizable Interactive Monitor" (LCIM), a novel application of the electronic health record system implemented in a Pediatric Intensive Care Unit.

METHODS

We employed a qualitative approach to collect and analyze data from pediatric intensive care physicians, pediatric nurse practitioners, and acute care specialists. Using semi-structured interviews, we collected data from January to April, 2015. The research team analyzed the transcripts using an iterative coding method to identify common themes.

RESULTS

Study results highlight contextual data on providers' use routines of the LCIM. Findings from thirty six interviews were classified into three groups: 1) providers' familiarity with the LCIM; 2) providers' use routines (i.e. when and how they use it); and 3) reasons why they use or do not use it.

CONCLUSION

It is important to conduct baseline studies of the use of novel technologies. The importance of training and orientation affects the adoption and use patterns of this new technology. This study is notable for being the first to investigate a LCIM system, a next generation system implemented in the pediatric critical care setting. Our study revealed this next generation HIT might have great potential for family-centered rounds, team education during rounds, and family education/engagement in their child's health in the patient room. This study also highlights the effect of training and orientation on the adoption patterns of new technology.

Feasibility of Population Health Analytics and Data Visualization for Decision Support in the Infectious Diseases Domain: A pilot study

OBJECTIVE

Big data or population-based information has the potential to reduce uncertainty in medicine by informing clinicians about individual patient care. The objectives of this study were: 1) to explore the feasibility of extracting and displaying population-based information from an actual clinical population's database records, 2) to explore specific design features for improving population display, 3) to explore perceptions of population information displays, and 4) to explore the impact of population information display on cognitive outcomes.

METHODS

We used the Veteran's Affairs (VA) database to identify similar complex patients based on a similar complex patient case. Study outcomes measures were 1) preferences for population information display 2) time looking at the population display, 3) time to read the chart, and 4) appropriateness of plans with pre- and post-presentation of population data. Finally, we redesigned the population information display based on our findings from this study.

RESULTS

The qualitative data analysis for preferences of population information display resulted in four themes: 1) trusting the big/population data can be an issue, 2) embedded analytics is necessary to explore patient similarities, 3) need for tools to control the view (overview, zoom and filter), and 4) different presentations of the population display can be beneficial to improve the display. We found that appropriateness of plans was at 60% for both groups (t9=-1.9; p=0.08), and overall time looking at the population information display was 2.3 minutes versus 3.6 minutes with experts processing information faster than non-experts (t8= -2.3, p=0.04).

CONCLUSION

A population database has great potential for reducing complexity and uncertainty in medicine to improve clinical care. The preferences identified for the population information display will guide future health information technology system designers for better and more intuitive display.

Multimodal monitoring in the pediatric intensive care unit: new modalities and informatics challenges

We review several newer modalities to monitor the brain in children with acute neurologic disease in the pediatric intensive care unit, such as partial brain tissue oxygen tension (PbtO2), jugular venous oxygen saturation (SjvO2), near infrared spectroscopy (NIRS), thermal diffusion measurement of cerebral blood flow, cerebral microdialysis, and EEG. We then discuss the informatics challenges to acquire, consolidate, analyze, and display the data. Acquisition includes multiple data types: discrete, waveform, and continuous. Consolidation requires device interoperability and time synchronization. Analysis could include pressure reactivity index and quantitative EEG. Displays should communicate the patient's current status, longitudinal and trend information, and critical alarms.

Evaluation of a configural vital signs display for intensive care unit nurses

OBJECTIVE

The objective was to evaluate a configural vital signs (CVS) display designed to support rapid detection and identification of physiological deterioration by graphically presenting patient vital signs data.

BACKGROUND

Current display technology in the intensive care unit (ICU) is not optimized for fast recognition and identification of physiological changes in patients. To support nurses more effectively, graphical or configural vital signs displays need to be developed and evaluated.

METHOD

A CVS display was developed based on findings from studies of the cognitive work of ICU nurses during patient monitoring. A total of 42 ICU nurses interpreted data presented either in a traditional, numerical format (n = 21) or on the CVS display (n = 21). Response time and accuracy in clinical data interpretation (i.e., identification of patient status) were assessed across four scenarios.

RESULTS

Data interpretation speed and accuracy improved significantly in the CVS display condition; for example, in one scenario nurses required only half of the time for data interpretation and showed up to 1.9 times higher accuracy in identifying the patient state compared to the numerical display condition.

CONCLUSION

Providing patient information in a configural display with readily visible trends and data variability can improve the speed and accuracy of data interpretation by ICU nurses.

APPLICATION

Although many studies, including this one, support the use of configural displays, the vast majority of ICU monitoring displays still present clinical data in numerical format. The introduction of configural displays in clinical monitoring has potential to improve patient safety.

Situational awareness, relational coordination and integrated care delivery to hospitalized elderly in the Netherlands: a comparison between hospitals

BACKGROUND

It is known that interprofessional collaboration is crucial for integrated care delivery, yet we are still unclear about the underlying mechanisms explaining effectiveness of integrated care delivery to older patients. In addition, we lack research comparing integrated care delivery between hospitals. Therefore, this study aims to (i) provide insight into the underlying components 'relational coordination' and 'situational awareness' of integrated care delivery and the role of team and organizational context in integrated care delivery; and (ii) compare situational awareness, relational coordination, and integrated care delivery of different hospitals in the Netherlands.

METHODS

This cross-sectional study took place in 2012 among professionals from three different hospitals involved in the delivery of care to older patients. A total of 215 professionals filled in the questionnaire (42% response rate).Descriptive statistics and paired-sample t-tests were used to investigate the level of situational awareness, relational coordination, and integrated care delivery in the three different hospitals. Correlation and multilevel analyses were used to investigate the relationship between background characteristics, team context, organizational context, situational awareness, relational coordination and integrated care delivery.

RESULTS

No differences in background characteristics, team context, organizational context, situational awareness, relational coordination and integrated care delivery were found among the three hospitals. Correlational analysis revealed that situational awareness (r = 0.30; p < 0.01), relational coordination (r = 0.17; p < 0.05), team climate (r = 0.29; p < 0.01), formal internal communication (r = 0.46; p < 0.01), and informal internal communication (r = 0.36; p < 0.01) were positively associated with integrated care delivery. Stepwise multilevel analyses showed that formal internal communication (p < 0.001) and situational awareness (p < 0.01) were associated with integrated care delivery. Team climate was not significantly associated with integrated care delivery when situational awareness and relational coordination were included in the equation. Thus situational awareness acted as mediator between team climate and integrated care delivery among professionals delivering care to older hospitalized patients.

CONCLUSIONS

The results of this study show the importance of formal internal communication and situational awareness for quality of care delivery to hospitalized older patients.