Usability Evaluation of Three Admission and Medical Records Subsystems Integrated into Nationwide Hospital Information Systems: Heuristic Evaluation

Usability study of a smartphone app entitled: Living with Parkinson's disease

Background

Mobile healthcare apps have transformed the healthcare industry and these apps can now be used for educational and preventive purposes, as well as providing valuable information for self-care. Apps related to Parkinson's disease can help from diagnoses to treatment, however the purpose of the app in this study is to inform and to educate.

Objective

To describe user appraisal of the refinement of a Parkinson's Disease app through a technical evaluation by researchers in the technological area of Human-computer Interaction HCI and usability from the perspective of the end user.

Methods

Technological development research of heuristic evaluation and user experience study carried out for usability testing, where the profile of users were surveyed and usability was evaluated by HCI researchers and end users.

Results

Parkinsonians with a recent diagnosis showed the greatest interest in the app. The final version of the app was ready after modifications proposed by experts and users. The app achieved an excellent usability rating, when rated on the Brooke scale in regard to user evaluation.

Conclusion

Structured strategies to promote greater adherence contribute to increased usability, and may allow for greater autonomy in care and early identification of symptoms.

Design, development, and evaluation of a registry system for hyperbaric oxygen therapy: A methodological study

Background and Aims

Hyperbaric oxygen therapy (HBOT), utilizes 100% oxygen at pressures greater than sea‐level atmospheric pressure, for the treatment of conditions in which the tissues starve for oxygen. The Undersea and Hyperbaric Medical Society (UHMS) has granted HBOT approval for the treatment of various conditions. On the other hand, applying informatics registry systems can improve care delivery, ameliorate outcomes, and reduce the costs and medical errors for the patients receiving HBOT treatment. Therefore, we aimed to design, develop, and evaluate a registry system for patients undergoing HBOT.

Methods

In the first phase, the conceptual and logical models were designed after conducting symposiums with experts and having other experts review the models. In the second phase, the system was developed on the web using ASP.NET  and C# programming languages frameworks. The last phase involved Nielsen's heuristic evaluation method for the system's usability. Five experts evaluated the system, including three health information management specialists and two medical informatics specialists.

Results

The hyperbaric patient information registry system (HPIRS) interacts with three types of users—a specialist physician, a nurse, and a system administrator. A scenario for each predefined activity was designed, and all the information was stored in the SQL servers. The five experts independently found 152 issues, of which 84 were duplicates. The 68 distinct issues of the system were then resolved.

Conclusions

The design and development of such registry systems can make data available and stored carefully to improve clinical care and medical research and decrease costs and errors. These registries can provide the healthcare systems with E‐health applications, improved data management, more secure data transfer, and support for statistical reporting. The implemented heuristic evaluation method can also provide a low‐cost and readily available system to fix the issues of the designed systems.

Evaluating the usability of a national health information system with heuristic method

BACKGROUND

Hospital Statistics and Information System is one of the most important health information systems in Iran used in all hospitals in this country. Usability problems can reduce the speed and precision of users when interacting with this system. This study aimed to identify the usability problems of a national health system called "AVAB".

MATERIALS AND METHODS

This descriptive cross-sectional study was conducted in 2020, and three experts evaluated the usability of this system independently by the heuristic evaluation method. Nielsen's usability principles were used to identify usability problems and to classify their severity.

RESULTS

A total of 86 unique problems were identified. The highest number of problems were related to the two principles of "help and documentation" and "match between system and the real world" with 23 and 11 usability problems, respectively. The lowest number of problems were related to the two principles of "visibility of system status" and "help users recognize, diagnose, and recover from errors," each with three problems. 58.1% of the identified problems were in the group of major and catastrophic problems.

CONCLUSIONS

With the help of heuristic evaluation method, a significant number of usability problems of Hospital Statistics and Information System were identified. Most of the identified problems were major and catastrophic, and it is necessary to solve these problems by the designers and developers of this system.

Identification and Classification of Usability Problems in a Nursing Information System: A Heuristic Evaluation

Nursing information system is a system that nurses are required to use in order to perform their daily activities. Poor user interface design of nursing information system can cause problems in nurses' interaction with the system. This research aimed to evaluate the usability of nursing information system. During this study, five evaluators examined the nursing information system with the heuristic evaluation method and by using the checklist of Nielsen usability principles. Then, the identified problems were categorized into 10 Nielsen usability principles, and the severity of the problems was determined. They also attributed each problem to one of usability attributes. A total of 104 unique problems were identified. Most of the problems were related to the principle of "consistency and standards." More than a third of the identified problems were classed as major and catastrophe, with the highest severity in the average problems of "help and documentation" and "error prevention." Most of the identified problems were attributed to effectiveness and satisfaction. Because a significant number of identified usability problems in nursing information system were major and catastrophe and were attributed to effectiveness and satisfaction, being able to remedy the problems could improve nurses' interaction with the system user interface and increase satisfaction and effectiveness of nurses.

The relationship between user interface problems of an admission, discharge and transfer module and usability features: a usability testing method

Background

The admission, discharge and transfer (ADT) module is used in the hospital information system (HIS) for the purposes of managing appointments, patient admission, daily control of hospital beds, planning surgery procedures, keeping up-to-date on patient discharges, and registering patient transfers within or outside the hospital. The present study aimed to evaluate the usability of ADT module of a HIS through usability testing and assess the relationship between the number of user interface problems and usability features (i.e. effectiveness, efficiency, and satisfaction).

Methods

This descriptive analytical study was conducted in Shahid Beheshti hospital in Kashan, Iran, in 2017. The participating users were eight students in their last semester of a Bachelor of Health Information Technology Sciences degree. First, the users were introduced to the module functions in a two-hour session; ten days later, the users were asked to perform scenarios designed based on seven tasks and take notes of the problems encountered in performing each task after it was over. Effectiveness was measured based on the rate of completing the tasks, efficiency based on the time taken to perform each task, and satisfaction based on the users’ answers to a satisfaction questionnaire. The relationship between these three usability features and the number of problems noted was assessed using Spearman’s test in SPSS version 16.

Results

Thirteen unique usability problems were identified from the perspective of the users. Effectiveness was rated as 58.9%, efficiency as 53.3%, and mean user satisfaction as 53.4 ± 10.6. The number of problems in each task had significant relationships to the effectiveness (P = 0.009) and efficiency (P = 0.016) scores. User satisfaction also had a significant relationship with the effectiveness (P = 0.043) but not with the efficiency (P = 0.230) scores.

Conclusions

In the view of the potential users, a HIS, used in more than 200 hospitals in a developing country, has several usability problems in its ADT module and its effectiveness, efficiency, and user satisfaction were not acceptable. The number of usability problems in the HIS user interface affected the effectiveness, efficiency and user satisfaction of the system.