Near field communications technology and the potential to reduce medication errors through multidisciplinary application

Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review

BACKGROUND

Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users' needs. No previous reviews have investigated the usability of mobile apps developed for health care education.

OBJECTIVE

The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education.

METHODS

A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O'Malley framework for scoping reviews.

RESULTS

Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method.

CONCLUSIONS

Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/19072.

Proposed model to determine satisfaction with computerised provider order entry systems in a long-stay hospital

Objectives

Computerised provider order entry (CPOE) systems reduce medication errors, but are not without dangers. Knowing satisfaction with the CPOE helps to improve its implementation. Our objective was to determine the satisfaction of healthcare professionals with the CPOE in a long-stay hospital and to propose a single model.

Methods

A cross-sectional study in a long-stay hospital. Two questionnaires were distributed to determine satisfaction with CPOE, one for medical personnel (MP) and another for nursing personnel (NP). Data collected were: sex, age and work aspects. A strategy for item refinement and creation of a single scale was designed.

Results

The overall participation rate was 63.6%, with 68 responses from the target population of 107. Overall, 72.2% (13 of 18) of MP and 40% (20 of 50) of NP were satisfied with CPOE. Regarding the specific questions on satisfaction in the questionnaires, 88.9% (n=16) of MP were very satisfied but only 56.0% (n=28) of NP. The median of each question was 4, with the exception of those for NP referring to a faster process and improved coordination, which were 3 and 3.5, respectively. The items weighing more in the second component were eliminated and the questions merged. After refining the items, a final six-item model was obtained with a single component of high reliability (Cronbach's α=0.896), which accounts for 67% of total variance.

Conclusion

The degree of satisfaction with CPOE in a long-stay hospital was high, though lower in NP than MP. Obtaining a single questionnaire can facilitate this process.