Initial Usability and Feasibility Evaluation of a Personal Health Record-Based Self-Management System for Older Adults

Patient and dentist perspectives on collecting patient reported outcomes after painful dental procedures in the National Dental PBRN

BACKGROUND

Dental Patient Reported Outcomes (PROs) relate to a dental patient's subjective experience of their oral health. How practitioners and patients value PROs influences their successful use in practice.

METHODS

Semi-structured interviews were conducted with 22 practitioners and 32 patients who provided feedback on using a mobile health (mHealth) platform to collect the pain experience after dental procedures. A themes analysis was conducted to identify implementation barriers and facilitators.

RESULTS

Five themes were uncovered: (1) Sense of Better Care. (2) Tailored Follow-up based on the dental procedure and patient's pain experience. (3) Effective Messaging and Alerts. (4) Usable Digital Platform. (5) Routine mHealth Integration.

CONCLUSION

Frequent automated and preferably tailored follow-up messages using an mHealth platform provided a positive care experience for patients, while providers felt it saved them time and effort. Patients thought that the mHealth questionnaires were well-developed and of appropriate length. The mHealth platform itself was perceived as user-friendly by users, and most would like to continue using it.

PRACTICAL IMPLICATIONS

Patients are prepared to use mobile phones to report their pain experience after dental procedures. Practitioners will be able to close the post-operative communication gap with their patients, with little interruption of their workflow.

Functionalities and Issues in the Implementation of Personal Health Records: Systematic Review

Background

Functionalities of personal health record (PHR) are evolving, and continued discussions about PHR functionalities need to be performed to keep it up-to-date. Technological issues such as nonfunctional requirements should also be discussed in the implementation of PHR.

Objective

This study systematically reviewed the main functionalities and issues in implementing the PHR.

Methods

This systematic review was conducted using Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. The search is performed using the online databases Scopus, ScienceDirect, IEEE, MEDLINE, CINAHL, and PubMed for English journal articles and conference proceedings published between 2015 and 2020.

Results

A total of 105 articles were selected in the review. Seven function categories were identified in this review, which is grouped into basic and advanced functions. Health records and administrative records were grouped into basic functions. Medication management, communication, appointment management, education, and self-health monitoring were grouped into advanced functions. The issues found in this study include interoperability, security and privacy, usability, data quality, and personalization.

Conclusions

In addition to PHR basic and advanced functions, other supporting functionalities may also need to be developed based on the issues identified in this study. This paper provides an integrated PHR architectural model that describes the functional requirements and data sources of PHRs.

Effect of Prior Health Knowledge on the Usability of Two Home Medical Devices: Usability Study

Background

Studies on the usability of health care devices are becoming more common, although usability standards are not necessarily specified and followed. Yet, there is little knowledge about the impact of the context of use on the usability outcome. It is specified in the usability standard (ISO 9241-11, 2018) of a device that it may be affected by its context of use and especially by the characteristics of its users. Among these, prior health knowledge (ie, knowledge about human body functioning) is crucial. However, no study has shown that prior health knowledge influences the usability of medical devices. 

Objective

Our study aimed to fill this gap by analyzing the relationship between the usability of two home medical devices (soon to be used in the context of ambulatory surgery) and prior health knowledge through an experimental approach.

Methods

For assessing the usability of two home medical devices (blood pressure monitor and pulse oximeter), user tests were conducted among 149 students. A mixed-methods approach (subjective vs objective) using a variety of standard instruments was adopted (direct observation, video analysis, and questionnaires). Participants completed a questionnaire to show the extent of their previous health knowledge and then operated both devices randomly. Efficiency (ie, handling time) and effectiveness (ie, number of handling errors) measures were collected by video analysis. Satisfaction measures were collected by a questionnaire (system usability scale [SUS]). The qualitative observational data were coded using inductive analysis by two independent researchers specialized in cognitive psychology and cognitive ergonomics. Correlational analyses and clusters were performed to test how usability relates to sociodemographic characteristics and prior health knowledge.

Results

The results indicated a lack of usability for both devices. Regarding the blood pressure monitor (137 participants), users made approximately 0.77 errors (SD 1.49), and the mean SUS score was 72.4 (SD 21.07), which is considered “satisfactory.” The pulse oximeter (147 participants) appeared easier to use, but participants made more errors (mean 0.99, SD 0.92), and the mean SUS score was 71.52 (SD 17.29), which is considered “satisfactory.” The results showed a low negative and significant correlation only between the effectiveness of the two devices and previous knowledge (blood pressure monitor: r=−0.191, P=.03; pulse oximeter: r=−0.263, P=.001). More subtly, we experimentally identified the existence of a threshold level (χ²_2,146=10.9, P=.004) for health knowledge to correctly use the pulse oximeter, but this was missing for the blood pressure monitor.

Conclusions

This study has the following two contributions: (1) a theoretical interest highlighting the importance of user characteristics including prior health knowledge on usability outcomes and (2) an applied interest to provide recommendations to designers and medical staff.

Feasibility-Usability Study of a Tablet App Adapted Specifically for Persons with Cognitive Impairment-SMART4MD (Support Monitoring and Reminder Technology for Mild Dementia)

Population ageing within Europe has major social and economic consequences. One of the most devastating conditions that predominantly affects older people is dementia. The SMART4MD (Support Monitoring and Reminder Technology for Mild Dementia) project aims to develop and test a health application specifically designed for people with mild dementia. The aim of this feasibility study was to evaluate the design of the SMART4MD protocol, including recruitment, screening, baseline examination and data management, and to test the SMART4MD application for functionality and usability before utilization in a full-scale study. The feasibility study tested the protocol and the app in Spain and Sweden. A total of nineteen persons with cognitive impairment, and their informal caregivers, individually performed a task-based usability test of the SMART4MD app model in a clinical environment, followed by four-week testing of the app in the home environment. By employing a user-centered design approach, the SMART4MD application proved to be an adequate and feasible interface for an eHealth intervention. In the final usability test, a score of 81% satisfied users was obtained. The possibility to test the application in all the procedures included in the study generated important information on how to present the technology to the users and how to improve these procedures.

Personal electronic healthcare records: What influences consumers to engage with their clinical data online? A literature review

Background:

Online electronic records such as patient portals and personally controlled electronic health records (PEHRs) have been widely viewed as a key component to modernising the delivery of healthcare but the uptake of such systems has been slow.

Objective:

The purpose of this literature review was to determine what influences consumers to engage and interact with their clinical data online.

Method:

A scoping literature review following PRISMA guidelines was completed. Electronic patient record research published between January 2009 and December 2018 was included. Following screening and full-text reviews, a total of 64 records were included in this review.

Results:

Three key areas of influence on consumer engagement with their clinical data online emerged: demographic factors affecting consumer interaction with PEHRs; consumers’ perceived benefits and detriments of PEHR use; and the influence of PEHR use on consumer empowerment and responsibility.

Discussion:

Consumer motivation and readiness for engaging with their clinical data online and their long-term ongoing use of these systems requires further exploration.

Conclusion:

As worldwide rates of consumer interactions with individual online clinical data remain low, what influences consumer engagement with a PEHR remains unknown. Further research into the consumer perspective of, and interaction with, a PEHR, needs to be undertaken to determine if factors such as frequent usage of the system by consumers leads to improved clinical outcomes.

Exploring the Digital Divide: Age and Race Disparities in Use of an Inpatient Portal

Background: Age and race disparities in the use of new technologies-the digital divide-may be limiting the potential of patient-facing health information technology to improve health and health care. Objective: To investigate whether disparities exist in the use of patient portals designed specifically for the inpatient environment. Methods: Patients admitted to the six hospitals affiliated with a large, Midwestern academic medical center from July 2017 to July 2018 were provided with access to a tablet equipped with an inpatient portal and recruited to participate in the study (n = 842). Demographic characteristics of study enrollees were obtained from patients' electronic health records and surveys given to patients during their hospital stay. Log files from the inpatient portal were used to create a global measure of use and calculate use rates for specific portal features. Results: We found both age and race disparities in use of the inpatient portal. Patients aged 60-69 (45.3% difference, p < 0.001) and those over age 70 (36.7% difference, p = 0.04) used the inpatient portal less than patients aged 18-29. In addition, African American patients used the portal less than White patients (40.4% difference, p = 0.004). Discussion: These findings suggest that the availability of the technology alone may be insufficient to overcome barriers to use and that additional intervention may be needed to close the digital divide. Conclusions: We identified lower use of the inpatient portal among African American and older patients, relative to White and younger patients, respectively.

Protocol for the Development of a Behavioral Family Lifestyle Intervention Supported by Mobile Health to Improve Weight Self-Management in Children With Asthma and Obesity

BACKGROUND

Asthma is the most common chronic childhood illness and is a leading cause of emergency department visits in the United States. Obesity increases the risk of poor health outcomes, reduced quality of life, and increased health care expenditures among youth with asthma. Weight loss is crucial for improving asthma outcomes in children with obesity. Our study team developed the Childhood Health and Asthma Management Program (CHAMP), a 16-session behavioral family lifestyle intervention (BFI) for school-age children with asthma and obesity and evaluated CHAMP in a randomized controlled trial compared with attention control. There were medium effect sizes favoring CHAMP for changes in body mass index z-scores, asthma control, and lung function among completers (ie, those who attended ≥9 of 16 sessions). Despite high rates of satisfaction reported by families, attendance and trial attrition were suboptimal, which raised concerns regarding the feasibility of CHAMP. Qualitative feedback from participants indicated 3 areas for refinement: (1) a less burdensome intervention modality, (2) a more individually tailored intervention experience, and (3) that interventionists can better answer health-related questions.

OBJECTIVE

We propose to improve upon our pilot intervention by developing the Mobile Childhood Health and Asthma Management Program (mCHAMP), a nurse-delivered BFI, delivered to individual families, and supported by a mobile health (mHealth) app. This study aims to (1) identify structural components of mCHAMP and (2) develop and test the usability of our mCHAMP app.

METHODS

Participants will be recruited from an outpatient pediatric pulmonary clinic. We will identify the structural components of mCHAMP by conducting a needs assessment with parents of children with asthma and obesity. Subsequently, we will develop and test our mCHAMP app using an iterative process that includes usability testing with target users and pediatric nurses.

RESULTS

This study was funded in 2018; 13 parents of children with asthma and obesity participated in the needs assessment. Preliminary themes from focus groups and individual meetings included barriers to engaging in health-promoting behaviors, perceived relationships between asthma and obesity, facilitators to behavior change, and intervention preferences. Participatory design sessions and usability testing are expected to conclude in late 2019.

CONCLUSIONS

Outcomes from this study are expected to include an mHealth app designed with direct participation from the target audience and usability data from stakeholders as well as potential end users.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/13549.

Optimizing the User Experience: Identifying Opportunities to Improve Use of an Inpatient Portal

BACKGROUND

Patient portals specifically designed for the inpatient setting have significant potential to improve patient care. However, little is known about how the users of this technology, the patients, may interact with the inpatient portals. As a result, hospitals have limited ability to design approaches that support patient use of the portal.

OBJECTIVES

This study aims to evaluate the user experience associated with an inpatient portal.

METHODS

We used a Think-Aloud protocol to study user interactions with a commercially available inpatient portal-MyChart Bedside (MCB). Study participants included 19 English-speaking adults over the age of 18 years. In one-on-one sessions, participants narrated their experience using the MCB application and completing eight specific tasks. Recordings were transcribed and coded into three dimensions of the user experience: physical, cognitive, and sociobehavioral.

RESULTS

Our analysis of the physical experience highlighted the navigational errors and technical challenges associated with the use of MCB. We also found that issues associated with the cognitive experience included comprehension problems that spurred anxiety and uncertainty. Analysis of the sociobehavioral experience suggested that users have different learning styles and preferences for learning including self-guided, handouts, and in-person training.

CONCLUSION

Inpatient portals may be an effective tool to improve the patient experience in the hospital. Moreover, making this technology available to inpatients may help to foster ongoing use of technology across the care continuum. However, deriving the benefits from the technology requires appropriate support. We identified multiple opportunities for hospital management to intervene. In particular, teaching patients to use the application by making a variety of instructional materials available could help to reduce several identified barriers to use. Additionally, hospitals should be prepared to manage patient anxiety and increased questioning arising from the availability of information in the inpatient portal application.

Online patient websites for electronic health record access among vulnerable populations: portals to nowhere?

Objective

With the rapid rise in the adoption of patient portals, many patients are gaining access to their personal health information online for the first time. The objective of this study was to examine specific usability barriers to patient portal engagement among a diverse group of patients and caregivers.

Materials and Methods

We conducted interviews using performance testing and think-aloud methods with 23 patients and 2 caregivers as they first attempted to use features of a newly launched patient portal.

Results

In navigating the portal, participants experienced basic computer barriers (eg, difficulty using a mouse), routine computer barriers (eg, mistyping, navigation issues), reading/writing barriers, and medical content barriers. Compared to participants with adequate health literacy, participants with limited health literacy required 2 additional minutes to complete each task and were more likely to experience each type of navigational barrier. They also experienced more inaccuracies in interpreting a test result and finding a treatment plan within an after-visit summary.

Discussion

When using a patient portal for the first time, participants with limited health literacy completed fewer tasks unassisted, had a higher prevalence of encountering barriers, took longer to complete tasks, and had more problems accurately interpreting medical information.

Conclusion

Our findings suggest a strong need for tailored and accessible training and support to assist all vulnerable patients and/or caregivers with portal registration and use. Measuring the health literacy of a patient population might serve as a strong proxy for identifying patients who need the most support in using health technologies.

Qualitative Assessment of the Feasibility, Usability, and Acceptability of a Mobile Client Data App for Community-Based Maternal, Neonatal, and Child Care in Rural Ghana

Mobile phone applications may enhance the delivery of critical health services and the accuracy of health service data. Yet, the opinions and experiences of frontline health workers on using mobile apps to track pregnant and recently delivered women are underreported. This evaluation qualitatively assessed the feasibility, usability, and acceptability of a mobile Client Data App for maternal, neonatal, and child client data management by community health nurses (CHNs) in rural Ghana. The mobile app enabled CHNs to enter, summarize, and query client data. It also sent visit reminders for clients and provided a mechanism to report level of care to district officers. Fourteen interviews and two focus groups with CHNs, midwives, and district health officers were conducted, coded, and thematically analyzed. Results indicated that the app was easily integrated into care, improved CHN productivity, and was acceptable due to its capacity to facilitate client follow-up, data reporting, and decision-making. However, the feasibility and usability of the app were hindered by high client volumes, staff shortages, and software and device challenges. Successful integration of mobile client data apps for frontline health workers in rural and resource-poor settings requires real-time monitoring, program investments, and targeted changes in human resources.

CDS, UX, and System Redesign - Promising Techniques and Tools to Bridge the Evidence Gap

Introduction:

In this special issue of eGEMs, we explore the struggles related to bringing evidence into day-to-day practice, what I define as the “evidence gap.” We are all aware of high quality evidence in the form of guidelines, randomized clinical trials for treatments and diagnostic tests, and clinical prediction rules, which are all readily available online. We also know that electronic health records (EHRs) are now ubiquitous in health care and in most practices across the country. How we marry this high quality evidence and the practice of medicine through effective decision support is a major challenge.

About the Issue:

All of the articles in this issue explore, in some fashion, CDS systems and how we can best bring providers and their work environment to the evidence. We are at the very early stages of the science of usability. Much more research and funding is needed in this area if we hope to improve the dissemination and implementation of evidence in practice. While the featured examples, techniques, and tools in the special issue are a promising start to improving usability and CDS, many of the papers highlight current gaps in knowledge and a great need for generalizable approaches. The great promise is for “learning” approaches to generate new evidence and to integrate this evidence in reliable, patient-centered ways at scale using new technology. Closing the evidence gap is a real possibility, but only if the community works together to innovate and invest in research on the best ways to disseminate, communicate, and implement evidence in practice.