Data Visualization for Chronic Neurological and Mental Health Condition Self-management: Systematic Review of User Perspectives

Design of patient-facing immunization visualizations affects task performance: an experimental comparison of 4 electronic visualizations

OBJECTIVE

This study experimentally evaluated how well lay individuals could interpret and use 4 types of electronic health record (EHR) patient-facing immunization visualizations.

MATERIALS AND METHODS

Participants (n = 69) completed the study using a secure online survey platform. Participants viewed the same immunization information in 1 of 4 EHR-based immunization visualizations: 2 different patient portals (Epic MyChart and eClinicWorks), a downloadable EHR record, and a clinic-generated electronic letter (eLetter). Participants completed a common task, created a standard vaccine schedule form, and answered questions about their perceived workload, subjective numeracy and health literacy, demographic variables, and familiarity with the task.

RESULTS

The design of the immunization visualization significantly affected both task performance measures (time taken to complete the task and number of correct dates). In particular, those using Epic MyChart took significantly longer to complete the task than those using eLetter or eClinicWorks. Those using Epic MyChart entered fewer correct dates than those using the eLetter or eClinicWorks. There were no systematic statistically significant differences in task performance measures based on the numeracy, health literacy, demographic, and experience-related questions we asked.

DISCUSSION

The 4 immunization visualizations had unique design elements that likely contributed to these performance differences.

CONCLUSION

Based on our findings, we provide practical guidance for the design of immunization visualizations, and future studies. Future research should focus on understanding the contexts of use and design elements that make tables an effective type of health data visualization.

Engagement With a Remote Symptom-Tracking Platform Among Participants With Major Depressive Disorder: Randomized Controlled Trial

BACKGROUND

Multiparametric remote measurement technologies (RMTs), which comprise smartphones and wearable devices, have the potential to revolutionize understanding of the etiology and trajectory of major depressive disorder (MDD). Engagement with RMTs in MDD research is of the utmost importance for the validity of predictive analytical methods and long-term use and can be conceptualized as both objective engagement (data availability) and subjective engagement (system usability and experiential factors). Positioning the design of user interfaces within the theoretical framework of the Behavior Change Wheel can help maximize effectiveness. In-app components containing information from credible sources, visual feedback, and access to support provide an opportunity to promote engagement with RMTs while minimizing team resources. Randomized controlled trials are the gold standard in quantifying the effects of in-app components on engagement with RMTs in patients with MDD.

OBJECTIVE

This study aims to evaluate whether a multiparametric RMT system with theoretically informed notifications, visual progress tracking, and access to research team contact details could promote engagement with remote symptom tracking over and above the system as usual. We hypothesized that participants using the adapted app (intervention group) would have higher engagement in symptom monitoring, as measured by objective and subjective engagement.

METHODS

A 2-arm, parallel-group randomized controlled trial (participant-blinded) with 1:1 randomization was conducted with 100 participants with MDD over 12 weeks. Participants in both arms used the RADAR-base system, comprising a smartphone app for weekly symptom assessments and a wearable Fitbit device for continuous passive tracking. Participants in the intervention arm (n=50, 50%) also had access to additional in-app components. The primary outcome was objective engagement, measured as the percentage of weekly questionnaires completed during follow-up. The secondary outcomes measured subjective engagement (system engagement, system usability, and emotional self-awareness).

RESULTS

The levels of completion of the Patient Health Questionnaire-8 (PHQ-8) were similar between the control (67/97, 69%) and intervention (66/97, 68%) arms (P value for the difference between the arms=.83, 95% CI -9.32 to 11.65). The intervention group participants reported slightly higher user engagement (1.93, 95% CI -1.91 to 5.78), emotional self-awareness (1.13, 95% CI -2.93 to 5.19), and system usability (2.29, 95% CI -5.93 to 10.52) scores than the control group participants at follow-up; however, all CIs were wide and included 0. Process evaluation suggested that participants saw the in-app components as helpful in increasing task completion.

CONCLUSIONS

The adapted system did not increase objective or subjective engagement in remote symptom tracking in our research cohort. This study provides an important foundation for understanding engagement with RMTs for research and the methodologies by which this work can be replicated in both community and clinical settings.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04972474; https://clinicaltrials.gov/ct2/show/NCT04972474.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/32653.

Patient Experience of Digitalized Follow-up of Antidepressant Treatment in Psychiatric Outpatient Care: Qualitative Analysis

BACKGROUND

Nonadherence to pharmaceutical antidepressant treatment is common among patients with depression. Digitalized follow-up (ie, self-monitoring systems through mobile apps) has been suggested as an effective adjunct to conventional antidepressant treatment to increase medical adherence, improve symptoms of depression, and reduce health care resource use.

OBJECTIVE

The aim of this study was to determine patients' experience of digitalized follow-up using a mobile app as an adjunct to treatment concurrent with a new prescription, a change of antidepressant, or a dose increase.

METHODS

This was a qualitative, descriptive study. Patients at 2 psychiatric outpatient clinics were recruited at the time of changing antidepressant medication. After using a mobile app (either a commercial app or a public app) for 4-6 weeks with daily registrations of active data, such as medical intake and questions concerning general mental health status, individual semistructured interviews were conducted. Recorded data were transcribed and then analyzed using content analysis.

RESULTS

In total, 13 patients completed the study. The mean age was 35 (range 20-67) years, 8 (61.5%) were female, and all reported high digital literacy. Overall, the emerging themes indicated that the patients found the digital app to be a valuable adjunct to antidepressant treatment but with potential for improvement. Both user adherence and medical adherence were positively affected by a daily reminder and the app's ease of use. User adherence was negatively affected by the severity of depression. The positive experience of visually presented data as graphs was a key finding, which was beneficial for self-awareness, the patient-physician relationship, and user adherence. Finally, the patients had mixed reactions to the app's content and requested tailored content.

CONCLUSIONS

The patients identified several factors addressing both medical adherence and user adherence to a digital app when using it for digitalized follow-up concurrent with the critical time related to changes in antidepressant medication. The findings highlight the need for rigorous evidence-based empirical studies to generate sustainable research results.

Human Factors and Organizational Issues: Contributions from 2022

OBJECTIVES

To review publications in the field of Human Factors and Organisational Issues (HF&OI) in the year 2022 and to assess major contributions to the subject.

METHOD

A bibliographic search was conducted following refinement of standardized queries used in previous years. Sources used were PubMed, Web of Science, and referral via references from other papers. The search was carried out in January 2023, and (using the PubMed article type inclusion functionality) included clinical trials, meta-analyses, randomized controlled trials, reviews, case reports, classical articles, clinical studies, observational studies (including veterinary), comparative studies, and pragmatic clinical trials.

RESULTS

Among the 520 returned papers published in 2022 in the various areas of HF&OI, the full review process selected two best papers from among 10 finalists. As in previous years, topics showed development including increased use of Artificial Intelligence (AI) and digital health tools, advancement of methodological frameworks for implementation and evaluation as well as design, and trials of specific digital tools.

CONCLUSIONS

Recent literature in HF&OI continues to focus on both theoretical advances and practical deployment, with focus on areas of patient-facing digital health, methods for design and evaluation, and attention to implementation barriers.

Non-equivalent, but still valid: Establishing the construct validity of a consumer fitness tracker in persons with multiple sclerosis

Tools for monitoring daily physical activity (PA) are desired by persons with multiple sclerosis (MS). However, current research-grade options are not suitable for longitudinal, independent use due to their cost and user experience. Our objective was to assess the validity of step counts and PA intensity metrics derived from the Fitbit Inspire HR, a consumer-grade PA tracker, in 45 persons with MS (Median age: 46, IQR: 40-51) undergoing inpatient rehabilitation. The population had moderate mobility impairment (Median EDSS 4.0, Range 2.0-6.5). We assessed the validity of Fitbit-derived PA metrics (Step count, total time in PA, time in moderate to vigorous PA (MVPA)) during scripted tasks and free-living activity at three levels of data aggregation (minute, daily, and average PA). Criterion validity was assessed though agreement with manual counts and multiple methods for deriving PA metrics via the Actigraph GT3X. Convergent and known-groups validity were assessed via relationships with reference standards and related clinical measures. Fitbit-derived step count and time in PA, but not time in MVPA, exhibited excellent agreement with reference measures during scripted tasks. During free-living activity, step count and time in PA correlated moderately to strongly with reference measures, but agreement varied across metrics, data aggregation levels, and disease severity strata. Time in MVPA weakly agreed with reference measures. However, Fitbit-derived metrics were often as different from reference measures as reference measures were from each other. Fitbit-derived metrics consistently exhibited similar or stronger evidence of construct validity than reference standards. Fitbit-derived PA metrics are not equivalent to existing reference standards. However, they exhibit evidence of construct validity. Consumer-grade fitness trackers such as the Fitbit Inspire HR may therefore be suitable as a PA tracking tool for persons with mild or moderate MS.

Experiences of health tracking in mobile apps for multiple sclerosis: A qualitative content analysis of user reviews

BACKGROUND

Mobile health applications (apps) are promising condition self-management tools for people living with multiple sclerosis (MS). However, most existing apps do not include health tracking features. This gap has been raised as a priority research topic, but the development of new self-management apps will require designers to understand the context and needs of those living with MS. Our aim was to conduct a content analysis of publicly available user reviews of existing MS self-management apps to understand desired features and guide the design of future apps.

METHODS

We systematically reviewed MS self-management apps which were publicly available in English on the Google Play and iOS app stores. We then conducted sentiment and content analysis of recent user reviews which referenced health tracking and data visualization to understand self-reported experiences and feedback.

RESULTS

Searches identified 75 unique apps, of which six met eligibility criteria and had reviews. One hundred and thirty-seven user reviews of these apps were eligible, though most were associated with a single app (n=108). Overall, ratings and sentiment scores skewed highly positive (Median [IQR]: Ratings - 5 [4-5], Sentiment scores - 0.70 [0.44-0.86]), though scores of individual apps varied. Content analysis revealed five themes: reasons for app usage, simple user experience, customization and flexibility, feature requests, and technical issues. Reviewers suggested that app customization, interconnectivity, and consolidated access to desired features should be considered in the design of future apps. User ratings weakly correlated with review sentiment scores (ρ = 0.27 [0.11-0.42]).

CONCLUSIONS

Self-tracking options in MS apps are currently limited, though the apps that offer these functions are considered useful by individuals with MS. Additional qualitative research is required to understand how specific app features and opportunities for personalization should be incorporated into new self-management tools for this population.

Lessons learned from recruiting into a longitudinal remote measurement study in major depressive disorder

The use of remote measurement technologies (RMTs) across mobile health (mHealth) studies is becoming popular, given their potential for providing rich data on symptom change and indicators of future state in recurrent conditions such as major depressive disorder (MDD). Understanding recruitment into RMT research is fundamental for improving historically small sample sizes, reducing loss of statistical power, and ultimately producing results worthy of clinical implementation. There is a need for the standardisation of best practices for successful recruitment into RMT research. The current paper reviews lessons learned from recruitment into the Remote Assessment of Disease and Relapse- Major Depressive Disorder (RADAR-MDD) study, a large-scale, multi-site prospective cohort study using RMT to explore the clinical course of people with depression across the UK, the Netherlands, and Spain. More specifically, the paper reflects on key experiences from the UK site and consolidates these into four key recruitment strategies, alongside a review of barriers to recruitment. Finally, the strategies and barriers outlined are combined into a model of lessons learned. This work provides a foundation for future RMT study design, recruitment and evaluation.

The Extent of User Involvement in the Design of Self-tracking Technology for Bipolar Disorder: Literature Review

BACKGROUND

The number of self-monitoring apps for bipolar disorder (BD) is increasing. The involvement of users in human-computer interaction (HCI) research has a long history and is becoming a core concern for designers working in this space. The application of models of involvement, such as user-centered design, is becoming standardized to optimize the reach, adoption, and sustained use of this type of technology.

OBJECTIVE

This paper aims to examine the current ways in which users are involved in the design and evaluation of self-monitoring apps for BD by investigating 3 specific questions: are users involved in the design and evaluation of technology? If so, how does this happen? And what are the best practice ingredients regarding the design of mental health technology?

METHODS

We reviewed the available literature on self-tracking technology for BD and make an overall assessment of the level of user involvement in design. The findings were reviewed by an expert panel, including an individual with lived experience of BD, to form best practice ingredients for the design of mental health technology. This combines the existing practices of patient and public involvement and HCI to evolve from the generic guidelines of user-centered design and to those that are tailored toward mental health technology.

RESULTS

For the first question, it was found that out of the 11 novel smartphone apps included in this review, 4 (36%) self-monitoring apps were classified as having no mention of user involvement in design, 1 (9%) self-monitoring app was classified as having low user involvement, 4 (36%) self-monitoring apps were classified as having medium user involvement, and 2 (18%) self-monitoring apps were classified as having high user involvement. For the second question, it was found that despite the presence of extant approaches for the involvement of the user in the process of design and evaluation, there is large variability in whether the user is involved, how they are involved, and to what extent there is a reported emphasis on the voice of the user, which is the ultimate aim of such design approaches. For the third question, it is recommended that users are involved in all stages of design with the ultimate goal of empowering and creating empathy for the user.

CONCLUSIONS

Users should be involved early in the design process, and this should not just be limited to the design itself, but also to associated research ensuring end-to-end involvement. Communities in health care-based design and HCI design need to work together to increase awareness of the different methods available and to encourage the use and mixing of the methods as well as establish better mechanisms to reach the target user group. Future research using systematic literature search methods should explore this further.