Development and usability testing of a web-based cancer symptom and quality-of-life support intervention

Meaningful consumer involvement in cancer care: a systematic review on co-design methods and processes

OBJECTIVE

Although the benefits of consumer involvement in research and health care initiatives are known, there is a need to optimize this for all people with cancer. This systematic review aimed to synthesize and evaluate the application of co-design in the oncology literature and develop recommendations to guide the application of optimal co-design processes and reporting in oncology research, practice, and policy.

METHODS

A systematic review of co-design studies in adults with cancer was conducted, searching MEDLINE, CINAHL, Embase, and PsycINFO databases and included studies focused on 2 concepts, co-design and oncology.

RESULTS

A total of 5652 titles and abstracts were screened, resulting in 66 eligible publications reporting on 51 unique studies. Four frameworks were applied to describe the co-design initiatives. Most co-design initiatives were designed for use in an outpatient setting (n = 38; 74%) and were predominantly digital resources (n = 14; 27%) or apps (n = 12; 23%). Most studies (n = 25; 49%) used a co-production approach to consumer engagement. Although some studies presented strong co-design methodology, most (n = 36; 70%) did not report the co-design approach, and 14% used no framework. Reporting was poor for the participant level of involvement, the frequency, and time commitment of co-design sessions. Consumer participation level was predominantly collaborate (n = 25; 49%).

CONCLUSIONS

There are opportunities to improve the application of co-design in oncology research. This review has generated recommendations to guide 1) methodology and frameworks, 2) recruitment and engagement of co-design participants, and 3) evaluation of the co-design process. These recommendations can help drive appropriate, meaningful, and equitable co-design, leading to better cancer research and care.

Usability and feasibility of E-nergEYEze: a blended vision-specific E-health based cognitive behavioral therapy and self-management intervention to reduce fatigue in adults with visual impairment

BACKGROUND

Over 50% of adults with visual impairment experience severe fatigue. Therefore, we developed a guided E-health intervention based on cognitive behavioral therapy and self-management to reduce fatigue in this population. This pilot study evaluated the usability, feasibility, fidelity and potential effectiveness of E-nergEYEze.

METHODS

E-nergEYEze was developed by a design team and customized by conducting a pilot study using an iterative development strategy. The intervention was first tested in a usability study among adults with visual impairment (n = 5). Participants were asked to think-aloud while exploring the intervention features and a semi-structured interview was performed afterwards. Subsequently, the enhanced intervention was tested in a feasibility study. Adults with visual impairment and severe fatigue (n = 10) followed the intervention partially with guidance from a social worker and one-time computer trainer support. Fatigue severity (Checklist Individual Strength), fatigue impact (Modified Fatigue Impact Scale) and cognitive behavioral therapy skills (Competencies of Cognitive Therapy Scale-Self Report) were measured at baseline and at three months follow-up and analyzed with the Wilcoxon signed-rank test. The intervention was evaluated through evaluation forms.

RESULTS

The usability study resulted in adjustments to content and lay-out with regard to optically shortened text sentences, separate pages for information and assignments with one read-aloud audio and an additional descriptive explanation of page content. Digital challenges were overcome with mandatory computer training and e-platform modifications. The feasibility study showed a positive trend in reducing fatigue severity (Z -6.108; P < .001; SD 8.4), impact of fatigue (Z - 4.451; P < .001; SD 11.4) and cognitive behavioral therapy skills (Z -2.278; P = .023; SD 19.3). Participants gave useful feedback regarding accessibility, content and guidance, with an overall positive experience. The intervention was rated with a median score of 8 (range 7-10).

CONCLUSION

We developed, evaluated and optimized E-nergEYEze by applying a user-centered and iterative approach. E-nergEYEze showed a promising trend to reduce fatigue severity and impact of fatigue and to increase cognitive behavioral therapy skills. The study methods were feasible and the fidelity of the intervention protocol was suitable. Performing a randomized controlled trial is warranted to give insight into whether E-nergEYEze is cost-effective in reducing severe fatigue in adults with visual impairment.

TRIAL REGISTRATION

International Clinical Trial Registry Platform: NL7764. Date registered: 28-05-2019.

A usability evaluation of the perceived user friendliness, accessibility, and inclusiveness of a personalized digital care pathway tool

OBJECTIVE

This study aimed to acquire insight into the perceived user friendliness, accessibility and inclusiveness of a personalized digital care pathway.

MATERIALS & METHODS

Usability of the tool was tested in an experimental setting. Mixed methods data collection consisted of scenario-based eye tracking tests in a web- or mobile-based prototype of the tool, followed by a questionnaire assessing user friendliness (System Usability Scale; SUS) and a structured interview. Inclusiveness was assessed by subgroup comparisons based on language proficiency, age and education level. Via purposive sampling a heterogeneous population of users (N = 24) was recruited. Eye tracking was used to measure gaze behavior.

RESULTS

Overall, participants were satisfied with the tool (scale 0-10, 7.5; SD = 1.29). User friendliness of the mobile version (68.3; SD = 21.6) was higher than the web version (50.9; SD = 17.3) measured by SUS score (0-100). With regard to accessibility, eye tracking scenarios showed that the menu bar was hard to find (17% mobile, 55% web). In all scenario's, information was found faster in the mobile version than the web version. Attention was easily drawn to images. Regarding inclusiveness of the tool, we found significantly longer completing time of the scenario tasks for low language proficiency (p-value = 0.029) and higher age subgroups (p-value = 0.049). Lower language proficiency scored a significant lower SUS score (p-value = 0.012).

CONCLUSIONS

Overall, user friendliness and accessibility were positively evaluated. Assessment of inclusiveness emphasized the need for tailoring digital tools to those with low language proficiency and/or an older age. Co-creation of digital care tools with users is therefore important to match users' needs, make tools easily understandable and accessible to all users, and ultimately result in better uptake and impact.

Usability and acceptability of the electronic self-assessment and care (eSAC) program in advanced ovarian cancer: A mixed methods study

OBJECTIVE

To determine usability and acceptability of the electronic self-assessment and care (eSAC) web-based, patient reported outcome (PRO) program for people with advanced ovarian cancer.

METHODS

Patient participants recruited from a single ambulatory site were prompted by email to answer symptom/quality of life items prior to each clinic visit. Patient participant acceptability was measured with the Acceptability E-Scale Score (AES). Usability was measured among a subset of patient participants using semi-structured interviews. Clinician participant acceptability and usability were measured via survey and semi-structured interviews. Quantitative data were analyzed with descriptive statistics. Qualitative data were analyzed using thematic content analysis. A mixed methods analysis was performed.

RESULTS

Of 163 eligible patients approached, 143 (87.7%) provided written consent. Patient participants (n = 71) who created an eSAC report prior to at least 3 clinic visits, rated eSAC as acceptable with a mean AES score of 26.19 ± 3.36 (out of 30). Interview data from patient participants (n = 33) revealed that eSAC was easy to use and important to the clinic visit conversation. Data from clinician surveys (n = 8) and focus groups (n = 3) revealed that the eSAC program was acceptable and useful for clinicians. Qualitative analysis suggested process improvements from patients and clinicians for effectiveness in the advanced ovarian cancer setting. Mixed methods analysis demonstrated no major discrepancies between quantitative and qualitative findings, with the qualitative data broadening understanding of quantitative ratings.

CONCLUSION

eSAC was useful and acceptable in this setting. This PRO is a promising strategy for enhancing patient-centered care for people with advanced ovarian cancer.

Deploying the Behavioral and Environmental Sensing and Intervention for Cancer Smart Health System to Support Patients and Family Caregivers in Managing Pain: Feasibility and Acceptability Study

BACKGROUND

Distressing cancer pain remains a serious symptom management issue for patients and family caregivers, particularly within home settings. Technology can support home-based cancer symptom management but must consider the experience of patients and family caregivers, as well as the broader environmental context.

OBJECTIVE

This study aimed to test the feasibility and acceptability of a smart health sensing system-Behavioral and Environmental Sensing and Intervention for Cancer (BESI-C)-that was designed to support the monitoring and management of cancer pain in the home setting.

METHODS

Dyads of patients with cancer and their primary family caregivers were recruited from an outpatient palliative care clinic at an academic medical center. BESI-C was deployed in each dyad home for approximately 2 weeks. Data were collected via environmental sensors to assess the home context (eg, light and temperature); Bluetooth beacons to help localize dyad positions; and smart watches worn by both patients and caregivers, equipped with heart rate monitors, accelerometers, and a custom app to deliver ecological momentary assessments (EMAs). EMAs enabled dyads to record and characterize pain events from both their own and their partners' perspectives. Sensor data streams were integrated to describe and explore the context of cancer pain events. Feasibility was assessed both technically and procedurally. Acceptability was assessed using postdeployment surveys and structured interviews with participants.

RESULTS

Overall, 5 deployments (n=10 participants; 5 patient and family caregiver dyads) were completed, and 283 unique pain events were recorded. Using our "BESI-C Performance Scoring Instrument," the overall technical feasibility score for deployments was 86.4 out of 100. Procedural feasibility challenges included the rurality of dyads, smart watch battery life and EMA reliability, and the length of time required for deployment installation. Postdeployment acceptability Likert surveys (1=strongly disagree; 5=strongly agree) found that dyads disagreed that BESI-C was a burden (1.7 out of 5) or compromised their privacy (1.9 out of 5) and agreed that the system collected helpful information to better manage cancer pain (4.6 out of 5). Participants also expressed an interest in seeing their own individual data (4.4 out of 5) and strongly agreed that it is important that data collected by BESI-C are shared with their respective partners (4.8 out of 5) and health care providers (4.8 out of 5). Qualitative feedback from participants suggested that BESI-C positively improved patient-caregiver communication regarding pain management. Importantly, we demonstrated proof of concept that seriously ill patients with cancer and their caregivers will mark pain events in real time using a smart watch.

CONCLUSIONS

It is feasible to deploy BESI-C, and dyads find the system acceptable. By leveraging human-centered design and the integration of heterogenous environmental, physiological, and behavioral data, the BESI-C system offers an innovative approach to monitor cancer pain, mitigate the escalation of pain and distress, and improve symptom management self-efficacy.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/16178.

Technology-Based Interventions for Cancer Caregivers: Concept Analysis

Background

Cancer is a taxing chronic disease that demands substantial care, most of which is shouldered by informal caregivers. As a result, cancer caregivers often have to manage considerable challenges that could result in severe physical and psychological health consequences. Technology-based interventions have the potential to address many, if not all, of the obstacles caregivers encounter while caring for patients with cancer. However, although the application of technology-based interventions is on the rise, the term is seldom defined in research or practice. Considering that the lack of conceptual clarity of the term could compromise the effectiveness of technology-based interventions for cancer caregivers, timely research is needed to bridge this gap.

Objective

This study aims to clarify the meaning of technology-based interventions in the context of cancer caregiving and provide a definition that can be used by cancer caregivers, patients, clinicians, and researchers to facilitate evidence-based research and practice.

Methods

The 8-step concept analysis method by Walker and Avant was used to analyze the concept of technology-based interventions in the context of cancer caregiving. PubMed, PsycINFO, CINAHL, and Scopus were searched for studies that examined technology-based interventions for cancer caregivers.

Results

The defining attributes of technology-based interventions were recognized as being accessible, affordable, convenient, and user-friendly. On the basis of insights gained on the defining attributes, antecedents to, and consequences of technology-based interventions through the concept analysis process, technology-based interventions were defined as the use of technology to design, develop, and deliver health promotion contents and strategies aimed at inducing or improving positive physical or psychological health outcomes in cancer caregivers.

Conclusions

This study clarified the meaning of technology-based interventions in the context of cancer caregiving and provided a clear definition that can be used by caregivers, patients, clinicians, and researchers to facilitate evidence-based oncology practice. A clear conceptualization of technology-based interventions lays foundations for better intervention design and research outcomes, which in turn have the potential to help health care professionals address the needs and preferences of cancer caregivers more cost-effectively.

The effect of web-based intervention programs on self-management and symptom management in patients with lymphoma: A systematic review of randomized controlled trials

AIM

This systematic review aimed to systematically summarize studies obtained through a database search and examine the effect of web-based intervention programs on self-management and symptom management in patients with lymphoma.

METHODS

A systematic review of randomized controlled trials was carried out. Cochrane Central Register of Controlled Trials, Web of Science, PubMed, CINAHL, Scopus, ProQuest, Science Direct, and Ovid databases were reviewed until January 2021. The flow chart of the Preferred Reporting Items for Systematic Review and Meta-Analysis checklist was used in the search procedure without setting a year limit. Population, Intervention, Comparison, Outcomes and Study criteria were determined by two independent investigators and published randomized controlled studies in English with lymphoma diagnosis and web-based intervention programs for self-management and symptom management were included in the systematic review. The included studies were examined for their risk of bias with the help of the Cochrane Collaboration tool. A narrative synthesis of study findings was performed.

RESULTS

Six randomized controlled trials with 2382 participants were included in the systematic review. Web-based intervention programs in patients diagnosed with lymphoma were found to be generally implemented for determining the levels of self-management and symptom management. In all of the studies reviewed, it was found that the interventions had treatment outcomes. The risk of Bias 2 was evaluated as high risk in two studies that did not meet the criteria for blinding outcome evaluations. The included studies, while evaluating the effects of web-based intervention programs on patient outcomes, could not provide information about the underlying mechanisms by which these effects occur and how they occur.

CONCLUSIONS

All of the studies included were found to apply a technology designed to improve outcomes in patients with lymphoma. It is recommended that web-based intervention programs be individualized by adapting them to lymphoma types and stages, and serve as a guide for effective symptom management.

Patients and Caregivers Rate the PAINReportIt Wireless Internet-Enabled Tablet as a Method for Reporting Pain During End-of-Life Cancer Care

BACKGROUND

In several studies, investigators have successfully used an internet-enabled PAINReportIt tablet to allow patients to report their pain to clinicians in real-time, but it is unknown how acceptable this technology is to patients and caregivers when used in their homes.

OBJECTIVE

The aims of this study were to examine computer use acceptability scores of patients with end-stage cancer in hospice and their caregivers and to compare the scores for differences by age, gender, race, and computer use experience.

INTERVENTION/METHODS

Immediately after using the tablet, 234 hospice patients and 231 caregivers independently completed the Computer Acceptability Scale (maximum scores of 14 for patients and 9 for caregivers).

RESULTS

The mean (SD) Computer Acceptability score was 12.2 (1.9) for patients and 8.5 (0.9) for caregivers. Computer Acceptability scores were significantly associated with age and with previous computer use for both patients and caregivers.

CONCLUSIONS

This technology was highly acceptable to patients and caregivers for reporting pain in real time to their hospice nurses.

IMPLICATIONS FOR PRACTICE

Findings provide encouraging results that are worthy of serious consideration for patients who are in end stages of illness, including older persons and those with minimal computer experience. Increasing availability of technology can provide innovative methods for improving care provided to patients facing significant cancer-related pain even at the end of life.

Status and Recommendations of Technological and Data-Driven Innovations in Cancer Care: Focus Group Study

BACKGROUND

The status of the data-driven management of cancer care as well as the challenges, opportunities, and recommendations aimed at accelerating the rate of progress in this field are topics of great interest. Two international workshops, one conducted in June 2019 in Cordoba, Spain, and one in October 2019 in Athens, Greece, were organized by four Horizon 2020 (H2020) European Union (EU)-funded projects: BOUNCE, CATCH ITN, DESIREE, and MyPal. The issues covered included patient engagement, knowledge and data-driven decision support systems, patient journey, rehabilitation, personalized diagnosis, trust, assessment of guidelines, and interoperability of information and communication technology (ICT) platforms. A series of recommendations was provided as the complex landscape of data-driven technical innovation in cancer care was portrayed.

OBJECTIVE

This study aims to provide information on the current state of the art of technology and data-driven innovations for the management of cancer care through the work of four EU H2020-funded projects.

METHODS

Two international workshops on ICT in the management of cancer care were held, and several topics were identified through discussion among the participants. A focus group was formulated after the second workshop, in which the status of technological and data-driven cancer management as well as the challenges, opportunities, and recommendations in this area were collected and analyzed.

RESULTS

Technical and data-driven innovations provide promising tools for the management of cancer care. However, several challenges must be successfully addressed, such as patient engagement, interoperability of ICT-based systems, knowledge management, and trust. This paper analyzes these challenges, which can be opportunities for further research and practical implementation and can provide practical recommendations for future work.

CONCLUSIONS

Technology and data-driven innovations are becoming an integral part of cancer care management. In this process, specific challenges need to be addressed, such as increasing trust and engaging the whole stakeholder ecosystem, to fully benefit from these innovations.

Understanding the Experience of Cancer Pain From the Perspective of Patients and Family Caregivers to Inform Design of an In-Home Smart Health System: Multimethod Approach

Background

Inadequately managed pain is a serious problem for patients with cancer and those who care for them. Smart health systems can help with remote symptom monitoring and management, but they must be designed with meaningful end-user input.

Objective

This study aims to understand the experience of managing cancer pain at home from the perspective of both patients and family caregivers to inform design of the Behavioral and Environmental Sensing and Intervention for Cancer (BESI-C) smart health system.

Methods

This was a descriptive pilot study using a multimethod approach. Dyads of patients with cancer and difficult pain and their primary family caregivers were recruited from an outpatient oncology clinic. The participant interviews consisted of (1) open-ended questions to explore the overall experience of cancer pain at home, (2) ranking of variables on a Likert-type scale (0, no impact; 5, most impact) that may influence cancer pain at home, and (3) feedback regarding BESI-C system prototypes. Qualitative data were analyzed using a descriptive approach to identity patterns and key themes. Quantitative data were analyzed using SPSS; basic descriptive statistics and independent sample t tests were run.

Results

Our sample (n=22; 10 patient-caregiver dyads and 2 patients) uniformly described the experience of managing cancer pain at home as stressful and difficult. Key themes included (1) unpredictability of pain episodes; (2) impact of pain on daily life, especially the negative impact on sleep, activity, and social interactions; and (3) concerns regarding medications. Overall, taking pain medication was rated as the category with the highest impact on a patient’s pain (=4.79), followed by the categories of wellness (=3.60; sleep quality and quantity, physical activity, mood and oral intake) and interaction (=2.69; busyness of home, social or interpersonal interactions, physical closeness or proximity to others, and emotional closeness and connection to others). The category related to environmental factors (temperature, humidity, noise, and light) was rated with the lowest overall impact (=2.51). Patients and family caregivers expressed receptivity to the concept of BESI-C and reported a preference for using a wearable sensor (smart watch) to capture data related to the abrupt onset of difficult cancer pain.

Conclusions

Smart health systems to support cancer pain management should (1) account for the experience of both the patient and the caregiver, (2) prioritize passive monitoring of physiological and environmental variables to reduce burden, and (3) include functionality that can monitor and track medication intake and efficacy; wellness variables, such as sleep quality and quantity, physical activity, mood, and oral intake; and levels of social interaction and engagement. Systems must consider privacy and data sharing concerns and incorporate feasible strategies to capture and characterize rapid-onset symptoms.

Hodgkin Lymphoma Survivor Wellness: Development of a Web-Based Intervention

BACKGROUND

Informational and supportive care resources are needed for Hodgkin lymphoma (HL) survivors.

OBJECTIVES

The aim of this article is to adapt and evaluate a previously developed survivorship care website for HL survivors.

METHODS

A mixed-methods, user-centered design, including one-time focus groups, was followed by iterative web design and user testing. Transcripts were content analyzed, and survey responses were summarized.

FINDINGS

HL survivors need survivorship care education and support. Tailored web-based resources may be an effective adjunct to clinical care. The Survivor Wellness website is a usable web-based resource for HL survivors that may facilitate survivorship care.

The Importance of Systematically Reporting and Reflecting on eHealth Development: Participatory Development Process of a Virtual Reality Application for Forensic Mental Health Care

Background

The use of electronic health (eHealth) technologies in practice often is lower than expected, mostly because there is no optimal fit among a technology, the characteristics of prospective users, and their context. To improve this fit, a thorough systematic development process is recommended. However, more knowledge about suitable development methods is necessary to create a tool kit that guides researchers in choosing development methods that are appropriate for their context and users. In addition, there is a need for reflection on the existing frameworks for eHealth development to be able to constantly improve them.

Objective

The two main objectives of this case study were to present and reflect on the (1) methods used in the development process of a virtual reality application for forensic mental health care and (2) development model that was used: the CeHRes Roadmap (the Centre for eHealth Research Roadmap).

Methods

In the development process, multiple methods were used to operationalize the first 2 phases of the CeHRes Roadmap: the contextual inquiry and value specification. To summarize the most relevant information for the goals of this study, the following information was extracted per method: (1) research goal, (2) explanation of the method used, (3) main results, (4) main conclusions, and (5) lessons learned about the method.

Results

Information on 10 methods used is presented in a structured manner. These 10 methods were stakeholder identification, project team composition, focus groups, literature study, semistructured interviews, idea generation with scenarios, Web-based questionnaire, value specification, idea generation with prototyping, and a second round of interviews. The lessons learned showed that although each method added new insights to the development process, not every method appeared to be the most appropriate for each research goal.

Conclusions

Reflection on the methods used pointed out that brief methods with concrete examples or scenarios fit the forensic psychiatric patients the best, among other things, because of difficulties with abstract reasoning and low motivation to invest much time in participating in research. Formulating clear research questions based on a model’s underlying principles and composing a multidisciplinary project team with prospective end users appeared to be important in this study. The research questions supported the project team in keeping the complex development processes structured and prevented tunnel vision. With regard to the CeHRes Roadmap, continuous stakeholder involvement and formative evaluations were evaluated as strong points. A suggestion to further improve the Roadmap is to explicitly integrate the use of domain-specific theories and models. To create a tool kit with a broad range of methods for eHealth development and further improve development models, studies that report and reflect on development processes in a consistent and structured manner are needed.

Automated analysis of free-text comments and dashboard representations in patient experience surveys: a multimethod co-design study

Background

Patient experience surveys (PESs) often include informative free-text comments, but with no way of systematically, efficiently and usefully analysing and reporting these. The National Cancer Patient Experience Survey (CPES), used to model the approach reported here, generates > 70,000 free-text comments annually.

Main aim

To improve the use and usefulness of PES free-text comments in driving health service changes that improve the patient experience.

Secondary aims

(1) To structure CPES free-text comments using rule-based information retrieval (IR) (‘text engineering’), drawing on health-care domain-specific gazetteers of terms, with in-built transferability to other surveys and conditions; (2) to display the results usefully for health-care professionals, in a digital toolkit dashboard display that drills down to the original free text; (3) to explore the usefulness of interdisciplinary mixed stakeholder co-design and consensus-forming approaches in technology development, ensuring that outputs have meaning for all; and (4) to explore the usefulness of Normalisation Process Theory (NPT) in structuring outputs for implementation and sustainability.

Design

A scoping review, rapid review and surveys with stakeholders in health care (patients, carers, health-care providers, commissioners, policy-makers and charities) explored clinical dashboard design/patient experience themes. The findings informed the rules for the draft rule-based IR [developed using half of the 2013 Wales CPES (WCPES) data set] and prototype toolkit dashboards summarising PES data. These were refined following mixed stakeholder, concept-mapping workshops and interviews, which were structured to enable consensus-forming ‘co-design’ work. IR validation used the second half of the WCPES, with comparison against its manual analysis; transferability was tested using further health-care data sets. A discrete choice experiment (DCE) explored which toolkit features were preferred by health-care professionals, with a simple cost–benefit analysis. Structured walk-throughs with NHS managers in Wessex, London and Leeds explored usability and general implementation into practice.

Key outcomes

A taxonomy of ranked PES themes, a checklist of key features recommended for digital clinical toolkits, rule-based IR validation and transferability scores, usability, and goal-oriented, cost–benefit and marketability results. The secondary outputs were a survey, scoping and rapid review findings, and concordance and discordance between stakeholders and methods.

Results

(1) The surveys, rapid review and workshops showed that stakeholders differed in their understandings of the patient experience and priorities for change, but that they reached consensus on a shortlist of 19 themes; six were considered to be core; (2) the scoping review and one survey explored the clinical toolkit design, emphasising that such toolkits should be quick and easy to use, and embedded in workflows; the workshop discussions, the DCE and the walk-throughs confirmed this and foregrounded other features to form the toolkit design checklist; and (3) the rule-based IR, developed using noun and verb phrases and lookup gazetteers, was 86% accurate on the WCPES, but needs modification to improve this and to be accurate with other data sets. The DCE and the walk-through suggest that the toolkit would be well accepted, with a favourable cost–benefit ratio, if implemented into practice with appropriate infrastructure support.

Limitations

Small participant numbers and sampling bias across component studies. The scoping review studies mostly used top-down approaches and focused on professional dashboards. The rapid review of themes had limited scope, with no second reviewer. The IR needs further refinement, especially for transferability. New governance restrictions further limit immediate use.

Conclusions

Using a multidisciplinary, mixed stakeholder, use of co-design, proof of concept was shown for an automated display of patient experience free-text comments in a way that could drive health-care improvements in real time. The approach is easily modified for transferable application.

Future work

Further exploration is needed of implementation into practice, transferable uses and technology development co-design approaches.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Requirements for an Electronic Health Tool to Support the Process of Help Seeking by Caregivers of Functionally Impaired Older Adults: Co-Design Approach

Background

In Quebec, Canada, many public, community, and private organizations provide resources to caregivers of functionally impaired older adults. Nevertheless, these resources may be difficult for caregivers to find. A co-design study was conducted to address the gap between caregivers and access to resources. The purpose of this study was to support the process of help seeking by caregivers of functionally impaired older adults through electronic health (eHealth).

Objective

The purpose of this study was to focus on the identification of functional and content requirements for an eHealth tool to support the help-seeking process of caregivers of functionally impaired older adults.

Methods

This study uses a co-design process based on qualitative action research approach to develop an eHealth tool with health and social service professionals (HSSPs), community workers, and caregivers. The participants acted as co-designers in identifying requirements for the tool. A total of 4 design workshops and 1 advisory committee session were held in different locations in Quebec, Canada. Activities were videotaped and analyzed with a conceptual framework of user experience.

Results

A total of 11 caregivers, 16 community workers, and 11 HSSPs participated in identifying the requirements for the eHealth tool. Several functional and content requirements were identified for each user need (19). Content requirements differed depending on the category of participant, corresponding to the concept of user segmentation in the design of information and communication technology. Nevertheless, there were disagreements among co-designers about specific functionalities, which included (1) functionalities related to the social Web, (2) functionalities related to the evaluation of resources for caregivers, and (3) functionalities related to the emerging technologies. Several co-design sessions were required to resolve disagreements.

Conclusions

Co-designers (participants) were able to identify functional and content requirements for each of the previously identified needs; however, several discussions were required to achieve consensus. Decision making was influenced by identity, social context, and participants’ knowledge, and it is a challenge to reconcile the different perspectives. The findings stressed the importance of allowing more time to deal with the iterative aspect of the design activity, especially during the identification of requirements of an eHealth tool.

International Registered Report Identifier (IRRID)

RR2-10.2196/11634

Employing a user-centered cognitive walkthrough to evaluate a mHealth diabetes self-management application: A case study and beginning method validation

INTRODUCTION

Self-management of chronic diseases using mobile health (mHealth) systems and applications is becoming common. Current evaluation methods such as formal usability testing can be very costly and time-consuming; others may be more efficient but lack a user focus. We propose an enhanced cognitive walkthrough (CW) method, the user-centered CW (UC-CW), to address identified deficiencies in the original technique and perform a beginning validation with think aloud protocol (TA) to assess its effectiveness, efficiency and user acceptance in a case study with diabetes patient users on a mHealth self-management application.

MATERIALS AND METHODS

A total of 12 diabetes patients at University of Utah Health, USA, were divided into UC-CW and think aloud (TA) groups. The UC-CW method included: making the user the main evaluator for detecting usability problems, having a dual domain facilitator, and using three other improved processes: validated task development, higher level tasks and a streamlined evaluation process. Users interacted with the same mHealth application for both methods. Post-evaluation assessments included the NASA RTLX instrument and a set of brief interview questions.

RESULTS

Participants had similar demographic characteristics. A total of 26 usability problems were identified with the UC-CW and 20 with TA. Both methods produced similar ratings: severity across all views (UC-CW = 2.7 and TA = 2.6), numbers of problems in the same views (Main View [UC-CW = 11, TA = 10], Carbohydrate Entry View [UC-CW = 4, TA = 3] and List View [UC-CW = 3, TA = 3]) with similar heuristic violations (Match Between the System and Real World [UC-CW = 19, TA = 16], Consistency and Standards [UC-CW = 17, TA = 15], and Recognition Rather than Recall [UC-CW = 13, TA = 10]). Both methods converged on eight usability problems, but the UC-CW group detected five critical issues while the TA group identified two. The UC-CW group identified needed personalized features for patients' disease needs not identified with TA. UC-CW was more efficient on average time per identified usability problem and on the total evaluation process with patients. NASA RTLX scores indicated that participants experienced the UC-CW half as cognitively demanding. Common themes from interviews indicated the UC-CW as enjoyable and easy to perform while TA was considered somewhat awkward and more cognitively challenging.

CONCLUSIONS

UC-CW was effective for finding severe, recurring usability problems and it highlighted the need for personalized user features. The method was also efficient and had high user acceptance. These results indicate UC-CW's utility and user acceptance in evaluating a mHealth self-management application. It provides an additional usability evaluation technique for researchers.

Usability Challenges for Health and Wellness Mobile Apps: Mixed-Methods Study Among mHealth Experts and Consumers

BACKGROUND

By 2019, there will be an estimated 4.68 billion mobile phone users globally. This increase comes with an unprecedented proliferation in mobile apps, a plug-and-play product positioned to improve lives in innumerable ways. Within this landscape, medical apps will see a 41% compounded annual growth rate between 2015 and 2020, but paradoxically, prevailing evidence indicates declining downloads of such apps and decreasing "stickiness" with the intended end users.

OBJECTIVE

As usability is a prerequisite for success of health and wellness mobile apps, this paper aims to provide insights and suggestions for improving usability experience of the mobile health (mHealth) app by exploring the degree of alignment between mHealth insiders and consumers.

METHODS

Usability-related major themes were selected from over 20 mHealth app development studies. The list of themes, grouped into 5 categories using the Nielsen usability model, was then used as a framework to identify and classify the responses from mHealth expert (insider) interviews. Responses from the qualitative phase were integrated into some questions for a quantitative consumer survey. Subsequently, categorical data from qualitative mHealth insider interviews and numerical data from a quantitative consumer survey were compared in order to identify common usability themes and areas of divergence.

RESULTS

Of the 5 usability attributes described in Nielsen model,  Satisfaction ranked as the top attribute for both mHealth insiders and consumers. Satisfaction refers to user likability, comfort, and pleasure. The consumer survey yielded 451 responses. Out of 9 mHealth insiders' top concerns, 5 were similar to those of the consumers. On the other hand, consumers did not grade themes such as Intuitiveness as important, which was deemed vital by mHealth insiders. Other concerns of the consumers include in-app charges and advertisements.

CONCLUSIONS

This study supports and contributes to the existing pool of mixed-research studies. Strengthening the connectivity between suppliers and users (through the designed research tool) will help increase uptake of mHealth apps. In a holistic manner, this will have a positive overall outcome for the mHealth app ecosystem.

Listening to the patients: using participatory design in the development of a cardiac telerehabilitation web portal

BACKGROUND

Cardiovascular disease is the leading cause of all deaths worldwide. Cardiac rehabilitation is an effective approach for preventing secondary complications, but it remains a complex intervention because of the need for lifestyle changes. One solution is to employ interactive telerehabilitation or eHealth web portals. However, these have not been implemented as intended by developers. The aim of this study was to evaluate the design and usability of a cardiac telerehabilitation web portal, called the 'HeartPortal', for use among heart failure (HF) patients.

METHODS

The HeartPortal was designed using participatory design (PD). The design process involved HF patients, their relatives, healthcare professionals (HCP), healthcare company specialists and researchers. Self-determination theory (SDT) was used to enable the design to elicit intrinsic motivation within the patients. With eHealth literacy skills in mind, the goal of the HeartPortal was to successfully target the end-users. The PD process and data collection techniques included cultural probes, workshops, participant-observation, questionnaires, and problem-solving tasks.

RESULTS

The PD process helped us design an interactive web portal, the HeartPortal. Based on participants' feedback, the design incorporated features such as being able to make notes and to communicate with HCP, view data from self-tracking devices in a graphic form, and to obtain information on rehabilitation in the form of text, audio, and video. More than half of those testing the HeartPortal found that it was easy to navigate, and most of the users stated that it had an excellent structure and that using it could possibly improve their condition.

CONCLUSIONS

Overall, the HeartPortal was found to be logical and easy to navigate and will now be tested in a clinical trial within the Future Patient Telerehabilitation Program.

Usability testing of EirV3-a computer-based tool for patient-reported outcome measures in cancer

PURPOSE

Eir version 3 (V3) is an electronic tool for administration of patient-reported outcome measures (Eir-Patient) that immediately presents patient scores on the physician's computer (Eir-Doctor). Perceived usability is an important determinant for successful implementation. The aim of this study was to answer the following research question evaluated at the cancer outpatient clinics, in the patients' home, and at general practitioners' (GPs) offices: What are the number, type, and severity of usability issues evaluated by the patient (Eir-Patient module) and by the physician (Eir-Doctor module)?

METHODS

A usability evaluation using observations, think-aloud sessions, individual interviews and focus group interviews in cancer patients and their physicians was conducted. Identified usability issues were graded on a severity scale from 1 (irritant) to 4 (unusable).

RESULTS

Overall, 73 Eir registrations were performed by 37 patients, and used by 17 physicians in clinical consultations. All patients were able to complete the Eir-Patient symptom registration. Seventy-two usability issues were identified. None of them were graded as unusable. For the Eir-Patient module, 62% of the identified usability issues was graded as irritant (grade 1), 18% as moderate (grade 2), and 20% as severe (grade 3). For the Eir-Doctor module, 46% of the identified usability issues were graded as irritant, 36% as moderate and 18% as severe.

CONCLUSIONS

In the updated Eir version, issues in the severe and moderate categories have been changed, to optimize the usability of using real-time PROMs in clinical practice.

Development of an eHealth tool for cancer patients: monitoring psycho-emotional aspects with the Family Resilience (FaRe) Questionnaire

In the last decade, clinicians have started to shift from an individualistic perspective of the patient towards family-centred models of care, due to the increasing evidence from research and clinical practice of the crucial role of significant others in determining the patient's adjustment to cancer disease and management. eHealth tools can be considered a means to compensate the services gap and support outpatient care flows. Within the works of the European H2020 iManageCancer project, a review of the literature in the field of family resilience was conducted, in order to determine how to monitor the patient and his/her family's resilience through an eHealth platform. An analysis of existing family resilience questionnaires suggested that no measure was appropriate for cancer patients and their families. For this reason, a new family resilience questionnaire (named FaRe) was developed to screen the patient's and caregiver's psycho-emotional resources. Composed of 24 items, it is divided into four subscales: Communication and Cohesion, Perceived Family Coping, Religiousness and Spirituality, and Perceived Social Support. Embedded in the iManageCancer eHealth platform, it allows users and clinicians to monitor the patient's and the caregivers' resilience throughout the cancer trajectory.

A Qualitative Investigation on Patient Empowerment in Prostate Cancer

Purpose: Men with prostate cancer often describe low levels of empowerment. eHealth interventions may represent useful tools to deliver care and education and to meet patients' needs within an empowerment framework. In order to design a platform for cancer patients' empowerment within the H2020 iManageCancer project, the perspective of the target population for the platform was assessed. The present study aims to assess the qualitative experience of prostate cancer patients during treatment in order to provide insights for clinical practice with a particular focus on the design of a web platform to promote cancer patients' empowerment.

Methods: Ten patients undergoing radiation therapy treatment took part in a semi-structured interview to explore different aspects of patient empowerment. Four main thematic areas were addressed: patient-healthcare providers' communication, decision-making, needs, and resources. A qualitative approach using thematic analysis was followed.

Results: Half of the patients reported little to no possibility to share information and questions with healthcare providers. With regards to decision-making, the role of healthcare providers was perceived as directive/informative, but half of the patients perceived to assume an active role in at least one interaction. Difficulties and needs included the choice of the specialist or of the structure after diagnosis, clinicians' support in self-management, surgical consequences, and side effects, preparation for radiation therapy. Resources included family and social support both from a practical and from an emotional perspective, coping style, and work schedule management.

Conclusions: These results suggest that relations with healthcare providers should be supported, especially immediately after diagnosis and after surgery. Support to self-management after surgery and at the beginning of radiation therapy treatment also constitutes a priority. The adoption of a personalized approach from the beginning of prostate cancer care flow may promote patient empowerment, overcoming the aforementioned needs and mobilizing resources. The social network represents an important resource that could be integrated in interventions. These considerations will be taken into account in the design of a cancer self-management platform aiming to increase patients' empowerment.

Eye tracking in library and information science: a literature review

Purpose

The purpose of this paper is to present a systematic literature review of the application of eye-tracking technology within the field of library and information science. Eye-tracking technology has now reached a level of maturity, which makes the use of the technology more accessible. Subsequently, a growing interest in employing eye tracking as a methodology within library and information science research must be anticipated.

Design/methodology/approach

The review follows the guidelines set in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses recommendations. Two reference databases are searched for relevant references: Library and Information Science Abstracts and Library, Information Science and Technology Abstracts. The main selection criteria are peer-reviewed literature that describes the experimental setting, including which eye-tracking equipment was used, the number of test persons and reports on the eye-tracking measures. Furthermore, this study will report which other methods were applied in combination with eye tracking.

Findings

The number of published research utilizing eye-tracking technologies within library and information science (LIS) is still limited although an increase in the use of eye-tracking technologies is observed during recent years.

Originality/value

To the knowledge of the author, this is the first systematic review on eye-tracking technology and application in LIS.

A Randomized Controlled Trial Protocol to Evaluate the Effectiveness of an Integrated Care Management Approach to Improve Adherence Among HIV-Infected Patients in Routine Clinical Care: Rationale and Design

BACKGROUND

Adherence to antiretroviral medications is a key determinant of clinical outcomes. Many adherence intervention trials investigated the effects of time-intensive or costly interventions that are not feasible in most clinical care settings.

OBJECTIVE

We set out to evaluate a collaborative care approach as a feasible intervention applicable to patients in clinical care including those with mental illness and/or substance use issues.

METHODS

We developed a randomized controlled trial (RCT) investigating an integrated, clinic-based care management approach to improve clinical outcomes that could be integrated into the clinical care setting. This is based on the routine integration and systematic follow-up of a clinical assessment of patient-reported outcomes targeting adherence, depression, and substance use, and adapts previously developed and tested care management approaches. The primary health coach or care management role is provided by clinic case managers allowing the intervention to be generalized to other human immunodeficiency virus (HIV) clinics that have case managers. We used a stepped-care approach to target interventions to those at greatest need who are most likely to benefit rather than to everyone to maintain feasibility in a busy clinical care setting.

RESULTS

The National Institutes of Health funded this study and had no role in study design, data collection, or decisions regarding whether or not to submit manuscripts for publication. This trial is currently underway, enrollment was completed in 2015, and follow-up time still accruing. First results are expected to be ready for publication in early 2017.

DISCUSSION

This paper describes the protocol for an ongoing clinical trial including the design and the rationale for key methodological decisions. There is a need to identify best practices for implementing evidence-based collaborative care models that are effective and feasible in clinical care. Adherence efficacy trials have not led to sufficient improvements, and there remains little guidance regarding how adherence interventions should be implemented into clinical care. By focusing on improving adherence within care settings using existing staff, routine assessment of key domains, such as depression, adherence, and substance use, and feasible interventions, we propose to evaluate this innovative way to improve clinical outcomes.

TRIAL REGISTRATION

Clinicaltrials.gov NCT01505660; http://clinicaltrials.gov/ct2/show/NCT01505660 (Archived by WebCite at http://www.webcitation/ 6ktOq6Xj7).

Development of an Internet Intervention to Address Behaviors Associated with Skin Cancer Risk among Young Adults

PURPOSE

Skin cancer is the most common cancer in the US, and its incidence is increasing. The major risk factor for skin cancer is exposure to ultraviolet radiation (UV). Young adults tend to expose themselves to large amounts of UV and engage in minimal skin protection, which increases their skin cancer risk. Interventions are needed to address risk behaviors among young adults that may lead to skin cancer. The nternet offers a cost-effective way to widely disseminate efficacious interventions. The current paper describes the development of an online skin cancer risk reduction intervention (UV4.me) for young adults.

PROCEDURES

The iterative development process for UV4.me followed best-practice guidelines and included the following activities: individual interviews, focus groups, content development by the expert team, acceptability testing, cognitive interviewing for questionnaires, quality control testing, usability testing, and a pilot randomized controlled trial. Participant acceptability and usability feedback was assessed.

PRINCIPAL RESULTS

The development process produced an evidence-informed intervention that is individually-tailored, interactive, and multimedia in nature based on the Integrative Model of Behavior Prediction, a model for internet interventions, and other best-practice recommendations, expert input, as well as user acceptability and usability feedback gathered before, during, and after development.

MAJOR CONCLUSIONS

Development of an acceptable intervention intended to have a significant public health impact requires a relatively large investment in time, money, expertise, and ongoing user input. Lessons learned and recommendations are discussed. The comprehensive process used may help prepare others interested in creating similar behavioral health interventions.

Exposure to a patient-centered, Web-based intervention for managing cancer symptom and quality of life issues: impact on symptom distress

Background

Effective eHealth interventions can benefit a large number of patients with content intended to support self-care and management of both chronic and acute conditions. Even though usage statistics are easily logged in most eHealth interventions, usage or exposure has rarely been reported in trials, let alone studied in relationship to effectiveness.

Objective

The intent of the study was to evaluate use of a fully automated, Web-based program, the Electronic Self Report Assessment-Cancer (ESRA-C), and how delivery and total use of the intervention may have affected cancer symptom distress.

Methods

Patients at two cancer centers used ESRA-C to self-report symptom and quality of life (SxQOL) issues during therapy. Participants were randomized to ESRA-C assessment only (control) or the ESRA-C intervention delivered via the Internet to patients’ homes or to a tablet at the clinic. The intervention enabled participants to self-monitor SxQOL and receive self-care education and customized coaching on how to report concerns to clinicians. Overall and voluntary intervention use were defined as having ≥2 exposures, and one non-prompted exposure to the intervention, respectively. Factors associated with intervention use were explored with Fisher’s exact test. Propensity score matching was used to select a sample of control participants similar to intervention participants who used the intervention. Analysis of covariance (ANCOVA) was used to compare change in Symptom Distress Scale (SDS-15) scores from pre-treatment to end-of-study by groups in the matched sample.

Results

Radiation oncology participants used the intervention, overall and voluntarily, more than medical oncology and transplant participants. Participants who were working and had more than a high school education voluntarily used the intervention more. The SDS-15 score was reduced by an estimated 1.53 points (P=.01) in the intervention group users compared to the matched control group.

Conclusions

The intended effects of a Web-based, patient-centered intervention on cancer symptom distress were modified by intervention use frequency. Clinical and personal demographics influenced voluntary use.

Trial Registration

Clinicaltrials.gov NCT00852852; http://clinicaltrials.gov/ct2/show/NCT00852852 (Archived by WebCite at http://www.webcitation.org/6YwAfwWl7).

Using Eye Trackers for Usability Evaluation of Health Information Technology: A Systematic Literature Review

Background

Eye-tracking technology has been used to measure human cognitive processes and has the potential to improve the usability of health information technology (HIT). However, it is still unclear how the eye-tracking method can be integrated with other traditional usability methodologies to achieve its full potential.

Objective

The objective of this study was to report on HIT evaluation studies that have used eye-tracker technology, and to envision the potential use of eye-tracking technology in future research.

Methods

We used four reference databases to initially identify 5248 related papers, which resulted in only 9 articles that met our inclusion criteria.

Results

Eye-tracking technology was useful in finding usability problems in many ways, but is still in its infancy for HIT usability evaluation. Limited types of HITs have been evaluated by eye trackers, and there has been a lack of evaluation research in natural settings.

Conclusions

More research should be done in natural settings to discover the real contextual-based usability problems of clinical and mobile HITs using eye-tracking technology with more standardized methodologies and guidance.