Developing Game-Based Design for eHealth in Practice: 4-Phase Game Design Process

BACKGROUND

Games are increasingly used in eHealth as a strategy for user engagement. There is an enormous diversity of end users and objectives targeted by eHealth. Hence, identifying game content that drives and sustains engagement is challenging. More openness in the game design process and motivational strategies could aid researchers and designers of future game-based apps.

OBJECTIVE

This study aims to provide insights into our approach to develop game-based eHealth in practice with a case study (Personalised ICT Supported Services for Independent Living and Active Ageing [PERSSILAA]). PERSSILAA is a self-management platform that aims to counter frailty by offering training modules to older adults in the domains of healthy nutrition and physical and cognitive training to maintain a healthy lifestyle. We elaborate on the entire game design process and show the motivational strategies applied.

METHODS

We introduce four game design phases in the process toward game-based eHealth: (1) end-user research, (2) conceptualization, (3) creative design, and (4) refinement (ie, prototyping and evaluations).

RESULTS

First, 168 participants participated in end-user research, resulting in an overview of their preferences for game content and a set of game design recommendations. We found that conventional games popular among older adults do not necessarily translate well into engaging concepts for eHealth. Recommendations include focusing game concepts on thinking, problem-solving, variation, discovery, and achievement and using high-quality aesthetics. Second, stakeholder sessions with development partners resulted in strategies for long-term engagement using indicators of user performance on the platform's training modules. These performance indicators, for example, completed training sessions or exercises, form the basis for game progression. Third, results from prior phases were used in creative design to create the game "Stranded!" The user plays a person who is shipwrecked who must gather parts for a life raft by completing in-game objectives. Finally, iterative prototyping resulted in the final prototype of the game-based app. A total of 35 older adults participated using simulated training modules. End users scored appreciation (74/100), ease of use (73/100), expected effectivity and motivation (62/100), fun and pleasantness of using the app (75/100), and intended future use (66/100), which implies that the app is ready for use by a larger population.

CONCLUSIONS

The study resulted in a game-based app for which the entire game design process within eHealth was transparently documented and where engagement strategies were based on extensive user research. Our user evaluations indicate that the strategies for long-term engagement led to game content that was perceived as engaging by older adults. As a next step, research is needed on the user experience and actual engagement with the game to support the self-management of older adults, followed by clinical studies on its added value.

Usability Assessment Methods for Mobile Apps for Physical Rehabilitation: Umbrella Review

BACKGROUND

Usability has been touted as one determiner of success of mobile health (mHealth) interventions. Multiple systematic reviews of usability assessment approaches for different mHealth solutions for physical rehabilitation are available. However, there is a lack of synthesis in this portion of the literature, which results in clinicians and developers devoting a significant amount of time and effort in analyzing and summarizing a large body of systematic reviews.

OBJECTIVE

This study aims to summarize systematic reviews examining usability assessment instruments, or measurements tools, in mHealth interventions including physical rehabilitation.

METHODS

An umbrella review was conducted according to a published registered protocol. A topic-based search of PubMed, Cochrane, IEEE Xplore, Epistemonikos, Web of Science, and CINAHL Complete was conducted from January 2015 to April 2023 for systematic reviews investigating usability assessment instruments in mHealth interventions including physical exercise rehabilitation. Eligibility screening included date, language, participant, and article type. Data extraction and assessment of the methodological quality (AMSTAR 2 [A Measurement Tool to Assess Systematic Reviews 2]) was completed and tabulated for synthesis.

RESULTS

A total of 12 systematic reviews were included, of which 3 (25%) did not refer to any theoretical usability framework and the remaining (n=9, 75%) most commonly referenced the ISO framework. The sample referenced a total of 32 usability assessment instruments and 66 custom-made, as well as hybrid, instruments. Information on psychometric properties was included for 9 (28%) instruments with satisfactory internal consistency and structural validity. A lack of reliability, responsiveness, and cross-cultural validity data was found. The methodological quality of the systematic reviews was limited, with 8 (67%) studies displaying 2 or more critical weaknesses.

CONCLUSIONS

There is significant diversity in the usability assessment of mHealth for rehabilitation, and a link to theoretical models is often lacking. There is widespread use of custom-made instruments, and preexisting instruments often do not display sufficient psychometric strength. As a result, existing mHealth usability evaluations are difficult to compare. It is proposed that multimethod usability assessment is used and that, in the selection of usability assessment instruments, there is a focus on explicit reference to their theoretical underpinning and acceptable psychometric properties. This could be facilitated by a closer collaboration between researchers, developers, and clinicians throughout the phases of mHealth tool development.

TRIAL REGISTRATION

PROSPERO CRD42022338785; https://www.crd.york.ac.uk/prospero/#recordDetails.

Implementing Wearable Sensors for Clinical Application at a Surgical Ward: Points to Consider before Starting

Incorporating technology into healthcare processes is necessary to ensure the availability of high-quality care in the future. Wearable sensors are an example of such technology that could decrease workload, enable early detection of patient deterioration, and support clinical decision making by healthcare professionals. These sensors unlock continuous monitoring of vital signs, such as heart rate, respiration rate, blood oxygen saturation, temperature, and physical activity. However, broad and successful application of wearable sensors on the surgical ward is currently lacking. This may be related to the complexity, especially when it comes to replacing manual measurements by healthcare professionals. This report provides practical guidance to support peers before starting with the clinical application of wearable sensors in the surgical ward. For this purpose, the Non-Adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework of technology adoption and innovations in healthcare organizations is used, combining existing literature and our own experience in this field over the past years. Specifically, the relevant topics are discussed per domain, and key lessons are subsequently summarized.

Feasibility and patient's experiences of perioperative telemonitoring in major abdominal surgery: an observational pilot study

BACKGROUND

Telemonitoring during the perioperative trajectory may improve patient outcomes and self-management. The aim of this study is to assess the feasibility of and patient's experiences with telemonitoring before and after major abdominal surgery to inform future study design.

METHODS

Patients planned for elective major abdominal surgery wore a sensor and answered well-being questions on a tablet daily for at least 2 weeks preoperatively up to 30-days postoperatively. Feasibility was assessed by participation and completion rate, compliance per day, weekly satisfaction scores, and reasons for nonscheduled contact.

RESULTS

Twenty-three patients were included (participation rate of 54.5%) with a completion rate of 69.6%. Median compliance with the wearable sensor and well-being questions was respectively: 94.7% and 83.3% preoperatively at home; 100% and 66.7% postoperatively in-hospital; and 95.4% and 85.8% postoperatively at home. Median weekly satisfaction scores for both wearing the sensor and well-being questions were 5 (IQR, 4-5). Contact moments were related to absence of sensor data and technological issues (76.0%) or patient discomfort and insecurity (24.0%).

CONCLUSIONS

In this study, telemonitoring showed high satisfaction and compliance during the perioperative trajectory. Future trial design regarding the effectiveness of telemonitoring requires embedding in clinical practice and support for patients, relatives, and healthcare personnel.

Determinants of Telerehabilitation Acceptance among Patients Attending Pulmonary Rehabilitation Programs in the United States

Background:

Pulmonary rehabilitation (PR) is an interdisciplinary intervention designed to improve the physical status and the psychological condition of people with chronic respiratory diseases. To improve patients' participation in PR programs, telerehabilitation has been introduced.

Objective:

This study aimed to identify factors that could influence the intention to use telerehabilitation among patients attending traditional PR programs.

Methods:

This cross-sectional study recruited subjects attending the PR centers in the hospitals of the Indiana State University, United States of America, between January and May 2017. Data were collected using self-administered Tele-Pulmonary Rehabilitation Acceptance Scale (TPRAS). TPRAS had two subscales: perceived usefulness and perceived ease of use. Behavioral intention (BI) was the dependent variable, and all responses were dichotomized into positive and negative intention to use. Multiple logistic regressions were performed to assess the influence of variables on the intention to use telerehabilitation.

Results:

A total of 134 respondents were included in this study, of which 61.2% indicated positive intention to use telerehabilitation. Perceived usefulness was a significant predictor of the positive intentions to use of telerehabilitation. Duration of respiratory disease was negatively associated with the use of telerehabilitation.

Conclusion:

Perceived usefulness was a significant predictor of using telerehabilitation. The findings of this study may be useful for health-care organizations in improving the adoption of telerehabilitation or in its implementation. Future telerehabilitation acceptance studies could explore the effects of additional factors including computer literacy and culture on the intention to use telerehabilitation.

Proactive changes in clinical practice as a result of the COVID-19 pandemic: Survey on use of telepractice by Quebec speech-language pathologists

BACKGROUND

The coronavirus disease2019 (COVID-19) pandemic has led to important challenges in health and education service delivery.

AIMS

The present study aimed to document: (i) changes in the use of telepractice by speech-language pathology (SLP) professionals in Quebec since the start of the COVID-19 outbreak; (ii) perceptions of the feasibility of telepractice by SLPs; (iii) barriers to the use of telepractice; and (iv) the perceptions of SLP professionals regarding the main issues of telepractice.

METHODS & PROCEDURES

An online survey with closed and open, Likert scale and demographic questions was completed by 83 SLPs in Quebec in June and July 2020.

OUTCOMES & RESULTS

The survey responses showed that within the cohort responding, telepractice use has increased significantly as a response to the COVID-19 pandemic. Most respondents planned to continue using telepractice after the pandemic ends. In addition, the respondents considered telepractice to be adequate for many clinical practices but less so for others (e.g., swallowing disorders, hearing impairment). Most of the reported barriers to the use of telepractice concerned technological problems and a lack of clinical materials for online use. Confidentiality and privacy issues were also raised.

CONCLUSIONS & IMPLICATIONS

SLP professionals rapidly took advantage of existing technologies in their clinical settings to cope with the pandemic's effects on service delivery. The discrepancy between their perceptions and the evidence in the literature for some practices and populations strengthens the need for more information and education on telepractice.

WHAT THIS PAPER ADDS

What is already known on the subject The proportion of speech-language pathologists (SLPs) in Canada who use telepractice for clinical activities is unknown. Knowing this information became crucial in the context of the coronavirus disease 2019 (COVID-19) pandemic because non-essential activities were interrupted to halt the spread of the disease. What this paper adds to existing knowledge The findings from this survey study confirmed that the use of telepractice in SLP in Quebec increased significantly during the COVID-19 pandemic. Moreover, the majority of the respondents began using telepractice because of the pandemic, and most planned to continue doing so after it ends. This demonstrates how SLP professionals rapidly took advantage of existing technologies in their clinical settings to cope with the pandemic's effects on service delivery. What are the potential or actual clinical implications of this work? Although the SLPs expressed an overall positive perception of telepractice, they also highlighted barriers to its optimal use. The findings of this study should help employers and regulatory bodies in Quebec to bring down those barriers and make telepractice in SLP a durable, effective and efficient service delivery model.

Acceptance of Rehabilitation Technology in Adults With Moderate to Severe Traumatic Brain Injury, Their Caregivers, and Healthcare Professionals: A Systematic Review

BACKGROUND

Moderate to severe traumatic brain injuries (TBIs) commonly result in persistent physical, cognitive, and/or emotional deficits that require long-term rehabilitation. Technology-enabled rehabilitation provides an innovative alternative to traditional intervention models. End-user acceptance of these interventions, however, is a critical factor in determining the effective implementation and acceptance of these technologies.

OBJECTIVE

To systematically review the literature to identify methods and measures used to evaluate user acceptance relating to rehabilitation technologies for adults with moderate to severe TBI, their caregivers, and healthcare professionals.

METHODS

Six key databases including Medline, Embase, CINAHL, Cochrane, Scopus, and Web of Science were searched using the relevant search terms.

RESULTS

From a yield of 2059 studies, 13 studies met the eligibility criteria. The review revealed limited research that formally evaluated user acceptance in relation to rehabilitation technologies designed for adults with TBI. Furthermore, where such evaluations were conducted, comprehensive research designs incorporating theoretical frameworks of technology acceptance were sparse. Importantly, a range of technologies and recommendations that positively influenced user acceptance were identified. Future directions for research in this area include the use of theory-driven research designs to enhance our understanding of technology acceptance, to support the development of rehabilitation technologies that maximize functional outcomes for individuals with TBI.

Health Care Practitioners' Determinants of Telerehabilitation Acceptance

Background:

Pulmonary rehabilitation is a multidisciplinary patient-tailored intervention that aims to improve the physical and psychological condition of people with chronic respiratory diseases. Providing pulmonary rehabilitation (PR) services to the growing population of patients is challenging due to shortages in health care practitioners and pulmonary rehabilitation programs. Telerehabilitation has the potential to address this shortage in practitioners and PR programs as well as improve patients' participation and adherence. This study's purpose was to identify and evaluate the influences of intention of health care practitioners to use telerehabilitation.

Methods:

Data were collected through a self-administered Internet-based survey.

Results:

Surveys were completed by 222 health care practitioners working in pulmonary rehabilitation with 79% having a positive intention to use telerehabilitation. Specifically, perceived usefulness was a significant individual predictor of positive intentions to use telerehabilitation.

Conclusion:

Perceived usefulness may be an important factor associated with health care providers' intent to use telerehabilitation for pulmonary rehabilitation.

German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review

Background

Over the past years, implementation science has gained more and more importance in German-speaking countries. Reliable and valid questionnaires are needed for evaluating the implementation of evidence-based practices. On an international level, several initiatives focused on the identification of questionnaires used in English-speaking countries but limited their search processes to mental health and public health settings. Our aim was to identify questionnaires used in German-speaking countries measuring the implementation of interventions in public health and health care settings in general and to assess their psychometric properties.

Methods

We searched five different bibliographic databases (from 1985 to August 2017) and used several other search strategies (e.g., reference lists, forward citation) to obtain our data. We assessed the instruments, which were identified in an independent dual review process, using 12 psychometric rating criteria. Finally, we mapped the instruments’ scales and subscales in regard to the constructs of the Consolidated Framework for Implementation Research (CFIR) and the Implementation Outcome Framework (IOF).

Results

We identified 31 unique instruments available for the assessment of implementation science constructs. Hospitals and other health care settings were the ones most often investigated (23 instruments), while education and childcare settings, workplace settings, and community settings lacked published instruments. Internal consistency, face and content validity, usability, and structural validity were the aspects most often described. However, most studies did not report on test-retest reliability, known-groups validity, predictive criterion validity, or responsiveness. Overall, the majority of studies did not reveal high-quality instruments, especially regarding the psychometric criteria internal consistency, structural validity, and criterion validity. In addition, we seldom detected instruments operationalizing the CFIR domains intervention characteristics, outer setting, and process, and the IOF constructs adoption, fidelity, penetration, and sustainability.

Conclusions

Overall, a sustained and continuous effort is needed to improve the reliability and validity of existing instruments to new ones. Instruments applicable to the assessment of implementation constructs in public health and community settings are urgently needed.

Trial registration

The systematic review protocol was registered in PROSPERO on October 19, 2017, under the following number: CRD42017075208.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0837-3) contains supplementary material, which is available to authorized users.

Exploring Determinants of Patient Adherence to a Portal-Supported Oncology Rehabilitation Program: Interview and Data Log Analyses

Background

Telemedicine applications often do not live up to their expectations and often fail once they have reached the operational phase.

Objective

The objective of this study was to explore the determinants of patient adherence to a blended care rehabilitation program, which includes a Web portal, from a patient’s perspective.

Methods

Patients were enrolled in a 12-week oncology rehabilitation treatment supported by a Web portal that was developed in cooperation with patients and care professionals. Semistructured interviews were used to analyze thought processes and behavior concerning patient adherence and portal use. Interviews were conducted with patients close to the start and the end of the treatment. Besides, usage data from the portal were analyzed to gain insights into actual usage of the portal.

Results

A total of 12 patients participated in the first interview, whereas 10 participated in the second round of interviews. Furthermore, portal usage of 31 patients was monitored. On average, 11 persons used the portal each week, with a maximum of 20 in the seventh week and a drop toward just one person in the weeks in the follow-up period of the treatment. From the interviews, it was derived that patients’ behavior in the treatment and use of the portal was primarily determined by extrinsic motivation cues (eg, stimulation by care professionals and patient group), perceived severity of the disease (eg, physical and mental condition), perceived ease of use (eg, accessibility of the portal and the ease with which information is found), and perceived usefulness (eg, fit with the treatment).

Conclusions

The results emphasized the impact that care professionals and fellow patients have on patient adherence and portal usage. For this reason, the success of blended care telemedicine interventions seems highly dependent on the willingness of care professionals to include the technology in their treatment and stimulate usage among patients.

Efficacy of Biofeedback in Chronic back Pain: a Meta-Analysis

PURPOSE

The aims of the present analysis were to investigate the short- and long-term efficacy and treatment moderators of biofeedback as a psychological treatment option for chronic back pain.

METHOD

A literature search using PubMed, PsycINFO, and the Cochrane Library identified 21 eligible studies including 23 treatment conditions and 1062 patients.

RESULTS

Meta-analytic integration resulted in a significant small-to-medium effect size for pain intensity reduction (Hedges' g = 0.60; 95 % confidence interval (CI) 0.44, 0.76) that proved to be stable with a significant small-to-large effect size (Hedges' g = 0.62; 95 % CI 0.40, 0.84) over an average follow-up phase of 8 months. Biofeedback also proved to be effective in reducing depression (Hedges' g = 0.40; 95 % CI 0.27, 0.52), disability (Hedges' g = 0.49; 95 % CI 0.34, 0.74), reduction of muscle tension (EMG; Hedges' g = 0.44; 95 % CI 0.22, 0.65), and improving cognitive coping (Hedges' g = 0.41; 95 % CI 0.26, 0.57). These effects remained comparatively stable at follow-up and for controlled studies only. Moderator analyses revealed longer biofeedback treatments to be more effective for reducing disability and a greater proportion of biofeedback in the treatment to be more effective for reducing depression. Publication bias analyses demonstrated the consistency of these effects.

CONCLUSION

It is concluded that biofeedback treatment can lead to improvements on various pain-related outcomes in the short and long terms, both as a standalone and as an adjunctive intervention.

Determinants of Adherence to the Online Component of a Blended Intervention for Patients with Hip and/or Knee Osteoarthritis: A Mixed Methods Study Embedded in the e-Exercise Trial

BACKGROUND

Embedding Web-based interventions within physiotherapy has potential, but knowledge on patient adherence to these interventions is limited.

INTRODUCTION

This study explores which patient-, intervention-, and environment-related factors are determinants of adherence to the online component of e-Exercise, a 12-week blended intervention for patients with hip and/or knee osteoarthritis.

METHODS

A convergent mixed methods study was performed, embedded within an ongoing trial. Quantitative data of 109 participants that received e-Exercise were used for negative binomial regression analysis. Adherence was defined as the number of online evaluated weeks. Next, semistructured interviews on factors related to adherence to the online component were analyzed.

RESULTS

Nineteen participants with missing outcome data because their program was not started were excluded. Of the 90 analyzed participants, 81.1% were evaluated for at least 8 weeks. Adherence was highest for participants with middle education, 1-5-year osteoarthritis duration, and participants who were physiotherapist recruited. The 10 analyzed interviews revealed that sufficient Internet skills, self-discipline, execution of the exercise plan, the intervention's usability, flexibility, persuasive design, added value, and acceptable required time, and research participation were linked to favorable adherence.

DISCUSSION

It is unknown if patients who adhered to the online component also adhered to their exercise plans. The relationship between adherence to the online component and clinical outcomes will be addressed in a future study.

CONCLUSIONS

The majority of the participants adhered to the online component of e-Exercise, illustrating its applicability. The integration within the physiotherapy setting and intervention's persuasive design appear to have an important role in optimizing patient adherence.

Design and Development of a Telerehabilitation Platform for Patients With Phantom Limb Pain: A User-Centered Approach

Background

Phantom limb pain is a frequent and persistent problem following amputation. Achieving sustainable favorable effects on phantom limb pain requires therapeutic interventions such as mirror therapy that target maladaptive neuroplastic changes in the central nervous system. Unfortunately, patients’ adherence to unsupervised exercises is generally poor and there is a need for effective strategies such as telerehabilitation to support long-term self-management of patients with phantom limb pain.

Objective

The main aim of this study was to describe the user-centered approach that guided the design and development of a telerehabilitation platform for patients with phantom limb pain. We addressed 3 research questions: (1) Which requirements are defined by patients and therapists for the content and functions of a telerehabilitation platform and how can these requirements be prioritized to develop a first prototype of the platform? (2) How can the user interface of the telerehabilitation platform be designed so as to match the predefined critical user requirements and how can this interface be translated into a medium-fidelity prototype of the platform? (3) How do patients with phantom limb pain and their treating therapists judge the usability of the medium-fidelity prototype of the telerehabilitation platform in routine care and how can the platform be redesigned based on their feedback to achieve a high-fidelity prototype?

Methods

The telerehabilitation platform was developed using an iterative user-centered design process. In the first phase, a questionnaire followed by a semistructured interview was used to identify the user requirements of both the patients and their physical and occupational therapists, which were then prioritized using a decision matrix. The second phase involved designing the interface of the telerehabilitation platform using design sketches, wireframes, and interface mock-ups to develop a low-fidelity prototype. Heuristic evaluation resulted in a medium-fidelity prototype whose usability was tested in routine care in the final phase, leading to the development of a high-fidelity prototype.

Results

A total of 7 categories of patient requirements were identified: monitoring, exercise programs, communication, settings, background information, log-in, and general requirements. One additional category emerged for therapists: patient management. Based on these requirements, patient and therapist interfaces for the telerehabilitation platform were developed and redesigned by the software development team in an iterative process, addressing the usability problems that were reported by the users during 4 weeks of field testing in routine care.

Conclusions

Our findings underline the importance of involving the users and other stakeholders early and continuously in an iterative design process, as well as the need for clear criteria to identify critical user requirements. A decision matrix is presented that incorporates the views of various stakeholders in systematically rating and prioritizing user requirements. The findings and lessons learned might help health care providers, researchers, software designers, and other stakeholders in designing and evaluating new teletreatments, and hopefully increase the likelihood of user acceptance.

Possibilities of ICT-supported services in the clinical management of older adults

Services making use of information and communication technology (ICT) are of potential interest to face the challenges of our aging society. Aim of this article is to describe the possible field of application for ICT-supported services in the management of older adults, in particular those with functional impairment. The current status of ICT-supported services is described and examples of how these services can be implemented in everyday practice are given. Upcoming technical solutions and future directions are also addressed. An ICT-supported service is not only the technological tool, but its combination with clinical purposes for which it is used and the way it is implemented in everyday care. Patient’s satisfaction with ICT-supported services is moderate to good. Actual use of patients is higher than those of professionals but very variable. Frequency of use is positively related to clinical outcome. ICT offers a variety of opportunities for the treatment and prevention of frailty and functional decline. Future challenges are related to the intelligence of the systems and making the technologies even more unobtrusive and intuitive.

Usability in telemedicine systems-A literature survey

INTRODUCTION

The rapid development of sensors and communication technologies enable the growth of new innovative services in healthcare, such as Telemedicine. An essential ingredient in the development of a telemedicine system and its final acceptance by end users are usability studies. The principles of usability engineering, evaluations and telemedicine are well established, and it may contribute to the adoption and eventually deployment of such systems and services. An in-depth usability analysis, including performance and attitude measures, requires knowledge about available usability techniques, and is depending on the amount of resources. Therefore it is worth investigating how usability methods are applied in developing telemedicine systems. Our hypothesis is: with increasing research and development of telemedicine systems, we expect that various usability methods are more equally employed for different end-user groups and applications.

METHOD

A literature survey was conducted to find telemedicine systems that have been evaluated for usability or ease of use. The elements of the PICO framework were used as a basis for the selection criteria in the literature search. The search was not limited by year. Two independent reviewers screened all search results first by title, and then by abstract for inclusion. Articles were included up to May 2015.

RESULTS

In total, 127 publications were included in this survey. The number of publications on telemedicine systems significantly increased after 2008. Older adults and end-users with cardiovascular conditions were among largest target end-user groups. Remote monitoring systems were found the most, in 90 publications. Questionnaires are the most common means for evaluating telemedicine systems, and were found in 88 publications. Questionnaires are used frequently in studies focusing on cardiovascular diseases, Parkinson's disease and older adult conditions. Interviews are found the most in publications related to stroke. In total 71% of the publications were trial-orientated and the remaining process orientated. An increase in telemedicine research, development and applications is found worldwide, with the majority of publications conducted in America.

DISCUSSION AND CONCLUSION

Monitoring patients in their homes can lead to better healthcare at lower costs which implies an increased demand of new healthcare strategies like telemedicine. We expected that with the increase in telemedicine research and development, a greater range of usability methods would also be employed in the included publications. This is not the case. Researchers employed questionnaires as a preferred usability method for each type of telemedicine system and most end-users. However, in process-orientated studies a greater range of usability evaluations were applied, with fewer differences found in the amount of publications for each evaluation method. Questionnaires enable researchers to evaluate a system quickly on end users, as it requires less expertise on the evaluation method compared to the other methods. They are easily distributed and are customizable. The use of questionnaires is therefore an evaluation method of choice for a variety of telemedicine systems and end-users.

Use of an embedded, micro-randomised trial to investigate non-compliance in telehealth interventions

Background/aims:

Many types of telehealth interventions rely on activity from the patient in order to have a beneficial effect on their outcome. Remote monitoring systems require the patient to record regular measurements at home, for example, blood pressure, so clinicians can see whether the patient’s health changes over time and intervene if necessary. A big problem in this type of intervention is non-compliance. Most telehealth trials report compliance rates, but they rarely compare compliance among various options of telehealth delivery, of which there may be many. Optimising telehealth delivery is vital for improving compliance and, therefore, clinical outcomes. We propose a trial design which investigates ways of improving compliance. For efficiency, this trial is embedded in a larger trial for evaluating clinical effectiveness. It employs a technique called micro-randomisation, where individual patients are randomised multiple times throughout the study. The aims of this article are (1) to verify whether the presence of an embedded secondary trial still allows valid analysis of the primary research and (2) to demonstrate the usefulness of the micro-randomisation technique for comparing compliance interventions.

Methods:

Simulation studies were used to simulate a large number of clinical trials, in which no embedded trial was used, a micro-randomised embedded trial was used, and a factorial embedded trial was used. Each simulation recorded the operating characteristics of the primary and secondary trials.

Results:

We show that the type I error rate of the primary analysis was not affected by the presence of an embedded secondary trial. Furthermore, we show that micro-randomisation is superior to a factorial design as it reduces the variation caused by within-patient correlation. It therefore requires smaller sample sizes – our simulations showed a requirement of 128 patients for a micro-randomised trial versus 760 patients for a factorial design, in the presence of within-patient correlation.

Conclusion:

We believe that an embedded, micro-randomised trial is a feasible technique that can potentially be highly useful in telehealth trials.

Process evaluation of a technology-delivered screening and brief intervention for substance use in primary care

Psychotherapy process research examines the content of treatment sessions and their association with outcomes in an attempt to better understand the interactions between therapists and clients, and to elucidate mechanisms of behavior change. A similar approach is possible in technology-delivered interventions, which have an interaction process that is always perfectly preserved and rigorously definable. The present study sought to examine the process of participants' interactions with a computer-delivered brief intervention for drug use, from a study comparing computer- and therapist-delivered brief interventions among adults at two primary health care centers in New Mexico. Specifically, we sought to describe the pattern of participants' (N=178) choices and reactions throughout the computer-delivered brief intervention, and to examine associations between that process and intervention response at 3-month follow-up. Participants were most likely to choose marijuana as the first substance they wished to discuss (n = 114, 64.0%). Most participants indicated that they had not experienced any problems as a result of their drug use (n = 108, 60.7%), but nearly a third of these (n = 32, 29.6%) nevertheless indicated a desire to stop or reduce its use; participants who did report negative consequences were most likely to endorse financial or relationship concerns. However, participant ratings of the importance of change or of the helpfulness of personalized normed feedback were unrelated to changes in substance use frequency. Design of future e-interventions should consider emphasizing possible benefits of quitting rather than the negative consequences of drug use, and-when addressing consequences-should consider focusing on the impacts of substance use on relationship and financial aspects. These findings are an early but important step toward using process evaluation to optimize e-intervention content.

Engaging Elderly People in Telemedicine Through Gamification

Background

Telemedicine can alleviate the increasing demand for elderly care caused by the rapidly aging population. However, user adherence to technology in telemedicine interventions is low and decreases over time. Therefore, there is a need for methods to increase adherence, specifically of the elderly user. A strategy that has recently emerged to address this problem is gamification. It is the application of game elements to nongame fields to motivate and increase user activity and retention.

Objective

This research aims to (1) provide an overview of existing theoretical frameworks for gamification and explore methods that specifically target the elderly user and (2) explore user classification theories for tailoring game content to the elderly user. This knowledge will provide a foundation for creating a new framework for applying gamification in telemedicine applications to effectively engage the elderly user by increasing and maintaining adherence.

Methods

We performed a broad Internet search using scientific and nonscientific search engines and included information that described either of the following subjects: the conceptualization of gamification, methods to engage elderly users through gamification, or user classification theories for tailored game content.

Results

Our search showed two main approaches concerning frameworks for gamification: from business practices, which mostly aim for more revenue, emerge an applied approach, while academia frameworks are developed incorporating theories on motivation while often aiming for lasting engagement. The search provided limited information regarding the application of gamification to engage elderly users, and a significant gap in knowledge on the effectiveness of a gamified application in practice. Several approaches for classifying users in general were found, based on archetypes and reasons to play, and we present them along with their corresponding taxonomies. The overview we created indicates great connectivity between these taxonomies.

Conclusions

Gamification frameworks have been developed from different backgrounds—business and academia—but rarely target the elderly user. The effectiveness of user classifications for tailored game content in this context is not yet known. As a next step, we propose the development of a framework based on the hypothesized existence of a relation between preference for game content and personality.

Promoting Daily Physical Activity by Means of Mobile Gaming: A Review of the State of the Art

OBJECTIVES

To review mobile games and gaming applications that claim to improve physical activity behavior in daily life.

SEARCH METHODS

We searched PubMed, Web of Science, and the ACM Digital Library and performed a manual search of relevant journals and reference lists. Studies that reported on a mobile game that requires players to perform physical activity in daily life and where the game has specific goals, rules, and feedback mechanisms were included. This excludes non-mobile exergames. Theoretical foundations, game characteristics, and evaluation methodologies were assessed.

RESULTS

In total, 797 articles were identified through the search, of which 11 articles were included. The reviewed studies show that there is limited theoretical foundation for the game development, and most studies used goal setting as a motivation strategy to engage people in playing the game. There was a large variety in game characteristics found, although the majority of the studies used metaphors or avatars to visualize activity, whereas feedback was mostly provided in relation to the goal. Rewards and competition were the most commonly incorporated game elements. The evaluations were focused on feasibility, and clinical evidence is lacking with only two randomized controlled studies found.

CONCLUSIONS

This review provides a first overview of mobile gaming applications to promote daily life physical activity and shows this as a new research area with demonstration of its acceptability and feasibility among the users. Clinical effectiveness and the added value of gaming in changing daily activity behavior have by far not yet been established.

Telerehabilitation and recovery of motor function: a systematic review and meta-analysis

Recent advances in telecommunication technologies have boosted the possibility to deliver rehabilitation via the internet (i.e. telerehabilitation). Several studies have shown that telerehabilitation is effective to improve clinical outcomes in disabling conditions. The aim of this review was to determine whether telerehabilitation was more effective than other modes of delivering rehabilitation to regain motor function, in different populations of patients.We searched PubMed, Embase and the Cochrane library retrieving 2360 records. Twelve studies were included involving different populations (i.e. neurological, total knee arthroplasty (TKA), cardiac) of patients. Inconclusive finding were found on the effect of telerehabilitation for neurological patients (SMD = 0.08, CI 95% = -0.13, 0.29), while both for cardiac (SMD = 0.24, CI 95% = 0.04, 0.43) and TKA patients (Timed Up and Go test: MD = -5.17, CI 95% = -9.79, -0.55) the results were in favour of telerehabilitation.Conclusive evidence on the efficacy of telerehabilitation for treatment of motor function, regardless of pathology, was not reached. Nevertheless, a strong positive effect was found for patients following orthopaedic surgery, suggesting that the increased intensity provided by telerehabilitation is a promising option to be offered to patients. More and higher quality research is needed in this field especially with neurological patients.

A telehealth program for self-management of COPD exacerbations and promotion of an active lifestyle: a pilot randomized controlled trial

The objective of this pilot study was to investigate the use of and satisfaction with a chronic obstructive pulmonary disease (COPD) telehealth program applied in both primary and secondary care. The program consisted of four modules: 1) activity coach for ambulant activity monitoring and real-time coaching of daily activity behavior, 2) web-based exercise program for home exercising, 3) self-management of COPD exacerbations via a triage diary on the web portal, including self-treatment of exacerbations, and 4) teleconsultation. Twenty-nine COPD patients were randomly assigned to either the intervention group (telehealth program for 9 months) or the control group (usual care). Page hits on the web portal showed the use of the program, and the Client Satisfaction Questionnaire showed satisfaction with received care. The telehealth program with decision support showed good satisfaction (mean 26.4, maximum score 32). The program was accessed on 86% of the treatment days, especially the diary. Patient adherence with the exercise scheme was low (21%). Health care providers seem to play an important role in patients’ adherence to telehealth in usual care. Future research should focus on full-scale implementation in daily care and investigating technological advances, like gaming, to increase adherence.

A telerehabilitation intervention for patients with Chronic Obstructive Pulmonary Disease: a randomized controlled pilot trial

OBJECTIVE

First, to investigate the effects of a telerehabilitation intervention on health status and activity level of patients with Chronic Obstructive Pulmonary Disease (COPD), compared to usual care. Second, to investigate how patients comply with the intervention and whether compliance is related to treatment outcomes.

DESIGN

a randomized controlled pilot trial

SUBJECTS

Thirty-four patients diagnosed with COPD.

INTERVENTION

The telerehabilitation application consists of an activity coach (3D-accelerometer with smartphone) for ambulant activity registration and real-time feedback, complemented by a web portal with a symptom diary for self-treatment of exacerbations. The intervention group used the application for 4 weeks. The control group received usual care.

MAIN MEASURES

Activity level measured by a pedometer (in steps/day), health status by the Clinical COPD Questionnaire at baseline and after intervention. Compliance was expressed as the time the activity coach was worn.

RESULTS

Fourteen intervention and 16 control patients completed the study. Activity level (steps/day) was not significantly affected by the intervention over time. There was a non-significant difference in improvement in health status between the intervention (-0.34±0.55) and control group (0.02±0.57, p=0.10). Health status significantly improved within the intervention group (p=0.05). The activity coach was used more than prescribed (108%) and compliance was related to the increase in activity level for the first two feedback weeks (r=0.62, p=0.03).

CONCLUSIONS

This pilot study shows the potential of the telerehabilitation intervention: compliance with the activity coach was high, which directly related to an improvement in activity levels.

The patient's perspective of in-home telerehabilitation physiotherapy services following total knee arthroplasty

This study aimed at exploring patients’ perceptions regarding telerehabilitation services received post total knee replacement. In this qualitative embedded single case study, semi-structured interviews were conducted with five patients who had previously received in-home telerehabilitation post total knee arthroplasty. Participants were asked to reflect on their 8-week rehabilitation process and on their experience with the home telerehabilitation program. Interviews were transcribed and a qualitative thematic analysis was conducted. Six overarching themes emerged from the patients’ perceptions: (1) improving access to services with reduced need for transportation; (2) developing a strong therapeutic relationship with therapist while maintaining a sense of personal space; (3) complementing telerehabilitation with in-person visits; (4) providing standardized yet tailored and challenging exercise programs using telerehabilitation; (5) perceived ease-of-use of telerehabilitation equipment; and (6) feeling an ongoing sense of support. Gaining a better understating of the patient’s experience in telerehabilitation will be essential as programs continue to be developed and implemented.

A scenario guideline for designing new teletreatments: a multidisciplinary approach

Lack of user acceptance of telemedicine services is an important barrier to deployment and stresses the need for involving users, i.e. medical professionals. However, the involvement of users in the service development process of telemedicine services is difficult because of (a) the knowledge gap between the expertise of medical and technical experts; (b) the language gap, i.e. the use of different terminologies between the medical and the technical professions; and (c) the methodological gap in applying requirement methods to multidisciplinary scientific matters. We have developed a guideline in which the medical and technical domains meet. The guideline can be used to develop a scenario from which requirements can be elicited. In a retrospective analysis of a myofeedback-based teletreatment service, the technically-oriented People-Activities-Context-Technology (PACT) framework and medically-oriented principles of evidence-based medicine were incorporated into a guideline. The guideline was developed to construct the content of a scenario which describes the new teletreatment service. This allows the different stakeholders to come together and develop the service. Our approach provides an arena for different stakeholders to take part in the early stages of the design process. This should increase the chance of user acceptance and thus adoption of the service being developed.