Combining qualitative and quantitative methods to analyze serious games outcomes: A pilot study for a new cognitive screening tool

Usability testing of the first prototype of the Memento system: a technological device to promote an independent living in people with dementia

PURPOSE

Assistive technologies have the potential for supporting people with memory complaints in their daily life. User-centered interaction design research helps developers to create systems that are suitable for users. The aim of this work is to describe the methodology and the results of the usability test for the first Memento prototype involving users.

MATERIALS AND METHODS

In each country, 5 subjects with different levels of cognitive reserve and technical proficiency were enrolled in Italy, Austria and Spain, respectively (15 subjects; 6 M; 9 F, age 72.8 ± 10.8 years, MMSE score 25.6 ± 1.6). Observation methods, performance metrics and the System Usability Scale were used to collect data.

RESULTS

The results are presented in terms of design, technical problems, target-group-related challenges and usability perception from the participant perspective. Suggestions for improvement were pointed out by the users. Considering the usability scores interpretation, the first prototype was classified as "OK" and "Good" by users.

CONCLUSIONS

The results of the Lab Trials provide important information on usability and the users' needs in order to improve the Memento prototype and to create a final system to be evaluated during the Field Trials phase of the project.Implication for rehabilitationThe MEMENTO project mission is to improve the quality of life of people in the early and middle stages of dementia, by supporting the management of daily activities that are usually affected by the loss of memory and cognition. The Lab Trial phase is essential to have feedback on the usability of the Memento prototype to allow a better understanding of users' needs and expectations.

Designing Serious Computer Games for People With Moderate and Advanced Dementia: Interdisciplinary Theory-Driven Pilot Study

Background

The field of serious games for people with dementia (PwD) is mostly driven by game-design principals typically applied to games created by and for younger individuals. Little has been done developing serious games to help PwD maintain cognition and to support functionality.

Objectives

We aimed to create a theory-based serious game for PwD, with input from a multi-disciplinary team familiar with aging, dementia, and gaming theory, as well as direct input from end users (the iterative process). Targeting enhanced self-efficacy in daily activities, the goal was to generate a game that is acceptable, accessible and engaging for PwD.

Methods

The theory-driven game development was based on the following learning theories: learning in context, errorless learning, building on capacities, and acknowledging biological changes—all with the aim to boost self-efficacy. The iterative participatory process was used for game screen development with input of 34 PwD and 14 healthy community dwelling older adults, aged over 65 years. Development of game screens was informed by the bio-psychological aging related disabilities (ie, motor, visual, and perception) as well as remaining neuropsychological capacities (ie, implicit memory) of PwD. At the conclusion of the iterative development process, a prototype game with 39 screens was used for a pilot study with 24 PwD and 14 healthy community dwelling older adults. The game was played twice weekly for 10 weeks.

Results

Quantitative analysis showed that the average speed of successful screen completion was significantly longer for PwD compared with healthy older adults. Both PwD and controls showed an equivalent linear increase in the speed for task completion with practice by the third session (P<.02). Most important, the rate of improved processing speed with practice was not statistically different between PwD and controls. This may imply that some form of learning occurred for PwD at a nonsignificantly different rate than for controls. Qualitative results indicate that PwD found the game engaging and fun. Healthy older adults found the game too easy. Increase in self-reported self-efficacy was documented with PwD only.

Conclusions

Our study demonstrated that PwD’s speed improved with practice at the same rate as healthy older adults. This implies that when tasks are designed to match PwD’s abilities, learning ensues. In addition, this pilot study of a serious game, designed for PwD, was accessible, acceptable, and enjoyable for end users. Games designed based on learning theories and input of end users and a multi-disciplinary team familiar with dementia and aging may have the potential of maintaining capacity and improving functionality of PwD. A larger longer study is needed to confirm our findings and evaluate the use of these games in assessing cognitive status and functionality.

Evaluation of a novel Serious Game based assessment tool for patients with Alzheimer's disease

Despite growing interest in developing ecological assessment of difficulties in patients with Alzheimer's disease new methods assessing the cognitive difficulties related to functional activities are missing. To complete current evaluation, the use of Serious Games can be a promising approach as it offers the possibility to recreate a virtual environment with daily living activities and a precise and complete cognitive evaluation. The aim of the present study was to evaluate the usability and the screening potential of a new ecological tool for assessment of cognitive functions in patients with Alzheimer's disease. Eighteen patients with Alzheimer's disease and twenty healthy controls participated to the study. They were asked to complete six daily living virtual tasks assessing several cognitive functions: three navigation tasks, one shopping task, one cooking task and one table preparation task following a one-day scenario. Usability of the game was evaluated through a questionnaire and through the analysis of the computer interactions for the two groups. Furthermore, the performances in terms of time to achieve the task and percentage of completion on the several tasks were recorded. Results indicate that both groups subjectively found the game user friendly and they were objectively able to play the game without computer interactions difficulties. Comparison of the performances between the two groups indicated a significant difference in terms of percentage of achievement of the several tasks and in terms of time they needed to achieve the several tasks. This study suggests that this new Serious Game based assessment tool is a user-friendly and ecological method to evaluate the cognitive abilities related to the difficulties patients can encounter in daily living activities and can be used as a screening tool as it allowed to distinguish Alzheimer's patient's performance from healthy controls.