The Role of AI in Serious Games and Gamification for Health: Scoping Review

BACKGROUND

Artificial intelligence (AI) and game-based methods such as serious games or gamification are both emerging technologies and methodologies in health care. The merging of the two could provide greater advantages, particularly in the field of therapeutic interventions in medicine.

OBJECTIVE

This scoping review sought to generate an overview of the currently existing literature on the connection of AI and game-based approaches in health care. The primary objectives were to cluster studies by disease and health topic addressed, level of care, and AI or games technology.

METHODS

For this scoping review, the databases PubMed, Scopus, IEEE Xplore, Cochrane Library, and PubPsych were comprehensively searched on February 2, 2022. Two independent authors conducted the screening process using Rayyan software (Rayyan Systems Inc). Only original studies published in English since 1992 were eligible for inclusion. The studies had to involve aspects of therapy or education in medicine and the use of AI in combination with game-based approaches. Each publication was coded for basic characteristics, including the population, intervention, comparison, and outcomes (PICO) criteria; the level of evidence; the disease and health issue; the level of care; the game variant; the AI technology; and the function type. Inductive coding was used to identify the patterns, themes, and categories in the data. Individual codings were analyzed and summarized narratively.

RESULTS

A total of 16 papers met all inclusion criteria. Most of the studies (10/16, 63%) were conducted in disease rehabilitation, tackling motion impairment (eg, after stroke or trauma). Another cluster of studies (3/16, 19%) was found in the detection and rehabilitation of cognitive impairment. Machine learning was the main AI technology applied and serious games the main game-based approach used. However, direct interaction between the technologies occurred only in 3 (19%) of the 16 studies. The included studies all show very limited quality evidence. From the patients' and healthy individuals' perspective, generally high usability, motivation, and satisfaction were found.

CONCLUSIONS

The review shows limited quality of evidence for the combination of AI and games in health care. Most of the included studies were nonrandomized pilot studies with few participants (14/16, 88%). This leads to a high risk for a range of biases and limits overall conclusions. However, the first results present a broad scope of possible applications, especially in motion and cognitive impairment, as well as positive perceptions by patients. In future, the development of adaptive game designs with direct interaction between AI and games seems promising and should be a topic for future reviews.

A systematic approach for English education model based on the neural network algorithm

This paper algorithms based on neural network model designed for English education, to develop a model education system with artificial intelligence, summarized the dimensions were can be used for data analysis related indicators. These indicators include not only the contents of the learning behavior, test behavior, cooperation behavior and resource search behavior and other human-computer interaction behavior data, also includes demographic background information, learning ability, learning attitude, and other characteristic data that affect the learning effect. We tried to collect relevant indicators to the maximum extent. An audiovisual fusion method based on Convolutional Neural Network (CNN) is proposed. The independent CNN structure is used to realize independent modeling of audiovisual perception and asynchronous information transmission and obtain the description of audiovisual parallel data in the high-dimensional feature space. Following the shared fully connected structure, it is possible to model the long-term dependence of audiovisual parallel data in a higher dimension. Experiments show that the AVSR system built using a CNN-based audiovisual fusion method can achieve a significant performance improvement, and its recognition error rate is relatively reduced by about 15%. The speech recognition system trained with the cross-domain adaptive method can obtain a significant performance improvement, and its recognition error rate is more than 10% lower than that of the baseline system..

A Study on Design Requirement Development and Satisfaction for Future Virtual World Systems

Virtual worlds have become global platforms connecting millions of people and containing various technologies. For example, No Man’s Sky (nomanssky.com), a cross-platform virtual world, can dynamically and automatically generate content with the progress of user adventure. AltspaceVR (altvr.com) is a social virtual reality platform supporting motion capture through Microsoft’s Kinect, eye tracking, and mixed reality extension. The changes in industrial investment, market revenue, user population, and consumption drive the evolution of virtual-world-related technologies (e.g., computing infrastructure and interaction devices), which turns into new design requirements and thus results in the requirement satisfaction problem in virtual world system architecture design. In this paper, we first study the new or evolving features of virtual worlds and emerging requirements of system development through market/industry trend analysis, including infrastructure mobility, content diversity, function interconnectivity, immersive environment, and intelligent agents. Based on the trend analysis, we propose a new design requirement space. We, then, discuss the requirement satisfaction of existing system architectures and highlight their limitations through a literature review. The feature-based requirement satisfaction comparison of existing system architectures sheds some light on the future virtual world system development to match the changing trends of the user market. At the end of this study, a new architecture from an ongoing research, called Virtual Net, is discussed, which can provide higher resource sufficiency, computing reliability, content persistency, and service credibility.

Gamorithm

Examining games from a fresh perspective we present the idea of game-inspired and game-based algorithms, dubbed gamorithms.

Optimal Skipping Rates: Training Agents with Fine-Grained Control Using Deep Reinforcement Learning

These days game AI is one of the focused and active research areas in artificial intelligence because computer games are the best test-beds for testing theoretical ideas in AI before practically applying them in real life world. Similarly, ViZDoom is a game artificial intelligence research platform based on Doom used for visual deep reinforcement learning in 3D game environments such as first-person shooters (FPS). While training, the speed of the learning agent greatly depends on the number of frames the agent is permitted to skip. In this paper, how the frame skipping rate influences the agent’s learning and final performance is proposed, particularly using deep Q-learning, experience replay memory, and the ViZDoom Game AI research platform. The agent is trained and tested on Doom’s basic scenario(s) where the results are compared and found to be 10% better compared to the existing state-of-the-art research work on Doom-based agents. The experiments show that the profitable and optimal frame skipping rate falls in the range of 3 to 11 that provides the best balance between the learning speed and the final performance of the agent which exhibits human-like behavior and outperforms an average human player and inbuilt game agents.