Evaluating the Usability of Authoring Environments for Serious Games

Iterative Development of a Digital Game-Based Learning Concept: Introduction of Veterinary Herd Health Management in a Virtual Pig Herd

A growing interest in the use of digital game-based learning has been identified in veterinary education. Projects in the development of veterinary game-based environments and scenarios are mostly initiated by veterinary institutions, faculties, or instructors; however, the process of development is complex and often involves expertise from a variety of disciplines. In the collaboration between professionals, discussions often arise about content, and how specific elements should be implemented or edited. As discussions are based on the individual experts' varied disciplines, it can be difficult to achieve a common language, and this leads to blockage and frustration in the development process. In 2012, the University of Copenhagen launched a project on digital game-based learning aimed at veterinary and agriculture students. The overall goal was to develop learning games for herd health management in pig production. The project was carried out in a collaboration between professional game developers, educational/didactic experts, and veterinarians. From early in the process, we identified a need to communicate across disciplines. Therefore, the framework of the Serious Game Development Triangle (SDT) was developed as a tool to facilitate a common language for solving complex issues. The SDT consists of three orientations: games, school, and professionalism. These three orientations are topics that are required considerations when developing a serious game that seeks to teach skills for a specific profession. The SDT contributed to improved understanding across disciplines and made the development process more progressive.

Developing Theory-Driven, Evidence-Based Serious Games for Health: Framework Based on Research Community Insights

Background

The idea of using serious games to effectuate better outcomes in health care has gained significant traction among a growing community of researchers, developers, and health care professionals. Many now recognize the importance of creating evidence-based games that are purposefully designed to address physical and mental health challenges faced by end users. To date, no regulatory resources have been established to guide the development of serious games for health (SGH). Developers must therefore look elsewhere for guidance. Although a more robust level of evidence exists in the research literature, it is neither structured nor is there any clear consensus. Developers currently use a variety of approaches and methodologies. The establishment of a well-defined framework that represents the consensus views of the SGH research community would help developers improve the efficiency of internal development processes, as well as chances of success. A consensus framework would also enhance the credibility of SGH and help provide quality evidence of their effectiveness.

Objective

This research aimed to (1) identify and evaluate the requirements, recommendations, and guidelines proposed by the SGH community in the research literature, and; (2) develop a consensus framework to guide developers, designers, researchers, and health care professionals in the development of evidence-based SGH.

Methods

A critical review of the literature was performed in October to November 2018. A 3-step search strategy and a predefined set of inclusion criteria were used to identify relevant articles in PubMed, ScienceDirect, Institute of Electrical and Electronics Engineers Xplore, CiteSeerX, and Google Scholar. A supplemental search of publications from regulatory authorities was conducted to capture their specific requirements. Three researchers independently evaluated the identified articles. The evidence was coded and categorized for analysis.

Results

This review identified 5 categories of high-level requirements and 20 low-level requirements suggested by the SGH community. These advocate a methodological approach that is multidisciplinary, iterative, and participatory. On the basis of the requirements identified, we propose a framework for developing theory-driven, evidence-based SGH. It comprises 5 stages that are informed by various stakeholders. It focuses on building strong scientific and design foundations that guide the creative and technical development. It includes quantitative trials to evaluate whether the SGH achieve the intended outcomes, as well as efforts to disseminate trial findings and follow-up monitoring after the SGH are rolled out for use.

Conclusions

This review resulted in the formulation of a framework for developing theory-driven, evidence-based SGH that represents many of the requirements set out by SGH stakeholders in the literature. It covers all aspects of the development process (scientific, technological, and design) and is transparently described in sufficient detail to allow SGH stakeholders to implement it in a wide variety of projects, irrespective of discipline, health care segments, or focus.