The Potential of Game-Based Digital Biomarkers for Modeling Mental Health

Identifying Game-Based Digital Biomarkers of Cognitive Risk for Adolescent Substance Misuse: Protocol for a Proof-of-Concept Study

BACKGROUND

Adolescents at risk for substance misuse are rarely identified early due to existing barriers to screening that include the lack of time and privacy in clinic settings. Games can be used for screening and thus mitigate these barriers. Performance in a game is influenced by cognitive processes such as working memory and inhibitory control. Deficits in these cognitive processes can increase the risk of substance use. Further, substance misuse affects these cognitive processes and may influence game performance, captured by in-game metrics such as reaction time or time for task completion. Digital biomarkers are measures generated from digital tools that explain underlying health processes and can be used to predict, identify, and monitor health outcomes. As such, in-game performance metrics may represent digital biomarkers of cognitive processes that can offer an objective method for assessing underlying risk for substance misuse.

OBJECTIVE

This is a protocol for a proof-of-concept study to investigate the utility of in-game performance metrics as digital biomarkers of cognitive processes implicated in the development of substance misuse.

METHODS

This study has 2 aims. In aim 1, using previously collected data from 166 adolescents aged 11-14 years, we extracted in-game performance metrics from a video game and are using machine learning methods to determine whether these metrics predict substance misuse. The extraction of in-game performance metrics was guided by literature review of in-game performance metrics and gameplay guidebooks provided by the game developers. In aim 2, using data from a new sample of 30 adolescents playing the same video game, we will test if metrics identified in aim 1 correlate with cognitive processes. Our hypothesis is that in-game performance metrics that are predictive of substance misuse in aim 1 will correlate with poor cognitive function in our second sample.

RESULTS

This study was funded by National Institute on Drug Abuse through the Center for Technology and Behavioral Health Pilot Core in May 2022. To date, we have extracted 285 in-game performance metrics. We obtained institutional review board approval on October 11, 2022. Data collection for aim 2 is ongoing and projected to end in February 2024. Currently, we have enrolled 12 participants. Data analysis for aim 2 will begin once data collection is completed. The results from both aims will be reported in a subsequent publication, expected to be published in late 2024.

CONCLUSIONS

Screening adolescents for substance use is not consistently done due to barriers that include the lack of time. Using games that provide an objective measure to identify adolescents at risk for substance misuse can increase screening rates, early identification, and intervention. The results will inform the utility of in-game performance metrics as digital biomarkers for identifying adolescents at high risk for substance misuse.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46990.

Digital Phenotyping: Data-Driven Psychiatry to Redefine Mental Health

The term "digital phenotype" refers to the digital footprint left by patient-environment interactions. It has potential for both research and clinical applications but challenges our conception of health care by opposing 2 distinct approaches to medicine: one centered on illness with the aim of classifying and curing disease, and the other centered on patients, their personal distress, and their lived experiences. In the context of mental health and psychiatry, the potential benefits of digital phenotyping include creating new avenues for treatment and enabling patients to take control of their own well-being. However, this comes at the cost of sacrificing the fundamental human element of psychotherapy, which is crucial to addressing patients' distress. In this viewpoint paper, we discuss the advances rendered possible by digital phenotyping and highlight the risk that this technology may pose by partially excluding health care professionals from the diagnosis and therapeutic process, thereby foregoing an essential dimension of care. We conclude by setting out concrete recommendations on how to improve current digital phenotyping technology so that it can be harnessed to redefine mental health by empowering patients without alienating them.

The Development of Game-Based Digital Mental Health Interventions: Bridging the Paradigms of Health Care and Entertainment

Game elements are increasingly used to improve user engagement in digital mental health interventions, and specific game mechanics may yield therapeutic effects per se and thereby contribute to digital mental health intervention efficacy. However, only a few commercial game-based interventions are available. We suggest that the key challenge in their development reflects the tension between the 2 underlying paradigms, health care and entertainment, which have disparate goals and processes in digital development. We describe 3 approaches currently used to negotiate the 2 paradigms: the gamification of health care software, designing serious games, and purpose shifting existing entertainment games. We advanced an integrative framework to focus attention on 4 key themes in intervention development: target audience, engagement, mechanisms of action, and health-related effectiveness. On each theme, we show how the 2 paradigms contrast and can complement each other. Finally, we consider the 4 interdependent themes through the new product development phases from concept to production. Our viewpoint provides an integrative synthesis that facilitates the research, design, and development of game-based digital mental health interventions.

Tasting inhibition: A proof-of-concept study of the food stop-signal game

Self-Control is an important skill in everyday life when attention is automatically drawn toward certain stimuli. For instance, food stimuli automatically capture visual attention and are processed preferentially. Therefore, efficient response inhibition is crucial to refrain from careless overeating. In the present proof-of-concept study we use a novel adaptation of a previously evaluated Stop-Signal Game (SSG) to measure reactive, food-specific, response inhibition in healthy adults. We analyzed a sample of 83 participants (60 female, mean age=24.1, mean BMI=21.71kg/m2) split into three groups. In a gamified stop-signal task, participants navigated an avatar in an urban environment toward high-calorie food, low-calorie food, or non-food stimuli in go-trials and were asked to inhibit the approach reaction in stop-trials. Hunger, eating styles, food craving, and impulsivity were assessed via self-reports to investigate their relationship with (food-specific) response inhibition. Results showed that response inhibition (in terms of stop-signal reaction time, SSRT) did not differ between the high-calorie, low-calorie, and non-food SSG which might be explained by characteristics of the sample. However, impulsivity was positively correlated with SSRT in the low-calorie SSG, whereas food-craving and hunger were positively related to response inhibition in the high-calorie SSG. Future studies could build upon the food SSG to measure and train food-specific response inhibition in the treatment of overeating.

Using shoe-mounted inertial sensors and stepping exergames to assess the motor-cognitive status of older adults: A correlational study

Objective

Stepping exergames designed to stimulate physical and cognitive skills can provide important information concerning individuals’ performance. In this study, we investigated the potential of stepping and gameplay metrics to assess the motor-cognitive status of older adults.

Methods

Stepping and gameplay metrics were recorded in a longitudinal study involving 13 older adults with mobility limitations. Game parameters included games’ scores and reaction times. Stepping parameters included length, height, speed, and duration, measured by inertial sensors placed on the shoes while interacting with the exergames. Parameters measured on the first gameplay were correlated against standard cognitive and mobility assessments, including the Montreal Cognitive Assessment (MoCA), gait speed, and the Short Physical Performance Battery. Based on MoCA scores, patients were then stratified into two groups: cognitively impaired and healthy controls. The differences between the two groups were visually inspected, considering their within-game progression over the training period.

Results

Stepping and gameplay metrics had moderate-to-strong correlations with cognitive and mobility performance indicators: faster, longer, and higher steps were associated with better mobility scores; better cognitive games’ scores and reaction times, and longer and faster steps were associated with better cognitive performance. The preliminary visual analysis revealed that the group with cognitive impairment required more time to advance to the next difficulty level, also presenting slower reaction times and stepping speeds when compared to the healthy control group.

Conclusion

Stepping exergames may be useful for assessing the cognitive and motor status of older adults, potentially allowing assessments to be more frequent, affordable, and enjoyable. Further research is required to confirm results in the long term using a larger and more diverse sample.

A dual-task-embedded virtual reality system for intelligent quantitative assessment of cognitive processing speed

Introduction

Processing speed is defined as the ability to quickly process information, which is generally considered as one of the affected cognitive functions of multiple sclerosis and schizophrenia. Paper-pencil type tests are traditionally used in the assessment of processing speed. However, these tests generally need to be conducted under the guidance of clinicians in a specific environment, which limits their application in cognitive assessment or training in daily life. Therefore, this paper proposed an intelligent evaluation method of processing speed to assist clinicians in diagnosis.

Methods

We created an immersive virtual street embedded with Stroop task (VR-Street). The behavior and performance information was obtained by performing the dual-task of street-crossing and Stroop, and a 50-participant dataset was established with the label of standard scale. Utilizing Pearson correlation coefficient to find the relationship between the dual-task features and the cognitive test results, and an intelligent evaluation model was developed using machine learning.

Results

Statistical analysis showed that all Stroop task features were correlated with cognitive test results, and some behavior features also showed correlation. The estimated results showed that the proposed method can estimate the processing speed score with an adequate accuracy (mean absolute error of 0.800, relative accuracy of 0.916 and correlation coefficient of 0.804). The combination of Stroop features and behavior features showed better performance than single task features.

Discussion

The results of this work indicates that the dual-task design in this study better mobilizes participants' attention and cognitive resources, and more fully reflects participants' cognitive processing speed. The proposed method provides a new opportunity for accurate quantitative evaluation of cognitive function through virtual reality.

Extended reality for mental health: Current trends and future challenges

Virtual and augmented reality have been used to diagnose and treat several mental health disorders for decades. Technological advances in these fields have facilitated the availability of commercial solutions for end customers and practitioners. However, there are still some barriers and limitations that prevent these technologies from being widely used by professionals on a daily basis. In addition, the COVID-19 pandemic has exposed a variety of new scenarios in which these technologies could play an essential role, like providing remote treatment. Disorders that traditionally had received less attention are also getting in the spotlight, such as depression or obsessive-compulsive disorder. Improvements in equipment and hardware, like Mixed Reality Head Mounted Displays, could help open new opportunities in the mental health field. Extended reality (XR) is an umbrella term meant to comprise Virtual reality (VR), mixed reality (MR), and augmented reality (AR). While XR applications are eminently visual, other senses are being explored in literature around multisensory interactions, such as auditory, olfactory, or haptic feedback. Applying such stimuli within XR experiences around mental disorders is still under-explored and could greatly enrich the therapeutic experience. This manuscript reviews recent research regarding the use of XR for mental health scenarios, highlighting trends, and potential applications as well as areas for improvement. It also discusses future challenges and research areas in upcoming topics such as the use of wearables, multisensory, and multimodal interaction. The main goal of this paper is to unpack how these technologies could be applied to XR scenarios for mental health to exploit their full potential and follow the path of other health technologies by promoting personalized medicine.

Modern views of machine learning for precision psychiatry

In light of the National Institute of Mental Health (NIMH)'s Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. We further review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We also discuss explainable AI (XAI) and neuromodulation in a closed human-in-the-loop manner and highlight the ML potential in multi-media information extraction and multi-modal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research.

Digital Biomarkers for Well-being Through Exergame Interactions: Exploratory Study

Background

Ecologically valid evaluations of patient states or well-being by means of new technologies is a key issue in contemporary research in health and well-being of the aging population. The in-game metrics generated from the interaction of users with serious games (SG) can potentially be used to predict or characterize a user’s state of health and well-being. There is currently an increasing body of research that investigates the use of measures of interaction with games as digital biomarkers for health and well-being.

Objective

The aim of this paper is to predict well-being digital biomarkers from data collected during interactions with SG, using the values of standard clinical assessment tests as ground truth.

Methods

The data set was gathered during the interaction with patients with Parkinson disease with the webFitForAll exergame platform, an SG engine designed to promote physical activity among older adults, patients, and vulnerable populations. The collected data, referred to as in-game metrics, represent the body movements captured by a 3D sensor camera and translated into game analytics. Standard clinical tests gathered before and after the long-term interaction with exergames (preintervention test vs postintervention test) were used to provide user baselines.

Results

Our results showed that in-game metrics can effectively categorize participants into groups of different cognitive and physical states. Different in-game metrics have higher descriptive values for specific tests and can be used to predict the value range for these tests.

Conclusions

Our results provide encouraging evidence for the value of in-game metrics as digital biomarkers and can boost the analysis of improving in-game metrics to obtain more detailed results.

A computational framework for discovering digital biomarkers of glycemic control

Digital biomarkers can radically transform the standard of care for chronic conditions that are complex to manage. In this work, we propose a scalable computational framework for discovering digital biomarkers of glycemic control. As a feasibility study, we leveraged over 79,000 days of digital data to define objective features, model the impact of each feature, classify glycemic control, and identify the most impactful digital biomarkers. Our research shows that glycemic control varies by age group, and was worse in the youngest population of subjects between the ages of 2–14. In addition, digital biomarkers like prior-day time above range and prior-day time in range, as well as total daily bolus and total daily basal were most predictive of impending glycemic control. With a combination of the top-ranked digital biomarkers, we achieved an average F1 score of 82.4% and 89.7% for classifying next-day glycemic control across two unique datasets.

Digital Biomarkers in Psychiatric Research: Data Protection Qualifications in a Complex Ecosystem

Psychiatric research traditionally relies on subjective observation, which is time-consuming and labor-intensive. The widespread use of digital devices, such as smartphones and wearables, enables the collection and use of vast amounts of user-generated data as "digital biomarkers." These tools may also support increased participation of psychiatric patients in research and, as a result, the production of research results that are meaningful to them. However, sharing mental health data and research results may expose patients to discrimination and stigma risks, thus discouraging participation. To earn and maintain participants' trust, the first essential requirement is to implement an appropriate data governance system with a clear and transparent allocation of data protection duties and responsibilities among the actors involved in the process. These include sponsors, investigators, operators of digital tools, as well as healthcare service providers and biobanks/databanks. While previous works have proposed practical solutions to this end, there is a lack of consideration of positive data protection law issues in the extant literature. To start filling this gap, this paper discusses the GDPR legal qualifications of controller, processor, and joint controllers in the complex ecosystem unfolded by the integration of digital biomarkers in psychiatric research, considering their implications and proposing some general practical recommendations.

Remote Assessment of Depression Using Digital Biomarkers From Cognitive Tasks

We describe the design and evaluation of a sub-clinical digital assessment tool that integrates digital biomarkers of depression. Based on three standard cognitive tasks (D2 Test of Attention, Delayed Matching to Sample Task, Spatial Working Memory Task) on which people with depression have been known to perform differently than a control group, we iteratively designed a digital assessment tool that could be deployed outside of laboratory contexts, in uncontrolled home environments on computer systems with widely varying system characteristics (e.g., displays resolution, input devices). We conducted two online studies, in which participants used the assessment tool in their own homes, and completed subjective questionnaires including the Patient Health Questionnaire (PHQ-9)-a standard self-report tool for assessing depression in clinical contexts. In a first study (n = 269), we demonstrate that each task can be used in isolation to significantly predict PHQ-9 scores. In a second study (n = 90), we replicate these results and further demonstrate that when used in combination, behavioral metrics from the three tasks significantly predicted PHQ-9 scores, even when taking into account demographic factors known to influence depression such as age and gender. A multiple regression model explained 34.4% of variance in PHQ-9 scores with behavioral metrics from each task providing unique and significant contributions to the prediction.

Play the Pain: A Digital Strategy for Play-Oriented Research and Action

The value of understanding patients' illness experience and social contexts for advancing medicine and clinical care is widely acknowledged. However, methodologies for rigorous and inclusive data gathering and integrative analysis of biomedical, cultural, and social factors are limited. In this paper, we propose a digital strategy for large-scale qualitative health research, using play (as a state of being, a communication mode or context, and a set of imaginative, expressive, and game-like activities) as a research method for recursive learning and action planning. Our proposal builds on Gregory Bateson's cybernetic approach to knowledge production. Using chronic pain as an example, we show how pragmatic, structural and cultural constraints that define the relationship of patients to the healthcare system can give rise to conflicted messaging that impedes inclusive health research. We then review existing literature to illustrate how different types of play including games, chatbots, virtual worlds, and creative art making can contribute to research in chronic pain. Inspired by Frederick Steier's application of Bateson's theory to designing a science museum, we propose DiSPORA (Digital Strategy for Play-Oriented Research and Action), a virtual citizen science laboratory which provides a framework for delivering health information, tools for play-based experimentation, and data collection capacity, but is flexible in allowing participants to choose the mode and the extent of their interaction. Combined with other data management platforms used in epidemiological studies of neuropsychiatric illness, DiSPORA offers a tool for large-scale qualitative research, digital phenotyping, and advancing personalized medicine.

The Development of Explicit and Implicit Game-Based Digital Behavioral Markers for the Assessment of Social Anxiety

Social relationships are essential for humans; neglecting our social needs can reduce wellbeing or even lead to the development of more severe issues such as depression or substance dependency. Although essential, some individuals face major challenges in forming and maintaining social relationships due to the experience of social anxiety. The burden of social anxiety can be reduced through accessible assessment that leads to treatment. However, socially anxious individuals who seek help face many barriers stemming from geography, fear, or disparities in access to systems of care. But recent research suggested digital behavioral markers as a way to deliver cheap and easily accessible digital assessment for social anxiety: As earlier work shows, players with social anxiety show similar behaviors in virtual worlds as in the physical world, including tending to walk farther around other avatars and standing farther away from other avatars. The characteristics of the movement behavior in-game can be harnessed for the development of digital behavioral markers for the assessment of social anxiety. In this paper, we investigate whether implicit as well as explicit digital behavioral markers, proposed by prior work, for social anxiety can be used for predicting the level of social anxiety. We show that both, explicit and implicit digital behavioral markers can be harnessed for the assessment. Our findings provide further insights about how game-based digital behavioral markers can be used for the assessment of social anxiety.

Dissecting Digital Card Games to Yield Digital Biomarkers for the Assessment of Mild Cognitive Impairment: Methodological Approach and Exploratory Study

Background

Mild cognitive impairment (MCI), the intermediate cognitive status between normal cognitive decline and pathological decline, is an important clinical construct for signaling possible prodromes of dementia. However, this condition is underdiagnosed. To assist monitoring and screening, digital biomarkers derived from commercial off-the-shelf video games may be of interest. These games maintain player engagement over a longer period of time and support longitudinal measurements of cognitive performance.

Objective

This paper aims to explore how the player actions of Klondike Solitaire relate to cognitive functions and to what extent the digital biomarkers derived from these player actions are indicative of MCI.

Methods

First, 11 experts in the domain of cognitive impairments were asked to correlate 21 player actions to 11 cognitive functions. Expert agreement was verified through intraclass correlation, based on a 2-way, fully crossed design with type consistency. On the basis of these player actions, 23 potential digital biomarkers of performance for Klondike Solitaire were defined. Next, 23 healthy participants and 23 participants living with MCI were asked to play 3 rounds of Klondike Solitaire, which took 17 minutes on average to complete. A generalized linear mixed model analysis was conducted to explore the differences in digital biomarkers between the healthy participants and those living with MCI, while controlling for age, tablet experience, and Klondike Solitaire experience.

Results

All intraclass correlations for player actions and cognitive functions scored higher than 0.75, indicating good to excellent reliability. Furthermore, all player actions had, according to the experts, at least one cognitive function that was on average moderately to strongly correlated to a cognitive function. Of the 23 potential digital biomarkers, 12 (52%) were revealed by the generalized linear mixed model analysis to have sizeable effects and significance levels. The analysis indicates sensitivity of the derived digital biomarkers to MCI.

Conclusions

Commercial off-the-shelf games such as digital card games show potential as a complementary tool for screening and monitoring cognition.

Trial Registration

ClinicalTrials.gov NCT02971124; https://clinicaltrials.gov/ct2/show/NCT02971124

Intercepting Dementia: Awareness and Innovation as Key Tools

Dementia is a common feature of several age-related brain diseases, leading to a progressive cognitive decline. Due to a growing aging rate, dementia-related disorders currently affect around 50 million people worldwide and by 2050 this number is expected to reach 150 million. Additionally to patients, these neurodegenerative pathologies have a strong impact on family members, caretakers, and other health professionals, therefore representing a public health burden that in 2020 accounted for over 1 trillion USD and is projected to nearly double in the next decade. To overcome this devastating condition, many organizations and collaborative networks sustain that only a complete understanding of dementia in its different characteristics can drive the scientific community towards the development of effective therapeutic approaches aiming at preventing its onset and halting its progression.In this work, we discuss two topics that represent fundamental resources in fighting dementia: (i) the importance of raising awareness about this condition to avoid stigma and gauging investment; and (ii) the introduction of novel screening measures to prevent and potentially revert cognitive decline. Finally, we discern how knowledge-based advocacy will help the rollout of clinical trials and the development of novel and timely pharmacological interventions.

A Local Community-Based Social Network for Mental Health and Well-being (Quokka): Exploratory Feasibility Study

BACKGROUND

Developing healthy habits and maintaining prolonged behavior changes are often difficult tasks. Mental health is one of the largest health concerns globally, including for college students.

OBJECTIVE

Our aim was to conduct an exploratory feasibility study of local community-based interventions by developing Quokka, a web platform promoting well-being activity on university campuses. We evaluated the intervention's potential for promotion of local, social, and unfamiliar activities pertaining to healthy habits.

METHODS

To evaluate this framework's potential for increased participation in healthy habits, we conducted a 6-to-8-week feasibility study via a "challenge" across 4 university campuses with a total of 277 participants. We chose a different well-being theme each week, and we conducted weekly surveys to (1) gauge factors that motivated users to complete or not complete the weekly challenge, (2) identify participation trends, and (3) evaluate the feasibility of the intervention to promote local, social, and novel well-being activities. We tested the hypotheses that Quokka participants would self-report participation in more local activities than remote activities for all challenges (Hypothesis H1), more social activities than individual activities (Hypothesis H2), and new rather than familiar activities (Hypothesis H3).

RESULTS

After Bonferroni correction using a Clopper-Pearson binomial proportion confidence interval for one test, we found that there was a strong preference for local activities for all challenge themes. Similarly, users significantly preferred group activities over individual activities (P<.001 for most challenge themes). For most challenge themes, there were not enough data to significantly distinguish a preference toward familiar or new activities (P<.001 for a subset of challenge themes in some schools).

CONCLUSIONS

We find that local community-based well-being interventions such as Quokka can facilitate positive behaviors. We discuss these findings and their implications for the research and design of location-based digital communities for well-being promotion.

A New Characterization of Mental Health Disorders Using Digital Behavioral Data: Evidence from Major Depressive Disorder

Mental health disorders are ambiguously defined and diagnosed. The established diagnosis technique, which is based on structured interviews, questionnaires and data subjectively reported by the patients themselves, leaves the mental health field behind other medical areas. We support these statements with examples from major depressive disorder (MDD). The National Institute of Mental Health (NIMH) launched the Research Domain Criteria (RDoC) project in 2009 as a new framework to investigate psychiatric pathologies from a multidisciplinary point of view. This is a good step in the right direction. Contemporary psychiatry considers mental illnesses as diseases that manifest in the mind and arise from the brain, expressed as a behavioral condition; therefore, we claim that these syndromes should be characterized primarily using behavioral characteristics. We suggest the use of smartphones and wearable devices to passively collect quantified behavioral data from patients by utilizing digital biomarkers of mental disorder symptoms. Various digital biomarkers of MDD symptoms have already been detected, and apps for collecting this longitudinal behavioral data have already been developed. This quantified data can be used to determine a patient’s diagnosis and personalized treatment, and thereby minimize the diagnosis rate of comorbidities. As there is a wide spectrum of human behavior, such a fluidic and personalized approach is essential.

Ethics and Law in Research on Algorithmic and Data-Driven Technology in Mental Health Care: Scoping Review

BACKGROUND

Uncertainty surrounds the ethical and legal implications of algorithmic and data-driven technologies in the mental health context, including technologies characterized as artificial intelligence, machine learning, deep learning, and other forms of automation.

OBJECTIVE

This study aims to survey empirical scholarly literature on the application of algorithmic and data-driven technologies in mental health initiatives to identify the legal and ethical issues that have been raised.

METHODS

We searched for peer-reviewed empirical studies on the application of algorithmic technologies in mental health care in the Scopus, Embase, and Association for Computing Machinery databases. A total of 1078 relevant peer-reviewed applied studies were identified, which were narrowed to 132 empirical research papers for review based on selection criteria. Conventional content analysis was undertaken to address our aims, and this was supplemented by a keyword-in-context analysis.

RESULTS

We grouped the findings into the following five categories of technology: social media (53/132, 40.1%), smartphones (37/132, 28%), sensing technology (20/132, 15.1%), chatbots (5/132, 3.8%), and miscellaneous (17/132, 12.9%). Most initiatives were directed toward detection and diagnosis. Most papers discussed privacy, mainly in terms of respecting the privacy of research participants. There was relatively little discussion of privacy in this context. A small number of studies discussed ethics directly (10/132, 7.6%) and indirectly (10/132, 7.6%). Legal issues were not substantively discussed in any studies, although some legal issues were discussed in passing (7/132, 5.3%), such as the rights of user subjects and privacy law compliance.

CONCLUSIONS

Ethical and legal issues tend to not be explicitly addressed in empirical studies on algorithmic and data-driven technologies in mental health initiatives. Scholars may have considered ethical or legal matters at the ethics committee or institutional review board stage. If so, this consideration seldom appears in published materials in applied research in any detail. The form itself of peer-reviewed papers that detail applied research in this field may well preclude a substantial focus on ethics and law. Regardless, we identified several concerns, including the near-complete lack of involvement of mental health service users, the scant consideration of algorithmic accountability, and the potential for overmedicalization and techno-solutionism. Most papers were published in the computer science field at the pilot or exploratory stages. Thus, these technologies could be appropriated into practice in rarely acknowledged ways, with serious legal and ethical implications.

Detecting Mild Cognitive Impairment via Digital Biomarkers of Cognitive Performance Found in Klondike Solitaire: A Machine-Learning Study

Background

Mild cognitive impairment (MCI) is a condition that entails a slight yet noticeable decline in cognition that exceeds normal age-related changes. Older adults living with MCI have a higher chance of progressing to dementia, which warrants regular cognitive follow-up at memory clinics. However, due to time and resource constraints, this follow-up is conducted at separate moments in time with large intervals in between. Casual games, embedded into the daily life of older adults, may prove to be a less resource-intensive medium that yields continuous and rich data on a patient's cognition.

Objective

To explore whether digital biomarkers of cognitive performance, found in the casual card game Klondike Solitaire, can be used to train machine-learning models to discern games played by older adults living with MCI from their healthy counterparts.

Methods

Digital biomarkers of cognitive performance were captured from 23 healthy older adults and 23 older adults living with MCI, each playing 3 games of Solitaire with 3 different deck shuffles. These 3 deck shuffles were identical for each participant. Using a supervised stratified, 5-fold, cross-validated, machine-learning procedure, 19 different models were trained and optimized for F1 score.

Results

The 3 best performing models, an Extra Trees model, a Gradient Boosting model, and a Nu-Support Vector Model, had a cross-validated F1 training score on the validation set of ≥0.792. The F1 score and AUC of the test set were, respectively, >0.811 and >0.877 for each of these models. These results indicate psychometric properties comparative to common cognitive screening tests.

Conclusion

The results suggest that commercial card games, not developed to address specific mental processes, may be used for measuring cognition. The digital biomarkers derived from Klondike Solitaire show promise and may prove useful to fill the current blind spot between consultations.

Survey on Acceptance of Passive Technology Monitoring for Early Detection of Cognitive Impairment

Introduction

Digital biomarkers may act as a tool for early detection of changes in cognition. It is important to understand public perception of technologies focused on monitoring cognition to better guide the design of these tools and inform patients appropriately about the associated risks and benefits. Health care systems may also play a role in the clinical, legal, and financial implications of such technologies.

Objective

To evaluate public opinion on the use of passive technology for monitoring cognition.

Methods

This was a one-time, Internet-based survey conducted in English and Spanish.

Results

Within the English survey distributed in the USA (n = 173), 58.1% of respondents would be highly likely to agree to passive monitoring of cognition via a smartphone application. Thirty-eight percent of those with a higher degree of experience with technology were likely to agree to monitoring versus 20% of those with less experience with technology (p = 0.003). Sixty-two percent of non-health-care professionals were likely to agree to monitoring versus 45% of health-care workers (p = 0.012). There were significant concerns regarding privacy (p < 0.01). We compared the surveys answered in Spanish in Costa Rica via logistic regression (n = 43, total n = 216), adjusting for age, education level, health-care profession, owning a smartphone, experience with technology, and perception of cognitive decline. Costa Rican/Spanish-speaking respondents were 7 times more likely to select a high probability of agreeing to such a technology (p < 0.01). English-speaking respondents from the USA were 5 times more likely to be concerned about the impact on health insurance (p = 0.001) and life insurance (p = 0.01).

Conclusions

Understanding public perception and ethical implications should guide the design of digital biomarkers for cognition. Privacy and the health-care system in which the participants take part are 2 major factors to be considered. It is the responsibility of researchers to convey the ethical and legal implications of cognition monitoring.

Can digital data diagnose mental health problems? A sociological exploration of 'digital phenotyping'

This paper critically explores the research and development of 'digital phenotyping', which broadly refers to the idea that digital data can measure and predict people's mental health as well as their potential risk for mental ill health. Despite increasing research and efforts to digitally track and predict ill mental health, there has been little sociological and critical engagement with this field. This paper aims to fill this gap by introducing digital phenotyping to the social sciences. We explore the origins of digital phenotyping, the concept of the digital phenotype and its potential for benefit, linking these to broader developments within the field of 'mental health sensing'. We then critically discuss the technology, offering three critiques. First, that there may be assumptions of normality and bias present in the use of algorithms; second, we critique the idea that digital data can act as a proxy for social life; and third that the often biological language employed in this field risks reifying mental health problems. Our aim is not to discredit the scientific work in this area, but rather to call for scientists to remain reflexive in their work, and for more social science engagement in this area.

Connected Mental Health: Systematic Mapping Study

BACKGROUND

Although mental health issues constitute an increasing global burden affecting a large number of people, the mental health care industry is still facing several care delivery barriers such as stigma, education, and cost. Connected mental health (CMH), which refers to the use of information and communication technologies in mental health care, can assist in overcoming these barriers.

OBJECTIVE

The aim of this systematic mapping study is to provide an overview and a structured understanding of CMH literature available in the Scopus database.

METHODS

A total of 289 selected publications were analyzed based on 8 classification criteria: publication year, publication source, research type, contribution type, empirical type, mental health issues, targeted cohort groups, and countries where the empirically evaluated studies were conducted.

RESULTS

The results showed that there was an increasing interest in CMH publications; journals were the main publication channels of the selected papers; exploratory research was the dominant research type; advantages and challenges of the use of technology for mental health care were the most investigated subjects; most of the selected studies had not been evaluated empirically; depression and anxiety were the most addressed mental disorders; young people were the most targeted cohort groups in the selected publications; and Australia, followed by the United States, was the country where most empirically evaluated studies were conducted.

CONCLUSIONS

CMH is a promising research field to present novel approaches to assist in the management, treatment, and diagnosis of mental health issues that can help overcome existing mental health care delivery barriers. Future research should be shifted toward providing evidence-based studies to examine the effectiveness of CMH solutions and identify related issues.

Digital Gamification to Enhance Vaccine Knowledge and Uptake: Scoping Review

BACKGROUND

Vaccine hesitancy is a growing threat to population health, and effective interventions are needed to reduce its frequency. Digital gamification is a promising new approach to tackle this public health issue.

OBJECTIVE

The purpose of this scoping review was to assess the amount and quality of outcomes in studies evaluating gamified digital tools created to increase vaccine knowledge and uptake.

METHODS

We searched for peer-reviewed articles published between July 2009 and August 2019 in PubMed, Google Scholar, Journal of Medical Internet Research, PsycINFO, PsycARTICLES, Psychology and Behavioral Sciences Collection, and SocINDEX. Studies were coded by author, year of publication, country, journal, research design, sample size and characteristics, type of vaccine, theory used, game content, game modality, gamification element(s), data analysis, type of outcomes, and mean quality score. Outcomes were synthesized through the textual narrative synthesis method.

RESULTS

A total of 7 articles met the inclusion criteria and were critically reviewed. Game modalities and gamification elements were diverse, but role play and a reward system were present in all studies. These articles included a mixture of randomized controlled trials, quasi-experimental studies, and studies comprising quantitative and qualitative measures. The majority of the studies were theory-driven. All the identified gamified digital tools were highly appreciated for their usability and were effective in increasing awareness of vaccine benefits and motivation for vaccine uptake.

CONCLUSIONS

Despite the relative paucity of studies on this topic, this scoping review suggests that digital gamification has strong potential for increasing vaccination knowledge and, eventually, vaccination coverage.

Development and Evaluation of Maze-Like Puzzle Games to Assess Cognitive and Motor Function in Aging and Neurodegenerative Diseases

There is currently a need for engaging, user-friendly, and repeatable tasks for assessment of cognitive and motor function in aging and neurodegenerative diseases. This study evaluated the feasibility of a maze-like Numberlink puzzle game in assessing differences in game-based measures of cognition and motor function due to age and neurodegenerative diseases. Fifty-five participants, including young (18-31 years, n = 18), older (64-79 years, n = 14), and oldest adults (86-98 years, n = 14), and patients with Parkinson's (59-76 years, n = 4) and Huntington's disease (HD; 35-66 years, n = 5) played different difficulty levels of the Numberlink puzzle game and completed usability questionnaires and tests for psychomotor, attentional, visuospatial, and constructional and executive function. Analyses of Numberlink game-based cognitive (solving time and errors) and motor [mean velocity and movement direction changes (MDC)] performance metrics revealed statistically significant differences between age groups and between patients with HD and older adults. However, patients with Parkinson's disease (PD) did not differ from older adults. Correlational analyses showed significant associations between game-based performance and movement metrics and performance on neuropsychological tests for psychomotor, attentional, visuospatial, and constructional and executive function. Furthermore, varying characteristics of the Numberlink puzzle game succeeded in creating graded difficulty levels. Findings from this study support recent suggestions that data from a maze-like puzzle game provide potential "digital biomarkers" to assess changes in psychomotor, visuoconstructional, and executive function related to aging and neurodegeneration. In particular, game-based movement measures from the maze-like puzzle Numberlink games are promising as a tool to monitor the progression of motor impairment in neurodegenerative diseases. Further studies are needed to more comprehensively establish the cognitive validity and test-retest reliability of using Numberlink puzzles as a valid cognitive assessment tool.

Validation of a mobile game-based assessment of cognitive control among children and adolescents

Cognitive control is the most fundamental psychological function that underlies the execution of many other psychological functions. A mobile game application could be a useful strategy to evaluate cognitive control in the groups of children and adolescents. Although a serious game that is based on gamification would be an optimal platform for the administration of behavioral and clinical assessments of children and adolescents, most studies on gamification have been conducted among adults and older adults than among children and adolescents. This study aimed to assess cognitive control using a mobile game that used gamification and compared the results to those from traditional neuropsychological tests for children and adolescents. In order to address this objective, this study used a serious game, namely, “CoCon,” which was developed to assess cognitive control in children and adolescents. This study included 100 participants from a community sample (mean age = 11.75 years, ranged from 9 to 16 years, SD = 1.40 years; Male = 59(59%), Female = 41(41%)). The analyses interrogated the relationships among various game behaviors scores of CoCon, the standardized neuropsychological tests (K-WISC-IV, CTT, and Stroop), and self-reporting executive function difficulty questionnaire. As results, a mobile game application-based assessment proved to be a reliable and valid measure of the cognitive control in children and adolescents. The index scores from the CoCon were significantly related to various cognitive control functions and differentiated between the high and low cognitive control groups. Specifically, even though the participants completed the mobile game ‘CoCon’ in their natural habitats, the CoCon scores were comparable to the measures from standard neuropsychological tests. In conclusion, the present findings suggest that mobile games that use advanced technology and sophisticated psychological strategies can serve as a new and expanded platform for the administration of psychological assessments.