Measuring Internet Gaming Disorder and Gaming Disorder: A Qualitative Content Validity Analysis of Validated Scales

The nature and characteristics of problem gaming, with a focus on ICD-11 diagnoses

PURPOSE OF REVIEW

This review describes the diagnoses related to problem gaming that are included in ICD-11, published by the WHO in 2022. It summarizes the recent literature on the prevalence of Gaming Disorder, its structure, antecedents and comorbidities, and explores whether the range of diagnoses currently available adequately covers the range of experiences seen with problem gaming.

RECENT FINDINGS

Overall, between 3 and 6% of the population worldwide are reported to have a gaming disorder as defined by ICD-11 or DSM-5. However, most studies are constrained by methodological issues such as nonrepresentative samples and the use of brief questionnaires to determine prevalence. ICD-11 Gaming Disorder is a psychometrically sound diagnosis. There is no diagnosis that currently captures the experience of harm from gaming, where the requirements for the diagnosis of Gaming Disorder are not reached.

SUMMARY

There is evidence in support of the proposed new entity of 'Harmful Gaming', which encompasses mental and physical harm/impairment due to a repeated pattern of gaming, but where requirements for the diagnosis of Gaming Disorder are not met. Such a diagnosis would complete the spectrum of diagnoses available for problem or unhealthy gaming, similar to those for unhealthy substance use, and would provide a framework for a public health approach to reducing the overall harm from unhealthy gaming.

Network analysis of additional clinical features of (Internet) gaming disorder

OBJECTIVES

There are dozens of screening instruments purporting to measure the (Internet) gaming disorder (IGD/GD). The two prominent diagnostic manuals, DSM-5 and ICD-11, list several additional diagnostic or clinical features and problems (e.g., neglect of sleep, neglect of daily duties, health deterioration) that should co-occur or be caused by the IGD/GD. It remains unclear how specific IGD/GD operationalizations (different screening scales) are related to these functional impairments.

METHODS

To explore this, data on six measures of IGD/GD (IGDS9-SF, GDSS, GDT, GAMES test, two self-assessments) and 18 additional diagnostic features were collected from a sample of 1009 players who play digital games at least 13 h per week. A network approach was utilized to determine which operationalization is most strongly associated with functional impairment.

RESULTS

In most of the networks, IGD/GD consistently emerged as the most central node.

CONCLUSION

The similar centrality of IGD/GD, irrespective of its definition (DSM-5 or ICD-11) or operationalization, provides support for the valid comparison or synthesis of results from studies that used instruments coming from both DSM-5 and ICD-11 ontologies, but only if the goal is to evaluate IGD/GD relationships to other phenomena, not the relationships between the symptoms themselves.

Gaming disorder test: Assessing psychometric properties, prevalence, temporal stability, and invariance using a Czech two-time-point longitudinal sample

In 2019, Gaming Disorder (GD) was acknowledged as an official diagnosis by the World Health Organization. The Gaming Disorder Test (GDT) is the most widely used tool to measure GD; however, due to its novelty, various measurement properties are still unexplored, and the number of validated language variants is still limited. The present study is the first to assess the psychometric properties of the Czech version of the GDT. Further, it focuses on its temporal prevalence and stability, gaming genre invariance, and criterion validity. A large-scale sample of adult Czech gamers collected at two points within nine months was analysed - T1 N = 5356; T2 N = 6077; longitudinal sample N = 1430. Confirmatory factor analysis (CFA), structural equation modelling (SEM), and multigroup CFA were employed to assess the measurement invariance. The study confirmed the one-factor structure of the GDT and showed that it is invariant across preferred gaming genres and the time of data collection. It showed a negative relationship with life satisfaction and a positive relationship with anxiety, even when controlling for their mutual relationships. The prevalence in the longitudinal sample was equal to or below 1.9% in each wave, but only 0.5% in the longitudinal sample (hence n = 7 participants fulfilled in both waves the criteria for GD). The study suggests that the Czech version of the GDT has good psychometric properties, including temporal stability and invariance across gaming genres, so it is suitable for the survey type and epidemiological investigation of the ICD-11's Gaming Disorder.

Low Overlap and High Heterogeneity Across Common Measures of Eating Disorder Pathology: A Content Analysis

This study evaluated symptoms assessed in common measures of eating disorder pathology and tested overlap to evaluate the extent to which measures may be interchangeable. Six measures were included: Bulimia Test-Revised, Eating Attitudes Test-26, Eating Disorder Diagnostic Scale, Eating Disorder Examination Questionnaire, Eating Pathology Symptoms Inventory, and Questionnaire for Eating Disorder Diagnoses. Content overlap was quantitatively estimated using the Jaccard Index. Mean overlap was low (.195), likely due to the wide range of symptoms (87) assessed. The mean overlap of each measure with all others was .117 - .267, and the overlap among individual measures was .083 - .382. Implications of low overlap among measures include variable characterization of eating disorder phenotypes and the risk for lower generalizability of findings due to measurement variability.

Investigating the interplay between gaming disorder and functional impairments in professional esports gaming

The relationship between Gaming Disorder (GD) and the experience of functional impairments has received considerable theoretical attention in the recent past and current diagnostic approaches underscore the centrality of functional impairments as a requirement for GD diagnosis. However, there is limited empirical evidence illuminating the interplay between GD and functional impairments, particularly among specific vulnerable groups. The present study seeks to bridge this gap by investigating an English-speaking sample (N = 5198) comprising an age- and gender-matched group of Professional Gamers (PG, n = 2599) and Non-Professional Gamers (NPG, n = 2599) sub-sampled from a larger sample of 192,260 individuals. The results revealed that PG were at a greater risk for GD compared to NPG as the prevalence rate of GD among PG (3.31%) was significantly higher and almost doubled that of NPG (1.73%), with PG further exhibiting higher overall GD symptom-load and weekly time spent gaming compared to NPG. Furthermore, PG reported experiencing significantly higher frequency of gaming-related functional impairments compared to NPG, with the in particular affected areas for both PG and NPG being 'school and/or work', 'physical health', and 'family', with other key differences emerging in relation to other outcomes. Overall, the present findings show that not only GD symptom-load but also some functional impairment is higher in PG compared to NPG which highlights the need to develop and support prevention and intervention strategies for this at-risk population.

Comparing psychopathological symptoms, life satisfaction, and personality traits between the WHO and APA frameworks of gaming disorder symptoms: A psychometric investigation

INTRODUCTION

The inclusion of Internet Gaming Disorder (IGD) in the fifth revision of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) by the American Psychiatric Association and Gaming Disorder in the 11th revision of the International Classification of Diseases (ICD-11) by the World Health Organization requires consistent psychological measures for reliable estimates. The current study aimed to investigate the psychometric properties of the Gaming Disorder Test (GDT), the Ten-Item Internet Gaming Disorder Test (IGDT-10), and the Five-Item Gaming Disorder Test (GDT-5) and to compare the WHO and the APA frameworks of gaming disorder symptoms in terms of psychopathological symptoms, life satisfaction, and personality traits.

METHODS

A sample of 723 Swedish gamers was recruited (29.8% women, 68.3% men, 1.9% other, Mage  = 29.50 years, SD = 8.91).

RESULTS

The results indicated notable differences regarding the estimated possible risk groups between the two frameworks. However, the association between gaming disorder symptoms and personality traits, life satisfaction, and psychopathological symptoms appeared consistent across the two frameworks. The results showed excellent psychometric properties in support of the one-factor model of the GDT, IGDT-10, and GDT-5, including good reliability estimates (McDonald's omega) and evidence of construct validity. Additionally, the results demonstrated full gender and age measurement invariance of the GDT, IGDT-10, and GDT-5, indicating that gaming disorder symptoms are measured equally across the subgroups.

CONCLUSION

These findings demonstrate that the IGDT-10, GDT-5, and GDT are appropriate measures for assessing gaming disorder symptoms and facilitating future research in Sweden.

Measurement Invariance of the Lemmens Internet Gaming Disorder Scale-9 Across Age, Gender, and Respondents

Although Internet gaming disorder (IGD) has gained increased attention in scientific, clinical, and community contexts, there is still a lack of consensus regarding the best assessment tools (i.e., self-report or other reports) for assessing its symptoms. The present study aimed to investigate the reliability, validity, and measurement invariance of both versions (youth and parent) of The Lemmens Internet Gaming Disorder Scale-9. To achieve this goal, we recruited between June and October 2019 from five Romanian highschools a total of 697 adolescents (11-19 years old) and one of their parents (N = 391). The internal consistency was good in both versions of the instrument (α = 0.772 for the youth version and α = 0.781 for the parent version). Construct validity assessed through confirmatory factor analysis showed support for the one factor structure of the scales, while multigroup confirmatory factor analysis endorsed the invariance across age, gender, and respondents (i.e., parent vs. youth report). The current research identifies both IGD scales to be reliable and valid, arguing for their utility for assessing IGD symptomatology among adolescents. Implications for theory, assessment, and future directions are discussed.

Translation and Validation of the Gaming Disorder Test and Gaming Disorder Scale for Adolescents into Chinese for Taiwanese Young Adults

PURPOSE

To translate and cross-culturally adapt the Gaming Disorder Test (GDT) and Gaming Disorder Scale for Adolescents (GADIS-A) for use in Taiwan and to validate their internal consistency, construct validity, measurement invariance, and convergent validity in Taiwanese young adults.

METHODS

The GDT and GADIS-A were translated into traditional (unsimplified) Chinese characters and culturally adapted according to standard guidelines. A sample of 608 Taiwanese university students were recruited online. All participants completed the GDT, GADIS-A, Internet Gaming Disorder Scale - Short Form (IGDS9-SF), and Depression Anxiety Stress Scale-21 (DASS-21). Internal consistency was assessed using Cronbach's α and McDonald's ω. Factor structure was examined using Confirmatory Factor Analysis (CFA). Measurement invariance in gender was assessed by three nested models in CFA. Convergent validity was determined by calculating Pearson's r among the GDT, GADIS-A, IGDS9-SF, and DASS-21.

RESULTS

The GDT and GADIS-A showed adequate internal consistency (both α and ω = 0.90). The CFA results supported a one-factor structure for the GDT and a two-factor structure for the GADIS-A. Measurement invariance across gender was supported for both the GDT and GADIS-A. The convergent validity of the GDT and GADIS-A were acceptable.

CONCLUSIONS

The Chinese versions of the GDT and GADIS-A are valid and reliable tools that can be used to assess gaming disorder in Taiwanese young adults. Measurement invariance across genders was supported for both tools. The convergent validity of the GDT and GADIS-A were also satisfactory.

Psychometric Assessment and Gender Invariance of the Polish Version of the Gaming Disorder Test

In 2019, Gaming Disorder (GD) was officially recognised by the World Health Organization (WHO) as an official mental health disorder. Currently, the Gaming Disorder Test (GDT) is one of the most widely utilised psychometric tools to assess GD symptoms according to the WHO framework. In this context, the present study aimed to develop the Polish version of the GDT so that this tool can be used within the Polish cultural context. Additionally, the research aimed to ascertain the psychometric properties and appropriateness of the Polish GDT. To achieve this goal, the Polish GDT was investigated in terms of its validity, reliability, and gender measurement invariance through two studies. Accordingly, study 1 recruited a total of 675 gamers (340 female; Meanage = 31.74 years; SD = 7.75 years; range: 15-45 years) and study 2 comprised 575 gamers (275 female; M age = 29.45 years; SD = 4.25 years; range: 18-35 years). A Confirmatory Factor Analysis (CFA) was used to assess psychometric properties of the Polish GDT. The reliability was assessed using Cronbach's alpha, McDonald's omega, and Average Variance Extracted. Gender measurement invariance was investigated using multiple-group CFA, and the unidimensionality was tested using mean of item residual absolute loadings (MIREAL), explained common variance (ECV), and unidimensional congruence (UC). The results of the psychometric analysis showed that the Polish GDT had a one-factor structure. Additionally, the present study demonstrated that the Polish GDT exhibited adequate levels of convergent validity, reliability, and strict gender measurement invariance. These findings suggest that the Polish version of GDT is a suitable psychometric test to assess GD and facilitate research on GD.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11469-022-00929-4.