Longitudinal Invariance Testing Of The Knee Injury Osteoarthritis Outcome Score For Joint Replacement Scale (KOOS-JR)

Background

The Knee Osteoarthritis Outcome Score for Joint Replacement (KOOS-JR) is a seven-item patient reported outcome measure used to assess perceived knee health. Though commonly used, the longitudinal psychometric properties of the KOOS-JR have not been established and further characterization of its structural validity and multi-group invariance properties is warranted.

Purpose

The purpose of this study was to evaluate psychometric properties of the KOOS-JR in a large sample of patients who received care for knee pathology.

Study Design

Original research.

Methods

Longitudinal data extracted from the Surgical Outcome System (SOS) database of 13,470 knee pathology patients who completed the KOOS-JR at baseline, three-months, six- months, and one-year. Scale structure was assessed with confirmatory factor analysis (CFA), while multi-group and longitudinal invariance properties were assessed with CFA-based procedures. Latent group means were compared with statistical significance set at α ≤ .05 and Cohen's d effect size as d = 0.2 (small), d = 0.5 (medium), and d = 0.8 (large).

Results

CFA results exceeded goodness-of-fit indices at all timepoints. Multi-group invariance properties passed test requirements. Longitudinal analysis identified a biased item resulting in removal of item #1; the retained six-item model (KOOS-JR-6) passed longitudinal invariance requirements. KOOS-JR-6 scores significantly changed over time (p ≤ .001, Mdiff = 1.08, Cohen's d = 0.57): the highest scores were at baseline examination and the lowest at 12-month assessment.

Conclusions

The KOOS-JR can be used to assess baseline differences between males and females, middle and older aged adults, and patients receiving total knee arthroplasty or non-operative care. Caution is warranted if the KOOS-JR is used longitudinally due to potential measurement error associated with item #1. The KOOS-JR-6 may be a more viable option to assess change over time; however, more research is warranted.

Level of Evidence

3© The Author(s).

Pedi-IKDC exhibits questionable measurement properties in a cohort of pediatric patients with ACL rupture

BACKGROUND

Pedi-IKDC is commonly used to evaluate anterior cruciate ligament (ACL) deficiency in children. However, its construct validity has not been thoroughly assessed. The aim was to examine the measurement properties of the Pediatric International Knee Documentation Committee (Pedi-IKDC) by modern test theory (MTT) models, confirmatory factor analysis (CFA), and item response theory (IRT).

METHODS

The cohort consisted of all children and adolescents in Denmark (n = 535, age 9-16) treated with physeal-sparing ACL reconstruction 2011-2020. Patient-reported outcome measure (PROM) data were collected before surgery and at 1 year follow-up. Structural validity of Pedi-IKDC was assessed with MTT models. Reliability was reported as McDonalds coefficient omega. Responsiveness was evaluated with standardized response means.

RESULTS

Sufficient PROM data were available for 372 patients. The original unidimensional construct did not fit CFA model expectations neither before surgery (χ2  = 462.0, df = 163, p < 0.0001; RMSEA: 0.109, CFI: 0.910, TFI: 0.895) nor at follow-up. Neither did a two-factor CFA model with "Symptoms" and "Sports activities" as individual subscales (χ2  = 455.6, df = 162, p < 0.0001) nor a bifactor model (χ2  = 338.9, df = 143, p < 0.0001), although fit indices improved with the latter (RMSEA: 0.094, CFI: 0.941, TFI: 0.922). The IRT models confirmed this pattern. The scale was responsive (SRM 1.66 (95% CI: 1.46-1.88)). Coefficient omega values were 0.866 before surgery and 0.919 at follow-up.

CONCLUSIONS

The Pedi-IKDC exhibited inadequate structural validity. Neither the original construct, a two-factor model, nor bifactor models fitted data well. We advise that data obtained by Pedi-IKDC are interpreted with caution.

Measurement invariance of the patient health questionnaire-9 depression scale in a nationally representative population-based sample

The Patient Health Questionnaire-9 (PHQ-9) is widely used to measure the severity of depressive symptoms and to screen for depressive disorder, but its measurement invariance has received little research attention. The aim of this study was to assess the measurement invariance of the PHQ-9 across various sociodemographic and medical-condition groups. The structural validity and internal consistency of the PHQ-9 were also assessed as the prerequisite properties for measurement invariance. This study was conducted using data from the Korea National Health and Nutrition Examination Survey. The included participants comprised 5,347 people older than 19 years. Exploratory graph analysis (EGA) and confirmatory factor analysis (CFA) were performed to determine structural validity, and the omega coefficient (ω ) was used to determine internal consistency. Measurement invariance (configural, metric, and scalar invariance) was evaluated using multigroup confirmatory factor analysis (MGCFA). The single structural model of the PHQ-9 that was validated by EGA was also satisfactory with fit indices of χ2 = 770.765 (p < 0.001), CFI = 0.944, SRMR = 0.040, and RMSEA = 0.076 (90% CI = 0.072-0.081). The ω of the PHQ-9 was 0.812, implying satisfactory internal consistency. The one-factor PHQ-9 had equivalent overall structure, factor loadings, and item intercepts across age groups, suggesting invariance across ages. Partial scalar invariance was demonstrated across sex and marital-status groups. Partial metric and scalar invariance were supported across education groups. Scalar invariance was supported among all of the medical-condition (hypertension, diabetes, cancer, arthritis, asthma, and heart disease) groups. Overall, the measurement invariance of the one-factor PHQ-9 was empirically supported across sociodemographic and medical-condition groups. The PHQ-9 can be reliably used to compare the severity of depressive symptoms across these groups in research and practice.

Evaluating Psychometric Properties of the International Knee Documentation Committee Subjective Knee Form in a Heterogeneous Sample of Post-Operative Patients

Background

The International Knee Document Committee Subjective Knee Form (IKDC-SKF) is a patient-reported outcome measure used in orthopedics and sports medicine. Further psychometric assessment is necessary to confirm measurement properties in a large, heterogenous sample.

Purpose

The purpose of the study was to assess the psychometric properties of the IKDC-SKF in a large, heterogenous sample.

Study Design

Cross-Sectional Study.

Methods

An exploratory factor analysis (EFA) was conducted to identify a sound latent structure and to assess internal consistency in a large sample of patients who underwent knee arthroscopy. A confirmatory factor analysis (CFA) was conducted to confirm structural validity. Multi-group invariance was conducted to assess factorial stability across sex and age groups, while longitudinal invariance procedures were performed to assess stability over time.

Results

A 3-factor, 9-item IKDC-SKF short form was identified with EFA procedures. The model was confirmed with CFA (CFI = 0.983; TLI = 0.975; IFI = 0.983; RMSEA = 0.057), while a sound 2-factor, 6-item model was also identified (CFI = 1.0; TLI = 0.999; IFI = 1.0; RMSEA = 0.11). The 9-item IKDC-SKF short form was invariant across groups but not time; removal of a single item (i.e., 8-item IKDC-SKF short form) resulted in longitudinal invariance. The 6-item IKDC-SKF short form was invariant across groups and time.

Conclusion

The 6-item, 8-item, and 9-item short form versions of the IKDC-SKF exceed contemporary fit recommendations and present as plausible alternatives to the IKDC-SKF with improved measurement properties, reduced scale response burden, and evidence of multi-group and longitudinal invariance. Further, the 6- and 8-item IKDC-SKF short forms may be used to assess group differences or change across time.# Level of evidence hereLevel 3©The Author(s).

Measuring Depression in Young Adults: Preliminary Development of an English Version of the Teate Depression Inventory

Depression is a common and debilitating condition that impacts individuals with various cultural backgrounds, medical conditions, and life circumstances. Thus, assessment tools need to be useful among different cultural groups. The 21-item Teate Depression Inventory (TDI) was developed in Italy, is designed to assess major depression, and focuses on cognitive and affective rather than somatic symptoms. This study aims to examine the factor structure and concurrent validity of the TDI English version among a non-clinical population in the United States. Participants included 398 adults (mean age 19.89 years, SD = 2.72, range: 18 to 46 years old) who completed the TDI and The Center for Epidemiologic Studies Depression Scale-Revised (CESD-R). The results supported a three-factor bifactor structure of the TDI (Positive Affect, Negative Affect, and Daily Functioning), which largely corresponds to the Tripartite Model of affective disorders. These findings support the use of TDI scores as measures of depressive symptoms among U.S. young adults, offering researchers and practitioners a brief and useful tool.

The Ten-Item Personality Inventory (TIPI): a scoping review of versions, translations and psychometric properties

Background

The Ten-Item Personality Inventory (TIPI) is a brief instrument designed to assess the five-factor model (FFM) personality dimensions. It was specifically developed to provide a brief assessment option in situations where using more comprehensive FFM instruments would be unfeasible. The TIPI enjoys widespread use and has been translated into several different languages.

Objective

The aim of this scoping review was to generate an overview of different versions of the TIPI, and their psychometric properties in terms of two aspects of validity (convergent and structural) and two aspects of reliability (internal consistency and test-retest reliability).

Methods

Four databases (PsycINFO, PubPsych, Medline, and Web of Science) were searched for studies exploring psychometric properties of the TIPI (original and/or translated or revised versions), published in English as full-text original research articles. Additionally, manual searches were conducted on the official TIPI website and in reference lists. Studies who utilized the TIPI simply as a measure, without an aim of testing its psychometric properties, were excluded. A descriptive-analytical approach was utilized to generate overviews of available TIPI versions and their psychometric properties.

Results

In a total of 29 studies, 27 versions of the TIPI were identified, covering 18 different languages. Across versions, and evaluated against conventions of acceptable psychometric properties, the TIPI demonstrated acceptable test-retest reliability, somewhat mixed results for convergent and structural validity, and inappropriate internal consistency.

Conclusion

Being a brief instrument, the TIPI is unsurprisingly characterized by certain psychometric shortcomings. However, the TIPI may represent a feasible compromise in instances where it is necessary to strike a balance between maximizing psychometric properties and minimizing survey length.

Reliability and Validity of Non-Instrumental Clinical Assessments for Adults with Oropharyngeal Dysphagia: A Systematic Review

This systematic review on non-instrumental clinical assessment in adult oropharyngeal dysphagia (OD) provides an overview of published measures with reported reliability and validity. In alignment with PRISMA, four databases (CINAHL, Embase, PsycINFO, and PubMed) were searched, resulting in a total of 16 measures and 32 psychometric studies included. The included measures assessed any aspect of swallowing, consisted of at least one specific subscale relating to swallowing, were developed by clinical observation, targeted adults, and were developed in English. The included psychometric studies focused on adults, reported on measures for OD-related conditions, described non-instrumental clinical assessments, reported on validity or reliability, and were published in English. Methodological quality was assessed using the standard quality assessment QualSyst. Most measures targeted only restricted subdomains within the conceptual framework of non-instrumental clinical assessments. Across the 16 measures, hypothesis testing and reliability were the most reported psychometrics, whilst structural validity and content validity were the least reported. Overall, data on the reliability and validity of the included measures proved incomplete and frequently did not meet current psychometric standards. Future research should focus on the development of comprehensive non-instrumental clinical assessments for adults with OD using contemporary psychometric research methods.

Assessment of a Novel Instrument Measuring Perceived Physical Education Teachers' In-Class Skills

Physical Education (PE) teachers' professional and personal skills may not only affect the quality of the teaching-learning processes in PE, but also individuals' future active/inactive behaviors. The aim of this study is to examine the structure of a pool of items developed for measuring individuals' perception of such skills in PE teachers. Exploratory Factorial Analysis and a following structural modeling test on data collected from 660 participants suggest a two-factor structural model for the 10 items considered (χ² = 191.155; df = 34; CFI = 0.953, and SRMR = 0.0529), with good internal consistency for both factors (factor 1: alpha = 0.879; omega = 0.878; factor 2: alpha = 0.850, and omega = 0.858) and the overall instrument (alpha = 0.892; omega = 0.895). The final "Teachers' Personal and Professional Skills Questionnaire" is a valid instrument that may be used alone or in combination with other instruments for the analysis of the quality of teaching-learning processes in PE environments and its impact on individuals' behaviors regarding physical activity in their adult life.

Validation of the Tilburg Pregnancy Distress Scale among pregnant women in Capricorn District, South Africa

BACKGROUND

The Tilburg Pregnancy Distress Scale (TPDS) was developed to measure pregnancy-specific psychological distress among pregnant women.

METHOD

The present study evaluated the psychometric properties of the TPDS in a South African location. Analysis was conducted using data obtained from a sample of 205 participants (average age = 27.69 years [SD = 5.977], average gestation weeks = 25.37 weeks [SD = 8.448]; domicile = 63% rural) attending their antenatal check-ups at various medical health facilities in the Capricorn District, Limpopo Province. The analysis involved structural and convergent validation.

RESULTS

Fit indices showed that the three-factor, second-order solution fitted the data better. The reliability estimates of the main TPDS factors, partner involvement (PI) and negative affect (NA), were good, and were obviously not influenced by gravidity. The associations of the TPDS factors with the Patient Health Questionnaire (PHQ-4) Depression and Anxiety, the Edinburgh Postnatal Depression Scale (EPDS), and the Pregnancy-Related Anxiety Scale (PRAS) were not generally good.

CONCLUSION

The results suggest that in spite of the TPDS having potential to be used in South Africa, further validation studies are required.

An Assessment of the Structural Validity and Measurement Invariance of the Web-Use Skills Scale for Aging Internet Users

Research on digital inequality has found that aging adults are often at risk of digital exclusion. Understanding the validity of survey measures assessing Internet skills in this population is critical to providing the high-quality data needed for effective digital inclusion policy interventions. This cross-validation study examines the structural validity and measurement invariance (across age, gender, and education groups) of the Web-Use Skills scale (WUS), which is commonly used as a proxy measure of Internet skills. We tested the 14-item version of the WUS. The scale was translated into the Slovenian language and pretested with older Internet users. Data were collected from two independent samples of Internet users aged 50+ years (N₁ = 259 and N₂ = 256) drawn from an online opt-in panel in Slovenia. The examination of structural validity confirmed that the WUS adequately reflects the one-factor structure of the web-use skills construct, although in a shorter six-item form. Moreover, the analysis confirmed strict measurement invariance between the two samples and, at least, scalar invariance between age, gender, and education groups. The results support the applicability of WUS in cross-group comparisons of Internet skills in the population of aging Internet users and point to several opportunities for future work.

Examining the Structure and Validity of Self-Report Measures of DSM-5 Alternative Model for Personality Disorders Criterion A

The Level of Personality Functioning Scale (LPFS) operationalizes Criterion A of the DSM-5 Alternative Model for Personality Disorders. Despite progress in LPFS measurement development and validation, there is a lack of research, and some disagreement, concerning structural, convergent, and incremental validity of LPFS self-report measures. The present study aimed to compare the LPFS Self-Report, LPFS Self-Report of Criterion A, and LPFS Brief Form. Internal structure was assessed through principal component analyses, factor analyses, and bifactor analyses of unidimensionality. Associations with both pathological and basic personality characteristics among the LPFS measures were explored. Incremental validity of LPFS severity in predicting pathological personality outcomes controlling for basic personality traits, and the reverse, were examined. Results suggest a unidimensional structure robustly associated with other pathological personality assessments. LPFS severity and basic personality traits mutually offered unique explanatory power. We discuss the implications of assessing personality pathology using LPFS self-report measures.

Modifying the ASPECT Survey to Support the Validity of Student Perception Data from Different Active Learning Environments

Measuring students' perceptions of active learning activities may provide valuable insight into their engagement and subsequent performance outcomes. A recently published measure, the Assessing Student Engagement in Class Tool (ASPECT), was developed to assess student perceptions of various active learning environments. As such, we sought to use this measure in our courses to assess the students' perceptions of different active learning environments. Initial results analyzed with confirmatory factor analysis (CFA) indicated that the ASPECT did not function as expected in our active learning environments. Therefore, before administration within an introductory biology course that incorporated two types of active learning strategies, additional items were created and the wording of some original items were modified to better align with the structure of each strategy, thereby producing two modified ASPECT (mASPECT) versions. Evidence of response process validity of the data collected was analyzed using cognitive interviews with students, while internal structure validity evidence was assessed through exploratory factor analysis (EFA). When data were collected after a "deliberative democracy" (DD) activity, 17 items were found to contribute to 3 factors related to 'personal effort', 'value of the environment', and 'instructor contribution'. However, data collected after a "clicker" day resulted in 21 items that contributed to 4 factors, 3 of which were similar to the DD activity, and a fourth was related to 'social influence'. Overall, these results suggested that the same measure may not function identically when used within different types of active learning environments, even with the same population, and highlights the need to collect data validity evidence when adopting and/or adapting measures.

Revisiting the Factor Structure of the German WISC-V for Clinical Interpretability: An Exploratory and Confirmatory Approach on the 10 Primary Subtests

With the exception of a recently published study and the analyses provided in the test manual, structural validity is mostly uninvestigated for the German version of the Wechsler Intelligence Scale for Children - Fifth Edition (WISC-V). Therefore, the main aim of the present study was to examine the latent structure of the 10 WISC-V primary subtests on a bifurcated extended population-representative German standardization sample (N=1,646) by conducting both exploratory (EFA; n=823) and confirmatory (CFA; n=823) factor analyses on the original data. Since no more than one salient subtest loading could be found on the Fluid Reasoning (FR) factor in EFA, results indicated a four-factor rather than a five-factor model solution when the extraction of more than two suggested factors was forced. Likewise, a bifactor model with four group factors was found to be slightly superior in CFA. Variance estimation from both EFA and CFA revealed that the general factor dominantly accounted for most of the subtest variance and construct reliability estimates further supported interpretability of the Full Scale Intelligence Quotient (FSIQ). In both EFA and CFA, most group factors explained rather small proportions of common subtest variance and produced low construct replicability estimates, suggesting that the WISC-V primary indexes were of lower interpretive value and should be evaluated with caution. Clinical interpretation should thus be primarily based on the FSIQ and include a comprehensive analysis of the cognitive profile derived from the WISC-V primary indexes rather than analyses of each single primary index.

Internal Consistency and Structural Validity of the Norwegian Translation of the Ten-Item Personality Inventory

Background: The Ten-Item Personality Inventory (TIPI) is a validated brief instrument measuring the five-factor model (FFM) personality dimensions, developed for instances where more comprehensive FFM instruments are impractical to use. The TIPI has been translated into several languages, but psychometric properties of the Norwegian version (N-TIPI) have not been systematically explored. Objectives: This study aimed to explore the psychometric properties of the N-TIPI, in terms of internal consistency and structural validity. Methods: In a cross-sectional study, responses on the N-TIPI were collected from 5,009 Norwegian master graduates. Descriptive statistics for the subscales and correlations between subscales were calculated. Internal consistency was assessed with inter-item correlations, Cronbach's α and Spearman-Brown coefficients. Structural validity was explored with principal component analysis, parallel analysis, and visual scree plot inspection. Results for the N-TIPI were compared with those previously reported for the original TIPI as well as the German, French, Spanish, and Portuguese versions. Results: Compared with the original and non-English versions of TIPI, results for N-TIPI showed comparable subscale rank order of means, standard deviations, and pattern of correlations between subscales, as well as inter-item correlations and Cronbach's α. The 10 N-TIPI items were adequately reduced to five components, theoretically corresponding with the FFM personality domains. Conclusion: The N-TIPI demonstrated acceptable internal consistency and satisfactory structural validity. Although further research is warranted, the instrument stands out as feasible when it is essential to minimize participants' response burden in studies that aim to explore personality as one among several concepts or utilize personality traits as covariates.

A Systematic Review Approach to Find Robust Items of the Zimbardo Time Perspective Inventory

The Zimbardo Time Perspective Inventory (ZTPI) is one of the most well-known and widely used measures of time perspective. Various short versions were proposed to resolve the psychometric problems of the ZTPI. The present study conducted a systematic review to obtain 25 short versions, calculated the frequency of each item of the ZTPI in short versions, and hypothesized that the more frequent the item is, the more robust it becomes. The hypothesis was tested by assessing the structural validity and internal consistency of short forms with high, medium, and low frequent items in Chinese samples (575 children, 407 undergraduates, and 411 older adults). Structural validity and internal consistency analyses showed that the form with more frequent items had better psychometric properties; item frequencies were positively correlated with factor loadings. The results suggest that the systematic review is an effective approach to identify the robust items of the ZTPI. This approach is general and can be the basis to improve the psychometric properties of scales in social science.

Exploratory Factor Analyses of the French WISC-V (WISC-VFR) for Five Age Groups: Analyses Based on the Standardization Sample

This study investigated the factor structure of the French Wechsler Intelligence Scale for Children–Fifth Edition with five standardization sample age groups (6-7, 8-9, 10-11, 12-13, 14-16 years) using hierarchical exploratory factor analysis followed by Schmid–Leiman procedure. The primary research questions included (a) how many French Wechsler Intelligence Scale for Children–Fifth Edition factors should be extracted and retained in each age subgroup, (b) how are subtests associated with the latent factors, (c) was there evidence for the publisher’s claim of five first-order factors and separate Visual Spatial and Fluid Reasoning factors, (d) what proportion of variance was due to general intelligence versus the first-order group ability factors following a Schmid–Leiman procedure, and (e) do results support the age differentiation hypothesis? Results suggested that four factors might be sufficient for all five age groups and results did not support the distinction between Visual Spatial and Fluid Reasoning factors. While the general factor accounted for the largest portions of variance, the four first-order factors accounted for small unique portions of variance. Results did not support the age differentiation hypothesis because the number of factors remained the same across age groups, and there was no change in the percentage of variance accounted for by the general factor across age groups.

Evidence of Validity for a Newly Developed Digital Cognitive Test Battery

Clinical practice still relies heavily on traditional paper-and-pencil testing to assess a patient’s cognitive functions. Digital technology has the potential to be an efficient and powerful alternative, but for many of the existing digital tests and test batteries the psychometric properties have not been properly established. We validated a newly developed digital test battery consisting of digitized versions of conventional neuropsychological tests. Two confirmatory factor analysis models were specified: a model based on traditional neuropsychological theory and expert consensus and one based on the Cattell-Horn-Carroll (CHC) taxonomy. For both models, the outcome measures of the digital tests loaded on the cognitive domains in the same way as established in the neuropsychological literature. Interestingly, no clear distinction could be made between the CHC model and traditional neuropsychological model in terms of model fit. Taken together, these findings provide preliminary evidence for the structural validity of the digital cognitive test battery.

Reliability and Structural Validity of the Movement Assessment Battery for Children-2 in Croatian Preschool Children

Monitoring and assessment of the development of motor skills is an important goal for practitioners in many disciplines as well as researchers interested in motor development. A well-established tool for such purpose is the Movement Assessment Battery for Children Second Edition (MABC-2) which covers three age ranges and contains eight motor items in each range related to the manual dexterity, aiming and catching, and balance. The main aim of the study was to investigate the reliability and validity of the MABC-2 age band one in a sample of Croatian preschool children. Structural validity was assessed using confirmatory factor analysis (CFA). Measures of relative and absolute reliability were established by computing the intraclass correlation coefficients (ICC), standard error of the measurement (SEM), and smallest detectable change (SDC). About 17% of the children of the total sample fall into the categories of motor impairment and risk for impairment, respectively, while 83% were found to be in the category of normally developing children. Intraclass correlation coefficient for the total standard score was 0.79 while individual items, all except one, ranged from 0.70 to 0.83. Drawing trail, but also throwing beanbag and one-leg balance items presented large SEM and SDC values. CFA initially yielded a model with questionable fit to the data. After re-specification, excellent model fit was attained confirming the proposed three-factor model. Satorra–Bentler χ²(26) reached 38.56 (p = 0.054), root mean square error of approximation (RMSEA) was 0.028, non-normed fit index (NNFI) was 0.98, adjusted goodness of fit (AGFI) was 0.97, and standardized root mean residual (SRMR) was 0.030. All the variables loaded significantly, and only two significant standardized residuals have been found. Correlations between the factors were weak, supporting discriminant validity of the test. We found MABC-2 to be an appropriate instrument to assess the development of motor competences of preschool children.

Measurement Invariance Across Gender on the Second-Order Five-Factor Model of the German Wechsler Intelligence Scale for Children-Fifth Edition

The present study investigated measurement invariance across gender on the German Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V). The higher order model that was preferred by the test publishers was tested on a population-representative German sample of 1,411 children and adolescents aged between 6 and 16 years. Confirmatory factor analyses were conducted to test for measurement invariance. As soon as partial scalar invariance could be established by freeing nonequivalent subtest intercepts, results demonstrated that 11 out of 15 subtest scores have the same meaning for male and female children. These findings support interpretable comparisons of the WISC-V test scores between males and females but only in due consideration of partial scalar invariance and with respect to the underlying factor structure. Despite this, however, results did not support the overall structural validity of the higher order model. Thus, replacing the former Perceptual Reasoning factor by Fluid Reasoning and Visual Spatial may be considered inappropriate due to the redundancy of the FRI as a separate factor. Results also indicated that the WISC-V provides stronger measurement of general intelligence (Full Scale IQ) than measurements of cognitive subdomains (WISC-V indexes). Interpretative emphasis should thus be placed on the Full Scale IQ rather than the WISC-V indexes.

Structural validity of the Parenting Daily Hassles Intensity Scale

Although the Parenting Daily Hassles Intensity Scale is a common measure, it has been relatively unclear whether users should employ the 15-item form that quantifies routine parenting hassles on two dimensions of intensity or the 20-item form that assumes a single dimension underlies the responses on the scale. To help address this gap, Bayesian confirmatory factor analysis was used to investigate the structural validity of the 15- and 20-item forms in a sample of 174 mothers with at least one young child ( x ¯  = 6.040, SD = 0.492). Results of the Bayesian analysis did not provide empirical support for either form. A subsequent exploratory factor analysis indicated that six of the hassles that appear to address challenging child behaviour tended to cluster onto one latent factor whereas 11 hassles that appear to speak to routine parenting chores tended to cluster onto a second factor. A follow-up Bayesian analysis indicated that intensity scores can be approximated well under the 17-item form (ppp = 0.124). Accordingly, researchers and clinicians are encouraged to consider the 17-item form when addressing their measurement needs.

Speed Effect Analysis Using the CFA Framework

The paper outlines a method for investigating the speed effect due to a time limit in testing. It is assumed that the time limit enables latent processing speed to influence responses by causing omissions in the case of insufficient speed. Because of processing speed as additional latent source, the customary confirmatory factor model is enlarged by a second latent variable representing latent processing speed. For distinguishing this effect from other method effects, the factor loadings are fixed according to the cumulative normal distribution. With the second latent variable added, confirmatory factor analysis of reasoning data (N=518) including omissions because of a time limit yielded good model fit and discriminated the speed effect from other possible effects due to the item difficulty, the homogeneity of an item subset and the item positions. Because of the crucial role of the cumulative normal distribution for fixing the factor loadings a check of the normality assumption is also reported.

Does the Effect of a Time Limit for Testing Impair Structural Investigations by Means of Confirmatory Factor Models?

The article reports three simulation studies conducted to find out whether the effect of a time limit for testing impairs model fit in investigations of structural validity, whether the representation of the assumed source of the effect prevents impairment of model fit and whether it is possible to identify and discriminate this method effect from another method effect. Omissions due to the time limit for testing were not considered as missing data but as information on the participants' processing speed. In simulated data the presence of a time-limit effect impaired comparative fit index and nonnormed fit index whereas normed chi-square, root mean square error of approximation, and standardized root mean square residual indicated good model fit. The explicit consideration of the effect due to the time limit by an additional component of the model improved model fit. Effect-specific assumptions included in the model of measurement enabled the discrimination of the effect due to the time limit from another possible method effect.

The dribbling agility test as a potential tool for evaluating the dribbling skill in young soccer players

The present study examined the construct validity and reliability of a new dribbling agility test (DAT) that incorporates reactive agility and multiple change of direction. To check its' validity, (a) DAT was performed by four groups (under 10, under 12, under 14 and under 16 yrs) of young soccer players (n = 125 in each group) and (b) a regression analysis was conducted to define the best DAT predictors. The reliability of DAT was assessed with repeated measurements. This test can differentiate the dribbling skill between groups (p < 0.01). Furthermore, 68% of the observed variance in DAT was explained by zigzag dribbling test, Illinois agility test, reaction time and running speed. The test-retest reliability was high in all groups (ICC = 0.77 - 0.90, p < 0.01). It was concluded that DAT can be a potential tool to evaluate the dribbling performance in young soccer players.

What to expect from reliability and validity claims? A pragmatic conception of psychiatric nosology

The reliability and validity of psychiatric diagnoses have always been a major concern. The Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) reliability field trials yielded ambiguous results, with some diagnostic categories scoring well below par. We argue that the emphasis on the reliability of psychiatric diagnoses, which has dominated psychiatric nosology and guided the endeavor of improving the DSM in its consecutive editions, is misguided and lacks in structural validity. In this article, we defend a pragmatic view on psychiatric disease as the most fruitful approach to an understanding of what the categorical distinctions in the DSM (can) represent. Disorders in the DSM are descriptions of clinical pictures and do not necessarily correspond to an identified pathological substrate. Although this is a logical result of the nature of psychiatric disease, it bears important consequences. The various DSM disease categories are not uniform but should be regarded as representing different kinds of disorders, ranging from a separation from normal behavior based on practical grounds to the discrete kind of disorders envisioned by proponents of a strong realistic view. We argue that the explication of kinds of disorders outlined in this article provides interesting perspectives on the problems of reliability and validity that the DSM faces.

second-order structural validity of the Health Literacy Scale in patients with diabetes

OBJECTIVE

The purpose of this study was to determine the structural validity of the Health Literacy Scale (HLS) in Korean patients with diabetes based on the previously reported first-order three-factor and two-factor models and a newly proposed second-order model, to identify which model best represents the structure of the Korean version of the HLS (HLS-K).

METHODS

The HLS was translated from Japanese into Korean using a translation and back-translation technique. A secondary data analysis was used to validate the structure of the HLS. Data were obtained from a cross-sectional survey involving 459 adults with diabetes recruited from outpatient clinics at two university hospitals in South Korea. The structural validity was examined using confirmatory factor analysis. Additionally, the known-groups validity by education level and internal consistency validity were assessed.

RESULTS

The second-order three-factor model of the HLS-K exhibited a good fit to the data, as indicated by χ² /df = 3.891, SRMR = 0.042, GFI = 0.924, RMSEA = 0.079 (90% CI = 0.069-0.090), and CFI = 0.962. The second-order three-factor model empirically demonstrated that both communicative and critical factors explained the variance in the overall health literacy better than did the functional factor. The HLS-K mean score was significantly lower for patients with only elementary school education than for those with higher education levels, implying the presence of known-groups validity. Cronbach's alpha for the total scale was 0.90.

CONCLUSIONS

This study found that the second-order three-factor model of the HLS-K is better than that the original first-order three-factor and first-order two-factor models. Further validation studies are needed to generalise the underlying structure of the instrument in diabetes populations across various cultures.

Posttraumatic growth inventory: factor structure in Spanish-speaking people living with HIV

This cross-sectional study analyzed the factorial structure of the Posttraumatic Growth Inventory (PTGI) in a sample of 304 Spanish-speaking HIV-positive adults. Participants completed the PTGI and a socio-demographic questionnaire. Exploratory factor analysis (EFA) was carried out through structural equations modeling, with a Varimax rotation. Factors with eigenvalues greater than 1 were extracted, and items with loadings higher than .5 on a factor and lower than .4 on the rest were retained. Two confirmatory factor analyses (CFA) were performed to test a hierarchical model and a bifactor model. Reliability analyses were conducted. EFA suggested a three-factor model keeping 11 of the original 21 items. The three factors that emerged were changes in philosophy of life, in the self and in interpersonal relationships. CFAs suggested that only the bifactor model fitted the data. The three factors as well as the global scale showed good reliability. The factor structure of PTGI's scores in our data is consistent with the three dimensions theorized by Tedeschi and Calhoun, which speaks in favor of the construct validity of this measure.

What Does the WRAML2 Core Battery Measure? Utilizing Exploratory and Confirmatory Techniques to Disclose Higher Order Structure

The present study examined the factor structure of the Wide Range Assessment of Memory and Learning-Second Edition (WRAML2) core battery with participants from the normative sample aged 9 to 90 years ( n = 880) using higher order exploratory and confirmatory factor analytic techniques that were not reported in the in the WRAML2 Administration and Technical Manual. Exploratory factor analysis results suggested only one factor, whereas confirmatory factor analysis results favored the three factors posited by the test authors. Although model fit statistics were equivalent for the oblique, indirect hierarchical, and direct hierarchical measurement models, it was determined that the bifactor model best disclosed the influence of latent dimensions on WRAML2 manifest variables. In the three-factor bifactor model, the general factor accounted for 31% of the total variance and 69% of the common variance, whereas the three first-order factors combined accounted for 41% of the total variance and 31% of the common variance. Latent factor reliability coefficients (as estimated by ω_h) indicated that only the general factor was measured with enough precision to warrant confident clinical interpretation. Implications for clinical interpretation of WRAML2 scores and the procedures utilized in the development of related measures are discussed.

Structural Validity of the Pittsburgh Sleep Quality Index in Chinese Undergraduate Students

The purpose of this study was to examine the structural validity of the Pittsburgh Sleep Quality Index (PSQI) in Chinese undergraduate students. A cross-sectional questionnaire survey with 631 Chinese undergraduate students was conducted, and the questionnaire package included a measure of demographic characteristics, PSQI, Chinese editions of Center for Epidemiologic Studies-Depression, State- Trait Anxiety Inventory, Rumination Response Scale, and Perceived Social Support Scale. Results showed that the item “use of sleep medicine” was not suitable for use with this population, that a two-factor model provided the best fit to the data as assessed through confirmatory factor analysis, and that other indices were consistently correlated with the sleep quality but not the sleep efficiency factor.

Internet Addiction Test (IAT): which is the best factorial solution?

BACKGROUND

The Internet Addiction Test (IAT) by Kimberly Young is one of the most utilized diagnostic instruments for Internet addiction. Although many studies have documented psychometric properties of the IAT, consensus on the optimal overall structure of the instrument has yet to emerge since previous analyses yielded markedly different factor analytic results.

OBJECTIVE

The objective of this study was to evaluate the psychometric properties of the Italian version of the IAT, specifically testing the factor structure stability across cultures.

METHODS

In order to determine the dimensional structure underlying the questionnaire, both exploratory and confirmatory factor analyses were performed. The reliability of the questionnaire was computed by the Cronbach alpha coefficient.

RESULTS

Data analyses were conducted on a sample of 485 college students (32.3%, 157/485 males and 67.7%, 328/485 females) with a mean age of 24.05 years (SD 7.3, range 17-47). Results showed 176/485 (36.3%) participants with IAT score from 40 to 69, revealing excessive Internet use, and 11/485 (1.9%) participants with IAT score from 70 to 100, suggesting significant problems because of Internet use. The IAT Italian version showed good psychometric properties, in terms of internal consistency and factorial validity. Alpha values were satisfactory for both the one-factor solution (Cronbach alpha=.91), and the two-factor solution (Cronbach alpha=.88 and Cronbach alpha=.79). The one-factor solution comprised 20 items, explaining 36.18% of the variance. The two-factor solution, accounting for 42.15% of the variance, showed 11 items loading on Factor 1 (Emotional and Cognitive Preoccupation with the Internet) and 7 items on Factor 2 (Loss of Control and Interference with Daily Life). Goodness-of-fit indexes (NNFI: Non-Normed Fit Index; CFI: Comparative Fit Index; RMSEA: Root Mean Square Error of Approximation; SRMR: Standardized Root Mean Square Residual) from confirmatory factor analyses conducted on a random half subsample of participants (n=243) were satisfactory in both factorial solutions: two-factor model (χ²₁₃₂= 354.17, P<.001, χ²/df=2.68, NNFI=.99, CFI=.99, RMSEA=.02 [90% CI 0.000-0.038], and SRMR=.07), and one-factor model (χ²₁₆₉=483.79, P<.001, χ²/df=2.86, NNFI=.98, CFI=.99, RMSEA=.02 [90% CI 0.000-0.039], and SRMR=.07).

CONCLUSIONS

Our study was aimed at determining the most parsimonious and veridical representation of the structure of Internet addiction as measured by the IAT. Based on our findings, support was provided for both single and two-factor models, with slightly strong support for the bidimensionality of the instrument. Given the inconsistency of the factor analytic literature of the IAT, researchers should exercise caution when using the instrument, dividing the scale into factors or subscales. Additional research examining the cross-cultural stability of factor solutions is still needed.