Confirmatory validation of the patient health questionnaire - 4 (PHQ-4) for gastrointestinal disorders: A large-scale cross-sectional survey

OBJECTIVE

Using the large Rome Foundation Global Epidemiology Survey dataset, the aim of this study was to evaluate the construct and convergent validity and internal consistency of the PHQ-4 across both gastrointestinal and non-gastrointestinal condition cohorts. Another aim was to provide descriptive information about the PHQ-4 including means, confidence intervals and percentage of caseness using a large representative sample.

METHODS

A cross-sectional survey was conducted in 26 countries. Confirmatory factor and internal consistency analyses were conducted across subsamples of patients with gastrointestinal conditions (i.e., disorders of gut-brain interaction [DGBI; any DGBI, individual DGBI, and DGBI region], gastroesophageal reflux disease (GERD), coeliac disease, diverticulitis, inflammatory bowel disease (IBD), cancer anywhere in the gastrointestinal tract, peptic ulcer) and those without a gastrointestinal condition. Convergent validity was also assessed via a series of Pearson's correlation coefficients with PROMIS (physical and mental quality of life), and PHQ-12 (somatisation).

RESULTS

Based on 54,127 participants (50.9% male; mean age 44.34 years) confirmatory factor analysis indicated acceptable to excellent model fits for the PHQ-4 across all subsamples and individual DGBI and DGBI region (Comparative Fit Index >0.950, Tucker-Lewis Index >0.950, Root Mean Squared Error of Approximation <0.05, and Standardised Root Mean Square Residual <0.05). The PHQ-4 was found to demonstrate convergent validity (Pearson's correlation coefficients >±0.4), and good internal consistency (Cronbach's α > 0.75).

CONCLUSIONS

This study provides evidence that the PHQ-4 is a valid and reliable tool for assessing mental health symptomology in both gastrointestinal and non-gastrointestinal cohorts.

Comparison of patient-reported outcomes measurement information system (PROMIS®)-29 and PROMIS global physical and mental health scores

PURPOSE

The Patient-Reported Outcomes Measurement and Information System (PROMIS®): includes the PROMIS-29 physical and mental health summary and the PROMIS global physical and mental health scores. It is unknown how these scores coincide with one another. This study examines whether the scores yield similar or different information.

METHODS

The PROMIS-29 and the PROMIS global health items were administered to 5804 adults from Amazon's Mechanical Turk (MTurk) in 2021-2022 and to 4060 adults in the Ipsos KnowledgePanel (KP) in 2022.

RESULTS

The median age of those in MTurk (KP) was 36 (54) and 53% (50%) were male. Mean T-scores on the PROMIS-29 and PROMIS global physical health scales were similar, but PROMIS global mental health was 3-4 points lower than the PROMIS-29 mental health summary score. Product-moment correlations ranged from 0.69 to 0.81 between the PROMIS-29 physical health and PROMIS global physical health scales and 0.56-0.69 between the mental health scales. Multi-trait multimethod analyses indicated that only a small proportion of the correlations between the two methods of measuring mental health were significantly more highly correlated with one another than correlations between physical and mental health.

CONCLUSIONS

PROMIS-29 and PROMIS global mental health scales provide different information and, therefore, study conclusions may vary depending on which measure is used. Interpretation of results needs to consider that the PROMIS-29 mental health scale is a weighted combination of specific domains while the PROMIS global mental health scale is based on general mental health perceptions. Further comparisons of methods of assessing mental health are needed.

Validating the Hebrew Version of the Modified Dementia Worry Scale (H-MDWS)

The body of knowledge regarding dementia worry - people's sense of threat about developing dementia - is still limited. Additional studies are essential to better understand levels of dementia worry and its correlates, especially in cross-cultural contexts. To reach this goal, it is critical to use structured and valid measures to assess dementia worry and to verify these measures in different languages. Therefore, the aim of the current study was to evaluate the psychometric properties of the Hebrew version of the Modified Dementia Worry Scale (the H-MDWS). A cross-sectional study using an online survey was conducted with 368 Israeli laypeople who were 18 years of age or older (53% women, 76% Jewish, mean age = 40, average years of education = 14). In addition to the H-MDWS, participants were asked to report their fear of Alzheimer's disease (using a dichotomous single item), stigma, health anxiety, and demographic characteristics. Reliability analyses showed that the Cronbach's alpha for the H-MDWS was excellent (α = 0.95). The results of the factor analysis demonstrated that the scale has a unidimensional structure, explaining over 66% of the variance. In addition, we found significant correlations between fear of developing Alzheimer's disease, stigma, and health anxiety, on the one hand, and the H-MDWS on the other. The H-MDWS is a reliable and valid tool for assessing dementia worry. The validation of the tool not only allows expanding the body of knowledge related to dementia worry, but will also allow professionals and caregivers to identify people who are at risk of reporting dementia worry and develop interventions accordingly.

Psychometric properties of the Interpersonal Emotion Regulation Questionnaire in a community sample of the Portuguese population

BACKGROUND

Intrapersonal aspects of emotion regulation have been at the forefront of research, while interpersonal aspects have received less attention. The Interpersonal Emotion Regulation Questionnaire (IERQ) was developed to address this issue. However, this scale was neither adapted nor validated for European Portuguese.

AIMS

The present study aims to adapt the IERQ to European Portuguese and explore the preliminary psychometric properties of the IERQ in a community sample, through confirmatory factor analysis (CFA). Construct validity was further supported by examining convergent validity with ERQ subscales.

METHOD

Using a cross-sectional design, individuals were recruited online. Self-report questionnaires were used, namely the IERQ and the Emotion Regulation Questionnaire (ERQ).

RESULTS

The four-factor structure was confirmed through CFA. IERQ subscales correlated positively with the dimensions of the ERQ of cognitive reappraisal and correlated negatively with experiential suppression.

CONCLUSIONS

This preliminary study showed that the IERQ has adequate psychometric properties in a Portuguese sample and supports that this instrument can be used to assess interpersonal emotion regulation strategies in non-clinical samples.

Exploring the validity of the ASQ-SE for socio-emotional competency screening of a low-risk Asian cohort at 2 years of age

AIMS

To assess the Ages & Stages Questionnaire: Social-Emotional (ASQ-SE)'s concurrent validity in a low-risk Singapore cohort and study its association with maternal mental health status.

METHODS

Concurrent validity of the parent-filled ASQ-SE with Child Behavior Checklist (CBCL1.5-5) was evaluated in 341 children at age 24 months. Data on maternal anxiety and depression were collected using the State-Trait Anxiety Inventory (STAI) and Beck Depression Inventory-Second Version (BDI-II). ASQ-SE cut-off scores based on receiver operating characteristic curve were compared to CBCL scores to derive a local ASQ-SE "at risk" cut-off score. Correlations of ASQ-SE with CBCL scores and with maternal STAI and BDI scores were evaluated using Pearson coefficients.

RESULTS

Using a cut-off score of 51 at 24 months, ASQ-SE had acceptable concurrent validity, with an AUC of 0.819(0.765-0.872), 70 % sensitivity and 79 % specificity. Mothers of children with "at-risk" ASQ-SE scores had significantly higher STAI and BDI-II scores. ASQ-SE had moderate- high correlations (r = 0.32-0.53) (p < .01) with CBCL scores at 24 and 48 months and with maternal mental health status(r = 0.32).

INTERPRETATION

ASQ-SE can be a useful tool for screening child's socio-emotional competence for primary health care use in Singapore Dyadic mental health screening would be helpful in identifying families at risk.

Measuring Developmental Delays: Comparison of Parent Report and Direct Testing

PURPOSE

Developmental assessment is part of a comprehensive autism evaluation. During in-person evaluations, developmental assessment is completed via direct testing by an examiner. In telehealth evaluations, developmental assessment relies on caregiver-report instruments. This study examined correspondence between caregiver report and direct testing of developmental skills.

METHODS

Participants were 93 children, aged 18-42 months, undergoing evaluation for possible autism spectrum disorder (ASD). Caregivers were interviewed with the Developmental Profile, 4th edition (DP-4) via telehealth platform and children were tested in person 2-4 weeks later using the Mullen Scales of Early Learning (MSEL).

RESULTS

Correlations between the DP-4 and MSEL were high (ranging from 0.50 to 0.82) across standard scores, age equivalents, and functional categories, as well as across individual subtests and overall composite scores.

CONCLUSION

The high convergent validity found in this study suggests that the DP-4 provides a suitable proxy for direct developmental testing using the MSEL in the context of telehealth evaluations for ASD in young children, delivering a good estimate of both developmental functioning and presence of delays.

TRIAL REGISTRATION

Data were obtained from registered clinical trial NCT05047224, date of registration 2021-09-07.

Life-Space Mobility: Normative Values From a National Cohort of U.S. Older Adults

BACKGROUND

Life-space mobility, which measures the distance, frequency, and independence achieved as individuals move through their community, is one of the most important contributors to healthy aging. The University of Alabama at Birmingham Life-Space Assessment (LSA) is the most commonly used measure of life-space mobility in older adults, yet U.S. national norms for LSA have not previously been reported. This study reports such norms based on age and sex among community-dwelling older adults.

METHODS

A cross-sectional analysis using data from the national REasons for Geographic and Racial Disparities in Stroke cohort study. LSA data were available for 10 118 Black and White participants over age 50, which were grouped by age (in 5-year increments) and sex, weighted for the U.S. national population. Correlations were calculated between LSA and measures of functional and cognitive impairment and physical performance.

RESULTS

The weighted mean LSA ranged from 102.9 for 50-54-year-old males to 69.5 for males aged 85 and older, and from 102.1 for 50-54-year-old females to 60.1 for females aged 85 and older. LSA was strongly correlated with measures of timed walking, activities of daily living, cognition, depressive symptoms, and quality of life (all p < .001).

CONCLUSIONS

We report U.S. national norms for LSA among community-dwelling Black and White older adults. These norms can serve as a reference tool for determining if clinical and research samples have greater or lesser life-space mobility than typical older adults in the United States for their age and sex.

Validity of the modified Rankin Scale in patients with aneurysmal subarachnoid hemorrhage: a randomized study

PURPOSE

The modified Rankin Scale (mRS), a clinician-reported outcome measure of global disability, has never been validated in patients with aneurysmal subarachnoid hemorrhage (aSAH). The aims of this study are to assess: (1) convergent validity of the mRS; (2) responsiveness of the mRS; and (3) the distribution of mRS scores across patient-reported outcome measures (PROMs).

METHODS

This is a prospective randomized multicenter study. The mRS was scored by a physician for all patients, and subsequently by structured interview for half of the patients and by self-assessment for the other half. All patients completed EuroQoL 5D-5L, RAND-36, Stroke Specific Quality of Life scale (SS-QoL) and Global Perceived Effect (GPE) questionnaires. Convergent validity and responsiveness were assessed by testing hypotheses.

RESULTS

In total, 149 patients with aSAH were included for analysis. The correlation of the mRS with EQ-5D-5L was r = - 0.546, while with RAND-36 physical and mental component scores the correlation was r = - 0.439and r = - 0.574 respectively, and with SS-QoL it was r = - 0.671. Three out of four hypotheses for convergent validity were met. The mRS assessed through structured interviews was more highly correlated with the mental component score than with the physical component score of RAND-36. Improvement in terms of GPE was indicated by 83% of patients; the mean change score of these patients on the mRS was - 0.08 (SD 0.915). None of the hypotheses for responsiveness were met.

CONCLUSION

The results show that the mRS generally correlates with other instruments, as expected, but it lacks responsiveness. A structured interview of the mRS is best for detecting disabling neuropsychological complaints.

REGISTRATION

URL: https://trialsearch.who.int ; Unique identifier: NL7859, Date of first administration: 08-07-2019.

Validation of the Center for Epidemiologic Studies Depression Scale (CES-D) in a Moroccan sample with substance use disorder

BACKGROUND

Transcultural validation studies of depression scales are rare in Morocco. The Center for Epidemiologic Studies Depression Scale (CES-D) is commonly one of the most common and frequently used screening instruments for depressive symptoms, but the scale has not, up to date, been validated in dialect of Arabic in Moroccan contexts. Given the importance of assessing and preventing depressive symptoms in our Moroccan context, this study aims to validate the CES-D, translated, and adapted to the dialect of Arabic and Moroccan culture, in a sample with substance use disorder.

METHODS

The data were analyzed in two successive phases. First, exploratory factor analysis (EFA) was used to assess the factor structure in the pilot sample (N = 140). Then, this structure was confirmed in the validation sample (N = 205) using confirmatory factor analysis (CFA).

RESULTS

Exploratory factor analysis extracted three factors different from the four factors in the original version. Confirmatory factor analysis confirmed the structure of three factors. The fit indices level showed acceptable to good performance of the measurement model. The instrument showed sufficient reliability and convergent validity, as demonstrated by acceptable values of composite reliability (CR = 0.89-0.93) and average variance extracted (AVE = 0.64-0.66), respectively. The square roots of AVE were higher than factor-factor pairs correlations, and the Heterotrait-Monotrait ratio (HTMT) of correlations values was less than 0.85, indicating acceptable discriminant validity.

CONCLUSIONS

Overall reliability and both convergent and discriminant validity tests indicated that the Moroccan dialectal Arabic version of the CES-D had a good performance and may serve as a valid tool for measuring the severity of depression in people with substance use disorder.

The Oxford Utilitarianism Scale: Psychometric properties of a French adaptation (OUS-Fr)

It is well established that one's sense of morality may be readily influenced by one's culture, education, and life situation. Very few psychometric tools are currently available to measure facets of human morality in different cultures. Therefore, the purpose of the present study was to develop a French adaptation of the Oxford Utilitarianism Scale (OUS-Fr) and formally evaluate its validity. The OUS-Fr was developed through a process of back-translation and administered to a sample of 552 participants. Results from exploratory factor analyses revealed a bidimensional structure with satisfactory loadings that was then also supported in the confirmatory factor analysis check. The OUS-Fr scale demonstrated good psychometric properties, with acceptable internal consistency and coherent results in the convergent validity analyses. These findings contribute to morality measurement literature by providing evidence for the reliability and validity of the French adaptation of the OUS. The OUS-Fr can be viewed as a valuable tool for researchers and practitioners for assessing utilitarian tendencies within the French-speaking population, which could pave the way for cross-cultural understandings that are important for fully understanding the intricacies of human morality.

Exploring the structure and psychometric properties of the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) in a representative adult population sample

This article reports the psychometric properties of both full and the abbreviated (Short) Warwick-Edinburgh Mental Well-being Scales (WEMWBS; SWEMWBS) in the Finnish general population. A large cross-sectional dataset (N = 5,335) was collected as part of the nationally representative FinHealth Study in 2017. Exploratory and confirmatory factor analyses of the data evaluated one-, two-, three-, and bi-factorial solutions with a split-half approach. McDonald's omega was used to assess internal consistency and convergent validity was evaluated using four established mental health and well-being scales (BDI-6, GHQ-12, MHI-5, EUROHIS-QOL8). Contrary to previous findings, our results supported a three-factor model of the full scale with separate, yet highly correlated, mental, social, and eudemonic well-being factors. For the SWEMWBS, the bi-factor model showed the best fit, with a strong general mental well-being factor and a weaker specific eudemonic well-being factor. In this sampling context, the social aspect of mental well-being may be considered a separable construct from other mental well-being dimensions and the shorter 7-item version might thus be a preferable option when assessing overall mental well-being.

Validating the PROMIS cognitive function short form in cancer survivors

PURPOSE

The Patient-Reported Outcome Measurement Information System Cognitive Function Short Form 8a  (PROMIS Cog) could provide a shorter, useful alternative to the often used Functional Assessment of Cancer Therapy - Cognition (FACT-Cog) in research and clinical care. This study aimed to determine the convergent validity and internal reliability of the PROMIS Cog in 3 separate samples of breast cancer survivors and to explore clinical cut points.

METHODS

Data from three samples of breast cancer survivors were used for this secondary analysis. Convergent validity was determined by evaluating correlation strength among the derived PROMIS Cog and measures of depression, anxiety, stress, fatigue, sleep, loneliness, the FACT-Cog . Clinical cut-points for the PROMIS Cog were determined by plotting the receiver operating characteristic curves.

RESULTS

3 samples of breast cancer survivors (N = 471, N = 132, N = 90) were included. Absolute values of correlations demonstrating convergent validity ranged from 0.21 to 0.82, p's < 0.001, and were comparable to correlations with the full FACT-Cog 18 item perceived cognitive impairments (PCI) scale. ROC curve plots indicated a clinical cut off < 34 for the combined sample.

CONCLUSION

The 8-item PROMIS Cog demonstrated good convergent validity and internal reliability in breast cancer survivors, comparable to the 18-item FACT-Cog PCI. The PROMIS Cog 8a is a brief self-report measure that can be easily incorporated into cancer-related cognitive impairment research designs or used in clinical settings.

Trait nostalgia: Four scales and a recommendation

We review four established scales for measuring individual differences in trait-level nostalgia: the Nostalgia Inventory, the Southampton Nostalgia Scale, the Nostalgia Prototype Scale, and the Personal Inventory of Nostalgic Experiences. To examine their convergent validity, we re-analyzed data from a published study in which all four scales were administered simultaneously. Multi-group confirmatory factor analyses demonstrated that a one-factor model accurately described the interrelations among the four scales, and supported full metric and partial scalar invariance across U.S. and Chinese samples. When measuring trait nostalgia, we recommend that researchers also consider potential confounders. Specifically, we discuss the importance of controlling for other ways in which individuals habitually reflect on their past, including brooding rumination and upward self-referent counterfactual thinking.

Exploring the validity of the Sydney Burnout Measure

This study aimed to examine the convergent validity of a new measure of burnout, the Sydney Burnout Measure (SBM) by comparison against the field standard measure - the Maslach Burnout Inventory (MBI). A second aim was to consider burnout's association with psychological distress. 1483 dental professionals completed the two burnout measures as well as two measures of psychological distress. The overall correlation between total scores on the two measures (and on shared constructs) was high, and thus the convergent validity of the SBM was supported. Further, the SBM and MBI total scores correlated highly with total scores on the two measures of distress. Exploratory structural equation modelling (ESEM) also identified substantial overlap between the measures, especially in relation to the exhaustion subscales of the burnout measures and their overlap with psychological distress items. While future research is required to determine which burnout measure and its associated burnout definition is most valid, our findings argue for further consideration of how burnout may best be conceptualized, as well as whether the syndrome is worthy of elevation to mental disorder status.

Food addiction and its relationship with other eating behaviours among Spanish university students

BACKGROUND

Food addiction (FA) is characterised by symptoms such as loss of control over food consumption, inability to reduce consumption despite the desire to do so, and continued consumption despite negative consequences. The modified Yale Food Addiction Scale 2.0 (mYFAS 2.0) is a widely used instrument to assess FA.

OBJECTIVES

To validate the Spanish mYFAS 2.0; to analyse the relationships between FA with other eating behaviours, sociodemographic variables, and Body Mass Index (BMI); and to test the eating-related variables that account for the variance in FA.

METHODS

The sample consisted of 400 university students (M_age = 24.16, SD_age = 6.12; 51% female), who completed the mYFAS 2.0 and measures of eating-related constructs.

RESULTS

A confirmatory factor analysis (CFA) supported the one-factor structure of the mYFAS 2.0. The scale showed good internal consistency (α = .78), and good convergent validity with the mYFAS. FA was related to eating styles, binge eating, and bulimia. No differences in FA were observed between males and females, and there was no association between FA and BMI. In addition, younger participants scored higher on FA than older participants. The eating-related variables explain 54.7% of the variance in FA.

CONCLUSIONS

The mYFAS 2.0 is a valid and reliable scale to assess FA in the Spanish population. The positive and significant relationship of variables related to eating (eating styles, binge eating and bulimia) with FA was demonstrated. These variables were indicated by those at high risk of FA.

Responsiveness and construct validity of EPIC-26, AQoL-6D and SF-6D following treatment in prostate cancer

PURPOSE

To assess construct validity and responsiveness of the Expanded Prostate Cancer Index Composite Instrument (EPIC-26) relative to the Short-Form Six-Dimension (SF-6D) and Assessment of Quality of Life 6-Dimension (AQoL-6D) in patients following treatment for prostate cancer.

METHODS

Retrospective prostate cancer registry data were used. The SF-6D, AQoL-6D, and EPIC-26 were collected at baseline and one year post treatment. Analyses were based on Spearman's correlation coefficient, Bland-Altman plots and intra-class correlation coefficient, Kruskal Wallis, and Effect Size and the Standardised Response Mean for responsiveness.

RESULTS

The study sample was comprised of 1915 patients. Complete case analysis of 3,697 observations showed moderate evidence of convergent validity between EPIC-26 vitality/hormonal domain and AQoL-6D (r = 0.45 and 0.54) and SF-6D (r = 0.52 and 0.56) at both timepoints. Vitality/hormonal domain also showed moderate convergent validity with coping domain of AQoL-6D (r = 0.45 and 0.54) and with role (r = 0.41 and 0.49) and social function (r = 0.47 and 0.50) domains of SF-6D at both timepoints, and with independent living (r = 0.40) and mental health (r = 0.43) of AQoL-6D at one year. EPIC-26 sexual domain had moderate convergent validity with relationship domain (r = 0.42 and 0.41) of AQoL-6D at both timepoints. Both AQoL-6D and SF-6D did not discriminate between age groups and tumour stage at both timepoints but AQoL-6D discriminated between outcomes for different treatments at one year. All EPIC-26 domains discriminated between age groups and treatment at both timepoints. The EPIC-26 was more responsive than AQoL-6D and SF-6D between baseline and one year following treatment.

CONCLUSIONS

AQoL-6D can be used in combination with EPIC-26 in place of SF-12. Although EPIC-26 is not utility based, its popularity amongst clinicians and ability to discriminate between disease-specific characteristics and post-treatment outcomes in clinical trials makes it a candidate for use within cost-effectiveness analyses. The generic measure provides a holistic assessment of quality of life and is suitable for generating quality adjusted life years (QALYs).

Convergent Validity of Myheartsmap: A Pediatric Psychosocial Health Screening Tool

Recognition of pediatric mental health concerns often depends on assessment by parents, educators, and primary care professionals. Therefore, a psychosocial screening instrument suitable for routine use in schools and primary care is needed. The Pediatric Quality of Life (PedsQL) and the Strengths and Difficulties Questionnaire (SDQ) are widely used for screening but lack adolescent-specific mental health measures. MyHEARTSMAP is an instrument assessing aspects of youth psychosocial health via four domains: Psychiatry, Function, Social, and Youth Health. We evaluated MyHEARTSMAP convergent validity with PedsQL and SDQ among 122 child-parent dyads participating in a larger concussion study. Convergent validity was assessed via correlations: MyHEARTSMAP Psychiatry and Function domains correlated strongly (r ≥ 0.44) and Social domain correlated weakly (r ≤ 0.25) to corresponding PedsQL and SDQ subscales, while Youth Health domain correlated moderately (r ≥ 0.31) to the tools' total scales. In conclusion, MyHEARTSMAP converges with PedsQL and SDQ, and benefits from the inclusion of adolescent-specific psychosocial measures.

Factor analysis of the stigma scale-child in pediatric inflammatory bowel disease

OBJECTIVE

Illness stigma, or perceived stigma related to a chronic health condition, is pervasive among youth with inflammatory bowel disease (IBD). However, no studies exist examining the psychometric properties of illness stigma measures in this population. Using a modified version of the Child Stigma Scale originally developed for youth with epilepsy, the current study investigated the factor structure and validity of this adapted measure (i.e., Stigma Scale - Child; SS-C) in youth with IBD.

METHODS

Factor analyses were conducted to determine the most parsimonious factor structure for the adapted 8-item Stigma Scale - Child in a sample of 180 youth with IBD. Correlations were conducted to assess convergent validity, and a multiple regression was conducted to further evaluate the measure's predictive validity of child depressive symptoms.

RESULTS

The most parsimonious model for the SS-C is a one-factor solution with an error covariance between the two items assessing concealment/disclosure of IBD diagnosis.

CONCLUSIONS

The SS-C is a psychometrically sound illness stigma measure in pediatric IBD that demonstrates strong convergent validity with psychosocial adjustment factors such as thwarted belongingness, illness uncertainty, and illness intrusiveness, as well as strong predictive validity with youth depressive symptoms. The SS-C is a viable option for use as a brief screener in youth with IBD across clinical and research settings.

Validation of the Tilburg Pregnancy Distress Scale among pregnant women in Capricorn District, South Africa

BACKGROUND

The Tilburg Pregnancy Distress Scale (TPDS) was developed to measure pregnancy-specific psychological distress among pregnant women.

METHOD

The present study evaluated the psychometric properties of the TPDS in a South African location. Analysis was conducted using data obtained from a sample of 205 participants (average age = 27.69 years [SD = 5.977], average gestation weeks = 25.37 weeks [SD = 8.448]; domicile = 63% rural) attending their antenatal check-ups at various medical health facilities in the Capricorn District, Limpopo Province. The analysis involved structural and convergent validation.

RESULTS

Fit indices showed that the three-factor, second-order solution fitted the data better. The reliability estimates of the main TPDS factors, partner involvement (PI) and negative affect (NA), were good, and were obviously not influenced by gravidity. The associations of the TPDS factors with the Patient Health Questionnaire (PHQ-4) Depression and Anxiety, the Edinburgh Postnatal Depression Scale (EPDS), and the Pregnancy-Related Anxiety Scale (PRAS) were not generally good.

CONCLUSION

The results suggest that in spite of the TPDS having potential to be used in South Africa, further validation studies are required.

Speech and non-speech measures of audiovisual integration are not correlated

Many natural events generate both visual and auditory signals, and humans are remarkably adept at integrating information from those sources. However, individuals appear to differ markedly in their ability or propensity to combine what they hear with what they see. Individual differences in audiovisual integration have been established using a range of materials, including speech stimuli (seeing and hearing a talker) and simpler audiovisual stimuli (seeing flashes of light combined with tones). Although there are multiple tasks in the literature that are referred to as "measures of audiovisual integration," the tasks themselves differ widely with respect to both the type of stimuli used (speech versus non-speech) and the nature of the tasks themselves (e.g., some tasks use conflicting auditory and visual stimuli whereas others use congruent stimuli). It is not clear whether these varied tasks are actually measuring the same underlying construct: audiovisual integration. This study tested the relationships among four commonly-used measures of audiovisual integration, two of which use speech stimuli (susceptibility to the McGurk effect and a measure of audiovisual benefit), and two of which use non-speech stimuli (the sound-induced flash illusion and audiovisual integration capacity). We replicated previous work showing large individual differences in each measure but found no significant correlations among any of the measures. These results suggest that tasks that are commonly referred to as measures of audiovisual integration may be tapping into different parts of the same process or different constructs entirely.

Construct validation of the Research Engagement Survey Tool (REST)

BACKGROUND

The Research Engagement Survey Tool (REST) was developed to examine the level of partner (e.g., patients, caregivers, advocates, clinicians, community members) engagement in research studies. The REST is aligned with eight engagement principles based on the literature and consensus reached through a five round Delphi process. Each of the engagement principles has three-five corresponding items that are assessed on two Likert type scales quantity (how often: never, rarely, sometimes, often, always, not applicable) and quality (how well: poor, fair, good, very good, excellent, not applicable). We conducted a comprehensive validation of the REST. Despite the importance of partner engagement in research, currently no gold standard measure exists.

METHODS

Multiple strategies were employed to validate the REST. Here, we examine the internal consistency of items for each of the eight engagement principles. In addition, we examine the convergent validity of the comprehensive (32-item) REST with other measures (e.g., medical mistrust, Community Engagement in Research Index, Partnership Self-Assessment Tool, Wilder collaboration inventory, Partnership Assessment In community-based Research). We propose two scoring approaches for the REST; one aligned with the engagement principles and the other aligned with levels of community engagement: (1) outreach and education, (2) consultation, (3) cooperation, (4) collaboration, and (5) partnership.

RESULTS

The REST has strong internal consistency (Cronbach's alpha > 0.75) for each of the eight engagement principals measured on both scales (quality and quantity). The REST had negligible (e.g., medical mistrust, community engagement in research index), low (e.g., Partnership Assessment In community-based Research, Partnership Self-Assessment Tool- benefits scale), and moderate (e.g., Wilder collaboration inventory, Partnership Self-Assessment Tool- synergy scale) statistically significant correlations with other measures based on the Spearman rank correlation coefficient. These results suggest the REST is measuring something similar and correlated to the existing measures, but it captures a different construct (perceived research engagement).

CONCLUSIONS

The REST is a valid and reliable tool to assess research engagement of community health stakeholders in the research process. Valid tools to assess research engagement are necessary to examine the impact of engagement on the scientific process and scientific discovery and move the field of stakeholder engagement from best practices and lessons learned to evidence-based approaches based on empirical data.

Psychometric properties of screening questionnaires to detect depression in primary healthcare setting in rural Ethiopia

BACKGROUND

Much of the research about the validity of depression screening questionnaires is on criterion validity. Evidence is scarce on the concurrent, convergent and construct validity of these measures, particularly from low-income countries. This study aimed to evaluate the psychometric properties of depression screening questionnaires in primary healthcare (PHC) in rural Ethiopia.

METHODS

A facility-based cross-sectional study was conducted with 587 participants recruited from patients attending three PHC facilities and two 'Holy water sites' (places where religious treatment is being provided). The psychometric properties of five mental health screening questionnaires were evaluated: the nine item Patient Health Questionnaire (PHQ-9), the two item version of PHQ-9 (PHQ-2), a version of PHQ-9 with two added items of irritability and noise intolerance (PHQ-11), the Patient Health Questionnaire-15 (PHQ-15), and the World Health Organization-Five Well-being Index (WHO-5). Clinical diagnosis of depression was ascertained by psychiatrists. We analyzed data using exploratory factor analysis, Spearman's rank order correlation coefficient (Rho), the Mann Whitney test of the equality of medians, univariate logistic regression and Cronbach's alpha.

RESULTS

PHQ-9, PHQ-11 and WHO-5 were found to be unidimensional, with items in each scale highly loading onto one factor (factor loadings ranging from 0.64 to 0.87). The items of each instrument were internally consistent, with Cronbach's alpha ranging from 0.72 (PHQ-2) to 0.89 (PHQ-11). Scores for all screening scales were moderately or highly correlated with each other (Rho = 0.58 to 0.98) and moderately correlated with anxiety and disability scores. Median scores of all screening scales were significantly higher in those diagnosed with depression. The association of items measuring emotional and cognitive symptoms with the diagnosis of depression was stronger than the association with items measuring somatic symptoms. Irritability and noise intolerance had higher association with depression diagnosis than PHQ-9 items.

CONCLUSION

Emotional and cognitive symptoms are more useful than somatic symptoms to predict the diagnosis of depression in the PHC context in Ethiopia. Future research should focus on testing the unidimensionality of PHQ-9, PHQ-11 and WHO-5 using confirmatory factor analysis; establishing the criterion validity of PHQ-11 and WHO-5; and on assessing test-retest reliability of all the measures.

Convergent validity of the developmental coordination disorder checklist using soft neurological signs

AIMS

To investigate the convergent validity of a new questionnaire, the Developmental Coordination Disorder Checklist (DCDC), we examined the relationship between the DCDC score and Soft Neurological Signs (SNS) which highly correlated with the Movement Assessment Battery for Children (MABC), which is widely applied to assess fine and gross motor skills.

METHODS

The patients were 70 elementary school children without intellectual disabilities who were referred to our clinic, examined for SNS, and whose parents completed the DCDC. The DCDC consists of 16 items that focus on three factors: fine motor, gross motor, and catch and throw. We used a previously described method to assess SNS, which included five tasks: (1) standing on one leg with closed eyes, (2) finger opposition test, (3) diadochokinesis, (4) associated movements during diadochokinesis, and (5) motor persistence (laterally fixed gaze).

RESULTS

DCDC scores and SNS were strongly and positively correlated, with higher DCDC scores (indicating greater coordination problems) associated with a higher number of positive SNS.

CONCLUSIONS

DCDC scores have been proven to be strongly correlated with SNS, and these data suggest that DCDC has good convergent validity.

Responsiveness and convergent validity of QLU-C10D and EQ-5D-3L in assessing short-term quality of life following esophagectomy

Aim

This study assessed the responsiveness and convergent validity of two preference-based measures; the newly developed cancer-specific EORTC Quality of Life Utility Measure-Core 10 dimensions (QLU-C10D) relative to the generic three-level version of the EuroQol 5 dimensions (EQ-5D-3L) in evaluating short-term health related quality of life (HRQoL) outcomes after esophagectomy.

Methods

Participants were enrolled in a multicentre randomised controlled trial to determine the impact of preoperative and postoperative immunonutrition versus standard nutrition in patients with esophageal cancer. HRQoL was assessed seven days before and 42 days after esophagectomy. Standardized Response Mean and Effect Size were calculated to assess responsiveness. Ceiling effects for each dimension were calculated as the proportion of the best level responses for that dimension at follow-up/post-operatively. Convergent validity was assessed using Spearman’s correlation and the level of agreement was explored using Bland–Altman plots.

Results

Data from 164 respondents (mean age: 63 years, 81% male) were analysed. HRQoL significantly reduced on both measures with large effect sizes (> 0.80), and a greater mean difference (0.29 compared to 0.16) on QLU-C10D. Both measures had ceiling effects (> 15%) on all dimensions at baseline. Following esophagectomy, ceiling effects were observed with self-care (86%), mobility (67%), anxiety/depression (55%) and pain/discomfort (19%) dimensions on EQ-5D-3L. For QLU-C10D ceiling effects were observed with emotional function (53%), physical function (16%), nausea (35%), sleep (31%), bowel problems (21%) and pain (20%). A strong correlation (r = 0.71) was observed between EQ-5D-3L anxiety and QLU-C10D emotional function dimensions. Good agreement (3.7% observations outside the limits of agreement) was observed between the utility scores.

Conclusion

The QLU-C10D is comparable to the more widely applied generic EQ-5D-3L, however, QLU-C10D was more sensitive to short-term utility changes following esophagectomy. Cognisant of requirements by policy makers to apply generic utility measures in cost effectiveness studies, the disease-specific QLU-C10D should be used alongside the generic measures like EQ-5D-3L.

Trial registration: The trial was registered with the Australian New Zealand Clinical Trial Registry (ACTRN12611000178943) on the 15th of February 2011.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12955-021-01867-w.

Forgotten Joint Score Post Total Knee Arthroplasty and Its Correlation with the New Knee Society Score

BACKGROUND/PURPOSE

Forgotten Joint Score (FJS) is designed to asses patient recovery post Total Knee Arthroplasty (TKA) in a new dimension. It assess the ability to forget the operated joint as artificial during activities of daily living. New Knee Society Score (NKSS) is developed to encompass objective and subjective outcome as well as an assessment of patient expectation and satisfaction. Our purpose was (1) to determine FJS at 1 year post TKA in Indian Patients, and (2) to assess convergent validity between FJS and the NKSS. We hypothesised that FJS should strongly correlate with the Satisfaction (SS) and Knee perception(KPS) sub-component of NKSS.

METHODS

We enrolled 181 patients who underwent primary TKA during an 8-month duration. They were prospectively followed up at 1-year review clinic when FJS and NKSS were administered. 169 patients completed the assessment forms and 13 patients were lost to follow-up. Statistical evaluation was done with Spearman correlation test.

RESULTS

Mean FJS at 1 year was 66.6 ± 25.9 with 14% ceiling and 1% floor effects. There was a mild to moderate correlation of FJS with NKSS (p < 0.001, r = 0.47) and its sub-scores (p < 0.001; r = 0.43 and r = 0.44). There was a weak correlation of FJS with NKSS sub-components of SS and KPS (p < 0.001; r = 0.37 and 0.25, respectively).

CONCLUSION

Mean FJS at 1 year post TKA showed convergent validity with NKSS; however, the correlation was not strong enough to use them interchangeably. Hypothesis that FJS should strongly correlate with the NKSS sub-components of satisfaction and joint perception was refuted. We conclude, FJS provides unique evaluation in recovery post TKA, different from NKSS.

LEVEL OF EVIDENCE

Level III.

Validity and reliability of the Amharic version of supportive care needs survey - short form 34 among cancer patients in Ethiopia

OBJECTIVES

Supportive care needs survey short form has a total of 34 items that have 5 domains that measure the unmet needs of cancer patients. It is important to validate this tool since there are differences in culture, geographic areas, and clinical care service which influence patients' needs. Therefore, this study aimed to assess the construct validity and reliability of the tool.

METHODS

The study was conducted among 170 cancer patients from April 1st to 30th 2019 in Hawassa hospital, South Ethiopia. Confirmatory factor analysis was done using fit indices. Convergent and discriminant validity was evaluated using average variance extracted and maximum shared variance respectively. Known group validity was checked using the Mann-Whitney U test. The reliability of the instrument was examined using Cronbach's alpha.

RESULTS

Domains except for health system and information, and patient care and support maintained convergent and divergent validity. The remaining validity was maintained after removing items that were redundant and double loading. The average variance extracted of domains varied from 0.52-0.81. The Square of correlation between constructs was lower than the average variance extracted for the constructs. The tool had reliability r = 0.932. The root mean square error of approximation was 0.057, comparative fit index 0.954, and the other fit indices were also indicating a good fit. Known groups difference was seen by age and type of treatment taken across the different domains.

CONCLUSION

After the health system and information, and patient care, and support domain validity issues were corrected by removing 8 items, the reduced tool was found to be a valid and reliable tool. The validated tool will be valuable if included in routine cancer care in our clinical settings.

Development and validation of the Croatian version of the Eating Disorder Examination Questionnaire in a community sample

PURPOSE

The Eating Disorder Examination Questionnaire (EDE-Q) is one of the most commonly used tools for identification of eating disorder (ED) symptoms. The purpose of this study was to develop and validate the Croatian version of the EDE-Q 6.0.

METHODS

Participants were 279 individuals from a community sample (215 females; 64 males) with an average age of 24.61 ± 5.68 years. The Eating Attitudes Test-26 and Body Image Satisfaction Scale were used to determine the convergent validity of the EDE-Q. Four-, three-, two-, and single-factor models were tested, together with a brief 8-item version of the EDE-Q.

RESULTS

Confirmatory factor analysis yielded a better fit of the original four-factor model when compared to other models, although the best model-data fit was obtained when testing subscales individually with correlations between factors ranging from 0.30 to 0.99. However, item 10 had to be excluded from the shape concern subscale to reach an acceptable fit. Correlation analyses showed that the EDE-Q has good convergent validity, but additional calculations discovered its tendency to overestimate ED symptomatology.

CONCLUSIONS

This study is the first to show satisfactory psychometric properties of the Croatian version of the EDE-Q with minor modifications of the original questionnaire. The Croatian translation and validation of the EDE-Q enables researchers and clinicians in Croatia to employ the most widely and commonly used instrument for the assessment of core ED features.

LEVEL OF EVIDENCE

Descriptive cross-sectional study, Level V.

Health-related quality of life in Iranian adolescents: a psychometric evaluation of the self-report form of the PedsQL 4.0 and an investigation of gender and age differences

Background

Research on the psychometric properties of the Persian self-report form of the Pediatric Quality of Life Inventory Version 4.0 (PedsQL 4.0) in adolescents has several gaps (e.g., convergent validity) that limit its clinical application and therefore the cross-cultural impact of this measure. This study aimed at investigating the psychometric properties of the PedsQL 4.0 and the effects of gender and age on quality of life in Iranian adolescents.

Method

The PedsQL 4.0 was administered to 326 adolescents (12–17 years). A subsample of 115 adolescents completed the scale two weeks after the first assessment. Confirmatory Factor Analysis (CFA), correlation of the PedsQL 4.0 with the Weiss Functional Impairment Rating Scale-Self-report (WFIRS-S), and Item Response Theory (IRT) analysis were conducted to examine validity. Cronbach’s alpha, McDonald’s Omega, and Intra class correlation (ICC) were calculated as well to examine reliability. Gender and age effects were also evaluated.

Results

Internal consistency and test–retest reliability of the total PedsQL 4.0 scale was .92 and .87, respectively. The PedsQL 4.0 scores showed negative moderate to strong correlations with the WFIRS-S total scale. The four-factor model of the PedsQL 4.0 was not fully supported by the CFA—the root mean square error of approximation and the comparative fit index showed a mediocre and poor fit, respectively. IRT analysis indicated that all items of the PedsQL 4.0 fit with the scale and most of them showed good discrimination. The items and total scale provided more information in the lower levels of the latent trait. Males showed significantly higher scores than females in physical and emotional functioning, psychosocial health, and total scale. Adolescents with lower ages showed better quality of life than those with higher ages in all scores of the PedsQL 4.0.

Conclusion

The PedsQL 4.0 showed good psychometric properties with regard to internal consistency, test–retest reliability, and convergent validity in Iranian adolescents, which supports its use in clinical settings among Persian-speaking adolescents. However, factor structure according to our CFA indicates that future work should address how to improve fit. In addition, studies that include PedsQL 4.0 should consider gender and age effects were reported.

The Malay version of SF-36 health survey instrument: testing data quality, scaling assumptions, reliability and validity in post-coronary artery bypass grafting (CABG) surgery patients at the National Heart Institute (Institut Jantung Negara-IJN), Kuala Lumpur

BACKGROUND

The Short Form 36 (SF-36) is a scoring system comprising of 36 items categorized into eight constructs corresponding to patients' health-related quality of life. It has been used extensively in various countries on different sub-populations and used to indicate the health status and help to ascertain the effect of clinical interventions on the particular population.

OBJECTIVE

To examine the psychometric properties of the Malay version of SF-36 (Malay SF-36) summated rating scales and validate the scale among post-coronary artery bypass grafting surgery (CABG) patients at the National Heart Institute (IJN), Kuala Lumpur.

METHODS

Five hundred and nine post-CABG patients at the IJN, Malaysia completed the questionnaires between 1 July and 31 December 2017. Psychometric tests endorsed by the "International Quality of Life Assessment Project" were utilised.

RESULTS

The data quality was excellent with a high questionnaire completion rate (100%). As hypothesized, the ordering of item means within scales was clustered. In unison, scaling assumptions were satisfied. Good discriminant validity was shown between subsets of patients with various levels of health status. Notwithstanding, there were probably translation issues of the Physical Functioning scale which showed small ceiling effects. We clearly observed high ceiling and floor effects in both Role Physical and Role Emotional scale most probably attributed to the dichotomous style of their choice of responses. Cronbach alpha values of the eight scales ranged from 0.73 to 0.90, showing good internal consistency reliability. Confirmatory Factor Analysis (CFA) confirmed the 8-factor solution and Composite Reliability revealed internal consistency reliability except for Vitality and Social Functioning. Based on the Average Variance Extracted (AVE), convergent validity was adequate except for two domains. Discriminant Validity is good for the eight constructs as the √AVE are generally higher than the correlation coefficients between the latent constructs.

CONCLUSION

The scoring for the Malay SF-36 based on the summated ratings method was proven to be valid to be applied in our local clinical population. The CFA, fitness estimates, reliability and validity assessments suggest that the Malay version of SF36 is a valid and reliable instrument. However, further work is warranted to further refine the convergent validity and reliability of some scales.

Objectively characterizing Huntington's disease using a novel upper limb dexterity test

BACKGROUND

The Clinch Token Transfer Test (C3t) is a bi-manual coin transfer task that incorporates cognitive tasks to add complexity. This study explored the concurrent and convergent validity of the C3t as a simple, objective assessment of impairment that is reflective of disease severity in Huntington's, that is not reliant on clinical expertise for administration.

METHODS

One-hundred-and-five participants presenting with pre-manifest (n = 16) or manifest (TFC-Stage-1 n = 39; TFC-Stage-2 n = 43; TFC-Stage-3 n = 7) Huntington's disease completed the Unified Huntington's Disease Rating Scale and the C3t at baseline. Of these, thirty-three were followed up after 12 months. Regression was used to estimate baseline individual and composite clinical scores (including cognitive, motor, and functional ability) using baseline C3t scores. Correlations between C3t and clinical scores were assessed using Spearman's R and visually inspected in relation to disease severity using scatterplots. Effect size over 12 months provided an indication of longitudinal behaviour of the C3t in relation to clinical measures.

RESULTS

Baseline C3t scores predicted baseline clinical scores to within 9-13% accuracy, being associated with individual and composite clinical scores. Changes in C3t scores over 12 months were small ([Formula: see text] ≤ 0.15) and mirrored the change in clinical scores.

CONCLUSION

The C3t demonstrates promise as a simple, easy to administer, objective outcome measure capable of predicting impairment that is reflective of Huntington's disease severity and offers a viable solution to support remote clinical monitoring. It may also offer utility as a screening tool for recruitment to clinical trials given preliminary indications of association with the prognostic index normed for Huntington's disease.

Validation study of the Italian version of Temporal Focus Scale: psychometric properties and convergent validity

Background

Over the last decade, international research has produced a large number of studies that have stressed the importance of temporal focus in various aspects of the lives of individuals, groups and organizations. This first Italian validation study of the Temporal Focus Scale (TFS) has shown a reliable measurement to assess the tendency of individuals to characteristically think about different periods of their lives.

Methods

TFS/I was administered to a sample of 1458 participants, while three other convenience samples (N₁ = 453; N₂ = 544; N₃ = 168) were used for convergent validity testing.

Results

Confirmatory factor analysis confirmed a three-factor solution (including 10 items) with good indices of fit to data, e.g., χ² = 49.533, CFI = 0.992, TLI = 0.986, RMSEA = 0.034, RMSEA 90% CI .018–.048. Convergent validity assessment confirmed predictive indications with variables such as life satisfaction, optimistic/pessimistic orientation, perceived general self-efficacy, self-regulatory modes, anxiety, depression.

Conclusion

The temporal focus has proven to be a significant feature associated with various aspects of both well-being and personal discomfort. By virtue of its good psychometric properties, the TFS can be an integrative tool along with others for a better evaluation of the person’s profile in different contexts such as education, coaching, psychotherapy, counseling and career guidance.

Convergent and discriminant validity of the Emotional Eating Scale Adapted for Children and Adolescents (EES-C) Short-Form

BACKGROUND

Emotional eating is associated with a number of negative outcomes in children and adolescents, including higher levels of loss of control eating (i.e., the inability to control the amount of food consumed). There is a need for psychometrically sound and feasible measures that assess emotional eating in children and adolescents. The purpose of the current study was to evaluate the convergent and discriminant validity of the 10-item Emotional Eating Scale Adapted for Children and Adolescents (EES-C) Short-Form in a community sample of adolescents. We also sought to assess the reliability and structural validity of this measure.

METHODS

Participants were 128 adolescents ages 13 to 19 years (mean age = 15.10 years; SD = 2.09; 53.9% female). Most participants fell within the healthy BMI range (58.6%). Participants completed the EES-C Short-Form, the loss of control eating section of the Questionnaire on Eating and Weight Patterns-Adolescent Version 5, the Gratitude Questionnaire-Six-Item Form, and a demographic questionnaire.

RESULTS

Convergent validity of the EES-C Short-Form was supported in that adolescents who endorsed loss of control eating reported significantly greater levels of emotional eating (mean = 24.37; SD = 8.94) compared to adolescents who did not endorse loss of control eating (mean = 19.42; SD = 7.33; p ≤ .01; d = 0.61). The EES-C Short-Form was significantly correlated with a subjective measure of loss of control eating (r_s = -0.255; p = .004), further demonstrating convergent validity. The EES-C Short-Form exhibited discriminant validity as demonstrated by a small, non-significant correlation with the Gratitude Questionnaire-Six-Item Form (r_s = 0.086; p = .347). The EES-C Short-Form demonstrated acceptable reliability (Cronbach's alpha = 0.84; Ordinal alpha = 0.88; Coefficient omega = 0.85) and a unidimensional factor structure (CFI = 0.98; NNFI = 0.98; RMSEA = 0.08).

CONCLUSIONS

These data contribute to the existing research that support the EES-C Short-Form as a reliable and valid measure for assessing emotional eating in children and adolescents.

The Korean Repeatable Battery for the Assessment of Neuropsychological Status-Update : Psychiatric and Neurosurgery Patient Sample Validity

Objective

This study aimed to validate the Korean version of the Repeatable Battery for the Assessment of Neuropsychological Status Update (K-RBANS).

Methods

We performed a retrospective analysis of 283 psychiatric and neurosurgery patients. To investigate the convergent validity of the K-RBANS, correlation analyses were performed for other intelligence and neuropsychological test results. Confirmatory factor analysis was used to test a series of alternative plausible models of the K-RBANS. To analyze the various capabilities of the K-RBANS, we compared the area under the receiver operating characteristic (ROC) curves (AUC).

Results

Significant correlations were observed, confirming the convergent validity of the K-RBANS among the Total Scale Index (TSI) and indices of the K-RBANS and indices of intelligence (r=0.47–0.81; p<0.001) and other neuropsychological tests at moderate and above significance (r=0.41–0.63; p<0.001). Additionally, the results testing the construct validity of the K-RBANS showed that the second-order factor structure model (model 2, similar to an original factor structure of RBANS), which includes a first-order factor comprising five index scores (immediate memory, visuospatial capacity, language, attention, delayed memory) and one higher-order factor (TSI), was statistically acceptable. The comparative fit index (CFI) (CFI, 0.949) values and the goodness of fit index (GFI) (GFI, 0.942) values higher than 0.90 indicated an excellent fit. The root mean squared error of approximation (RMSEA) (RMSEA, 0.082) was considered an acceptable fit. Additionally, the factor structure of model 2 was found to be better and more valid than the other model in χ² values (Δχ²=7.69, p<0.05). In the ROC analysis, the AUCs of the TSI and five indices were 0.716–0.837, and the AUC of TSI (AUC, 0.837; 95% confidence interval, 0.760–0.896) was higher than the AUCs of the other indices. The sensitivity and specificity of TSI were 77.66% and 78.12%, respectively.

Conclusion

The overall results of this study suggest that the K-RBANS may be used as a valid tool for the brief screening of neuropsychological patients in Korea.

Psychometric properties of the DSM-5 Clinician-Rated Dimensions of Psychosis Symptom Severity

OBJECTIVE

The Clinician-Rated Dimensions of Psychosis Symptom Severity (CRDPSS) was presented in the DSM-5 as a new scale to assess the dimensional aspects of psychosis in daily clinical practice. However, agreement in CRDPSS-ratings among raters in clinical practice remains unknown. We examined the inter-rater reliability (IRR) and convergent validity of the CRDPSS.

METHOD

Consecutively recruited outpatients with recent onset schizophrenia spectrum disorders were included between January 2015 and July 2018. We collected multiple CRDPSS measurements of 335 participants, of whom 179 PANSS measurements were available. IRR was determined by comparing the CRDPSS-ratings of psychiatrists with a vis-à-vis contact and CRDPSS observations based on a detailed clinical presentation. IRR was expressed in Krippendorff's alpha and we estimated convergent validity by studying associations with PANSS factors by Spearman's rank correlation coefficient.

RESULTS

Inter-rater reliability scores measured in Krippendorff's alpha were low (0.35-0.64) for all items of the CRDPSS, except the item delusions (0.74). A three-factor model was found: 'deficit/motor symptoms', 'positive symptoms' and 'mood symptoms'. Positive associations between CRDPSS factors with PANSS factors were found.

CONCLUSION

This study demonstrated that the IRR of the CRDPSS between raters in clinical practice was insufficient. We did find some supporting evidence for convergent validity of the CRDPSS, but these results should be interpreted carefully due to low IRR. Consequently, general implementation in clinical practice should be done with caution and we recommend assessors to be trained.

Standardization of the Computerized Battery for Neuropsychological Evaluation of Children (BENCI) in an urban setting, in Kenya: a study protocol

Objective

In sub Saharan Africa one of the key challenges in assessment using neuropsychological tools has been the lack of adequately validated and easily implementable measures. This study will translate into English, adapt and standardize the Computerized Battery for Neuropsychological Evaluation of Children (BENCI). The BENCI battery will be adapted using back-translation design, comprehensive cultural adaptation and standardized in a case–control study involving two groups of children: HIV infected and HIV unexposed, uninfected children. The content adaptation will be iteratively carried out using knowledge of English and feedback from pilot testing with children. The proposed study will first involve the cultural adaptation of the BENCI. It will then recruit 544 children aged 8–11 years with half of them being HIV+, while the other half will be HIV unexposed-uninfected. Test–retest reliability will be analyzed using Pearson’s correlation while ANOVA and correlational analyses will be used to calculate discriminant, convergent and construct validity.

Results

This study will result in an open access adequately adapted and standardized measure of neuropsychological functioning for use with children in East Africa. The protocol paper provides an opportunity to share the planned methods and approaches.

The convergent, discriminant, and nomological validity of the Depression Anxiety Stress Scales-21 (DASS-21)

BACKGROUND

Previous validity studies of Depression Anxiety Stress Scales-21 (DASS-21) through confirmatory factor analysis (CFA) were limited by yielding poor factor loading values and eventually skipping the critical process addressing convergent, discriminant, and nomological validity. Without the crucial process, it was risky that past studies insisted DASS-21 be ready for use. Therefore, the current study examined DASS-21 regarding the three kinds of validity to determine if DASS-21 can be further used in the future.

METHODS

The current study formulated a CFA model (i.e., modified one-factor model) of DASS-21, which yielded factor loading values over β = 0.70 and estimated a latent variable of Psychological Distress by employing indicators of Depression, Anxiety, and Stress. The data collection was conducted at two universities in the U.S. and South Korea in November 2016 (N = 255). The study participants completed an online survey developed with DASS-21. With the collected data, the present study investigated the convergent, discriminant, and nomological validity of the modified one-factor model of DASS-21 through CFA.

RESULTS

The model fit of the modified one-factor model was complete as saturated. The convergent validity coefficient of Psychological Distress was 0.87, and average variance extracted of the variable was 0.68. The three correlations among the measured variables (i.e., indicators) were 0.50 < r < 0.75.

LIMITATIONS

Application of the current study's findings to youth or older adults can be limited as the subjects were young adults.

CONCLUSIONS

The current study made substantial evidence regarding the convergent, discriminant, and nomological validity of DASS-21 through CFA.

The Psychometric Properties of the Patient Health Questionnaire-9 in a Sample of Korean University Students

OBJECTIVE

Depressive symptoms among university students are a major mental-health issue worldwide, and university students are particularly vulnerable to various stressors that can produce depression. Therefore, accurate and sustainable assessment of depressive symptoms among university students is of special importance. The Patient Health Questionnaire-9 (PHQ-9) is one such measure. The objective of the current study was to evaluate the psychometric properties of the PHQ-9 among Korean university students.

METHODS

A total sample of 582 university students attending a four-year private university in South Korea was recruited for the study. Confirmatory factor analyses (CFAs) were performed to compare the goodness-of-fit of four competing models suggested by extant literature on the PHQ-9. Convergent validity was assessed using a correlation analysis between the PHQ-9 and other psychiatric instruments, including the Depression, Anxiety, and Stress Scale-21 (DASS-21) and the Generalized Anxiety Disorder Scale (GAD-7).

RESULTS

A one-factor structure of the PHQ-9 provided the best fit to the data. Internal consistency was adequate. The PHQ-9 demonstrated good convergent validity with related constructs.

CONCLUSION

The psychometric properties of the PHQ-9 proved to be adequate, with a robust and interpretable factor structure and good internal consistency. The PHQ-9's validity, reliability, brevity and ease of administration make it a useful screening instrument for depression among university students in Korea.

Quantification of nonverbal synchrony using linear time series analysis methods: Lack of convergent validity and evidence for facets of synchrony

Nonverbal synchrony describes coordination of the nonverbal behavior of two interacting partners. Additionally, it seems to be important in human interactions, such as during psychotherapy. Currently, there are several options for the automated determination of synchrony based on linear time series analysis methods (TSAMs). However, investigations into whether the different methods measure the same construct have been missing. In this study, N = 84 patient-therapist dyads were videotaped during psychotherapy sessions. Motion energy analysis was used to assess body movements. We applied seven different TSAMs and recorded multiple output scores (average synchrony, maximum synchrony, and frequency of synchrony; in total, N = 16 scores). Convergent validity was examined using correlations of the output scores and exploratory factor analysis. Additionally, two criterion-based validations were conducted: investigations of concordant validity with a more generalized nonlinear method, and of the predictive validity of the synchrony scores for improvement in interpersonal problems at the end of therapy. We found that the synchrony measures only partially correlated with each other. The factor analysis did not support a common-factor model. A three-factor model with a second-order synchrony variable showed the best fit for eight of the selected synchrony scores. Only some synchrony scores were able to predict improvement at the end of therapy. We concluded that the considered TSAMs do not measure the same synchrony construct, but different facets of synchrony: the strength of synchrony of the total interaction, the strength of synchrony during synchronization intervals, and the frequency of synchrony.

Psychometric properties of the Weight Self-Stigma Questionnaire (WSSQ) among a sample of overweight/obese French-speaking adolescents

PURPOSE

The Weight Self-Stigma Questionnaire (WSSQ) was recently developed to assess the internalization of weight stigma among English-speaking overweight and obese adults. The objective of the present study was to develop and examine the psychometric properties of a French version of the WSSQ, as well as its applicability to adolescents.

METHODS

The sample comprised 156 overweight and obese adolescents (81 boys, 75 girls, M_age = 16.31). The factor validity and the convergent validity of the French version of the WSSQ were examined using a confirmatory factor analysis and a structural equation model, respectively.

RESULTS

The a priori two-factor structure of the WSSQ and the composite reliability of its subscales (self-devaluation and fear of enacted stigma) were supported. Convergent validity analyses revealed that both WSSQ subscales were significantly and (a) negatively correlated with measures of self-esteem and physical appearance, and (b) positively correlated with measures of anxiety, depression, fear of negative appearance evaluation, and eating-related pathology (fear of getting fat, eating-related control, food preoccupation, vomiting-purging behaviors, and eating-related guilt subscales). However, no significant relation was found between the WSSQ subscales and body mass index.

CONCLUSION

These results suggest that the French version of the WSSQ has acceptable psychometric properties and can be used to assess weight self-stigma among overweight and obese adolescents.

Assessing the maturity of the healthcare system for integrated care: testing measurement properties of the SCIROCCO tool

Background

The Scaling Integrated Care in Context (SCIROCCO) tool has been developed to facilitate knowledge transfer and learning about the implementation and scaling-up of integrated care in European regions. To adequately test the functionality of the tool in assessing the maturity for integrated care within regions, this study evaluated its structural validity, internal consistency and convergent validity.

Methods

Exploratory factor analysis was used to investigate the structural validity of the 12-items of the SCIROCCO tool. Hereafter, the internal consistency was assessed by calculating Cronbach’s and ordinal alpha. The convergent validity was explored by testing 23 pre-hypothesized relationships between items of the SCIROCCO tool and items of an instrument measuring a similar construct.

Results

Factor analysis revealed a one-factor structure. Cronbach’s alpha of the overall instrument was 0.92, ordinal alpha was 0.94. Only 30.34% of the hypotheses for testing the convergent validity were met.

Conclusion

The one-factor structure is considered relevant in representing the structural validity of the SCIROCCO tool. The scale of the SCIROCCO tool shows good internal consistency. The tool (DMIC Quickscan) used to assess the convergent validity might measure a different aspect of integrated care than the SCIROCCO tool. Further research is needed to continue investigating the validity and reliability of the tool.

Electronic supplementary material

The online version of this article (10.1186/s12874-019-0704-1) contains supplementary material, which is available to authorized users.

Validity of the Birchwood insight scale in patients with schizophrenia spectrum- and bipolar disorders

The aim of this study is to investigate the validity of the Norwegian version of the Insight Scale (IS) in large and representative samples of patients with schizophrenia spectrum disorders, bipolar I disorder and bipolar II disorder. A total of 997 participants were included (schizophrenia spectrum disorders: 557; bipolar I disorder: 282; bipolar II disorder: 138). Confirmatory factor analysis was conducted to investigate the construct validity and bivariate correlational analysis was applied to investigate convergent validity. Confirmatory factor analyses indicated a reasonable model fit to the original three-factor subscale structure of the IS in all three diagnostic groups. The IS total score and its subscales correlated significantly with both the insight items in the Young Mania Rating Scale and the Positive and Negative Syndrome Scale in both schizophrenia spectrum disorders and bipolar I disorder. In the bipolar II disorder group, however, the IS subscales correlated poorly with both the observer-rated measures. Our study supports the construct validity of the IS in both schizophrenia spectrum disorder- and bipolar disorder populations. The study also demonstrates that patients' self-reports of insight correspond to observer-based single item ratings of insight in bipolar I disorder and schizophrenia spectrum disorders.

Convergent and divergent validity of the schedule for affective disorders and schizophrenia for school-age children - present and lifetime version diagnoses in a sample of children and adolescents with obsessive-compulsive disorder

The presence of comorbid conditions associated with paediatric obsessive-compulsive disorder (OCD) is reported to range from 50 to 80% and to have an impact on treatment outcome. Accurate identification of comorbid psychiatric disorders is necessary in order to provide personalised care. Reliable and valid diagnostic interviews are essential in the process of establishing the correct diagnoses. The objective of this study was to evaluate the convergent and divergent validity of four diagnose categories generated by the Schedule for Affective Disorders and Schizophrenia for School-Age Children - Present and Lifetime Version (K-SADS-PL). The diagnose categories were: anxiety, depression, attention deficit hyperactivity disorder (ADHD), and oppositional defiant disorder (ODD). The K-SADS-PL was applied in a clinical sample of youth aged 7-17 years (N = 269), who were participants in the Nordic long-term OCD-treatment study (NordLOTS). Youth and parents completed measures to evaluate symptoms of anxiety, depression, ADHD, and ODD. Convergent and divergent validity of K-SADS-PL anxiety diagnosis was supported based on both anxiety self- and parent-reports. Similarly, support was found for convergent and divergent validity of ADHD and ODD diagnoses. For depressive disorder, support for convergent validity was found based on the depression self-report. Support for divergent validity of depression was found based on both the depression self- and parent-reports. Results of the present study suggest that the K-SADS-PL generates valid diagnoses of comorbid anxiety disorders, depression disorders, ODD, and ADHD in children and adolescents with OCD.

The structural and convergent validity of three commonly used measures of self-management in persons with neurological conditions

PURPOSE

Self-management ability is commonly assessed in chronic disease research and clinical practice. The purpose of this study was to assess the structural and convergent validity of three commonly used self-management outcome measures in a sample of persons with neurological conditions.

METHODS

We used data from a Canadian survey of persons with neurological conditions, which included three commonly used self-management measures: the Partners in Health Scale (PIH), the Patient Activation Measure (PAM), and the Self-Efficacy for Managing a Chronic Disease Scale (SEMCD). Confirmatory factor analysis was used to assess the structural and convergent validity of the three measures.

RESULTS

When treated as single-factor constructs, none of the measurement models provided a good fit to the data. A four-domain version of the PIH was the best fitting model. Confirmatory factor analysis suggests that the three tools measure different, but correlated constructs.

CONCLUSIONS

While the PAM, PIH and SEMCD scales are all used as measures of patient self-management, our study indicates that they measure different, but correlated latent variables. None, when treated as single, uni-dimensional construct, provides an acceptable fit to our data. This is probably because self-management is multi-dimensional, as is consistently shown by qualitative evidence. While these measures may provide reliable summative measures, multi-dimensional scales are needed for clinical use and more detailed research on self-management.

Comparison of nutrient profiling models for assessing the nutritional quality of foods: a validation study

Nutrient profiling (NP) is a method for evaluating the healthfulness of foods. Although many NP models exist, most have not been validated. This study aimed to examine the content and construct/convergent validity of five models from different regions: Australia/New Zealand (FSANZ), France (Nutri-Score), Canada (HCST), Europe (EURO) and Americas (PAHO). Using data from the 2013 UofT Food Label Information Program (n15342 foods/beverages), construct/convergent validity was assessed by comparing the classifications of foods determined by each model to a previously validated model, which served as the reference (Ofcom). The parameters assessed included associations (Cochran-Armitage trend test), agreement (κ statistic) and discordant classifications (McNemar's test). Analyses were conducted across all foods and by food category. On the basis of the nutrients/components considered by each model, all models exhibited moderate content validity. Although positive associations were observed between each model and Ofcom (all P trend<0·001), agreement with Ofcom was 'near perfect' for FSANZ (κ=0·89) and Nutri-Score (κ=0·83), 'moderate' for EURO (κ=0·54) and 'fair' for PAHO (κ=0·28) and HCST (κ=0·26). There were discordant classifications with Ofcom for 5·3 % (FSANZ), 8·3 % (Nutri-Score), 22·0 % (EURO), 33·4 % (PAHO) and 37·0 % (HCST) of foods (all P<0·001). Construct/convergent validity was confirmed between FSANZ and Nutri-Score v. Ofcom, and to a lesser extent between EURO v. Ofcom. Numerous incongruencies with Ofcom were identified for HCST and PAHO, which highlights the importance of examining classifications across food categories, the level at which differences between models become apparent. These results may be informative for regulators seeking to adapt and validate existing models for use in country-specific applications.

Validation of the Iranian/Persian Version of the Perceived Therapeutic Efficacy Scale for Type 2 Diabetes

BACKGROUND

The theory if self-efficacy is the central concept of social cognitive theory with emphasis on the constructs of efficacy expectation, outcome expectation. Efficacy expectation is defined as the person's confidence to carry out a specific behavior. Outcome expectation is beliefs that carrying out a specific behavior will lead to a specific outcome. While the benefit of measuring outcome expectations has been established, there has been no large scale within the Iranian context. The purpose of this study is to examine the reliability-validity of the Persian version of the Perceived Therapeutic Efficacy Scale (PTES).

METHODS

This study was conducted among 160 patients with type 2 diabetes mellitus (T2DM) using a self-administered instrument measuring outcome expectation. We used a methodological study design to assess the validity and reliability of the translated Persian version of the instrument.

RESULTS

The findings of the present study support the uni-dimensionality of the Persian version of the instrument. The 10 items of the scale account for 73.54% of the total variance and the un-rotated factor loadings ranged from 0.66 to 0.93. Moreover, this study offers support for convergent validity and internal consistency of the scale.

CONCLUSION

Our study demonstrated good convergent validity, factor structure and internal consistency in a sample of 160 Iranian adults with T2DM. Therefore, the Persian version of the scale is a valid and reliable instrument and can be used in research and clinical settings.

Validity and responsiveness of the work functioning impairment scale (WFun) in workers with pain due to musculoskeletal disorders

Objective:

To determine the convergent validity and responsiveness of the work functioning impairment scale (WFun) in workers with musculoskeletal disorder-related pain.

Methods:

Participants were extracted from an internet user study and prospectively examined using the pain intensity numerical rating scale (pain-NRS), the work ability numerical rating scale (productivity-NRS), and the WFun at baseline, 2 weeks, 6 weeks, and 3 months. The convergent validity and responsiveness of the WFun were examined by multilevel regression analysis.

Results:

A total of 786 workers participated and 593 completed all surveys. The WFun score gradually increased and decreased as the pain-NRS and the productivity-NRS increased, respectively. Changes in the WFun score steadily increased and decreased as changes in the pain-NRS and the productivity-NRS increased, respectively. Multilevel analyses showed that all linear associations were significant.

Conclusions:

The convergent validity and responsiveness of the WFun were consistent with the expected direction and magnitude.

External validity of the Psychiatric Diagnostic Screening Questionnaire (PDSQ) in a clinical sample

This study contributes to the convergent and discriminant validity of the Psychiatric Diagnostic Screening Questionnaire (PDSQ) by investigating its correlations with the relevant clinical scales of the Personality Assessment Inventory (PAI) and life space variables, such as relationship status, education level, job loss, and history of suicide attempts. Bivariate correlations were calculated for a sample of 254 psychiatric outpatients. The results indicated that the PDSQ scales demonstrated good to excellent convergent and discriminant validity with target scales from the PAI. They were also found to be meaningfully associated with a variety of life space variables. For example, five of the subscales and the Total Score correlated positively with a recent job loss, and eight of the subscales were negatively associated with education and/or employment status. Some incongruence with hypothesized relationships was discovered for life correlates classified as markers of psychiatric severity. Overall, these findings add to the emerging body of evidence corroborating the convergent and discriminant validity of the PDSQ.

Evaluation of the convergent validity of an estimated cardiorespiratory fitness algorithm

PURPOSE

Examine the convergent validity of a cardiorespiratory fitness (CRF) algorithm when compared to treadmill-assessed CRF.

METHODS

Data from the 1999-2004 NHANES were used (N = 3259 adults 20-49 years). Cardiorespiratory fitness was estimated from an algorithm. Participants completed a submaximal treadmill-based protocol. We (1) evaluated the pairwise association (and ICC) between estimated and measured cardiorespiratory fitness, (2) employed a paired samples t test to examine potential mean differences between estimated and measured cardiorespiratory fitness, (3) constructed a Bland-Altman plot and 95% limits of agreement (LoA) to explore systematic differences and random error between estimated and measured cardiorespiratory fitness, and (4) examined the association (via linear regression) of estimated and measured cardiorespiratory fitness with chronic disease prevalence and C-reactive protein (CRP).

RESULTS

Mean estimated CRF (10.68 METs) was lower than the mean measured CRF of 11.37 METs (p < 0.0001). The calculated pairwise correlation was of a moderate strength, r = 0.43 (p < 0.0001), with an ICC of 0.40 (p < 0.001). Calculated LoA indicated that estimated CRF may differ from measured CRF by 40% below to 48% above. Regression analyses yielded statistically significant inverse associations of estimated (unstandardized coefficient = - 0.026; p < 0.001) and measured (unstandardized coefficient = - 0.007; p = 0.002) CRF with chronic disease and estimated (unstandardized coefficient = - 0.08; p < 0.001) and measured (unstandardized coefficient = - 0.03; p < 0.001) CRF with CRP.

CONCLUSION

Measured and estimated CRF were moderately correlated. However, estimated and measured CRF were statistically significant different from one another with noteworthy scatter around the average difference. As such, when feasible, objective measurements of CRF should be taken.

Validation of the VBLaST pattern cutting task: a learning curve study

BACKGROUND

Mastery of laparoscopic skills is essential in surgical practice and requires considerable time and effort to achieve. The Virtual Basic Laparoscopic Skill Trainer (VBLaST-PC^©) is a virtual simulator that was developed as a computerized version of the pattern cutting (PC) task in the Fundamentals of Laparoscopic Surgery (FLS) system. To establish convergent validity for the VBLaST-PC^©, we assessed trainees' learning curves using the cumulative summation (CUSUM) method and compared them with those on the FLS.

METHODS

Twenty-four medical students were randomly assigned to an FLS training group, a VBLaST training group, or a control group. Fifteen training sessions, 30 min in duration per session per day, were conducted over 3 weeks. All subjects completed pretest, posttest, and retention test (2 weeks after posttest) on both the FLS and VBLaST^© simulators. Performance data, including time, error, FLS score, learning rate, learning plateau, and CUSUM score, were analyzed.

RESULTS

The learning curve for all trained subjects demonstrated increasing performance and a performance plateau. CUSUM analyses showed that five of the seven subjects reached the intermediate proficiency level but none reached the expert proficiency level after 150 practice trials. Performance was significantly improved after simulation training, but only in the assigned simulator. No significant decay of skills after 2 weeks of disuse was observed. Control subjects did not show any learning on the FLS simulator, but improved continually in the VBLaST simulator.

CONCLUSIONS

Although VBLaST^©- and FLS-trained subjects demonstrated similar learning rates and plateaus, the majority of subjects required more than 150 trials to achieve proficiency. Trained subjects demonstrated improved performance in only the assigned simulator, indicating specificity of training. The virtual simulator may provide better opportunities for learning, especially with limited training exposure.

Construction and Validation of Afterlife Belief Scale for Muslims

The purpose of this study was to develop a scale in Urdu language for measuring different dimensions of afterlife belief. The scale was subjected to exploratory and confirmatory factor analysis on a sample of 504 individuals (235 men and 269 women) recruited from different cities in the Punjab, Pakistan. After exploratory and confirmatory factor analysis, 16 items were retained with three well-defined factor structures of afterlife belief: positive, negative, and extinction. The alpha coefficients of the subscales ranged from .65 to .78. Convergent and discriminant validity of the subscales of Afterlife Belief Scale was determined by finding its relationship with the Pleasant Afterlife Belief Scale, the Unpleasant Afterlife Belief Scale, the Anxiety Subscale of DASS, and the Belief in Equitable World Scale. The results support that the newly developed scale has promising validity.