Developing and testing a cognitive bolt-on for the EQ-5D-Y (Youth)

Testing four cognition bolt-on items to the EQ-5D in a general Chinese population

OBJECTIVES

This study aimed to evaluate the psychometric properties of four candidate cognition bolt-on items and their combinations to the EQ-5D-5L.

METHODS

Four cognition items (concentration, memory, calculation, and learning) were developed as separate questionnaire items, and were administered with the standard EQ-5D-5L to 640 individuals in a general population survey in China. From the 4 items, 11 compound items were constructed, and the 'worse level counts' rule was used to calculate a compound item score. Psychometric performance of the cognition bolt-ons was assessed in terms of informativity, convergent validity, explanatory power, and discriminatory power.

RESULTS

The tested four cognition bolt-on items improved the informativity, convergent validity, explanatory power, and discriminatory power of EQ-5D-5L, with calculation and learning yielding better psychometric performance. The compound bolt-on items that coverd a range of cognitive functions demonstrated superior psychometric performance compared to single-aspect bolt-on items, with those items covering calculation and learning resulting in better psychometric performance.

CONCLUSION

This study confirmed the validity of the tested cognition bolt-ons in a general Chinese population. It supported the use of a compound bolt-on item covering a range of cognitive functions such as the ability to calculate and learn.

Associations Between Movement Behaviors, Cognition, and Academic Achievement in Children and Adolescents: A Systematic Review

OBJECTIVE

This systematic review summarizes the literature on the associations between movement behaviors (eg, sleep, sedentary behavior, and physical activity [PA]) and cognition, and academic achievement (AA) in children and adolescents.

METHODS

Four electronic databases (PubMed, Embase, PsycINFO, and SPORTDiscus) were searched from inception until October 2023.

RESULTS

This systematic review included 24 reports, representing 48,558 youth aged 6-17.9 years. Ten reports (46%) showed a high risk of bias, and overall quality of evidence ranged from very low to moderate. No reports assessed the associations between sleep and cognition; 1 cross-sectional report showed beneficial associations between sleep and AA. Sedentary behaviors showed null associations with AA in 43% of the reports; however, screen time was detrimentally associated with AA in all reports. Overall, 57% of the reports looking at the associations between PA and cognition showed beneficial associations; 53% showed beneficial associations between PA and AA; 56% of the randomized controlled trials showed beneficial impacts on cognition (3 out of 5) or on AA (2 out of 4).

CONCLUSIONS

Overall, this systematic review showed evidence of beneficial associations between PA and cognition and AA, as well as detrimental effects of screen time. Due to the many inconsistent results found for sedentary behavior, together with scarce data on associations between sleep duration and cognition, and AA in children and adolescents, more research is needed so researchers can draw strong and evidence-based conclusions.

Cross-cultural adaptation and content validation of the Singapore English version of EQ-5D-Y: a qualitative study

BACKGROUND

The EQ-5D-Y is a generic preference-weighted measure for children and adolescents which was developed within Europe. Two versions exist, the EQ-5D-Y-3L (Y-3L) and EQ-5D-Y-5L (Y-5L). This study aimed to cross-culturally adapt the Y-3L and Y-5L for use in Singapore and to assess the content validity, specifically, the relevance and comprehensiveness of the EQ-5D-Y descriptive system (DS) in Asia.

METHODS

To culturally adapt the instruments, an expert panel consisting of paediatricians and primary school educators were consulted. Modifications suggested by the expert panel were tested via cognitive debriefing interviews with children aged 8-12 in Singapore. To assess the content validity of the EQ-5D-Y DS, interviews were conducted with both healthy (n = 8) and ill children (n = 6) aged 8-15. In the interviews, children discussed their experience with poor health and commented on the comprehensiveness and relevance of the EQ-5D-Y DS.

RESULTS

The cross-cultural adaptation process led to minor modifications to the UK English Y-3L and Y-5L versions, including using phrases familiar to the local children and adding examples to facilitate understanding. The five health dimensions in the EQ-5D-Y DS were spontaneously elicited when children discussed their experience with poor health. All health dimensions related to poor health elicited from the interviews fell into three broad categories: physical health (e.g. Appetite, Mobility, and Sleep), mental well-being (e.g. Annoyed/Frustrated and Scared/Worried), and social relationships (e.g. Family and Friends). The EQ-5D-Y DS was generally found to be relevant and comprehensive, although some health dimensions that may be relevant to the local population (Social relationship and Appetite) were not covered.

CONCLUSIONS

The UK English EQ-5D-Y instruments were adapted to produce the Singapore English EQ-5D-Y instrument that were comprehensible to local children as young as 8 years old. The EQ-5D-Y DS was generally relevant and comprehensive to measure poor health of local children. Future studies should ascertain the benefits of adding bolt-on items related to social relationships and appetite to the EQ-5D-Y DS.

Comparing Generic Paediatric Health-Related Quality-of-Life Instruments: A Dimensionality Assessment Using Factor Analysis

BACKGROUND

Widely used generic instruments to measure paediatric health-related quality of life (HRQoL) include the EQ-5D-Y-5L, Child Health Utility 9 Dimension (CHU-9D), Paediatric Quality of Life Inventory (PedsQL) and Health Utilities Index (HUI). There are similarities and differences in the content of these instruments, but there is little empirical evidence on how the items they contain relate to each other, and to an overarching model of HRQoL derived from their content.

OBJECTIVE

This study aimed to explore the dimensionality of the instruments using exploratory factor analysis (EFA).

METHODS

Data from the Australian Paediatric Multi-Instrument Comparison (P-MIC) Study were used. EQ-5D-Y-5L, CHU-9D, PedsQL and HUI data were collected via proxy or child self-report data. EFA was used to investigate the underlying domain structure and measurement relationship. Items from the four instruments were pooled and domain models were identified for self- and proxy-reported data. The number of factors was determined based on eigenvalues greater than 1. A correlation cut-off of 0.32 was used to determine item loading on a given factor, with cross-loading also considered. Oblique rotation was used.

RESULTS

Results suggest a six-factor structure for the proxy-reported data, including emotional functioning, pain, daily activities, physical functioning, school functioning, and senses, while the self-report data revealed a similar seven-factor structure, with social functioning emerging as an additional factor.

CONCLUSION

We provide evidence of differences and similarities between paediatric HRQoL instruments and the aspects of health being measured by these instruments. The results identified slight differences between self- and proxy-reported data in the relationships among items within the resulting domains.

Systematic Review of the Psychometric Performance of Generic Childhood Multi-attribute Utility Instruments

BACKGROUND

Childhood multi-attribute utility instruments (MAUIs) can be used to measure health utilities in children (aged ≤ 18 years) for economic evaluation. Systematic review methods can generate a psychometric evidence base that informs their selection for application. Previous reviews focused on limited sets of MAUIs and psychometric properties, and only on evidence from studies that directly aimed to conduct psychometric assessments.

OBJECTIVE

This study aimed to conduct a systematic review of psychometric evidence for generic childhood MAUIs and to meet three objectives: (1) create a comprehensive catalogue of evaluated psychometric evidence; (2) identify psychometric evidence gaps; and (3) summarise the psychometric assessment methods and performance by property.

METHODS

A review protocol was registered with the Prospective Register of Systematic Reviews (PROSPERO; CRD42021295959); reporting followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline. The searches covered seven academic databases, and included studies that provided psychometric evidence for one or more of the following generic childhood MAUIs designed to be accompanied by a preference-based value set (any language version): 16D, 17D, AHUM, AQoL-6D, CH-6D, CHSCS-PS, CHU9D, EQ-5D-Y-3L, EQ-5D-Y-5L, HUI2, HUI3, IQI, QWB, and TANDI; used data derived from general and/or clinical childhood populations and from children and/or proxy respondents; and were published in English. The review included 'direct studies' that aimed to assess psychometric properties and 'indirect studies' that generated psychometric evidence without this explicit aim. Eighteen properties were evaluated using a four-part criteria rating developed from established standards in the literature. Data syntheses identified psychometric evidence gaps and summarised the psychometric assessment methods/results by property.

RESULTS

Overall, 372 studies were included, generating a catalogue of 2153 criteria rating outputs across 14 instruments covering all properties except predictive validity. The number of outputs varied markedly by instrument and property, ranging from 1 for IQI to 623 for HUI3, and from zero for predictive validity to 500 for known-group validity. The more recently developed instruments targeting preschool children (CHSCS-PS, IQI, TANDI) have greater evidence gaps (lack of any evidence) than longer established instruments such as EQ-5D-Y, HUI2/3, and CHU9D. The gaps were prominent for reliability (test-retest, inter-proxy-rater, inter-modal, internal consistency) and proxy-child agreement. The inclusion of indirect studies (n = 209 studies; n = 900 outputs) increased the number of properties with at least one output of acceptable performance. Common methodological issues in psychometric assessment were identified, e.g., lack of reference measures to help interpret associations and changes. No instrument consistently outperformed others across all properties.

CONCLUSION

This review provides comprehensive evidence on the psychometric performance of generic childhood MAUIs. It assists analysts involved in cost-effectiveness-based evaluation to select instruments based on the application-specific minimum standards of scientific rigour. The identified evidence gaps and methodological issues also motivate and inform future psychometric studies and their methods, particularly those assessing reliability, proxy-child agreement, and MAUIs targeting preschool children.

Measurement Properties of the EQ-5D-Y: A Systematic Review

OBJECTIVES

This study aimed to perform a systematic review of published evidence on the psychometric properties of 3-level version of EQ-5D-Y and 5-level version of EQ-5D-Y (EQ-5D-Y-5L).

METHODS

A literature search on the MEDLINE, Embase, and EuroQol website (until June 2021) was conducted. Original studies on EQ-5D-Y psychometric properties such as feasibility, distribution properties (ceiling and floor effects), reliability (test-retest, interrater, intermodal), validity (known-groups, convergent), and responsiveness, published as full-text articles in English, were included. Studies on experimental EQ-5D-Y versions were excluded. The following data were pooled using random effects models: missing values, the ceiling effect, and correlations coefficients with other measures.

RESULTS

A total of 47 studies (inclusive of 7 on EQ-5D-Y-5L) containing data from 45 310 children and 2690 proxy respondents representing 15 countries were included. These studies were characterized as being high quality according to the quality index. The most represented areas were school populations and musculoskeletal diseases and orthopedics. The EQ-5D-Y dimensions, EQ visual analog scale, and EQ index were reported in 89%, 77%, and 26% of studies, respectively. Most articles addressed validity (known-groups, n = 27; convergent, n = 21) and reliability (test-retest and interrater, n = 10 each). Convergent validity studies showed that, where the assessment of the child's functioning at school is required, EQ-5D-Y should be supplemented with other school-specific measures.

CONCLUSIONS

This systematic review provides a summary of measurement properties and the psychometric performance of 3-level version of EQ-5D-Y and EQ-5D-Y-5L. The existing evidence supports using the EQ-5D-Y descriptive system and EQ visual analog scale in children and adolescent populations. Further research on test-retest reliability and the responsiveness of the EQ-5D-Y index obtained with child-specific value sets is needed.