Development of a parent-report cognitive function item bank using item response theory and exploration of its clinical utility in computerized adaptive testing

Using ECHO program data to develop a brief measure of caregiver support and cognitive stimulation using the home observation for measurement of the environment-infant/toddler (HOME-IT)

Data from three NIH Environmental influences on Child Health Outcomes (ECHO) Program cohorts that collected the HOME-Infant-Toddler (HOME-IT age 0-3 years) version were used to examine the reliability of a brief scale of caregiver support and cognitive stimulation. Participants with HOME-IT data (N = 2518) were included in this analysis. Mean child age at HOME-IT assessment was 1.51 years, 48% of children were female, and 43% of children identified as Black. A four-stage analysis plan was used to evaluate item response theory assumptions, item response theory model fit, monotonicity, scalability, item fit, and differential item functioning. Results indicate the feasibility of developing a reliable 10-item scale (reliability >0.7) with particularly high precision for children with lower levels of cognitive stimulation.

From Evidence-Based Guidelines to Clinical Practice: Pediatric Neuropsychology Care in Multidisciplinary Clinics

OBJECTIVE

High demand for pediatric neuropsychological care has highlighted the time- and resource-intensive nature of traditional comprehensive evaluations. Emerging care models address these constraints by facilitating tiered neuropsychological services provided in various contexts, including multidisciplinary clinics (MDCs). We aim to demonstrate feasibility and acceptability of tiered neuropsychological care in MDCs through examples from a single institution.

METHODS

A review of all current MDC practices at a tertiary pediatric care center was conducted to describe clinic workflow, services provided, and triage strategies. Pediatric neuropsychologists (n = 5) and other health care providers (n = 31) completed a survey focused on experience with neuropsychology consultation in MDCs.

RESULTS

Neuropsychologists provided care in 11 MDCs, including universal monitoring with consultative interviews and questionnaires, as well as targeted screening. Neuropsychologists (89%) and other health professionals (100%) reported that tiered neuropsychological services improved patient care within MDCs. Other health professionals reported utilizing results from neuropsychology MDC care to inform their clinical approach (48-90%), referrals (58%), and treatment or surveillance decisions (55-71%).

CONCLUSION

Tiered neuropsychological care in pediatric MDCs is feasible, and provider experience ratings indicate high acceptability. Practical steps for development of MDCs are provided, including identifying teams, clinic goals and outcomes, operational logistics, and billing.

Development of an International Standard Set of Outcomes and Measurement Methods for Routine Practice for Infants, Children, and Adolescents with Epilepsy: The International Consortium for Health Outcomes Measurement Consensus Recommendations

At present, there is no internationally accepted set of core outcomes or measurement methods for epilepsy clinical practice. The International Consortium for Health Outcomes Measurement (ICHOM) convened an international working group of experts in epilepsy, people with epilepsy, and their representatives to develop minimum sets of standardized outcomes and outcome measurement methods for clinical practice. Using modified Delphi consensus methods with consecutive rounds of online voting over 12 months, a core set of outcomes and corresponding measurement tool packages to capture the outcomes were identified for infants, children, and adolescents with epilepsy. Consensus methods identified 20 core outcomes. In addition to the outcomes identified for the ICHOM Epilepsy adult standard set, behavioral, motor, and cognitive/language development outcomes were voted as essential for all infants and children with epilepsy. The proposed set of outcomes and measurement methods will facilitate the implementation of the use of patient-centered outcomes in daily practice.

Recent Advances in Neuropsychological Test Interpretation for Clinical Practice

Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.

A Narrative Review of Patient-Reported Outcome Measures and Their Application in Recent Pediatric Surgical Research: Advancing Knowledge and Offering New Perspectives to the Field

INTRODUCTION

 Patient-reported outcome measures (PROMs) can be employed in both research and clinical care to enhance our understanding of outcomes that matter to patients. This narrative review aims to describe PROM use in recent pediatric surgical research, identify and describe psychometrically robust PROMs, providing an overview of those derived from pediatric patient input, and make recommendations for future research.

MATERIALS AND METHODS

 A search was conducted to identify articles published from 2021 to August 2023 describing the availability and/or use of at least one valid or reliable PROM in children with conditions including anorectal malformations, biliary atresia, congenital diaphragmatic hernia, duodenal atresia, esophageal atresia, abdominal wall defects, Hirschsprung's disease, sacrococcygeal teratoma, and short bowel syndrome. Articles were categorized based on their objectives in applying PROMs. Psychometrically robust PROMs were identified and described.

RESULTS

 Out of the 345 articles identified, 49 met the inclusion criteria. Seventeen focused on esophageal atresia and 14 on Hirschsprung's disease. Twenty-nine PROMs were identified, with 12 deemed psychometrically robust. Seven psychometrically robust PROMs were developed using patient input in the primary item generation. Most PROMs were applied to advance understanding of conditions and/or treatment and fewer were developed or psychometrically evaluated. No PROMs were assessed for their impact or incorporated into an implementation study.

CONCLUSIONS

 This review reveals gaps in the application of PROMs in recent pediatric surgical research. Emphasis should be placed on the development and utilization of psychometrically robust PROMs, broadening the scope of covered diseases, conducting impact assessments, and evaluating implementation strategies.

Assessing quality of life in childhood cancer survivors at risk for hearing loss: a comparison of HEAR-QL and PROMIS measures

Background

Childhood cancer survivors (CCS) exposed to platinum chemotherapy are at an increased risk of developing hearing loss and reporting decreased quality of life (QOL). This study compared two QOL measures; one developed for children with hearing loss, The Hearing Environments and Refection on Quality of Life (HEAR-QL), and one validated in CCS, the Patient-Reported Outcomes Measurement Information System (PROMIS), to assess their ability to evaluate QOL deficits in this population.

Methods

Subject eligibility were restricted to CCS exposed to platinum-based chemotherapy but who were free of known risk factors for cognitive impairment, (non-central nervous system tumor, no cranial radiation, or intrathecal chemotherapy). Participants had to be between 8-17 years, have completed anti-cancer therapy for at least 6 months, and have an audiogram within 1 year, Participants completed the HEAR-QL-26 (7-12 years) or the HEAR-QL-28 (13-18 years) and the PROMIS. Independent samples and/or one sample T-tests were utilized to compare participants with normal hearing and hearing loss, and to compare outcome measures to normative HEAR-QL and PROMIS data. Non-parametric correlations were utilized to evaluate the relationship between QOL and demographic and medical variables, and QOL and severity of hearing loss.

Results

Fifty-four CCS were evaluable. The mean age was 12.0 years. Twenty-eight participants (51.9%) received cisplatin, 30 (55.6%) carboplatin, and 4 (7.4%) received both. Twenty participants (37%) demonstrated hearing loss. Participants with hearing loss scored significantly lower on the HEAR-QL than those with normal hearing (mean: 70.3, SD: 21.7, vs mean: 88.0, SD: 9.3, p =.004 for the HEAR-QL-26; mean: 84.7, SD: 10.2 vs mean: 94.8, SD: 3.4, p =.040 for the HEAR-QL-28). Participants with normal hearing scored significantly lower on the HEAR-QL-26 than the normative mean (mean: 88, SD: 9.3, normative mean: 98, SD: 5, p =.000). The PROMIS failed to identify any differences in QOL between participants based on hearing status, or when compared to the normative mean.

Conclusion

The HEAR-QL was more sensitive than the PROMIS in identifying QOL deficits in CCS at risk for hearing loss. The HEAR-QL should be considered in studies seeking to improve the QOL of CCS with hearing loss.

Prevalence and assessment tools of cancer-related cognitive impairment in lung cancer survivors: a systematic review and proportional meta-analysis

PURPOSE

Cancer-related cognitive impairment (CRCI) is a significant risk factor influencing the quality of life in lung cancer survivors. No absolute assessment tool has been confirmed to assess CRCI in lung cancer survivors. This review was undertaken to pool the overall prevalence of CRCI and to summarize the assessment tools in assessing CRCI among lung cancer survivors.

METHODS

PubMed, Cochrane Library, Embase, CINAHL, and CNKI were searched to retrieve articles reported CRCI prevalence. Summary prevalence estimates were pooled using a random effects model, along with corresponding 95% prediction intervals (PIs). The Freeman-Tukey double arcsine transformation of proportions was incorporated in the analysis. Additionally, subgroup analysis, meta-regression, and leave-one-out analysis were performed.

RESULTS

A total of 12 studies, involving 1934 survivors, were included in the review. All of these studies were found to have a low risk of bias in terms of their methodological quality. Four studies (33.3%) utilized the International Cognition and Cancer Task Force (ICCTF) criteria to identify CRCI through neuropsychological tests. The pooled prevalence rate of CRCI was found to be 26% (95% PI, 16-37%), I2 = 95.97%. The region in which the studies were conducted was identified as a significant factor contributing to this heterogeneity (p = 0.013). No indication of small-study effects was found (Egger's test: p = 0.9191).

CONCLUSION

This review provides an overview of CRCI prevalence and assessment tools in lung cancer survivors. The findings can serve as epidemiological evidence to enhance clinicians' and researchers' understanding of early detection and assessment.

Engaging carers in neuropsychological rehabilitation for brain cancer survivors: The "I'm aware: Patients And Carers Together" (ImPACT) program

BACKGROUND

Cognitive impairment is a common late effect in child and adult brain cancer survivors (BCS). Still, there is a dearth of research aimed at therapeutic interventions and no standard treatment options for most BCS.

OBJECTIVE

To describe 1) a novel neuropsychological rehabilitation program for BCS - the "I'm aware: Patients And Carers Together" (ImPACT) program, and 2) two studies that aim to assess the feasibility of the ImPACT program in child and adult BCS, respectively. The program adapts the holistic neuropsychological approach pioneered by Leonard Diller and Yehuda Ben-Yishay to an outpatient setting.

METHODS

Two feasibility studies are described: 1) A single-armed study with 15 child BCS (10-17 years) (ImPACT Child); and 2) a randomized waitlist-controlled trial with 26 adult BCS (>17 years) (ImPACT Adult). In both studies, patients will undergo an 8-week program together with a cohabiting carer. Primary outcomes (i.e., cognitive and neurobehavioral symptoms), and secondary outcomes (i.e., behavioral and psychological symptoms, e.g., quality of life, fatigue) will be assessed at four time points: pre-, mid-, and post intervention, and 8 weeks follow-up. Adult waitlist controls will be assessed at equivalent time points and will be included in the intervention group after all study assessments. Semi-structured interviews will be conducted at follow-up.

EXPECTED OUTCOMES

Results will provide feasibility data in support of future larger scale trials.

DISCUSSION

The findings could potentially improve the management of cognitive impairment in BCS and transform available services. The program can be delivered in-person or remotely and harnesses existing resources in patients' lives.

Neurodevelopmental outcomes in children and adults with Fetal Valproate Spectrum Disorder: A contribution from the ConcePTION project

AIM

To describe the neurodevelopmental phenotype of older children and adults with a diagnosis of Fetal Valproate Spectrum Disorder (FVSD).

METHODS

In this cross-sectional study, 90 caregivers were recruited and completed a series of questionnaires regarding the neurodevelopmental outcomes of 146 individuals aged 7-37 years (M = 18.1), including individuals with a formal diagnosis of FVSD (n = 99), individuals exposed to Valproate but without an FVSD diagnosis (n = 24), and individuals not exposed to Valproate (N = 23). The mean dose of valproate exposure for individuals with an FVSD diagnosis was 1470 mg/day.

RESULTS

Individuals with a diagnosis of FVSD showed significantly higher levels of moderate (43.4%) and severe (14.4%) cognitive impairment than other groups (p = 0.003), high levels of required formal educational support (77.6%), and poorer academic competence than individuals not exposed to Valproate (p = 0.001). Overall psychosocial problems (p = 0.02), internalising problems (p = 0.05) and attention problems (p = 0.001), but not externalising problems, were elevated in individuals with a diagnosis of FVSD. Rates of neurodevelopmental disorders, particularly autistic spectrum disorders (62.9%) and sensory problems (80.6%) are particularly central to the FVSD phenotype. There was no evidence of a statistical dose-dependent effect, possibly due to the high mean dose of exposure having a uniformly negative impact across the sample. Individuals with FVSD had required a significant number of health and child development services.

INTERPRETATION

Children and young adults with a diagnosis of FVSD are at an increased risk of a range of altered neurodevelopmental outcomes, highlighting the need for a multidisciplinary approach to clinical management across the lifespan.

The challenges of classical galactosemia: HRQoL in pediatric and adult patients

BACKGROUND

Classical galactosemia (CG), an inborn error of galactose metabolism, results in long-term complications including cognitive impairment and movement disorders, despite early diagnosis and dietary treatment. Two decades ago, lower motor-, cognitive- and social health related quality of life (HRQoL) was demonstrated in pediatric and adult patients. Since then, the diet has been relaxed, newborn screening was implemented and new international guidelines resulted in major changes in follow-up. The aim of this study was to assess HRQoL of CG by means of online self- and/or proxy-HRQoL-questionnaires focusing on the main areas of concern of CG (i.e. anxiety, depression, cognition, fatigue, social- and upper extremity function) within the patient-reported outcomes measurement information system (PROMIS®) and generic HRQoL-questionnaires (TAPQOL, TACQOL, TAAQOL).

RESULTS

Data of 61 Dutch patients (aged 1-52 years) were collected and compared to available Dutch or US reference populations. On the PROMIS-questionnaires, children reported more fatigue (P = 0.044), lower function in upper extremities (P = 0.021), more cognitive difficulties (P = 0.055, d = 0.56) and higher anxiety (P = 0.063, d = 0.52) than reference children although the latter findings remained non-significant. Parents of CG patients reported lower quality of peer relationships of their children (P < 0.001). Both children and parents reported lower cognitive functioning (P = 0.005, P = 0.010) on the TACQOL. Adults reported on PROMIS domains lower cognitive functioning (P = 0.030), higher anxiety (P = 0.004) and more fatigue (P = 0.026). Cognitive difficulties were reported on the TAAQOL by adults (P < 0.001), as well as physical-, sleeping and social difficulties.

CONCLUSIONS

CG remains to impact the HRQoL of pediatric and adult patients negatively on several domains including cognition, anxiety, motor function and fatigue. A lower social health was mainly reported by parents, and not by patients themselves. The Covid-19 pandemic might have amplified the results on anxiety although higher levels of anxiety fit pre-pandemic findings. The reported fatigue is a new finding in CG. Because the effect of lockdown fatigue could not be eliminated and fatigue is a frequent finding in patients with chronic disorders, future studies are warranted. Clinicians and researchers should be attentive to both pediatric and adult patients, and the age-dependent difficulties they might encounter.

It’s time to talk fathers: The impact of paternal depression on parenting style and child development during the COVID-19 pandemic

This study aimed to understand the relationship between paternal depression, parenting behavior and child developmental outcomes during the SARS-CoV-2 (COVID) pandemic. In addition, the paternal experience of the pandemic, such as the impact of lockdowns, was explored. Fathers of children aged 6–11 years old (n = 87) were recruited for an online cross-sectional survey. Data was collected through questionnaires and open-ended comments. Regression analysis indicated a higher level of self-reported depressive symptomology in fathers more severely impacted by the pandemic across financial, familial and health domains. Further, COVID-19 impact, but not paternal depression, was linked to fewer authoritative parenting behaviors, characterized as lower warmth and responsiveness. Paternal pandemic impact and depression symptoms were independently predictive of child cognitive scores, and both were associated with emotional and behavioral outcomes. A content analysis of open-ended responses from fathers noted that concerns for their children, work and mental health were most prevalent during the pandemic. However, several responders also reported no change or positive facets of lockdowns related to the pandemic. These finds are discussed in the context of a possible behavioural mechanism of action accounting for the effect of these factors on child development. Clinical implications include targeted interventions for at risk groups as well as psychoeducation for fathers that acknowledge difference in paternal coping and support seeking.

A Core Outcome Measurement Set for Pediatric Critical Care

OBJECTIVES

To identify a PICU Core Outcome Measurement Set (PICU COMS), a set of measures that can be used to evaluate the PICU Core Outcome Set (PICU COS) domains in PICU patients and their families.

DESIGN

A modified Delphi consensus process.

SETTING

Four webinars attended by PICU physicians and nurses, pediatric surgeons, rehabilitation physicians, and scientists with expertise in PICU clinical care or research ( n = 35). Attendees were from eight countries and convened from the Pediatric Acute Lung Injury and Sepsis Investigators Pediatric Outcomes STudies after PICU Investigators and the Eunice Kennedy Shriver National Institute of Child Health and Human Development Collaborative Pediatric Critical Care Research Network PICU COS Investigators.

SUBJECTS

Measures to assess outcome domains of the PICU COS are as follows: cognitive, emotional, overall (including health-related quality of life), physical, and family health. Measures evaluating social health were also considered.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Measures were classified as general or additional based on generalizability across PICU populations, feasibility, and relevance to specific COS domains. Measures with high consensus, defined as 80% agreement for inclusion, were selected for the PICU COMS. Among 140 candidate measures, 24 were delineated as general (broadly applicable) and, of these, 10 achieved consensus for inclusion in the COMS (7 patient-oriented and 3 family-oriented). Six of the seven patient measures were applicable to the broadest range of patients, diagnoses, and developmental abilities. All were validated in pediatric populations and have normative pediatric data. Twenty additional measures focusing on specific populations or in-depth evaluation of a COS subdomain also met consensus for inclusion as COMS additional measures.

CONCLUSIONS

The PICU COMS delineates measures to evaluate domains in the PICU COS and facilitates comparability across future research studies to characterize PICU survivorship and enable interventional studies to target long-term outcomes after critical illness.

Parent-Reported Perceived Cognitive Functioning Identifies Cognitive Problems in Children Who Survived Neonatal Critical Illness

Children with congenital anatomical foregut anomalies and children treated with neonatal extracorporeal membrane oxygenation (ECMO) are at risk for neurocognitive morbidities. We evaluated the association between the parent-reported pediatric perceived cognitive functioning (PedsPCF) questionnaire and the parent-reported behavior rating inventory of executive function (BRIEF) as well as neuropsychological assessments (NPA). We included 8-, 12- and 17-year-old participants who had joined a prospective follow-up program between 2017 and 2019. Self- and parental proxy-reported PedsPCF and proxy-reported BRIEF scores and their mutual association were evaluated. In total, 168 participants were included. Self- and proxy-reported PedsPCF scores were significantly below normal (mean (SD) z-score: −0.35 (0.88), p < 0.001; −0.36 (1.06), p < 0.001, respectively). Total BRIEF scores were significantly above normal (mean (SD) z-score 0.33 (0.98), p < 0.001). Proxy-reported PedsPCF scores and the Metacognition Index subscores of the BRIEF correlated strongly (τ = 0.551, p < 0.001). Self-reported PedsPCF scores were not associated with NPA test scores. Proxy-reported PedsPCF scores were positively associated with multiple NPA test scores, especially intelligence (R2 = 0.141). The proxy-reported PedsPCF revealed cognitive problems more often than the BRIEF in school-aged children who had survived neonatal critical illness. The proxy-reported PedsPCF may support clinical decision-making regarding the need for extensive neuropsychological assessments.

Measuring PROMIS® Physical Activity and Sleep Problems in Early Childhood

OBJECTIVE

Physical activity (PA) and sleep are leading health indicators for individuals of all ages. Monitoring young children's PA and sleep using psychometrically sound instruments could help facilitate timely interventions to promote healthy development. This article describes the development of the PROMIS® Early Childhood (EC) Parent Report Physical Activity (PA) and Sleep Problems (SP) measures for children aged 1-5 years.

METHODS

Item pools were generated by interviewing parents, input from content experts, and literature review. Data from a U.S. general population sample were used to determine factor structures of item pools via factor analytic approaches, estimate item parameters via item response theory (IRT) models, and establish norms. Pearson correlations were used to evaluate across-domain associations. Analysis of variance was used and known-groups' validity of PA and SP by comparing their scores to PROMIS EC Parent Report Global Health: child's physical, emotional, and mental conditions.

RESULTS

Initial item pools consisted of 19 and 26 items for PA and SP, respectively. Factor analyses' results supported unidimensionality of 5 and 16 items measuring PA and SP, respectively, which were then calibrated using IRT. Norms were established by centering to a probability-based U.S. general population. Computerized adaptive testing algorithms were established. Some analyses supported initial measure validity.

CONCLUSIONS

The PROMIS EC PA calibrated scale and SP item banks are user-friendly and brief, yet produce precise scores. Both measures enable psychometrically sound assessment of PA behavior and sleep problems. Future studies to comprehensively evaluate the validity of these two measures are warranted.

The CLASS Study (Circadian Light in Adolescence, Sleep and School): protocol for a prospective, longitudinal cohort to assess sleep, light, circadian timing and academic performance in adolescence

BACKGROUND

During adolescence, sleep and circadian timing shift later, contributing to restricted sleep duration and irregular sleep-wake patterns. The association of these developmental changes in sleep and circadian timing with cognitive functioning, and consequently academic outcomes, has not been examined prospectively. The role of ambient light exposure in these developmental changes is also not well understood. Here, we describe the protocol for the Circadian Light in Adolescence, Sleep and School (CLASS) Study that will use a longitudinal design to examine the associations of sleep-wake timing, circadian timing and light exposure with academic performance and sleepiness during a critical stage of development. We also describe protocol adaptations to enable remote data collection when required during the COVID-19 pandemic.

METHODS

Approximately 220 healthy adolescents aged 12-13 years (school Year 7) will be recruited from the general community in Melbourne, Australia. Participants will be monitored at five 6 monthly time points over 2 years. Sleep and light exposure will be assessed for 2 weeks during the school term, every 6 months, along with self-report questionnaires of daytime sleepiness. Circadian phase will be measured via dim light melatonin onset once each year. Academic performance will be measured via national standardised testing (National Assessment Program-Literacy and Numeracy) and the Wechsler Individual Achievement Test-Australian and New Zealand Standardised Third Edition in school Years 7 and 9. Secondary outcomes, including symptoms of depression, anxiety and sleep disorders, will be measured via questionnaires.

DISCUSSION

The CLASS Study will enable a comprehensive longitudinal assessment of changes in sleep-wake timing, circadian phase, light exposure and academic performance across a key developmental stage in adolescence. Findings may inform policies and intervention strategies for secondary school-aged adolescents.

ETHICS AND DISSEMINATION

Ethical approval was obtained by the Monash University Human Research Ethics Committee and the Victorian Department of Education. Dissemination plans include scientific publications, scientific conferences, via stakeholders including schools and media.

STUDY DATES

Recruitment occurred between October 2019 and September 2021, data collection from 2019 to 2023.

Psychometric Considerations in Developing PROMIS® Measures for Early Childhood

OBJECTIVE

The early expression of lifespan health and disease states can often be detected in early childhood. Currently, the Patient-Reported Outcome Measurement Information System (PROMIS®) includes over 300 measures of health for individuals ages 5 years and older. We extended PROMIS to early childhood by creating developmentally appropriate, lifespan coherent parent-report measures for 1-5-year-olds. This paper describes the psychometric approaches used for these efforts.

METHODS

2 waves of data from parents of children ages 1-5 were collected via 2 internet panel companies. Wave 1 data (n = 1,400) were used to evaluate item pool unidimensionality, model fit, and initial item parameters. Combined data from wave 1 and wave 2 (reference sample; n = 1,057) were used to estimate final item parameters. Using item response theory methods, we developed and tested 12 item pools: Global Health, Physical Activity, Sleep Disturbance, Sleep-related Impairment, Anger/Irritability, Anxiety, Depressive Symptoms, Positive Affect, Self-Regulation, Engagement, Family Relationships, and Peer Relationships.

RESULTS

Wave 1 analyses supported the unidimensionality of Physical Activity, Positive Affect, Anger/Irritability, Anxiety, Depressive Symptoms, and Global Health. Family Relationships and Peer Relationships were combined to form "Social Relationships"; Sleep Disturbance and Sleep-related Impairment were combined to form "Sleep Problems." Self-Regulation was divided into "Flexibility" and "Frustration Tolerance"; Engagement was divided into "Curiosity" and "Persistence." Short forms were developed for item banks with more than 10 items; and.

CONCLUSIONS

Using rigorous mixed-methods, we successfully extended PROMIS to early childhood (1-5-year-olds). Measures are now publicly available in English and Spanish (www.healthmeasures.net).

Using Patient-Reported Outcome Measures to Screen for Cognitive Function Deficits and Stigma in Patients with Single-Suture Craniosynostosis

SUMMARY

Children with single-suture craniosynostosis have small but significant deficits in appearance ratings and neurodevelopment. Traditionally, these parameters are studied using a full battery of examinations, which are very time consuming. This study evaluated a convenient method to measure psychosocial parameters in this population by utilizing patient-reported outcomes measures to evaluate cognitive function and stigma. Stigma and cognitive function were measured, using the Patient-Reported Outcomes Measurement Information System and Quality of Life in Neurological Disorders questionnaires, in 59 consecutive patients at least 5 years old presenting to clinic from July of 2018 to January of 2020 with repaired single-suture craniosynostosis. Parents completed parent proxy cognitive function surveys for patients under age 8. Questionnaires were administered electronically as part of clinical care. Scores were automatically transferred to the electronic medical record and correlated with previously acquired Child Behavior Checklist results. Median time to complete the questionnaires was 57 and 49 seconds, respectively. Stigma and cognitive function were significantly correlated with the associated Child Behavior Checklist subscores (Spearman's rho, -0.384, p = 0.023; and Spearman's rho, -0.683, p = 0.001, respectively). The Patient-Reported Outcomes Measurement Information System and Quality of Life in Neurological Disorders questionnaires offer a convenient method of screening psychosocial parameters in children with single-suture craniosynostosis that otherwise would be difficult to obtain during standard visits. Short completion times and electronic scoring increase clinical utility.

CLINICAL QUESTION/LEVEL OF EVIDENCE

Diagnostic, II.

Incorporating patient-centered quality-of-life measures for outcome assessment after Chiari malformation type I decompression in a pediatric population: a pilot study

OBJECTIVE

Optimal management of pediatric Chiari malformation type I (CM-I) is much debated, chiefly due to the lack of validated tools for outcome assessment, with very few tools incorporating patient-centered measures of health-related quality of life (HRQOL). Although posterior fossa decompression (PFD) benefits a subset of patients, prediction of its impact across patients is challenging. The primary aim of this study was to investigate the role of patient-centered HRQOL measures in the assessment and prediction of outcomes after PFD.

METHODS

The authors collected HRQOL data from a cohort of 20 pediatric CM-I patients before and after PFD. The surveys included assessments of selected Patient-Reported Outcomes Measurement Information System (PROMIS) health domains and were used to generate the PROMIS preference (PROPr) score, which is a measure of HRQOL. PROMIS is a reliable standardized measure of HRQOL domains such as pain, fatigue, depression, and physical function, which are all relevant to CM-I. The authors then compared the PROPr scores with Chicago Chiari Outcome Scale (CCOS) scores derived from time-matched clinical documentation. Finally, the authors used the PROPr scores as an outcome measure to predict postsurgical HRQOL improvement at 1 year on the basis of patient demographic characteristics, comorbidities, and radiological and physical findings. The Wilcoxon signed-rank test, Mann-Whitney U-test, and Kendall's correlation were used for statistical analysis.

RESULTS

Aggregate analysis revealed improvement of pain severity after PFD (p = 0.007) in anatomical patterns characteristic of CM-I. Most PROMIS domain scores trended toward improvement after surgery, with anxiety and pain interference reaching statistical significance (p < 0.002 and p < 0.03, respectively). PROPr scores also significantly improved after PFD (p < 0.008). Of the baseline patient characteristics, preexisting scoliosis was the most accurate negative predictor of HRQOL improvement after PFD (median -0.095 vs 0.106, p < 0.001). A correlation with modest magnitude (Kendall's tau range 0.19-0.47) was detected between the patient-centered measures and CCOS score.

CONCLUSIONS

The authors observed moderate improvement of HRQOL, when measured using a modified panel of PROMIS question banks, in this pilot cohort of pediatric CM-I patients after PFD. Further investigations are necessary to validate this tool for children with CM-I and to determine whether these scores correlate with clinical and radiographic findings.

Neuropsychological Screening in Pediatric Multidisciplinary Clinics: Group Characteristics and Predictive Utility

OBJECTIVE

To evaluate the feasibility of administering caregiver-report neuropsychological screening measures in pediatric multidisciplinary clinics (MDCs) and investigate predictive utility for cognitive and academic difficulties on follow-up testing.

METHOD

The Pediatric Perceived Cognitive Functioning (Peds PCF) and Colorado Learning Difficulties Questionnaire (CLDQ) were administered to caregivers of youth with history of brain tumor (BT), non-central nervous system (CNS) cancer, or Fontan circulation as part of routine neuropsychological consultation in MDCs from 2017 to 2019. We examined cross-sectional differences on screening measures, and relationships between screening and intellectual and academic test performance in a subset who presented for follow-up neuropsychological evaluation. Receiver operating characteristic (ROC) curve analysis was used to identify suggested cut scores on screening measures for predicting who would most benefit from further evaluation.

RESULTS

Screening was completed with 192 families. Children with history of non-CNS cancer (n = 29) had fewer parent-reported cognitive and academic concerns compared with either BT (n = 88) or Fontan (n = 75) groups. Peds PCF and CLDQ scores were related to intellectual and academic test performance in the group presenting for neuropsychological evaluation (n = 68). ROC curve analysis identified cut scores across screening measures with maximal sensitivity and specificity for detecting neuropsychological difficulties.

CONCLUSIONS

It is feasible to utilize parent rating measures during neuropsychological consultation in pediatric MDCs. The Peds PCF and CLDQ demonstrated sensitivity to intellectual and academic difficulties in children with significant medical histories. Screening may be a helpful tool for pediatric neuropsychologists and other professionals during MDC consultation to inform clinical management.

Generation and Validation of the PROMIS Itch Questionnaire - Child to Measure the Impact of Itch on Life Quality

Itch compromises quality of life, but most itch assessments focus only on itch intensity. We aimed to develop and validate a comprehensive PROMIS (Patient Reported Outcomes Measurement Information System®) pediatric measure for itch symptoms and itch impact, defined as the effect specifically of itch on physical, mental, and social health, all of which can affect life quality. After literature review, concept elicitation and cognitive interviews with parents and children with itch, and repeated content-expert review, an item pool was generated and refined. The pool was calibrated with data from 499 pruritic children using exploratory and confirmatory factor analyses, item response theory, and item fit analysis. The resultant 45-item bank, PROMIS Itch Questionnaire - Child (PIQ-C), showed good convergent and discriminant validity in 181 children 8-17 years of age, discriminating children with different levels of severity, and was responsive to change. Strong correlations (rho>.60) were observed with pain and sleep measures, and moderate correlations with other pediatric PROMIS measures. PIQ-C comprehensively measures itch intensity and burden, providing an itch-specific alternative for assessing life quality. The independent calibration of each item/question allows for flexibility in generating short-forms or computerized adaptive testing for efficient use in research and office practice.

Measuring Self-Reported Cancer-Related Cognitive Impairment: Recommendations From the Cancer Neuroscience Initiative Working Group

Cancer and its treatments are associated with increased risk for cancer-related cognitive impairment (CRCI). Methods and measures used to study and assess self-reported CRCI (sr-CRCI), however, remain diverse, resulting in heterogeneity across studies. The Patient-Reported Outcomes Working Group has been formed to promote homogeneity in the methods used to study sr-CRCI. In this report, using a psychometric taxonomy, we inventory and appraise instruments used in research to measure sr-CRCI, and we consider advances in patient-reported outcome methodology. Given its psychometric properties, we recommend the Patient-Reported Outcome Measurement Information System Cognitive Function Short Form 8a for measurement of sr-CRCI in cancer patients and survivors, at a minimum, to increase scientific rigor and progress in addressing CRCI.

Symptom burden trajectories experienced by patients with brain tumors

BACKGROUND

Survivors of childhood brain tumors experience persistent health concerns across their lifespan. In the current study, the authors evaluated changes in symptom burden over the course of 12 months using pediatric Patient-Reported Outcomes Measurement Information System (PROMIS) measures.

METHODS

Data from 202 survivors aged 8 to 21 years and 262 parents of survivors who were aged 5 to 21 years were analyzed. All completed a PROMIS Cognition short form and computerized adaptive tests of pediatric Anxiety, Depressive Symptoms, Fatigue, Mobility, Upper Extremity Function, and Peer Relationships. Approximately one-half of participants (223 participants: 97 survivors of childhood brain tumors and 126 parents) completed the 12-month follow-up. Linear mixed-effects models evaluated group-level symptoms over time. Cox proportional hazard models explored whether symptoms predicted survival, and latent class growth analysis investigated patterns of individual-level symptom changes over time.

RESULTS

Linear mixed-effects models demonstrated that patient-reported Cognition and parent-reported Anxiety worsened over time. Latent class growth analysis results indicated that patient and parent reports diverged, both with regard to the number of classes identified and in the trends of these classes. Parents and patients reported similar patterns of depression over time. For the other areas, parents either were more likely to observe different patterns (Peer Relationships and Mobility) or less likely to observe different patterns (Upper Extremity Function, Cognition, Anxiety, and Fatigue). Baseline patient-reported Mobility and Upper Extremity Function were found to be associated with survival.

CONCLUSIONS

Survivors of childhood brain tumors demonstrated different trajectory patterns of symptom burden. Along with baseline functioning status and days since treatment, patient-reported Mobility and Upper Extremity Function were associated with survival, suggesting a possible role for patient-reported outcomes in clinical care, especially individualized, tailored assessments such as PROMIS.

Auditory attention late effects in pediatric acute lymphoblastic leukemia

This study sought to characterize auditory attention functioning among pediatric Acute Lymphoblastic Leukemia (ALL) survivors treated on a chemotherapy-only protocol, given previous literature suggesting late impact on sustained visual attention. We hypothesized similar deficits would be observed in auditory attention relative to previous literature indicating weakness with aspect of visual attention in this population. Survivors (n = 107, 53 females, M = 12.80 years) completed the Conners Continuous Auditory Test of Attention (CATA). Parents completed the Behavior Assessment System for Children, Second Edition and reported educational performance and services via structured questionnaire. Results indicated several CATA indices associated with sustained auditory attention were significantly worse than normative data, though group means were average. Reflecting individual variability in performance, 50% of the sample performed worse than one standard deviation from the mean on at least one CATA variable. Parent report of attention did not differ from normative means for the sample. Parent-report data indicated that 60% of the sample utilized academic support services, with a large proportion of survivors having utilized special education services. Poorer performance with sustained auditory attention was associated with poor academic outcomes. Greater methotrexate exposure and younger age at diagnosis were risk factors for inattentiveness. No gender differences were identified on direct assessment of auditory attention or parent report of attention, though male gender was associated with poorer educational performance. Findings suggest that auditory attention is an at-risk cognitive domain following treatment for pediatric ALL, and that an association exists between auditory attention and school performance in this population.

A Lifespan Approach to Patient-Reported Outcomes and Quality of Life for People on the Autism Spectrum

Autistic self-advocates, family members, and community organizations have called for greater emphasis on enhancing quality of life (QoL) for people with autism. Doing this is critical to understand how QoL unfolds across the life course and to clarify whether gender affects QoL, health, and functioning for people with autism. The purpose of this study was to curate and test a lifespan QoL measurement tool using freely available and well-constructed National Institutes of Health Parent-Reported Outcomes Measurement Information System (PROMIS). To develop the PROMIS Autism Battery-Lifespan (PAB-L), we identified PROMIS scales relevant for autism, reviewed each item, consulted with a panel of autism experts, and elicited feedback from autistic people and family members. This battery provides a comprehensive portrait of QoL for children ages 5-13 (through parent proxy), teens 14-17 (parent proxy and self-report), and adults 18-65 (self-report) with autism compared to the general population. Participants and parent informants (N = 912) recruited through a children's hospital and nationwide U.S. autism research registry completed the PAB-L online. Results indicate that compared to general population norms, people with autism of all ages (or their proxies) reported less desirable outcomes and lower QoL across all domains. Women and girls experienced greater challenges in some areas compared to men and boys with autism. The PAB-L appears to be a feasible and acceptable method for assessing patient-reported outcomes and QoL for autistic people across the life course. Autism Res 2020, 13: 970-987. © 2020 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: We developed a survey to measure the quality of life of children, teens, and adults with autism using free National Institutes of Health PROMIS questionnaires. People with autism and family members rated the PROMIS Autism Battery-Lifespan as useful and important. Some reported a good quality of life, while many reported that their lives were not going as well as they wanted. Women and girls reported more challenges in some areas of life than men and boys.

Computerized adaptive testing and short form development for child and adolescent oral health patient-reported outcomes measurement

OBJECTIVES

To develop computerized adaptive testing (CAT) and short forms of self-report oral health measures that are predictive of both the children's oral health status index (COHSI) and the children's oral health referral recommendation (COHRR) scales, for children and adolescents, ages 8-17.

MATERIAL AND METHODS

Using final item calibration parameters (discrimination and difficulty parameters) from the item response theory analysis, we performed post hoc CAT simulation. Items most frequently administered in the simulation were incorporated for possible inclusion in final oral health assessment toolkits, to select the best performing eight items for COHSI and COHRR.

RESULTS

Two previously identified unidimensional sets of self-report items consisting of 19 items for the COHSI and 22 items for the COHRR were administered through CAT resulting in eight-item short forms for both the COHSI and COHRR. Correlations between the simulated CAT scores and the full item bank representing the latent trait are r = .94 for COHSI and r = .96 for COHRR, respectively, which demonstrated high reliability of the CAT and short form.

CONCLUSIONS

Using established rigorous measurement development standards, the CAT and corresponding eight-item short form items for COHSI and COHRR were developed to assess the oral health status of children and adolescents, ages 8-17. These measures demonstrated good psychometric properties and can have clinical utility in oral health screening and evaluation and clinical referral recommendations.

Health-Related Quality of Life and Cognitive Functioning in Pediatric Liver Transplant Recipients

The goal of this work was to examine the change in health-related quality of life (HRQOL) and cognitive functioning from early childhood to adolescence in pediatric liver transplantation (LT) recipients. Patients were recruited from 8 North American centers through the Studies of Pediatric Liver Transplantation consortium. A total of 79 participants, ages 11-18 years, previously tested at age 5-6 years in the Functional Outcomes Group study were identified as surviving most recent LT by 2 years and in stable medical follow-up. The Pediatric Quality of Life 4.0 Generic Core Scale, Pediatric Quality of Life Cognitive Function Scale, and PROMIS Pediatric Cognitive Function tool were distributed to families electronically. Data were analyzed using repeated measures and paired t tests. Predictive variables were analyzed using univariate regression analysis. Of the 69 families contacted, 65 (94.2%) parents and 61 (88.4%) children completed surveys. Median age of participants was 16.1 years (range, 12.9-18.0 years), 55.4% were female, 33.8% were nonwhite, and 84.0% of primary caregivers had received at least some college education. Median age at LT was 1.1 years (range, 0.1-4.8 years). The majority of participants (86.2%) were not hospitalized in the last year. According to parents, adolescents had worse HRQOL and cognitive functioning compared with healthy children in all domains. Adolescents reported HRQOL similar to healthy children in all domains except psychosocial, school, and cognitive functioning (P = 0.02; P < 0.001; P = 0.04). Participants showed no improvement in HRQOL or cognitive functioning over time. For cognitive and school functioning, 60.0% and 50.8% of parents reported "poor" functioning, respectively (>1 standard deviation below the healthy mean). Deficits in HRQOL seem to persist in adolescence. Over half of adolescent LT recipients appear to be at risk for poor school and cognitive functioning, likely reflecting attention and executive function deficits.

A Pilot Study of a Screening Tool for Pediatric Minimal Hepatic Encephalopathy

OBJECTIVES

Despite the need for monitoring cognition for minimal hepatic encephalopathy (MHE) in children with portal hypertension, few screening methods exist. The Patient-Reported Outcomes Measurement Information System (PROMIS) Pediatric Perceived Cognitive Function (PedsPCF) item bank, a 43-item parent- and self-report questionnaire, could be a useful screening tool. This study aimed to evaluate the PedsPCF item bank as a screening tool and explore its correlation with other neurocognitive measures and clinical indicators of portal hypertension.

METHODS

Pediatric patients with portal hypertension were recruited at Lurie Children's Liver Clinic. A short battery of neuropsychological tests tapping attention, executive functioning, and fine motor speed was administered along with surveys of cognitive functioning (PedsPCF, Behavior Rating Inventory of Executive Function; BRIEF) and quality of life (PROMIS Pediatric-25 Profile).

RESULTS

Eighteen patients participated (ages 8--17). The PedsPCF correlated well with the BRIEF but did not correlate with neurocognitive testing. Qualitative heatmap analysis of the relationship between z-scores and clinical signs of portal hypertension suggests the PedsPCF is less sensitive than the BRIEF. The fine motor task (Grooved Pegboard) appears to offer the highest sensitivity of the tests administered and is also relatively quick and easy to administer.

CONCLUSIONS

Elements of the battery show promise in this small pilot sample. The BRIEF and the Grooved Pegboard may hold the most potential for screening in the clinical setting. Further study is necessary to examine this question in a larger multicenter sample.

Omphalocele at school age: What do parents report? A call for long-term follow-up of complex omphalocele patients

OBJECTIVE

Many children with omphalocele experience morbidity in early life, which could affect long-term outcomes. We determined parent-reported outcomes in school-aged children treated for minor or giant omphalocele.

STUDY DESIGN

We sent paper questionnaires to the parents of all children treated for omphalocele in 2000-2012. Giant omphalocele was defined as defect diameter ≥ 5 cm with liver protruding. Motor function (MABC-2 Checklist) was compared with Dutch reference data; cognition (PedsPCF), health status (PedsQL), quality of life (DUX-25) and behavior (Strengths and Difficulties Questionnaire; SDQ) were compared with those of controls (two per child) matched for age, gender and maternal education level. Possible predictors of cognition and behavior were evaluated using linear regression analyses.

RESULTS

Of 54 eligible participants, 31 (57%) returned the questionnaires. MABC-2 Checklist scores were normal for 21/26 (81%) children. Cognition, health status, quality of life and behavior were similar to scores of matched controls. One quarter (26%) of children with omphalocele scored ≤ - 1 standard deviation on the PedsPCF, compared with 9% of matched controls (p = 0.07). Giant omphalocele and presence of multiple congenital anomalies (MCA) were most prominently associated with lower PedsPCF scores (giant omphalocele: β -22.11 (95% CI: -43.65 to -0.57); MCA -23.58 (-40.02 to -7.13)), although not significantly after correction for multiple testing.

CONCLUSIONS

Parent-reported outcomes of children with omphalocele at school age are reassuring. Children with an isolated, minor omphalocele do not need extensive long-term follow-up of daily functioning. Those with a giant omphalocele or MCA might be at risk for delayed cognitive functioning at school age; we recommend long-term follow-up to offer timely intervention.

Pediatric Perceived Cognitive Functioning: Psychometric Properties and Normative Data of the Dutch Item Bank and Short Form

OBJECTIVE

With increasing numbers of children growing up with conditions that are associated with acquired brain injury, efficient neuropsychological screening for cognitive deficits is pivotal. Brief self-report measures concerning daily complaints can play an important role in such screening. We translated and adapted the pediatric perceived cognitive functioning (PedsPCF) self- and parent-report item bank to Dutch. This study presents (1) psychometric properties, (2) a new short form, and (3) normative data for the short form.

METHODS

A general population sample of children and parents was recruited. Dimensionality of the PedsPCF was assessed using confirmatory factor analyses and exploratory bifactor analyses. Item response theory (IRT) modeling was used to evaluate model fit of the PedsPCF, to identify differential item functioning (DIF), and to select items for the short form. To select short-form items, we also considered the neuropsychological content of items.

RESULTS

In 1441 families, a parent and/or child participated (response rate 66% at family level). Assessed psychometric properties were satisfactory and the predominantly unidimensional factor structure of the PedsPCF allowed for IRT modeling using the graded response model. One item showed meaningful DIF. For the short form, 10 items were selected.

CONCLUSIONS

In this first study of the PedsPCF outside the United States, studied psychometric properties of the translated PedsPCF were satisfactory, and allowed for IRT modeling. Based on the IRT analyses and the content of items, we proposed a new 10-item short form. Further research should determine the relation of PedsPCF outcomes with neurocognitive measures and its ability to facilitate neuropsychological screening in clinical practice.

Patient Reported Outcomes Measurement Information System and Quality of Life in Neurological Disorders Measurement System to Evaluate Quality of Life for Children and Adolescents with Neurofibromatosis Type 1 Associated Plexiform Neurofibroma

OBJECTIVE

To assess the health-related quality of life of children with neurofibromatosis type 1-related plexiform neurofibromas (pNF) using a battery of patient-reported outcome measures selected based on a conceptual framework derived from input by patients, parents, and clinicians regarding the most important pNF symptoms and concerns.

STUDY DESIGN

There were 140 children with pNF ages 8-17 years who completed the Patient-Reported Outcomes Measurement Information System (including domains anxiety, depressive symptom, psychosocial stress experiences, fatigue, pain interference, meaning and purpose, positive affect, peer relationships, physical function-mobility) and Quality of Life in Neurological Disorders measurement system (stigma) via an online platform. T-scores for each measure were compared with US population norms.

RESULTS

Children with pNF reported significantly worse scores than the population norms on 8 of 10 domains. Children with at least 1 family member having a diagnosis of neurofibromatosis type 1 and those having pain reported significantly worse symptoms and functioning on all domains. Boys reported significantly worse pain interference, stigma, meaning and purpose, mobility function, and upper extremity function than girls.

CONCLUSIONS

Children with pNF experience significantly worse health-related quality of life on all but 1 domain, highlighting the importance of monitoring children's quality of life over time in clinical research and practice. Future research should evaluate the replicability of these findings and evaluate the validity of the Patient-Reported Outcomes Measurement Information System and Quality of Life in Neurological Disorders measurement system in relation to clinical characteristics among children with pNF.

Using the Patient-Reported Outcomes Measurement Information System (PROMIS) to measure symptom burden reported by patients with brain tumors

BACKGROUND

Children with brain tumors can experience symptom burden throughout their disease continuum. The aim of the study was to evaluate symptom burden reported by children with brain tumors and factors that potentially were associated with their symptoms.

METHODS

Data from 199 children with brain tumors aged 7-22 (mean age = 14 years; 52% males; 76% white) were analyzed. Symptom burden was assessed using the Patient-Reported Outcomes Measurement Information System (PROMIS) via computerized adaptive testing (CAT)-anxiety, depression, fatigue, mobility, upper extremity function, peer relationship, and cognition. Patients and parents completed Symptom Distress Scales (SDS). Test statistics and ANOVA were used to evaluate relationships between PROMIS measures and potentially influential variables.

RESULTS

Significant results (P < 0.01) showing impact of symptom burden included: PROMIS measures correlated with SDSs reported by patients and parents on all comparisons. Fatigue, mobility, and upper extremity function were associated with Karnofsky functional performance status, number of treatment modalities (0-3), and time since last treatment (≤1 year, >1 year). Fatigue and cognition were associated with educational program (regular classroom without an individualized education plan vs those that had an individualized education plan); mobility and upper extremity function were associated with time since last radiation. Mobility, upper extremity function, and anxiety were associated with time since last chemotherapy.

CONCLUSIONS

Significant associations were found between PROMIS and SDS as well as clinical and demographic characteristics. Brief-yet-precise PROMIS CATs can be used to systematically assess symptom burden experienced by children with brain tumors.

Computerized Adaptive Testing in Pediatric Brain Tumor Clinics

CONTEXT

Monitoring of health-related quality of life and symptoms of patients with brain tumors is needed yet not always feasible. This is partially due to lack of brief-yet-precise assessments with minimal administration burden that are easily incorporated into clinics. Dynamic computerized adaptive testing (CAT) or static fixed-length short forms, derived from psychometrically sound item banks, are designed to fill this void.

OBJECTIVE

This study evaluated the comparability of scores obtained from CATs and short forms.

METHODS

Patients (ages 7-22 years) were recruited from brain tumor clinics and completed Patient-Reported Outcome Measurement Information System CATs and short forms (Fatigue, Mobility, Upper Extremity, Depressive Symptoms, Anxiety, and Peer Relationships). Pearson correlations, paired t-tests, and Cohen's d were used to evaluate the relationship, significant differences, and the magnitude of the difference between these two scores, respectively.

RESULTS

Data from 161 patients with brain tumors were analyzed. Patients completed each CAT within 2 minutes. Scores obtained from CATs and short forms were highly correlated (r = 0.95-0.98). Significantly different CAT vs. short-form scores were found on 4 (of 6) domains yet with negligible effect sizes (|d| < 0.09). These relationships varied across patients with different levels of reported symptoms, with the strongest association at the worst or best symptom scores.

CONCLUSIONS

This study demonstrated the comparability of scores from CATs and short forms. Yet the agreement between these two varied across degrees of symptom severity which was a result of the ceiling effects of static short forms. We recommend CATs to enable individualized assessment for longitudinal monitoring.

Implementing guidelines: Proposed definitions of neuropsychology services in pediatric oncology

Several organizations have published guidelines for the neuropsychological care of survivors of childhood cancer. However, there is limited consensus in how these guidelines are applied. The model of neuropsychology service delivery is further complicated by the variable terminology used to describe recommended services. In an important first step to translate published guidelines into clinical practice, this paper proposes definitions for specific neuropsychological processes and services, with the goal of facilitating consistency across sites to foster future clinical program development and to clarify clinical practice guidelines.

The association between the behavior rating inventory of executive functioning and cognitive testing in children diagnosed with a brain tumor

Pediatric brain tumor survivors (PBTS) suffer from cognitive late effects, such as deteriorating executive functioning (EF). We explored the suitability of the Behavior Rating Inventory of Executive Function (BRIEF) to screen for these late effects. We assessed the relationship between the BRIEF and EF tasks, and between the BRIEF-Parent and BRIEF-Teacher, and we explored the clinical utility. Eighty-two PBTS (8-18 years) were assessed with EF tasks measuring attention, cognitive flexibility, inhibition, visual-, and working memory (WM), and with the BRIEF-Parent and BRIEF-Teacher. Pearson's correlations between the BRIEF and EF tasks, and between the BRIEF-Parent and BRIEF-Teacher were calculated. The BRIEF-Parent related poorly to EF tasks (rs < .26, ps > .01), but of the BRIEF-Teacher the WM-scale, Monitor-scale, Behavioral-Regulation-Index, and Meta-cognition-Index, and Total-score (rs > .31, ps < .01) related significantly to some EF tasks. When controlling for age, only the WM scale and Total score related significantly to the attention task (ps < .01). The inhibit scales of the BRIEF-Parent and BRIEF-Teacher correlated significantly (r = .33, p < .01). Children with clinically elevated scores on BRIEF scales that correlated with EF tasks performed worse on all EF tasks (ds 0.56-1.23, ps < .05). The BRIEF-Teacher Total and Index scores might better screen general EF in PBTS than the BRIEF-Parent. However, the BRIEF-Teacher is also not specific enough to capture separate EFs. Solely relying on the BRIEF as a screening measure of EFs in BPTS is insufficient. Questionnaires and tasks give distinctive, valuable information.

Health-related quality of life and adherence to hydroxyurea in adolescents and young adults with sickle cell disease

BACKGROUND

Complications related to sickle cell disease (SCD) result in significant declines in health-related quality of life (HRQOL). While hydroxyurea reduces SCD complications, adherence remains suboptimal. The study's objectives were to assess the feasibility of Internet-based electronic assessment of HRQOL in SCD clinic and to examine the relationship between HRQOL and hydroxyurea adherence in adolescents and young adults (AYAs) with SCD.

PROCEDURE

A cross-sectional survey was administered on tablets to 34 AYAs (12-22 years old) in a SCD clinic from January through December 2015. Study measures included Patient Reported Outcomes Measurement Information System (PROMIS^® ) computerized adaptive testing and ©Modified Morisky Adherence Scale 8-items (©MMAS-8).

RESULTS

Participants (59% male, 91% Black) had median age of 13.5 (range 12-18) years. Ninety-one percent completed PROMIS® measures electronically in the clinic, meeting our feasibility criterion of ≥85% completion rate. ©MMAS-8 scores positively correlated with fetal hemoglobin (HbF) (r_s = 0.34, P = 0.04) and mean corpuscular volume (MCV) (r_s = 0.42, P = 0.01) and inversely correlated with fatigue (r_s = -0.45, P = 0.01), depression (r_s = -0.3, P = 0.08), and social isolation (r_s = -0.78, P = 0.02). Low ©MMAS-8 scores, indicating poor adherence, were associated with worse fatigue (P = 0.001) and trended toward significance for pain (P = 0.07) and depression (P = 0.06). Homozygous hemoglobin S disease patients with low HbF (<16%) had worse social isolation (P = 0.04) and those with low MCV (<102 fl) reported worse fatigue (P = 0.001), pain (P = 0.01), mobility (P = 0.01), and social isolation (P = 0.04).

CONCLUSIONS

HRQOL assessment in the SCD clinic is feasible. SCD patients with low hydroxyurea adherence and/or low HbF or MCV levels had worse HRQOL scores, particularly fatigue. Future prospective studies examining the relationship between HRQOL and hydroxyurea adherence are warranted.

Parent-reported cognitive function is associated with leukoencephalopathy in children with brain tumors

PURPOSE

Cognitive dysfunction is a major concern for children with brain tumors. A valid, user-friendly screening tool could facilitate prompt referral for comprehensive neuropsychological assessments and therefore early intervention. Applications of the pediatric perceived cognitive function item bank (pedsPCF) such as computerized adaptive testing can potentially serve as such a tool given its brevity and user-friendly nature. This study aimed to evaluate whether pedsPCF was a valid indicator of cerebral compromise using the criterion of structural brain changes indicated by leukoencephalopathy grades.

METHODS

Data from 99 children (mean age = 12.6 years) with brain tumors and their parents were analyzed. Average time since diagnosis was 5.8 years; time since last treatment was 4.3 years. Leukoencephalopathy grade (range 0-4) was based on white matter damage and degree of deep white matter volume loss shown on MRI. Parents of patients completed the pedsPCF. Scores were based on the US general population-based T-score metric (mean = 50; SD = 10). Higher scores reflect better function.

RESULTS

Leukoencephalopathy grade distributions were as follows: 36 grade 0, 27 grade 1, 22 grade 2, 13 grade 3, and 1 grade 4. The mean pedsPCF T-score was 48.3 (SD = 8.3; range 30.5-63.7). The pedsPCF scores significantly discriminated patients with different leukoencephalopathy grades, F = 4.14, p = 0.0084. Effect sizes ranged from 0.09 (grade 0 vs. 1) to 1.22 (grade 0 vs. 3/4).

CONCLUSION

This study demonstrates that the pedsPCF is a valid indicator of leukoencephalopathy and provides support for its use as a screening tool for more comprehensive neurocognitive testing.

An Item Bank to Measure Systems, Services, and Policies: Environmental Factors Affecting People With Disabilities

OBJECTIVES

To develop a measure of perceived systems, services, and policies facilitators (see Chapter 5 of the International Classification of Functioning, Disability and Health) for people with neurologic disabilities and to evaluate the effect of perceived systems, services, and policies facilitators on health-related quality of life.

DESIGN

Qualitative approaches to develop and refine items. Confirmatory factor analysis including 1-factor confirmatory factor analysis and bifactor analysis to evaluate unidimensionality of items. Rasch analysis to identify misfitting items. Correlational and analysis of variance methods to evaluate construct validity.

SETTING

Community-dwelling individuals participated in telephone interviews or traveled to the academic medical centers where this research took place.

PARTICIPANTS

Participants (N=571) had a diagnosis of spinal cord injury, stroke, or traumatic brain injury. They were 18 years or older and English speaking.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

An item bank to evaluate environmental access and support levels of services, systems, and policies for people with disabilities.

RESULTS

We identified a general factor defined as "access and support levels of the services, systems, and policies at the level of community living" and 3 local factors defined as "health services," "community living," and "community resources." The systems, services, and policies measure correlated moderately with participation measures: Community Participation Indicators (CPI) - Involvement, CPI - Control over Participation, Quality of Life in Neurological Disorders - Ability to Participate, Quality of Life in Neurological Disorders - Satisfaction with Role Participation, Patient-Reported Outcomes Measurement Information System (PROMIS) Ability to Participate, PROMIS Satisfaction with Role Participation, and PROMIS Isolation.

CONCLUSIONS

The measure of systems, services, and policies facilitators contains items pertaining to health services, community living, and community resources. Investigators and clinicians can measure perceptions of systems, services, and policies resources reliably with the items described here. Moderate relations between systems, services, and policies facilitators and PROMIS and CPI variables provide support for the measurement and theory of environmental effects on social functioning related to participation.

Using the ICF's environmental factors framework to develop an item bank measuring built and natural environmental features affecting persons with disabilities

OBJECTIVES

To develop a measure of natural environment and human-made change features (Chapter 2 of the international classification of functioning, disability, and health) and evaluate the influence of perceived barriers on health-related quality of life.

METHODS

A sample of 570 adults with stroke, spinal cord injury, and traumatic brain injury residing in community settings reported their functioning in home, outdoor, and community settings (mean age = 47.0 years, SD = 16.1). They rated 18 items with a 5-point rating scale to describe the influence of barriers to moving around, seeing objects, hearing sounds, hearing conversations, feeling safe, and regulating temperature and indicated whether any difficulties were due to environmental features. We used Rasch analysis to identify misfitting items and evaluate differential item functioning (DIF) across impairment groups. We computed correlations between barriers and patient-reported outcomes measurement information system (PROMIS) social domain measures and community participation indicators (CPI) measures.

RESULTS

The 18 items demonstrated person reliability of .70, discriminating nearly three levels of barriers. All items fit the Rasch model; impairment-related DIF was negligible. Ceiling effects were negligible, but 25 % of the respondents were at the floor, indicating that they did not experience barriers that they attributed to the built and natural environment. As anticipated, barriers correlated moderately with PROMIS and CPI variables, suggesting that although this new item bank measures a construct that is related to participation and health-related quality of life, it also captures something unique. Known-groups validity was supported by wheelchair users reporting a higher level of barriers than did ambulatory respondents.

CONCLUSIONS

Preliminary evidence supports the reliability and validity of this new measure of barriers to the built and natural environment. This measure allows investigators and clinicians to measure perceptions of the natural environment and human-made changes, providing information that can guide interventions to reduce barriers. Moderate relationships between barriers and PROMIS and CPI variables provide support for the measurement and theory of environmental influences on social health and participation.

Cognitive Performance Scores for the Pediatric Automated Neuropsychological Assessment Metrics in Childhood-Onset Systemic Lupus Erythematosus

OBJECTIVE

To develop and initially validate a global cognitive performance score (CPS) for the Pediatric Automated Neuropsychological Assessment Metrics (PedANAM) to serve as a screening tool of cognition in childhood lupus.

METHODS

Patients (n = 166) completed the 9 subtests of the PedANAM battery, each of which provides 3 principal performance parameters (accuracy, mean reaction time for correct responses, and throughput). Cognitive ability was measured by formal neurocognitive testing or estimated by the Pediatric Perceived Cognitive Function Questionnaire-43 to determine the presence or absence of neurocognitive dysfunction (NCD). A subset of the data was used to develop 4 candidate PedANAM-CPS indices with supervised or unsupervised statistical approaches: PedANAM-CPSUWA , i.e., unweighted averages of the accuracy scores of all PedANAM subtests; PedANAM-CPSPCA , i.e., accuracy scores of all PedANAM subtests weighted through principal components analysis; PedANAM-CPSlogit , i.e., algorithm derived from logistic models to estimate NCD status based on the accuracy scores of all of the PedANAM subtests; and PedANAM-CPSmultiscore , i.e., algorithm derived from logistic models to estimate NCD status based on select PedANAM performance parameters. PedANAM-CPS candidates were validated using the remaining data.

RESULTS

PedANAM-CPS indices were moderately correlated with each other (|r| > 0.65). All of the PedANAM-CPS indices discriminated children by NCD status across data sets (P < 0.036). The PedANAM-CPSmultiscore had the highest area under the receiver operating characteristic curve (AUC) across all data sets for identifying NCD status (AUC >0.74), followed by the PedANAM-CPSlogit , the PedANAM-CPSPCA , and the PedANAM-CPSUWA , respectively.

CONCLUSION

Based on preliminary validation and considering ease of use, the PedANAM-CPSmultiscore and the PedANAM-CPSPCA appear to be best suited as global measures of PedANAM performance.

Validation of the Neuro-QoL measurement system in children with epilepsy

OBJECTIVE

Children with epilepsy often face complex psychosocial consequences that are not fully captured by existing patient-reported outcome (PRO) measures. The Neurology Quality of Life Measurement System "Neuro-QoL" was developed to provide a set of common PRO measures that address issues important to people with neurologic disorders. This paper reports Neuro-QoL (anxiety, depression, interaction with peers, fatigue, pain, cognitive function, stigma, and upper and lower extremity functions) validation in children with epilepsy.

METHOD

Patients (aged 10-18years) diagnosed with epilepsy completed Neuro-QoL and legacy measures at time 1 (initial study visit) and 6-month follow-up. Internal consistency reliability was also evaluated. Concurrent validity was assessed by comparing Neuro-QoL measures with more established "legacy" measures of the same concepts. Clinical validity was evaluated by comparing mean Neuro-QoL scores of patients grouped by clinical anchors such as disease severity. Responsiveness of the Neuro-QoL from time 1 (initial study visit) to 6months was evaluated using self-reported change as the primary anchor.

RESULTS

Sixty-one patients (mean age=13.4years; 62.3% male, 75.9% white) participated. Most patients (64.2%) had been seizure-free in the 3months prior to participation, and seizure frequency was otherwise described as follows: 17.8% daily, 13.3% weekly, 35.6% monthly, and 33.3% yearly. All patients were taking antiepileptic drugs. Patients reported better function/less symptoms compared to the reference groups. Internal consistency (alpha) coefficients ranged from 0.76 to 0.87. Patients with different seizure frequencies differed on anxiety (p<.01) and cognitive function (p<.05). Compared to patients on polytherapy, those on monotherapy had better upper extremity scores (p<.05). Compared to those with localized seizures, those experiencing generalized seizures reported worse stigma (p<.05). Depression, anxiety, lower extremity, fatigue, pain, interaction with peers, and stigma also significantly discriminated patients with different levels of quality of life (p≤.05). All Neuro-QoL measures were significantly correlated with other measures assessing similar domains. Stigma was related to self-reported change in several areas of functioning but in sometimes unexpected directions.

SIGNIFICANCE

The Neurology Quality of Life Measurement System is a valid and reliable assessment tool for children with epilepsy and can be used in research and clinical settings.

Evaluating Psychometric Properties of the Spanish-version of the Pediatric Functional Assessment of Chronic Illness Therapy-Perceived Cognitive Function (pedsFACIT-PCF)

PURPOSE

The pediatric Functional Assessment of Chronic Illness Therapy-Perceived Cognitive Function (pedsFACIT-PCF) is a 13-item short-form derived from the pediatric Perceived Cognitive Function item bank (pedsPCF), which was developed to measure children's daily cognitive behaviors and was validated on the US general population and children with cancer. This study evaluated the psychometric properties of Spanish language pedsFACIT-PCF and the measurement equivalence between Spanish and English versions.

METHODS

pedsFACIT-PCF items were translated into Spanish using a standard iterative methodology. A total of 1358 English- and 604 Spanish-speaking children aged 8-17 years who completed English and Spanish versions of pedsFACIT-PCF, respectively, were administered through an Internet survey company. Unidimensionality was evaluated using confirmatory factor analysis. Item responses were modeled using item response theory. The presence and impact of differential item functioning (DIF) were evaluated using ordinal logistic regression.

RESULTS

Unidimensionality of the pedsFACIT-PCF was supported. One of the 13 items demonstrated statistically significant DIF by language; however, impacts of language DIF on both individual scores and at the test level were negligible. No Spanish items showed DIF with respect to age and gender.

CONCLUSIONS

The 13-item pedsFACIT-PCF demonstrated stable measurement properties on language, gender and age and can be used for future trials.

Developing an item bank to measure economic quality of life for individuals with disabilities

OBJECTIVE

To develop and evaluate the psychometric properties of an item set measuring economic quality of life (QOL) for use by individuals with disabilities.

DESIGN

Survey.

SETTING

Community settings.

PARTICIPANTS

Individuals with disabilities completed individual interviews (n=64), participated in focus groups (n=172), and completed cognitive interviews (n=15). Inclusion criteria included the following: traumatic brain injury, spinal cord injury, or stroke; age ≥18 years; and ability to read and speak English. We calibrated the items with 305 former rehabilitation inpatients.

INTERVENTIONS

None.

MAIN OUTCOME MEASURE

Economic QOL.

RESULTS

Confirmatory factor analysis showed acceptable fit indices (comparative fit index=.939, root mean square error of approximation=.089) for the 37 items. However, 3 items demonstrated local item dependence. Dropping 9 items improved fit and obviated local dependence. Rasch analysis of the remaining 28 items yielded a person reliability of .92, suggesting that these items discriminate about 4 economic QOL levels.

CONCLUSIONS

We developed a 28-item bank that measures economic aspects of QOL. Preliminary confirmatory factor analysis and Rasch analysis results support the psychometric properties of this new measure. It fills a gap in health-related QOL measurement by describing the economic barriers and facilitators of community participation. Future development will make the item bank available as a computer adaptive test.

Self-reported cognitive concerns and abilities: two sides of one coin?

OBJECTIVE

Patient-reported cognitive function can be measured using negatively worded items (concerns) and positively worded (abilities) items. It is possible that reporting abilities is less subject to the influence of emotional states. This study evaluated the relationship between cognitive concerns and cognitive abilities.

METHODS

Cancer patients (N = 509; mean age = 61 years; 50% men; 86% White) completed concerns and abilities items developed by the National Institutes of Health Patient-Reported Outcomes Information System (PROMIS). Confirmatory factor analysis was used to evaluate the extent to which items were loaded on one single factor (unidimensionality). Multidimensionality was evaluated using bi-factor analysis (local factors: concerns and abilities). Slope parameters from multidimensional item response theory (IRT) and unidimensional IRT were compared to evaluate which factor solution fits best.

RESULTS

Acceptable fit indices were found in both one-factor confirmatory factor analysis (comparative fit index (CFI) = 0.96; root mean squared error of approximation (RMSEA) = 0.062) and bi-factor analysis (CFI = 0.98; RMSEA = 0.043). Thus, abilities and concerns could be considered as a single dimension. Yet, high loadings on the local factor in bi-factor analysis and slope discrepancies between unidimensional IRT and multidimensional IRT indicate that abilities should be considered as a separate factor from concerns.

CONCLUSIONS

Concerns and abilities could be measured using one-unidimensional item bank. Results also support measuring each construct separately. We recommend a conservative approach by measuring and reporting concerns and abilities separately. We therefore recommend two separate but co-calibrated item banks in the PROMIS network: cognitive function item bank-concerns and cognitive function item bank-abilities. Both item banks showed good psychometric properties and are available for research and clinical purposes.

Parent-reported cognition of children with cancer and its potential clinical usefulness

PURPOSE

Cognitive dysfunction is a common concern for children with brain tumors (BTs) or those receiving central nervous system (CNS) toxic cancer treatments. Perceived cognitive function (PCF) is an economical screening that may be used to trigger full, formal cognitive testing. We assessed the potential clinical utility of PCF by comparing parent-reported scores for children with cancer with scores from the general US population.

METHODS

Children (n = 515; mean age = 13.5 years; 57.0 % male) and one of their parents were recruited from pediatric oncology clinics. Most children (53.3 %) had a diagnosis of CNS tumor with an average time since diagnosis of 5.6 years. PCF was evaluated using the pediatric PCF item bank (pedsPCF), which was developed and normed on a sample drawn from the US general pediatric population. Children also completed computer-based neuropsychological tests. We tested relationships between PCF and clinical variables. Differential item functioning (DIF) was used to evaluate measurement bias between the samples.

RESULTS

No item showed DIF, supporting the use of pedsPCF in the cancer sample. PedsPCF differentiated children with (vs. without) a BT, p < 0.01, and groups defined by years since diagnosis, p < 0.01. It significantly (p < 0.05) correlated with computerized neuropsychological tests in 40 of 60 comparisons. Children with BTs were rated as having worse pedsPCF scores than the norm, regardless of years since diagnosis.

CONCLUSIONS

PCF significantly differentiated cancer survivors with various clinical characteristics. It is brief and easy to implement. PCF should be considered for routine care of pediatric cancer survivors.

Development and psychometric properties of the PROMIS(®) pediatric fatigue item banks

PURPOSE

This paper reports on the development and psychometric properties of self-reported pediatric fatigue item banks as part of the Patient-Reported Outcomes Measurement Information System (PROMIS).

METHODS

Candidate items were developed by using PROMIS qualitative methodology. The resulting 39 items (25 tiredness related and 14 energy related) were field tested in a sample that included 3,048 participants aged 8-17 years. We used confirmatory factor analysis (CFA) to evaluate dimensionality and differential item functioning (DIF) analysis to evaluate parameter stability between genders and by age; we examined residual correlations to evaluate local dependence (LD) among items and estimated the parameters of item response theory (IRT) models.

RESULTS

Of 3,048 participants, 48 % were males, 60 % were white, and 23 % had at least one chronic condition. CFA results suggest two moderately correlated factors. Two items were removed due to high LD, and three due to gender-based DIF. Two item banks were calibrated separately using IRT: Tired and (Lack of) Energy, which consisted of 23 and 11 items, respectively; 10- and 8-item short-forms were created.

CONCLUSION

The PROMIS assessment of self-reported fatigue in pediatrics includes two item banks: Tired and (Lack of) Energy. Both demonstrated satisfactory psychometric properties and can be used for research settings.

Using Rasch rating scale model to reassess the psychometric properties of the Persian version of the PedsQL™ 4.0 Generic Core Scales in school children

BACKGROUND

Item response theory (IRT) is extensively used to develop adaptive instruments of health-related quality of life (HRQoL). However, each IRT model has its own function to estimate item and category parameters, and hence different results may be found using the same response categories with different IRT models. The present study used the Rasch rating scale model (RSM) to examine and reassess the psychometric properties of the Persian version of the PedsQL™ 4.0 Generic Core Scales.

METHODS

The PedsQL™ 4.0 Generic Core Scales was completed by 938 Iranian school children and their parents. Convergent, discriminant and construct validity of the instrument were assessed by classical test theory (CTT). The RSM was applied to investigate person and item reliability, item statistics and ordering of response categories.

RESULTS

The CTT method showed that the scaling success rate for convergent and discriminant validity were 100% in all domains with the exception of physical health in the child self-report. Moreover, confirmatory factor analysis supported a four-factor model similar to its original version. The RSM showed that 22 out of 23 items had acceptable infit and outfit statistics (<1.4, >0.6), person reliabilities were low, item reliabilities were high, and item difficulty ranged from -1.01 to 0.71 and -0.68 to 0.43 for child self-report and parent proxy-report, respectively. Also the RSM showed that successive response categories for all items were not located in the expected order.

CONCLUSIONS

This study revealed that, in all domains, the five response categories did not perform adequately. It is not known whether this problem is a function of the meaning of the response choices in the Persian language or an artifact of a mostly healthy population that did not use the full range of the response categories. The response categories should be evaluated in further validation studies, especially in large samples of chronically ill patients.