Initial development and pilot testing of observer-reported outcomes (ObsROs) for children with cystic fibrosis ages 0-11years

Caregiver Observations of Infant Well-Being Before and After Cleft Lip Surgery

OBJECTIVE

To evaluate the sensitivity to change of daily ratings of the comfort (COMF) and behavioral/emotional health (BEH) domains of the Infants with Clefts Observation Outcomes Instrument (iCOO) at 3 time points, and to assess the association of post-surgical interventions on iCOO ratings.

DESIGN

The COMF and BEH domains were completed by caregivers before (T0), immediately after (T1), and 2-months after (T2) cleft lip (CL) surgery. Analyses included descriptive statistics, correlations, t-tests, and generalized estimating equations.

PARTICIPANTS

Caregivers (N  =  140) of infants with CL with/without cleft palate.

MAIN OUTCOME MEASURES

The COMF and BEH domain scores of the iCOO: Scale (SCALE), a summary of observable signs; and Global Impression (IMPR), a single item measuring caregivers' overall impression.

RESULTS

Daily COMF and BEH SCALE and IMPR scores changed significantly during T1 (P's < 0.001) but not T0 or T2. Day 1 and 7 T0 scores were significantly higher than Day 1 and 7 T1 scores (P's <0.001 to <0.012) but similar at T2 (P's > 0.05). After CL surgery, the combined use of immobilizers and nasal stents and the use of multiple feeding methods with treatment for gastroesophageal reflux were associated with lower daily scores in COMF and BEH SCALE and IMPR (P's: 0.040 to <0.001).

CONCLUSIONS

COMF and BEH iCOO scores were sensitive to daily changes in infant well-being following CL surgery. Future studies should further investigate impact of post-surgical treatments on infant well-being.

Topical fluoride hesitancy among caregivers: Development of a content-valid topical fluoride hesitancy identification item pool

OBJECTIVES

To develop a content-valid set of items to characterize different types of topical fluoride hesitancy among caregivers. We will use this information to develop and test tailor-made interventions directed to caregivers with varied types and levels of topical fluoride hesitancy, to ultimately improve child oral health.

METHODS

Caregivers participated in three study activities, in the following order: (1) semi-structured concept elicitation interviews (n = 56), (2) cognitive interviews (n = 9), and (3) usability interviews (n = 3). Interviews were conducted via telephone and audio-recorded and transcribed for qualitative analysis. Twelve pediatric dental providers and researchers participated in item review. An assessment of reading level of items was made with goal of 6th grade reading level or less.

RESULTS

Based on elicitation interviews, we initially developed 271 items, which the investigative team evaluated for conceptual clarity, specificity to topical fluoride hesitancy, and sensitivity to potential interventions. After four rounds of review and cognitive interviews, we retained 33 items across five previously identified domains. Changes after cognitive interviews included item revision to improve comprehension and item re-ordering to avoid order effects. Changes after usability testing including clarification regarding referent child for families with multiple children. The reading level of the item pool is grade 3.2.

CONCLUSIONS

The resulting 33-item fluoride hesitancy item pool is content valid and will address an important need for identifying and addressing topical fluoride hesitancy in the context of dental research and clinical practice. Next steps include psychometric evaluation to assess scale and test-retest reliability and construct validity.

Exploration of Caregiver Interrater Agreement and Test-Retest Reliability on the Infant Cleft Observer Outcomes (iCOO)

Caregiver and observer-reported measures are frequently used as outcomes for research on infants and young children who are unable to report on their own health. Our team developed the Infant with Clefts Observation Outcomes Instrument (iCOO) for infants with cleft lip with or without cleft palate. This exploratory study compared test-retest and interrater reliabilities to inform whether differences in caregiver perspective might affect the iCOO.

This study is a secondary analysis comparing caregiver interrater agreement to test-retest reliability. Twenty-five pairs of caregivers completed the iCOO before surgery, 1 week later for test-retest reliability, 2 days after surgery, and 2 months after surgery. Reliability was assessed using intraclass correlations (ICCs) and t-tests were used to compare ratings between caregivers.

Infants had cleft lip (28%) or cleft lip and palate (72%). Primary caregivers were predominantly mothers (92%) and secondary caregivers were predominantly fathers (80%). Test-retest reliability met psychometric standards for most items on the iCOO (81%-86% of items). Caregiver agreement on the iCOO items was lower than test-retest reliability (33%-46% of items met psychometric standards). Caregivers did not systematically differ in whether they rated infants as healthier or less healthy than the other caregiver (5%-16% of items had statistically significant differences).

Caregivers used the measure consistently, but had different experiences and perceptions of their infant's health and functioning. Future studies are needed to explore mechanisms for the differences in test-retest and interrater reliability. Whenever possible, the same caregiver should provide ratings of the infant, including on the iCOO.

Infant with Clefts Observation Outcomes Instrument (iCOO): A New Outcome for Infants and Young Children with Orofacial Clefts

OBJECTIVE

We evaluated the measurement properties for item and domain scores of the Infant with Clefts Observation Outcomes Instrument (iCOO).

DESIGN

Cross-sectional (before lip surgery) and longitudinal study (preoperative baseline and 2 days and 2 months after lip surgery).

SETTING

Three academic craniofacial centers and national online advertisements.

PARTICIPANTS

Primary caregivers with an infant with cleft lip with or without cleft palate (CL  ±  P) scheduled to undergo primary lip repair. There were 133 primary caregivers at baseline, 115 at 2 days postsurgery, and 112 at 2 months postsurgery.

MAIN OUTCOME MEASURE(S)

Caregiver observation items (n = 61) and global impression of health and function items (n = 8) across eight health domains.

RESULTS

Mean age at surgery was 6.0 months (range 2.7-11.8 months). Five of eight iCOO domains have scale scores, with Cronbach's alphas ranging from 0.67 to 0.87. Except for the Facial Skin and Mouth domain, iCOO scales had acceptable intraclass correlation coefficients (ICCs) ranging from 0.76 to 0.84. The internal consistency of the Global Impression items across all domains was 0.90 and had acceptable ICCs (range 0.76-0.91). Sixteen out of 20 (nonscale) items had acceptable ICCs (range 0.66-0.96). As anticipated, iCOO scores 2 days postoperatively were generally lower than baseline and scores 2 months postsurgery were consistent with baseline or higher. The iCOO took approximately 10 min to complete.

CONCLUSIONS

The iCOO meets measurement standards and may be used for assessing the impact of cleft-related treatments in clinical research and care. More research is needed on its use in various treatment contexts.

Acceptability of patient reported outcome measures (PROMs) in a cystic fibrosis data registry

Introduction

Improvements in the treatment of cystic fibrosis (CF) have resulted in longer survival and an increased focus on optimising daily functioning with the condition. Patient-reported outcome measures (PROMs) are valuable tools in evaluating the health-related quality of life of persons with chronic diseases. PROMs may be incorporated into clinical registries to assess and provide feedback regarding the health-related quality of life of the affected population. This study uses qualitative methodology to describe the views of patients with CF, caregivers and clinicians on the usefulness and practicality of incorporating a PROM in the Australian Cystic Fibrosis Data Registry (ACFDR).

Methods

We conducted semistructured interviews with a convenience sample of patients with CF (n=5), caregivers (n=7) and clinicians (n=13) on their opinions on incorporating the Cystic Fibrosis Questionnaire-Revised or the Cystic Fibrosis Quality of Life Questionnaire into the ACFDR. We analysed data into topics and subtopics using conventional content analysis.

Results

Participants believed that PROMs could generate useful aggregate health-related quality of life data to support better understanding of the experiences of the modern CF population. Participants emphasised that implementation must be supported by processes to feedback data to patients and clinicians. Most participants preferred electronic PROMs administration for easy integration into existing systems and the potential to support feedback.

Conclusion

Patients, caregivers and clinicians in this study generally supported the usefulness and practicality of PROM implementation in the ACFDR.

The measurement properties of tests and tools used in cystic fibrosis studies: a systematic review

There is no consensus on how best to measure responses to interventions among children and adults with cystic fibrosis (CF). We have systematically reviewed and summarised the characteristics and measurement properties of tests and tools that have been used to capture outcomes in studies among people with CF, including their reliability, validity and responsiveness. This review is intended to guide researchers when selecting tests or tools for measuring treatment effects in CF trials. A consensus set of these tests and tools could improve consistency in how outcomes are captured and thereby facilitate comparisons and synthesis of evidence across studies.

Outcomes and endpoints reported in studies of pulmonary exacerbations in people with cystic fibrosis: A systematic review

BACKGROUND

There is no consensus about which outcomes should be evaluated in studies of pulmonary exacerbations in people with cystic fibrosis (CF). Outcomes used for evaluation should be meaningful; that is, they should capture how people feel, function or survive and be acknowledged as important to people with CF, or should be reliable surrogates of those outcomes. We aimed to summarise the outcomes and corresponding endpoints which have been reported in studies of pulmonary exacerbations, and to identify those which are most likely to be meaningful.

METHODS

A PROSPERO registered systematic review (CRD42020151785) was conducted in Medline, Embase and Cochrane from inception until July 2020. Registered trials were also included.

RESULTS

144 studies met the inclusion criteria. A wide range of outcomes and corresponding endpoints were reported. Death, QoL and many patient-reported outcomes are likely to be meaningful as they directly capture how people feel, function or survive. Forced expiratory volume in 1-second [FEV₁] is a validated surrogate of risk of death and reduced QoL. The extent of structural lung disease has also been correlated with lung function, pulmonary exacerbations and risk of death. Since no evidence of a correlation between airway microbiology or biomarkers with clinically meaningful outcomes was found, the value of these as surrogates was unclear.

CONCLUSIONS

Death, QoL, patient-reported outcomes, FEV₁, and structural lung changes were identified as outcomes that are most likely to be meaningful. Development of a core outcome set in collaboration with stakeholders including people with CF is recommended.

A systematic review of patient-reported outcome measures (PROMs) in cystic fibrosis

BACKGROUND

To determine patient-reported outcome measures (PROMs) which may be suitable for incorporation into the Australian Cystic Fibrosis Data Registry (ACFDR) by identifying PROMs administered in adult and paediatric cystic fibrosis (CF) populations in the last decade.

METHODS

We searched MEDLINE, EMBASE, Scopus, CINAHL, PsycINFO and Cochrane Library databases for studies published between January 2009 and February 2019 describing the use of PROMs to measure health-related quality of life (HRQoL) in adult and paediatric patients with CF. Validation studies, observational studies and qualitative studies were included. The search was conducted on 13 February 2019. The COnsensus-based Standards for the selection of health Measurement INstruments Risk of Bias Checklist was used to assess the methodological quality of included studies.

RESULTS

Twenty-seven different PROMs were identified. The most commonly used PROMs were designed specifically for CF. Equal numbers of studies were conducted on adult (32%, n=31), paediatric (35%, n=34) and both (27%, n=26) populations. No PROMs were used within a clinical registry setting previously. The two most widely used PROMs, the Cystic Fibrosis Questionnaire-Revised (CFQ-R) and the Cystic Fibrosis Quality of Life Questionnaire (CFQoL), demonstrated good psychometric properties and acceptability in English-speaking populations.

DISCUSSION

We found that although PROMs are widely used in CF, there is a lack of reporting on the efficacy of methods and timepoints of administration. We identified the CFQ-R and CFQoL as the most suitable for incorporation in the ACFDR as they captured significant effects of CF on HRQoL and were reliable and valid in CF populations. These PROMs will be used in a further qualitative study assessing patients' with CF and clinicians' perspectives toward the acceptability and feasibility of incorporating a PROM in the ACFDR.

PROSPERO REGISTRATION NUMBER

CRD42019126931.

Parent Observations of the Health Status of Infants With Clefts of the Lip: Results From Qualitative Interviews

OBJECTIVE

To explore, using semistructured qualitative interviews, parent observations of their infant's health as they relate to having a cleft lip or cleft lip and cleft palate (CL±P) and/or associated treatments.

DESIGN

Cross-sectional, qualitative study across 3 sites.

SETTING

Parents were recruited from 3 academic craniofacial centers. Most interviews were conducted over the telephone, audio-recorded, and transcribed.

PARTICIPANTS

Forty-one parents (31 English-, 10 Spanish-speaking) were interviewed. Parents had a child ages 1 to 35 months diagnosed with CL±P.

MAIN OUTCOME MEASURE(S)

Twelve domains reflecting infant health and well-being, likely affected by a CL±P and/or associated treatments, were identified from clinical experience and literature review. Study investigators conducted semistructured interviews based on 12 identified domains. After transcripts of the interviews were reviewed, our multidisciplinary team selected illustrative quotes from each domain that reflected consistent observations made by parents.

RESULTS

Parents' responses covered all 12 domains. Specifically, parents discussed the domain of feeding most frequently, followed by observations about sleep, development, comfort, breathing, and vocalization.

CONCLUSIONS

We found that parents of infants with clefts provided caregiver-centered language useful in describing their daily observations. No additional domains of infant health were noted by parents. We will use these observations and language to develop and validate a parent-reported observation diary that can augment assessments of the impacts of interventions on infants who are receiving care for CL±P.