Design and Administration of Patient-Centred Outcome Measures: The Perspectives of Children and Young People with Life-Limiting or Life-Threatening Conditions and Their Family Members

BACKGROUND

Self-reported health data from children with life-limiting conditions is rarely collected. To improve acceptability and feasibility of child and family-centred outcome measures for children, they need to be designed in a way that reflects preferences, priorities and abilities.

OBJECTIVES

The aim was to identify preferences for patient-reported outcome measure design (recall period, response format, length, administration mode) to improve the feasibility, acceptability, comprehensibility and relevance of a child and family-centred outcome measure, among children with life-limiting conditions and their family members.

METHOD

A semi-structured qualitative interview study seeking the perspectives of children with life-limiting conditions, their siblings and parents on measure design was conducted. Participants were purposively sampled and recruited from nine UK sites. Verbatim transcripts were analysed using framework analysis.

RESULTS

A total of 79 participants were recruited: 39 children aged 5-17 years (26 living with a life-limiting condition; 13 healthy siblings) and 40 parents (of children aged 0-17 years). Children found a short recall period and a visually appealing measure with ten questions or fewer most acceptable. Children with life-limiting conditions were more familiar with using rating scales such as numeric and Likert than their healthy siblings. Children emphasised the importance of completing the measure alongside interactions with a healthcare professional to enable them to talk about their responses. While parents assumed that electronic completion methods would be most feasible and acceptable, a small number of children preferred paper.

CONCLUSIONS

This study demonstrates that children with life-limiting conditions can engage in communicating preferences regarding the design of a patient-centred outcome measure. Where possible, children should be given the opportunity to participate in the measure development process to enhance acceptability and uptake in clinical practice. Results of this study should be considered in future research on outcome measure development in children.

Equivalence of Paper and Electronic-Based Patient Reported Outcome Measures for Children: A Systematic Review

Patient-reported outcome measures (PROMs) exist for a variety of chronic gastrointestinal disorders in children. The availability of electronic (e-)formats of PROMs enhance the accessibility of these tools. The International Society for Pharmacoeconomic and Outcomes Research (ISPOR) defines measurement equivalence (ME) as "comparability of the psychometric properties of data" obtained from the administration of original and adapted versions of PROMs. Consideration of proxy PROM versions is unique to pediatrics and must be included in ME evaluations. We conducted a systematic review (SR) of the literature evaluating ME of e-versions adapted from pediatric paper-based PROMs. A literature search was conducted through Medline, Embase, APA PsychInfo, and the Cochrane Library. Titles, abstracts, and manuscripts were reviewed by 2 independent reviewers. The search yielded 19 studies meeting pre-defined criteria. Just over half (52.6%) of 19 PROMs were disease-specific ones. ME between paper- and e-PROM versions was reported as present in all 19 studies evaluating 5653 participants under the age of 18 years. However, only 6 (31.6%) studies evaluated ME in proxy reported e-versions. Despite the use of PROMs for children with a variety of chronic gastrointestinal disorders, only 1 study evaluated a PROM in this population (IMPACT III for inflammatory bowel disease). Findings from this SR highlight strategic opportunities for the pediatric gastroenterologist to broaden the clinical and research armamentarium to include e-PROMs.

Quality of Life in Children and Adolescents with Stickler Syndrome in Spain

Objective: To describe the quality of life and daily functioning of Spanish children and adolescents living with Stickler syndrome (SS) and to estimate the prevalence of associated disease features in a representative sample. Methods: A cross-sectional study of children and adolescents with SS were recruited via telephone calls through the Spanish SS Association. All participants underwent a structured clinical interview and filled in questionnaires reporting their quality of life (EuroQol-5D, TSK-11, CHAQ and PedsQoL). The prevalence of the main features associated with the syndrome and the mean scores of the questionnaires were estimated with 95% confidence intervals (95% CI). Results: The recruited sample included 26 persons who were mainly children (mean age 10.4 ± 4.5 (SD) range: 5–14) and male (65.4%). The prevalence estimates of SS features were as follows: the presence of moderate pain (52%), hearing loss 67% (95% CI: 54.8 to 91.3) and myopia 96% (95% CI: 87.2 to 104.4). The mean scores of the QoL indices were as follows: 22.4 (95% CI: 19.2 to 25.5) (±7.5) for TSK-11; 76.2 (95% CI: 68.8 to 83.6) (±17.1) for PedsQoL, 0.8 (95% CI: 0.7 to 0.9) (±0.3) for EQ-5D and 0.61 (95% CI: 0.24 to 1.0) (±0.9) for the cHAQ functional index. Conclusions: Our results confirmed a high variability in syndrome-related manifestations, with a large prevalence of visual and hearing deficits, pain and maxillofacial alterations. These findings may facilitate the detection of the most prevalent problems in this population, which could be a target to be addressed during the treatment of children and adolescents with SS.

Feasibility of quantitative sensory testing in juvenile idiopathic arthritis

OBJECTIVE

Juvenile Idiopathic Arthritis (JIA) is a childhood-rheumatic disease with pain as a major early complaint, and in 10-17% pain remains a major symptom. Very few data exist on sensory threshold changes at the knee in JIA, a location in which inflammation often manifests. We determined whether JIA is associated with sensory threshold changes at the knee by using Quantitative Sensory Testing (QST) and established reference values at the knee of children.

METHODS

Sixteen patients with JIA aged 9-18 years with one affected knee and a patient-reported pain by Visual Analog Scale (VAS) > 10 on a 0-100 scale, and 16 healthy controls completed the study and were included for the analysis. QST was assessed in compliance with the German Research Network on Neuropathic Pain (DFNS) standard. Disease severity was determined using Juvenile Disease Activity Score (JADAS. Perceived pain was assessed with a visual analogue scale(0-100). Feasibility of QST was tested in patients aged 6-9.

RESULTS

Under the age of 9, QST testing showed not to be feasible in 3 out of 5 JIA patients. Patients with JIA aged 9 and older reported an average VAS pain score of 54.3. QST identified a significant reduction in pressure pain threshold (PPT) and increase in cold detection threshold (CDT) compared to healthy controls. PPT is reduced in both the affected and the unaffected knee, CDT is reduced in the unaffected knee, not the affected knee.

CONCLUSION

In a Dutch cohort of Patients with JIA, QST is only feasible from 9 years and up. Also, sensory threshold changes at the knee are restricted to pressure pain and cold detection thresholds in Patients with JIA.

PERSPECTIVE

This article shows that in a Dutch population, the extensive QST protocol is only feasible in the age group from 9 years and older, and a reduced set of QST tests containing at least pressure pain thresholds and cold detection thresholds could prove to be better suited to the pediatric setting with arthritis.

Enhancing validity, reliability and participation in self-reported health outcome measurement for children and young people: a systematic review of recall period, response scale format, and administration modality

Introduction

Self-report is the gold standard for measuring children’s health-related outcomes. Design of such measures is complex and challenging. This review aims to systematically appraise the evidence on recall period, response scale format, mode of administration and approaches needed to enable children and young people < 19 years to participate in valid and reliable self-reporting of their health outcomes.

Method

PsycInfo, Medline, CINAHL and Embase were searched from 1 January 1990 to 15 March 2020, and citation searching undertaken in Scopus. Articles were included if they were primary research or case reports of ≥ 3 participants reporting the following: recall period, response scale selection, administration modality. Quality was assessed using QualSyst, and results synthesised narratively. This review was conducted and reported according to PRISMA guidelines.

Results

81 of 13,215 retrieved articles met the inclusion criteria. Children < 5 years old cannot validly and reliably self-report health outcomes. Face scales demonstrate better psychometric properties than visual analogue or Likert scales. Computerised and paper scales generally show equivalent construct validity. Children prefer computerised measures. Children ≤ 7 years old think dichotomously so need two response options. Those > 8 years old can reliably use a 3-point scale.

Conclusion

The results of this review have both clinical and research implications. They can be used to inform appropriate choice of PROM for use with CYP in the clinical setting. We also give eight recommendations for future development of self-reported outcome measures for children and young people.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02814-4.

Validation of novel patient-centred juvenile idiopathic arthritis-specific patient-reported outcome and experience measures (PROMs/PREMs)

BACKGROUND

Measuring the outcomes that matter to children and young people (CYP) with juvenile idiopathic arthritis (JIA), is a necessary precursor to patient-centred improvements in quality of clinical care. We present a two-centre validation of novel JIA patient-reported outcome and experience measures (PROM and PREM) developed as part of the CAPTURE-JIA project.

METHODS

CYP with JIA were recruited from paediatric rheumatology clinics, completing the CAPTURE-JIA PROM and PREM, CHAQ and CHU 9D. A subset participated in face-to-face interviews and completed the PROM/PREM 1 week later. The OMERACT filter was applied and the three domains of validation assessed. Truth assessments included cognitive interviewing, sensitivity analysis and Spearman's correlations. Discrimination assessments included specificity and reliability testing. Feasibility was assessed using time to form completion and proportion of missing data.

RESULTS

Eighty-two CYP and their families were recruited; ten cognitive interviews and fifteen PROM/PREM test/retests were conducted. Truth: CYP and parents understood the PROM/PREM and felt important areas were covered. PROM criteria had high sensitivities (> 70%) against similar items on the CHU 9D, with the exception of fatigue (58%). Correlations between similar PROM and CHU 9D criteria were moderate to very strong (coefficients 0.40-0.82.) Discrimination: high specificities (> 70%) on corresponding PROM and CHU 9D domains. Feasibility: median completion times for PROM 60 s (IQR 38-75) and PREM 49 s (IQR 30-60) respectively.

CONCLUSION

The CAPTURE-JIA PROM and PREM are valid and feasible in UK paediatric rheumatology clinics. Embedding routine collection into clinical care would be a major step towards improving quality of care.

Effects of sense and functionality changes in the hands on activity and participation in patients with juvenile scleroderma

OBJECTIVES

The purpose of the study was to examine the effects of sense and functionality changes in the hands on activity and participation in patients with juvenile scleroderma (JS).

METHODS

Sixteen patients with juvenile localized scleroderma (JLS), 14 patients with Juvenile Systemic Sclerosis (JSS), and 30 healthy controls were included. Light touch-deep pressure sensation was assessed by Semmes-Weinstein monofilament test (SWMT). Localization sensation testing was performed by lightly stroking the patient's skin. The hand joint range of motion was measured with a goniometer, hand grip strength with Dynomometer, the pinch gripping force with pinch meter, and the hand mobility with modified Hand Mobility in Scleroderma (mHAMIS). Children completed their activity and participant performance status with 'Childhood Health Assessment Questionnaire (CHAQ)' and 'Jebson Taylor Hand Function Test (JTHFT)' questionnaire tests. The quality of life was evaluated using the 'Scleroderma Health Assessment Questionnaire (SHAQ)'.

RESULTS

There were significantly differences among evaluated three groups in light of touch-deep pressure sensation, sense of touch localization, range of motion, mHAMIS scores, JTHFT scores, all CHAQ scores, and almost all SHAQ score (p < .05). Over than half of patients with JSS (57.1%) and almost half of patients with JLS stated that their diseases obstructed them from doing any activity (p < .001). A significant percent of JSS patients (64.3%) had hand and wrist joint involvement.

CONCLUSION

Sensory and functional disorders caused by hand involvement in JS patients result in limitation of daily living activities and affect negatively the effective usage of the hand. Approximately half of the JS patients had disabilities in performing pinch motor skills of hands. The assessment of sensory symptoms that affect the functionality, activity level and participation of JSS and JLS patients should be considered during the routine clinical examination. We suggest the sensory therapies as an important factor in increasing the effectiveness of rehabilitation.

Developing and Evaluating JIApp: Acceptability and Usability of a Smartphone App System to Improve Self-Management in Young People With Juvenile Idiopathic Arthritis

BACKGROUND

Flare-ups in juvenile idiopathic arthritis (JIA) are characterized by joint pain and swelling and often accompanied with fatigue, negative emotions, and reduced participation in activities. To minimize the impact of JIA on the physical and psychosocial development and well-being of young people (YP), it is essential to regularly monitor disease activity and side effects, as well as to support self-management such as adherence to treatment plans and engagement in general health-promoting behaviors. Smartphone technology has the potential to engage YP with their health care through convenient self-monitoring and easy access to information. In addition, having a more accurate summary of self-reported fluctuations in symptoms, behaviors, and psychosocial problems can help both YP and health care professionals (HCPs) better understand the patient's condition, identify barriers to self-management, and assess treatment effectiveness and additional health care needs. No comprehensive smartphone app has yet been developed in collaboration with YP with JIA, their parents, and HCPs involved in their care.

OBJECTIVES

The objective of this study was to design, develop, and evaluate the acceptability and usability of JIApp, a self-management smartphone app system for YP with JIA and HCPs.

METHODS

We used a qualitative, user-centered design approach involving YP, parents, and HCPs from the rheumatology team. The study was conducted in three phases: (1) phase I focused on developing consensus on the features, content, and design of the app; (2) phase II was used for further refining and evaluating the app prototype; and (3) phase III focused on usability testing of the app. The interview transcripts were analyzed using qualitative content analysis.

RESULTS

A total of 29 YP (aged 10-23, median age 17) with JIA, 7 parents, and 21 HCPs were interviewed. Major themes identified as the ones that helped inform app development in phase I were: (1) remote monitoring of symptoms, well-being, and activities; (2) treatment adherence; and (3) education and support. During phase II, three more themes emerged that informed further refinement of the app prototype. These included (4) adapting a reward system to motivate end users for using the app; (5) design of the app interface; and (6) clinical practice integration. The usability testing during phase III demonstrated high rates of overall satisfaction and further affirmed the content validity of the app.

CONCLUSIONS

We present the development and evaluation of a smartphone app to encourage self-management and engagement with health care for YP with JIA. The app was found to have high levels of acceptability and usability among YP and HCPs and has the potential to improve health care and outcomes for this age group. Future feasibility testing in a prospective study will firmly establish the reliability, efficacy, and cost-effectiveness of such an app intervention for patients with arthritis.

Implementation of the Kids-CAT in clinical settings: a newly developed computer-adaptive test to facilitate the assessment of patient-reported outcomes of children and adolescents in clinical practice in Germany

PURPOSE

To describe the implementation process of a computer-adaptive test (CAT) for measuring health-related quality of life (HRQoL) of children and adolescents in two pediatric clinics in Germany. The study focuses on the feasibility and user experience with the Kids-CAT, particularly the patients' experience with the tool and the pediatricians' experience with the Kids-CAT Report.

METHODS

The Kids-CAT was completed by 312 children and adolescents with asthma, diabetes or rheumatoid arthritis. The test was applied during four clinical visits over a 1-year period. A feedback report with the test results was made available to the pediatricians. To assess both feasibility and acceptability, a multimethod research design was used. To assess the patients' experience with the tool, the children and adolescents completed a questionnaire. To assess the clinicians' experience, two focus groups were conducted with eight pediatricians.

RESULTS

The children and adolescents indicated that the Kids-CAT was easy to complete. All pediatricians reported that the Kids-CAT was straightforward and easy to understand and integrate into clinical practice; they also expressed that routine implementation of the tool would be desirable and that the report was a valuable source of information, facilitating the assessment of self-reported HRQoL of their patients.

CONCLUSIONS

The Kids-CAT was considered an efficient and valuable tool for assessing HRQoL in children and adolescents. The Kids-CAT Report promises to be a useful adjunct to standard clinical care with the potential to improve patient-physician communication, enabling pediatricians to evaluate and monitor their young patients' self-reported HRQoL.

Quality of life measures and psychiatric symptoms in adolescents with systemic lupus erythematosus and familial Mediterranean fever

PURPOSE

To describe the relation between global Quality of Life (QL) and psychiatric symptoms in adolescents with systemic lupus erythematosus (SLE) and familial Mediterranean fever (FMF), and to analyze the perceptions of parents and adolescents.

METHODS

This study included 51 adolescents diagnosed with SLE (n=25) and FMF (n=26), and 51 healthy adolescents. The Health Related QL (HRQL) of SLE patients was rated by parents and adolescents using the Simple Measurement of Impact of Lupus Erythematosus in Youngsters© (SMILEY©). The global QL of FMF patients and healthy adolescents was rated by the response given to the first question of the SMILEY© by each parent and adolescent. All participants completed the Brief Symptom Inventory (BSI), which measures psychiatric symptoms.

RESULTS

In total, 92.3% with FMF, 56% with SLE and 76.5% of healthy adolescents reported their global QL as good and very good using the first question of the SMILEY©. The global QL perceptions of adolescents and their parents did not correlate (FMF, p=0.94; SLE, p=0.16). SLE patients had the highest rate of depression (54.2%), whereas hostility was detected among 54.9% of healthy adolescents. Significant relations were detected between BSI and SMILEY© scores.

CONCLUSION

The global QL perceptions of adolescents with FMF were better than those of healthy adolescents, which may be explained by their perceived relief of anguish they suffer during their short-lived attacks. The global QL perceptions of adolescents with SLE were the worst, most probably due to the chronic course resulting in an awareness of limitations and intense treatment. Adolescents with SLE had similar psychopathological symptom scores when compared with FMF patients and healthy adolescents. This could be explained by developing resilience. Differences in the perception of adolescents versus their parents regarding global QL emphasized the importance of adolescent-specific interviews for chronic illnesses and multidisciplinary follow-up with adolescent medicine.

Recent developments in disease activity indices and outcome measures for juvenile idiopathic arthritis

There has been a concerted and important international effort to develop and validate disease activity and outcome instruments specific to JIA in recent years. This review aims to describe the disease assessment indices important to routine clinical care and integral to the design of outcome studies and clinical trials in JIA. In view of the increasing number of JIA clinical studies and clinical trials, together with a number of national and international paediatric biologic registers, it is important that knowledge of these new outcome measures is widespread, such that results can be placed in a meaningful context.

Psychometric characteristics of outcome measures in juvenile idiopathic arthritis: a systematic review

OBJECTIVE

To review the performance characteristics of the instruments most commonly used to measure clinical outcomes in juvenile idiopathic arthritis (JIA), including global assessments, articular indices, functional/disability assessments, and quality of life measures.

METHODS

As part of an Agency for Healthcare Research and Quality comparative effectiveness review of antirheumatic drugs, we explored the characteristics of commonly used outcome measures for JIA. English-language studies of children with JIA were identified from Medline and Embase. Two independent reviewers screened titles and abstracts, with subsequent full-text review of studies selected based on predetermined criteria.

RESULTS

We included 35 publications describing 34 unique studies and involving 14,831 patients. The Childhood Health Assessment Questionnaire (C-HAQ) was the most extensively studied instrument and had high reliability, but only moderate correlations with other indices of disease activity and poor responsiveness to change in disease status. The physician global assessment of disease activity (PGA) and articular indices had the strongest association with disease activity and were the most responsive to change. Measures of psychosocial function and quality of life were moderately associated with measures of disease activity, but were less responsive to changes in disease status.

CONCLUSION

In children with JIA, no single instrument was superior in reliability or validity or in describing the impact of JIA. Although the C-HAQ has been extensively evaluated, the PGA and articular indices appear to have the highest responsiveness to change and, therefore, the highest potential for detecting important differences in treatment response.