Interpreting patient-reported outcome results: US FDA guidance and emerging methods

Variability in Minimal Clinically Important Difference Calculation and Reporting in the Otolaryngology Literature

OBJECTIVE

Best practices for calculation of the minimal clinically important difference (MCID) of outcome measures include the use of complementary methodologies (broadly classified as anchor-based and distribution-based) and reporting of the MCID's predictive ability. We sought to determine MCID calculation and reporting patterns within the otolaryngology literature.

METHODS

A systematic search strategy of Embase, PubMed, and Web of Science databases was developed and implemented to identify studies reporting the determination of an MCID for an outcome measure. Studies specifically within the otolaryngology literature (defined as journals classified as "otorhinolaryngology" in the Journal Citation Reports database) were included. All those journals were additionally searched for relevant articles.

RESULTS

There were 35 articles that met the inclusion criteria. Of these studies, 88.6% reported MCID of a patient-reported outcome measure and the remainder were for objective outcome measurements. Anchor-based methods were used by 82.9% of studies and distribution-based methods were used by 68.6% of studies. Of all studies, 31.4% utilized anchor-based methods alone, 17.1% utilized distribution-based methods alone, and 51.4% used both methods. Only 25.7% of studies reported the sensitivity (median: 60.8%, range: 40.5%-86.7%) and specificity (median: 80.4%, range: 63.5%-88.0%) of the MCID to detect patients experiencing clinically important change.

CONCLUSION

Deviation from best practices in MCID calculation and reporting exists within the otolaryngology literature, with almost half of all studies only using one method of MCID calculation and almost three-quarters not reporting the predictive ability (sensitivity/specificity) of the calculated MCID. When predictive ability is reported, however, MCIDs appear to be more specific than sensitive.

LEVEL OF EVIDENCE

NA Laryngoscope, 134:2059-2069, 2024.

Psychometric evaluation of the near activity visual questionnaire presbyopia (NAVQ-P) and additional patient-reported outcome items

BACKGROUND

The Near Visual Acuity Questionnaire Presbyopia (NAVQ-P) is a patient-reported outcome (PRO) measure that was developed in a phakic presbyopia population to assess near vision function impacts. The study refined and explored the psychometric properties and score interpretability of the NAVQ-P and additional PRO items assessing near vision correction independence (NVCI), near vision satisfaction (NVS), and near vision correction preference (NVCP).

METHODS

This was a psychometric validation study conducted using PRO data collected as part of a Phase IIb clinical trial (CUN8R44 A2202) consisting of 235 randomized adults with presbyopia from the US, Japan, Australia, and Canada. Data collected at baseline, week 2, and months 1, 2, and 3 during the 3-month trial treatment period were included in the analyses to assess item (question) properties, NAVQ-P dimensionality and scoring, reliability, validity, and score interpretation.

RESULTS

Item responses were distributed across the full response scale for most NAVQ-P and additional PRO items. Confirmatory factor analysis supported the pre-defined unidimensional structure and calculation of a NAVQ-P total score as a measure of near vision function. Item deletion informed by item response distributions, dimensionality analyses, item response theory, and previous qualitative findings, including clinical input, supported retention of 14 NAVQ-P items. The 14-item NAVQ-P total score had excellent internal consistency (α = 0.979) and high test-retest reliability (Intraclass Correlation Coefficients > = 0.898). There was good evidence of construct-related validity for all PROs supported by strong correlations with concurrent measures. Excellent results for known-groups validity and ability to detect change analyses were also demonstrated. Anchor-based and distribution-based methods supported interpretation of scores through generation of group-level and within-individual estimates of meaningful change thresholds. A meaningful within-patient change in the range of 8-15-point improvement on the NAVQ-P total score (score range 0-42) was recommended, including a more specific responder definition of 10-point improvement.

CONCLUSIONS

The NAVQ-P, NVCI, and NVS are valid and reliable instruments which have the ability to detect change over time. Findings strongly support the use of these measures as outcome assessments in clinical/research studies and in clinical practice in the presbyopia population.

Development and validation of a universal esophageal patient-reported outcome measure: The Cleveland Clinic Esophageal Questionnaire (CEQ)

OBJECTIVE

Currently, there is no validated patient-reported outcome measure (PROM) applicable to all esophageal diseases. Our objective was to create a psychometrically robust, validated universal esophageal PROM that can also objectively assess patients' quality of life (QoL).

METHODS

The pilot PROM constructed based on expert opinions, literature review, and previous unpublished institutional research had 27 items covering 8 domains. It was completed by 30 patients in the outpatient clinic followed by a structured debriefing interview, which allowed for refining the PROM. The final PROM: Cleveland Clinic Esophageal Questionnaire (CEQ) included 34 items across 6 domains (Dysphagia, Eating, Pain, Reflux & Regurgitation, Dyspepsia, Dumping), each accompanied by a corresponding QoL component. Further psychometric assessment of the PROM was conducted by evaluating (1) acceptability, (2) construct validity, (3) reliability, and (4) responsiveness.

RESULTS

Five hundred forty-six unique patients (median 63.7 years [54.3-71.7], 53% male [287], 86% White) completed CEQ at >90% completion within 5 minutes. Construct validity was demonstrated by differentiating scores across esophageal cancer (n = 146), achalasia (n = 170), hiatal hernia (n = 160), and other diagnoses (n = 70). Internal reliability (Cronbach alpha 0.83-0.89), and test-retest reliability (intraclass correlation coefficients 0.63-0.85) were strong. Responsiveness was demonstrated through CEQ domains improving for 53 patients who underwent surgery for achalasia or hiatal hernia (Cohen d 0.86-2.59).

CONCLUSIONS

We have constructed a psychometrically robust, universal esophageal PROM that allows concise, consistent, objective quantification of symptoms and their effect on the patient. The CEQ is valuable in prognostication and tracking of longitudinal outcomes in both benign and malignant esophageal diseases.

The Utilization of Forced-Rate Cycling to Facilitate Motor Recovery Following Stroke: A Randomized Clinical Trial

BACKGROUND

The potential for aerobic exercise (AE) to enhance neuroplasticity post-stroke has been theorized but not systematically investigated. Our aim was to determine the effects of forced-rate AE (FE) paired with upper extremity (UE) repetitive task practice (FE + RTP) compared to time-matched UE RTP (RTP only) on motor recovery.

METHODS

A single center randomized clinical trial was conducted from April 2019 to December 2022. Sixty individuals ≥6 months post-stroke with UE hemiparesis were randomized to FE + RTP (N = 30) or RTP only (N = 30), completing 90-minute sessions, 3×/week for 8 weeks. The FE + RTP group underwent 45-minute of FE (5-minute warm-up, 35-minute main set, and 5-minute cool down) followed by 45-minute of UE RTP. The RTP only group completed 90-minute of RTP. Primary outcomes were the Fugl-Meyer Assessment (FMA) and Action Research Arm Test (ARAT). The 6-minute Walk Test (6MWT, secondary outcome) assessed walking capacity.

RESULTS

Sixty individuals enrolled and 56 completed the study. The RTP only group completed more RTP in terms of repetitions (411.8 ± 44.4 vs 222.8 ± 28.4, P < .001) and time (72.7 ± 6.7 vs 37.8 ± 2.4 minutes, P < .001) versus FE + RTP. There was no significant difference between groups on the FMA (FE + RTP, 36.2 ± 10.1-44.0 ± 11.8 and RTP only, 34.4 ± 11.0-41.2 ± 13.4, P = .43) or ARAT (FE + RTP, 32.5 ± 16.6-37.7 ± 17.9 and RTP only, 32.8 ± 18.6-36.4 ± 18.5, P = .88). The FE + RTP group demonstrated greater improvements on the 6MWT (274.9 ± 122.0-327.1 ± 141.2 m) versus RTP only (285.5 ± 160.3-316.9 ± 170.0, P = .003).

CONCLUSIONS

There was no significant difference between groups in the primary outcomes. The FE + RTP improved more on the 6MWT, a secondary outcome.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT03819764.

Virtual focus groups among individuals with use disorders: assessing feasibility and acceptability in an underserved clinical population

Objective

There are substantial barriers to conducting research among individuals with stigmatized and complicated health conditions like substance use disorders. These barriers slow progress when developing, refining, and assessing interventions to better treat underserved populations. Virtual focus groups are an innovative method for collecting data from individuals via a discreet and accessible platform which can inform novel as well as existing treatment approaches. This article reports on the feasibility and acceptability of virtual focus groups as a mechanism to recruit and engage geographically and demographically diverse samples of participants with substance use disorders that are otherwise logistically difficult to assess.

Method

Participants were assessed for eligibility for a virtual focus group study based on demographic features, drug use history, and psychiatric history via a remote, interview-based screening. Focus groups were completed anonymously without video or name-sharing. Discussion contributions, quantified with number of times speaking and total number of words spoken, were compared across gender, and treatment status. Participants provided quantitative and qualitative feedback on the focus group experience in a follow-up survey.

Results

Focus groups (N=26) based in geographical areas throughout the United States were conducted with 88 individuals with opioid use disorder or stimulant use disorder. Discussion contributions were comparable between genders and among individuals in treatment versus those seeking treatment. A follow-up survey (n=50, 57% of focus group participants) reflected high levels of enjoyment, comfort, and honesty during focus group discussions.

Discussion

Findings suggest virtual focus groups can be an effective and efficient tool for substance use research.

Development and validation of a questionnaire to assess owner and canine quality-of-life and treatment satisfaction in canine allergic dermatitis

BACKGROUND

Animal and owner quality-of-life (QoL) is pivotal in treatment decisions. Accurate measurement of owner-reported QoL and treatment satisfaction (TS) supports disease burden and treatment benefit evaluation.

OBJECTIVES

Develop and evaluate an owner-completed canine dermatitis QoL and TS questionnaire (CDQoL-TSQ) in allergic dogs.

MATERIALS AND METHODS

The CDQoL-TSQ was drafted following review of existing measures and expert input. Content validity was assessed through interviews with owners of allergic dogs. Psychometric properties of the QoL domains (Canine QoL, Owner QoL) were evaluated. Score interpretation was derived.

RESULTS

Twenty dog owners were interviewed. Item wording was amended following the first 10 interviews. Data from 211 owners were used in the psychometric evaluation. The Canine QoL domain demonstrated strong internal consistency (α = 0.89), test-retest reliability (ICC2,1  = 0.844), moderate convergent validity (r = 0.41) and moderate-high known-groups validity (effect size 0.37-0.64). The Owner QoL domain demonstrated strong internal consistency (α = 0.73), high convergent validity (r = 0.63) and moderate-high known-groups validity (0.43-0.63). Test-retest reliability approached moderate strength (ICC2,1  = 0.490). Group-level interpretation analysis showed minimal important difference of 7.0-13.6 points for dogs and 13.0-13.6 for owners. For individual dogs a change of 6.3 or 12.5 points for dogs, and 12.5 or 18.8 for owners indicates a response.

CONCLUSIONS AND CLINICAL RELEVANCE

The CDQOL-TSQ is a two-part assessment to evaluate QoL and TS in canine allergic dermatitis. The QoL questionnaire demonstrated validity and reliability, and interpretation of scores was derived, making it suitable for use in research and practice. The TS module is suitable for clinical setting use to improve owner-veterinarian communication.

Psychometric validation of the Ostomy Skin Tool 2.0

Background

Peristomal skin complications (PSCs) pose a major challenge for people living with an ostomy. To avoid severe PSCs, it is important that people with an ostomy check their peristomal skin condition on a regular basis and seek professional help when needed.

Aim

To validate a new ostomy skin tool (OST 2.0) that will make regular assessment of the peristomal skin easier.

Methods

Seventy subjects participating in a clinical trial were eligible for the analysis and data used for the validation. Item-level correlation with anchors, inter-item correlations, convergent validity of domains, test-retest reliability, anchor- and distribution-based methods for assessment of meaningful change were all part of the psychometric validation of the tool.

Results

A final tool was established including six patient reported outcome items and automatic assessment of the discolored peristomal area. Follow-up with cognitive debriefing interviews assured that the concepts were considered relevant for people with an ostomy.

Conclusion

The OST 2.0 demonstrated evidence supporting its reliability and validity as an outcome measure to capture both visible and non-visible peristomal skin complications.

Accelerated versus standard epirubicin followed by cyclophosphamide, methotrexate, and fluorouracil or capecitabine as adjuvant therapy for breast cancer (UK TACT2; CRUK/05/19): quality of life results from a multicentre, phase 3, open-label, randomised, controlled trial

BACKGROUND

Adjuvant chemotherapy for patients with early breast cancer improves outcomes but its toxicity affects patients' quality of life (QOL). The UK TACT2 trial investigated whether accelerated epirubicin improves time to recurrence and if oral capecitabine is non-inferior to cyclophosphamide, methotrexate, and fluorouracil (CMF) for efficacy with less toxicity. Results showed no benefit for accelerated epirubicin and capecitabine was non-inferior. As part of the QOL substudy, we aimed to assess the effect of chemotherapies on psychological distress, physical symptoms, and functional domains.

METHODS

TACT2 was a multicentre, phase 3, open-label, parallel-group, randomised, controlled trial done in 129 UK centres. Participants were aged 18 years or older with histologically confirmed node-positive or high-risk node-negative invasive primary breast cancer, who had undergone complete excision, and due to receive adjuvant chemotherapy. Patients were randomly assigned (1:1:1:1) to four cycles of 100 mg/m2 epirubicin either every 3 weeks (standard epirubicin) or every 2 weeks with 6 mg pegfilgrastim on day 2 of each cycle (accelerated epirubicin), followed by four 4-week cycles of either CMF (600 mg/m2 cyclophosphamide intravenously on days 1 and 8 or 100 mg/m2 orally on days 1-14; 40 mg/m2 methotrexate intravenously on days 1 and 8; and 600 mg/m2 fluorouracil intravenously on days 1 and 8 of each cycle) or four 3-week cycles of 2500 mg/m2 capecitabine (1250 mg/m2 given twice daily on days 1-14 of each cycle). The randomisation schedule was computer generated in random permuted blocks, stratified by centre, number of nodes involved (none vs 1-3 vs ≥4), age (≤50 years vs >50 years), and planned endocrine treatment (yes vs no). QOL was one of the secondary outcomes and is reported here. All patients from a subset of 44 centres were invited to complete QOL questionnaires (Hospital Anxiety and Depression Scale [HADS] and European Organisation for Research and Treatment of Cancer [EORTC] Quality of Life Questionnaire 30-item core module [QLQ-C30] and Quality of Life Questionnaire breast module [QLQ-BR23]) at baseline, end of standard or accelerated epirubicin, end of CMF or capecitabine, and at 12 and 24 months after randomisation. The QOL substudy prespecified two coprimary QOL outcomes assessed in the intention-to-treat population: overall QOL (reported elsewhere) and HADS total score. Prespecified secondary QOL outcomes were EORTC QLQ-C30 subscales of physical function, role function, and fatigue and EORTC QLQ-BR23 subscales of sexual function and systemic therapy side-effects. This trial is registered with ISRCTN, ISRCTN68068041, and ClinicalTrials.gov, NCT00301925.

FINDINGS

From Dec 16, 2005, to Dec 5, 2008, 4391 patients (20 [0·5%] of whom were male) were enrolled in TACT2; 1281 (85·8%) of 1493 eligible patients were included in the QOL substudy. Eight (0·6%) participants in the QOL substudy were male and 1273 (99·4%) were female. Median follow-up was 85·6 months (IQR 80·6-95·9). Analysis was performed on the complete QOL dataset (as of Sept 15, 2011) when all participants had passed the 24-month timepoint. Prerandomisation questionnaires were completed by 1172 (91·5%) patients and 1179 (92·0%) completed at least one postrandomisation questionnaire. End-of-treatment HADS depression score (p=0·0048) and HADS total change score (p=0·0093) were worse for CMF versus capecitabine. Accelerated epirubicin led to worse physical function (p=0·0065), role function (p<0·0001), fatigue (p=0·0002), and systemic side-effects (p=0·0001), but not sexual function (p=0·36), compared with standard epirubicin during treatment, but the effect did not persist. Worse physical function (p=0·0048), sexual function (p=0·0053), fatigue (p<0·0001), and systemic side-effects (p<0·0001), but not role functioning (p=0·013), were seen for CMF versus capecitabine at end of treatment; these differences persisted at 12 months and 24 months.

INTERPRETATION

Accelerated epirubicin was associated with worse QOL than was standard epirubicin but only during treatment. These findings will help patients and clinicians make an informed choice about accelerated chemotherapy. CMF had worse QOL effects than did capecitabine, which were persistent for 24 months. The favourable capecitabine QOL compared with CMF supports its use as an adjuvant option after neoadjuvant chemotherapy in patients with triple-negative breast cancer.

FUNDING

Cancer Research UK, Amgen, Pfizer, and Roche.

Meaningful within-patient change for clinical outcome assessments: model-based approach versus cumulative distribution functions

OBJECTIVES

The FDA recommends the use of anchor-based methods and empirical cumulative distribution function (eCDF) curves to establish a meaningful within-patient change (MWPC) for a clinical outcome assessment (COA). In practice, the estimates obtained from model-based methods and eCDF curves may not closely align, although an anchor is used with both. To help interpret their results, we investigated and compared these approaches.

METHODS

Both repeated measures model (RMM) and eCDF approaches were used to estimate an MWPC on a target COA. We used both real-life (ClinicalTrials.gov: NCT02697773) and simulated data sets that included 688 patients with up to six visits per patient, target COA (range 0 to 10), and an anchor measure on patient global assessment of osteoarthritis from 1 (very good) to 5 (very poor). Ninety-five percent confidence intervals for the MWPC were calculated by the bootstrap method.

RESULTS

The distribution of the COA score changes affected the degree of concordance between RMM and eCDF estimates. The COA score changes from simulated normally distributed data led to greater concordance between the two approaches than did COA score changes from the actual clinical data. The confidence intervals of MWPC estimate based on eCDF methods were much wider than that by RMM methods, and the point estimate of eCDF methods varied noticeably across visits.

CONCLUSIONS

Our data explored the differences of model-based methods over eCDF approaches, finding that the former integrates more information across a diverse range of COA and anchor scores and provides more precise estimates for the MWPC.

Evaluation of clinical benefits of treatments for Alzheimer's disease

The need for regulatory approval of new therapies for the treatment of Alzheimer's disease-a progressive neurodegenerative condition-has made the assessment of treatment efficacy an urgent priority for discussion and investigation in the field. In the first part of this Personal View, we summarise current views on what constitutes a clinically meaningful benefit from treatment for Alzheimer's disease, including the concept of a minimum treatment effect against which to compare trial outcomes and its limitations. Considering existing and divergent definitions of clinically meaningful change, we define this concept in the second part of the Personal View by proposing a new approach that consecutively considers whether a treatment benefit for Alzheimer's disease is noticeable, valuable, and worthwhile in the context of costs and risks. This approach could be a useful foundation from which the field can move forwards on this issue and address existing gaps in understanding.

Novel Endpoints in Solid Organ Transplantation: Targeting Patient-reported Outcome Measures

Although solid organ transplantation improves survival and quality of life in many patients with organ failure, treatment complications and side effects can have debilitating consequences for patients. Patient-reported outcome measures (PROMs) capture how patients feel and function, including quality of life, symptoms, and side effects that are assessed directly by patients. Yet, they remain infrequently reported in trials in solid organ transplantation. Barriers to implementing PROMs in trials include uncertainty in selecting appropriate PROMs, concerns about resources limitations, patient burden, and limited evidence to support the psychometric robustness of measures for use in transplant recipients. In recent years, there have been increasing efforts to include patient-reported outcomes that are important to patients in trials to ensure that trials provide patient-centered information for decision-making. This article will provide an overview of PROMs, discuss PROs that are important to solid organ transplant recipients and those that are used in trials in solid organ transplantation, and outline approaches for selecting PROMs for clinical trials.

Determining minimal clinically important difference estimates following surgery for degenerative conditions of the lumbar spine: analysis of the Canadian Spine Outcomes and Research Network (CSORN) registry

BACKGROUND CONTEXT

There is significant variability in minimal clinically important difference (MCID) criteria for lumbar spine surgery that suggests population and primary pathology specific thresholds may be required to help determine surgical success when using patient reported outcome measures (PROMs).

PURPOSE

The purpose of this study was to estimate MCID thresholds for 3 commonly used PROMs after surgical intervention for each of 4 common lumbar spine pathologies.

STUDY DESIGN/SETTING

Observational longitudinal study of patients from the Canadian Spine Outcomes and Research Network (CSORN) national registry.

PATIENT SAMPLE

Patients undergoing surgery from 2015 to 2018 for lumbar spinal stenosis (LSS; n = 856), degenerative spondylolisthesis (DS; n = 591), disc herniation (DH; n = 520) or degenerative disc disease (DDD n = 185) were included.

OUTCOME MEASURES

PROMs were collected presurgery and 1-year postsurgery: the Oswestry Disability Index (ODI), and back and leg Numeric Pain Rating Scales (NPRS). At 1-year, patients reported whether they were 'Much better'/'Better'/'Same'/'Worse'/'Much worse' compared to before their surgery. Responses to this item were used as the anchor in analyses to determine surgical MCIDs for benefit ('Much better'/'Better') and substantial benefit ('Much better').

METHODS

MCIDs for absolute and percentage change for each of the 3 PROMs were estimated using a receiving operating curve (ROC) approach, with maximization of Youden's index as primary criterion. Area under the curve (AUC) estimates, sensitivity, specificity and correct classification rates were determined. All analyses were conducted separately by pathology group.

RESULTS

MCIDs for ODI change ranged from -10.0 (DDD) to -16.9 (DH) for benefit, and -13.8 (LSS) to -22.0 (DS,DH) for substantial benefit. MCID for back and leg NPRS change were -2 to -3 for each group for benefit and -4.0 for substantial benefit for all groups on back NPRS. MCID estimates for percentage change varied by PROM and pathology group, ranging from -11.1% (ODI for DDD) to -50.0% (leg NPRS for DH) for benefit and from -40.0% (ODI for DDD) to -66.6% (leg NPRS for DH) for substantial benefit. Correct classification rates for all MCID thresholds ranged from 71% to 89% and were relatively lower for absolute vs percent change for those with high or low presurgical scores.

CONCLUSIONS

Our findings suggest that the use of generic MCID thresholds across pathologies in lumbar spine surgery is not recommended. For patients with relatively low or high presurgery PROM scores, MCIDs based on percentage change, rather than absolute change, appear generally preferable. These findings have applicability in clinical and research settings, and are important for future surgical prognostic work.

Approach to patient reported outcome measures selection and implementation in a chronic norovirus clinical efficacy trial for patients after solid organ transplant

Norovirus is the second most common cause of diarrhea among solid organ transplant recipients. There are currently no approved therapies for Norovirus, which can substantially impact quality of life, particularly in an immunocompromised patient population. In order to establish clinical efficacy and support any medication claims related to a patient's symptoms or function, the Food and Drug Administration requires that a trial's primary endpoints be derived from patient reported outcome measures- an outcome that comes directly from the patient, without interpretation of the patient's response by a clinician or anyone else. In this paper, we describe our study team's approach to the definition, selection, measurement and evaluation of patient reported outcome measures as part of establishing clinical efficacy of Nitazoxanide for acute and chronic Norovirus in solid organ transplant recipients. We specifically describe our approach to measuring the primary efficacy endpoint- days to cessation of vomiting and diarrhea after randomization through 160 days, measured through daily symptom diaries as well as the impact of treatment on exploratory efficacy endpoints, particularly change in the impact of norovirus on psychological function and quality of life.

Recovery and long-term outcome after neurosurgical closure of spinal CSF leaks in patients with spontaneous intracranial hypotension

INTRODUCTION

Spontaneous intracranial hypotension due to a spinal cerebrospinal fluid leak causes orthostatic headaches and impacts quality of life. Successful closure rates are often reported, whereas data on long-term outcome are still scarce.

METHODS

Between April 2020 and December 2022 surgically treated patients completed the Headache Impact Test-6 prior to surgery and at 14 days, three months, six months, and 12 months postoperatively. In addition to the Headache Impact Test-6 score, we extracted data related to orthostatic symptoms.

RESULTS

Eighty patients were included. Median Headache Impact Test-6 score preoperatively was 65 (IQR 61-69), indicating severe and disabling impact of headaches. At three months headache impact significantly improved to 49 (IQR 44-58) (p < 0.001) and remained stable up to 12 months (48, IQR 40-56), indicating little to no impact of headaches on quality of life. The need to lie down "always" or "very often" was reduced from 79% to 23% three months postoperatively (p < 0.001).

CONCLUSIONS

Surgical closure of spinal CSF leaks significantly improves the impact of headaches in the long term. At least three months should be expected for recovery. Despite permanent closure of the CSF-leak, a quarter of patients still have relevant long-term impairment, indicating the need for further research on its cause and possible treatment.

Facial involvement is reflective of patients' global perception of vitiligo extent

BACKGROUND

The involvement of visible areas in vitiligo has been found to be correlated with increased psychiatric morbidity. Although multiple tools have been developed to assess vitiligo, no cutoff for improvement or worsening of vitiligo from a patient's perspective has been established.

OBJECTIVES

To determine the minimal clinically important difference (MCID) of the Self-Assessment Vitiligo Extent Score (SA-VES) in patients with vitiligo and to evaluate, from the patient's perspective, the importance of the change in the involvement of visible areas (face and hands) in patients' overall perception of disease worsening or improving.

METHODS

This was a cross-sectional study in the context of the ComPaRe e-cohort. Adult patients with vitiligo were invited to answer online questionnaires. They completed the SA-VES twice, 1 year apart. In addition, patients answered a 5-point Likert anchor question aimed at assessing their perception of the evolution of the extent of their vitiligo. The MCID was calculated using distribution- and anchor-based approaches. Using ordinal logistic regression, the change of vitiliginous lesions on the face or hands was compared to the overall extent of vitiligo (patches on all body areas).

RESULTS

In total, 244 patients with vitiligo were included in the analyses; 20 (8%) were found to have an improvement in their vitiligo. The MCID in worsened patients was equal to a 1.3% body surface area [95% confidence interval (CI) 1.01-1.43] increase in the SA-VES. For participants with improved vitiligo, the MCID was equal to a decrease in total SA-VES of 1.3% (95% CI 0.867-1.697). Patients' perceptions of change in their vitiligo was increased sevenfold when it affected the face vs. the rest of the body.

CONCLUSIONS

Changes in the facial SA-VES were highly correlated with patients' impressions of the extent of vitiligo.

Comparison of false positive and false negative rates of two indices of individual reliable change: Jacobson-Truax and Hageman-Arrindell methods

Background

Quantification of change is crucial for correctly estimating the effect of a treatment and for distinguishing random or non-systematic changes from substantive changes. The objective of the present study was to learn about the performance of two distribution-based methods [the Jacobson-Truax Reliable Change Index (RCI) and the Hageman-Arrindell (HA) approach] that were designed for evaluating individual reliable change.

Methods

A pre-post design was simulated with the purpose to evaluate the false positive and false negative rates of RCI and HA methods. In this design, a first measurement is obtained before treatment and a second measurement is obtained after treatment, in the same group of subjects.

Results

In relation to the rate of false positives, only the HA statistic provided acceptable results. Regarding the rate of false negatives, both statistics offered similar results, and both could claim to offer acceptable rates when Ferguson's stringent criteria were used to define effect sizes as opposed to when the conventional criteria advanced by Cohen were employed.

Conclusion

Since the HA statistic appeared to be a better option than the RCI statistic, we have developed and presented an Excel macro so that the greater complexity of calculating HA would not represent an obstacle for the non-expert user.

Quality of Life in Teduglutide-Treated Patients with Short Bowel Syndrome Intestinal Failure-A Nested Matched Pair Real-World Study

BACKGROUND

Quality of life (QoL) data of chronic intestinal failure (cIF) patients treated with the GLP-2 analogue teduglutide are scarce. This study aims to analyze QoL changes over time in teduglutide-treated patients and compare the results to a matched non-treated cIF control group in a real-world setting.

METHODS

QoL data (SF-36 and SBS-QoL^TM) were obtained from adult cIF patients being treated with teduglutide and compared to previously collected QoL data from a PNLiver trial (DRKS00010993), during which patients had been therapy naive. The dataset was then extended by a pairwise matched control group (non-teduglutide-treated PNLiver trial patients) and follow-up data from this group were collected accordingly.

RESULTS

Median teduglutide treatment duration and the follow-up period of controls were both 4.3 years. SBS-QoL^TM subscales and the SBS-QoL^TM sum score showed significant improvements over time in teduglutide-treated patients, as well as for the SF-36 physical and mental component summary scores (all p < 0.02), while non-treated patients showed no significant changes in any of the mentioned scores. Significant differences of QoL changes between treated and non-treated patients were seen for both SF-36 summary scores (p = 0.031 and 0.012).

CONCLUSIONS

We herein demonstrate for the first time that QoL significantly improved during teduglutide treatment in SBS-cIF patients in a real-world setting compared to individually matched non-treated SBS-cIF patients, indicating relevant clinical benefits.

Psychometric Validation of the ViSIO-PRO and ViSIO-ObsRO in Retinitis Pigmentosa and Leber Congenital Amaurosis

INTRODUCTION

Retinitis Pigmentosa (RP) and Leber Congenital Amaurosis (LCA) are rare inherited retinal degenerative disorders. The Visual Symptom and Impact Outcomes patient-reported outcome (ViSIO-PRO) and observer-reported outcome (ViSIO-ObsRO) instruments were developed in this population to assess visual function symptoms and impacts on vision-dependent activities of daily living (ADL) and distal health-related quality of life (HRQoL). This study aimed to explore the psychometric properties of the ViSIO-PRO and ViSIO-ObsRO in RP/LCA.

METHODS

The 49-item ViSIO-PRO and 27-item ViSIO-ObsRO instruments were completed by 83 adult and adolescent patients and 22 caregivers of child patients aged 3-11 years with RP/LCA, respectively, at baseline and 12-16-day follow-up. Concurrent measures were also administered at baseline. Psychometric analyses assessed item (question) properties, dimensionality, scoring, reliability, validity, and score interpretation.

RESULTS

Item responses were mainly evenly distributed across the response scale, and inter-item correlations were mostly moderate to strong (> 0.30) at baseline within hypothesized domains. Item deletion was informed by item properties, qualitative data, and clinical input and supported retention of 35 ViSIO-PRO items and 25 ViSIO-ObsRO items. Confirmatory factor analysis in line with pre-hypothesized domains supported a four-factor model assessing visual function symptoms, mobility, vision-dependent ADL, and distal HRQoL. A bifactor model supported calculation of total scores and four domain scores. Internal consistency was high for domain and total scores (Cronbach's alpha > 0.70) and test-retest reliability for total scores was strong between baseline and 12-16-day follow-up (intraclass correlation coefficients 0.66-0.98). Convergent validity was supported by strong correlations in a logical pattern with concurrent measures. Mean baseline scores differed significantly between severity groups. Distribution-based methods provided initial insights to guide interpretation of scores.

CONCLUSIONS

Findings supported item reduction and established scoring of the instruments. Evidence of reliability and validity as outcome measures in RP/LCA was also reported. Further research is ongoing to explore responsiveness of the ViSIO-PRO and ViSIO-ObsRO instruments and interpretation of change scores.

Impact of the number of previous lumbar operations on patient-reported outcomes after surgery for lumbar spinal stenosis or lumbar disc herniation

Repeated lumbar spine surgery has been associated with inferior clinical outcomes. This study aimed to examine and quantify the impact of this association in a national clinical register cohort. This is a population-based study from the Norwegian Registry for Spine surgery (NORspine). We included 26,723 consecutive cases operated for lumbar spinal stenosis or lumbar disc herniation from January 2007 to December 2018. The primary outcome was the Oswestry Disability Index (ODI), presented as the proportions reaching a patient-acceptable symptom state (PASS; defined as an ODI raw score ≤ 22) and ODI raw and change scores at 12-month follow-up. Secondary outcomes were the Global Perceived Effect scale, the numerical rating scale for pain, the EuroQoL five-dimensions health questionnaire, occurrence of perioperative complications and wound infections, and working capability. Binary logistic regression analysis was conducted to examine how the number of previous operations influenced the odds of not reaching a PASS. The proportion reaching a PASS decreased from 66.0% (95% confidence interval (CI) 65.4 to 66.7) in cases with no previous operation to 22.0% (95% CI 15.2 to 30.3) in cases with four or more previous operations (p < 0.001). The odds of not reaching a PASS were 2.1 (95% CI 1.9 to 2.2) in cases with one previous operation, 2.6 (95% CI 2.3 to 3.0) in cases with two, 4.4 (95% CI 3.4 to 5.5) in cases with three, and 6.9 (95% CI 4.5 to 10.5) in cases with four or more previous operations. The ODI raw and change scores and the secondary outcomes showed similar trends. We found a dose-response relationship between increasing number of previous operations and inferior outcomes among patients operated for degenerative conditions in the lumbar spine. This information should be considered in the shared decision-making process prior to elective spine surgery.

Using Movement Disorder Society Unified Parkinson's Disease Rating Scale Parts 2 and 3 Simultaneously: Combining the Patient Voice with Clinician Ratings

BACKGROUND

Regulatory recommendations favor outcomes combining objective and patient input. The Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), the most commonly used scale in Parkinson's disease (PD), includes patient and investigator ratings in distinct parts, but original clinimetric analyses failed to confirm the validity of combining parts by simple summing.

OBJECTIVES

The aim was to develop clinimetrically valid constructs for combining patient-reported Part 2 and investigator-rated Part 3 MDS-UPDRS scores.

METHODS

Using 7888 MDS-UPDRS scores, we assessed construct validity of combined Part 2 and Part 3 items using exploratory factor analysis (EFA) and graded item response theory (IRT) with threshold criteria: comparative fit index ≥0.9 (EFA) and discrimination parameters ≥0.65 (IRT).

RESULTS

The direct sum of Parts 2 + 3 failed to meet the threshold for a valid outcome of PD severity (comparative fit index, CFI = 0.855). However, a two-domain construct combining item scores for tremor and non-tremor domains from Parts 2 and 3 confirmed validity, meeting both EFA and IRT criteria as distinct but correlated indices of disease severity (CFI = 0.923; discrimination mean 2.197 ± 0.480 [tremor] and 1.737 ± 0.344 [non-tremor] domains).

CONCLUSIONS

The sum of Parts 2 + 3 is not clinimetrically sound. However, considering tremor and non-tremor items of both Parts 2 and 3 as two outcomes results in a valid summary of PD motor severity that leverages simultaneous patient- and investigator-derived measures. This analytic application addresses regulatory prioritizations and retains the well-validated MDS-UPDRS items. In future interventional trials, we suggest that tremor and non-tremor components of PD motor severity from Parts 2 + 3 be monitored and analyzed to accurately detect objective changes that integrate the patient's voice. © 2023 International Parkinson and Movement Disorder Society.

Quality of life with relugolix combination therapy for uterine fibroids: LIBERTY randomized trials

BACKGROUND

Symptomatic uterine fibroids are burdensome to live with; they are associated with symptom-related distress, affect daily activities, and reduce health-related quality of life. The LIBERTY randomized clinical trials showed that oral relugolix combination therapy (40 mg relugolix, 1 mg estradiol, and 0.5 mg norethindrone acetate once daily) markedly improved fibroid-associated symptoms and conditions, including heavy menstrual bleeding, pain, and anemia, and was well-tolerated.

OBJECTIVE

This study aimed to evaluate the effect of relugolix combination therapy on the symptom burden and health-related quality of life among women with uterine fibroids.

STUDY DESIGN

Two replicate, multinational, double-blind, 24-week, randomized, placebo-controlled, phase 3 studies, LIBERTY 1 and LIBERTY 2, were conducted in premenopausal women with uterine fibroid-associated heavy menstrual bleeding (≥80 mL per cycle for 2 cycles or ≥160 mL during 1 cycle). The symptom burden and health-related quality of life were secondary endpoints and were assessed using the validated Uterine Fibroid Symptom and Quality of Life questionnaire, which the participants completed at baseline and at week 12 and 24 of treatment. For this secondary analysis, the pooled LIBERTY 1 and LIBERTY 2 data set was used. The Uterine Fibroid Symptom and Quality of Life questionnaire is made up of a Symptom Severity scale and a Health-Related Quality of Life scale, the latter of which includes 6 subscales focusing on the following aspects of daily life: concern, activities, energy or mood, control, self-consciousness, and sexual function. The Revised Activities subscale of the Health-Related Quality of Life scale addresses the impact of uterine fibroids on physical and social activities. Symptom burden was also assessed via the Bleeding and Pelvic Discomfort subscale, a patient-reported outcome measure derived from the Uterine Fibroid Symptom Severity scale that focuses on distress from key uterine fibroid symptoms, which was a key secondary endpoint. Least squares mean changes from baseline to week 24 in the Symptom Severity scale, Bleeding and Pelvic Discomfort subscale, overall Health-Related Quality of Life scale, and the respective subscales were compared between the relugolix combination therapy and placebo groups. Responder analyses of the proportion of women who experienced a clinically meaningful change from baseline to week 24 were conducted for the Bleeding and Pelvic Discomfort and the activity subscales. A stratified Cochran-Mantel-Haenszel test, adjusted for stratification factors (region [North America vs rest of world] and baseline menstrual blood loss volume), was used for treatment comparisons.

RESULTS

Across both trials, 509 women were randomized to the relugolix combination therapy or placebo groups (April 2017-December 2018). Participants on relugolix combination therapy showed a statistically significant reduction in symptom severity (-33.5 vs -12.1; nominal P<.0001) and the Bleeding and Pelvic Discomfort subscale from baseline to week 24 when compared with those on placebo treatment (-48.4 vs -17.4; nominal P<.0001). Overall, the total Health-Related Quality of Life scores improved significantly from baseline to week 24 in the relugolix combination therapy group when compared with the placebo (+37.6 vs +13.1; nominal P<.0001). Responder analyses demonstrated that more women treated with relugolix combination therapy reported a clinically meaningful reduction in the Bleeding and Pelvic Discomfort subscale and an improvement in physical and social activities when compared with those treated with the placebo (nominal P<.0001).

CONCLUSION

After 24 weeks of treatment with relugolix combination therapy, women with symptomatic uterine fibroids experienced substantial improvements in health-related quality of life with all subscales showing improvement, including emotional well-being, physical and social activities, and sexual function. In addition, women reported substantial reductions in the overall symptom burden and distress caused by key fibroid-associated symptoms.

Development and evaluation of the Acromegaly Symptom Diary

BACKGROUND

Patient-reported outcome (PRO) measures are important to consider when evaluating treatments, yet there are no PRO measures for patients with acromegaly that have been developed in accordance with US Food and Drug Administration guidance. Acromegaly is a rare, chronic condition caused by hypersecretion of growth hormone. Disease activity is monitored by measurement in serum of growth hormone and insulin-like growth factor-I. The objectives of this research were to develop the Acromegaly Symptom Diary (ASD), establish a scoring algorithm, and evaluate the psychometric measurement properties of the ASD.

METHODS

Semistructured interviews consisting of concept elicitation and cognitive debriefing components were conducted with 16 adult participants with acromegaly. The concept elicitation component identified symptoms important to individuals with acromegaly. The cognitive debriefing component gathered information about the participants' experience with each proposed item of the ASD, their thought process for answering each question, and their interpretation of the items. The psychometric properties of the draft ASD were then evaluated using data from the ACROBAT Evolve (NCT03792555; n = 13) and ACROBAT Edge (NCT03789656; n = 47) clinical trials.

RESULTS

The 16 participants from the interviews described ongoing symptoms, with the most frequently reported being joint pain (n = 13) and fatigue (n = 12), followed by swelling (n = 8), headache (n = 7), and mood swings (n = 6), and were able to interpret and understand the ASD items and had no issues with the 24-hour recall period. From data collected in the clinical studies, the psychometric properties of internal consistency (0.91 - 0.80), test-retest reliability with item-level and total ASD scores (> 0.70), baseline construct validity (r ≥ |0.38|) across scales, and responsiveness to change (r = 0.52-0.56) were supported for the ASD. The proposed preliminary threshold range to characterize a meaningful change from the patients' perspective for the ASD total is a 4- to 6-point change for improvement or worsening out of a total score of 70.

CONCLUSION

These findings provide qualitative and quantitative evidence to support the ASD as fit for the purpose of evaluating the symptom experience of patients with acromegaly in clinical trials.

Biologic Abatement and Capturing Kids' Outcomes and Flare Frequency in Juvenile Spondyloarthritis (BACK-OFF JSpA): study protocol for a randomized pragmatic trial

BACKGROUND

The effectiveness of biologic therapies, primarily tumor necrosis factor inhibitors (TNFi), for children with spondyloarthritis (SpA) has made inactive disease a realistic patient outcome. However, biologic therapies are costly, primarily delivered by subcutaneous or intravenous route, and have non-trivial side effects. Many patients and families want to know if biologic medications can be discontinued after inactive disease is achieved. It remains unclear whether medication dose should remain unchanged, tapered (increase the time between doses), or discontinued once when inactive disease is attained.

METHODS

The Biologic Abatement and Capturing Kids' Outcomes and Flare Frequency in Juvenile SpA (BACK-OFF JSpA) trial is a multicenter pragmatic trial that will randomize 198 participants ages 8-21 years old with SpA and sustained inactive disease on standard TNFi dosing to (1) continue standard TNFi dosing, (2) fixed longer dosing intervals of TNFi, or (3) stop TNFi. The trial will compare the hazard rate of protocol-defined flare and participants' emotional health among the 3 groups over 12 months. Innovative aspects of this trial are the involvement of patient and parent stakeholders in the design and conduct of the study as well as an electronic health record-based enhanced recruitment strategy.

DISCUSSION

This is the first randomized pragmatic trial to assess the efficacy of TNFi de-escalation strategies in children with JSpA with sustained inactive disease. This research will improve the evidence base that patients, caregivers, and rheumatologists use to make shared decisions about continued treatment versus de-escalation of TNFi therapy in this population.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04891640. Registered on 18 May 2021.

Validation of a Health-Related Quality of Life Questionnaire in Patients With Recurrent Clostridioides difficile Infection in ECOSPOR III, a Phase 3 Randomized Trial

BACKGROUND

Debilitating symptoms of recurrent Clostridioides difficile infection (rCDI) often lead to long-term effects on health-related quality-of-life (HRQOL). In ECOSPOR III, SER-109, an investigational oral microbiome therapeutic, was superior to placebo in reducing rCDI. We investigated the validity, reliability, and responsiveness of a 32-item, CDI-specific questionnaire-the Clostridium difficile Quality of Life Survey (Cdiff32)-across mental, physical, and social domains in patients with rCDI.

METHODS

In this post hoc analysis of a phase 3 clinical trial, 182 outpatients with rCDI completed Cdiff32 and EQ-5D at baseline and at 1 and 8 weeks. Cdiff32 was evaluated for item performance, internal reliability, and convergent validity. To assess known-groups validity, Cdiff32 scores were compared by disease recurrence status at week 1; internal responsiveness was evaluated in the nonrecurrent disease group by 8 weeks by means of paired t test.

RESULTS

All 182 patients (mean age [standard deviation], 65.5 [16.5] years; 59.9% female) completed baseline Cdiff32. Confirmatory factor analysis identified 3 domains (physical, mental, and social relationships) with good item fit. High internal reliability was demonstrated (Cronbach α = 0.94 with all subscales >0.80). Convergent validity was evidenced by significant correlations between Cdiff32 subscales and EQ-5D (r = 0.29-0.37; P < .001). Cdiff32 differentiated patients by disease recurrence status at week 1 (effect sizes, 0.38-0.42; P < .05 overall), with significant improvement from baseline through week 8 in patients with nonrecurrent disease at week 1 (effect sizes, 0.75-1.02; P < .001 overall).

CONCLUSIONS

Cdiff32 is a valid, reliable, and responsive disease-specific HRQOL questionnaire that is fit for purpose for interventional treatment trials. The significant improvement in patients with nonrecurrent disease by 8 weeks demonstrates the negative impact of rCDI on HRQOL.

It Is as It Was: MDS-UPDRS Part III Scores Cannot Be Combined with Other Parts to Give a Valid Sum

BACKGROUND

Original clinimetric analyses by the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS) developers did not confirm the validity of summing the scores of its parts. Recent studies used the summed score of Part III and other parts as efficacy outcomes.

OBJECTIVE

The aim of this study was to establish whether summing scores of MDS-UPDRS parts can be recommended.

METHODS

Using 7466 full MDS-UPDRS scores, we applied two-step factor analysis as in the original article to reassess the validity analysis with the threshold criterion set at comparative fit index ≥0.9.

RESULTS

All comparative fit indexes of any combination including Part III were lower than 0.90.

CONCLUSIONS

Summing Part III MDS-UPDRS scores with other parts is not clinimetrically sound. The MDS-UPDRS is a validated four-part scale with corresponding individual part scores and needs to be used within the limits originally presented. © 2022 International Parkinson and Movement Disorder Society.

Development and Validation of a Juvenile Spondyloarthritis Disease Flare Measure: Ascertaining Flare in Patients With Inactive Disease

OBJECTIVE

Our objective was to develop and validate a composite disease flare definition for juvenile spondyloarthritis (SpA) that would closely approximate the clinical decision made to reinitiate or not reinitiate systemic therapy after therapy de-escalation.

METHODS

Retrospective chart reviews of children with SpA who underwent systemic therapy de-escalation of biologic or conventional disease-modifying antirheumatic drugs were used to develop and validate the flare outcome. Data on independent cohorts for development (1 center) and validation (4 centers) were collected from large tertiary health care systems. Core measure thresholds and candidate disease flare outcomes were assessed using sensitivity, specificity, positive predictive values (PPVs) and negative predictive values (NPVs), and the receiver operating characteristic (ROC) area under the curve (AUC), with physician assessment of active disease plus re-initiation of standard dose of systemic therapy as the reference standard.

RESULTS

Of the candidate definitions, clinically meaningful worsening in ≥3 of the following 5 core measures performed best: caregiver/patient assessment of well-being; physician assessment of disease activity; caregiver/patient assessment of pain, physical function, and active joint count. The ROC AUC was 0.91, PPV 87.5%, NPV 98.1%, sensitivity 82.4%, and specificity 98.7%. Cronbach's α was 0.81, signifying internal consistency, and factor analysis demonstrated that the outcome measured 1 construct. The Juvenile SpA Flare measure had face validity according to 21 surveyed pediatric rheumatologists. Juvenile SpA Flare had an ROC AUC of 0.85, a PPV of 92.3%, and an NPV of 96.8% in the validation cohort.

CONCLUSION

There is initial support for the validity of the Juvenile SpA Flare measure as a tool to identify disease flare in juvenile SpA patients de-escalating therapy, and the measure is potentially applicable in clinical practice, observational studies, and therapeutic trials.

Sensitivity-to-change and predictive validity of the Cervantes Short-Form (C-SF) questionnaire in postmenopausal women

OBJECTIVES

To explore, for the first time, the ability of the Cervantes Short-Form (C-SF) questionnaire to detect and to predict meaningful changes (sensitivity-to-change and predictive validity) in women with menopausal symptoms receiving any therapeutic management under routine medical care.

METHODS

Postmenopausal women included in a registry study were the source of data. Sensitivity-to-change was explored by assessing the responses of C-SF to different type of treatment management: no treatment, natural therapies or systemic hormonal therapy (SHT). Predictive validity assessed the ability of baseline score to predict the reduction in the impact of menopausal symptoms in C-SF scoring equal or higher than one time its minimally important difference (MID) of improvement (response rate).

RESULTS

A total of 245 women were enrolled. C-SF score was significantly reduced (better QoL) with SHT by 10.62 points versus no change or 2.32 point by natural therapies or no treatment, respectively (p < 0.001 in both cases). Women declaring better improvement after treatment showed higher significant reduction in C-SF score versus those with no self-perceived improvement or impairment: -12.49 point versus +1.06 and +12.71, respectively (p < 0,01 in both cases). Responder rate showed a significant lineal growing trend with higher C-SF scoring at baseline in women who received SHT: higher scoring showed higher response rates (lineal Chi² = 15.9, p < 0.001), but not in the case of receiving natural therapies or no treatment.

CONCLUSIONS

C-SF was shown to be sensitive-to-change when postmenopausal QOL status changes due to mainly systemic hormonal treatment, therefore, supporting the utilization of this instrument to monitor response to treatment. Likewise, pre-treatment scoring in C-SF was able to predict woman's QOL meaningful response with hormonal treatment.

Anatomical double-bundle anterior cruciate ligament reconstruction moderately improved tegner scores over the long-term: a systematic review and meta-analysis of randomized controlled trials

PURPOSE

To assess the effects of anatomical double-bundle (DB) versus single-bundle (SB) for anterior cruciate ligament (ACL) reconstruction in skeletally mature patients with ACL injuries.

METHODS

MEDLINE, EMBASE, and CENTRAL were searched from inception to February 7, 2022 were screened for randomized controlled trials. The Anatomic Anterior Cruciate Ligament Reconstruction Checklist was used to categorize studies as anatomic. A random-effects meta-analysis was conducted, with pooled results being summarized using mean difference (MD). Risk of Bias (RoB) was assessed using the RoB 2.0 tool. Certainty of evidence was rated using GRADE.

RESULTS

A search of 1371 unique articles yielded eight eligible trials, representing 735 patients (360 DB, 375 SB) with mean (SD) age of 28.5 (2.86) years and follow-up of 52.1 (36.2) months. Most trials had moderate to low RoB. Overall, DB was not significantly better than SB on Lysholm scores (MD = 0.52, 95% CI, - 1.80-2.85, p = 0.66; moderate certainty) or subjective International Knee Documentation Committee (IKDC) scores (MD = - 0.40, 95% CI, - 4.35-3.55, p = 0.84; moderate certainty). Tegner scores were significantly higher in SB than DB in the intermediate term (MD = - 0.72, 95% CI, - 1.10 to - 0.34, p = 0.0002; high certainty), while significantly higher in DB relative to SB in the long-term (MD = 0.52, 95% CI, 0.02-1.03, p = 0.04; high certainty).

CONCLUSION

DB ACL reconstruction significantly improves Tegner scores relative to SB ACL reconstruction over the long-term (t ≥ 5 years). Intermediate term Tegner scores favour SB reconstruction. In both durations, there was no clinically significant difference based on the pre-specified minimal clinically important difference of 1.0 point. There were also no significant differences in IKDC or Lysholm scores. Surgeons should consider anatomical DB ACL reconstruction as a result of long-term improvement in patient-reported outcomes.

LEVEL OF EVIDENCE

I.

Comparison of anchor-based methods for estimating thresholds of meaningful within-patient change using simulated PROMIS PF 20a data under various joint distribution characteristic conditions

PURPOSE

To compare the performance of anchor-based methods for estimating thresholds of meaningful within-patient change (i.e., individual change) of clinical outcome assessments in conditions reflecting data characteristics of small- to medium-sized clinical trials.

METHODS

Datasets were generated from the joint distributions of the PROMIS PF 20a T-score changes and a seven-point global change anchor measure. The 108 simulation conditions (1000 replications per condition) included combinations of three marginal distributions of T-score changes, three improvement percentages in the anchor measure, four levels of responsiveness correlations, and three sample sizes. Threshold estimation methods included mean change, median change, ROC curve, predictive modeling, half SD, and SEM. Relative bias, precision, accuracy, and measurement significance of the estimates were evaluated based on comparison with true thresholds and IRT-based individual reliable changes of PROMIS scores. Quantile regression models were applied to select and interpret effects of simulation conditions on estimation bias.

RESULTS

When PROMIS T-score changes were distributed normally, the predictive modeling method performed best with 50% or more responders identified by the anchor; the mean and median methods were preferred with 30% responders. For skewed distributions, the median method and ROC method gained more advantages. Among the evaluated study conditions, the improvement percentage condition had the most obvious effects on estimation bias.

CONCLUSION

To establish accurate and precise thresholds, clinical researchers are recommended to prioritize study designs with at least 50% anchor-defined responders and strongly responsive target endpoints with highly reliable scoring calibration and to select optimal anchor-based methods given the data characteristics.

Interpreting Patient-Reported Outcome Scores: Pediatric Inflammatory Bowel Disease as a Use Case

OBJECTIVE

To demonstrate how to interpret Patient-Reported Outcomes Measurement Information System (PROMIS) pediatric patient-reported outcome measure (PROM) scores for patients with pediatric inflammatory bowel disease (IBD).

METHODS

Using data from a prospective cohort study of patients ages 8 to 23 years with IBD (n = 1049), we established disease-specific percentiles and computed the minimal clinically important difference (MCID) change score for 6 pediatric PROMs. We applied these results, general population percentiles, and the reliable change index to interpret PROM scores in a clinical trial sample of patients ages 8 to 20 years with IBD (n = 294) in which PROMIS PROMs were obtained at baseline and 3 months later.

RESULTS

Application of general population percentiles showed that the clinical trial sample at baseline had moderately worse self-reported health than the general population (22% of patients at or above the 95th percentile on Fatigue; 21% on Pain Interference). IBD-specific percentiles showed that the sample was somewhat worse than the reference IBD sample (8% of patients at or above the 95th percentile on Fatigue; 11% on Pain Interference). Application of the MCID threshold indicated that among the subgroup of patients that improved by 15 or more on the short Pediatric Crohn's Disease Activity Index (n = 38), 45% also improved on IBD Symptoms, 47% for Fatigue, and 65% for Pain Interference.

CONCLUSION

This study established IBD-specific percentiles for 6 pediatric PROMIS measures and demonstrated the application of percentiles and other methods for interpreting PROM scores.

Minimal important change was on the lower spectrum of previous estimates and responsiveness was sufficient for core outcomes in chronic low back pain

OBJECTIVES

The objective of this study was to estimate the minimal important change (MIC) and responsiveness of core patient reported outcome measures for chronic low back pain (LBP) and Modic changes.

STUDY DESIGN AND SETTING

In the Antibiotics in Modic changes (AIM) trial we measured disability (RMDQ, ODI), LBP intensity (NRS) and health-related quality of life (EQ5D) electronically at baseline, three- and 12-month follow-up. MICs were estimated using Receiver Operating Curve (ROC) curve and Predictive modeling analyses against the global perceived effect. Credibility of the estimates was assessed by a standardized set of criteria. Responsiveness was assessed by a construct and criterion approach according to COSMIN guidelines.

RESULTS

The MIC estimates of RMDQ, ODI and NRS scores varied between a 15-40% reduction, depending on including "slightly improved" in the definition of MIC or not. The MIC estimates for EQ5D were lower. The credibility of the estimates was moderate. For responsiveness, five out of six hypotheses were confirmed and AUC was >0.7 for all PROMs.

CONCLUSION

When evaluated in a clinical trial of patients with chronic LBP and Modic changes, MIC thresholds for all PROMs were on the lower spectrum of previous estimates, varying depending on the definition of MIC. Responsiveness was sufficient.

Development, Psychometric Validation and Responder Definition of Worst Itch Scale in Children with Severe Atopic Dermatitis

INTRODUCTION

Itch associated with atopic dermatitis (AD) has a profoundly negative effect on patients of all ages. Therefore, itch is a main target for AD therapeutic approaches, and treatments are perceived as beneficial when they achieve an itch reduction. In the absence of a validated scale for children aged 6-11 years that is suitable for assessing itch intensity in clinical trial settings, the Worst Itch Scale was developed.

METHODS

Qualitative interviews, comprising concept elicitation and cognitive debriefing, were conducted to develop and evaluate the content validity of the Worst Itch Scale. Psychometric assessments used data from the LIBERTY AD PEDS phase 3 trial of dupilumab in patients aged 6-11 years with severe AD. These included test-retest reliability, construct validity, known-groups validity and responsiveness. Thresholds for clinically meaningful change were defined using anchor- and distribution-based methods.

RESULTS

The Worst Itch Scale consisted of two items asking about 'worst itching' experienced 'last night' and 'today'. Worst Itch Scale scores showed large, positive correlations with existing patient-reported outcome (PRO) measures of itch, and weaker correlations with clinician-reported outcome (ClinRO) measures assessing objective signs of AD. Improvements in Worst Itch Scale scores were highly correlated with improvements in other itch PROs and moderately correlated with improvements in ClinROs. The responder definition based on the primary anchor, a 1-point improvement in the Patient Global Impression of Disease, was 2.84. Supportive anchors produced response estimates ranging from 2.43 to 4.80 points.

CONCLUSIONS

The Worst Itch Scale is a fit-for-purpose (e.g. well-defined, reliable, responsive and valid) scale for evaluating worst itch intensity in children aged 6-11 years with severe AD. The within-patient threshold for defining a clinically meaningful response was a ≥ 3-4-point change in the Worst Itch Scale score.

TRIAL REGISTRATION

NCT03345914. Video: How can we reliably assess itch intensity in children 6-11 years with severe atopic dermatitis in clinical trial settings?

Implementation of sacral neuromodulation for urinary indications. A Danish prospective study during the initial 15 months of a new service in a tertiary referral hospital

OBJECTIVE

Sacral neuromodulation (SNM) is a well-established treatment modality for idiopathic overactive bladder and urgency incontinence, idiopathic fecal incontinence and non-obstructive urinary retention. This study describes the start-up phase of establishing the SNM service. Primary objective: To investigate the patient-reported outcome measures of SNM on lower urinary tract dysfunction symptoms. Secondary objectives: To investigate bowel function, sexual satisfaction and to monitor SNM safety.

MATERIALS AND METHODS

Twenty-two patients with refractory idiopathic and neurogenic lower urinary tract dysfunction were offered a two-stage test-phase procedure and SNM device implantation. On completing the study, the patients rated their satisfaction with the treatment using a five-point Likert scale and a bother score of urinary, bowel and sexual symptoms on a scale of 1-10 (the worst). Their complications were assessed.

RESULTS

Nineteen patients (86%) were responders during the test phase and had the pulse generator implanted. Seventeen patients were very satisfied/satisfied. A statistically significant change in urinary symptoms bother score was observed in the idiopathic and neurogenic patients, a reduction from 10 to 4 (p = .0057) and 10 to 3 (p = .014), respectively. Eleven patients (58%) had symptoms from two or three pelvic compartments. Nine patients (47%) had complications. All but one event was resolved.

CONCLUSIONS

SNM is safe in this heterogeneous group of patients with refractory lower urinary tract dysfunction of various etiologies. A substantial improvement was observed in the pelvic organ dysfunction, demanding a multidisciplinary approach. More studies are required to standardize the evaluation of the subjective and objective outcomes of SNM.

Is IQWiG's 15% Threshold Universally Applicable in Assessing the Clinical Relevance of Patient-Reported Outcomes Changes? An ISPOR Special Interest Group Report

This article discusses a recent methodological change to assess the additional benefit of drug intervention by the German Federal Joint Committee (Gemeinsamer Bundesausschuss), a key stakeholder in EUnetHTA21 (European Network for Health Technology Assessment joint consortium for future EU HTA regulation), methodological workstream. The German Federal Joint Committee (Gemeinsamer Bundesausschuss) set a universal individual response threshold at ≥ 15% of the scale range of the measurement instrument, for all patient-reported outcomes, to achieve an additional benefit rating for a given pharmaceutical intervention. This approach is originally based on a corresponding recommendation from the Institute for Quality and Efficiency in Health Care. The merits of this approach are reviewed from various perspectives, including the evidence basis, statistical and psychometric considerations, and regulatory perspectives by the ISPOR Clinical Outcomes Assessment Special Interest Group's multistakeholder group of authors (academia, contract research organizations, and industry). Particular focus is placed on the patient perspective within the Institute for Quality and Efficiency in Health Care approach. The article development incorporated feedback from ISPOR members during well-attended ISPOR US and European conference presentations and 2 formal rounds of written review. The authors concluded that the ≥ 15% response threshold is incongruent with previously defined and scientifically established thresholds and is not well-suited for universal implementation. Further scientific evidence and discussion among all stakeholders are needed, especially should this universal rule be considered in the context of future joint clinical assessments of health technologies in the European Union scheduled from 2025 onward.

Using qualitative methods to establish the clinically meaningful threshold for treatment success in alopecia areata

PURPOSE

Traditionally, appropriate anchors are used to investigate the amount of change on a clinician-reported outcome assessment that is meaningful to individual patients. However, novel qualitative methods involving input from disease state experts together with patients may better inform the individual improvement threshold for demonstrating the clinical benefit of new treatments. This study aimed to establish a clinically meaningful threshold for treatment success for the clinician-reported Severity of Alopecia Tool (SALT) score for patients with alopecia areata (AA).

METHODS

A purposive sample of 10 dermatologists expert in AA and 30 adult and adolescent patients with AA and a history of ≥ 50% scalp hair loss were recruited. Semi-structured interview questions explored the outcome that represented treatment success to clinicians and patients. Findings were analyzed using thematic methods to identify treatment success thresholds.

RESULTS

Both informant groups confirmed scalp hair amount as the outcome of priority. Most expert clinicians considered a static threshold of 80% (n = 5) or 75% (n = 3) of the scalp hair as a treatment success. Most patient responses ranged from 70 to 90% (median: 80% of the scalp hair). Subsequently, queried patients confirmed that achieving SALT score ≤ 20 with treatment would be a success, as reflected in the Alopecia Areata Investigator Global Assessment (AA-IGA™). The novel qualitative processes used to inform this meaningful threshold reflects a clinician-then-patient process for: (a) confirmation of the patient outcome of priority; and (b) clinician input on a preliminary treatment success level for independent understanding among patients.

CONCLUSION

This qualitative investigation of expert clinicians-then-patients with AA confirmed that achieving an amount of 80% or more scalp hair (SALT score ≤ 20) was an appropriate individual treatment success threshold indicating clinically meaningful improvement for patients with ≥ 50% scalp hair loss. A qualitative investigation of a quantifiable treatment success threshold is possible through a well-designed interview process with expert clinicians and the appropriate patient population.

Determining the minimal important differences in the RQLQ score with grass and tree allergy immunotherapy versus placebo in adults with moderate-to-severe allergy

Background

Pollen from grasses and trees can trigger allergic rhinitis (AR), where the symptoms and associated consequences can negatively affect quality of life (QoL). The Rhinoconjunctivitis Quality of Life Questionnaire (RQLQ) is frequently used in clinical trials of AR to assess QoL. To help interpret RQLQ data, the minimal important difference (MID) can be used to assess whether a mean difference in QoL between treatment groups is clinically meaningful. In seasonal allergy, an MID differs according to the allergen, pollen exposure, symptom severity, patient age and treatment; the same MID cannot be applied to all scenarios.

Methods

Using data from four Phase III clinical trials of SQ sublingual immunotherapy‐tablets in adults with moderate‐to‐severe allergy, between‐group MIDs were derived for the RQLQ in grass pollen allergy (during the peak [n = 501] and entire [n = 514] pollen seasons), and in tree pollen allergy (during the birch [n = 516] and tree [n = 518] pollen seasons), using anchor‐based methodology, supported by distribution‐based methods.

Results

For grass pollen allergy, anchor‐based derived between‐group MIDs were 0.22 for the entire pollen season (n = 343) and 0.10 for the peak pollen season (n = 335). For tree pollen allergy, anchor‐based derived between‐group MIDs were 0.26 for the tree pollen season (n = 306) and 0.16 for the birch pollen season (n = 305) (representative of peak season). Distribution‐based derived MIDs were supportive of the anchor‐based values.

Conclusions

This analysis has derived between‐group MIDs specific to the trial populations evaluated and to the conditions under which the data were obtained, and highlights the need for a range of MIDs to reflect the unique nature of seasonal allergic disease.

When Dialysis "Becomes Life": Pediatric Caregivers' Lived Experiences Obtained From Patient-Reported Outcomes Measures

Introduction

Qualitative research reveals significant caregiver impact resulting from managing children requiring chronic dialysis but offers few quantitative measures of their lived experiences.

Materials and Methods

This cross-sectional study included 25 caregivers of children on chronic peritoneal dialysis (PD) and hemodialysis (HD) enrolled from 2018 to 2019 at a large pediatric dialysis program in the U.S.Patient Reported Outcomes Measures Information System (PROMIS) measures and free text commentary were collected and analyzed to evaluate the self-reported impact and wellbeing of these caregivers.

Results

Among all dialysis modalities, caregivers' positive affect (43.4 ± 10) and general life satisfaction (45.1 ± 11.5) were significantly lower than the general adult population. Compared with HD caregivers, PD caregivers demonstrated significantly more fatigue and sleep disturbance and less positive affect and life satisfaction. Amongst HD caregivers, sleep disturbance, positive affect, and meaning/purpose differed significantly from the general population. Analyses of text commentary revealed that caregivers also expressed the feelings of loss, importance of knowing the impact of dialysis prior to initiation, need for a support group, and value of home nursing.

Conclusions

Caregivers of children on chronic dialysis had significantly poorer self-rated health and wellbeing compared with the general adult population. This may be due in part to their feelings of social isolation. Our findings highlight opportunities to improve caregivers' lived experiences.

Quality of life impact of eye diseases: a Save Sight Registries study

BACKGROUND

The objectives of this study were to evaluate the quality-of-life (QoL) impact of eye diseases (keratoconus; neovascular age-related macular degeneration, AMD; retinal vein occlusion, RVO; and diabetic macular edema, DME) using the Impact of Vision Impairment (IVI) questionnaire, and to determine the relationship between the IVI scores and visual acuity.

METHODS

This cross-sectional, multicentre, real-world study utilised the prospective, web-based Save Sight Registries. The IVI was completed by 1557 patients: 307 with keratoconus, 1049 with AMD, 148 with RVO and 53 with DME. Statistical analysis included Rasch analysis, Welch t-test, one-way ANOVA, Tukey's test, Pearson correlation, and multiple regression.

RESULTS

The IVI scales (Overall; Visual Function, VF; Emotional, EM) had robust psychometric properties. The keratoconus patients had the worst Overall (adjusted mean: 48.2 vs. DME 58.8, RVO 64.6, AMD 67.6 units), VF (47.7 vs. DME 59.4, RVO 65.9, AMD 68.9 units) and EM (50.8 vs. DME 63.1, RVO 69.2, AMD 71.8 units) scores (all p < 0.05). The IVI scales scores weakly correlated with better and worse eye visual acuity (Pearson's r 0.24-0.39, all p < 0.05). The correlations were similar in the better eye (Overall 0.35, VF 0.39, EM 0.24) and the worse eye (Overall 0.31, VF 0.33, EM 0.25) visual acuity. Correlations with visual acuity were stronger for VF than for the EM scores.

CONCLUSIONS

The IVI was a psychometrically robust QoL questionnaire. Keratoconus patients had worse IVI scores than patients with retinal diseases. The low strength of correlations between visual acuity and QoL scores, although statistically significant, suggested that a complex relationship exists.

Validation of the work ability index-single item and the pain disability index-work item in patients with chronic low back pain

PURPOSE

A cross-sectional and longitudinal study was conducted to analyse construct validity, responsiveness, and Minimal Clinically Important Change (MCIC) in the Work Ability Score (WAS) and Pain Disability Index Work item (PDI-W) in patients with Chronic Low Back Pain (CLBP).

METHOD

Construct validity was assessed by testing predefined hypotheses. Responsiveness and MCIC were measured with an anchor-based method. The area under the receiver Operating Characteristic Curve (AUC) and the optimal cut-off point were calculated. Smallest Detectable Change (SDC) was calculated to determine measurement error.

RESULTS

In total, 1502 patients (age 18-65 years) with CLBP were included. For validity of the WAS and PDI-W, respectively, seven and six out of 10 hypotheses were not rejected. The WAS (n = 355) was responsive to change with an AUC of 0.70. MCIC was 1.5 point, SDC_individual 4.9, and SDC_group 0.3. MCICs were 4.5, 1.5, and - 0.5 points for, respectively, low, middle, and high scoring baseline groups. The PDI-W (n = 297) was responsive to change with an AUC of 0.80. MCIC was - 2.5 points, SDC_individual 5.2, and SDC_group 0.3. MCICs were - 0.5, - 2.5, and - 4.5 points for, respectively, low, middle, and high scoring baseline groups.

CONCLUSION

Construct validity of the WAS and PDI-W was insufficient in this patient sample. The WAS and PDI-W are responsive to change. On average, improvements of 1.5 point (WAS) and  - 2.5 points (PDI-W) were interpreted as clinically important. However, MCICs are also baseline dependent. Due to a risk of measurement error, at the individual level change scores should be interpreted with caution.

Use of Patient-Reported Outcomes Measurement Information System Pediatric Measures as Clinical Trial Endpoints: Experience from a Multicenter Pragmatic Trial in Children with Crohn's Disease

OBJECTIVES

To evaluate whether Patient-Reported Outcomes Measurement Information System (PROMIS) pediatric patient-reported outcome (PRO) measures can serve as valid endpoints in a clinical trial of a chronic pediatric illness.

STUDY DESIGN

We evaluated the responsiveness of PROMIS pediatric measures collected through the Clinical Outcomes of Methotrexate Binary Therapy in Practice (COMBINE) trial, a multicenter, randomized, double-blind, placebo-controlled, pragmatic clinical trial in pediatric patients with Crohn's disease (CD). We examined the relationships between changes in PROMIS pediatric measures and changes in disease activity by evaluating PRO score changes among patients who did and patients who did not experience improvement in disease activity.

RESULTS

Participants included 266 children and adolescents with CD from a total of 35 institutions. Over the course of follow-up, participants showed improvement in most PRO domains, with the largest effect sizes observed for the clinically improved group. Patients who maintained steroid-free remission showed significantly lower PRO scores for the Pain Interference, Fatigue, and inflammatory bowel disease (IBD) Symptoms domains and higher scores for the Positive Affect domain.

CONCLUSIONS

This study demonstrates the responsiveness of the PROMIS pediatric measures of Fatigue and Pain Interference as study endpoints in a large, multicenter pragmatic trial in pediatric CD, extending a growing body of research supporting the use of PROMIS pediatric measures as reliable PRO endpoints for clinical trials.

Clinically Meaningful Benefit in Women with Hypoactive Sexual Desire Disorder Treated with Flibanserin

Background

The efficacy of flibanserin in treating hypoactive sexual desire disorder (HSDD) is based upon statistically significant improvements in sexual desire, satisfying sexual events, and distress. However, clinically meaningful benefit has not been well characterized.

Aim

Evaluate clinically meaningful benefit of flibanserin.

Methods

Data were pooled from 3 pivotal trials evaluating flibanserin 100 mg qhs in premenopausal women (flibanserin, n = 1192; placebo, n = 1215). Flibanserin trial data in postmenopausal women (flibanserin, n = 450; placebo, n = 476) were analyzed separately. Clinically meaningful benefit was evaluated by the Patient Global Impression of Improvement (PGI-I). Responders were determined through anchor-based analyses that used the PGI-I for key efficacy endpoints: satisfying sexual events (SSE), desire domain of the Female Sexual Function Index (FSFI-d), and distress associated with decreased sexual desire (FSDS-R13). Odds ratios were calculated to assess effect size and Kaplan-Meier analyses were performed to estimate onset time for treatment benefit.

Outcomes

PGI-I, anchor-based analyses for key efficacy endpoints (SSE, FSFI-d, FSDS-R13), odds ratios, onset time for treatment benefit.

Results

Based on the PGI-I, more patients reported clinically meaningful benefit with flibanserin treatment versus placebo (49.8% vs 33.6%, premenopausal cohort; 40.5% vs 28.7%, postmenopausal cohort). In anchor-based analyses, responder rates were significantly higher for premenopausal women on flibanserin (46.1%–55.2%) than placebo (34.1%–44.2%) for all 3 key efficacy endpoints (P < .0001). Responder rates for postmenopausal women on flibanserin were higher compared to placebo for SSE (29.8% vs 22.9%; P = .015) and FSFI-d (38.9% vs 26.3%; P = .0001). Odds ratios for key endpoints indicated that premenopausal women were 2.0–2.4 times as likely to be responders with flibanserin treatment compared to placebo. Postmenopausal women were 1.6 times as likely to be responders with flibanserin for FSFI-d. Kaplan-Meier analyses indicated significant separation between flibanserin and placebo for the key endpoints in both premenopausal and postmenopausal cohorts (log-rank tests P < .01) with earlier median response times among patients receiving flibanserin.

Clinical Implications

Patient-reported benefit assessments such as the PGI-I capture the patient's perspective and may be a useful approach in assessing overall clinical meaningfulness for sexual dysfunction therapies.

Strengths and Limitations

Strengths include a well-powered study with large enrollment, use of validated instruments, and self-assessment of treatment benefit. Limitations include pooling of trial data in premenopausal women with slightly different study designs and use of an endpoint (SSE) indirectly related to HSDD.

Conclusion

Assessment of clinically meaningful benefit and additional responder analyses provide further support for flibanserin's efficacy beyond numerical improvements in endpoint measures.

Simon JA, Clayton AH, Kim NN, et al. Clinically Meaningful Benefit in Women with Hypoactive Sexual Desire Disorder Treated with Flibanserin. Sex Med 2022;10:100476.

Interpreting Evaluating Respiratory SymptomsTM in COPD Diary Scores in Clinical Trials: Terminology, Methods, and Recommendations

Accurately interpreting scores on patient-reported outcome (PRO) measures is essential to understanding and communicating treatment benefit. Over the years, terminology and methods for developing recommendations for PRO score interpretation in clinical trials have evolved, leading to some confusion in the field. The phrase "minimal clinically important difference (MCID)" has been simplified to "minimal important difference (MID)" and use of responder thresholds to interpret statistically significant treatment effects has increased. Anchor-based derivation methods continue to be the standard, with specific variations preferred by regulatory authorities for drug development programs. In the midst of these changes, the Evaluating Respiratory Symptoms™ in COPD (E-RS:COPD) was developed and qualified for use as an endpoint in chronic obstructive pulmonary disease (COPD) drug development programs. This paper summarizes the evolution of terminology and method preferences for the development of recommendations for interpreting scores from PRO measures used in clinical trials, and how these changes are reflected in the E-RS:COPD recommendations. The intent is to add clarity to discussions around PRO endpoints and facilitate use of the E-RS:COPD as a key efficacy endpoint in clinical trials of COPD.

Patient-Centered Goals for Treatment of Pelvic Floor Disorders

Purpose of review

To review the current literature on patient centered goals for the treatment of pelvic floor disorders (PFDs).

Recent findings

Patients have a poor understanding of their PFDs, regardless if they had prior PFD treatments or received counseling, emphasizing the need for improved education from healthcare providers. Understanding the patient perspective provides insights into identifying patient goals, which facilitates communication and allows for tailored counseling, management of expectations, and assessment of treatment response. Functional outcomes are consistently important to patients, often listed as their main treatment goals. The achievement of these goals is fundamental to satisfaction. IMPACT and PROMIS are examples of PCO measures that can be utilized in both research and clinical settings. Finally, telemedicine has emerged as a viable alternative to clinic visits that offers improved access to care with no increase in adverse events or dissatisfaction, in order to aid in monitoring and meeting patient treatment goals.

Summary

Patient involvement is fundamental to providing value-based care. Provider understanding of the patient perspective is necessary to guide counseling and treatment. Patient-centered goals offer a way to engage patients, facilitate communication, and improve patient satisfaction. Although there are multiple validated PCO tools, further development and research involving patient input is needed.

Guidelines for Designing and Evaluating Feasibility Pilot Studies

BACKGROUND

Pilot studies test the feasibility of methods and procedures to be used in larger-scale studies. Although numerous articles describe guidelines for the conduct of pilot studies, few have included specific feasibility indicators or strategies for evaluating multiple aspects of feasibility. In addition, using pilot studies to estimate effect sizes to plan sample sizes for subsequent randomized controlled trials has been challenged; however, there has been little consensus on alternative strategies.

METHODS

In Section 1, specific indicators (recruitment, retention, intervention fidelity, acceptability, adherence, and engagement) are presented for feasibility assessment of data collection methods and intervention implementation. Section 1 also highlights the importance of examining feasibility when adapting an intervention tested in mainstream populations to a new more diverse group. In Section 2, statistical and design issues are presented, including sample sizes for pilot studies, estimates of minimally important differences, design effects, confidence intervals (CI) and nonparametric statistics. An in-depth treatment of the limits of effect size estimation as well as process variables is presented. Tables showing CI around parameters are provided. With small samples, effect size, completion and adherence rate estimates will have large CI.

CONCLUSION

This commentary offers examples of indicators for evaluating feasibility, and of the limits of effect size estimation in pilot studies. As demonstrated, most pilot studies should not be used to estimate effect sizes, provide power calculations for statistical tests or perform exploratory analyses of efficacy. It is hoped that these guidelines will be useful to those planning pilot/feasibility studies before a larger-scale study.

Estimating Clinically Meaningful Change of Efficacy Outcomes in Inadequately Controlled Chronic Rhinosinusitis with Nasal Polyposis

OBJECTIVES/HYPOTHESIS

Clinical trials of biologics to treat chronic rhinosinusitis with nasal polyposis (CRSwNP) have evaluated objective outcomes (e.g., University of Pennsylvania Smell Identification Test [UPSIT], nasal polyps score [NPS], and computed tomography Lund-Mackay score [CT-LMK]) and patient-reported symptoms (e.g., nasal congestion/obstruction [NC], loss of smell [LoS], and total symptom score [TSS]). We estimated anchor-based thresholds for clinically meaningful change in objective and patient-reported outcomes in patients with CRSwNP using data from LIBERTY NP SINUS-24 and SINUS-52 trials (NCT02912468; NCT02898454).

METHODS

Target patient-reported outcomes were NC, LoS, and TSS; target objective outcomes were UPSIT, NPS, and CT-LMK. Anchor measures were the 22-item sinonasal outcome test (SNOT-22) rhinologic symptoms domain and total score and rhinosinusitis visual analog scale (VAS). The appropriateness of each anchor measure was evaluated by reviewing correlations between change in anchor measures and target outcomes and descriptive scores on target outcomes by levels of change in the anchor measure. Established thresholds for anchor measures (3.8 points for SNOT-22 rhinologic symptoms, 8.9 points for SNOT-22 total, 1-category improvement for rhinosinusitis VAS) were used to estimate clinically meaningful score changes for each target outcome.

RESULTS

Based on correlations between change in anchor measures and target outcomes, SNOT-22 rhinologic symptoms domain was deemed the most appropriate anchor measure. Using this anchor measure, thresholds for clinically meaningful within-patient change were NC: 1 point; LoS: 1 point; TSS: 3 points; UPSIT: 8 points; NPS: 1 point; and CT-LMK: 5 points.

CONCLUSION

These thresholds support interpretation of efficacy results for target outcomes in CRSwNP trials.

LEVEL OF EVIDENCE

2 Laryngoscope, 2021.