A Pharmacometric Analysis of Patient-Reported Outcomes in Breast Cancer Patients Through Item Response Theory

Comparison of Two Methods for Determining Item Characteristic Functions and Latent Variable Time-Course for Pharmacometric Item Response Models

There are examples in the literature demonstrating different approaches to defining the item characteristic functions (ICF) and characterizing the latent variable time-course within a pharmacometrics item response theory (IRT) framework. One such method estimates both the ICF and latent variable time-course simultaneously, and another method establishes the ICF first then models the latent variable directly. To date, a direct comparison of the "simultaneous" and "sequential" methodologies described in this work has not yet been systematically investigated. Item parameters from a graded response IRT model developed from Parkinson's Progression Marker Initiative (PPMI) study data were used as simulation parameters. Each method was evaluated under the following conditions: (i) with and without drug effect and (ii) slow progression rate with smaller sample size and rapid progression rate with larger sample size. Overall, the methods performed similarly, with low bias and good precision for key parameters and hypothesis testing for drug effect. The ICF parameters were well determined when the model was correctly specified, with an increase in precision in the scenario with rapid progression. In terms of drug effect, both methods had large estimation bias for the slow progression rate; however, this bias can be considered small relative to overall progression rate. Both methods demonstrated type 1 error control and similar discrimination between model with and without drug effect. The simultaneous method was slightly more precise than the sequential method while the sequential method was more robust towards longitudinal model misspecification and offers practical advantages in model building.

A disease model predicting placebo response and remission status of patients with ulcerative colitis using modified Mayo score

The Mayo Clinical Score is used in clinical trials to describe the clinical status of patients with ulcerative colitis (UC). It comprises four subscores: rectal bleeding (RB), stool frequency (SF), physician's global assessment, and endoscopy (ENDO). According to recent US Food and Drug Administration guidelines (Ulcerative colitis: developing drugs for treatment, Guidance Document, https://www.fda.gov/regulatory-information/s. 2022), clinical response and remission should be based on modified Mayo Score (mMS) relying on RB, SF, and ENDO. Typically, ENDO is performed at the beginning and end of each phase, whereas RB and SF are more frequently available. Item response theory (IRT) models allow the shared information to be used for prediction of all subscores at each observation time; therefore, it leverages information from RB and SF to predict ENDO. A UC disease IRT model was developed based on four etrolizumab phase III studies to describe the longitudinal mMS subscores, placebo response, and remission at the end of induction and maintenance. For each subscore, a bounded integer model was developed. The placebo response was characterized by a mono-exponential function acting on all mMS subscores similarly. The final model reliably predicted longitudinal mMS data. In addition, remission was well-predicted by the model, with only 5% overprediction at the end of induction and 3% underprediction at the end of maintenance. External evaluation of the final model using placebo arms from five different studies indicated adequate performance for both longitudinal mMS subscores and remission status. These results suggest utility of the current disease model for informed decision making in UC clinical development, such as assisting future clinical trial designs and evaluations.

Psychometric parameters of food allergy quality of life during an allergen immunotherapy trial

BACKGROUND

The Food Allergy Quality of Life Questionnaire-Parent Form (FAQLQ-PF) is a commonly used patient-reported outcome measure in food allergy (FA) research. It was developed before FA treatment clinical trials were commonplace and is used as a secondary outcome measure in pivotal FA treatment trials. We examined the psychometric properties of the FAQLQ-PF and its relevance to children with peanut allergy engaged in an epicutaneous immunotherapy (EPIT) clinical trial.

METHODS

Analysis was performed on 26 universally answered items of the FAQLQ-PF, from assessments undertaken during the phase 3 PEPITES study (baseline, Month 12), which examined the safety and efficacy of EPIT for children with peanut allergy aged 4-11 years. Item response theory (IRT) was used to assess psychometric parameters of the FAQLQ-PF (i.e., discrimination, difficulty, and information). Confirmatory factor analysis was also employed; reliability was assessed using McDonald's omega (ω) and Cronbach's alpha (α).

RESULTS

A total of 23 of 26 items presented very high discrimination levels (>1.7), and all 26 fell within the recommended difficulty threshold (between -1.5 and 1.5). The items contributed a reasonable information level for their respective factors/subdomains. The measure also presented a marginally acceptable model fit for the 3-factor structure (e.g., comparative fit index = 0.88, Tucker-Lewis index = 0.87) and good reliability levels across time points (ω and α > 0.90).

CONCLUSIONS

Herein, we present a novel reanalysis of the FAQLQ-PF items using IRT. The longitudinal performance of individual items and subscales was corroborated, and items with the highest discrimination were identified, showing that the tool is suitable for longitudinal measurements in FA treatment trials.

Improved Confidence in a Confirmatory Stage by Application of Item-Based Pharmacometrics Model: Illustration with a Phase III Active Comparator-Controlled Trial in COPD Patients

PURPOSE

The current study aimed to illustrate how a non-linear mixed effect (NLME) model-based analysis may improve confidence in a Phase III trial through more precise estimates of the drug effect.

METHODS

The FULFIL clinical trial was a Phase III study that compared 24 weeks of once daily inhaled triple therapy with twice daily inhaled dual therapy in patients with chronic obstructive pulmonary disease (COPD). Patient reported outcome data, obtained by using The Evaluating Respiratory Symptoms in COPD (E-RS:COPD) questionnaire, from the FULFIL study were analyzed using an NLME item-based response theory model (IRT). The change from baseline (CFB) in E-RS:COPD total score over 4-week intervals for each treatment arm was obtained using the IRT and compared with published results obtained with a mixed model repeated measures (MMRM) analysis.

RESULTS

The IRT included a graded response model characterizing item parameters and a Weibull function combined with an offset function to describe the COPD symptoms-time course in patients receiving either triple therapy (n = 907) or dual therapy (n = 894). The IRT improved precision of the estimated drug effect compared to MMRM, resulting in a sample size of at least 3.64 times larger for the MMRM analysis to achieve the IRT precision in the CFB estimate.

CONCLUSION

This study shows the advantage of IRT over MMRM with a direct comparison of the same primary endpoint for the two analyses using the same observed clinical trial data, resulting in an increased confidence in Phase III.

Improved Decision-Making Confidence Using Item-Based Pharmacometric Model: Illustration with a Phase II Placebo-Controlled Trial

This study aimed to illustrate how a new methodology to assess clinical trial outcome measures using a longitudinal item response theory–based model (IRM) could serve as an alternative to mixed model repeated measures (MMRM). Data from the EXACT (Exacerbation of chronic pulmonary disease tool) which is used to capture frequency, severity, and duration of exacerbations in COPD were analyzed using an IRM. The IRM included a graded response model characterizing item parameters and functions describing symptom-time course. Total scores were simulated (month 12) using uncertainty in parameter estimates. The 50th (2.5th, 97.5th) percentiles of the resulting simulated differences in average total score (drug minus placebo) represented the estimated drug effect (95%CI), which was compared with published MMRM results. Furthermore, differences in sample size, sensitivity, specificity, and type I and II errors between approaches were explored. Patients received either oral danirixin 75 mg twice daily (n = 45) or placebo (n = 48) on top of standard of care over 52 weeks. A step function best described the COPD symptoms-time course in both trial arms. The IRM improved precision of the estimated drug effect compared to MMRM, resulting in a sample size of 2.5 times larger for the MMRM analysis to achieve the IRM precision. The IRM showed a higher probability of a positive predictive value (34%) than MMRM (22%). An item model–based analysis data gave more precise estimates of drug effect than MMRM analysis for the same endpoint in this one case study.

Detecting placebo and drug effects on Parkinson's disease symptoms by longitudinal item-score models

This study tested the hypothesis that analyzing longitudinal item scores of the Unified Parkinson's Disease Rating Scale could allow a smaller trial size and describe a drug's effect on symptom progression. Two historical studies of the dopaminergic drug ropinirole were analyzed: a cross-over formulation comparison trial in 161 patients with early-stage Parkinson's disease, and a 24-week, parallel-group, placebo-controlled efficacy trial in 393 patients with advanced-stage Parkinson's disease. We applied item response theory to estimate the patients' symptom severity and developed a longitudinal model using the symptom severity to describe the time course of the placebo response and the drug effect on the time course. Similarly, we developed a longitudinal model using the total score. We then compared sample size needs for drug effect detection using these two different models. Total score modeling estimated median changes from baseline at 24 weeks (90% confidence interval) of -3.7 (-5.4 to -2.0) and -9.3 (-11 to -7.3) points by placebo and ropinirole. Comparable changes were estimated (with slightly higher precision) by item-score modeling as -2.0 (-4.0 to -1.0) and -9.0 (-11 to -8.0) points. The treatment duration was insufficient to estimate the symptom progression rate; hence the drug effect on the progression could not be assessed. The trial sizes to detect a drug effect with 80% power on total score and on symptom severity were estimated (at the type I error level of 0.05) as 88 and 58, respectively. Longitudinal item response analysis could markedly reduce sample size; it also has the potential for assessing drug effects on disease progression in longer trials.

Health-Related Quality of Life Data in Cancer Clinical Trials for Drug Registration: The Value Beyond Reimbursement

PURPOSE

A review of the literature was performed to evaluate how quality of life measures are collected, analyzed, and reported in cancer clinical trials intended to support drug registration.Health-related quality of life (HRQoL) data points are one of the patient-reported outcome (PRO) assessments used in clinical trials to evaluate the effects of treatments from the patient perspective. The use of PROs has gained focus in cancer clinical trials as more options become available for greater longevity of patients on treatment. Standardization of PRO data is evolving and involves unique challenges when used for assessing biologic and chemotherapeutic agents for the treatment of cancer.

METHODS

In this study, a review of literature published between 2009 and 2019 was conducted using PubMed, COCHRANE Library, and Medline. The research focus was on the current guidance, implementation, and reporting as well as highlighting the issues, and recommendations for the inclusion of HRQoL end points in cancer clinical trials intended for use in drug registration.

RESULTS

Although there exist many levels of guidance for HRQoL measures in cancer drug trials, challenges to operational implementation, the current inconsistent adherence to reporting standards, and the lack of consensus and understanding of analyses limit the value and potential of the resulting data collected.

CONCLUSION

The results of HRQoL data collected from cancer clinical trials can be difficult to interpret and apply to inform clinical decision making. Increased reporting and access to these data can provide opportunities for potential applications to improve translatability of HRQoL data collected in clinical trials into practice.

Item Response Theory Modeling of the International Prostate Symptom Score in Patients with Lower Urinary Tract Symptoms Associated with Benign Prostatic Hyperplasia

Item response theory (IRT) was used to characterize the time course of lower urinary tract symptoms due to benign prostatic hyperplasia (BPH-LUTS) measured by item-level International Prostate Symptom Scores (IPSS). The Fisher information content of IPSS items was determined and the power to detect a drug effect using the IRT approach was examined. Data from 403 patients with moderate-to-severe BPH-LUTS in a placebo-controlled phase II trial studying the effect of degarelix over 6 months were used for modeling. Three pharmacometric models were developed: a model for total IPSS, a unidimensional IRT model, and a bidimensional IRT model, the latter separating voiding and storage items. The population-level time course of BPH-LUTS in all models was described by initial improvement followed by worsening. In the unidimensional IRT model, the combined information content of IPSS voiding items represented 72% of the total information content, indicating that the voiding subscore may be more sensitive to changes in BPH-LUTS compared with the storage subscore. The pharmacometric models showed considerably higher power to detect a drug effect compared with a cross-sectional and while-on-treatment analysis of covariance, respectively. Compared with the sample size required to detect a drug effect at 80% power with the total IPSS model, a reduction of 5.9% and 11.7% was obtained with the unidimensional and bidimensional IPSS IRT model, respectively. Pharmacometric IRT analysis of the IPSS within BPH-LUTS may increase the precision and efficiency of treatment effect assessment, albeit to a more limited extent compared with applications in other therapeutic areas.

Integrated Item Response Theory Modeling of Multiple Patient-Reported Outcomes Assessing Lower Urinary Tract Symptoms Associated with Benign Prostatic Hyperplasia

In clinical trials within lower urinary tract symptoms due to benign prostatic hyperplasia (BPH-LUTS), the International Prostate Symptom Score (IPSS) is commonly the primary efficacy outcome while the Quality of Life (QoL) score and the BPH Impact Index (BII) are common secondary efficacy markers. The current study aimed to characterize BPH-LUTS progression using responses to the IPSS, the QoL, and the BII in an integrated item response theory (IRT) framework and assess the Fisher information of each scale. The power of this approach to detect a drug effect was compared with an IRT approach considering only IPSS responses. A unidimensional and a bidimensional pharmacometric IRT model, based on item-level IPSS responses in a clinical trial with 403 patients, were extended by incorporating patients’ QoL and summary BII scores over the 6-month trial period. In the developed unidimensional integrated model, the QoL score was found to be the most informative, representing 17% of the total Fisher information, while the combined information content of the seven IPSS items represented 70.6%. In the bidimensional model, “storage” and both storage and “voiding” disability drove QoL and summary BII responses, respectively. Sample size reduction of 16% to detect a drug effect at 80% power was obtained with the unidimensional integrated IRT model compared with its counterpart IPSS IRT model. This study shows that utilizing the information content across the IPSS, QoL, and BII scales in an integrated IRT framework results in a modest but meaningful increase in power to detect a drug effect.

Evaluation of ABC gene polymorphisms on the pharmacokinetics and pharmacodynamics of capecitabine in colorectal patients: Implications for dosing recommendations

AIMS

The aims are to develop a population pharmacokinetic model of capecitabine (CAP) and its main metabolites after the oral administration of CAP in colorectal cancer patients with different polymorphisms of the ATP-binding cassette (ABC) gene and a population pharmacokinetic/pharmacodynamic model capable of accounting for the neutropenic effects, and to optimize the dosing strategy based on the polymorphisms of the ABC gene and/or the administration regimen as a single agent or in combination.

METHODS

Forty-eight patients diagnosed with colorectal cancer were included, with 432 plasma levels of CAP, 5'-desoxi-5-fluorouridine (5'-DFUR) and 5-fluorouracil (5-FU), and 370 neutrophil observations. Capecitabine doses ranged from 1250 to 2500 mg/m² /24 h. Plasma measurements of CAP, 5'-DFUR and 5-FU were obtained at 1, 2 and 3 hours post administration. Neutrophil levels were measured between day 15 and day 24 post administration.

RESULTS

The pharmacokinetic model incorporates oxaliplatin as a covariate on absorption lag time, rs6720173 (ABCG5 gene) on clearance of 5'-DFUR (182% increase for mutated rs6720173) and rs2271862 (ABCA2 gene) on clearance of 5-FU (184% increase for mutated rs2271862). System- (Circ₀ = 3.54 × 10⁹ cells/mL, MTT = 204 hours and γ = 6.0 × 10^-2 ) and drug-related (slope [SLP] = 3.1 × 10^-2 mL/mg). Co-administration of oxaliplatin resulted in a 2.84-fold increase in SLP. The predicted exposure thresholds to G3/4 neutropenia in combination and monotherapy were 26 and 70 mg·h/L, respectively.

CONCLUSIONS

The population pharmacokinetic/pharmacodynamic model characterized the time course of capecitabine and its metabolites in plasma. Dose recommendations of capecitabine in patients with mutated and wild allele for single nucleotide polymorphisms rs2271862 of ≤3000 and ≤2400 mg/m² /24 h in monotherapy and ≤1750 and ≤600 mg/m² /24 h in combination with oxaliplatin, respectively, have been proposed.

Supervised Multidimensional Item Response Theory Modeling of Pediatric Iatrogenic Withdrawal Symptoms

Item‐level data from composite scales can be analyzed with pharmacometric item response theory (IRT) models to improve the quantification of disease severity compared with the use of total composite scores. However, regular IRT models assume unidimensionality, which is violated in the scale measuring iatrogenic withdrawal in children because some items are also affected by pain, undersedation, or delirium. Here, we compare regular IRT modelling of pediatric iatrogenic withdrawal symptom data with two new analysis approaches in which the latent variable is guided towards the condition of interest using numerical withdrawal severity scored by nurses as a “supervising variable:” supervised IRT (sIRT) and supervised multi‐dimensional (smIRT) modelling. In this example, in which the items scores are affected by multiple conditions, regular IRT modeling is worse to quantify disease severity than the total composite score, whereas improved performance compared with the composite score is observed for the sIRT and smIRT models.

An item response theory based integrated model of headache, nausea, photophobia, and phonophobia in migraine patients

This study developed an integrated model of severity scores of migraine headache and the incidence of nausea, photophobia, and phonophobia to predict the natural time course of migraine symptoms, which are likely to occur by a common disease progression mechanism. Data were acquired from two phase 3 clinical trials conducted during the development of eletriptan. Only the placebo arm was used for analysis. A conventional proportional odds model was compared with an item response theory (IRT) based approach. Results suggested that the IRT based approach led to a better model fit, successfully revealing the difference in relief rates among different symptoms, which was the fastest in phonophobia and the slowest in headache. Simulation with the developed model suggested that using headache scores at 4 h post-dose attained greatest statistical power, yielding sample size of 100 per arm given drug effect of 40%, as compared to that of 200 per arm when 2 h post-dose scores were used as in the original eletriptan protocol. This work demonstrated the usefulness of an IRT based model as applied to analyzing multidimensional migraine symptoms and designing clinical trials. Our model can be similarly applied to analyzing other multiple endpoints sharing a common underlying mechanism.