The effect of using a robust optimality criterion in model based adaptive optimization

Optimizing the design of a pharmacokinetic trial to evaluate the dosing scheme of a novel tuberculosis drug in children living with or without HIV

Pharmacokinetic (PK) studies in children are usually small and have ethical constraints due to the medical complexities of drawing blood in this special population. Often, population PK models for the drug(s) of interest are available in adults, and these models can be extended to incorporate the expected deviations seen in children. As a consequence, there is increasing interest in the use of optimal design methodology to design PK sampling schemes in children that maximize information using a small sample size and limited number of sampling times per dosing period. As a case study, we use the novel tuberculosis drug delamanid, and show how applications of optimal design methodology can result in highly efficient and model-robust designs in children for estimating PK parameters using a limited number of sampling measurements. Using developed population PK models based on available data from adults living with and without HIV, and limited data on children without HIV, competing designs for children living with HIV were derived and assessed based on robustness to model uncertainty.

Statistical recommendations for count, binary, and ordinal data in rare disease cross-over trials

BACKGROUND

Recommendations for statistical methods in rare disease trials are scarce, especially for cross-over designs. As a result various state-of-the-art methodologies were compared as neutrally as possible using an illustrative data set from epidermolysis bullosa research to build recommendations for count, binary, and ordinal outcome variables. For this purpose, parametric (model averaging), semiparametric (generalized estimating equations type [GEE-like]) and nonparametric (generalized pairwise comparisons [GPC] and a marginal model implemented in the R package nparLD) methods were chosen by an international consortium of statisticians.

RESULTS

It was found that there is no uniformly best method for the aforementioned types of outcome variables, but in particular situations, there are methods that perform better than others. Especially if maximizing power is the primary goal, the prioritized unmatched GPC method was able to achieve particularly good results, besides being appropriate for prioritizing clinically relevant time points. Model averaging led to favorable results in some scenarios especially within the binary outcome setting and, like the GEE-like semiparametric method, also allows for considering period and carry-over effects properly. Inference based on the nonparametric marginal model was able to achieve high power, especially in the ordinal outcome scenario, despite small sample sizes due to separate testing of treatment periods, and is suitable when longitudinal and interaction effects have to be considered.

CONCLUSION

Overall, a balance has to be found between achieving high power, accounting for cross-over, period, or carry-over effects, and prioritizing clinically relevant time points.

Optimizing study design in LPS challenge studies for quantifying drug induced inhibition of TNFα response: Did we miss the prime time?

In this work we evaluate the study design of LPS challenge experiments used for quantification of drug induced inhibition of TNFα response and provide general guidelines of how to improve the study design. Analysis of model simulated data, using a recently published TNFα turnover model, as well as the optimal design tool PopED have been used to find the optimal values of three key study design variables - time delay between drug and LPS administration, LPS dose, and sampling time points - that in turn could make the resulting TNFα response data more informative. Our findings suggest that the current rule of thumb for choosing the time delay should be reconsidered, and that the placement of the measurements after maximal TNFα response are crucial for the quality of the experiment. Furthermore, a literature study summarizing a wide range of published LPS challenge studies is provided, giving a broader perspective of how LPS challenge studies are usually conducted both in a preclinical and clinical setting.

Robust designs accounting for model uncertainty in longitudinal studies with binary outcomes

To optimize designs for longitudinal studies analyzed by mixed-effect models with binary outcomes, the Fisher information matrix can be used. Optimal design approaches, however, require a priori knowledge of the model. We aim to propose, for the first time, a robust design approach accounting for model uncertainty in longitudinal trials with two treatment groups, assuming mixed-effect logistic models. To optimize designs given one model, we compute several optimality criteria based on Fisher information matrix evaluated by the new approach based on Monte-Carlo/Hamiltonian Monte-Carlo. We propose to use the DDS-optimality criterion, as it ensures a compromise between the precision of estimation of the parameters, and hence the Wald test power, and the overall precision of parameter estimation. To account for model uncertainty, we assume candidate models with their respective weights. We compute robust design across these models using compound DDS-optimality. Using the Fisher information matrix, we propose to predict the average power over these models. Evaluating this approach by clinical trial simulations, we show that the robust design is efficient across all models, allowing one to achieve good power of test. The proposed design strategy is a new and relevant approach to design longitudinal studies with binary outcomes, accounting for model uncertainty.

Reduced and optimized trial designs for drugs described by a target mediated drug disposition model

Monoclonal antibodies against soluble targets are often rich and include the sampling of multiple analytes over a lengthy period of time. Predictive models built on data obtained in such studies can be useful in all drug development phases. If adequate model predictions can be maintained with a reduced design (e.g. fewer samples or shorter duration) the use of such designs may be advocated. The effect of reducing and optimizing a rich design based on a published study for Omalizumab (OMA) was evaluated as an example. OMA pharmacokinetics were characterized using a target-mediated drug disposition model considering the binding of OMA to free IgE and the subsequent formation of an OMA–IgE complex. The performance of the reduced and optimized designs was evaluated with respect to: efficiency, parameter uncertainty and predictions of free target. It was possible to reduce the number of samples in the study by 30% while still maintaining an efficiency of almost 90%. A reduction in sampling duration by two-thirds resulted in an efficiency of 75%. Omission of any analyte measurement or a reduction of the number of dose levels was detrimental to the efficiency of the designs (efficiency ≤ 51%). However, other metrics were, in some cases, relatively unaffected, showing that multiple metrics may be needed to obtain balanced assessments of design performance.

Lessons learned from IDeAl - 33 recommendations from the IDeAl-net about design and analysis of small population clinical trials

BACKGROUND

IDeAl (Integrated designs and analysis of small population clinical trials) is an EU funded project developing new statistical design and analysis methodologies for clinical trials in small population groups. Here we provide an overview of IDeAl findings and give recommendations to applied researchers.

METHOD

The description of the findings is broken down by the nine scientific IDeAl work packages and summarizes results from the project's more than 60 publications to date in peer reviewed journals. In addition, we applied text mining to evaluate the publications and the IDeAl work packages' output in relation to the design and analysis terms derived from in the IRDiRC task force report on small population clinical trials.

RESULTS

The results are summarized, describing the developments from an applied viewpoint. The main result presented here are 33 practical recommendations drawn from the work, giving researchers a comprehensive guidance to the improved methodology. In particular, the findings will help design and analyse efficient clinical trials in rare diseases with limited number of patients available. We developed a network representation relating the hot topics developed by the IRDiRC task force on small population clinical trials to IDeAl's work as well as relating important methodologies by IDeAl's definition necessary to consider in design and analysis of small-population clinical trials. These network representation establish a new perspective on design and analysis of small-population clinical trials.

CONCLUSION

IDeAl has provided a huge number of options to refine the statistical methodology for small-population clinical trials from various perspectives. A total of 33 recommendations developed and related to the work packages help the researcher to design small population clinical trial. The route to improvements is displayed in IDeAl-network representing important statistical methodological skills necessary to design and analysis of small-population clinical trials. The methods are ready for use.

Feasibility of Exposure-Response Analyses for Clinical Dose-Ranging Studies of Drug Combinations

The exposure-response relationship of combinatory drug effects can be quantitatively described using pharmacodynamic interaction models, which can be used for the selection of optimal dose combinations. The aim of this simulation study was to evaluate the reliability of parameter estimates and the probability for accurate dose identification for various underlying exposure-response profiles, under a number of different phase II designs. An efficacy variable driven by the combined exposure of two theoretical compounds was simulated and model parameters were estimated using two different models, one estimating all parameters and one assuming that adequate previous knowledge for one drug is readily available. Estimation of all pharmacodynamic parameters under a realistic, in terms of sample size and study design, phase II trial, proved to be challenging. Inaccurate estimates were found in all exposure-response scenarios, except for situations where no pharmacodynamic interaction was present, with the drug potency and interaction parameters being the hardest to estimate. When previous knowledge of the exposure-response relationship of one of the monocomponents is available, such information should be utilized, as it enabled relevant improvements in parameter estimation and in correct dose identification. No general trends for classification of the performance of the tested study designs across different scenarios could be identified. This study shows that pharmacodynamic interactions models can be used for the exposure-response analysis of clinical endpoints especially when accompanied by appropriate dose selection in regard to the expected drug potencies and appropriate trial size and if information regarding the exposure-response profile of one monocomponent is available.