Examining Endpoint Concordance in Clinical Trials and Real-World Clinical Practice to Advance Real-World Evidence Utilization

Real-world evidence (RWE) is increasingly contributing to more informed decisions regarding the optimal access to and use of therapeutics to improve patient outcomes. However, in many cases, a disconnect between evidence derived from clinical trials and the RWE that follows market approval impedes the potential value and widespread adoption of RWE to optimize patient care. Collaborators with the Learning Ecosystems Accelerator for Patient-centered, Sustainable innovation (LEAPS), a major project of the Tufts Medical Center [formally Massachusetts Institute of Technology (MIT)] NEW Drug Development ParadIGmS (NEWDIGS) initiative, propose assessing the relationship between efficacy endpoints used in randomized controlled trials (RCTs) and effectiveness measures that inform treatment decisions within real-world clinical settings as one way to bridge this divide and further leverage RWE to improve care and patient outcomes. This commentary outlines elements of an endpoint concordance study using Rheumatoid Arthritis as a case study. The authors describe the ways in which better understanding of the relationship between effectiveness and RCT endpoints could improve the confidence in and adoption of RWE by both contextualizing existing RWE as well as identifying ways in which to improve the value of RWE in improving care and outcomes.

Designing an exploratory phase 2b platform trial in NASH with correlated, co-primary binary endpoints

Non-alcoholic steatohepatitis (NASH) is the progressive form of nonalcoholic fatty liver disease (NAFLD) and a disease with high unmet medical need. Platform trials provide great benefits for sponsors and trial participants in terms of accelerating drug development programs. In this article, we describe some of the activities of the EU-PEARL consortium (EU Patient-cEntric clinicAl tRial pLatforms) regarding the use of platform trials in NASH, in particular the proposed trial design, decision rules and simulation results. For a set of assumptions, we present the results of a simulation study recently discussed with two health authorities and the learnings from these meetings from a trial design perspective. Since the proposed design uses co-primary binary endpoints, we furthermore discuss the different options and practical considerations for simulating correlated binary endpoints.

Development of a core outcome set and outcome measurement set for physiotherapy trials in adults with Bronchiectasis (COS-PHyBE study): A protocol

Background

Bronchiectasis is a chronic respiratory disease characterised by airways widening and recurrent infections, resulting in episodes of chronic cough, sputum expectoration, and dyspnoea. This leads to deterioration in daily function, repeated hospital admissions and poor quality of life. The prevalence and mortality related to bronchiectasis is increasing worldwide with growing economic burden on healthcare systems. Physiotherapy for bronchiectasis aims to decrease accumulation of sputum, dyspnoea, and improve exercise capacity and daily function. A robust evidence base to support physiotherapy in bronchiectasis is currently lacking. This is partly because of inconsistency and poor reporting of outcomes in available studies.

A core outcome set is the minimum acceptable group of outcomes that should be used in clinical trials for a specific condition. This decreases research waste by improving consistency and reporting of key outcomes and facilitates the synthesis of study outcomes in systematic reviews and guidelines.

The aim of the study is therefore to develop a core outcome set and outcome measurement set for physiotherapy research in adults with bronchiectasis. This will ensure outcomes important to key stakeholders are consistently used and reported in future research.

Methods and analysis

This project will use the COMET Initiative and COSMIN guidelines of core outcome set development and will include three phases. In the first phase, a comprehensive list of outcomes will be developed using systematic review of reported outcomes and qualitative interviews with patients and physiotherapists. Then consensus on key outcomes will be established in phase two using a Delphi survey and a consensus meeting. Finally, in phase three, we will identify appropriate instruments to measure the core outcomes by evaluating the psychometric properties of available instruments and a stakeholders’ meeting to establish consensus.

Ethics

The study was reviewed and has received ethical approval from the health-related Research Ethics Committee- Edge Hill University (ETH2021-0217).

Registration

This study is registered with the COMET database. https://www.comet-initiative.org/Studies/Details/1931.

The full systematic review protocol is registered in PROSPERO under the number CRD42021266247.

RIFM fragrance ingredient safety assessment, phenethyl phenylacetate, CAS Registry Number 102-20-5

The existing information supports the use of this material as described in this safety assessment. Phenethyl phenylacetate was evaluated for genotoxicity, repeated dose toxicity, reproductive toxicity, local respiratory toxicity, phototoxicity/photoallergenicity, skin sensitization, and environmental safety. Data show that phenethyl phenylacetate is not genotoxic. Data provide a calculated MOE >100 for the repeated dose toxicity endpoint. Data on read-across analog benzyl benzoate (CAS # 120-51-4) provide an MOE >100 for the developmental toxicity endpoint. The fertility and local respiratory toxicity endpoints were evaluated using the TTC for a Cramer Class I material, and the exposure to phenethyl phenylacetate is below the TTC (0.03 mg/kg/day, and 1.4 mg/day, respectively). Data from analog benzyl phenylacetate (CAS # 102-16-9) show that there are no safety concerns for phenethyl phenylacetate for skin sensitization under the current declared levels of use. The phototoxicity/photoallergenicity endpoints were evaluated based on UV/Vis spectra; phenethyl phenylacetate is not expected to be phototoxic/photoallergenic. The environmental endpoints were evaluated; phenethyl phenylacetate was found not to be PBT as per the IFRA Environmental Standards and its risk quotients, based on its current volume of use in Europe and North America (i.e., PEC/PNEC), are <1.

Benchmark dose-response analyses for multiple endpoints in drug safety evaluation

Hazard characterization during pharmaceutical development identifies the candidate drug's potential hazards and dose-response relationships. To date, the no-observed-adverse-effect-level (NOAEL) approach has been employed to identify the highest dose which results in no observed adverse effects. The benchmark dose (BMD) modeling approach describes potential dose-response relationships and has been used in diverse regulatory domains, but its applicability for pharmaceutical development has not previously been examined. Thus, we applied BMD-modeling to all endpoints in three sequential in vivo studies in a drug development setting, including biochemistry, hematology, organ pathology and clinical observations. In order to compare the results across such a broad range of effects, we needed to standardize the choice of the critical effect size (CES) for the different endpoints. A CES of 5%, previously suggested by the European Food Safety Authority, was compared with the study NOAEL and with the General Theory of Effect Size, which takes natural variability into account. Compared to the NOAEL approach, the BMD-modeling approach resulted in more informative estimates of the doses leading to effects. The BMD-modeling approach handled well situations where effects occurred below the lowest tested dose and the study's NOAEL, and seems advantageous to characterize the potential toxicity during safety assessment. The results imply a considerable step forward from the perspective of reducing and refining animal experiments, as more information is yielded from the same number of animals and at lower doses. Taken together, employing BMD-modeling as a substitute, or as a complement, to the NOAEL approach seems appropriate.

The efficacy and safety of levilimab in severely ill COVID-19 patients not requiring mechanical ventilation: results of a multicenter randomized double-blind placebo-controlled phase III CORONA clinical study

OBJECTIVE AND DESIGN

The aim of this double-blind, placebo-controlled, phase III CORONA clinical trial was to evaluate the efficacy and safety of IL-6 receptor inhibitor levilimab (LVL) in subjects with severe COVID-19.

SUBJECTS

The study included 217 patients. The eligible were men and non-pregnant women aged 18 years or older, hospitalized for severe COVID-19 pneumonia.

TREATMENT

206 subjects were randomized (1:1) to receive single subcutaneous administration of LVL 324 mg or placebo, both in combination with standard of care (SOC). 204 patients received allocated therapy. After the LVL/placebo administration in case of deterioration of symptoms, the investigator could perform a single open-label LVL 324 mg administration as the rescue therapy.

METHODS

The primary efficacy endpoint was the proportion of patients with sustained clinical improvement on the 7-category ordinal scale on Day 14. All efficacy data obtained after rescue therapy administration were considered missing. For primary efficacy analysis, all subjects with missing data were considered non-responders.

RESULTS

63.1% and 42.7% of patients in the LVL and in the placebo groups, respectively, achieved sustained clinical improvement on Day 14 (P = .0017). The frequency of adverse drug reactions was comparable between the groups.

CONCLUSION

In patients with radiologically confirmed SARS-CoV-2 pneumonia, requiring or not oxygen therapy (but not ventilation) with no signs of other active infection administration of LVL + SOC results in an increase of sustained clinical improvement rate.

TRAIL REGISTRATION

The trial is registered at the US National Institutes of Health (ClinicalTrials.gov; NCT04397562).

Characterization and standardization of multiassay platforms for four commonly studied traumatic brain injury protein biomarkers: a TBI Endpoints Development Study

Aim: There is a critical need to validate biofluid-based biomarkers as diagnostic and drug development tools for traumatic brain injury (TBI). As part of the TBI Endpoints Development Initiative, we identified four potentially predictive and pharmacodynamic biomarkers for TBI: astroglial markers GFAP and S100B and the neuronal markers UCH-L1 and Tau. Materials & methods: Several commonly used platforms for these four biomarkers were identified and compared on analytic performance and ability to detect gold standard recombinant protein antigens and to pool control versus TBI cerebrospinal fluid (CSF). Results: For each marker, only some assay formats could differentiate TBI CSF from the control CSF. Also, different assays for the same biomarker reported divergent biomarker values for the same biosamples. Conclusion: Due to the variability of TBI marker assay in performance and reported values, standardization strategies are recommended when comparing reported biomarker levels across assay platforms.

Development of a core outcome set for groin hernia trials: a study protocol

INTRODUCTION

Reporting of outcomes in groin hernia trials is inconsistent and poorly defined thereby limiting the production of high-quality meta-analyses. Outcome reporting can be standardised and improved through consensus-based development of a core outcome set, which is a minimum set of outcomes recommended to be reported in all effectiveness trials within a specific field of research. We aim to develop a core outcome set for effectiveness trials within clinical groin hernia research.

METHODS

The study is divided into three phases. Phase 1 is an update of a systematic review on outcome reporting in groin hernia trials, which will identify relevant outcomes of groin hernia repair. In Phase 2, we will conduct multiple Delphi rounds to achieve consensus on which of the identified outcomes are most important. These Delphi rounds will involve important stakeholders in the field, i.e. patients, surgeons and researchers. In Phase 3, we will organise a consensus meeting to determine the final contents of the core outcome set. The meeting will involve the expert members of the study Steering Committee and invited key stakeholders. Data collection permissions and ethical approvals will be sought from the appropriate national and local authorities.

CONCLUSION

Development of a core outcome set for groin hernia trials is necessary and feasible.

FUNDING

none.

TRIAL REGISTRATION

COMET Database (registration no.: 1331) https://www.comet-initiative.org/Studies/Details/1331.

Berberine Phospholipid Is an Effective Insulin Sensitizer and Improves Metabolic and Hormonal Disorders in Women with Polycystic Ovary Syndrome: A One-Group Pretest-Post-Test Explanatory Study

Polycystic Ovary Syndrome (PCOS) is the most frequent endocrine disease in females of reproductive age and is characterized by multifactorial unhealthy conditions related to hormonal unbalance and also to dysmetabolism and inflammation. Recently, increasing evidence has shown that natural plant-based products may play a role in PCOS management. The aim of this one-group pretest-post-test explanatory study was to evaluate, in normal-overweight PCOS women with normal menses, the effectiveness of berberine on: Insulin resistance (IR) by Homeostasis Model Assessment (HOMA); Inflammation by C-Reactive Protein (CRP), Tumor Necrosis Factor α (TNF-α); Lipid metabolism; Sex hormone profile and symptoms correlated to hyperandrogenism, such as acne, by Global Acne Grading System (GAGS) and Cardiff Acne Disability Index (CADI); Body composition by DXA. Finally, adverse effects were assessed by liver and kidney functions and creatine phosphokinase (CPK). All these parameters were collected at baseline and 60 days after supplementation with a new bioavailable and safe berberine formulation. Twelve females (aged 26.6 ± 4.9, BMI 25.3 ± 3.6) were supplied for 60 days with two tablets/day (550 mg/table) of the bioavailable berberine. Results showed a statistically significant decrease in HOMA, CRP, TNF-α, Triglycerides, testosterone, Body Mass Index (BMI), Visceral Adipose Tissue (VAT), fat mass, GAGS and CADI scores, and a statistically significant increase in sex hormone-binding globulin (SHBG). Liver and kidney functions and CPK are not statistically significantly different. Therefore, berberine can represent a safe novel dietary supplement, helpful in treatment strategy for PCOS.

Targeting Autoregulation-Guided Cerebral Perfusion Pressure after Traumatic Brain Injury (COGiTATE): A Feasibility Randomized Controlled Clinical Trial

Managing traumatic brain injury (TBI) patients with a cerebral perfusion pressure (CPP) near to the cerebral autoregulation (CA)-guided "optimal" CPP (CPPopt) value is associated with improved outcome and might be useful to individualize care, but has never been prospectively evaluated. This study evaluated the feasibility and safety of CA-guided CPP management in TBI patients requiring intracranial pressure monitoring and therapy (TBIicp patients). The CPPopt Guided Therapy: Assessment of Target Effectiveness (COGiTATE) parallel two-arm feasibility trial took place in four tertiary centers. TBIicp patients were randomized to either the Brain Trauma Foundation (BTF) guideline CPP target range (control group) or to the individualized CA-guided CPP targets (intervention group). CPP targets were guided by six times daily software-based alerts for up to 5 days. The primary feasibility end-point was the percentage of time with CPP concordant (±5 mm Hg) with the set CPP targets. The main secondary safety end-point was an increase in therapeutic intensity level (TIL) between the control and intervention group. Twenty-eight patients were randomized to the control and 32 patients to the intervention group. CPP in the intervention group was in the target range for 46.5% (interquartile range, 41.2-58) of the monitored time, significantly higher than the feasibility target specified in the published protocol (36%; p < 0.001). There were no significant differences between groups for TIL or for other safety end-points. Conclusively, targeting an individual and dynamic CA-guided CPP is feasible and safe in TBIicp patients. This encourages a prospective trial powered for clinical outcomes.

Three year clinical outcomes in a nationwide, observational, siteless clinical trial of atrial fibrillation screening-mHealth Screening to Prevent Strokes (mSToPS)

Background

Atrial fibrillation (AF) is common, often without symptoms, and is an independent risk factor for mortality, stroke and heart failure. It is unknown if screening asymptomatic individuals for AF can improve clinical outcomes.

Methods

mSToPS was a pragmatic, direct-to-participant trial that randomized individuals from a single US-wide health plan to either immediate or delayed screening using a continuous-recording ECG patch to be worn for two weeks and 2 occasions, ~3 months apart, to potentially detect undiagnosed AF. The 3-year outcomes component of the trial was designed to compare clinical outcomes in the combined cohort of 1718 individuals who underwent monitoring and 3371 matched observational controls. The prespecified primary outcome was the time to first event of the combined endpoint of death, stroke, systemic embolism, or myocardial infarction among individuals with a new AF diagnosis, which was hypothesized to be the same in the two cohorts but was not realized.

Results

Over the 3 years following the initiation of screening (mean follow-up 29 months), AF was newly diagnosed in 11.4% (n = 196) of screened participants versus 7.7% (n = 261) of observational controls (p<0.01). Among the screened cohort with incident AF, one-third were diagnosed through screening. For all individuals whose AF was first diagnosed clinically, a clinical event was common in the 4 weeks surrounding that diagnosis: 6.6% experienced a stroke,10.2% were newly diagnosed with heart failure, 9.2% had a myocardial infarction, and 1.5% systemic emboli. Cumulatively, 42.9% were hospitalized. For those diagnosed via screening, none experienced a stroke, myocardial infarction or systemic emboli in the period surrounding their AF diagnosis, and only 1 person (2.3%) had a new diagnosis of heart failure. Incidence rate of the prespecified combined primary endpoint was 3.6 per 100 person-years among the actively monitored cohort and 4.5 per 100 person-years in the observational controls.

Conclusions

At 3 years, screening for AF was associated with a lower rate of clinical events and improved outcomes relative to a matched cohort, although the influence of earlier diagnosis of AF via screening on this finding is unclear. These observational data, including the high event rate surrounding a new clinical diagnosis of AF, support the need for randomized trials to determine whether screening for AF will yield a meaningful protection from strokes and other clinical events.

Trail registration

The mHealth Screening To Prevent Strokes (mSToPS) Trial is registered on ClinicalTrials.gov with the identifier NCT02506244.

Offering ART refill through community health workers versus clinic-based follow-up after home-based same-day ART initiation in rural Lesotho: The VIBRA cluster-randomized clinical trial

BACKGROUND

Community-based antiretroviral therapy (ART) dispensing by lay workers is an important differentiated service delivery model in sub-Sahara Africa. However, patients new in care are generally excluded from such models. Home-based same-day ART initiation is becoming widespread practice, but linkage to the clinic is challenging. The pragmatic VIBRA (Village-Based Refill of ART) trial compared ART refill by existing lay village health workers (VHWs) versus clinic-based refill after home-based same-day ART initiation.

METHODS AND FINDINGS

The VIBRA trial is a cluster-randomized open-label clinical superiority trial conducted in 249 rural villages in the catchment areas of 20 health facilities in 2 districts (Butha-Buthe and Mokhotlong) in Lesotho. In villages (clusters) randomized to the intervention arm, individuals found to be HIV-positive during a door-to-door HIV testing campaign were offered same-day ART initiation with the option of refill by VHWs. The trained VHWs dispensed drugs and scheduled clinic visits for viral load measurement at 6 and 12 months. In villages randomized to the control arm, participants were offered same-day ART initiation with clinic-based ART refill. The primary outcome was 12-month viral suppression. Secondary endpoints included linkage and 12-month engagement in care. Analyses were intention-to-treat. The trial was registered on ClinicalTrials.gov (NCT03630549). From 16 August 2018 until 28 May 2019, 118 individuals from 108 households in 57 clusters in the intervention arm, and 139 individuals from 130 households in 60 clusters in the control arm, were enrolled (150 [58%] female; median age 36 years [interquartile range 30-48]; 200 [78%] newly diagnosed). In the intervention arm, 48/118 (41%) opted for VHW refill. At 12 months, 46/118 (39%) participants in the intervention arm and 64/139 (46%) in the control arm achieved viral suppression (adjusted risk difference -0.07 [95% CI -0.20 to 0.06]; p = 0.256). Arms were similar in linkage (adjusted risk difference 0.03 [-0.10 to 0.16]; p = 0.630), but engagement in care was non-significantly lower in the intervention arm (adjusted risk difference -0.12 [-0.23 to 0.003]; p = 0.058). Seven and 0 deaths occurred in the intervention and control arm, respectively. Of the intervention participants who did not opt for drug refill from the VHW at enrollment, 41/70 (59%) mentioned trust or conflict issues as the primary reason. Study limitations include a rather small sample size, 9% missing viral load measurements in the primary endpoint window, the low uptake of the VHW refill option in the intervention arm, and substantial migration among the study population.

CONCLUSIONS

The offer of village-based ART refill after same-day initiation led to similar outcomes as clinic-based refill. The intervention did not amplify the effect of home-based same-day ART initiation alone. The findings raise concerns about acceptance and safety of ART delivered by lay health workers after initiation in the community.

TRIAL REGISTRATION

Registered with Clinicaltrials.gov (NCT03630549).

Regulatory and clinical consequences of negative confirmatory trials of accelerated approval cancer drugs: retrospective observational study

OBJECTIVES

To investigate the regulatory handling of cancer drugs that were granted accelerated approval by the US Food and Drug Administration (FDA) but failed to improve the primary endpoint in post-approval trials and to evaluate the extent to which negative post-approval trials changed the recommendations in treatment guidelines.

DESIGN

Retrospective observational study.

SETTING

FDA and National Comprehensive Cancer Network (NCCN) reports.

INCLUDED DRUGS

Cancer drugs that received accelerated approval from the FDA and had negative post-approval trials.

MAIN OUTCOME MEASURES

Regulatory outcomes, including withdrawal, conversion to regular approval, and no action.

RESULTS

18 indications for 10 cancer drugs that received accelerated approval but failed to improve the primary endpoint in post-approval trials were identified. Of these, 11 (61%) were voluntarily withdrawn by the manufacturer and one (bevacizumab for breast cancer) was revoked by the FDA. Of the 11 withdrawals, six occurred in 2021 alone. The remaining six (33%) indications remain on the label. The NCCN guidelines provide a high level of endorsement (category 1 endorsement for one and category 2A endorsement for seven) for accelerated approval drugs that have failed post-approval trials, sometimes even after the approval has been withdrawn or revoked.

CONCLUSION

Cancer drug indications that received accelerated approval often remained on formal FDA approved drug labelling and continued to be recommended in clinical guidelines several years after statutorily required post-approval trials showed no improvement in the primary efficacy endpoint. Clinical guidelines should better align with the results of post-approval trials of cancer drugs that received accelerated approval.

NT-proBNP Qualifies as a Surrogate for Clinical End Points in Heart Failure

N-terminal pro-B-type natriuretic peptide (NT-proBNP) is a well-established biomarker in heart failure (HF) but controversially discussed as a potential surrogate marker in HF trials. We analyzed the NT-proBNP/mortality relationship in real-world data (RWD) of 108,330 HF patients from the IBM Watson Health Explorys database and compared it with the NT-proBNP / clinical event end-point relationship in 20 clinical HF studies. With a hierarchical statistical model, we quantified the functional relationship and interstudy variability. To independently qualify the model, we predicted outcome hazard ratios in five phase III HF studies solely based on NT-proBNP measured early in the respective study. In RWD and clinical studies, the relationship between NT-proBNP and clinical outcome is well described by an Emax model. The NT-proBNP independent baseline risk (R0 , RWD/studies median (interstudy interquartile range): 5.5%/3.0% (1.7-4.9%)) is very low compared with the potential NT-proBNP-associated maximum risk (Rmax : 55.2%/79.4% (61.5-89.0%)). The NT-proBNP concentration associated with the half-maximal risk is comparable in RWD and across clinical studies (EC50 : 3,880/2,414 pg/mL (1,460-4,355 pg/mL)). Model-based predictions of phase III outcomes, relying on short-term NT-proBNP data only, match final trial results with comparable confidence intervals. Our analysis qualifies NT-proBNP as a surrogate for clinical outcome in HF trials. NT-proBNP levels after short treatment durations of less than 10 weeks quantitatively predict hazard ratios with confidence levels comparable to final trial readout. Early NT-proBNP measurement can therefore enable shorter and smaller but still reliable HF trials.