Data Rich, Information Poor: Can We Use Electronic Health Records to Create a Learning Healthcare System for Pharmaceuticals?

High-Throughput Computing to Automate Population-Based Studies to Detect the 30-Day Risk of Adverse Outcomes After New Outpatient Medication Use in Older Adults with Chronic Kidney Disease: A Clinical Research Protocol

Background

Safety issues are detected in about one third of prescription drugs in the years following regulatory agency approval. Older adults, especially those with chronic kidney disease, are at particular risk of adverse reactions to prescription drugs. This protocol describes a new approach that may identify credible drug-safety signals more efficiently using administrative health care data.

Objective

To use high-throughput computing and automation to conduct 700+ drug-safety cohort studies in older adults in Ontario, Canada. Each study will compare 74 acute (30-day) outcomes in patients who start a new prescription drug (new users) to a group of nonusers with similar baseline health characteristics. Risks will be assessed within strata of baseline kidney function.

Design and setting

The studies will be population-based, new-user cohort studies conducted using linked administrative health care databases in Ontario, Canada (January 1, 2008, to March 1, 2020). The source population for these studies will be residents of Ontario aged 66 years or older who filled at least one outpatient prescription through the Ontario Drug Benefit (ODB) program during the study period (all residents have universal health care, and those aged 65+ have universal prescription drug coverage through the ODB).

Patients

We identified 3.2 million older adults in the source population during the study period and built 700+ initial medication cohorts, each containing mutually exclusive groups of new users and nonusers. Nonusers were randomly assigned cohort entry dates that followed the same distribution of prescription start dates as new users. Eligibility criteria included a baseline estimated glomerular filtration rate (eGFR) measurement within 12 months before the cohort entry date (median time was 71 days before cohort entry in the new user group), no prior receipt of maintenance dialysis or a kidney transplant, and no prior prescriptions for drugs in the same subclass as the study drug. New users and nonusers will be balanced on ~400 baseline health characteristics using inverse probability of treatment weighting on propensity scores within 3 strata of baseline eGFR: ≥60, 45 to <60, <45 mL/min per 1.73 m2.

Outcomes

We will compare new user and nonuser groups on 74 clinically relevant outcomes (17 composites and 57 individual outcomes) in the 30 days after cohort entry. We used a prespecified approach to identify these 74 outcomes.

Statistical analysis plan

In each cohort, we will obtain eGFR-stratum-specific weighted risk ratios and risk differences using modified Poisson regression and binomial regression, respectively. Additive and multiplicative interaction by eGFR category will be examined. Drug-outcome associations that meet prespecified criteria (identified signals) will be further examined in additional analyses (including survival, negative-control exposure, and E-value analyses) and visualizations.

Results

The initial medication cohorts had a median of 6120 new users per cohort (interquartile range: 1469-38 839) and a median of 1 088 301 nonusers (interquartile range: 751 697-1 267 009). Medications with the largest number of new users were amoxicillin trihydrate (n = 1 000 032), cephalexin (n = 571 566), prescription acetaminophen (n = 571 563), and ciprofloxacin (n = 504,374); 19% to 29% of new users in these cohorts had an eGFR <60 mL/min per 1.73 m2.

Limitations

Despite our use of robust techniques to balance baseline indicators and to control for confounding by indication, residual confounding will remain a possibility. Only acute (30-day) outcomes will be examined. Our data sources do not include nonprescription (over-the-counter) drugs or drugs prescribed in hospitals and do not include outpatient prescription drug use in children or adults <65 years.

Conclusion

This accelerated approach to conducting postmarket drug-safety studies has the potential to more efficiently detect drug-safety signals in a vulnerable population. The results of this protocol may ultimately help improve medication safety.

Current trends and future prospects of drug repositioning in gastrointestinal oncology

Gastrointestinal (GI) cancers comprise a significant number of cancer cases worldwide and contribute to a high percentage of cancer-related deaths. To improve survival rates of GI cancer patients, it is important to find and implement more effective therapeutic strategies with better prognoses and fewer side effects. The development of new drugs can be a lengthy and expensive process, often involving clinical trials that may fail in the early stages. One strategy to address these challenges is drug repurposing (DR). Drug repurposing is a developmental strategy that involves using existing drugs approved for other diseases and leveraging their safety and pharmacological data to explore their potential use in treating different diseases. In this paper, we outline the existing therapeutic strategies and challenges associated with GI cancers and explore DR as a promising alternative approach. We have presented an extensive review of different DR methodologies, research efforts and examples of repurposed drugs within various GI cancer types, such as colorectal, pancreatic and liver cancers. Our aim is to provide a comprehensive overview of employing the DR approach in GI cancers to inform future research endeavors and clinical trials in this field.

Learning healthcare systems in cardiology: A qualitative interview study on ethical dilemmas of a learning healthcare system

Background

Implementation of an LHS in cardiology departments presents itself with ethical challenges, including ethical review and informed consent. In this qualitative study, we investigated stakeholders' attitudes toward ethical issues regarding the implementation of an LHS in the cardiology department.

Methods

We conducted a qualitative study using 35 semi-structured interviews and 5 focus group interviews with 34 individuals. We interviewed cardiologists, research nurses, cardiovascular patients, ethicists, health lawyers, epidemiologists/statisticians and insurance spokespersons.

Results

Respondents identified different ethical obstacles for the implementation of an LHS within the cardiology department. These obstacles were mainly on ethical oversight in LHSs; in particular, informed con sent and data ownership were discussed. In addition, respondents reported on the role of patients in LHS. Respondents described the LHS as a possibility for patients to engage in both research and care. While the LHS can promote patient engagement, patients might also be reduced to their data and are therefore at risk, according to respondents.

Conclusions

Views on the ethical dilemmas of a LHSs within cardiology are diverse. Similar to the literary debate on oversight, there are different views on how ethical oversight should be regulated. This study adds to the literary debate on oversight by highlighting that patients wish to be informed about the learning activities within the LHS they participate in, and that they wish to actively contribute by sharing their data and identifying learning goals, provided that informed consent is obtained.

Considerations when planning and conducting large global observational studies: Experience from the DISCOVER study of patients with type 2 diabetes

DISCOVER is a global programme of observational research that includes patients with type 2 diabetes initiating second-line glucose-lowering therapy from 38 countries worldwide, including many with little or no previous epidemiological data available. More than 15,000 patients were followed-up for 3 years, and comprehensive data were collected using a standardized electronic case report form at enrolment, and 6, 12, 24 and 36 months. The study has formed the basis for a long-term registry that is intended to expand the geographic and clinical scope of the study and allow data collection beyond 3 years. In this review, critical aspects of study planning and implementation are summarized, along with challenges that were faced, to provide a resource for researchers planning similar studies. In particular, it is essential to set realistic expectations regarding the degree of study representativeness that can be achieved, allow for sufficient time to obtain ethics committee approval, develop tools to help recruit patients effectively, ensure that data collection systems are robust, user-friendly and adaptable, plan adequate remote and on-site monitoring, maximize patient retention through continuous engagement with study sites and ensure that everyone involved in the study forms a friendly and effective team. Observational studies such as DISCOVER are crucial for understanding disease epidemiology and management in real-world settings. They are also increasingly used by governmental, regulatory and payor agencies for post-marketing surveillance and when considering new drug submissions. The development of future studies of similar scope and ambition to DISCOVER is encouraged.

Documentation of wounds in emergency departments through a forensic lens

BACKGROUND

Nurses document wounds to direct and evaluate the care. People admitted to emergency departments with wounds should be regarded as potential forensic patients, requiring meticulous documentation for evidence purposes.

AIM

To explore the documentation of wounds in emergency departments through a forensic lens and compare it between different levels of emergency departments.

METHODS

In this descriptive retrospective study, we randomly sampled 515 paper-based medical files of patients who sustained wounds admitted to three selected emergency departments. The files were analysed using a structured data collection tool the data were descriptively analysed.

RESULTS

All files included information on the type of wound (100%) and the site of the wound (100%) with most files including the mechanisms of injury (98.6%). Few files included information on blood loss (18.1%) and the size of the wound (15%). Only one file included information on the contents of the wound. No files included information on the wound's shape and the surrounding skin's condition.

CONCLUSION

Wounds were poorly documented in emergency departments, irrespective of the level of care. Nurses in emergency departments should have strict guidelines for documenting wounds since accurate documentation protects patients' human rights and protects nurses.

Review of the research databases on population-based Registries of Unified electronic Healthcare system of Kazakhstan (UNEHS): Possibilities and limitations for epidemiological research and Real-World Evidence

INTRODUCTION

A 'learning healthcare system', based on electronic health records and other routinely collected healthcare data, would allow Real World Data (RWD) to be continuously fed into the system, ensuring that with every new patient treated, we know more overall about the practice of medicine. A judicious use of RWD would complement the traditional evidence from clinical research, for the benefit of all stakeholders involved in healthcare. Lack of data on disease epidemiology in Kazakhstan resonates with lower life expectancy and poorer health indicators compared to countries with analogous income per capita. Usage of primary data collection methods to fill these gaps require additional financial and human resources. Usage of big data, which is routinely collected though healthcare information systems, is considered as a competitive alternative in described circumstances.

OBJECTIVE

Development of the Unified National Electronic Healthcare System (UNEHS) in Kazakhstan allowed the creation of research databases to investigate epidemiology of numerous diseases. UNEHS research databases endorse extensive research activities due to a prospective follow-up, coverage of the whole Kazakhstani population and relatively lower expenses to conduct epidemiological studies. This review paper aims to introduce the content and descriptive data on research databases on population-based registries of UNEHS and to discuss opportunities and limitations of its usage.

RESULTS AND DISCUSSION

UNEHS databases include medical data on 36.4% of an adult population of Kazakhstan. Research databases presented in this paper contain critical variables that can be utilized for investigation of disease epidemiology, effectiveness of provided medical procedures and infectious disease epidemiology. A few examples accompany a detailed elaboration on the possibilities of research database utilization in epidemiological research.

CONCLUSION

Considering numerous advantages, the UNEHS research databases are expected to greatly contribute to healthcare in Kazakhstan by providing critical data on disease epidemiology. To warrant long-term usage and high research output several concerns and limitations should be addressed as well.

How can artificial intelligence optimize value-based contracting?

Efforts in the pharmaceutical market have been aimed at ensuring that the benefits obtained from the introduction of new therapies justify the associated costs. In recent years, drug payment models in healthcare have undergone a dramatic shift from focusing on volume (i.e., size of the target clinical population) to focusing on value (i.e., drug performance in real-world settings). In this context, value-based contracts (VBCs) were designed to align the payment of a drug to its clinical performance outside clinical trials by evaluating the effectiveness using real-word evidence (RWE). Despite their widespread implementation, different factors jeopardize the application of VBCs to most marketed drugs in a near future, including the need for easily measurable and relevant outcomes associated with clinical improvements, and access to a large patient population to assess said outcomes. Here, we argue that the extraction and analysis of massive amounts of RWE captured in patients' electronic health records (EHRs) will circumvent these issues and optimize negotiations in VBCs. Particularly, the use of Natural Language Processing (NLP) has proven successful in the analysis of structured and unstructured clinical information in EHRs in multicenter research studies. Thus, the application of NLP to analyze patient-centered information in EHRs in the context of innovative contracting can be utterly beneficial as it enables the real-time evaluation of treatment response and financial impact in real-world settings.

Translating periodontal data to knowledge in a learning health system

BACKGROUND

A learning health system (LHS) is a health system in which patients and clinicians work together to choose care on the basis of best evidence and to drive discovery as a natural outgrowth of every clinical encounter to ensure the right care at the right time. An LHS for dentistry is now feasible, as an increased number of oral health care encounters are captured in electronic health records (EHRs).

METHODS

The authors used EHRs data to track periodontal health outcomes at 3 large dental institutions. The 2 outcomes of interest were a new periodontitis case (for patients who had not received a diagnosis of periodontitis previously) and tooth loss due to progression of periodontal disease.

RESULTS

The authors assessed a total of 494,272 examinations (new periodontitis outcome: n = 168,442; new tooth loss outcome: n = 325,830), representing a total of 194,984 patients. Dynamic dashboards displaying performance on both measures over time allow users to compare demographic and risk factors for patients. The incidence of new periodontitis and tooth loss was 4.3% and 1.2%, respectively.

CONCLUSIONS

Periodontal disease, diagnosis, prevention, and treatment are particularly well suited for an LHS model. The results showed the feasibility of automated extraction and interpretation of critical data elements from the EHRs. The 2 outcome measures are being implemented as part of a dental LHS. The authors are using this knowledge to target the main drivers of poorer periodontal outcomes in a specific patient population, and they continue to use clinical health data for the purpose of learning and improvement.

PRACTICAL IMPLICATIONS

Dental institutions of any size can conduct contemporaneous self-evaluation and immediately implement targeted strategies to improve oral health outcomes.

The relevance of real-world data for the evaluation of neuropathic pain treatments

Treatment of neuropathic pain (NP) is challenging. Interest in real-world evidence (RWE) for benefit-risk assessments of NP treatments increases given the paucity of drugs showing efficacy in randomized controlled trials and restricted labels of available medicines. To provide further context, a literature review regarding regulatory use of RWE and a clinical trial registry search for randomized controlled trials over the last 10 years was carried out. Taken together, and especially for available NP treatments, there is increasing support to consider RWE when evaluating their benefit-risk profile. Examples are provided in which RWE could be used effectively for updating the product label and informing treatment recommendations. Collected and analyzed according to state-of-the-art standards, RWE can inform treatment recommendations and product label decisions.

How do cancer clinicians perceive real-world data and the evidence derived therefrom? Findings from an international survey of the European Organisation for Research and Treatment of Cancer

Background: The role of real-world evidence (RWE) in the development of anticancer therapies has been gradually growing over time. Regulators, payers and health technology assessment agencies, spurred by the rise of the precision medicine model, are increasingly incorporating RWE into their decision-making regarding the authorization and reimbursement of novel antineoplastic treatments. However, it remains unclear how this trend is viewed by clinicians in the field. This study aimed to investigate the opinions of these stakeholders with respect to RWE and its suitability for informing regulatory, reimbursement-related and clinical decisions in oncology.

Methods: An online survey was disseminated to clinicians belonging to the network of the European Organisation for Research and Treatment of Cancer between May and July 2021.

Results: In total, 557 clinicians across 30 different countries participated in the survey, representing 13 distinct cancer domains. Despite seeing the methodological challenges associated with its interpretation as difficult to overcome, the respondents mostly (75.0%) perceived RWE positively, and believed such evidence could be relatively strong, depending on the designs and data sources of the studies from which it is produced. Few (4.6%) saw a future expansion of its influence on decision-makers as a negative evolution. Furthermore, nearly all (94.0%) participants were open to the idea of sharing anonymized or pseudonymized electronic health data of their patients with external parties for research purposes. Nevertheless, most clinicians (77.0%) still considered randomized controlled trials (RCTs) to be the gold standard for generating clinical evidence in oncology, and a plurality (49.2%) thought that RWE cannot fully address the knowledge gaps that remain after a new antitumor intervention has entered the market. Moreover, a majority of respondents (50.7%) expressed that they relied more heavily on RCT-derived evidence than on RWE for their own decision-making.

Conclusion: While cancer clinicians have positive opinions about RWE and want to contribute to its generation, they also continue to hold RCTs in high regard as sources of actionable evidence.

Treatment of Open-Angle Glaucoma and Ocular Hypertension with the Fixed-Dose Combination of Preservative-Free Tafluprost/Timolol: Clinical Outcomes from Ophthalmology Clinics in Italy

Introduction

The VISIONARY study examined the intraocular pressure (IOP)-lowering efficacy and tolerability of the preservative-free fixed-dose combination of tafluprost (0.0015%) and timolol (0.5%) (PF tafluprost/timolol FC) in a real-world setting. The country-level data reported herein comprise the largest and first observational study of PF tafluprost/timolol FC therapy in Italy.

Methods

An observational, multicenter, prospective study included adult Italian patients with open-angle glaucoma (OAG) or ocular hypertension (OHT) demonstrating insufficient response or poor tolerability with topical prostaglandin analogue (PGA) or beta-blocker monotherapy. Treatment was switched to PF tafluprost/timolol FC therapy at baseline. Primary endpoint was the absolute mean IOP change from baseline at Month 6. Exploratory and safety endpoints included change in IOP at Weeks 4 and 12, ocular signs, symptom severity and reporting of adverse events (AEs).

Results

Overall, 160 OAG/OHT patients were included. Mean ± standard deviation IOP was reduced from 19.6 ± 3.6 mmHg at baseline to 14.5 ± 2.6 mmHg at Month 6 (reduction of 5.1 ± 3.7 mmHg; 24.1%; p < 0.0001). IOP reduction was also statistically significant at Week 4 (23.1%; p < 0.0001) and Week 12 (24.7%; p < 0.0001). Based on data cutoff values for mean IOP change of ≥20%, ≥25%, ≥30% and ≥35%, respective Month 6 responder rates were 68.1%, 48.7%, 36.2% and 26.9%. Most ocular signs and symptoms were significantly reduced in severity from baseline at Month 6. Two non-serious and mild AEs were reported during the study period, among which, one AE was treatment-related (eyelash growth).  

Conclusion

Italian OAG and OHT patients demonstrated a significant IOP reduction from baseline at Week 4 that was maintained over a 6-month period following a switch from topical PGA or beta-blocker monotherapy to PF tafluprost/timolol FC therapy. Severity of most ocular signs and symptoms was significantly reduced during the study period, and PF tafluprost/timolol FC was generally well tolerated.

Mapping Outcomes and Registries Used in Current Danish Pharmacoepidemiological Research

Purpose

There is an increasing need for national and international pharmacoepidemiological studies based on high-quality real-world data of which the Danish registries are a valuable source. In lack of a complete overview of which data are used to assess real-world drug safety and effectiveness outcomes, we aimed to map the outcomes, data sources, and the reporting of outcome quality in recent pharmacoepidemiological studies.

Methods

We conducted a systematic mapping review of pharmacoepidemiological studies based on Danish registries investigating drug safety and/or effectiveness, published in the period 2018-2019, identified in PubMed and Scopus. Extraction included: Anatomical Therapeutic Chemical level 2 code for drug exposures, outcomes, outcome data sources, and quality of outcomes.

Results

Of the 210 included studies, 96% used outcomes categorized as Clinical, 4% utilized outcomes categorized as Society-related, 5% used outcomes categorized as Healthcare cost and utilization, and 3% of the studies applied outcomes categorized as Patient-reported in which the percentages are not mutually exclusive. Diagnosis (66%) and Mortality (38%) were the two most utilized subcategories among those categorized as Clinical outcomes. Danish Health Data Authority and Statistics Denmark registries were the most reported outcome data sources (90%). Ninety-six studies (46%) reported one or more quality parameters related to their outcomes of interest with accuracy/validity being the most reported parameter (22%).

Conclusion

The Danish registries support a wide range of outcomes. Across therapeutic areas, most studies investigate traditional clinical outcomes of disease and mortality based on data from a small number of available registries. In contrast, clinical and biochemical databases, despite potentially offering outcomes with high responsiveness, and the high-quality social and healthcare cost registries were rarely used as outcome data sources.

Continuity and Completeness of Electronic Health Record Data for Patients Treated With Oral Hypoglycemic Agents: Findings From Healthcare Delivery Systems in Taiwan

Objective: To evaluate the continuity and completeness of electronic health record (EHR) data, and the concordance of select clinical outcomes and baseline comorbidities between EHR and linked claims data, from three healthcare delivery systems in Taiwan.

Methods: We identified oral hypoglycemic agent (OHA) users from the Integrated Medical Database of National Taiwan University Hospital (NTUH-iMD), which was linked to the National Health Insurance Research Database (NHIRD), from June 2011 to December 2016. A secondary evaluation involved two additional EHR databases. We created consecutive 90-day periods before and after the first recorded OHA prescription and defined patients as having continuous EHR data if there was at least one encounter or prescription in a 90-day interval. EHR data completeness was measured by dividing the number of encounters in the NTUH-iMD by the number of encounters in the NHIRD. We assessed the concordance between EHR and claims data on three clinical outcomes (cardiovascular events, nephropathy-related events, and heart failure admission). We used individual comorbidities that comprised the Charlson comorbidity index to examine the concordance of select baseline comorbidities between EHRs and claims.

Results: We identified 39,268 OHA users in the NTUH-iMD. Thirty-one percent (n = 12,296) of these users contributed to the analysis that examined data continuity during the 6-month baseline and 24-month follow-up period; 31% (n = 3,845) of the 12,296 users had continuous data during this 30-month period and EHR data completeness was 52%. The concordance of major cardiovascular events, nephropathy-related events, and heart failure admission was moderate, with the NTU-iMD capturing 49–55% of the outcome events recorded in the NHIRD. The concordance of comorbidities was considerably different between the NTUH-iMD and NHIRD, with an absolute standardized difference >0.1 for most comorbidities examined. Across the three EHR databases studied, 29–55% of the OHA users had continuous records during the 6-month baseline and 24-month follow-up period.

Conclusion: EHR data continuity and data completeness may be suboptimal. A thorough evaluation of data continuity and completeness is recommended before conducting clinical and translational research using EHR data in Taiwan.

Treatment of Open-Angle Glaucoma and Ocular Hypertension with Preservative-Free Tafluprost/Timolol Fixed-Dose Combination Therapy: Results from the VISIONARY Study Population in Spain

Purpose: Data are presented from ophthalmology clinics in Spain participating in the VISIONARY study, examining the effectiveness, tolerability, and safety of the preservative-free tafluprost (0.0015%) and timolol (0.5%) fixed-dose combination (PF tafluprost/timolol FC) in the treatment of OAG and OHT. Methods: An observational, multicenter prospective study examined treatment outcomes following a switch to PF tafluprost/timolol FC in adult OAG/OHT patients demonstrating insufficient response to beta-blocker or prostaglandin analog (PGA) monotherapy. Primary end point was mean change in intraocular pressure (IOP) from baseline at month 6. Changes in the severity of ocular signs and symptoms were also assessed. Results: Overall, 92 patients (51.1% female) were included. Mean (standard deviation) age was 68.3 (12.1) years. Mean IOP was reduced from 21.9 mmHg at baseline to 16.7 mmHg at month 6 (22.3% decrease; P < 0.0001). Significant IOP reductions were observed at weeks 4 and 12 (P < 0.0001). Baseline PGA and beta-blocker users demonstrated mean month 6 IOP reductions of 5.5 mmHg (23.5%; P < 0.001) and 3.5 mmHg (14.6%; P = 0.029), respectively. Severity of conjunctival hyperemia, dry eye, irritation, itching, foreign body sensation, and eye pain was significantly reduced. Three treatment-related adverse events were reported, all were nonserious and mild/moderate in severity. Conclusion: In real-world clinical practice, PF tafluprost/timolol FC treatment provided significant IOP reductions over 6 months and was well tolerated among OAG/OHT patients showing poor response to PGA or beta-blocker monotherapy. IOP-lowering efficacy and improvements in ocular signs and symptoms were evident from week 4 and maintained over the 6-month study period. Trial Registration: European Union electronic Register of Post-Authorisation Studies (EU PAS) register number EUPAS22204.

Real-World Effectiveness, Tolerability and Safety of Cyclosporine A 0.1% Cationic Emulsion in Severe Keratitis and Dry Eye Treatment

Introduction

The PERSPECTIVE study evaluated, in routine clinical practice, the effectiveness, tolerability and safety of cyclosporine A (CsA) 0.1% cationic emulsion (CE) in controlling severe keratitis in adults with dry eye who remained insufficiently controlled despite artificial tear (AT) use.

Methods

A prospective, multicenter, observational study was conducted at 44 ophthalmology clinics across Finland, Germany, Norway, Sweden and the UK. Adults treated with ATs for severe keratitis and dry eye received CsA 0.1% CE therapy (1 drop in both eyes at bedtime) and were followed up at weeks 4, 12 and 24 and at month 12. Primary endpoint was mean [standard deviation (SD)] change from baseline in corneal fluorescein staining (CFS; Oxford Grade Scale) at month 12 following CsA 0.1% CE initiation. Secondary endpoints examined ocular sign and symptom severity and adverse events (AEs).

Results

The full analysis set included 472 adults (75.9% female). Mean (SD) age was 61.9 (15.41) years. Mean (SD) CFS score was significantly reduced from baseline [2.56 (1.10)] at month 12 [1.10 (SD 1.13); P < 0.0001]. CFS score reductions were statistically significant from week 4, with further incremental decreases reported at study visits through month 12 (P < 0.0001). Severity of eyelid and conjunctival erythema was significantly reduced from baseline at week 4 and maintained through month 12 (P < 0.001). Tear film breakup time increased significantly from baseline at all study visits through month 12 (P < 0.001). Ocular symptom severity was significantly reduced from baseline at all study visits through month 12 (P < 0.001). Overall, 101 treatment-related AEs were reported. Most were mild/moderate (83.6%) and resolved by month 12 (73.3%).

Conclusions

In routine clinical practice, CsA 0.1% CE provided statistically significant reductions in dry eye signs and symptoms. Improvements were seen at week 4 and maintained over 12 months. Treatment tolerability was good and consistent with previous CsA 0.1% CE clinical studies.

Trial registration

EU PAS register number: EUPAS 22376.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40123-022-00487-x.

Fulfilling the Promise of Artificial Intelligence in the Health Sector: Let's Get Real

OBJECTIVES

This study aimed to showcase the potential and key concerns and risks of artificial intelligence (AI) in the health sector, illustrating its application with current examples, and to provide policy guidance for the development, assessment, and adoption of AI technologies to advance policy objectives.

METHODS

Nonsystematic scan and analysis of peer-reviewed and gray literature on AI in the health sector, focusing on key insights for policy and governance.

RESULTS

The application of AI in the health sector is currently in the early stages. Most applications have not been scaled beyond the research setting. The use in real-world clinical settings is especially nascent, with more evidence in public health, biomedical research, and "back office" administration. Deploying AI in the health sector carries risks and hazards that must be managed proactively by policy makers. For AI to produce positive health and policy outcomes, 5 key areas for policy are proposed, including health data governance, operationalizing AI principles, flexible regulation, skills among health workers and patients, and strategic public investment.

CONCLUSIONS

AI is not a panacea, but a tool to address specific problems. Its successful development and adoption require data governance that ensures high-quality data are available and secure; relevant actors can access technical infrastructure and resources; regulatory frameworks promote trustworthy AI products; and health workers and patients have the information and skills to use AI products and services safely, effectively, and efficiently. All of this requires considerable investment and international collaboration.

Real-world data in drug development strategies for orphan drugs: tafasitamab in B cell lymphoma, a case study for approval based on a single-arm combination trial

Tafasitamab (TAF) plus lenalidomide (LEN) is a novel treatment option for patients with relapsed/refractory diffuse large B cell lymphoma (rrDLBCL) who are not eligible for autologous stem cell transplantation. The initial US/EU approvals for TAF represent precedents because this is the first time that approval of a novel combination therapy was granted based on a pivotal single-arm trial (SAT). Matching real world-data (RWD) helped to disentangle the contribution of individual agents. In this review, we present the TAF development strategy, the prospective incorporation of RWD within the clinical development plan, the corresponding regulatory hurdles of this strategy, and the prior regulatory actions for other cancer drugs that previously incorporated RWD and propensity score matching in EU and US regulatory submissions. We also outline how RWD could further advance and impact orphan drug development.

Real-World Evidence for Regulatory Decision-Making: Guidance From Around the World

PURPOSE

Interest in leveraging real-world evidence (RWE) to support regulatory decision making for product effectiveness has been increasing globally as evident by the increasing number of regulatory frameworks and guidance documents. However, acceptance of RWE, especially before marketing for regulatory approval, differs across countries. In addition, guidance on the design and conduct of innovative clinical trials, such as randomized controlled registry studies, pragmatic trials, and other hybrid studies, is lacking.

METHODS

We assessed the global regulatory environment with regard to RWE based on regional availability of the following 3 key regulatory elements: (1) RWE regulatory framework, (2) data quality and standards guidance. and (3) study methods guidance.

FINDINGS

This article reviews the available frameworks and existing guidance from across the globe and discusses the observed gaps and opportunities for further development and harmonization.

IMPLICATIONS

Cross-country collaborations are encouraged to further shape and align RWE policies and help establish frameworks in countries without current policies with the goal of creating efficiencies when considering RWE to support regulatory decision-making globally.

Overall survival in the real-world and clinical trials: a case study validating external controls in advanced melanoma

Aims: We assessed the suitability of real-world data (RWD) as an external control for analysis of overall survival (OS) compared with clinical trial data (CTD) in advanced melanoma. Methods: OS among adults receiving ipilimumab for advanced melanoma was compared between trials (CTD group) and the Flatiron Health database (RWD group) using Cox models. Adjusted analyses accounted for differences in baseline factors; missing data were addressed through multiple imputation. Results: After adjusting for baseline factors and accounting for missingness, OS was similar in the CTD (n = 241) versus RWD groups (n = 816) (hazard ratio: 0.98; 95% CI: 0.75-1.26). Conclusion: Flatiron Health data is suitable to construct external control groups for OS in advanced melanoma trials after adjusting for baseline factors and missing data.

Switching to Preservative-Free Tafluprost/Timolol Fixed-Dose Combination in the Treatment of Open-Angle Glaucoma or Ocular Hypertension: Subanalysis of Data from the VISIONARY Study According to Baseline Monotherapy Treatment

INTRODUCTION

The VISIONARY study demonstrated statistically significant intraocular pressure (IOP) reductions with the preservative-free fixed-dose combination of tafluprost 0.0015% and timolol 0.5% (PF tafluprost/timolol FC) in open-angle glaucoma (OAG) or ocular hypertension (OHT) patients, sub-optimally controlled with topical prostaglandin analogue (PGA) or beta-blocker monotherapy. Current subanalyses have examined these data according to the baseline monotherapy.

METHODS

A European, prospective, observational study included adults (aged ≥ 18 years) with OAG or OHT, who were switched to the PF tafluprost/timolol FC from PGA or beta-blocker monotherapy. Treatment outcomes were reported according to prior monotherapy subgroup: beta-blocker, preserved latanoprost, PF-latanoprost, bimatoprost, tafluprost, and travoprost. Endpoints included the mean change from baseline regarding IOP, conjunctival hyperemia, and corneal fluorescein staining (CFS) at Week 4 and Week 12, and at Month 6.

RESULTS

The subanalysis included 577 patients. All prior monotherapy subgroups demonstrated statistically significant IOP reductions from baseline at Week 4, that were maintained through Month 6 (p < 0.001). Mean (SD) IOP change at Month 6 was 6.6 (4.16), 6.3 (4.39), 5.6 (3.67), 4.9 (2.97), 4.6 (4.39), and 4.7  (3.64) mmHg for prior beta-blocker, preserved latanoprost, PF-latanoprost, tafluprost, bimatoprost, and travoprost subgroups, respectively. The largest IOP change was observed in the preserved latanoprost subgroup for each of the ≥ 20%, ≥ 25%, ≥ 30%, and ≥ 35% IOP reduction categories at Month 6, demonstrating respective reductions of 8.06, 9.20, 10.64, and 11.55 mmHg. CFS was significantly reduced at Month 6 in the prior bimatoprost subgroup (p = 0.0013). Conjunctival hyperemia severity was significantly reduced at each study visit for prior preserved latanoprost users (p < 0.001).

CONCLUSION

PF tafluprost/timolol FC therapy provided statistically and clinically significant IOP reductions from Week 4 over the total 6-month period, in patients with OAG/OHT, regardless of the type of prior PGA or beta-blocker monotherapy used. Conjunctival hyperemia severity and CFS decreased significantly in prior bimatoprost and preserved latanoprost users, respectively.

CLINICAL STUDY NUMBER

European Union electronic Register of Post-Authorization Studies (EU PAS) register number: EUPAS22204.

The GetReal Trial Tool: Design, Assess and Discuss Clinical Drug Trials in Light of RWE Generation

Methodologies incorporating Real World Elements into clinical trial design (also called pragmatic trials) offer an attractive opportunity to assess the effect of a treatment strategy in routine care and as such guide decision making in practice. Uptake of these methods is slow for several reasons, including uncertainty about acceptability of trial results, lack of experience with the methodology and operational challenges. We developed the 'Get Real Trial Tool', an easy-to-use interface, which allows users to assess the impact of design choices on generalisability to routine clinical practice, while taking into account risk of bias, precision, acceptability and operational feasibility. The tool is grounded in the scientific literature on pragmatic trials combined with knowledge of experts from academia, pharmaceutical companies, HTA bodies, patient organisations, and regulators. The aim is to help researchers optimise trial design and facilitate translation of evidence from pragmatic trials to clinical practice. In this paper we describe the development, structure and application of the GetReal Trial Tool.

Evaluating Diuretics in Normal Care (EVIDENCE): protocol of a cluster randomised controlled equivalence trial of prescribing policy to compare the effectiveness of thiazide-type diuretics in hypertension

INTRODUCTION

Healthcare systems must use treatments that are effective and safe. Regulators licensed many currently used older medications before introducing the stringent evidential requirements imposed on modern treatments. Also, there has been little encouragement to carry out within-class, head-to-head comparisons of licensed medicines. For commonly prescribed drugs, even small differences in effectiveness or safety could have significant public health implications. However, conventional clinical trials that randomise individual subjects are costly and unwieldy. Such trials are also often criticised as having low external validity. We describe an approach to rapidly generate externally valid evidence of comparative safety and effectiveness using the example of two widely used diuretics for the management of hypertension.

METHODS AND ANALYSIS

The EVIDENCE (Evaluating Diuretics in Normal Care) study has a prospective, cluster-randomised, open-label, blinded end-point design. By randomising prescribing policy in primary care practices, the study compares the safety and effectiveness of commonly used diuretics in treating hypertension. Participating practices are randomised 1:1 to a policy of prescribing either indapamide or bendroflumethiazide when clinically indicated. Suitable patients who are not already taking the policy diuretic are switched accordingly. All patients taking the study medications are written to explaining the rationale for changing the prescribing policy and notifying them they can opt-out of any switch. The prescribing policies' effectiveness and safety will be compared using rates of major adverse cardiovascular events (hospitalisation with myocardial infarction, heart failure or stroke or cardiovascular death), routinely collected in national healthcare administrative datasets. The study will seek to recruit 250 practices to provide a study population of approximately 50,000 individuals with a mean follow-up time of two years. A primary intention-to-treat time-to-event analysis will be used to estimate the relative effect of the two policies.

ETHICS AND DISSEMINATION

EVIDENCE has been approved by the East of Scotland Research Ethics Service (17/ES/0016, current approved protocol version 5, 26 August 2021). The results will be disseminated widely in peer reviewed journals, guideline committees, National Health Service (NHS) organisations and patient groups.

TRIAL REGISTRATION

ISRCTN 46635087 . Registered on 11 August 2017 (pre-recruitment).

A Review of the Evidence on Attitudes, Perceived Impacts and Motivational Factors for European Member State Collaboration for Pricing and Reimbursement of Medicines: Time for the EEA Member States to Apply Their Experience and Expertise in Evidence-Based Decision Making to Their Current Pharmaceutical Policy Challenges

In 2018/2019 there were a number of initiatives for collaboration between Member States in the European Economic Area (EEA) and the European Commission published a Proposal for a Regulation on Health Technology Assessment. In view of the perceived benefits from collaboration, the experiences and challenges of these collaborative initiatives and the possible implications of the proposed legislation, a study of the evidence on attitudes, perceived impacts and the motivational factors towards European Member State collaboration regarding the pricing and reimbursement of medicines was conducted. This study adopted an evidence-based management approach by Barends and Rousseau. The main findings showed that Member States differed in their motivation for collaboration for different pharmaceutical activities. Member States favoured voluntary co-operation for all activities of pricing and reimbursement except for relative effectiveness assessments where Member State authorities had divergent attitudes and prioritised activities related to the sustainability of their healthcare systems and access to medicines. Contrastingly pharmaceutical companies strongly favoured mandatory cooperation for evaluation. Member States motivation for collaboration was highly dependent on the purpose, political will, implementation climate and cultural factors. Currently, with the experiences of ongoing collaborations, following the progress of the discussion at Council, and with a number of inititatives for new pharmaceutical strategy and policy, it is proposed that Member States use their trust, expertise and knowledge of application of evidence-based decision making for pricing and reimbursement of medicines and apply it to decide the future model for Member State collaboration. The applicability of principles of evidence-based management to pharmaceutical policy can be used as a starting point.

Use of Real-World Data and Evidence in Drug Development of Medicinal Products Centrally Authorized in Europe in 2018-2019

Real‐world data/real‐world evidence (RWD/RWE) are considered to have a great potential to complement, in some cases, replace the evidence generated through randomized controlled trials. By tradition, use of RWD/RWE in the postauthorization phase is well‐known, whereas published evidence of use in the pre‐authorization phase of medicines development is lacking. The primary aim of this study was to identify and quantify the role of potential use of RWD/RWE (RWE signatures) during the pre‐authorization phase, as presented in the initial marketing authorization applications of new medicines centrally evaluated with a positive opinion in 2018–2019 (n = 111) by the European Medicines Agency (EMA). Data for the study was retrieved from the evaluation overviews of the European Public Assessment Reports (EPARs), which reflect the scientific conclusions of the assessment process and are accessible through the EMA website. RWE signatures were extracted into an RWE Data Matrix, including 11 categories divided over 5 stages of the drug development lifecycle. Nearly all EPARs included RWE signatures for the discovery (98.2%) and life‐cycle management (100.0%). Half of them included RWE signatures for the full development phase (48.6%) and for supporting regulatory decisions at the registration (46.8%), whereas over a third (35.1%) included RWE signatures for the early development. RWE signatures were more often seen for orphan and conditionally approved medicines. Oncology, hematology, and anti‐infectives stood out as therapeutic areas with most RWE signatures in their full development phase. The findings bring unprecedented insights about the vast use of RWD/RWE in drug development supporting the regulatory decision making.

Subcategorizing EHR diagnosis codes to improve clinical application of machine learning models

BACKGROUND

Electronic health record (EHR) data is commonly used for secondary purposes such as research and clinical decision support. However, reuse of EHR data presents several challenges including but not limited to identifying all diagnoses associated with a patient's clinical encounter. The purpose of this study was to assess the feasibility of developing a schema to identify and subclassify all structured diagnosis codes for a patient encounter.

METHODS

To develop a subclassification schema we used EHR data from an interhospital transport data repository that contained complete hospital encounter level data. Eight discrete data sources containing structured diagnosis codes were identified. Diagnosis codes were normalized using the Unified Medical Language System and additional EHR data were combined with standardized terminologies to create and validate the subcategories. We then employed random forest to assess the usefulness of the new subcategorized diagnoses to predict post-interhospital transfer mortality by building 2 models, one using standard diagnosis codes, and one using the new subcategorized diagnosis codes.

RESULTS

Six subcategories of diagnoses were identified and validated. The subcategories included: primary or admitting diagnoses (10%), past medical, surgical or social history (9%), problem list (20%), comorbidity (24%), discharge diagnoses (6%), and unmapped diagnoses (31%). The subcategorized model outperformed the standard model, achieving a training AUROC of 0.97 versus 0.95 and testing model AUROC of 0.81 versus 0.46.

DISCUSSION

Our work demonstrates that merging structured diagnosis codes with additional EHR data and secondary data sources provides additional information to understand the role of diagnosis throughout a clinical encounter and improves predictive model performance. Further work is necessary to assess if subcategorizing produces benefits in interpreting the results of prognostic models and/or operationalizing the results in clinical decision support applications.

The EHA Research Roadmap: Blood Coagulation and Hemostatic Disorders

In 2016, the European Hematology Association (EHA) published the EHA Roadmap for European Hematology Research1 aiming to highlight achievements in the diagnostics and treatment of blood disorders, and to better inform European policy makers and other stakeholders about the urgent clinical and scientific needs and priorities in the field of hematology. Each section was coordinated by 1-2 section editors who were leading international experts in the field. In the 5 years that have followed, advances in the field of hematology have been plentiful. As such, EHA is pleased to present an updated Research Roadmap, now including 11 sections, each of which will be published separately. The updated EHA Research Roadmap identifies the most urgent priorities in hematology research and clinical science, therefore supporting a more informed, focused, and ideally funded future for European hematology research. The 11 EHA Research Roadmap sections include Normal Hematopoiesis; Malignant Lymphoid Diseases; Malignant Myeloid Diseases; Anemias and Related Diseases; Platelet Disorders; Blood Coagulation and Hemostatic Disorders; Transfusion Medicine; Infections in Hematology; Hematopoietic Stem Cell Transplantation; CAR-T and Other Cell-based Immune Therapies; and Gene Therapy.

Replication of Oncology Randomized Trial Results using Swedish Registry Real World-Data: A Feasibility Study

Nationwide healthcare registries are potential important real-world data (RWD) sources for assessing drug effectiveness in oncology. However, it is unclear whether registry-derived RWD are suitable for clinical development. In this study, we replicate results from the comparator arm of two previously published oncology randomized controlled trials (RCTs) using RWD from Swedish nationwide healthcare registries. For replication 1, the RCT included 553 patients and the RWD included 283 patients treated with sorafenib for advanced hepatocellular cancer. The median overall survival (OS) was 11.2 (95% confidence interval (CI): 10.1-13.2) months in the RCT and 8.2 (95% CI: 7.0-9.9) months in the RWD, unadjusted hazard ratio (HR) 0.75 (95% CI: 0.63-0.88). For time-to-treatment discontinuation (TTD), the HR was 1.00 (95% CI: 0.87-1.16). For replication 2, the RCT included 154 patients and the RWD included 704 patients treated with melphalan, prednisone, and thalidomide for untreated multiple myeloma. The median OS was 52.6 (95% CI: 40-not applicable) months in the RCT and 36.9 (95% CI: 33.8-40.5) months in the RWD, unadjusted HR 0.67 (95% CI: 0.51-0.87). For TTD, the HR was 0.89 (95% CI: 0.74-1.06). The results were similar when applying various propensity-based confounding adjustments. In conclusion, OS was shorter in the RWD, whereas TTD was similar. Importantly, the data necessary (ex: eligibility criteria and baseline confounders) for replicating RCTs was mostly not available and these results further underscore the importance of developing frameworks for capturing relevant patient-level RWD for clinical and regulatory decision making in oncology.

Measuring the Effectiveness of Real-World Evidence to Ensure Appropriate Impact

The value of real-world evidence (RWE) in medicines regulation and health technology assessment has been increasingly emphasized. Nevertheless, although RWE is increasingly used, there has been limited systematic evidence of its value. A recent study that examined the role and impact of RWE in regulatory assessments conducted through the European Medicines Agency provided such evidence. Results of the study demonstrated RWE was important to decision making, particularly for certain questions such as the quantification of adverse events, the evaluation of risk minimization measures, and the assessment of product usage. The study suggested, however, that in many of the assessments further RWE would have been valuable and concluded that RWE has, as yet, played a limited role in hypothesis generation and in the assessment of medication effectiveness. This study had been possible only because of the transparency of the European Medicines Agency decision making. Ensuring transparency of RWE evidence collection, study design and conduct, and of decision making based on this evidence will facilitate further development of the uses and value of RWE. Keywords: benefit-risk assessment; medicines regulation; real-world evidence; regulatory decision making.

Insulin glargine 300 units/mL for the treatment of individuals with type 2 diabetes in the real world: A review of the DELIVER programme

Evidence from randomized controlled trials (RCTs) has shown that second-generation basal insulin (BI) analogues, insulin glargine 300 U/mL (Gla-300) and insulin degludec (IDeg), provide similar glycaemic control, with a lower risk of hypoglycaemia compared with the first-generation BI analogue insulin glargine 100 U/mL (Gla-100) in people with type 2 diabetes (T2D). However, the highly selected participants and frequent follow-up of RCTs may not be truly representative of real-life clinical practice. It is important to assess the safety and effectiveness of these second-generation BI analogues in real-life clinical practice settings. The DELIVER programme utilized electronic healthcare records from the United States to compare clinical outcomes in people with T2D who received either Gla-300 or other BI analogues in real-world clinical practice. This review provides a concise overview of the results of the DELIVER studies. Overall, Gla-300 provided similar antihyperglycaemic effectiveness and a lower risk of hypoglycaemia versus the first-generation BI analogues Gla-100 and insulin detemir in people with T2D who had switched BIs. In those who were insulin-naïve, initiation with Gla-300 versus Gla-100 was associated with significantly better antihyperglycaemic effectiveness and similar or lower hypoglycaemic risk. Both glycaemic control and hypoglycaemia risk were also shown to be similar with Gla-300 and IDeg, in people who had switched BIs and in those who were insulin-naïve. In addition, the DELIVER 2 study reported that people with T2D who switched to Gla-300 had reduced healthcare resource utilization, with an overall saving of US$1439 per person per year compared with those who switched to another BI analogue. Overall, the real-world DELIVER programme showed that the glycaemic control with a low risk of hypoglycaemia observed with Gla-300 in RCTs was also seen in standard clinical practice.

Considerations for Drug Dosing in Premature Infants

In premature infants, effective and safe drug therapy depends on optimal dose selection and requires a thorough understanding of the underlying disease(s) of these fragile infants as well as the pharmacokinetics and pharmacodynamics of the drugs selected to treat their diseases. Differences in gestational and postnatal age or weight are the major determinants of the observed variability in drug disposition and effect in these infants. This article presents an outline on how to translate the results of a population pharmacokinetic/pharmacodynamic study into rational dosing regimens, and how physiologically based pharmacokinetic modeling, electronic health records, and the abundantly available data of vital functions of premature infants during their stay in the neonatal intensive care unit for evaluation of their pharmacotherapy can be used to tailor the most safe and effective dose in these infants.

Towards a Responsible Transition to Learning Healthcare Systems in Precision Medicine: Ethical Points to Consider

Learning healthcare systems have recently emerged as a strategy to continuously use experiences and outcomes of clinical care for research purposes in precision medicine. Although it is known that learning healthcare transitions in general raise important ethical challenges, the ethical ramifications of such transitions in the specific context of precision medicine have not extensively been discussed. Here, we describe three levers that institutions can pull to advance learning healthcare systems in precision medicine: (1) changing testing of individual variability (such as genes); (2) changing prescription of treatments on the basis of (genomic) test results; and/or (3) changing the handling of data that link variability and treatment to clinical outcomes. Subsequently, we evaluate how patients can be affected if one of these levers are pulled: (1) patients are tested for different or more factors than before the transformation, (2) patients receive different treatments than before the transformation and/or (3) patients’ data obtained through clinical care are used, or used more extensively, for research purposes. Based on an analysis of the aforementioned mechanisms and how these potentially affect patients, we analyze why learning healthcare systems in precision medicine need a different ethical approach and discuss crucial points to consider regarding this approach.

The Potential of AI in Care Optimization: Insights from the User-Driven Co-Development of a Care Integration System

Transitions from one level of care to another are complex processes that pose medical and organizational risks and depend on care integration between different providers. This qualitative study investigated user experiences with an existing digital system for care integration between hospitals and nursing homes, and the potential of artificial intelligence to contribute to its optimization. The findings reveal challenges regarding (a) untimely information, (b) irrelevant information, (c) confusing information, (d) missing information, (e) information overload, and (f) information multiplicity. Artificial intelligence could address these by (i) identifying and verifying low-quality information, (ii) targeting information for different user groups, (iii) visually summarizing relevant information, and (iv) jointly presenting multiple versions. The implications of these findings extend beyond the context of care integration, presenting empirical evidence for the importance of qualitative health research in, and a model for, determining the scope and design of future artificial intelligence solutions to optimize (health)care processes.

Personalized Dosing of Intravenous Vancomycin Among Critically Ill Neonates in Hong Kong: Harnessing Electronic Health Records to Develop a Web-Based Dosing Interface (Preprint)

Background

Intravenous (IV) vancomycin is used in the treatment of severe infection in neonates. However, its efficacy is compromised by elevated risks of acute kidney injury. The risk is even higher among neonates admitted to the neonatal intensive care unit (NICU), in whom the pharmacokinetics of vancomycin vary widely. Therapeutic drug monitoring is an integral part of vancomycin treatment to balance efficacy against toxicity. It involves individual dose adjustments based on the observed serum vancomycin concentration (VC_s). However, the existing trough-based approach shows poor evidence for clinical benefits. The updated clinical practice guideline recommends population pharmacokinetic (popPK) model–based approaches, targeting area under curve, preferably through the Bayesian approach. Since Bayesian methods cannot be performed manually and require specialized computer programs, there is a need to provide clinicians with a user-friendly interface to facilitate accurate personalized dosing recommendations for vancomycin in critically ill neonates.

Objective

We used medical data from electronic health records (EHRs) to develop a popPK model and subsequently build a web-based interface to perform model-based individual dose optimization of IV vancomycin for NICU patients in local medical institutions.

Methods

Medical data of subjects prescribed IV vancomycin in the NICUs of Prince of Wales Hospital and Queen Elizabeth Hospital in Hong Kong were extracted from EHRs, namely the Clinical Information System, In-Patient Medication Order Entry, and electronic Patient Record. Patient demographics, such as body weight and postmenstrual age (PMA), serum creatinine (SCr), vancomycin administration records, and VC_s were collected. The popPK model employed a 2-compartment infusion model. Various covariate models were tested against body weight, PMA, and SCr, and were evaluated for the best goodness of fit. A previously published web-based dosing interface was adapted to develop the interface in this study.

Results

The final data set included EHR data extracted from 207 subjects, with a total of 689 VC_s measurements. The final model chosen explained 82% of the variability in vancomycin clearance. All parameter estimates were within the bootstrapping CIs. Predictive plots, residual plots, and visual predictive checks demonstrated good model predictability. Model approximations showed that the model-based Bayesian approach consistently promoted a probability of target attainment (PTA) above 75% for all subjects, while only half of the subjects could achieve a PTA over 50% with the trough-based approach. The dosing interface was developed with the capability to optimize individual doses with the model-based empirical or Bayesian approach.

Conclusions

Using EHRs, a satisfactory popPK model was verified and adopted to develop a web-based individual dose optimization interface. The interface is expected to improve treatment outcomes of IV vancomycin for severe infections among critically ill neonates. This study provides the foundation for a cohort study to demonstrate the utility of the new approach compared with previous dosing methods.

How well can we assess the validity of non-randomised studies of medications? A systematic review of assessment tools

OBJECTIVE

To determine whether assessment tools for non-randomised studies (NRS) address critical elements that influence the validity of NRS findings for comparative safety and effectiveness of medications.

DESIGN

Systematic review and Delphi survey.

DATA SOURCES

We searched PubMed, Embase, Google, bibliographies of reviews and websites of influential organisations from inception to November 2019. In parallel, we conducted a Delphi survey among the International Society for Pharmacoepidemiology Comparative Effectiveness Research Special Interest Group to identify key methodological challenges for NRS of medications. We created a framework consisting of the reported methodological challenges to evaluate the selected NRS tools.

STUDY SELECTION

Checklists or scales assessing NRS.

DATA EXTRACTION

Two reviewers extracted general information and content data related to the prespecified framework.

RESULTS

Of 44 tools reviewed, 48% (n=21) assess multiple NRS designs, while other tools specifically addressed case-control (n=12, 27%) or cohort studies (n=11, 25%) only. Response rate to the Delphi survey was 73% (35 out of 48 content experts), and a consensus was reached in only two rounds. Most tools evaluated methods for selecting study participants (n=43, 98%), although only one addressed selection bias due to depletion of susceptibles (2%). Many tools addressed the measurement of exposure and outcome (n=40, 91%), and measurement and control for confounders (n=40, 91%). Most tools have at least one item/question on design-specific sources of bias (n=40, 91%), but only a few investigate reverse causation (n=8, 18%), detection bias (n=4, 9%), time-related bias (n=3, 7%), lack of new-user design (n=2, 5%) or active comparator design (n=0). Few tools address the appropriateness of statistical analyses (n=15, 34%), methods for assessing internal (n=15, 34%) or external validity (n=11, 25%) and statistical uncertainty in the findings (n=21, 48%). None of the reviewed tools investigated all the methodological domains and subdomains.

CONCLUSIONS

The acknowledgement of major design-specific sources of bias (eg, lack of new-user design, lack of active comparator design, time-related bias, depletion of susceptibles, reverse causation) and statistical assessment of internal and external validity is currently not sufficiently addressed in most of the existing tools. These critical elements should be integrated to systematically investigate the validity of NRS on comparative safety and effectiveness of medications. SYSTEMATIC REVIEW PROTOCOL AND REGISTRATION: https://osf.io/es65q.

Real-world evidence to support regulatory decision making: New or expanded medical product indications

There is increasing interest in utilizing real-world data (RWD) to produce real-world evidence (RWE) on the benefits and risks of medical products that could support regulatory approval decisions. The field of pharmacoepidemiology has a long history of focusing on data and evidence that would now be termed "real-world," including evidence from healthcare claims, registries, and electronic health records. However, several emerging trends over the past decade are converging to support the use of these and other RWD sources for approval decisions, and there are several recent examples and ongoing research that demonstrate how RWE may be used to support regulatory approval of new or expanded indications. The goal of this article is to review the current landscape and future directions of the use of RWE in this context. This manuscript is endorsed by the International Society for Pharmacoepidemiology (ISPE).

The Prospective Dutch Colorectal Cancer (PLCRC) cohort: real-world data facilitating research and clinical care

Real-world data (RWD) sources are important to advance clinical oncology research and evaluate treatments in daily practice. Since 2013, the Prospective Dutch Colorectal Cancer (PLCRC) cohort, linked to the Netherlands Cancer Registry, serves as an infrastructure for scientific research collecting additional patient-reported outcomes (PRO) and biospecimens. Here we report on cohort developments and investigate to what extent PLCRC reflects the “real-world”. Clinical and demographic characteristics of PLCRC participants were compared with the general Dutch CRC population (n = 74,692, Dutch-ref). To study representativeness, standardized differences between PLCRC and Dutch-ref were calculated, and logistic regression models were evaluated on their ability to distinguish cohort participants from the Dutch-ref (AU-ROC 0.5 = preferred, implying participation independent of patient characteristics). Stratified analyses by stage and time-period (2013–2016 and 2017–Aug 2019) were performed to study the evolution towards RWD. In August 2019, 5744 patients were enrolled. Enrollment increased steeply, from 129 participants (1 hospital) in 2013 to 2136 (50 of 75 Dutch hospitals) in 2018. Low AU-ROC (0.65, 95% CI: 0.64–0.65) indicates limited ability to distinguish cohort participants from the Dutch-ref. Characteristics that remained imbalanced in the period 2017–Aug’19 compared with the Dutch-ref were age (65.0 years in PLCRC, 69.3 in the Dutch-ref) and tumor stage (40% stage-III in PLCRC, 30% in the Dutch-ref). PLCRC approaches to represent the Dutch CRC population and will ultimately meet the current demand for high-quality RWD. Efforts are ongoing to improve multidisciplinary recruitment which will further enhance PLCRC’s representativeness and its contribution to a learning healthcare system.

Using propensity scores to estimate effects of treatment initiation decisions: State of the science

Confounding can cause substantial bias in nonexperimental studies that aim to estimate causal effects. Propensity score methods allow researchers to reduce bias from measured confounding by summarizing the distributions of many measured confounders in a single score based on the probability of receiving treatment. This score can then be used to mitigate imbalances in the distributions of these measured confounders between those who received the treatment of interest and those in the comparator population, resulting in less biased treatment effect estimates. This methodology was formalized by Rosenbaum and Rubin in 1983 and, since then, has been used increasingly often across a wide variety of scientific disciplines. In this review article, we provide an overview of propensity scores in the context of real-world evidence generation with a focus on their use in the setting of single treatment decisions, that is, choosing between two therapeutic options. We describe five aspects of propensity score analysis: alignment with the potential outcomes framework, implications for study design, estimation procedures, implementation options, and reporting. We add context to these concepts by highlighting how the types of comparator used, the implementation method, and balance assessment techniques have changed over time. Finally, we discuss evolving applications of propensity scores.

Randomized Controlled Trials Versus Real World Evidence: Neither Magic Nor Myth

Compared with drugs from the blockbuster era, recently authorized drugs and those expected in the future present a heterogenous mix of chemicals, biologicals, and cell and gene therapies, a sizable fraction being for rare diseases, and even individualized treatments or individualized combinations. The shift in the nature of products entails secular trends for the definitions of “drugs” and “target population” and for clinical use and evidence generation. We discuss that the lessons learned from evidence generation for 20th century medicines may have limited relevance for 21st century medicines. We explain why the future is not about randomized controlled trials (RCTs) vs. real‐world evidence (RWE) but RCTs and RWE—not just for the assessment of safety but also of effectiveness. Finally, we highlight that, in the era of precision medicine, we may not be able to reliably describe some small treatment effects—either by way of RCTs or RWE.

Overcoming cancer therapeutic bottleneck by drug repurposing

Ever present hurdles for the discovery of new drugs for cancer therapy have necessitated the development of the alternative strategy of drug repurposing, the development of old drugs for new therapeutic purposes. This strategy with a cost-effective way offers a rare opportunity for the treatment of human neoplastic disease, facilitating rapid clinical translation. With an increased understanding of the hallmarks of cancer and the development of various data-driven approaches, drug repurposing further promotes the holistic productivity of drug discovery and reasonably focuses on target-defined antineoplastic compounds. The "treasure trove" of non-oncology drugs should not be ignored since they could target not only known but also hitherto unknown vulnerabilities of cancer. Indeed, different from targeted drugs, these old generic drugs, usually used in a multi-target strategy may bring benefit to patients. In this review, aiming to demonstrate the full potential of drug repurposing, we present various promising repurposed non-oncology drugs for clinical cancer management and classify these candidates into their proposed administration for either mono- or drug combination therapy. We also summarize approaches used for drug repurposing and discuss the main barriers to its uptake.

Suitability of external controls for drug evaluation in Duchenne muscular dystrophy

Objective

To evaluate the suitability of real-world data (RWD) and natural history data (NHD) for use as external controls in drug evaluations for ambulatory Duchenne muscular dystrophy (DMD).

Methods

The consistency of changes in the 6-minute walk distance (Δ6MWD) was assessed across multiple clinical trial placebo arms and sources of NHD/RWD. Six placebo arms reporting 48-week Δ6MWD were identified via literature review and represented 4 sets of inclusion/exclusion criteria (n = 383 patients in total). Five sources of RWD/NHD were contributed by Universitaire Ziekenhuizen Leuven, DMD Italian Group, The Cooperative International Neuromuscular Research Group, ImagingDMD, and the PRO-DMD-01 study (n = 430 patients, in total). Mean Δ6MWD was compared between each placebo arm and RWD/NHD source after subjecting the latter to the inclusion/exclusion criteria of the trial for baseline age, ambulatory function, and steroid use. Baseline covariate adjustment was investigated in a subset of patients with available data.

Results

Analyses included ∼1,200 patient-years of follow-up. Differences in mean Δ6MWD between trial placebo arms and RWD/NHD cohorts ranged from −19.4 m (i.e., better outcomes in RWD/NHD) to 19.5 m (i.e., worse outcomes in RWD/NHD) and were not statistically significant before or after covariate adjustment.

Conclusions

We found that Δ6MWD was consistent between placebo arms and RWD/NHD subjected to equivalent inclusion/exclusion criteria. No evidence for systematic bias was detected. These findings are encouraging for the use of RWD/NHD to augment, or possibly replace, placebo controls in DMD trials. Multi-institution collaboration through the Collaborative Trajectory Analysis Project rendered this study feasible.

Treatment of Open-Angle Glaucoma and Ocular Hypertension with Preservative-Free Tafluprost/Timolol Fixed-Dose Combination Therapy: The VISIONARY Study

Introduction

A non-interventional, multicenter, European, prospective evaluation of the effectiveness, tolerability, and safety of a topical preservative-free tafluprost (0.0015%) and timolol (0.5%) fixed-dose combination (PF tafluprost/timolol FC) in adults with open-angle glaucoma (OAG) and ocular hypertension (OHT) demonstrating insufficient response to topical beta-receptor blockers or prostaglandin analogue (PGA) monotherapy.

Methods

Mean intraocular pressure (IOP) change from baseline was measured at study visits following a switch to PF tafluprost/timolol FC. Primary endpoint was absolute mean IOP change at month 6. Change from baseline concerning ocular signs and symptoms was also explored.

Results

Analyses included 577 patients (59.6% female). Mean age (SD) was 67.8 (11.67) years. Mean (SD) IOP reduction from baseline was significant at all study visits; 5.4 (3.76) mmHg (23.7%) at week 4, 5.9 (3.90) mmHg (25.6%) at week 12, and 5.7 (4.11) mmHg (24.9%) at month 6 (p < 0.0001 for all visits). At month 6, 69.2%, 53.6%, 40.0%, and 25.8% were responders based on ≥ 20%, ≥ 25%, ≥ 30%, and ≥ 35% cutoff values for mean IOP, respectively. Significant reductions were observed concerning corneal fluorescein staining (p < 0.0001), dry eye symptoms, irritation, itching, and foreign body sensation (p < 0.001 for each parameter). Conjunctival hyperemia was significantly reduced at all study visits (p < 0.0001 at each visit). Overall, 69 treatment-related adverse events (AEs) were reported, one of which was serious (status asthmaticus). Most AEs were mild to moderate in severity, and the majority had resolved or were resolving at the end of the study period.

Conclusion

In clinical practice, PF tafluprost/timolol FC provided statistically and clinically significant IOP reductions in patients with OAG and OHT insufficiently controlled on or intolerant to PGA or beta-receptor blocker monotherapy. The full IOP reduction appeared at week 4 and was maintained over the 6-month study period. Key symptoms of ocular surface health improved.

Trial Registration

European Union electronic Register of Post-Authorisation Studies (EU PAS) register number, EUPAS22204.

Are Novel, Nonrandomized Analytic Methods Fit for Decision Making? The Need for Prospective, Controlled, and Transparent Validation

Real-world data and patient-level data from completed randomized controlled trials are becoming available for secondary analysis on an unprecedented scale. A range of novel methodologies and study designs have been proposed for their analysis or combination. However, to make novel analytical methods acceptable for regulators and other decision makers will require their testing and validation in broadly the same way one would evaluate a new drug: prospectively, well-controlled, and according to a pre-agreed plan. From a European regulators' perspective, the established methods qualification advice procedure with active participation of patient groups and other decision makers is an efficient and transparent platform for the development and validation of novel study designs.