An algorithm to identify cases of pulmonary arterial hypertension from the electronic medical record

The importance of data in Pulmonary Arterial Hypertension: from international registries to Machine Learning

Real-world registries have been critical to building the scientific knowledge of rare diseases, including Pulmonary Arterial Hypertension (PAH). In the past 4 decades, a considerable number of registries on this condition have allowed to improve the pathology and its subgroupś definition, to advance in the understanding of its pathophysiology, to elaborate prognostic scales and to check the transferability of the results from clinical trials to clinical practice. However, in a moment where a huge amount of data from multiple sources is available, they are not always taken into account by the registries. For that reason, Machine Learning (ML) offer a unique opportunity to manage all these data and, finally, to obtain tools that may help to get an earlier diagnose, to help to deduce the prognosis and, in the end, to advance in Personalized Medicine. Thus, we present a narrative revision with the aims of, in one hand, summing up the aspects in which data extraction is important in rare diseases -focusing on the knowledge gained from PAH real-world registries- and, on the other hand, describing some of the achievements and the potential use of the ML techniques on PAH.

Clinical evaluation of code-based algorithms to identify patients with pulmonary arterial hypertension in healthcare databases

Pulmonary arterial hypertension (PAH) is a rare subgroup of pulmonary hypertension (PH). Claims and administrative databases can be particularly important for research in rare diseases; however, there is a lack of validated algorithms to identify PAH patients using administrative codes. We aimed to measure the accuracy of code-based PAH algorithms against the true clinical diagnosis by right heart catheterization (RHC). This study evaluated algorithms in patients who were recorded in two linkable data assets: the Stanford Healthcare administrative electronic health record database and the Stanford Vera Moulton Wall Center clinical PH database (which records each patient's RHC diagnosis). We assessed the sensitivity and specificity achieved by 16 algorithms (six published). In total, 720 PH patients with linked data available were included and 558 (78%) of these were PAH patients. Algorithms consisting solely of a P(A)H-specific diagnostic code classed all or almost all PH patients as PAH (sensitivity >97%, specificity <12%) while multicomponent algorithms with well-defined temporal sequences of procedure, diagnosis and treatment codes achieved a better balance of sensitivity and specificity. Specificity increased and sensitivity decreased with increasing algorithm complexity. The best-performing algorithms, in terms of fewest misclassified patients, included multiple components (e.g., PH diagnosis, PAH treatment, continuous enrollment for ≥6 months before and ≥12 months following index date) and achieved sensitivities and specificities of around 95% and 38%, respectively. Our findings help researchers tailor their choice and design of code-based PAH algorithms to their research question and demonstrate the importance of including well-defined temporal components in the algorithms.

Real-world evidence to advance knowledge in pulmonary hypertension: Status, challenges, and opportunities. A consensus statement from the Pulmonary Vascular Research Institute's Innovative Drug Development Initiative's Real-world Evidence Working Group

This manuscript on real-world evidence (RWE) in pulmonary hypertension (PH) incorporates the broad experience of members of the Pulmonary Vascular Research Institute's Innovative Drug Development Initiative Real-World Evidence Working Group. We aim to strengthen the research community's understanding of RWE in PH to facilitate clinical research advances and ultimately improve patient care. Herein, we review real-world data (RWD) sources, discuss challenges and opportunities when using RWD sources to study PH populations, and identify resources needed to support the generation of meaningful RWE for the global PH community.

A claims-based, machine-learning algorithm to identify patients with pulmonary arterial hypertension

Many patients with pulmonary arterial hypertension (PAH) experience substantial delays in diagnosis, which is associated with worse outcomes and higher costs. Tools for diagnosing PAH sooner may lead to earlier treatment, which may delay disease progression and adverse outcomes including hospitalization and death. We developed a machine-learning (ML) algorithm to identify patients at risk for PAH earlier in their symptom journey and distinguish them from patients with similar early symptoms not at risk for developing PAH. Our supervised ML model analyzed retrospective, de-identified data from the US-based Optum® Clinformatics® Data Mart claims database (January 2015 to December 2019). Propensity score matched PAH and non-PAH (control) cohorts were established based on observed differences. Random forest models were used to classify patients as PAH or non-PAH at diagnosis and at 6 months prediagnosis. The PAH and non-PAH cohorts included 1339 and 4222 patients, respectively. At 6 months prediagnosis, the model performed well in distinguishing PAH and non-PAH patients, with area under the curve of the receiver operating characteristic of 0.84, recall (sensitivity) of 0.73, and precision of 0.50. Key features distinguishing PAH from non-PAH cohorts were a longer time between first symptom and the prediagnosis model date (i.e., 6 months before diagnosis); more diagnostic and prescription claims, circulatory claims, and imaging procedures, leading to higher overall healthcare resource utilization; and more hospitalizations. Our model distinguishes between patients with and without PAH at 6 months before diagnosis and illustrates the feasibility of using routine claims data to identify patients at a population level who might benefit from PAH-specific screening and/or earlier specialist referral.