The N3C governance ecosystem: A model socio-technical partnership for the future of collaborative analytics at scale

The National COVID Cohort Collaborative (N3C) is a public-private-government partnership established during the Coronavirus pandemic to create a centralized data resource called the "N3C data enclave." This resource contains individual-level health data from participating healthcare sites nationwide to support rapid collaborative analytics. N3C has enabled analytics within a cloud-based enclave of data from electronic health records from over 17 million people (with and without COVID-19) in the USA. To achieve this goal of a shared data resource, N3C implemented a shared governance strategy involving stakeholders in decision-making. The approach leveraged best practices in data stewardship and team science to rapidly enable COVID-19-related research at scale while respecting the privacy of data subjects and participating institutions. N3C balanced equitable access to data, team-based scientific productivity, and individual professional recognition - a key incentive for academic researchers. This governance approach makes N3C research sustainable and effective beyond the initial days of the pandemic. N3C demonstrated that shared governance can overcome traditional barriers to data sharing without compromising data security and trust. The governance innovations described herein are a helpful framework for other privacy-preserving data infrastructure programs and provide a working model for effective team science beyond COVID-19.

Risk factors associated with post-acute sequelae of SARS-CoV-2: an N3C and NIH RECOVER study

BACKGROUND

More than one-third of individuals experience post-acute sequelae of SARS-CoV-2 infection (PASC, which includes long-COVID). The objective is to identify risk factors associated with PASC/long-COVID diagnosis.

METHODS

This was a retrospective case-control study including 31 health systems in the United States from the National COVID Cohort Collaborative (N3C). 8,325 individuals with PASC (defined by the presence of the International Classification of Diseases, version 10 code U09.9 or a long-COVID clinic visit) matched to 41,625 controls within the same health system and COVID index date within ± 45 days of the corresponding case's earliest COVID index date. Measurements of risk factors included demographics, comorbidities, treatment and acute characteristics related to COVID-19. Multivariable logistic regression, random forest, and XGBoost were used to determine the associations between risk factors and PASC.

RESULTS

Among 8,325 individuals with PASC, the majority were > 50 years of age (56.6%), female (62.8%), and non-Hispanic White (68.6%). In logistic regression, middle-age categories (40 to 69 years; OR ranging from 2.32 to 2.58), female sex (OR 1.4, 95% CI 1.33-1.48), hospitalization associated with COVID-19 (OR 3.8, 95% CI 3.05-4.73), long (8-30 days, OR 1.69, 95% CI 1.31-2.17) or extended hospital stay (30 + days, OR 3.38, 95% CI 2.45-4.67), receipt of mechanical ventilation (OR 1.44, 95% CI 1.18-1.74), and several comorbidities including depression (OR 1.50, 95% CI 1.40-1.60), chronic lung disease (OR 1.63, 95% CI 1.53-1.74), and obesity (OR 1.23, 95% CI 1.16-1.3) were associated with increased likelihood of PASC diagnosis or care at a long-COVID clinic. Characteristics associated with a lower likelihood of PASC diagnosis or care at a long-COVID clinic included younger age (18 to 29 years), male sex, non-Hispanic Black race, and comorbidities such as substance abuse, cardiomyopathy, psychosis, and dementia. More doctors per capita in the county of residence was associated with an increased likelihood of PASC diagnosis or care at a long-COVID clinic. Our findings were consistent in sensitivity analyses using a variety of analytic techniques and approaches to select controls.

CONCLUSIONS

This national study identified important risk factors for PASC diagnosis such as middle age, severe COVID-19 disease, and specific comorbidities. Further clinical and epidemiological research is needed to better understand underlying mechanisms and the potential role of vaccines and therapeutics in altering PASC course.

Risk of post-acute sequelae of SARS-CoV-2 infection associated with pre-coronavirus disease obstructive sleep apnea diagnoses: an electronic health record-based analysis from the RECOVER initiative

STUDY OBJECTIVES

Obstructive sleep apnea (OSA) has been associated with more severe acute coronavirus disease-2019 (COVID-19) outcomes. We assessed OSA as a potential risk factor for Post-Acute Sequelae of SARS-CoV-2 (PASC).

METHODS

We assessed the impact of preexisting OSA on the risk for probable PASC in adults and children using electronic health record data from multiple research networks. Three research networks within the REsearching COVID to Enhance Recovery initiative (PCORnet Adult, PCORnet Pediatric, and the National COVID Cohort Collaborative [N3C]) employed a harmonized analytic approach to examine the risk of probable PASC in COVID-19-positive patients with and without a diagnosis of OSA prior to pandemic onset. Unadjusted odds ratios (ORs) were calculated as well as ORs adjusted for age group, sex, race/ethnicity, hospitalization status, obesity, and preexisting comorbidities.

RESULTS

Across networks, the unadjusted OR for probable PASC associated with a preexisting OSA diagnosis in adults and children ranged from 1.41 to 3.93. Adjusted analyses found an attenuated association that remained significant among adults only. Multiple sensitivity analyses with expanded inclusion criteria and covariates yielded results consistent with the primary analysis.

CONCLUSIONS

Adults with preexisting OSA were found to have significantly elevated odds of probable PASC. This finding was consistent across data sources, approaches for identifying COVID-19-positive patients, and definitions of PASC. Patients with OSA may be at elevated risk for PASC after SARS-CoV-2 infection and should be monitored for post-acute sequelae.

Coding long COVID: characterizing a new disease through an ICD-10 lens

BACKGROUND

Naming a newly discovered disease is a difficult process; in the context of the COVID-19 pandemic and the existence of post-acute sequelae of SARS-CoV-2 infection (PASC), which includes long COVID, it has proven especially challenging. Disease definitions and assignment of a diagnosis code are often asynchronous and iterative. The clinical definition and our understanding of the underlying mechanisms of long COVID are still in flux, and the deployment of an ICD-10-CM code for long COVID in the USA took nearly 2 years after patients had begun to describe their condition. Here, we leverage the largest publicly available HIPAA-limited dataset about patients with COVID-19 in the US to examine the heterogeneity of adoption and use of U09.9, the ICD-10-CM code for "Post COVID-19 condition, unspecified."

METHODS

We undertook a number of analyses to characterize the N3C population with a U09.9 diagnosis code (n = 33,782), including assessing person-level demographics and a number of area-level social determinants of health; diagnoses commonly co-occurring with U09.9, clustered using the Louvain algorithm; and quantifying medications and procedures recorded within 60 days of U09.9 diagnosis. We stratified all analyses by age group in order to discern differing patterns of care across the lifespan.

RESULTS

We established the diagnoses most commonly co-occurring with U09.9 and algorithmically clustered them into four major categories: cardiopulmonary, neurological, gastrointestinal, and comorbid conditions. Importantly, we discovered that the population of patients diagnosed with U09.9 is demographically skewed toward female, White, non-Hispanic individuals, as well as individuals living in areas with low poverty and low unemployment. Our results also include a characterization of common procedures and medications associated with U09.9-coded patients.

CONCLUSIONS

This work offers insight into potential subtypes and current practice patterns around long COVID and speaks to the existence of disparities in the diagnosis of patients with long COVID. This latter finding in particular requires further research and urgent remediation.

SARS-CoV-2 Reinfection is Preceded by Unique Biomarkers and Related to Initial Infection Timing and Severity: an N3C RECOVER EHR-Based Cohort Study

Although the COVID-19 pandemic has persisted for over 2 years, reinfections with SARS-CoV-2 are not well understood. We use the electronic health record (EHR)-based study cohort from the National COVID Cohort Collaborative (N3C) as part of the NIH Researching COVID to Enhance Recovery (RECOVER) Initiative to characterize reinfection, understand development of Long COVID after reinfection, and compare severity of reinfection with initial infection. We validate previous findings of reinfection incidence (5.9%), the occurrence of most reinfections during the Omicron epoch, and evidence of multiple reinfections. We present novel findings that Long COVID diagnoses occur closer to the index date for infection or reinfection in the Omicron BA epoch. We report lower albumin levels leading up to reinfection and a statistically significant association of severity between first infection and reinfection (chi-squared value: 9446.2, p-value: 0) with a medium effect size (Cramer's V: 0.18, DoF = 4).

Vital Measurements of Hospitalized COVID-19 Patients as a Predictor of Long COVID: An EHR-based Cohort Study from the RECOVER Program in N3C

It is shown that various symptoms could remain in the stage of post-acute sequelae of SARS-CoV-2 infection (PASC), otherwise known as Long COVID. A number of COVID patients suffer from heterogeneous symptoms, which severely impact recovery from the pandemic. While scientists are trying to give an unambiguous definition of Long COVID, efforts in prediction of Long COVID could play an important role in understanding the characteristic of this new disease. Vital measurements (e.g. oxygen saturation, heart rate, blood pressure) could reflect body's most basic functions and are measured regularly during hospitalization, so among patients diagnosed COVID positive and hospitalized, we analyze the vital measurements of first 7 days since the hospitalization start date to study the pattern of the vital measurements and predict Long COVID with the information from vital measurements.

The impact of COVID-19 on clinical outcomes among acute myocardial infarction patients undergoing early invasive treatment strategy

BACKGROUND

The implications of coronavirus disease 2019 (COVID-19) infection on outcomes after invasive therapeutic strategies among patients presenting with acute myocardial infarction (AMI) are not well studied.

HYPOTHESIS

To assess the outcomes of COVID-19 patients presenting with AMI undergoing an early invasive treatment strategy.

METHODS

This study was a cross-sectional, retrospective analysis of the National COVID Cohort Collaborative database including all patients presenting with a recorded diagnosis of AMI (ST-elevation myocardial infarction (MI) and non-ST elevation MI). COVID-19 positive patients with AMI were stratified into one of four groups: (1a) patients who had a coronary angiogram with percutaneous coronary intervention (PCI) within 3 days of their AMI; (1b) PCI within 3 days of AMI with coronary artery bypass graft (CABG) within 30 days; (2a) coronary angiogram without PCI and without CABG within 30 days; and (2b) coronary angiogram with CABG within 30 days. The main outcomes were respiratory failure, cardiogenic shock, prolonged length of stay, rehospitalization, and death.

RESULTS

There were 10 506 COVID-19 positive patients with a diagnosis of AMI. COVID-19 positive patients with PCI had 8.2 times higher odds of respiratory failure than COVID-19 negative patients (p = .001). The odds of prolonged length of stay were 1.7 times higher in COVID-19 patients who underwent PCI (p = .024) and 1.9 times higher in patients who underwent coronary angiogram followed by CABG (p = .001).

CONCLUSION

These data demonstrate that COVID-19 positive patients with AMI undergoing early invasive coronary angiography had worse outcomes than COVID-19 negative patients.

Coding Long COVID: Characterizing a new disease through an ICD-10 lens

Background

Naming a newly discovered disease is a difficult process; in the context of the COVID-19 pandemic and the existence of post-acute sequelae of SARS-CoV-2 infection (PASC), which includes Long COVID, it has proven especially challenging. Disease definitions and assignment of a diagnosis code are often asynchronous and iterative. The clinical definition and our understanding of the underlying mechanisms of Long COVID are still in flux, and the deployment of an ICD-10-CM code for Long COVID in the US took nearly two years after patients had begun to describe their condition. Here we leverage the largest publicly available HIPAA-limited dataset about patients with COVID-19 in the US to examine the heterogeneity of adoption and use of U09.9, the ICD-10-CM code for "Post COVID-19 condition, unspecified."

Methods

We undertook a number of analyses to characterize the N3C population with a U09.9 diagnosis code ( n = 21,072), including assessing person-level demographics and a number of area-level social determinants of health; diagnoses commonly co-occurring with U09.9, clustered using the Louvain algorithm; and quantifying medications and procedures recorded within 60 days of U09.9 diagnosis. We stratified all analyses by age group in order to discern differing patterns of care across the lifespan.

Results

We established the diagnoses most commonly co-occurring with U09.9, and algorithmically clustered them into four major categories: cardiopulmonary, neurological, gastrointestinal, and comorbid conditions. Importantly, we discovered that the population of patients diagnosed with U09.9 is demographically skewed toward female, White, non-Hispanic individuals, as well as individuals living in areas with low poverty, high education, and high access to medical care. Our results also include a characterization of common procedures and medications associated with U09.9-coded patients.

Conclusions

This work offers insight into potential subtypes and current practice patterns around Long COVID, and speaks to the existence of disparities in the diagnosis of patients with Long COVID. This latter finding in particular requires further research and urgent remediation.

Risk Factors Associated with Post-Acute Sequelae of SARS-CoV-2 in an EHR Cohort: A National COVID Cohort Collaborative (N3C) Analysis as part of the NIH RECOVER program

Background

More than one-third of individuals experience post-acute sequelae of SARS-CoV-2 infection (PASC, which includes long-COVID).

Objective

To identify risk factors associated with PASC/long-COVID.

Design

Retrospective case-control study.

Setting

31 health systems in the United States from the National COVID Cohort Collaborative (N3C).

Patients

8,325 individuals with PASC (defined by the presence of the International Classification of Diseases, version 10 code U09.9 or a long-COVID clinic visit) matched to 41,625 controls within the same health system.

Measurements

Risk factors included demographics, comorbidities, and treatment and acute characteristics related to COVID-19. Multivariable logistic regression, random forest, and XGBoost were used to determine the associations between risk factors and PASC.

Results

Among 8,325 individuals with PASC, the majority were >50 years of age (56.6%), female (62.8%), and non-Hispanic White (68.6%). In logistic regression, middle-age categories (40 to 69 years; OR ranging from 2.32 to 2.58), female sex (OR 1.4, 95% CI 1.33-1.48), hospitalization associated with COVID-19 (OR 3.8, 95% CI 3.05-4.73), long (8-30 days, OR 1.69, 95% CI 1.31-2.17) or extended hospital stay (30+ days, OR 3.38, 95% CI 2.45-4.67), receipt of mechanical ventilation (OR 1.44, 95% CI 1.18-1.74), and several comorbidities including depression (OR 1.50, 95% CI 1.40-1.60), chronic lung disease (OR 1.63, 95% CI 1.53-1.74), and obesity (OR 1.23, 95% CI 1.16-1.3) were associated with increased likelihood of PASC diagnosis or care at a long-COVID clinic. Characteristics associated with a lower likelihood of PASC diagnosis or care at a long-COVID clinic included younger age (18 to 29 years), male sex, non-Hispanic Black race, and comorbidities such as substance abuse, cardiomyopathy, psychosis, and dementia. More doctors per capita in the county of residence was associated with an increased likelihood of PASC diagnosis or care at a long-COVID clinic. Our findings were consistent in sensitivity analyses using a variety of analytic techniques and approaches to select controls.

Conclusions

This national study identified important risk factors for PASC such as middle age, severe COVID-19 disease, and specific comorbidities. Further clinical and epidemiological research is needed to better understand underlying mechanisms and the potential role of vaccines and therapeutics in altering PASC course.

Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative

OBJECTIVE

In response to COVID-19, the informatics community united to aggregate as much clinical data as possible to characterize this new disease and reduce its impact through collaborative analytics. The National COVID Cohort Collaborative (N3C) is now the largest publicly available HIPAA limited dataset in US history with over 6.4 million patients and is a testament to a partnership of over 100 organizations.

MATERIALS AND METHODS

We developed a pipeline for ingesting, harmonizing, and centralizing data from 56 contributing data partners using 4 federated Common Data Models. N3C data quality (DQ) review involves both automated and manual procedures. In the process, several DQ heuristics were discovered in our centralized context, both within the pipeline and during downstream project-based analysis. Feedback to the sites led to many local and centralized DQ improvements.

RESULTS

Beyond well-recognized DQ findings, we discovered 15 heuristics relating to source Common Data Model conformance, demographics, COVID tests, conditions, encounters, measurements, observations, coding completeness, and fitness for use. Of 56 sites, 37 sites (66%) demonstrated issues through these heuristics. These 37 sites demonstrated improvement after receiving feedback.

DISCUSSION

We encountered site-to-site differences in DQ which would have been challenging to discover using federated checks alone. We have demonstrated that centralized DQ benchmarking reveals unique opportunities for DQ improvement that will support improved research analytics locally and in aggregate.

CONCLUSION

By combining rapid, continual assessment of DQ with a large volume of multisite data, it is possible to support more nuanced scientific questions with the scale and rigor that they require.

Tumor pharmacokinetics and pharmacodynamics of the CDK4/6 inhibitor ribociclib in patients with recurrent glioblastoma

INTRODUCTION

We conducted a phase Ib study (NCT02345824) to determine whether ribociclib, an inhibitor of cyclin-dependent kinases 4 and 6 (CDK4/6), penetrates tumor tissue and modulates downstream signaling pathways including retinoblastoma protein (Rb) in patients with recurrent glioblastoma (GBM).

METHODS

Study participants received ribociclib (600 mg QD) for 8-21 days before surgical resection of their recurrent GBM. Total and unbound concentrations of ribociclib were measured in samples of tumor tissue, plasma, and cerebrospinal fluid (CSF). We analyzed tumor specimens obtained from the first (initial/pre-study) and second (recurrent/on-study) surgery by immunohistochemistry for Rb status and downstream signaling of CDK4/6 inhibition. Participants with Rb-positive recurrent tumors continued ribociclib treatment on a 21-day-on, 7-day-off schedule after surgery, and were monitored for toxicity and disease progression.

RESULTS

Three participants with recurrent Rb-positive GBM participated in this study. Mean unbound (pharmacologically active) ribociclib concentrations in plasma, CSF, MRI-enhancing, MRI-non-enhancing, and tumor core regions were 0.337 μM, 0.632 μM, 1.242 nmol/g, 0.484 nmol/g, and 1.526 nmol/g, respectively, which exceeded the in vitro IC₅₀ (0.04 μM) for inhibition of CDK4/6 in cell-free assay. Modulation of pharmacodynamic markers of ribociclib CDK 4/6 inhibition in tumor tissues were inconsistent between study participants. No participants experienced serious adverse events, but all experienced early disease progression.

CONCLUSIONS

This study suggests that ribociclib penetrated recurrent GBM tissue at concentrations predicted to be therapeutically beneficial. Our study was unable to demonstrate tumor pharmacodynamic correlates of drug activity. Although well tolerated, ribociclib monotherapy seemed ineffective for the treatment of recurrent GBM.

A pilot study of focused ultrasound thalamotomy for essential tremor

BACKGROUND

Recent advances have enabled delivery of high-intensity focused ultrasound through the intact human cranium with magnetic resonance imaging (MRI) guidance. This preliminary study investigates the use of transcranial MRI-guided focused ultrasound thalamotomy for the treatment of essential tremor.

METHODS

From February 2011 through December 2011, in an open-label, uncontrolled study, we used transcranial MRI-guided focused ultrasound to target the unilateral ventral intermediate nucleus of the thalamus in 15 patients with severe, medication-refractory essential tremor. We recorded all safety data and measured the effectiveness of tremor suppression using the Clinical Rating Scale for Tremor to calculate the total score (ranging from 0 to 160), hand subscore (primary outcome, ranging from 0 to 32), and disability subscore (ranging from 0 to 32), with higher scores indicating worse tremor. We assessed the patients' perceptions of treatment efficacy with the Quality of Life in Essential Tremor Questionnaire (ranging from 0 to 100%, with higher scores indicating greater perceived disability).

RESULTS

Thermal ablation of the thalamic target occurred in all patients. Adverse effects of the procedure included transient sensory, cerebellar, motor, and speech abnormalities, with persistent paresthesias in four patients. Scores for hand tremor improved from 20.4 at baseline to 5.2 at 12 months (P=0.001). Total tremor scores improved from 54.9 to 24.3 (P=0.001). Disability scores improved from 18.2 to 2.8 (P=0.001). Quality-of-life scores improved from 37% to 11% (P=0.001).

CONCLUSIONS

In this pilot study, essential tremor improved in 15 patients treated with MRI-guided focused ultrasound thalamotomy. Large, randomized, controlled trials will be required to assess the procedure's efficacy and safety. (Funded by the Focused Ultrasound Surgery Foundation; ClinicalTrials.gov number, NCT01304758.).