Association of Premorbid GLP-1RA and SGLT-2i Prescription Alone and in Combination with COVID-19 Severity

INTRODUCTION

People with type 2 diabetes are at heightened risk for severe outcomes related to COVID-19 infection, including hospitalization, intensive care unit admission, and mortality. This study was designed to examine the impact of premorbid use of glucagon-like peptide-1 receptor agonist (GLP-1RA) monotherapy, sodium-glucose cotransporter-2 inhibitor (SGLT-2i) monotherapy, and concomitant GLP1-RA/SGLT-2i therapy on the severity of outcomes in individuals with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection.

METHODS

Utilizing observational data from the National COVID Cohort Collaborative through September 2022, we compared outcomes in 78,806 individuals with a prescription of GLP-1RA and SGLT-2i versus a prescription of dipeptidyl peptidase 4 inhibitors (DPP-4i) within 24 months of a positive SARS-CoV-2 PCR test. We also compared concomitant GLP-1RA/SGLT-2i therapy to GLP-1RA and SGLT-2i monotherapy. The primary outcome was 60-day mortality, measured from the positive test date. Secondary outcomes included emergency room (ER) visits, hospitalization, and mechanical ventilation within 14 days. Using a super learner approach and accounting for baseline characteristics, associations were quantified with odds ratios (OR) estimated with targeted maximum likelihood estimation (TMLE).

RESULTS

Use of GLP-1RA (OR 0.64, 95% confidence interval [CI] 0.56-0.72) and SGLT-2i (OR 0.62, 95% CI 0.57-0.68) were associated with lower odds of 60-day mortality compared to DPP-4i use. Additionally, the OR of ER visits and hospitalizations were similarly reduced with GLP1-RA and SGLT-2i use. Concomitant GLP-1RA/SGLT-2i use showed similar odds of 60-day mortality when compared to GLP-1RA or SGLT-2i use alone (OR 0.92, 95% CI 0.81-1.05 and OR 0.88, 95% CI 0.76-1.01, respectively). However, lower OR of all secondary outcomes were associated with concomitant GLP-1RA/SGLT-2i use when compared to SGLT-2i use alone.

CONCLUSION

Among adults who tested positive for SARS-CoV-2, premorbid use of either GLP-1RA or SGLT-2i is associated with lower odds of mortality compared to DPP-4i. Furthermore, concomitant use of GLP-1RA and SGLT-2i is linked to lower odds of other severe COVID-19 outcomes, including ER visits, hospitalizations, and mechanical ventilation, compared to SGLT-2i use alone. Graphical abstract available for this article.

EFFECT OF PAXLOVID TREATMENT DURING ACUTE COVID-19 ON LONG COVID ONSET: AN EHR-BASED TARGET TRIAL EMULATION FROM THE N3C AND RECOVER CONSORTIA

Preventing and treating post-acute sequelae of SARS-CoV-2 infection (PASC), commonly known as Long COVID, has become a public health priority. In this study, we examined whether treatment with Paxlovid in the acute phase of COVID-19 helps prevent the onset of PASC. We used electronic health records from the National Covid Cohort Collaborative (N3C) to define a cohort of 426,352 patients who had COVID-19 since April 1, 2022, and were eligible for Paxlovid treatment due to risk for progression to severe COVID-19. We used the target trial emulation (TTE) framework to estimate the effect of Paxlovid treatment on PASC incidence. We estimated overall PASC incidence using a computable phenotype. We also measured the onset of novel cognitive, fatigue, and respiratory symptoms in the post-acute period. Paxlovid treatment did not have a significant effect on overall PASC incidence (relative risk [RR] = 0.98, 95% confidence interval [CI] 0.95-1.01). However, it had a protective effect on cognitive (RR = 0.90, 95% CI 0.84-0.96) and fatigue (RR = 0.95, 95% CI 0.91-0.98) symptom clusters, which suggests that the etiology of these symptoms may be more closely related to viral load than that of respiratory symptoms.

Effectiveness of mRNA Booster Vaccine Against Coronavirus Disease 2019 Infection and Severe Outcomes Among Persons With and Without Immune Dysfunction: A Retrospective Cohort Study of National Electronic Medical Record Data in the United States

Background

Real-world evidence of coronavirus disease 2019 (COVID-19) messenger RNA (mRNA) booster effectiveness among patients with immune dysfunction are limited.

Methods

We included data from patients in the United States National COVID Cohort Collaborative (N3C) who completed ≥2 doses of mRNA vaccination between 10 December 2020 and 27 May 2022. Immune dysfunction conditions included human immunodeficiency virus infection, solid organ or bone marrow transplant, autoimmune diseases, and cancer. We defined incident COVID-19 BTI as positive results from laboratory tests or diagnostic codes 14 days after at least 2 doses of mRNA vaccination; and severe COVID-19 BTI as hospitalization, invasive cardiopulmonary support, and/or death. We used propensity scores to match boosted versus nonboosted patients and evaluated hazards of incident and severe COVID-19 BTI using Cox regression after matching.

Results

Among patients without immune dysfunction, the relative effectiveness of booster (3 doses) after 6 months from the primary (2 doses) vaccination against BTI ranged from 69% to 81% during the Delta-predominant period and from 33% to 39% during the Omicron-predominant period. Relative effectiveness against BTI was lower among patients with immune dysfunction but remained statistically significant in both periods. Boosted patients had lower risk of COVID-19-related hospitalization (hazard ratios [HR] ranged from 0.5 [95% confidence interval {CI}, .48-.53] to 0.63 [95% CI, .56-.70]), invasive cardiopulmonary support, or death (HRs ranged from 0.46 [95% CI, .41-.52] to 0.63 [95% CI, .50-.79]) during both periods.

Conclusions

Booster vaccines remain effective against severe COVID-19 BTI throughout the Delta- and Omicron-predominant periods, regardless of patients' immune status.

The Science of Precision Prevention: Research Opportunities and Clinical Applications to Reduce Cardiovascular Health Disparities

Precision prevention embraces personalized prevention but includes broader factors such as social determinants of health to improve cardiovascular health. The quality, quantity, precision, and diversity of data relatable to individuals and communities continue to expand. New analytical methods can be applied to these data to create tools to attribute risk, which may allow a better understanding of cardiovascular health disparities. Interventions using these analytic tools should be evaluated to establish feasibility and efficacy for addressing cardiovascular disease disparities in diverse individuals and communities. Training in these approaches is important to create the next generation of scientists and practitioners in precision prevention. This state-of-the-art review is based on a workshop convened to identify current gaps in knowledge and methods used in precision prevention intervention research, discuss opportunities to expand trials of implementation science to close the health equity gaps, and expand the education and training of a diverse precision prevention workforce.

COVID-19 outcomes in persons with hemophilia: results from a US-based national COVID-19 surveillance registry

BACKGROUND

Hypercoagulable state contributing to thrombotic complications worsens COVID-19 severity and outcomes, whereas anticoagulation improves outcomes by alleviating hypercoagulability.

OBJECTIVES

To examine whether hemophilia, an inherent hypocoagulable condition, offers protection against COVID-19 severity and reduces venous thromboembolism (VTE) risk in persons with hemophilia (PwH).

METHODS

A 1:3 propensity score-matched retrospective cohort study used national COVID-19 registry data (January 2020 through January 2022) to compare outcomes between 300 male PwH and 900 matched controls without hemophilia.

RESULTS

Analyses of PwH demonstrated that known risk factors (older age, heart failure, hypertension, cancer/malignancy, dementia, and renal and liver disease) contributed to severe COVID-19 and/or 30-day all-cause mortality. Non-central nervous system bleeding was an additional risk factor for poor outcomes in PwH. Odds of developing VTE with COVID-19 in PwH were associated with pre-COVID VTE diagnosis (odds ratio [OR], 51.9; 95% CI, 12.8-266; p < .001), anticoagulation therapy (OR, 12.7; 95% CI, 3.01-48.6; p < .001), and pulmonary disease (OR, 16.1; 95% CI, 10.4-25.4; p < .001). Thirty-day all-cause mortality (OR, 1.27; 95% CI, 0.75-2.11; p = .3) and VTE events (OR, 1.32; 95% CI, 0.64-2.73; p = .4) were not significantly different between the matched cohorts; however, hospitalizations (OR, 1.58; 95% CI, 1.20-2.10; p = .001) and non-central nervous system bleeding events (OR, 4.78; 95% CI, 2.98-7.48; p < .001) were increased in PwH. In multivariate analyses, hemophilia did not reduce adverse outcomes (OR, 1.32; 95% CI, 0.74-2.31; p = .2) or VTE (OR, 1.14; 95% CI, 0.44-2.67; p = .8) but increased bleeding risk (OR, 4.70; 95% CI, 2.98-7.48; p < .001).

CONCLUSION

After adjusting for patient characteristics/comorbidities, hemophilia increased bleeding risk with COVID-19 but did not protect against severe disease and VTE.

Outcomes of SARS-CoV-2 infection among patients with orthopaedic fracture surgery in the National COVID Cohort Collaborative (N3C)

BACKGROUND

The objective of this study was to investigate the outcomes of COVID-19-positive patients undergoing orthopaedic fracture surgery using data from a national database of U.S. adults with a COVID-19 test for SARS-CoV-2.

METHODS

This is a retrospective cohort study using data from a national database to compare orthopaedic fracture surgery outcomes between COVID-19-positive and COVID-19-negative patients in the United States. Participants aged 18-99 with orthopaedic fracture surgery between March and December 2020 were included. The main exposure was COVID-19 status. Outcomes included perioperative complications, 30-day all-cause mortality, and overall all-cause mortality. Multivariable adjusted models were fitted to determine the association of COVID-positivity with all-cause mortality.

RESULTS

The total population of 6.5 million patient records was queried, identifying 76,697 participants with a fracture. There were 7,628 participants in the National COVID Cohort who had a fracture and operative management. The Charlson Comorbidity Index was higher in the COVID-19-positive group (n = 476, 6.2 %) than the COVID-19-negative group (n = 7,152, 93.8 %) (2.2 vs 1.4, p<0.001). The COVID-19-positive group had higher mortality (13.2 % vs 5.2 %, p<0.001) than the COVID-19-negative group with higher odds of death in the fully adjusted model (Odds Ratio=1.59; 95 % Confidence Interval: 1.16-2.18).

CONCLUSION

COVID-19-positive participants with a fracture requiring surgery had higher mortality and perioperative complications than COVID-19-negative patients in this national cohort of U.S. adults tested for COVID-19. The risks associated with COVID-19 can guide potential treatment options and counseling of patients and their families. Future studies can be conducted as data accumulates.

LEVEL OF EVIDENCE

Level III.

An open natural language processing (NLP) framework for EHR-based clinical research: a case demonstration using the National COVID Cohort Collaborative (N3C)

Despite recent methodology advancements in clinical natural language processing (NLP), the adoption of clinical NLP models within the translational research community remains hindered by process heterogeneity and human factor variations. Concurrently, these factors also dramatically increase the difficulty in developing NLP models in multi-site settings, which is necessary for algorithm robustness and generalizability. Here, we reported on our experience developing an NLP solution for Coronavirus Disease 2019 (COVID-19) signs and symptom extraction in an open NLP framework from a subset of sites participating in the National COVID Cohort (N3C). We then empirically highlight the benefits of multi-site data for both symbolic and statistical methods, as well as highlight the need for federated annotation and evaluation to resolve several pitfalls encountered in the course of these efforts.

The N3C governance ecosystem: A model socio-technical partnership for the future of collaborative analytics at scale

The National COVID Cohort Collaborative (N3C) is a public-private-government partnership established during the Coronavirus pandemic to create a centralized data resource called the "N3C data enclave." This resource contains individual-level health data from participating healthcare sites nationwide to support rapid collaborative analytics. N3C has enabled analytics within a cloud-based enclave of data from electronic health records from over 17 million people (with and without COVID-19) in the USA. To achieve this goal of a shared data resource, N3C implemented a shared governance strategy involving stakeholders in decision-making. The approach leveraged best practices in data stewardship and team science to rapidly enable COVID-19-related research at scale while respecting the privacy of data subjects and participating institutions. N3C balanced equitable access to data, team-based scientific productivity, and individual professional recognition - a key incentive for academic researchers. This governance approach makes N3C research sustainable and effective beyond the initial days of the pandemic. N3C demonstrated that shared governance can overcome traditional barriers to data sharing without compromising data security and trust. The governance innovations described herein are a helpful framework for other privacy-preserving data infrastructure programs and provide a working model for effective team science beyond COVID-19.

Risk factors associated with post-acute sequelae of SARS-CoV-2: an N3C and NIH RECOVER study

BACKGROUND

More than one-third of individuals experience post-acute sequelae of SARS-CoV-2 infection (PASC, which includes long-COVID). The objective is to identify risk factors associated with PASC/long-COVID diagnosis.

METHODS

This was a retrospective case-control study including 31 health systems in the United States from the National COVID Cohort Collaborative (N3C). 8,325 individuals with PASC (defined by the presence of the International Classification of Diseases, version 10 code U09.9 or a long-COVID clinic visit) matched to 41,625 controls within the same health system and COVID index date within ± 45 days of the corresponding case's earliest COVID index date. Measurements of risk factors included demographics, comorbidities, treatment and acute characteristics related to COVID-19. Multivariable logistic regression, random forest, and XGBoost were used to determine the associations between risk factors and PASC.

RESULTS

Among 8,325 individuals with PASC, the majority were > 50 years of age (56.6%), female (62.8%), and non-Hispanic White (68.6%). In logistic regression, middle-age categories (40 to 69 years; OR ranging from 2.32 to 2.58), female sex (OR 1.4, 95% CI 1.33-1.48), hospitalization associated with COVID-19 (OR 3.8, 95% CI 3.05-4.73), long (8-30 days, OR 1.69, 95% CI 1.31-2.17) or extended hospital stay (30 + days, OR 3.38, 95% CI 2.45-4.67), receipt of mechanical ventilation (OR 1.44, 95% CI 1.18-1.74), and several comorbidities including depression (OR 1.50, 95% CI 1.40-1.60), chronic lung disease (OR 1.63, 95% CI 1.53-1.74), and obesity (OR 1.23, 95% CI 1.16-1.3) were associated with increased likelihood of PASC diagnosis or care at a long-COVID clinic. Characteristics associated with a lower likelihood of PASC diagnosis or care at a long-COVID clinic included younger age (18 to 29 years), male sex, non-Hispanic Black race, and comorbidities such as substance abuse, cardiomyopathy, psychosis, and dementia. More doctors per capita in the county of residence was associated with an increased likelihood of PASC diagnosis or care at a long-COVID clinic. Our findings were consistent in sensitivity analyses using a variety of analytic techniques and approaches to select controls.

CONCLUSIONS

This national study identified important risk factors for PASC diagnosis such as middle age, severe COVID-19 disease, and specific comorbidities. Further clinical and epidemiological research is needed to better understand underlying mechanisms and the potential role of vaccines and therapeutics in altering PASC course.

Risk of post-acute sequelae of SARS-CoV-2 infection associated with pre-coronavirus disease obstructive sleep apnea diagnoses: an electronic health record-based analysis from the RECOVER initiative

STUDY OBJECTIVES

Obstructive sleep apnea (OSA) has been associated with more severe acute coronavirus disease-2019 (COVID-19) outcomes. We assessed OSA as a potential risk factor for Post-Acute Sequelae of SARS-CoV-2 (PASC).

METHODS

We assessed the impact of preexisting OSA on the risk for probable PASC in adults and children using electronic health record data from multiple research networks. Three research networks within the REsearching COVID to Enhance Recovery initiative (PCORnet Adult, PCORnet Pediatric, and the National COVID Cohort Collaborative [N3C]) employed a harmonized analytic approach to examine the risk of probable PASC in COVID-19-positive patients with and without a diagnosis of OSA prior to pandemic onset. Unadjusted odds ratios (ORs) were calculated as well as ORs adjusted for age group, sex, race/ethnicity, hospitalization status, obesity, and preexisting comorbidities.

RESULTS

Across networks, the unadjusted OR for probable PASC associated with a preexisting OSA diagnosis in adults and children ranged from 1.41 to 3.93. Adjusted analyses found an attenuated association that remained significant among adults only. Multiple sensitivity analyses with expanded inclusion criteria and covariates yielded results consistent with the primary analysis.

CONCLUSIONS

Adults with preexisting OSA were found to have significantly elevated odds of probable PASC. This finding was consistent across data sources, approaches for identifying COVID-19-positive patients, and definitions of PASC. Patients with OSA may be at elevated risk for PASC after SARS-CoV-2 infection and should be monitored for post-acute sequelae.

De-black-boxing health AI: demonstrating reproducible machine learning computable phenotypes using the N3C-RECOVER Long COVID model in the All of Us data repository

Machine learning (ML)-driven computable phenotypes are among the most challenging to share and reproduce. Despite this difficulty, the urgent public health considerations around Long COVID make it especially important to ensure the rigor and reproducibility of Long COVID phenotyping algorithms such that they can be made available to a broad audience of researchers. As part of the NIH Researching COVID to Enhance Recovery (RECOVER) Initiative, researchers with the National COVID Cohort Collaborative (N3C) devised and trained an ML-based phenotype to identify patients highly probable to have Long COVID. Supported by RECOVER, N3C and NIH's All of Us study partnered to reproduce the output of N3C's trained model in the All of Us data enclave, demonstrating model extensibility in multiple environments. This case study in ML-based phenotype reuse illustrates how open-source software best practices and cross-site collaboration can de-black-box phenotyping algorithms, prevent unnecessary rework, and promote open science in informatics.

Long COVID risk and pre-COVID vaccination in an EHR-based cohort study from the RECOVER program

Long COVID, or complications arising from COVID-19 weeks after infection, has become a central concern for public health experts. The United States National Institutes of Health founded the RECOVER initiative to better understand long COVID. We used electronic health records available through the National COVID Cohort Collaborative to characterize the association between SARS-CoV-2 vaccination and long COVID diagnosis. Among patients with a COVID-19 infection between August 1, 2021 and January 31, 2022, we defined two cohorts using distinct definitions of long COVID-a clinical diagnosis (n = 47,404) or a previously described computational phenotype (n = 198,514)-to compare unvaccinated individuals to those with a complete vaccine series prior to infection. Evidence of long COVID was monitored through June or July of 2022, depending on patients' data availability. We found that vaccination was consistently associated with lower odds and rates of long COVID clinical diagnosis and high-confidence computationally derived diagnosis after adjusting for sex, demographics, and medical history.

Clinical encounter heterogeneity and methods for resolving in networked EHR data: a study from N3C and RECOVER programs

OBJECTIVE

Clinical encounter data are heterogeneous and vary greatly from institution to institution. These problems of variance affect interpretability and usability of clinical encounter data for analysis. These problems are magnified when multisite electronic health record (EHR) data are networked together. This article presents a novel, generalizable method for resolving encounter heterogeneity for analysis by combining related atomic encounters into composite "macrovisits."

MATERIALS AND METHODS

Encounters were composed of data from 75 partner sites harmonized to a common data model as part of the NIH Researching COVID to Enhance Recovery Initiative, a project of the National Covid Cohort Collaborative. Summary statistics were computed for overall and site-level data to assess issues and identify modifications. Two algorithms were developed to refine atomic encounters into cleaner, analyzable longitudinal clinical visits.

RESULTS

Atomic inpatient encounters data were found to be widely disparate between sites in terms of length-of-stay (LOS) and numbers of OMOP CDM measurements per encounter. After aggregating encounters to macrovisits, LOS and measurement variance decreased. A subsequent algorithm to identify hospitalized macrovisits further reduced data variability.

DISCUSSION

Encounters are a complex and heterogeneous component of EHR data and native data issues are not addressed by existing methods. These types of complex and poorly studied issues contribute to the difficulty of deriving value from EHR data, and these types of foundational, large-scale explorations, and developments are necessary to realize the full potential of modern real-world data.

CONCLUSION

This article presents method developments to manipulate and resolve EHR encounter data issues in a generalizable way as a foundation for future research and analysis.

Effect of Nirmatrelvir/Ritonavir (Paxlovid) on Hospitalization among Adults with COVID-19: an EHR-based Target Trial Emulation from N3C

This study leverages electronic health record data in the National COVID Cohort Collaborative's (N3C) repository to investigate disparities in Paxlovid treatment and to emulate a target trial assessing its effectiveness in reducing COVID-19 hospitalization rates. From an eligible population of 632,822 COVID-19 patients seen at 33 clinical sites across the United States between December 23, 2021 and December 31, 2022, patients were matched across observed treatment groups, yielding an analytical sample of 410,642 patients. We estimate a 65% reduced odds of hospitalization among Paxlovid-treated patients within a 28-day follow-up period, and this effect did not vary by patient vaccination status. Notably, we observe disparities in Paxlovid treatment, with lower rates among Black and Hispanic or Latino patients, and within socially vulnerable communities. Ours is the largest study of Paxlovid's real-world effectiveness to date, and our primary findings are consistent with previous randomized control trials and real-world studies.

ICD-11: A catalyst for advancing patient safety surveillance globally

The World Health Organization's (WHO) international classification of disease version 11 (ICD-11) contains several features which enable improved classification of patient safety events. We have identified three suggestions to facilitate adoption of ICD-11 from the patient safety perspective. One, health system leaders at national, regional, and local levels should incorporate ICD-11 into all approaches to monitor patient safety. This will allow them to take advantage of the innovative patient safety classification methods embedded in ICD-11 to overcome several limitations related to existing patient safety surveillance methods. Two, application developers should incorporate ICD-11 into software solutions. This will accelerate adoption and utility of software-enabled clinical and administrative workflows relevant to patient safety management. This is enabled as a result of the ICD-11 application programming interface (or API) developed by the WHO. Third, health system leaders should adopt the ICD-11 using a continuous improvement framework. This will help leaders at national, regional and local levels to take advantage of specific existing initiatives which will be strengthened by ICD-11, including peer review comparisons, clinician engagement, and alignment of front-line safety efforts with post marketing surveillance of medical technologies. While the investment to adopt ICD-11 will be considerable, these will be offset by reducing the ongoing costs related to a lack of accurate routine information.

Recommended practices and ethical considerations for natural language processing-assisted observational research: A scoping review

An increasing number of studies have reported using natural language processing (NLP) to assist observational research by extracting clinical information from electronic health records (EHRs). Currently, no standardized reporting guidelines for NLP-assisted observational studies exist. The absence of detailed reporting guidelines may create ambiguity in the use of NLP-derived content, knowledge gaps in the current research reporting practices, and reproducibility challenges. To address these issues, we conducted a scoping review of NLP-assisted observational clinical studies and examined their reporting practices, focusing on NLP methodology and evaluation. Through our investigation, we discovered a high variation regarding the reporting practices, such as inconsistent use of references for measurement studies, variation in the reporting location (reference, appendix, and manuscript), and different granularity of NLP methodology and evaluation details. To promote the wide adoption and utilization of NLP solutions in clinical research, we outline several perspectives that align with the six principles released by the World Health Organization (WHO) that guide the ethical use of artificial intelligence for health.

Characterizing variability of electronic health record-driven phenotype definitions

OBJECTIVE

The aim of this study was to analyze a publicly available sample of rule-based phenotype definitions to characterize and evaluate the variability of logical constructs used.

MATERIALS AND METHODS

A sample of 33 preexisting phenotype definitions used in research that are represented using Fast Healthcare Interoperability Resources and Clinical Quality Language (CQL) was analyzed using automated analysis of the computable representation of the CQL libraries.

RESULTS

Most of the phenotype definitions include narrative descriptions and flowcharts, while few provide pseudocode or executable artifacts. Most use 4 or fewer medical terminologies. The number of codes used ranges from 5 to 6865, and value sets from 1 to 19. We found that the most common expressions used were literal, data, and logical expressions. Aggregate and arithmetic expressions are the least common. Expression depth ranges from 4 to 27.

DISCUSSION

Despite the range of conditions, we found that all of the phenotype definitions consisted of logical criteria, representing both clinical and operational logic, and tabular data, consisting of codes from standard terminologies and keywords for natural language processing. The total number and variety of expressions are low, which may be to simplify implementation, or authors may limit complexity due to data availability constraints.

CONCLUSIONS

The phenotype definitions analyzed show significant variation in specific logical, arithmetic, and other operators but are all composed of the same high-level components, namely tabular data and logical expressions. A standard representation for phenotype definitions should support these formats and be modular to support localization and shared logic.

Coding long COVID: characterizing a new disease through an ICD-10 lens

BACKGROUND

Naming a newly discovered disease is a difficult process; in the context of the COVID-19 pandemic and the existence of post-acute sequelae of SARS-CoV-2 infection (PASC), which includes long COVID, it has proven especially challenging. Disease definitions and assignment of a diagnosis code are often asynchronous and iterative. The clinical definition and our understanding of the underlying mechanisms of long COVID are still in flux, and the deployment of an ICD-10-CM code for long COVID in the USA took nearly 2 years after patients had begun to describe their condition. Here, we leverage the largest publicly available HIPAA-limited dataset about patients with COVID-19 in the US to examine the heterogeneity of adoption and use of U09.9, the ICD-10-CM code for "Post COVID-19 condition, unspecified."

METHODS

We undertook a number of analyses to characterize the N3C population with a U09.9 diagnosis code (n = 33,782), including assessing person-level demographics and a number of area-level social determinants of health; diagnoses commonly co-occurring with U09.9, clustered using the Louvain algorithm; and quantifying medications and procedures recorded within 60 days of U09.9 diagnosis. We stratified all analyses by age group in order to discern differing patterns of care across the lifespan.

RESULTS

We established the diagnoses most commonly co-occurring with U09.9 and algorithmically clustered them into four major categories: cardiopulmonary, neurological, gastrointestinal, and comorbid conditions. Importantly, we discovered that the population of patients diagnosed with U09.9 is demographically skewed toward female, White, non-Hispanic individuals, as well as individuals living in areas with low poverty and low unemployment. Our results also include a characterization of common procedures and medications associated with U09.9-coded patients.

CONCLUSIONS

This work offers insight into potential subtypes and current practice patterns around long COVID and speaks to the existence of disparities in the diagnosis of patients with long COVID. This latter finding in particular requires further research and urgent remediation.

SARS-CoV-2 Reinfection is Preceded by Unique Biomarkers and Related to Initial Infection Timing and Severity: an N3C RECOVER EHR-Based Cohort Study

Although the COVID-19 pandemic has persisted for over 2 years, reinfections with SARS-CoV-2 are not well understood. We use the electronic health record (EHR)-based study cohort from the National COVID Cohort Collaborative (N3C) as part of the NIH Researching COVID to Enhance Recovery (RECOVER) Initiative to characterize reinfection, understand development of Long COVID after reinfection, and compare severity of reinfection with initial infection. We validate previous findings of reinfection incidence (5.9%), the occurrence of most reinfections during the Omicron epoch, and evidence of multiple reinfections. We present novel findings that Long COVID diagnoses occur closer to the index date for infection or reinfection in the Omicron BA epoch. We report lower albumin levels leading up to reinfection and a statistically significant association of severity between first infection and reinfection (chi-squared value: 9446.2, p-value: 0) with a medium effect size (Cramer's V: 0.18, DoF = 4).

Generalisable long COVID subtypes: findings from the NIH N3C and RECOVER programmes

BACKGROUND

Stratification of patients with post-acute sequelae of SARS-CoV-2 infection (PASC, or long COVID) would allow precision clinical management strategies. However, long COVID is incompletely understood and characterised by a wide range of manifestations that are difficult to analyse computationally. Additionally, the generalisability of machine learning classification of COVID-19 clinical outcomes has rarely been tested.

METHODS

We present a method for computationally modelling PASC phenotype data based on electronic healthcare records (EHRs) and for assessing pairwise phenotypic similarity between patients using semantic similarity. Our approach defines a nonlinear similarity function that maps from a feature space of phenotypic abnormalities to a matrix of pairwise patient similarity that can be clustered using unsupervised machine learning.

FINDINGS

We found six clusters of PASC patients, each with distinct profiles of phenotypic abnormalities, including clusters with distinct pulmonary, neuropsychiatric, and cardiovascular abnormalities, and a cluster associated with broad, severe manifestations and increased mortality. There was significant association of cluster membership with a range of pre-existing conditions and measures of severity during acute COVID-19. We assigned new patients from other healthcare centres to clusters by maximum semantic similarity to the original patients, and showed that the clusters were generalisable across different hospital systems. The increased mortality rate originally identified in one cluster was consistently observed in patients assigned to that cluster in other hospital systems.

INTERPRETATION

Semantic phenotypic clustering provides a foundation for assigning patients to stratified subgroups for natural history or therapy studies on PASC.

FUNDING

NIH (TR002306/OT2HL161847-01/OD011883/HG010860), U.S.D.O.E. (DE-AC02-05CH11231), Donald A. Roux Family Fund at Jackson Laboratory, Marsico Family at CU Anschutz.

Long COVID Risk and Pre-COVID Vaccination: An EHR-Based Cohort Study from the RECOVER Program

Importance

Characterizing the effect of vaccination on long COVID allows for better healthcare recommendations.

Objective

To determine if, and to what degree, vaccination prior to COVID-19 is associated with eventual long COVID onset, among those a documented COVID-19 infection.

Design Settings and Participants

Retrospective cohort study of adults with evidence of COVID-19 between August 1, 2021 and January 31, 2022 based on electronic health records from eleven healthcare institutions taking part in the NIH Researching COVID to Enhance Recovery (RECOVER) Initiative, a project of the National Covid Cohort Collaborative (N3C).

Exposures

Pre-COVID-19 receipt of a complete vaccine series versus no pre-COVID-19 vaccination.

Main Outcomes and Measures

Two approaches to the identification of long COVID were used. In the clinical diagnosis cohort (n=47,752), ICD-10 diagnosis codes or evidence of a healthcare encounter at a long COVID clinic were used. In the model-based cohort (n=199,498), a computable phenotype was used. The association between pre-COVID vaccination and long COVID was estimated using IPTW-adjusted logistic regression and Cox proportional hazards.

Results

In both cohorts, when adjusting for demographics and medical history, pre-COVID vaccination was associated with a reduced risk of long COVID (clinic-based cohort: HR, 0.66; 95% CI, 0.55-0.80; OR, 0.69; 95% CI, 0.59-0.82; model-based cohort: HR, 0.62; 95% CI, 0.56-0.69; OR, 0.70; 95% CI, 0.65-0.75).

Conclusions and Relevance

Long COVID has become a central concern for public health experts. Prior studies have considered the effect of vaccination on the prevalence of future long COVID symptoms, but ours is the first to thoroughly characterize the association between vaccination and clinically diagnosed or computationally derived long COVID. Our results bolster the growing consensus that vaccines retain protective effects against long COVID even in breakthrough infections.

Key Points

Question: Does vaccination prior to COVID-19 onset change the risk of long COVID diagnosis?Findings: Four observational analyses of EHRs showed a statistically significant reduction in long COVID risk associated with pre-COVID vaccination (first cohort: HR, 0.66; 95% CI, 0.55-0.80; OR, 0.69; 95% CI, 0.59-0.82; second cohort: HR, 0.62; 95% CI, 0.56-0.69; OR, 0.70; 95% CI, 0.65-0.75).Meaning: Vaccination prior to COVID onset has a protective association with long COVID even in the case of breakthrough infections.

FHIR-Ontop-OMOP: Building clinical knowledge graphs in FHIR RDF with the OMOP Common data Model

BACKGROUND

Knowledge graphs (KGs) play a key role to enable explainable artificial intelligence (AI) applications in healthcare. Constructing clinical knowledge graphs (CKGs) against heterogeneous electronic health records (EHRs) has been desired by the research and healthcare AI communities. From the standardization perspective, community-based standards such as the Fast Healthcare Interoperability Resources (FHIR) and the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) are increasingly used to represent and standardize EHR data for clinical data analytics, however, the potential of such a standard on building CKG has not been well investigated.

OBJECTIVE

To develop and evaluate methods and tools that expose the OMOP CDM-based clinical data repositories into virtual clinical KGs that are compliant with FHIR Resource Description Framework (RDF) specification.

METHODS

We developed a system called FHIR-Ontop-OMOP to generate virtual clinical KGs from the OMOP relational databases. We leveraged an OMOP CDM-based Medical Information Mart for Intensive Care (MIMIC-III) data repository to evaluate the FHIR-Ontop-OMOP system in terms of the faithfulness of data transformation and the conformance of the generated CKGs to the FHIR RDF specification.

RESULTS

A beta version of the system has been released. A total of more than 100 data element mappings from 11 OMOP CDM clinical data, health system and vocabulary tables were implemented in the system, covering 11 FHIR resources. The generated virtual CKG from MIMIC-III contains 46,520 instances of FHIR Patient, 716,595 instances of Condition, 1,063,525 instances of Procedure, 24,934,751 instances of MedicationStatement, 365,181,104 instances of Observations, and 4,779,672 instances of CodeableConcept. Patient counts identified by five pairs of SQL (over the MIMIC database) and SPARQL (over the virtual CKG) queries were identical, ensuring the faithfulness of the data transformation. Generated CKG in RDF triples for 100 patients were fully conformant with the FHIR RDF specification.

CONCLUSION

The FHIR-Ontop-OMOP system can expose OMOP database as a FHIR-compliant RDF graph. It provides a meaningful use case demonstrating the potentials that can be enabled by the interoperability between FHIR and OMOP CDM. Generated clinical KGs in FHIR RDF provide a semantic foundation to enable explainable AI applications in healthcare.

Coding Long COVID: Characterizing a new disease through an ICD-10 lens

Background

Naming a newly discovered disease is a difficult process; in the context of the COVID-19 pandemic and the existence of post-acute sequelae of SARS-CoV-2 infection (PASC), which includes Long COVID, it has proven especially challenging. Disease definitions and assignment of a diagnosis code are often asynchronous and iterative. The clinical definition and our understanding of the underlying mechanisms of Long COVID are still in flux, and the deployment of an ICD-10-CM code for Long COVID in the US took nearly two years after patients had begun to describe their condition. Here we leverage the largest publicly available HIPAA-limited dataset about patients with COVID-19 in the US to examine the heterogeneity of adoption and use of U09.9, the ICD-10-CM code for "Post COVID-19 condition, unspecified."

Methods

We undertook a number of analyses to characterize the N3C population with a U09.9 diagnosis code ( n = 21,072), including assessing person-level demographics and a number of area-level social determinants of health; diagnoses commonly co-occurring with U09.9, clustered using the Louvain algorithm; and quantifying medications and procedures recorded within 60 days of U09.9 diagnosis. We stratified all analyses by age group in order to discern differing patterns of care across the lifespan.

Results

We established the diagnoses most commonly co-occurring with U09.9, and algorithmically clustered them into four major categories: cardiopulmonary, neurological, gastrointestinal, and comorbid conditions. Importantly, we discovered that the population of patients diagnosed with U09.9 is demographically skewed toward female, White, non-Hispanic individuals, as well as individuals living in areas with low poverty, high education, and high access to medical care. Our results also include a characterization of common procedures and medications associated with U09.9-coded patients.

Conclusions

This work offers insight into potential subtypes and current practice patterns around Long COVID, and speaks to the existence of disparities in the diagnosis of patients with Long COVID. This latter finding in particular requires further research and urgent remediation.

Risk Factors Associated with Post-Acute Sequelae of SARS-CoV-2 in an EHR Cohort: A National COVID Cohort Collaborative (N3C) Analysis as part of the NIH RECOVER program

Background

More than one-third of individuals experience post-acute sequelae of SARS-CoV-2 infection (PASC, which includes long-COVID).

Objective

To identify risk factors associated with PASC/long-COVID.

Design

Retrospective case-control study.

Setting

31 health systems in the United States from the National COVID Cohort Collaborative (N3C).

Patients

8,325 individuals with PASC (defined by the presence of the International Classification of Diseases, version 10 code U09.9 or a long-COVID clinic visit) matched to 41,625 controls within the same health system.

Measurements

Risk factors included demographics, comorbidities, and treatment and acute characteristics related to COVID-19. Multivariable logistic regression, random forest, and XGBoost were used to determine the associations between risk factors and PASC.

Results

Among 8,325 individuals with PASC, the majority were >50 years of age (56.6%), female (62.8%), and non-Hispanic White (68.6%). In logistic regression, middle-age categories (40 to 69 years; OR ranging from 2.32 to 2.58), female sex (OR 1.4, 95% CI 1.33-1.48), hospitalization associated with COVID-19 (OR 3.8, 95% CI 3.05-4.73), long (8-30 days, OR 1.69, 95% CI 1.31-2.17) or extended hospital stay (30+ days, OR 3.38, 95% CI 2.45-4.67), receipt of mechanical ventilation (OR 1.44, 95% CI 1.18-1.74), and several comorbidities including depression (OR 1.50, 95% CI 1.40-1.60), chronic lung disease (OR 1.63, 95% CI 1.53-1.74), and obesity (OR 1.23, 95% CI 1.16-1.3) were associated with increased likelihood of PASC diagnosis or care at a long-COVID clinic. Characteristics associated with a lower likelihood of PASC diagnosis or care at a long-COVID clinic included younger age (18 to 29 years), male sex, non-Hispanic Black race, and comorbidities such as substance abuse, cardiomyopathy, psychosis, and dementia. More doctors per capita in the county of residence was associated with an increased likelihood of PASC diagnosis or care at a long-COVID clinic. Our findings were consistent in sensitivity analyses using a variety of analytic techniques and approaches to select controls.

Conclusions

This national study identified important risk factors for PASC such as middle age, severe COVID-19 disease, and specific comorbidities. Further clinical and epidemiological research is needed to better understand underlying mechanisms and the potential role of vaccines and therapeutics in altering PASC course.

Generalizable Long COVID Subtypes: Findings from the NIH N3C and RECOVER Programs

Accurate stratification of patients with post-acute sequelae of SARS-CoV-2 infection (PASC, or long COVID) would allow precision clinical management strategies. However, the natural history of long COVID is incompletely understood and characterized by an extremely wide range of manifestations that are difficult to analyze computationally. In addition, the generalizability of machine learning classification of COVID-19 clinical outcomes has rarely been tested. We present a method for computationally modeling PASC phenotype data based on electronic healthcare records (EHRs) and for assessing pairwise phenotypic similarity between patients using semantic similarity. Our approach defines a nonlinear similarity function that maps from a feature space of phenotypic abnormalities to a matrix of pairwise patient similarity that can be clustered using unsupervised machine learning procedures. Using k-means clustering of this similarity matrix, we found six distinct clusters of PASC patients, each with distinct profiles of phenotypic abnormalities. There was a significant association of cluster membership with a range of pre-existing conditions and with measures of severity during acute COVID-19. Two of the clusters were associated with severe manifestations and displayed increased mortality. We assigned new patients from other healthcare centers to one of the six clusters on the basis of maximum semantic similarity to the original patients. We show that the identified clusters were generalizable across different hospital systems and that the increased mortality rate was consistently observed in two of the clusters. Semantic phenotypic clustering can provide a foundation for assigning patients to stratified subgroups for natural history or therapy studies on PASC.

Post-recovery COVID-19 and incident heart failure in the National COVID Cohort Collaborative (N3C) study

Cardiac involvement has been noted in COVID-19 infection. However, the relationship between post-recovery COVID-19 and development of de novo heart failure has not been investigated in a large, nationally representative population. We examined post-recovery outcomes of 587,330 patients hospitalized in the United States (257,075 with COVID-19 and 330,255 without), using data from the National COVID Cohort Collaborative study. Patients hospitalized with COVID-19 were older (51 vs. 46 years), more often male (49% vs. 42%), and less often White (61% vs. 69%). Over a median follow up of 367 days, 10,979 incident heart failure events occurred. After adjustments, COVID-19 hospitalization was associated with a 45% higher hazard of incident heart failure (hazard ratio = 1.45; 95% confidence interval: 1.39-1.51), with more pronounced associations among patients who were younger (P-interaction = 0.003), White (P-interaction = 0.005), or who had established cardiovascular disease (P-interaction = 0.005). In conclusion, COVID-19 hospitalization is associated with increased risk of incident heart failure.

Identifying who has long COVID in the USA: a machine learning approach using N3C data

BACKGROUND

Post-acute sequelae of SARS-CoV-2 infection, known as long COVID, have severely affected recovery from the COVID-19 pandemic for patients and society alike. Long COVID is characterised by evolving, heterogeneous symptoms, making it challenging to derive an unambiguous definition. Studies of electronic health records are a crucial element of the US National Institutes of Health's RECOVER Initiative, which is addressing the urgent need to understand long COVID, identify treatments, and accurately identify who has it-the latter is the aim of this study.

METHODS

Using the National COVID Cohort Collaborative's (N3C) electronic health record repository, we developed XGBoost machine learning models to identify potential patients with long COVID. We defined our base population (n=1 793 604) as any non-deceased adult patient (age ≥18 years) with either an International Classification of Diseases-10-Clinical Modification COVID-19 diagnosis code (U07.1) from an inpatient or emergency visit, or a positive SARS-CoV-2 PCR or antigen test, and for whom at least 90 days have passed since COVID-19 index date. We examined demographics, health-care utilisation, diagnoses, and medications for 97 995 adults with COVID-19. We used data on these features and 597 patients from a long COVID clinic to train three machine learning models to identify potential long COVID among all patients with COVID-19, patients hospitalised with COVID-19, and patients who had COVID-19 but were not hospitalised. Feature importance was determined via Shapley values. We further validated the models on data from a fourth site.

FINDINGS

Our models identified, with high accuracy, patients who potentially have long COVID, achieving areas under the receiver operator characteristic curve of 0·92 (all patients), 0·90 (hospitalised), and 0·85 (non-hospitalised). Important features, as defined by Shapley values, include rate of health-care utilisation, patient age, dyspnoea, and other diagnosis and medication information available within the electronic health record.

INTERPRETATION

Patients identified by our models as potentially having long COVID can be interpreted as patients warranting care at a specialty clinic for long COVID, which is an essential proxy for long COVID diagnosis as its definition continues to evolve. We also achieve the urgent goal of identifying potential long COVID in patients for clinical trials. As more data sources are identified, our models can be retrained and tuned based on the needs of individual studies.

FUNDING

US National Institutes of Health and National Center for Advancing Translational Sciences through the RECOVER Initiative.

A Simple Standard for Sharing Ontological Mappings (SSSOM)

Despite progress in the development of standards for describing and exchanging scientific information, the lack of easy-to-use standards for mapping between different representations of the same or similar objects in different databases poses a major impediment to data integration and interoperability. Mappings often lack the metadata needed to be correctly interpreted and applied. For example, are two terms equivalent or merely related? Are they narrow or broad matches? Or are they associated in some other way? Such relationships between the mapped terms are often not documented, which leads to incorrect assumptions and makes them hard to use in scenarios that require a high degree of precision (such as diagnostics or risk prediction). Furthermore, the lack of descriptions of how mappings were done makes it hard to combine and reconcile mappings, particularly curated and automated ones. We have developed the Simple Standard for Sharing Ontological Mappings (SSSOM) which addresses these problems by: (i) Introducing a machine-readable and extensible vocabulary to describe metadata that makes imprecision, inaccuracy and incompleteness in mappings explicit. (ii) Defining an easy-to-use simple table-based format that can be integrated into existing data science pipelines without the need to parse or query ontologies, and that integrates seamlessly with Linked Data principles. (iii) Implementing open and community-driven collaborative workflows that are designed to evolve the standard continuously to address changing requirements and mapping practices. (iv) Providing reference tools and software libraries for working with the standard. In this paper, we present the SSSOM standard, describe several use cases in detail and survey some of the existing work on standardizing the exchange of mappings, with the goal of making mappings Findable, Accessible, Interoperable and Reusable (FAIR). The SSSOM specification can be found at http://w3id.org/sssom/spec. Database URL: http://w3id.org/sssom/spec.

Postcoordination of codes in ICD-11

A new coding feature introduced with ICD-11, the 11th revision of the International Classification of Diseases (ICD), is postcoordination, which supports combining (linking) two or more codes into a cluster that describes a clinical concept. Postcoordination allows for coded data to be reported to a greater level of specificity than was possible in previous version of ICD. The linked codes are kept together in a cluster when submitted for reporting. This article presents background detail on the postcoordination feature in ICD and the postcoordination tool. Also presented are several examples that demonstrate the flexibility that ICD-11 provides for enriching coded health information.

Overview of ICD-11 architecture and structure

BACKGROUND

The International Classification of Diseases (ICD) has progressed from a short list of causes of death to become the predominant classification of human diseases, syndromes, and conditions around the world. The World Health Organization has now explored how the ICD could be revised to leverage the advances in computer science, ontology, and knowledge representation that had accelerated in the twentieth and early twenty-first centuries.

METHODS

Many teams of clinical specialists and domain leaders worked to fundamentally revise the science and knowledge base of ICD-11. Development of the ICD-11 architecturally was a fundamental revision. The architecture for ICD-11 proposed in 2007 included three layers: a semantic network of biomedical concepts (Foundation), a traditional tabulation of hierarchical codes that would derive from that network (Linearization), and a formal ontology that would anchor the meaning of terms in the semantic network. Additionally, each entry in the semantic network would have an associated information model of required and optional content (Content Model).

RESULTS

This paper describes the innovative architecture developed for ICD-11.

CONCLUSION

ICD11 is a revolutionary transformation of a century long medical classification that retains is historical rendering and interface while expanding the opportunity for multiple linearization and underpinning its content with a formally constructed semantic network. The new artifact can enable modern data science and analyses with content encoded with ICD11.

NSAID use and clinical outcomes in COVID-19 patients: a 38-center retrospective cohort study

BACKGROUND

Non-steroidal anti-inflammatory drugs (NSAIDs) are commonly used to reduce pain, fever, and inflammation but have been associated with complications in community-acquired pneumonia. Observations shortly after the start of the COVID-19 pandemic in 2020 suggested that ibuprofen was associated with an increased risk of adverse events in COVID-19 patients, but subsequent observational studies failed to demonstrate increased risk and in one case showed reduced risk associated with NSAID use.

METHODS

A 38-center retrospective cohort study was performed that leveraged the harmonized, high-granularity electronic health record data of the National COVID Cohort Collaborative. A propensity-matched cohort of 19,746 COVID-19 inpatients was constructed by matching cases (treated with NSAIDs at the time of admission) and 19,746 controls (not treated) from 857,061 patients with COVID-19 available for analysis. The primary outcome of interest was COVID-19 severity in hospitalized patients, which was classified as: moderate, severe, or mortality/hospice. Secondary outcomes were acute kidney injury (AKI), extracorporeal membrane oxygenation (ECMO), invasive ventilation, and all-cause mortality at any time following COVID-19 diagnosis.

RESULTS

Logistic regression showed that NSAID use was not associated with increased COVID-19 severity (OR: 0.57 95% CI: 0.53-0.61). Analysis of secondary outcomes using logistic regression showed that NSAID use was not associated with increased risk of all-cause mortality (OR 0.51 95% CI: 0.47-0.56), invasive ventilation (OR: 0.59 95% CI: 0.55-0.64), AKI (OR: 0.67 95% CI: 0.63-0.72), or ECMO (OR: 0.51 95% CI: 0.36-0.7). In contrast, the odds ratios indicate reduced risk of these outcomes, but our quantitative bias analysis showed E-values of between 1.9 and 3.3 for these associations, indicating that comparatively weak or moderate confounder associations could explain away the observed associations.

CONCLUSIONS

Study interpretation is limited by the observational design. Recording of NSAID use may have been incomplete. Our study demonstrates that NSAID use is not associated with increased COVID-19 severity, all-cause mortality, invasive ventilation, AKI, or ECMO in COVID-19 inpatients. A conservative interpretation in light of the quantitative bias analysis is that there is no evidence that NSAID use is associated with risk of increased severity or the other measured outcomes. Our results confirm and extend analogous findings in previous observational studies using a large cohort of patients drawn from 38 centers in a nationally representative multicenter database.

Harmonizing units and values of quantitative data elements in a very large nationally pooled electronic health record (EHR) dataset

Objective

The goals of this study were to harmonize data from electronic health records (EHRs) into common units, and impute units that were missing.

Materials and Methods

The National COVID Cohort Collaborative (N3C) table of laboratory measurement data—over 3.1 billion patient records and over 19 000 unique measurement concepts in the Observational Medical Outcomes Partnership (OMOP) common-data-model format from 55 data partners. We grouped ontologically similar OMOP concepts together for 52 variables relevant to COVID-19 research, and developed a unit-harmonization pipeline comprised of (1) selecting a canonical unit for each measurement variable, (2) arriving at a formula for conversion, (3) obtaining clinical review of each formula, (4) applying the formula to convert data values in each unit into the target canonical unit, and (5) removing any harmonized value that fell outside of accepted value ranges for the variable. For data with missing units for all the results within a lab test for a data partner, we compared values with pooled values of all data partners, using the Kolmogorov-Smirnov test.

Results

Of the concepts without missing values, we harmonized 88.1% of the values, and imputed units for 78.2% of records where units were absent (41% of contributors’ records lacked units).

Discussion

The harmonization and inference methods developed herein can serve as a resource for initiatives aiming to extract insight from heterogeneous EHR collections. Unique properties of centralized data are harnessed to enable unit inference.

Conclusion

The pipeline we developed for the pooled N3C data enables use of measurements that would otherwise be unavailable for analysis.

Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative

OBJECTIVE

In response to COVID-19, the informatics community united to aggregate as much clinical data as possible to characterize this new disease and reduce its impact through collaborative analytics. The National COVID Cohort Collaborative (N3C) is now the largest publicly available HIPAA limited dataset in US history with over 6.4 million patients and is a testament to a partnership of over 100 organizations.

MATERIALS AND METHODS

We developed a pipeline for ingesting, harmonizing, and centralizing data from 56 contributing data partners using 4 federated Common Data Models. N3C data quality (DQ) review involves both automated and manual procedures. In the process, several DQ heuristics were discovered in our centralized context, both within the pipeline and during downstream project-based analysis. Feedback to the sites led to many local and centralized DQ improvements.

RESULTS

Beyond well-recognized DQ findings, we discovered 15 heuristics relating to source Common Data Model conformance, demographics, COVID tests, conditions, encounters, measurements, observations, coding completeness, and fitness for use. Of 56 sites, 37 sites (66%) demonstrated issues through these heuristics. These 37 sites demonstrated improvement after receiving feedback.

DISCUSSION

We encountered site-to-site differences in DQ which would have been challenging to discover using federated checks alone. We have demonstrated that centralized DQ benchmarking reveals unique opportunities for DQ improvement that will support improved research analytics locally and in aggregate.

CONCLUSION

By combining rapid, continual assessment of DQ with a large volume of multisite data, it is possible to support more nuanced scientific questions with the scale and rigor that they require.

Developing an ETL tool for converting the PCORnet CDM into the OMOP CDM to facilitate the COVID-19 data integration

OBJECTIVE

The large-scale collection of observational data and digital technologies could help curb the COVID-19 pandemic. However, the coexistence of multiple Common Data Models (CDMs) and the lack of data extract, transform, and load (ETL) tool between different CDMs causes potential interoperability issue between different data systems. The objective of this study is to design, develop, and evaluate an ETL tool that transforms the PCORnet CDM format data into the OMOP CDM.

METHODS

We developed an open-source ETL tool to facilitate the data conversion from the PCORnet CDM and the OMOP CDM. The ETL tool was evaluated using a dataset with 1000 patients randomly selected from the PCORnet CDM at Mayo Clinic. Information loss, data mapping accuracy, and gap analysis approaches were conducted to assess the performance of the ETL tool. We designed an experiment to conduct a real-world COVID-19 surveillance task to assess the feasibility of the ETL tool. We also assessed the capacity of the ETL tool for the COVID-19 data surveillance using data collection criteria of the MN EHR Consortium COVID-19 project.

RESULTS

After the ETL process, all the records of 1000 patients from 18 PCORnet CDM tables were successfully transformed into 12 OMOP CDM tables. The information loss for all the concept mapping was less than 0.61%. The string mapping process for the unit concepts lost 2.84% records. Almost all the fields in the manual mapping process achieved 0% information loss, except the specialty concept mapping. Moreover, the mapping accuracy for all the fields were 100%. The COVID-19 surveillance task collected almost the same set of cases (99.3% overlaps) from the original PCORnet CDM and target OMOP CDM separately. Finally, all the data elements for MN EHR Consortium COVID-19 project could be captured from both the PCORnet CDM and the OMOP CDM.

CONCLUSION

We demonstrated that our ETL tool could satisfy the data conversion requirements between the PCORnet CDM and the OMOP CDM. The outcome of the work would facilitate the data retrieval, communication, sharing, and analysis between different institutions for not only COVID-19 related project, but also other real-world evidence-based observational studies.

Characteristics, Outcomes, and Severity Risk Factors Associated With SARS-CoV-2 Infection Among Children in the US National COVID Cohort Collaborative

Importance

Understanding of SARS-CoV-2 infection in US children has been limited by the lack of large, multicenter studies with granular data.

Objective

To examine the characteristics, changes over time, outcomes, and severity risk factors of children with SARS-CoV-2 within the National COVID Cohort Collaborative (N3C).

Design, Setting, and Participants

A prospective cohort study of encounters with end dates before September 24, 2021, was conducted at 56 N3C facilities throughout the US. Participants included children younger than 19 years at initial SARS-CoV-2 testing.

Main Outcomes and Measures

Case incidence and severity over time, demographic and comorbidity severity risk factors, vital sign and laboratory trajectories, clinical outcomes, and acute COVID-19 vs multisystem inflammatory syndrome in children (MIS-C), and Delta vs pre-Delta variant differences for children with SARS-CoV-2.

Results

A total of 1 068 410 children were tested for SARS-CoV-2 and 167 262 test results (15.6%) were positive (82 882 [49.6%] girls; median age, 11.9 [IQR, 6.0-16.1] years). Among the 10 245 children (6.1%) who were hospitalized, 1423 (13.9%) met the criteria for severe disease: mechanical ventilation (796 [7.8%]), vasopressor-inotropic support (868 [8.5%]), extracorporeal membrane oxygenation (42 [0.4%]), or death (131 [1.3%]). Male sex (odds ratio [OR], 1.37; 95% CI, 1.21-1.56), Black/African American race (OR, 1.25; 95% CI, 1.06-1.47), obesity (OR, 1.19; 95% CI, 1.01-1.41), and several pediatric complex chronic condition (PCCC) subcategories were associated with higher severity disease. Vital signs and many laboratory test values from the day of admission were predictive of peak disease severity. Variables associated with increased odds for MIS-C vs acute COVID-19 included male sex (OR, 1.59; 95% CI, 1.33-1.90), Black/African American race (OR, 1.44; 95% CI, 1.17-1.77), younger than 12 years (OR, 1.81; 95% CI, 1.51-2.18), obesity (OR, 1.76; 95% CI, 1.40-2.22), and not having a pediatric complex chronic condition (OR, 0.72; 95% CI, 0.65-0.80). The children with MIS-C had a more inflammatory laboratory profile and severe clinical phenotype, with higher rates of invasive ventilation (117 of 707 [16.5%] vs 514 of 8241 [6.2%]; P < .001) and need for vasoactive-inotropic support (191 of 707 [27.0%] vs 426 of 8241 [5.2%]; P < .001) compared with those who had acute COVID-19. Comparing children during the Delta vs pre-Delta eras, there was no significant change in hospitalization rate (1738 [6.0%] vs 8507 [6.2%]; P = .18) and lower odds for severe disease (179 [10.3%] vs 1242 [14.6%]) (decreased by a factor of 0.67; 95% CI, 0.57-0.79; P < .001).

Conclusions and Relevance

In this cohort study of US children with SARS-CoV-2, there were observed differences in demographic characteristics, preexisting comorbidities, and initial vital sign and laboratory values between severity subgroups. Taken together, these results suggest that early identification of children likely to progress to severe disease could be achieved using readily available data elements from the day of admission. Further work is needed to translate this knowledge into improved outcomes.

Association Between Immune Dysfunction and COVID-19 Breakthrough Infection After SARS-CoV-2 Vaccination in the US

Importance

Persons with immune dysfunction have a higher risk for severe COVID-19 outcomes. However, these patients were largely excluded from SARS-CoV-2 vaccine clinical trials, creating a large evidence gap.

Objective

To identify the incidence rate and incidence rate ratio (IRR) for COVID-19 breakthrough infection after SARS-CoV-2 vaccination among persons with or without immune dysfunction.

Design, Setting, and Participants

This retrospective cohort study analyzed data from the National COVID Cohort Collaborative (N3C), a partnership that developed a secure, centralized electronic medical record-based repository of COVID-19 clinical data from academic medical centers across the US. Persons who received at least 1 dose of a SARS-CoV-2 vaccine between December 10, 2020, and September 16, 2021, were included in the sample.

Main Outcomes and Measures

Vaccination, COVID-19 diagnosis, immune dysfunction diagnoses (ie, HIV infection, multiple sclerosis, rheumatoid arthritis, solid organ transplant, and bone marrow transplantation), other comorbid conditions, and demographic data were accessed through the N3C Data Enclave. Breakthrough infection was defined as a COVID-19 infection that was contracted on or after the 14th day of vaccination, and the risk after full or partial vaccination was assessed for patients with or without immune dysfunction using Poisson regression with robust SEs. Poisson regression models were controlled for a study period (before or after [pre- or post-Delta variant] June 20, 2021), full vaccination status, COVID-19 infection before vaccination, demographic characteristics, geographic location, and comorbidity burden.

Results

A total of 664 722 patients in the N3C sample were included. These patients had a median (IQR) age of 51 (34-66) years and were predominantly women (n = 378 307 [56.9%]). Overall, the incidence rate for COVID-19 breakthrough infection was 5.0 per 1000 person-months among fully vaccinated persons but was higher after the Delta variant became the dominant SARS-CoV-2 strain (incidence rate before vs after June 20, 2021, 2.2 [95% CI, 2.2-2.2] vs 7.3 [95% CI, 7.3-7.4] per 1000 person-months). Compared with partial vaccination, full vaccination was associated with a 28% reduced risk for breakthrough infection (adjusted IRR [AIRR], 0.72; 95% CI, 0.68-0.76). People with a breakthrough infection after full vaccination were more likely to be older and women. People with HIV infection (AIRR, 1.33; 95% CI, 1.18-1.49), rheumatoid arthritis (AIRR, 1.20; 95% CI, 1.09-1.32), and solid organ transplant (AIRR, 2.16; 95% CI, 1.96-2.38) had a higher rate of breakthrough infection.

Conclusions and Relevance

This cohort study found that full vaccination was associated with reduced risk of COVID-19 breakthrough infection, regardless of the immune status of patients. Despite full vaccination, persons with immune dysfunction had substantially higher risk for COVID-19 breakthrough infection than those without such a condition. For persons with immune dysfunction, continued use of nonpharmaceutical interventions (eg, mask wearing) and alternative vaccine strategies (eg, additional doses or immunogenicity testing) are recommended even after full vaccination.

Ankle Fracture and Length of Stay in US Adult Population Using Data From the National COVID Cohort Collaborative

Background:

The National COVID Cohort Collaborative (N3C) is an innovative approach to integrate real-world clinical observations into a harmonized database during the time of the COVID-19 pandemic when clinical research on ankle fracture surgery is otherwise mostly limited to expert opinion and research letters. The purpose of this manuscript is to introduce the largest cohort of US ankle fracture surgery patients to date with a comparison between lab-confirmed COVID-19–positive and COVID-19–negative.

Methods:

A retrospective cohort of adults with ankle fracture surgery using data from the N3C database with patients undergoing surgery between March 2020 and June 2021. The database is an NIH-funded platform through which the harmonized clinical data from 46 sites is stored. Patient characteristics included body mass index, Charlson Comorbidity Index, and smoking status. Outcomes included 30-day mortality, overall mortality, surgical site infection (SSI), deep SSI, acute kidney injury, pulmonary embolism, deep vein thrombosis, sepsis, time to surgery, and length of stay. COVID-19–positive patients were compared to COVID-19–negative controls to investigate perioperative outcomes during the pandemic.

Results:

A total population of 8.4 million patient records was queried, identifying 4735 adults with ankle fracture surgery. The COVID-19–positive group (n=158, 3.3%) had significantly longer times to surgery (6.5 ± 6.6 vs 5.1 ± 5.5 days, P = .001) and longer lengths of stay (8.3 ± 23.5 vs 4.3 ± 7.4 days, P < .001), compared to the COVID-19–negative group. The COVID-19–positive group also had a higher rate of 30-day mortality.

Conclusion:

Patients with ankle fracture surgery had longer time to surgery and prolonged hospitalizations in COVID-19–positive patients compared to those who tested negative (average delay was about 1 day and increased length of hospitalization was about 4 days). Few perioperative events were observed in either group. Overall, the risks associated with COVID-19 were measurable but not substantial.

Level of Evidence: Level III, retrospective cohort study.

NSAID use and clinical outcomes in COVID-19 patients: A 38-center retrospective cohort study

BACKGROUND

Non-steroidal anti-inflammatory drugs (NSAIDs) are commonly used to reduce pain, fever, and inflammation but have been associated with complications in community-acquired pneumonia. Observations shortly after the start of the COVID-19 pandemic in 2020 suggested that ibuprofen was associated with an increased risk of adverse events in COVID-19 patients, but subsequent observational studies failed to demonstrate increased risk and in one case showed reduced risk associated with NSAID use.

METHODS

A 38-center retrospective cohort study was performed that leveraged the harmonized, high-granularity electronic health record data of the National COVID Cohort Collaborative. A propensity-matched cohort of COVID-19 inpatients was constructed by matching cases (treated with NSAIDs) and controls (not treated) from 857,061 patients with COVID-19. The primary outcome of interest was COVID-19 severity in hospitalized patients, which was classified as: moderate, severe, or mortality/hospice. Secondary outcomes were acute kidney injury (AKI), extracorporeal membrane oxygenation (ECMO), invasive ventilation, and all-cause mortality at any time following COVID-19 diagnosis.

RESULTS

Logistic regression showed that NSAID use was not associated with increased COVID-19 severity (OR: 0.57 95% CI: 0.53-0.61). Analysis of secondary outcomes using logistic regression showed that NSAID use was not associated with increased risk of all-cause mortality (OR 0.51 95% CI: 0.47-0.56), invasive ventilation (OR: 0.59 95% CI: 0.55-0.64), AKI (OR: 0.67 95% CI: 0.63-0.72), or ECMO (OR: 0.51 95% CI: 0.36-0.7). In contrast, the odds ratios indicate reduced risk of these outcomes, but our quantitative bias analysis showed E-values of between 1.9 and 3.3 for these associations, indicating that comparatively weak or moderate confounder associations could explain away the observed associations.

CONCLUSIONS

Study interpretation is limited by the observational design. Recording of NSAID use may have been incomplete. Our study demonstrates that NSAID use is not associated with increased COVID-19 severity, all-cause mortality, invasive ventilation, AKI, or ECMO in COVID-19 inpatients. A conservative interpretation in light of the quantitative bias analysis is that there is no evidence that NSAID use is associated with risk of increased severity or the other measured outcomes. Our findings are the largest EHR-based analysis of the effect of NSAIDs on outcome in COVID-19 patients to date. Our results confirm and extend analogous findings in previous observational studies using a large cohort of patients drawn from 38 centers in a nationally representative multicenter database.

Characterizing Long COVID: Deep Phenotype of a Complex Condition

BACKGROUND

Numerous publications describe the clinical manifestations of post-acute sequelae of SARS-CoV-2 (PASC or "long COVID"), but they are difficult to integrate because of heterogeneous methods and the lack of a standard for denoting the many phenotypic manifestations. Patient-led studies are of particular importance for understanding the natural history of COVID-19, but integration is hampered because they often use different terms to describe the same symptom or condition. This significant disparity in patient versus clinical characterization motivated the proposed ontological approach to specifying manifestations, which will improve capture and integration of future long COVID studies.

METHODS

The Human Phenotype Ontology (HPO) is a widely used standard for exchange and analysis of phenotypic abnormalities in human disease but has not yet been applied to the analysis of COVID-19.

FUNDING

We identified 303 articles published before April 29, 2021, curated 59 relevant manuscripts that described clinical manifestations in 81 cohorts three weeks or more following acute COVID-19, and mapped 287 unique clinical findings to HPO terms. We present layperson synonyms and definitions that can be used to link patient self-report questionnaires to standard medical terminology. Long COVID clinical manifestations are not assessed consistently across studies, and most manifestations have been reported with a wide range of synonyms by different authors. Across at least 10 cohorts, authors reported 31 unique clinical features corresponding to HPO terms; the most commonly reported feature was Fatigue (median 45.1%) and the least commonly reported was Nausea (median 3.9%), but the reported percentages varied widely between studies.

INTERPRETATION

Translating long COVID manifestations into computable HPO terms will improve analysis, data capture, and classification of long COVID patients. If researchers, clinicians, and patients share a common language, then studies can be compared/pooled more effectively. Furthermore, mapping lay terminology to HPO will help patients assist clinicians and researchers in creating phenotypic characterizations that are computationally accessible, thereby improving the stratification, diagnosis, and treatment of long COVID.

FUNDING

U24TR002306; UL1TR001439; P30AG024832; GBMF4552; R01HG010067; UL1TR002535; K23HL128909; UL1TR002389; K99GM145411.

ICD-11 extension codes support detailed clinical abstraction and comprehensive classification

Background

The new International Classification of Diseases—11th revision (ICD-11) succeeds ICD-10. In the three decades since ICD-10 was released, demands for detailed information on the clinical history of a morbid patient have increased.

Methods

ICD-11 has now implemented an addendum chapter X called “Extension Codes”. This chapter contains numerous codes containing information on concepts including disease stage, severity, histopathology, medicaments, and anatomical details. When linked to a stem code representing a clinical state, the extension codes add significant detail and allow for multidimensional coding.

Results

This paper discusses the purposes and uses of extension codes and presents three examples of how extension codes can be used in coding clinical detail.

Conclusion

ICD-11 with its extension codes implemented has the potential to improve precision and evidence based health care worldwide.

ICD-11: an international classification of diseases for the twenty-first century

BACKGROUND

The International Classification of Diseases (ICD) has long been the main basis for comparability of statistics on causes of mortality and morbidity between places and over time. This paper provides an overview of the recently completed 11th revision of the ICD, focusing on the main innovations and their implications.

MAIN TEXT

Changes in content reflect knowledge and perspectives on diseases and their causes that have emerged since ICD-10 was developed about 30 years ago. Changes in design and structure reflect the arrival of the networked digital era, for which ICD-11 has been prepared. ICD-11's information framework comprises a semantic knowledge base (the Foundation), a biomedical ontology linked to the Foundation and classifications derived from the Foundation. ICD-11 for Mortality and Morbidity Statistics (ICD-11-MMS) is the primary derived classification and the main successor to ICD-10. Innovations enabled by the new architecture include an online coding tool (replacing the index and providing additional functions), an application program interface to enable remote access to ICD-11 content and services, enhanced capability to capture and combine clinically relevant characteristics of cases and integrated support for multiple languages.

CONCLUSIONS

ICD-11 was adopted by the World Health Assembly in May 2019. Transition to implementation is in progress. ICD-11 can be accessed at icd.who.int.

Associations between HIV infection and clinical spectrum of COVID-19: a population level analysis based on US National COVID Cohort Collaborative (N3C) data

BACKGROUND

Evidence of whether people living with HIV are at elevated risk of adverse COVID-19 outcomes is inconclusive. We aimed to investigate this association using the population-based National COVID Cohort Collaborative (N3C) data in the USA.

METHODS

We included all adult (aged ≥18 years) COVID-19 cases with any health-care encounter from 54 clinical sites in the USA, with data being deposited into the N3C. The outcomes were COVID-19 disease severity, hospitalisation, and mortality. Encounters in the same health-care system beginning on or after January 1, 2018, were also included to provide information about pre-existing health conditions (eg, comorbidities). Logistic regression models were employed to estimate the association of HIV infection and HIV markers (CD4 cell count, viral load) with hospitalisation, mortality, and clinical severity of COVID-19 (multinomial). The models were initially adjusted for demographic characteristics, then subsequently adjusted for smoking, obesity, and a broad range of comorbidities. Interaction terms were added to assess moderation effects by demographic characteristics.

FINDINGS

In the harmonised N3C data release set from Jan 1, 2020, to May 8, 2021, there were 1 436 622 adult COVID-19 cases, of these, 13 170 individuals had HIV infection. A total of 26 130 COVID-19 related deaths occurred, with 445 among people with HIV. After adjusting for all the covariates, people with HIV had higher odds of COVID-19 death (adjusted odds ratio 1·29, 95% CI 1·16-1·44) and hospitalisation (1·20, 1·15-1·26), but lower odds of mild or moderate COVID-19 (0·61, 0·59-0·64) than people without HIV. Interaction terms revealed that the elevated odds were higher among older age groups, male, Black, African American, Hispanic, or Latinx adults. A lower CD4 cell count (<200 cells per μL) was associated with all the adverse COVID-19 outcomes, while viral suppression was only associated with reduced hospitalisation.

INTERPRETATION

Given the COVID-19 pandemic's exacerbating effects on health inequities, public health and clinical communities must strengthen services and support to prevent aggravated COVID-19 outcomes among people with HIV, particularly for those with pronounced immunodeficiency.

FUNDING

National Center for Advancing Translational Sciences, National Institute of Allergy and Infectious Diseases, National Institutes of Health, USA.

Use of Hydroxychloroquine, Remdesivir, and Dexamethasone Among Adults Hospitalized With COVID-19 in the United States : A Retrospective Cohort Study

BACKGROUND

Relatively little is known about the use patterns of potential pharmacologic treatments of COVID-19 in the United States.

OBJECTIVE

To use the National COVID Cohort Collaborative (N3C), a large, multicenter, longitudinal cohort, to characterize the use of hydroxychloroquine, remdesivir, and dexamethasone, overall as well as across individuals, health systems, and time.

DESIGN

Retrospective cohort study.

SETTING

43 health systems in the United States.

PARTICIPANTS

137 870 adults hospitalized with COVID-19 between 1 February 2020 and 28 February 2021.

MEASUREMENTS

Inpatient use of hydroxychloroquine, remdesivir, or dexamethasone.

RESULTS

Among 137 870 persons hospitalized with confirmed or suspected COVID-19, 8754 (6.3%) received hydroxychloroquine, 29 272 (21.2%) remdesivir, and 53 909 (39.1%) dexamethasone during the study period. Since the release of results from the RECOVERY (Randomised Evaluation of COVID-19 Therapy) trial in mid-June, approximately 78% to 84% of people who have had invasive mechanical ventilation have received dexamethasone or other glucocorticoids. The use of hydroxychloroquine increased during March 2020, peaking at 42%, and started declining by April 2020. By contrast, remdesivir and dexamethasone use gradually increased over the study period. Dexamethasone and remdesivir use varied substantially across health centers (intraclass correlation coefficient, 14.2% for dexamethasone and 84.6% for remdesivir).

LIMITATION

Because most N3C data contributors are academic medical centers, findings may not reflect the experience of community hospitals.

CONCLUSION

Dexamethasone, an evidence-based treatment of COVID-19, may be underused among persons who are mechanically ventilated. The use of remdesivir and dexamethasone varied across health systems, suggesting variation in patient case mix, drug access, treatment protocols, and quality of care.

PRIMARY FUNDING SOURCE

National Center for Advancing Translational Sciences; National Heart, Lung, and Blood Institute; and National Institute on Aging.

COVID-19 Disease Severity among People with HIV Infection or Solid Organ Transplant in the United States: A Nationally-representative, Multicenter, Observational Cohort Study

Background

Individuals with immune dysfunction, including people with HIV (PWH) or solid organ transplant recipients (SOT), might have worse outcomes from COVID-19. We compared odds of COVID-19 outcomes between patients with and without immune dysfunction.

Methods

We evaluated data from the National COVID-19 Cohort Collaborative (N3C), a multicenter retrospective cohort of electronic medical record (EMR) data from across the United States, on. 1,446,913 adult patients with laboratory-confirmed SARS-CoV-2 infection. HIV, SOT, comorbidity, and HIV markers were identified from EMR data prior to SARS-CoV-2 infection. COVID-19 disease severity within 45 days of SARS-CoV-2 infection was classified into 5 categories: asymptomatic/mild disease with outpatient care; mild disease with emergency department (ED) visit; moderate disease requiring hospitalization; severe disease requiring ventilation or extracorporeal membrane oxygenation (ECMO); and death. We used multivariable, multinomial logistic regression models to compare odds of COVID-19 outcomes between patients with and without immune dysfunction.

Findings

Compared to patients without immune dysfunction, PWH and SOT had a greater likelihood of having ED visits (adjusted odds ratio [aOR]: 1.28, 95% confidence interval [CI] 1.27-1.29; aOR: 2.61, CI: 2.58-2.65, respectively), requiring ventilation or ECMO (aOR: 1.43, CI: 1.43-1.43; aOR: 4.82, CI: 4.78-4.86, respectively), and death (aOR: 1.20, CI: 1.19-1.20; aOR: 3.38, CI: 3.35-3.41, respectively). Associations were independent of sociodemographic and comorbidity burden. Compared to PWH with CD4>500 cells/mm3, PWH with CD4<350 cells/mm3 were independently at 4.4-, 5.4-, and 7.6-times higher odds for hospitalization, requiring ventilation, and death, respectively. Increased COVID-19 severity was associated with higher levels of HIV viremia.

Interpretation

Individuals with immune dysfunction have greater risk for severe COVID-19 outcomes. More advanced HIV disease (greater immunosuppression and HIV viremia) was associated with higher odds of severe COVID-19 outcomes. Appropriate prevention and treatment strategies should be investigated to reduce the higher morbidity and mortality associated with COVID-19 among PWH and SOT.

Children with SARS-CoV-2 in the National COVID Cohort Collaborative (N3C)

IMPORTANCE

SARS-CoV-2.

OBJECTIVE

To determine the characteristics, changes over time, outcomes, and severity risk factors of SARS-CoV-2 affected children within the National COVID Cohort Collaborative (N3C).

DESIGN

Prospective cohort study of patient encounters with end dates before May 27th, 2021.

SETTING

45 N3C institutions.

PARTICIPANTS

Children <19-years-old at initial SARS-CoV-2 testing.

MAIN OUTCOMES AND MEASURES

Case incidence and severity over time, demographic and comorbidity severity risk factors, vital sign and laboratory trajectories, clinical outcomes, and acute COVID-19 vs MIS-C contrasts for children infected with SARS-CoV-2.

RESULTS

728,047 children in the N3C were tested for SARS-CoV-2; of these, 91,865 (12.6%) were positive. Among the 5,213 (6%) hospitalized children, 685 (13%) met criteria for severe disease: mechanical ventilation (7%), vasopressor/inotropic support (7%), ECMO (0.6%), or death/discharge to hospice (1.1%). Male gender, African American race, older age, and several pediatric complex chronic condition (PCCC) subcategories were associated with higher clinical severity (p ≤ 0.05). Vital signs (all p≤0.002) and many laboratory tests from the first day of hospitalization were predictive of peak disease severity. Children with severe (vs moderate) disease were more likely to receive antimicrobials (71% vs 32%, p<0.001) and immunomodulatory medications (53% vs 16%, p<0.001). Compared to those with acute COVID-19, children with MIS-C were more likely to be male, Black/African American, 1-to-12-years-old, and less likely to have asthma, diabetes, or a PCCC (p < 0.04). MIS-C cases demonstrated a more inflammatory laboratory profile and more severe clinical phenotype with higher rates of invasive ventilation (12% vs 6%) and need for vasoactive-inotropic support (31% vs 6%) compared to acute COVID-19 cases, respectively (p<0.03).

CONCLUSIONS

In the largest U.S. SARS-CoV-2-positive pediatric cohort to date, we observed differences in demographics, pre-existing comorbidities, and initial vital sign and laboratory test values between severity subgroups. Taken together, these results suggest that early identification of children likely to progress to severe disease could be achieved using readily available data elements from the day of admission. Further work is needed to translate this knowledge into improved outcomes.

The WHO ICD-11 Classification of Dermatological Disorders: a new comprehensive online skin disease taxonomy designed by and for dermatologists

In May 2019, the World Health Assembly officially adopted the Eleventh Revision of the International Classification of Diseases (ICD-11)¹ . When the current 10th Revision (ICD-10) was released some three decades ago, the world was at the beginning of the modern information technology era. The World Health Organization (WHO) had long recognised that the "one size fits all" nature of ICD-10 and its inability to adapt to change seriously hampered its usefulness in healthcare research and management. The initial designs for ICD-11 were formulated by the WHO in 2007. Since then, many individuals from around the globe have participated in its development.

Clinical Characterization and Prediction of Clinical Severity of SARS-CoV-2 Infection Among US Adults Using Data From the US National COVID Cohort Collaborative

Importance

The National COVID Cohort Collaborative (N3C) is a centralized, harmonized, high-granularity electronic health record repository that is the largest, most representative COVID-19 cohort to date. This multicenter data set can support robust evidence-based development of predictive and diagnostic tools and inform clinical care and policy.

Objectives

To evaluate COVID-19 severity and risk factors over time and assess the use of machine learning to predict clinical severity.

Design, Setting, and Participants

In a retrospective cohort study of 1 926 526 US adults with SARS-CoV-2 infection (polymerase chain reaction >99% or antigen <1%) and adult patients without SARS-CoV-2 infection who served as controls from 34 medical centers nationwide between January 1, 2020, and December 7, 2020, patients were stratified using a World Health Organization COVID-19 severity scale and demographic characteristics. Differences between groups over time were evaluated using multivariable logistic regression. Random forest and XGBoost models were used to predict severe clinical course (death, discharge to hospice, invasive ventilatory support, or extracorporeal membrane oxygenation).

Main Outcomes and Measures

Patient demographic characteristics and COVID-19 severity using the World Health Organization COVID-19 severity scale and differences between groups over time using multivariable logistic regression.

Results

The cohort included 174 568 adults who tested positive for SARS-CoV-2 (mean [SD] age, 44.4 [18.6] years; 53.2% female) and 1 133 848 adult controls who tested negative for SARS-CoV-2 (mean [SD] age, 49.5 [19.2] years; 57.1% female). Of the 174 568 adults with SARS-CoV-2, 32 472 (18.6%) were hospitalized, and 6565 (20.2%) of those had a severe clinical course (invasive ventilatory support, extracorporeal membrane oxygenation, death, or discharge to hospice). Of the hospitalized patients, mortality was 11.6% overall and decreased from 16.4% in March to April 2020 to 8.6% in September to October 2020 (P = .002 for monthly trend). Using 64 inputs available on the first hospital day, this study predicted a severe clinical course using random forest and XGBoost models (area under the receiver operating curve = 0.87 for both) that were stable over time. The factor most strongly associated with clinical severity was pH; this result was consistent across machine learning methods. In a separate multivariable logistic regression model built for inference, age (odds ratio [OR], 1.03 per year; 95% CI, 1.03-1.04), male sex (OR, 1.60; 95% CI, 1.51-1.69), liver disease (OR, 1.20; 95% CI, 1.08-1.34), dementia (OR, 1.26; 95% CI, 1.13-1.41), African American (OR, 1.12; 95% CI, 1.05-1.20) and Asian (OR, 1.33; 95% CI, 1.12-1.57) race, and obesity (OR, 1.36; 95% CI, 1.27-1.46) were independently associated with higher clinical severity.

Conclusions and Relevance

This cohort study found that COVID-19 mortality decreased over time during 2020 and that patient demographic characteristics and comorbidities were associated with higher clinical severity. The machine learning models accurately predicted ultimate clinical severity using commonly collected clinical data from the first 24 hours of a hospital admission.

Association Between Glucagon-Like Peptide 1 Receptor Agonist and Sodium-Glucose Cotransporter 2 Inhibitor Use and COVID-19 Outcomes

OBJECTIVE

To determine the respective associations of premorbid glucagon-like peptide-1 receptor agonist (GLP1-RA) and sodium-glucose cotransporter 2 inhibitor (SGLT2i) use, compared with premorbid dipeptidyl peptidase 4 inhibitor (DPP4i) use, with severity of outcomes in the setting of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection.

RESEARCH DESIGN AND METHODS

We analyzed observational data from SARS-CoV-2-positive adults in the National COVID Cohort Collaborative (N3C), a multicenter, longitudinal U.S. cohort (January 2018-February 2021), with a prescription for GLP1-RA, SGLT2i, or DPP4i within 24 months of positive SARS-CoV-2 PCR test. The primary outcome was 60-day mortality, measured from positive SARS-CoV-2 test date. Secondary outcomes were total mortality during the observation period and emergency room visits, hospitalization, and mechanical ventilation within 14 days. Associations were quantified with odds ratios (ORs) estimated with targeted maximum likelihood estimation using a super learner approach, accounting for baseline characteristics.

RESULTS

The study included 12,446 individuals (53.4% female, 62.5% White, mean ± SD age 58.6 ± 13.1 years). The 60-day mortality was 3.11% (387 of 12,446), with 2.06% (138 of 6,692) for GLP1-RA use, 2.32% (85 of 3,665) for SGLT2i use, and 5.67% (199 of 3,511) for DPP4i use. Both GLP1-RA and SGLT2i use were associated with lower 60-day mortality compared with DPP4i use (OR 0.54 [95% CI 0.37-0.80] and 0.66 [0.50-0.86], respectively). Use of both medications was also associated with decreased total mortality, emergency room visits, and hospitalizations.

CONCLUSIONS

Among SARS-CoV-2-positive adults, premorbid GLP1-RA and SGLT2i use, compared with DPP4i use, was associated with lower odds of mortality and other adverse outcomes, although DPP4i users were older and generally sicker.

Preferences for Updates on General Research Results: A Survey of Participants in Genomic Research from Two Institutions

There is a need for multimodal strategies to keep research participants informed about study results. Our aim was to characterize preferences of genomic research participants from two institutions along four dimensions of general research result updates: content, timing, mechanism, and frequency.

METHODS

We conducted a web-based cross-sectional survey that was administered from 25 June 2018 to 5 December 2018.

RESULTS

397 participants completed the survey, most of whom (96%) expressed a desire to receive research updates. Preferences with high endorsement included: update content (brief descriptions of major findings, descriptions of purpose and goals, and educational material); update timing (when the research is completed, when findings are reviewed, when findings are published, and when the study status changes); update mechanism (email with updates, and email newsletter); and update frequency (every three months). Hierarchical cluster analyses based on the four update preferences identified four profiles of participants with similar preference patterns. Very few participants in the largest profile were comfortable with budgeting less money for research activities so that researchers have money to set up services to send research result updates to study participants.

CONCLUSION

Future studies may benefit from exploring preferences for research result updates, as we have in our study. In addition, this work provides evidence of a need for funders to incentivize researchers to communicate results to participants.

Drug repositioning candidates identified using in-silico quasi-quantum molecular simulation demonstrate reduced COVID-19 mortality in 1.5M patient records

Background

Drug repositioning is a key component of COVID-19 pandemic response, through identification of existing drugs that can effectively disrupt COVID-19 disease processes, contributing valuable insights into disease pathways. Traditional non in silico drug repositioning approaches take substantial time and cost to discover effect and, crucially, to validate repositioned effects.

Methods

Using a novel in-silico quasi-quantum molecular simulation platform that analyzes energies and electron densities of both target proteins and candidate interruption compounds on High Performance Computing (HPC), we identified a list of FDA-approved compounds with potential to interrupt specific SARS-CoV-2 proteins. Subsequently we used 1.5M patient records from the National COVID Cohort Collaborative to create matched cohorts to refine our in-silico hits to those candidates that show statistically significant clinical effect.

Results

We identified four drugs, Metformin, Triamcinolone, Amoxicillin and Hydrochlorothiazide, that were associated with reduced mortality by 27%, 26%, 26%, and 23%, respectively, in COVID-19 patients.

Conclusions

Together, these findings provide support to our hypothesis that in-silico simulation of active compounds against SARS-CoV-2 proteins followed by statistical analysis of electronic health data results in effective therapeutics identification.