SummaryAUC: a tool for evaluating the performance of polygenic risk prediction models in validation datasets with only summary level statistics

Novel Genes Associated With Atrial Fibrillation and the Predictive Models for AF Incorporating Polygenic Risk Score and PheWAS-Derived Risk Factors

BACKGROUND

Atrial fibrillation (AF), the most common atrial arrhythmia, presents with varied clinical manifestations. Despite the identification of genetic loci associated with AF, particularly in specific populations, research within Asian ethnicities remains limited. In this study we aimed to develop predictive models for AF using AF-associated single-nucleotide polymorphisms (SNPs) from a genome-wide association study (GWAS) on a substantial cohort of Taiwanese individuals, to evaluate the predictive efficacy of the model.

METHODS

There were 75,121 subjects, that included 5694 AF patients and 69,427 normal control subjects with GWAS data, and we merged polygenic risk scores from AF-associated SNPs with phenome-wide association study-derived risk factors. Advanced statistical and machine learning techniques were used to develop and evaluate AF predictive models for discrimination and calibration.

RESULTS

The study identified the top 30 significant SNPs associated with AF, predominantly on chromosomes 10 and 16, implicating genes like NEURL1, SH3PXD2A, INA, NT5C2, STN1, and ZFHX3. Notably, INA, NT5C2, and STN1 were newly linked to AF. The GWAS predictive power using polygenic risk score-continuous shrinkage analysis for AF exhibited an area under the curve of 0.600 (P < 0.001), which improved to 0.855 (P < 0.001) after adjusting for age and sex. Phenome-wide association study analysis showed the top 10 diseases associated with these genes were circulatory system diseases.

CONCLUSIONS

Integrating genetic and phenotypic data enhanced the accuracy and clinical relevance of AF predictive models. The findings suggest promise for refining AF risk assessment, enabling personalized interventions, and reducing AF-related morbidity and mortality burdens.

Optimizing and benchmarking polygenic risk scores with GWAS summary statistics

BACKGROUND

Polygenic risk score (PRS) is a major research topic in human genetics. However, a significant gap exists between PRS methodology and applications in practice due to often unavailable individual-level data for various PRS tasks including model fine-tuning, benchmarking, and ensemble learning.

RESULTS

We introduce an innovative statistical framework to optimize and benchmark PRS models using summary statistics of genome-wide association studies. This framework builds upon our previous work and can fine-tune virtually all existing PRS models while accounting for linkage disequilibrium. In addition, we provide an ensemble learning strategy named PUMAS-ensemble to combine multiple PRS models into an ensemble score without requiring external data for model fitting. Through extensive simulations and analysis of many complex traits in the UK Biobank, we demonstrate that this approach closely approximates gold-standard analytical strategies based on external validation, and substantially outperforms state-of-the-art PRS methods.

CONCLUSIONS

Our method is a powerful and general modeling technique that can continue to combine the best-performing PRS methods out there through ensemble learning and could become an integral component for all future PRS applications.

The goldmine of GWAS summary statistics: a systematic review of methods and tools

Genome-wide association studies (GWAS) have revolutionized our understanding of the genetic architecture of complex traits and diseases. GWAS summary statistics have become essential tools for various genetic analyses, including meta-analysis, fine-mapping, and risk prediction. However, the increasing number of GWAS summary statistics and the diversity of software tools available for their analysis can make it challenging for researchers to select the most appropriate tools for their specific needs. This systematic review aims to provide a comprehensive overview of the currently available software tools and databases for GWAS summary statistics analysis. We conducted a comprehensive literature search to identify relevant software tools and databases. We categorized the tools and databases by their functionality, including data management, quality control, single-trait analysis, and multiple-trait analysis. We also compared the tools and databases based on their features, limitations, and user-friendliness. Our review identified a total of 305 functioning software tools and databases dedicated to GWAS summary statistics, each with unique strengths and limitations. We provide descriptions of the key features of each tool and database, including their input/output formats, data types, and computational requirements. We also discuss the overall usability and applicability of each tool for different research scenarios. This comprehensive review will serve as a valuable resource for researchers who are interested in using GWAS summary statistics to investigate the genetic basis of complex traits and diseases. By providing a detailed overview of the available tools and databases, we aim to facilitate informed tool selection and maximize the effectiveness of GWAS summary statistics analysis.

Tuning parameters for polygenic risk score methods using GWAS summary statistics from training data

Various polygenic risk scores (PRS) methods have been proposed to combine the estimated effects of single nucleotide polymorphisms (SNPs) to predict genetic risks for common diseases, using data collected from genome-wide association studies (GWAS). Some methods require external individual-level GWAS dataset for parameter tuning, posing privacy and security-related concerns. Leaving out partial data for parameter tuning can also reduce model prediction accuracy. In this article, we propose PRStuning, a method that tunes parameters for different PRS methods using GWAS summary statistics from the training data. PRStuning predicts the PRS performance with different parameters, and then selects the best-performing parameters. Because directly using training data effects tends to overestimate the performance in the testing data, we adopt an empirical Bayes approach to shrinking the predicted performance in accordance with the genetic architecture of the disease. Extensive simulations and real data applications demonstrate PRStuning's accuracy across PRS methods and parameters.

A new method for multiancestry polygenic prediction improves performance across diverse populations

Polygenic risk scores (PRSs) increasingly predict complex traits; however, suboptimal performance in non-European populations raise concerns about clinical applications and health inequities. We developed CT-SLEB, a powerful and scalable method to calculate PRSs, using ancestry-specific genome-wide association study summary statistics from multiancestry training samples, integrating clumping and thresholding, empirical Bayes and superlearning. We evaluated CT-SLEB and nine alternative methods with large-scale simulated genome-wide association studies (~19 million common variants) and datasets from 23andMe, Inc., the Global Lipids Genetics Consortium, All of Us and UK Biobank, involving 5.1 million individuals of diverse ancestry, with 1.18 million individuals from four non-European populations across 13 complex traits. Results demonstrated that CT-SLEB significantly improves PRS performance in non-European populations compared with simple alternatives, with comparable or superior performance to a recent, computationally intensive method. Moreover, our simulation studies offered insights into sample size requirements and SNP density effects on multiancestry risk prediction.

Genetic risk and gastric cancer: polygenic risk scores in population-based case-control study

OBJECTIVE

This study aimed to screen and identify common variants and long noncoding RNA (lncRNA) single nucleotide polymorphisms (SNPs) associated with gastric cancer risk, and construct prediction models based on polygenic risk score (PRS).

METHODS

The risk factors associated with gastric cancer were screened following meta-analysis and bioinformatics, verified by population-based case-control study. We constructed PRS and weighted genetic risk scores (wGRS) derived from the validation data set. Net reclassification improvement (NRI), integrated discrimination improvement (IDI), Akaike information criterion (AIC) and Bayesian information criterion (BIC) were used to evaluate model.

RESULTS

The PRS was divided into 10 quantiles, with the 40-60% quantile as a reference. A risk gradient was revealed across quantile of the PRS, the risk of gastric cancer in the highest 10 quantile of PRS was 3.24-fold higher than that in control population (OR = 3.24, 95%CI: 2.07, 5.06). For NRI and IDI, PRS combinations were significantly improved compared to wGRS model combinations (P < 0.001). The model of PRS combined with lncRNA SNPs, smoking, drinking and Helicobacter pylori infection was the best-fitting model (AIC = 117.23, BIC = 122.31).

CONCLUSION

The model based on PRS combined with lncRNA SNPs, H. pylori infection, smoking, and drinking had the optimal predictive ability for gastric cancer risk, which was helpful to distinguish high-risk groups.

Genetic prediction of complex traits with polygenic scores: a statistical review

Accurate genetic prediction of complex traits can facilitate disease screening, improve early intervention, and aid in the development of personalized medicine. Genetic prediction of complex traits requires the development of statistical methods that can properly model polygenic architecture and construct a polygenic score (PGS). We present a comprehensive review of 46 methods for PGS construction. We connect the majority of these methods through a multiple linear regression framework which can be instrumental for understanding their prediction performance for traits with distinct genetic architectures. We discuss the practical considerations of PGS analysis as well as challenges and future directions of PGS method development. We hope our review serves as a useful reference both for statistical geneticists who develop PGS methods and for data analysts who perform PGS analysis.

PUMAS: fine-tuning polygenic risk scores with GWAS summary statistics

Polygenic risk scores (PRSs) have wide applications in human genetics research, but often include tuning parameters which are difficult to optimize in practice due to limited access to individual-level data. Here, we introduce PUMAS, a novel method to fine-tune PRS models using summary statistics from genome-wide association studies (GWASs). Through extensive simulations, external validations, and analysis of 65 traits, we demonstrate that PUMAS can perform various model-tuning procedures using GWAS summary statistics and effectively benchmark and optimize PRS models under diverse genetic architecture. Furthermore, we show that fine-tuned PRSs will significantly improve statistical power in downstream association analysis.

A penalized regression framework for building polygenic risk models based on summary statistics from genome-wide association studies and incorporating external information

Large-scale genome-wide association (GWAS) studies provide opportunities for developing genetic risk prediction models that have the potential to improve disease prevention, intervention or treatment. The key step is to develop polygenic risk score (PRS) models with high predictive performance for a given disease, which typically requires a large training data set for selecting truly associated single nucleotide polymorphisms (SNPs) and estimating effect sizes accurately. Here, we develop a comprehensive penalized regression for fitting l ₁ regularized regression models to GWAS summary statistics. We propose incorporating Pleiotropy and ANnotation information into PRS (PANPRS) development through suitable formulation of penalty functions and associated tuning parameters. Extensive simulations show that PANPRS performs equally well or better than existing PRS methods when no functional annotation or pleiotropy is incorporated. When functional annotation data and pleiotropy are informative, PANPRS substantially outperforms existing PRS methods in simulations. Finally, we applied our methods to build PRS for type 2 diabetes and melanoma and found that incorporating relevant functional annotations and GWAS of genetically related traits improved prediction of these two complex diseases.

Penalized regression and model selection methods for polygenic scores on summary statistics

Polygenic scores quantify the genetic risk associated with a given phenotype and are widely used to predict the risk of complex diseases. There has been recent interest in developing methods to construct polygenic risk scores using summary statistic data. We propose a method to construct polygenic risk scores via penalized regression using summary statistic data and publicly available reference data. Our method bears similarity to existing method LassoSum, extending their framework to the Truncated Lasso Penalty (TLP) and the elastic net. We show via simulation and real data application that the TLP improves predictive accuracy as compared to the LASSO while imposing additional sparsity where appropriate. To facilitate model selection in the absence of validation data, we propose methods for estimating model fitting criteria AIC and BIC. These methods approximate the AIC and BIC in the case where we have a polygenic risk score estimated on summary statistic data and no validation data. Additionally, we propose the so-called quasi-correlation metric, which quantifies the predictive accuracy of a polygenic risk score applied to out-of-sample data for which we have only summary statistic information. In total, these methods facilitate estimation and model selection of polygenic risk scores on summary statistic data, and the application of these polygenic risk scores to out-of-sample data for which we have only summary statistic information. We demonstrate the utility of these methods by applying them to GWA studies of lipids, height, and lung cancer.

Genetic risk scores and hallucinations in patients with Parkinson disease

Objective

We examine the hypothesized overlap of genetic architecture for Alzheimer disease (AD), schizophrenia (SZ), and Parkinson disease (PD) through the use of polygenic risk scores (PRSs) with the occurrence of hallucinations in PD.

Methods

We used 2 population-based studies (ParkWest, Norway, and Parkinson's Environment and Gene, USA) providing us with 399 patients with PD with European ancestry and a PD diagnosis after age 55 years to assess the associations between 4 PRSs and hallucinations after 5 years of mean disease duration. Based on the existing genome-wide association study of other large consortia, 4 PRSs were created: one each using AD, SZ, and PD cohorts and another PRS for height, which served as a negative control.

Results

A higher prevalence of hallucinations was observed with each SD increase of the AD-PRS (odds ratio [OR]: 1.37, 95% confidence interval [CI]: 1.03-1.83). This effect was mainly driven by APOE (OR: 1.92, 95% CI: 1.14-3.22). In addition, a suggestive decrease and increase, respectively, in hallucination prevalence were observed with the SZ-PRS and the PD-PRS (OR: 0.77, 95% CI: 0.59-1.01; and OR: 1.29, 95% CI: 0.95-1.76, respectively). No association was observed with the height PRS.

Conclusions

These results suggest that mechanisms for hallucinations in PD may in part be driven by the same genetic architecture that leads to cognitive decline in AD, especially by APOE.

Assessing the performance of genome-wide association studies for predicting disease risk

To date more than 3700 genome-wide association studies (GWAS) have been published that look at the genetic contributions of single nucleotide polymorphisms (SNPs) to human conditions or human phenotypes. Through these studies many highly significant SNPs have been identified for hundreds of diseases or medical conditions. However, the extent to which GWAS-identified SNPs or combinations of SNP biomarkers can predict disease risk is not well known. One of the most commonly used approaches to assess the performance of predictive biomarkers is to determine the area under the receiver-operator characteristic curve (AUROC). We have developed an R package called G-WIZ to generate ROC curves and calculate the AUROC using summary-level GWAS data. We first tested the performance of G-WIZ by using AUROC values derived from patient-level SNP data, as well as literature-reported AUROC values. We found that G-WIZ predicts the AUROC with <3% error. Next, we used the summary level GWAS data from GWAS Central to determine the ROC curves and AUROC values for 569 different GWA studies spanning 219 different conditions. Using these data we found a small number of GWA studies with SNP-derived risk predictors that have very high AUROCs (>0.75). On the other hand, the average GWA study produces a multi-SNP risk predictor with an AUROC of 0.55. Detailed AUROC comparisons indicate that most SNP-derived risk predictions are not as good as clinically based disease risk predictors. All our calculations (ROC curves, AUROCs, explained heritability) are in a publicly accessible database called GWAS-ROCS (http://gwasrocs.ca). The G-WIZ code is freely available for download at https://github.com/jonaspatronjp/GWIZ-Rscript/.