DeepCoVDR: deep transfer learning with graph transformer and cross-attention for predicting COVID-19 drug response

Autoencoder-based drug-virus association prediction with reliable negative sample selection: A case study with COVID-19

Emergence of viruses cause unprecedented challenges and thus leading to wide-ranging consequences today. The world has faced massive disruptions like COVID-19 and continues to suffer in terms of public health and world economy. Fighting with this emergence of viruses and its reemergence plays a critical role in the health care industry. Identification of novel virus-drug associations is a vital step in drug discovery. Prediction and prioritization of novel virus-drug associations through computational approaches is an alternative and best choice considering the cost and risk of biological experiments. This study proposes a method, KR-AEVDA that relies on k-nearest neighbor based reliable negative sample selection and autoencoder based feature extraction to explore promising virus-drug associations for further experimental validation. The method analyzes complex relationships among drugs and viruses by investigating similarity and association data between drugs and viruses. It generates feature vectors from the similarity data, and reliable negative samples are extracted through an effective distance-based algorithm from the unlabeled samples in the dataset. Then high level features are extracted via an autoencoder and is fed to an ensemble classifier for inferring novel associations. Experimental results on three different datasets showed that KR-AEVDA reliably attained better performance than other state-of-the-art methods. Molecular docking is carried out between the top-predicted drugs and the crystal structure of the SARS-CoV-2's main protease to further validate the predictions. Case studies for SARS-CoV-2 illustrate the effectiveness of KR-AEVDA in identifying potential virus-drug associations.

A deep drug prediction framework for viral infectious diseases using an optimizer-based ensemble of convolutional neural network: COVID-19 as a case study

The SARS-CoV-2 outbreak highlights the persistent vulnerability of humanity to epidemics and emerging microbial threats, emphasizing the lack of time to develop disease-specific treatments. Therefore, it appears beneficial to utilize existing resources and therapies. Computational drug repositioning is an effective strategy that redirects authorized drugs to new therapeutic purposes. This strategy holds significant promise for newly emerging diseases, as drug discovery is a lengthy and expensive process. Through this study, we present an ensemble method based on the convolutional neural network integrated with genetic algorithm and deep forest classifier for virus-drug association prediction (CGDVDA). We generated feature vectors by combining drug chemical structure and virus genomic sequence-based similarities, and extracted prominent deep features by applying the convolutional neural network. The convoluted features are optimized using the genetic algorithm and classified using the ensemble deep forest classifier to predict novel virus-drug associations. The proposed method predicts drugs for COVID-19 and other viral diseases in the dataset. The model could achieve ROC-AUC scores of 0.9159 on fivefold cross-validation. We compared the performance of the model with state-of-the-art approaches and classifiers. The experimental results and case studies illustrate the efficacy of CGDVDA in predicting drugs against viral infectious diseases.

AiGPro: a multi-tasks model for profiling of GPCRs for agonist and antagonist

G protein-coupled receptors (GPCRs) play vital roles in various physiological processes, making them attractive drug discovery targets. Meanwhile, deep learning techniques have revolutionized drug discovery by facilitating efficient tools for expediting the identification and optimization of ligands. However, existing models for the GPCRs often focus on single-target or a small subset of GPCRs or employ binary classification, constraining their applicability for high throughput virtual screening. To address these issues, we introduce AiGPro, a novel multitask model designed to predict small molecule agonists (EC50) and antagonists (IC50) across the 231 human GPCRs, making it a first-in-class solution for large-scale GPCR profiling. Leveraging multi-scale context aggregation and bidirectional multi-head cross-attention mechanisms, our approach demonstrates that ensemble models may not be necessary for predicting complex GPCR states and small molecule interactions. Through extensive validation using stratified tenfold cross-validation, AiGPro achieves robust performance with Pearson's correlation coefficient of 0.91, indicating broad generalizability. This breakthrough sets a new standard in the GPCR studies, outperforming previous studies. Moreover, our first-in-class multi-tasking model can predict agonist and antagonist activities across a wide range of GPCRs, offering a comprehensive perspective on ligand bioactivity within this diverse superfamily. To facilitate easy accessibility, we have deployed a web-based platform for model access at https://aicadd.ssu.ac.kr/AiGPro . Scientific Contribution We introduce a deep learning-based multi-task model to generalize the agonist and antagonist bioactivity prediction for GPCRs accurately. The model is implemented on a user-friendly web server to facilitate rapid screening of small-molecule libraries, expediting GPCR-targeted drug discovery. Covering a diverse set of 231 GPCR targets, the platform delivers a robust, scalable solution for advancing GPCR-focused therapeutic development. The proposed framework incorporates an innovative dual-label prediction strategy, enabling the simultaneous classification of molecules as agonists, antagonists, or both. Each prediction is further accompanied by a confidence score, offering a quantitative measure of activity likelihood. This advancement moves beyond conventional models focusing solely on binding affinity, providing a more comprehensive understanding of ligand-receptor interactions. At the core of our model lies the Bi-Directional Multi-Head Cross-Attention (BMCA) module, a novel architecture that captures forward and backward contextual embeddings of protein and ligand features. By leveraging BMCA, the model effectively integrates structural and sequence-level information, ensuring a precise representation of molecular interactions. Results show that this approach is highly accurate in binding affinity predictions and consistent across diverse GPCR families. By unifying agonist and antagonist bioactivity prediction into a single model architecture, we bridge a critical gap in GPCR modeling. This enhances prediction accuracy and accelerates virtual screening workflows, offering a valuable and innovative solution for advancing GPCR-targeted drug discovery.

TransCDR: a deep learning model for enhancing the generalizability of drug activity prediction through transfer learning and multimodal data fusion

BACKGROUND

Accurate and robust drug response prediction is of utmost importance in precision medicine. Although many models have been developed to utilize the representations of drugs and cancer cell lines for predicting cancer drug responses (CDR), their performances can be improved by addressing issues such as insufficient data modality, suboptimal fusion algorithms, and poor generalizability for novel drugs or cell lines.

RESULTS

We introduce TransCDR, which uses transfer learning to learn drug representations and fuses multi-modality features of drugs and cell lines by a self-attention mechanism, to predict the IC50 values or sensitive states of drugs on cell lines. We are the first to systematically evaluate the generalization of the CDR prediction model to novel (i.e., never-before-seen) compound scaffolds and cell line clusters. TransCDR shows better generalizability than 8 state-of-the-art models. TransCDR outperforms its 5 variants that train drug encoders (i.e., RNN and AttentiveFP) from scratch under various scenarios. The most critical contributors among multiple drug notations and omics profiles are Extended Connectivity Fingerprint and genetic mutation. Additionally, the attention-based fusion module further enhances the predictive performance of TransCDR. TransCDR, trained on the GDSC dataset, demonstrates strong predictive performance on the external testing set CCLE. It is also utilized to predict missing CDRs on GDSC. Moreover, we investigate the biological mechanisms underlying drug response by classifying 7675 patients from TCGA into drug-sensitive or drug-resistant groups, followed by a Gene Set Enrichment Analysis.

CONCLUSIONS

TransCDR emerges as a potent tool with significant potential in drug response prediction.

HemoFuse: multi-feature fusion based on multi-head cross-attention for identification of hemolytic peptides

Hemolytic peptides are therapeutic peptides that damage red blood cells. However, therapeutic peptides used in medical treatment must exhibit low toxicity to red blood cells to achieve the desired therapeutic effect. Therefore, accurate prediction of the hemolytic activity of therapeutic peptides is essential for the development of peptide therapies. In this study, a multi-feature cross-fusion model, HemoFuse, for hemolytic peptide identification is proposed. The feature vectors of peptide sequences are transformed by word embedding technique and four hand-crafted feature extraction methods. We apply multi-head cross-attention mechanism to hemolytic peptide identification for the first time. It captures the interaction between word embedding features and hand-crafted features by calculating the attention of all positions in them, so that multiple features can be deeply fused. Moreover, we visualize the features obtained by this module to enhance its interpretability. On the comprehensive integrated dataset, HemoFuse achieves ideal results, with ACC, SP, SN, MCC, F1, AUC, and AP of 0.7575, 0.8814, 0.5793, 0.4909, 0.6620, 0.8387, and 0.7118, respectively. Compared with HemoDL proposed by Yang et al., it is 3.32%, 3.89%, 5.93%, 10.6%, 8.17%, 5.88%, and 2.72% higher. Other ablation experiments also prove that our model is reasonable and efficient. The codes and datasets are accessible at https://github.com/z11code/Hemo .

Perturbed Lipid Metabolism Transduction Pathways in SARS-CoV-2 Infection and Their Possible Treating Nutraceuticals

The coronavirus disease 2019 (COVID-19) epidemic has evolved into an international public health concern. Its causing agent was SARS-CoV-2 (severe acute respiratory syndrome coronavirus 2), a lipid bilayer encapsulated virus. Lipids have relevance in the host's viral cycle; additionally; viruses have been speculated to manipulate lipid signaling and production to influence the lipidome of host cells. SARS-CoV-2 engages the host lipid pathways for replication, like fatty acid synthesis activation via upregulation of AKT and SREBP pathway and inhibiting lipid catabolism by AMPK and PPAR deactivation. Consequently, lipoprotein levels are altered in most cases, i.e., raised LDL, TG, VLDL levels and reduced HDL levels like a hyperlipidemic state. Apo lipoproteins, a subsiding structural part of lipoproteins, may also impact viral spike protein binding to host cell receptors. In a few studies conducted on COVID-19 patients, maintaining Apo lipoprotein levels has also shown antiviral activity against SARS-CoV-2 infection. It was speculated that several potent hypolipidemic drugs, such as statins, hydroxychloroquine, and metformin, could be used as add-on treatment in COVID-19 management. Nutraceuticals like Garlic, Fenugreek, and vinegar have the potency to lower the lipid capability acting via these pathways. A link between COVID-19 and post-COVID alteration in lipoprotein levels has not yet been fully understood. In this review, we try to look over the possible modifications in lipid metabolism due to SARS-CoV-2 viral exposure, besides the prospect of focusing on the potential of lipid metabolic processes to interrupt the viral cycle.

Transfer learning of condition-specific perturbation in gene interactions improves drug response prediction

SUMMARY

Drug response is conventionally measured at the cell level, often quantified by metrics like IC50. However, to gain a deeper understanding of drug response, cellular outcomes need to be understood in terms of pathway perturbation. This perspective leads us to recognize a challenge posed by the gap between two widely used large-scale databases, LINCS L1000 and GDSC, measuring drug response at different levels-L1000 captures information at the gene expression level, while GDSC operates at the cell line level. Our study aims to bridge this gap by integrating the two databases through transfer learning, focusing on condition-specific perturbations in gene interactions from L1000 to interpret drug response integrating both gene and cell levels in GDSC. This transfer learning strategy involves pretraining on the transcriptomic-level L1000 dataset, with parameter-frozen fine-tuning to cell line-level drug response. Our novel condition-specific gene-gene attention (CSG2A) mechanism dynamically learns gene interactions specific to input conditions, guided by both data and biological network priors. The CSG2A network, equipped with transfer learning strategy, achieves state-of-the-art performance in cell line-level drug response prediction. In two case studies, well-known mechanisms of drugs are well represented in both the learned gene-gene attention and the predicted transcriptomic profiles. This alignment supports the modeling power in terms of interpretability and biological relevance. Furthermore, our model's unique capacity to capture drug response in terms of both pathway perturbation and cell viability extends predictions to the patient level using TCGA data, demonstrating its expressive power obtained from both gene and cell levels.

AVAILABILITY AND IMPLEMENTATION

The source code for the CSG2A network is available at https://github.com/eugenebang/CSG2A.

Artificial intelligence approaches for molecular representation in drug response prediction

Drug response prediction is essential for drug development and disease treatment. One key question in predicting drug response is the representation of molecules, which has been greatly advanced by artificial intelligence (AI) techniques in recent years. In this review, we first describe different types of representation methods, pinpointing their key principles and discussing their limitations. Thereafter we discuss potential ways how these methods could be further developed. We expect that this review will provide useful guidance for researchers in the community.

GPDRP: a multimodal framework for drug response prediction with graph transformer

BACKGROUND

In the field of computational personalized medicine, drug response prediction (DRP) is a critical issue. However, existing studies often characterize drugs as strings, a representation that does not align with the natural description of molecules. Additionally, they ignore gene pathway-specific combinatorial implication.

RESULTS

In this study, we propose drug Graph and gene Pathway based Drug response prediction method (GPDRP), a new multimodal deep learning model for predicting drug responses based on drug molecular graphs and gene pathway activity. In GPDRP, drugs are represented by molecular graphs, while cell lines are described by gene pathway activity scores. The model separately learns these two types of data using Graph Neural Networks (GNN) with Graph Transformers and deep neural networks. Predictions are subsequently made through fully connected layers.

CONCLUSIONS

Our results indicate that Graph Transformer-based model delivers superior performance. We apply GPDRP on hundreds of cancer cell lines' bulk RNA-sequencing data, and it outperforms some recently published models. Furthermore, the generalizability and applicability of GPDRP are demonstrated through its predictions on unknown drug-cell line pairs and xenografts. This underscores the interpretability achieved by incorporating gene pathways.

Attention is all you need: utilizing attention in AI-enabled drug discovery

Recently, attention mechanism and derived models have gained significant traction in drug development due to their outstanding performance and interpretability in handling complex data structures. This review offers an in-depth exploration of the principles underlying attention-based models and their advantages in drug discovery. We further elaborate on their applications in various aspects of drug development, from molecular screening and target binding to property prediction and molecule generation. Finally, we discuss the current challenges faced in the application of attention mechanisms and Artificial Intelligence technologies, including data quality, model interpretability and computational resource constraints, along with future directions for research. Given the accelerating pace of technological advancement, we believe that attention-based models will have an increasingly prominent role in future drug discovery. We anticipate that these models will usher in revolutionary breakthroughs in the pharmaceutical domain, significantly accelerating the pace of drug development.