Deep generative models for peptide design

Recent Progress in Peptide-Based Molecular Probes for Disease Bioimaging

Recent strides in molecular pathology have unveiled distinctive alterations at the molecular level throughout the onset and progression of diseases. Enhancing the in vivo visualization of these biomarkers is crucial for advancing disease classification, staging, and treatment strategies. Peptide-based molecular probes (PMPs) have emerged as versatile tools due to their exceptional ability to discern these molecular changes with unparalleled specificity and precision. In this Perspective, we first summarize the methodologies for crafting innovative functional peptides, emphasizing recent advancements in both peptide library technologies and computer-assisted peptide design approaches. Furthermore, we offer an overview of the latest advances in PMPs within the realm of biological imaging, showcasing their varied applications in diagnostic and therapeutic modalities. We also briefly address current challenges and potential future directions in this dynamic field.

Automatic generation of functional peptides with desired bioactivity and membrane permeability using Bayesian optimization

Peptides are potentially useful modalities of drugs; however, cell membrane permeability is an obstacle in peptide drug discovery. The identification of bioactive peptides for a therapeutic target is also challenging because of the huge amino acid sequence patterns of peptides. In this study, we propose a novel computational method, PEptide generation system using Neural network Trained on Amino acid sequence data and Gaussian process-based optimizatiON (PENTAGON), to automatically generate new peptides with desired bioactivity and cell membrane permeability. In the algorithm, we mapped peptide amino acid sequences onto the latent space constructed using a variational autoencoder and searched for peptides with desired bioactivity and cell membrane permeability using Bayesian optimization. We used our proposed method to generate peptides with cell membrane permeability and bioactivity for each of the nine therapeutic targets, such as the estrogen receptor (ER). Our proposed method outperformed a previously developed peptide generator in terms of similarity to known active peptide sequences and the length of generated peptide sequences.

Challenges in computational discovery of bioactive peptides in 'omics data

Peptides have a plethora of activities in biological systems that can potentially be exploited biotechnologically. Several peptides are used clinically, as well as in industry and agriculture. The increase in available 'omics data has recently provided a large opportunity for mining novel enzymes, biosynthetic gene clusters, and molecules. While these data primarily consist of DNA sequences, other types of data provide important complementary information. Due to their size, the approaches proven successful at discovering novel proteins of canonical size cannot be naïvely applied to the discovery of peptides. Peptides can be encoded directly in the genome as short open reading frames (smORFs), or they can be derived from larger proteins by proteolysis. Both of these peptide classes pose challenges as simple methods for their prediction result in large numbers of false positives. Similarly, functional annotation of larger proteins, traditionally based on sequence similarity to infer orthology and then transferring functions between characterized proteins and uncharacterized ones, cannot be applied for short sequences. The use of these techniques is much more limited and alternative approaches based on machine learning are used instead. Here, we review the limitations of traditional methods as well as the alternative methods that have recently been developed for discovering novel bioactive peptides with a focus on prokaryotic genomes and metagenomes.

Computational Design of Peptides for Biomaterials Applications

Computer-aided molecular design and protein engineering emerge as promising and active subjects in bioengineering and biotechnological applications. On one hand, due to the advancing computing power in the past decade, modeling toolkits and force fields have been put to use for accurate multiscale modeling of biomolecules including lipid, protein, carbohydrate, and nucleic acids. On the other hand, machine learning emerges as a revolutionary data analysis tool that promises to leverage physicochemical properties and structural information obtained from modeling in order to build quantitative protein structure-function relationships. We review recent computational works that utilize state-of-the-art computational methods to engineer peptides and proteins for various emerging biomedical, antimicrobial, and antifreeze applications. We also discuss challenges and possible future directions toward developing a roadmap for efficient biomolecular design and engineering.

Revolutionizing Peptide-Based Drug Discovery: Advances in the Post-AlphaFold Era

Peptide-based drugs offer high specificity, potency, and selectivity. However, their inherent flexibility and differences in conformational preferences between their free and bound states create unique challenges that have hindered progress in effective drug discovery pipelines. The emergence of AlphaFold (AF) and Artificial Intelligence (AI) presents new opportunities for enhancing peptide-based drug discovery. We explore recent advancements that facilitate a successful peptide drug discovery pipeline, considering peptides' attractive therapeutic properties and strategies to enhance their stability and bioavailability. AF enables efficient and accurate prediction of peptide-protein structures, addressing a critical requirement in computational drug discovery pipelines. In the post-AF era, we are witnessing rapid progress with the potential to revolutionize peptide-based drug discovery such as the ability to rank peptide binders or classify them as binders/non-binders and the ability to design novel peptide sequences. However, AI-based methods are struggling due to the lack of well-curated datasets, for example to accommodate modified amino acids or unconventional cyclization. Thus, physics-based methods, such as docking or molecular dynamics simulations, continue to hold a complementary role in peptide drug discovery pipelines. Moreover, MD-based tools offer valuable insights into binding mechanisms, as well as the thermodynamic and kinetic properties of complexes. As we navigate this evolving landscape, a synergistic integration of AI and physics-based methods holds the promise of reshaping the landscape of peptide-based drug discovery.

Leveraging attention-enhanced variational autoencoders: Novel approach for investigating latent space of aptamer sequences

Aptamers are increasingly recognized as potent alternatives to antibodies for diagnostic and therapeutic applications. The application of deep learning, particularly attention-based models, for aptamer (DNA/RNA) sequences is an innovative field. The ongoing advancements in aptamer sequencing technologies coupled with machine learning algorithms have resulted in novel developments. Further research is required to investigate the full potential of deep learning models and address the challenges associated with the generation of sequences, like the large search space of possible sequences. In this study, we propose a workflow that integrates an attention mechanism within a framework of a generative variational autoencoder, to generate novel sequences by expanding latent memory. They show 100 % novelty compared with the dataset, and approximately 88 % of them show negative values for the minimum free energy, which may indicate the likelihood of an RNA sequence folding into a functional structure. Because the field of aptamer discovery is affected by data scarcity, advanced strategies that facilitate the generation of diverse and superior sequences are necessitated. The utilization of our workflow can result in novel aptamers. Thus, investigations such as the present study can address the abovementioned challenge. Our research is anticipated to facilitate further discoveries and advancements in aptamer fields.

Artificial intelligence-driven antimicrobial peptide discovery

Antimicrobial peptides (AMPs) emerge as promising agents against antimicrobial resistance, providing an alternative to conventional antibiotics. Artificial intelligence (AI) revolutionized AMP discovery through both discrimination and generation approaches. The discriminators aid in the identification of promising candidates by predicting key peptide properties such as activity and toxicity, while the generators learn the distribution of peptides and enable sampling novel AMP candidates, either de novo or as analogs of a prototype peptide. Moreover, the controlled generation of AMPs with desired properties is achieved by discriminator-guided filtering, positive-only learning, latent space sampling, as well as conditional and optimized generation. Here we review recent achievements in AI-driven AMP discovery, highlighting the most exciting directions.

VirusHound-I: prediction of viral proteins involved in the evasion of host adaptive immune response using the random forest algorithm and generative adversarial network for data augmentation

Throughout evolution, pathogenic viruses have developed different strategies to evade the response of the adaptive immune system. To carry out successful replication, some pathogenic viruses encode different proteins that manipulate the molecular mechanisms of host cells. Currently, there are different bioinformatics tools for virus research; however, none of them focus on predicting viral proteins that evade the adaptive system. In this work, we have developed a novel tool based on machine and deep learning for predicting this type of viral protein named VirusHound-I. This tool is based on a model developed with the multilayer perceptron algorithm using the dipeptide composition molecular descriptor. In this study, we have also demonstrated the robustness of our strategy for data augmentation of the positive dataset based on generative antagonistic networks. During the 10-fold cross-validation step in the training dataset, the predictive model showed 0.947 accuracy, 0.994 precision, 0.943 F1 score, 0.995 specificity, 0.896 sensitivity, 0.894 kappa, 0.898 Matthew's correlation coefficient and 0.989 AUC. On the other hand, during the testing step, the model showed 0.964 accuracy, 1.0 precision, 0.967 F1 score, 1.0 specificity, 0.936 sensitivity, 0.929 kappa, 0.931 Matthew's correlation coefficient and 1.0 AUC. Taking this model into account, we have developed a tool called VirusHound-I that makes it possible to predict viral proteins that evade the host's adaptive immune system. We believe that VirusHound-I can be very useful in accelerating studies on the molecular mechanisms of evasion of pathogenic viruses, as well as in the discovery of therapeutic targets.

Antibiotic failure: Beyond antimicrobial resistance

Despite significant progress in antibiotic discovery, millions of lives are lost annually to infections. Surprisingly, the failure of antimicrobial treatments to effectively eliminate pathogens frequently cannot be attributed to genetically-encoded antibiotic resistance. This review aims to shed light on the fundamental mechanisms contributing to clinical scenarios where antimicrobial therapies are ineffective (i.e., antibiotic failure), emphasizing critical factors impacting this under-recognized issue. Explored aspects include biofilm formation and sepsis, as well as the underlying microbiome. Therapeutic strategies beyond antibiotics, are examined to address the dimensions and resolution of antibiotic failure, actively contributing to this persistent but escalating crisis. We discuss the clinical relevance of antibiotic failure beyond resistance, limited availability of therapies, potential of new antibiotics to be ineffective, and the urgent need for novel anti-infectives or host-directed therapies directly addressing antibiotic failure. Particularly noteworthy is multidrug adaptive resistance in biofilms that represent 65 % of infections, due to the lack of approved therapies. Sepsis, responsible for 19.7 % of all deaths (as well as severe COVID-19 deaths), is a further manifestation of this issue, since antibiotics are the primary frontline therapy, and yet 23 % of patients succumb to this condition.

Human gut metagenomic mining reveals an untapped source of peptide antibiotics

Drug-resistant bacteria are outpacing traditional antibiotic discovery efforts. Here, we computationally mined 444,054 families of putative small proteins from 1,773 human gut metagenomes, identifying 323 peptide antibiotics encoded in small open reading frames (smORFs). To test our computational predictions, 78 peptides were synthesized and screened for antimicrobial activity in vitro, with 59% displaying activity against either pathogens or commensals. Since these peptides were unique compared to previously reported antimicrobial peptides, we termed them smORF-encoded peptides (SEPs). SEPs killed bacteria by targeting their membrane, synergized with each other, and modulated gut commensals, indicating that they may play a role in reconfiguring microbiome communities in addition to counteracting pathogens. The lead candidates were anti-infective in both murine skin abscess and deep thigh infection models. Notably, prevotellin-2 from Prevotella copri presented activity comparable to the commonly used antibiotic polymyxin B. We report the discovery of hundreds of peptide sequences in the human gut.

Computationally Designed AMPs with Antibacterial and Antibiofilm Activity against MDR Acinetobacter baumannii

The discovery of new antimicrobials is necessary to combat multidrug-resistant (MDR) bacteria, especially those that infect wounds and form prodigious biofilms, such as Acinetobacter baumannii. Antimicrobial peptides (AMPs) are a promising class of new therapeutics against drug-resistant bacteria, including gram-negatives. Here, we utilized a computational AMP design strategy combining database filtering technology plus positional analysis to design a series of novel peptides, named HRZN, designed to be active against A. baumannii. All of the HRZN peptides we synthesized exhibited antimicrobial activity against three MDR A. baumannii strains with HRZN-15 being the most active (MIC 4 µg/mL). This peptide also inhibited and eradicated biofilm of A. baumannii strain AB5075 at 8 and 16 µg/mL, which is highly effective. HRZN-15 permeabilized and depolarized the membrane of AB5075 rapidly, as demonstrated by the killing kinetics. HRZN 13 and 14 peptides had little to no hemolysis activity against human red blood cells, whereas HRZN-15, -16, and -17 peptides demonstrated more significant hemolytic activity. HRZN-15 also demonstrated toxicity to waxworms. Further modification of HRZN-15 could result in a new peptide with an improved toxicity profile. Overall, we successfully designed a set of new AMPs that demonstrated activity against MDR A. baumannii using a computational approach.

Leveraging artificial intelligence in the fight against infectious diseases

Despite advances in molecular biology, genetics, computation, and medicinal chemistry, infectious disease remains an ominous threat to public health. Addressing the challenges posed by pathogen outbreaks, pandemics, and antimicrobial resistance will require concerted interdisciplinary efforts. In conjunction with systems and synthetic biology, artificial intelligence (AI) is now leading to rapid progress, expanding anti-infective drug discovery, enhancing our understanding of infection biology, and accelerating the development of diagnostics. In this Review, we discuss approaches for detecting, treating, and understanding infectious diseases, underscoring the progress supported by AI in each case. We suggest future applications of AI and how it might be harnessed to help control infectious disease outbreaks and pandemics.

Geometric deep learning as a potential tool for antimicrobial peptide prediction

Antimicrobial peptides (AMPs) are components of natural immunity against invading pathogens. They are polymers that fold into a variety of three-dimensional structures, enabling their function, with an underlying sequence that is best represented in a non-flat space. The structural data of AMPs exhibits non-Euclidean characteristics, which means that certain properties, e.g., differential manifolds, common system of coordinates, vector space structure, or translation-equivariance, along with basic operations like convolution, in non-Euclidean space are not distinctly established. Geometric deep learning (GDL) refers to a category of machine learning methods that utilize deep neural models to process and analyze data in non-Euclidean settings, such as graphs and manifolds. This emerging field seeks to expand the use of structured models to these domains. This review provides a detailed summary of the latest developments in designing and predicting AMPs utilizing GDL techniques and also discusses both current research gaps and future directions in the field.

Deep learning tools to accelerate antibiotic discovery

INTRODUCTION

As machine learning (ML) and artificial intelligence (AI) expand to many segments of our society, they are increasingly being used for drug discovery. Recent deep learning models offer an efficient way to explore high-dimensional data and design compounds with desired properties, including those with antibacterial activity.

AREAS COVERED

This review covers key frameworks in antibiotic discovery, highlighting physicochemical features and addressing dataset limitations. The deep learning approaches here described include discriminative models such as convolutional neural networks, recurrent neural networks, graph neural networks, and generative models like neural language models, variational autoencoders, generative adversarial networks, normalizing flow, and diffusion models. As the integration of these approaches in drug discovery continues to evolve, this review aims to provide insights into promising prospects and challenges that lie ahead in harnessing such technologies for the development of antibiotics.

EXPERT OPINION

Accurate antimicrobial prediction using deep learning faces challenges such as imbalanced data, limited datasets, experimental validation, target strains, and structure. The integration of deep generative models with bioinformatics, molecular dynamics, and data augmentation holds the potential to overcome these challenges, enhance model performance, and utlimately accelerate antimicrobial discovery.

BioAutoMATED: An end-to-end automated machine learning tool for explanation and design of biological sequences

The design choices underlying machine-learning (ML) models present important barriers to entry for many biologists who aim to incorporate ML in their research. Automated machine-learning (AutoML) algorithms can address many challenges that come with applying ML to the life sciences. However, these algorithms are rarely used in systems and synthetic biology studies because they typically do not explicitly handle biological sequences (e.g., nucleotide, amino acid, or glycan sequences) and cannot be easily compared with other AutoML algorithms. Here, we present BioAutoMATED, an AutoML platform for biological sequence analysis that integrates multiple AutoML methods into a unified framework. Users are automatically provided with relevant techniques for analyzing, interpreting, and designing biological sequences. BioAutoMATED predicts gene regulation, peptide-drug interactions, and glycan annotation, and designs optimized synthetic biology components, revealing salient sequence characteristics. By automating sequence modeling, BioAutoMATED allows life scientists to incorporate ML more readily into their work.

A Systematic Review of Deep Learning Methodologies Used in the Drug Discovery Process with Emphasis on In Vivo Validation

The discovery and development of new drugs are extremely long and costly processes. Recent progress in artificial intelligence has made a positive impact on the drug development pipeline. Numerous challenges have been addressed with the growing exploitation of drug-related data and the advancement of deep learning technology. Several model frameworks have been proposed to enhance the performance of deep learning algorithms in molecular design. However, only a few have had an immediate impact on drug development since computational results may not be confirmed experimentally. This systematic review aims to summarize the different deep learning architectures used in the drug discovery process and are validated with further in vivo experiments. For each presented study, the proposed molecule or peptide that has been generated or identified by the deep learning model has been biologically evaluated in animal models. These state-of-the-art studies highlight that even if artificial intelligence in drug discovery is still in its infancy, it has great potential to accelerate the drug discovery cycle, reduce the required costs, and contribute to the integration of the 3R (Replacement, Reduction, Refinement) principles. Out of all the reviewed scientific articles, seven algorithms were identified: recurrent neural networks, specifically, long short-term memory (LSTM-RNNs), Autoencoders (AEs) and their Wasserstein Autoencoders (WAEs) and Variational Autoencoders (VAEs) variants; Convolutional Neural Networks (CNNs); Direct Message Passing Neural Networks (D-MPNNs); and Multitask Deep Neural Networks (MTDNNs). LSTM-RNNs were the most used architectures with molecules or peptide sequences as inputs.

Novel technologies for applying immune checkpoint blockers

Cancer cells develop several ways to subdue the immune system among others via upregulation of inhibitory immune checkpoint (ICP) proteins. These ICPs paralyze immune effector cells and thereby enable unfettered tumor growth. Monoclonal antibodies (mAbs) that block ICPs can prevent immune exhaustion. Due to their outstanding effects, mAbs revolutionized the field of cancer immunotherapy. However, current ICP therapy regimens suffer from issues related to systemic administration of mAbs, including the onset of immune related adverse events, poor pharmacokinetics, limited tumor accessibility and immunogenicity. These drawbacks and new insights on spatiality prompted the exploration of novel administration routes for mAbs for instance peritumoral delivery. Moreover, novel ICP drug classes that are adept to novel delivery technologies were developed to circumvent the drawbacks of mAbs. We therefore review the state-of-the-art and novel delivery strategies of ICP drugs.

Bacterial resistance to antibacterial agents: Mechanisms, control strategies, and implications for global health

The spread of bacterial drug resistance has posed a severe threat to public health globally. Here, we cover bacterial resistance to current antibacterial drugs, including traditional herbal medicines, conventional antibiotics, and antimicrobial peptides. We summarize the influence of bacterial drug resistance on global health and its economic burden while highlighting the resistance mechanisms developed by bacteria. Based on the One Health concept, we propose 4A strategies to combat bacterial resistance, including prudent Application of antibacterial agents, Administration, Assays, and Alternatives to antibiotics. Finally, we identify several opportunities and unsolved questions warranting future exploration for combating bacterial resistance, such as predicting genetic bacterial resistance through the use of more effective techniques, surveying both genetic determinants of bacterial resistance and the transmission dynamics of antibiotic resistance genes (ARGs).

Deep Learning Concepts and Applications for Synthetic Biology

Synthetic biology has a natural synergy with deep learning. It can be used to generate large data sets to train models, for example by using DNA synthesis, and deep learning models can be used to inform design, such as by generating novel parts or suggesting optimal experiments to conduct. Recently, research at the interface of engineering biology and deep learning has highlighted this potential through successes including the design of novel biological parts, protein structure prediction, automated analysis of microscopy data, optimal experimental design, and biomolecular implementations of artificial neural networks. In this review, we present an overview of synthetic biology-relevant classes of data and deep learning architectures. We also highlight emerging studies in synthetic biology that capitalize on deep learning to enable novel understanding and design, and discuss challenges and future opportunities in this space.

Emerging Computational Approaches for Antimicrobial Peptide Discovery

In the last two decades many reports have addressed the application of artificial intelligence (AI) in the search and design of antimicrobial peptides (AMPs). AI has been represented by machine learning (ML) algorithms that use sequence-based features for the discovery of new peptidic scaffolds with promising biological activity. From AI perspective, evolutionary algorithms have been also applied to the rational generation of peptide libraries aimed at the optimization/design of AMPs. However, the literature has scarcely dedicated to other emerging non-conventional in silico approaches for the search/design of such bioactive peptides. Thus, the first motivation here is to bring up some non-standard peptide features that have been used to build classical ML predictive models. Secondly, it is valuable to highlight emerging ML algorithms and alternative computational tools to predict/design AMPs as well as to explore their chemical space. Another point worthy of mention is the recent application of evolutionary algorithms that actually simulate sequence evolution to both the generation of diversity-oriented peptide libraries and the optimization of hit peptides. Last but not least, included here some new considerations in proteogenomic analyses currently incorporated into the computational workflow for unravelling AMPs in natural sources.