Discovery of Novel Gain-of-Function Mutations Guided by Structure-Based Deep Learning

GMMA Can Stabilize Proteins Across Different Functional Constraints

Stabilizing proteins without otherwise hampering their function is a central task in protein engineering and design. PYR1 is a plant hormone receptor that has been engineered to bind diverse small molecule ligands. We sought a set of generalized mutations that would provide stability without affecting functionality for PYR1 variants with diverse ligand-binding capabilities. To do this we used a global multi-mutant analysis (GMMA) approach, which can identify substitutions that have stabilizing effects and do not lower function. GMMA has the added benefit of finding substitutions that are stabilizing in different sequence contexts and we hypothesized that applying GMMA to PYR1 with different functionalities would identify this set of generalized mutations. Indeed, conducting FACS and deep sequencing of libraries for PYR1 variants with two different functionalities and applying a GMMA analysis identified 5 substitutions that, when inserted into four PYR1 variants that each bind a unique ligand, provided an increase of 2-6 °C in thermal inactivation temperature and no decrease in functionality.

Enhancing PET Degrading Enzymes: A Combinatory Approach

Plastic waste has become a substantial environmental issue. A potential strategy to mitigate this problem is to use enzymatic hydrolysis of plastics to depolymerize post-consumer waste and allow it to be reused. Over the last few decades, the use of enzymatic PET-degrading enzymes has shown promise as a great solution for creating a circular plastic waste economy. PsPETase from Piscinibacter sakaiensis has been identified as an enzyme with tremendous potential for such applications. But to improve its efficiency, enzyme engineering has been applied aiming at enhancing its thermal stability, enzymatic activity, and ease of production. Here, we combine different strategies such as structure-based rational design, ancestral sequence reconstruction and machine learning to engineer a more highly active Combi-PETase variant with a melting temperature of 70 °C and optimal performance at 60 °C. Furthermore, this study demonstrates that these approaches, commonly used in other works of enzyme engineering, are most effective when utilized in combination, enabling the improvement of enzymes for industrial applications.

Reconstructing dynamics correlation network to simultaneously improve activity and stability of 2,3-butanediol dehydrogenase by design of distal interchain disulfide bonds

The complete enzyme catalytic cycle includes substrate binding, chemical reaction and product release, in which different dynamic conformations are adopted. Due to the complex relationship among enzyme activity, stability and dynamics, the directed evolution of enzymes for improved activity or stability commonly leads to a trade-off in stability or activity. It hence remains a challenge to engineer an enzyme to have both enhanced activity and stability. Here, we have attempted to reconstruct the dynamics correlation network involved with active center to improve both activity and stability of a 2,3-butanediol dehydrogenase (2,3-BDH) by introducing inter-chain disulfide bonds. A computational strategy was first applied to evaluate the effect of introducing inter-chain disulfide bond on activity and stability of three 2,3-BDHs, and the N258C mutation of 2,3-BDH from Corynebacterium glutamicum (CgBDH) was proved to be effective in improving both activity and stability. In the results, CgBDH-N258C showed a different unfolding curve from the wild type, with two melting temperatures (Tm) of 68.3 °C and 50.8 °C, 19.7 °C and 2 °C higher than 48.6 °C of the wild type. Its half-life was also improved by 14.8-fold compared to the wild type. Catalytic efficiency (kcat/Km) of the mutant was increased by 7.9-fold toward native substrate diacetyl and 8.8-fold toward non-native substrate 2,5-hexanedione compared to the wild type. Molecular dynamics simulations revealed that an interaction network formed by Cys258, Arg162, Ala144 and the catalytic residues was reconstructed in the mutant and the dynamics change caused by the disulfide bond could be propagated through the interactions network. This improved the enzyme stability and activity by decreasing the flexibility and locking more "reactive" pose, respectively. Further construction of mutations including A144G showing a 44-fold improvement in catalytic efficiency toward meso-2,3-BD confirmed the role of modifying dynamics correlation network in tunning enzyme activity and selectivity. This study provided important insights into the relationship among dynamics, enzyme catalysis and stability, and will be useful in the designing new enzymes with co-evolution of stability, activity and selectivity.

Click, Compute, Create: A Review of Web-based Tools for Enzyme Engineering

Enzyme engineering, though pivotal across various biotechnological domains, is often plagued by its time-consuming and labor-intensive nature. This review aims to offer an overview of supportive in silico methodologies for this demanding endeavor. Starting from methods to predict protein structures, to classification of their activity and even the discovery of new enzymes we continue with describing tools used to increase thermostability and production yields of selected targets. Subsequently, we discuss computational methods to modulate both, the activity as well as selectivity of enzymes. Last, we present recent approaches based on cutting-edge machine learning methods to redesign enzymes. With exception of the last chapter, there is a strong focus on methods easily accessible via web-interfaces or simple Python-scripts, therefore readily useable for a diverse and broad community.

Enhancing missense variant pathogenicity prediction with protein language models using VariPred

Computational approaches for predicting the pathogenicity of genetic variants have advanced in recent years. These methods enable researchers to determine the possible clinical impact of rare and novel variants. Historically these prediction methods used hand-crafted features based on structural, evolutionary, or physiochemical properties of the variant. In this study we propose a novel framework that leverages the power of pre-trained protein language models to predict variant pathogenicity. We show that our approach VariPred (Variant impact Predictor) outperforms current state-of-the-art methods by using an end-to-end model that only requires the protein sequence as input. Using one of the best-performing protein language models (ESM-1b), we establish a robust classifier that requires no calculation of structural features or multiple sequence alignments. We compare the performance of VariPred with other representative models including 3Cnet, Polyphen-2, REVEL, MetaLR, FATHMM and ESM variant. VariPred performs as well as, or in most cases better than these other predictors using six variant impact prediction benchmarks despite requiring only sequence data and no pre-processing of the data.

Asymmetric Synthesis of α-Chloroamides via Photoenzymatic Hydroalkylation of Olefins

Photoenzymatic intermolecular hydroalkylations of olefins are highly enantioselective for chiral centers formed during radical termination but poorly selective for centers set in the C-C bond-forming event. Here, we report the evolution of a flavin-dependent "ene"-reductase to catalyze the coupling of α,α-dichloroamides with alkenes to afford α-chloroamides in good yield with excellent chemo- and stereoselectivity. These products can serve as linchpins in the synthesis of pharmaceutically valuable motifs. Mechanistic studies indicate that radical formation occurs by exciting a charge-transfer complex templated by the protein. Precise control over the orientation of molecules within the charge-transfer complex potentially accounts for the observed stereoselectivity. The work expands the types of motifs that can be prepared using photoenzymatic catalysis.

Biosensor and machine learning-aided engineering of an amaryllidaceae enzyme

A major challenge to achieving industry-scale biomanufacturing of therapeutic alkaloids is the slow process of biocatalyst engineering. Amaryllidaceae alkaloids, such as the Alzheimer's medication galantamine, are complex plant secondary metabolites with recognized therapeutic value. Due to their difficult synthesis they are regularly sourced by extraction and purification from the low-yielding daffodil Narcissus pseudonarcissus. Here, we propose an efficient biosensor-machine learning technology stack for biocatalyst development, which we apply to engineer an Amaryllidaceae enzyme in Escherichia coli. Directed evolution is used to develop a highly sensitive (EC50 = 20 μM) and specific biosensor for the key Amaryllidaceae alkaloid branchpoint 4'-O-methylnorbelladine. A structure-based residual neural network (MutComputeX) is subsequently developed and used to generate activity-enriched variants of a plant methyltransferase, which are rapidly screened with the biosensor. Functional enzyme variants are identified that yield a 60% improvement in product titer, 2-fold higher catalytic activity, and 3-fold lower off-product regioisomer formation. A solved crystal structure elucidates the mechanism behind key beneficial mutations.

Machine Learning and Deep Learning in Synthetic Biology: Key Architectures, Applications, and Challenges

Machine learning (ML), particularly deep learning (DL), has made rapid and substantial progress in synthetic biology in recent years. Biotechnological applications of biosystems, including pathways, enzymes, and whole cells, are being probed frequently with time. The intricacy and interconnectedness of biosystems make it challenging to design them with the desired properties. ML and DL have a synergy with synthetic biology. Synthetic biology can be employed to produce large data sets for training models (for instance, by utilizing DNA synthesis), and ML/DL models can be employed to inform design (for example, by generating new parts or advising unrivaled experiments to perform). This potential has recently been brought to light by research at the intersection of engineering biology and ML/DL through achievements like the design of novel biological components, best experimental design, automated analysis of microscopy data, protein structure prediction, and biomolecular implementations of ANNs (Artificial Neural Networks). I have divided this review into three sections. In the first section, I describe predictive potential and basics of ML along with myriad applications in synthetic biology, especially in engineering cells, activity of proteins, and metabolic pathways. In the second section, I describe fundamental DL architectures and their applications in synthetic biology. Finally, I describe different challenges causing hurdles in the progress of ML/DL and synthetic biology along with their solutions.

Opportunities and Challenges for Machine Learning-Assisted Enzyme Engineering

Enzymes can be engineered at the level of their amino acid sequences to optimize key properties such as expression, stability, substrate range, and catalytic efficiency-or even to unlock new catalytic activities not found in nature. Because the search space of possible proteins is vast, enzyme engineering usually involves discovering an enzyme starting point that has some level of the desired activity followed by directed evolution to improve its "fitness" for a desired application. Recently, machine learning (ML) has emerged as a powerful tool to complement this empirical process. ML models can contribute to (1) starting point discovery by functional annotation of known protein sequences or generating novel protein sequences with desired functions and (2) navigating protein fitness landscapes for fitness optimization by learning mappings between protein sequences and their associated fitness values. In this Outlook, we explain how ML complements enzyme engineering and discuss its future potential to unlock improved engineering outcomes.

Learning the shape of protein microenvironments with a holographic convolutional neural network

Proteins play a central role in biology from immune recognition to brain activity. While major advances in machine learning have improved our ability to predict protein structure from sequence, determining protein function from its sequence or structure remains a major challenge. Here, we introduce holographic convolutional neural network (H-CNN) for proteins, which is a physically motivated machine learning approach to model amino acid preferences in protein structures. H-CNN reflects physical interactions in a protein structure and recapitulates the functional information stored in evolutionary data. H-CNN accurately predicts the impact of mutations on protein stability and binding of protein complexes. Our interpretable computational model for protein structure-function maps could guide design of novel proteins with desired function.

Data-Driven Protein Engineering for Improving Catalytic Activity and Selectivity

Protein engineering is essential for altering the substrate scope, catalytic activity and selectivity of enzymes for applications in biocatalysis. However, traditional approaches, such as directed evolution and rational design, encounter the challenge in dealing with the experimental screening process of a large protein mutation space. Machine learning methods allow the approximation of protein fitness landscapes and the identification of catalytic patterns using limited experimental data, thus providing a new avenue to guide protein engineering campaigns. In this concept article, we review machine learning models that have been developed to assess enzyme-substrate-catalysis performance relationships aiming to improve enzymes through data-driven protein engineering. Furthermore, we prospect the future development of this field to provide additional strategies and tools for achieving desired activities and selectivities.

Improving Protein Expression, Stability, and Function with ProteinMPNN

Natural proteins are highly optimized for function but are often difficult to produce at a scale suitable for biotechnological applications due to poor expression in heterologous systems, limited solubility, and sensitivity to temperature. Thus, a general method that improves the physical properties of native proteins while maintaining function could have wide utility for protein-based technologies. Here, we show that the deep neural network ProteinMPNN, together with evolutionary and structural information, provides a route to increasing protein expression, stability, and function. For both myoglobin and tobacco etch virus (TEV) protease, we generated designs with improved expression, elevated melting temperatures, and improved function. For TEV protease, we identified multiple designs with improved catalytic activity as compared to the parent sequence and previously reported TEV variants. Our approach should be broadly useful for improving the expression, stability, and function of biotechnologically important proteins.

Mammalian Antigen Display for Pandemic Countermeasures

Pandemic countermeasures require the rapid design of antigens for vaccines, profiling patient antibody responses, assessing antigen structure-function landscapes, and the surveillance of emerging viral lineages. Cell surface display of a viral antigen or its subdomains can facilitate these goals by coupling the phenotypes of protein variants to their DNA sequence. Screening surface-displayed proteins via flow cytometry also eliminates time-consuming protein purification steps. Prior approaches have primarily relied on yeast as a display chassis. However, yeast often cannot express large viral glycoproteins, requiring their truncation into subdomains. Here, we describe a method to design and express antigens on the surface of mammalian HEK293T cells. We discuss three use cases, including screening of stabilizing mutations, deep mutational scanning, and epitope mapping. The mammalian antigen display platform described herein will accelerate ongoing and future pandemic countermeasures.

Engineering Enzymes for Environmental Sustainability

The development and implementation of sustainable catalytic technologies is key to delivering our net-zero targets. Here we review how engineered enzymes, with a focus on those developed using directed evolution, can be deployed to improve the sustainability of numerous processes and help to conserve our environment. Efficient and robust biocatalysts have been engineered to capture carbon dioxide (CO2) and have been embedded into new efficient metabolic CO2 fixation pathways. Enzymes have been refined for bioremediation, enhancing their ability to degrade toxic and harmful pollutants. Biocatalytic recycling is gaining momentum, with engineered cutinases and PETases developed for the depolymerization of the abundant plastic, polyethylene terephthalate (PET). Finally, biocatalytic approaches for accessing petroleum-based feedstocks and chemicals are expanding, using optimized enzymes to convert plant biomass into biofuels or other high value products. Through these examples, we hope to illustrate how enzyme engineering and biocatalysis can contribute to the development of cleaner and more efficient chemical industry.

Engineering Enzymes for Environmental Sustainability

The development and implementation of sustainable catalytic technologies is key to delivering our net-zero targets. Here we review how engineered enzymes, with a focus on those developed using directed evolution, can be deployed to improve the sustainability of numerous processes and help to conserve our environment. Efficient and robust biocatalysts have been engineered to capture carbon dioxide (CO2 ) and have been embedded into new efficient metabolic CO2 fixation pathways. Enzymes have been refined for bioremediation, enhancing their ability to degrade toxic and harmful pollutants. Biocatalytic recycling is gaining momentum, with engineered cutinases and PETases developed for the depolymerization of the abundant plastic, polyethylene terephthalate (PET). Finally, biocatalytic approaches for accessing petroleum-based feedstocks and chemicals are expanding, using optimized enzymes to convert plant biomass into biofuels or other high value products. Through these examples, we hope to illustrate how enzyme engineering and biocatalysis can contribute to the development of cleaner and more efficient chemical industry.

Modifying the amino acids in conformational motion pathway of the α-amylase of Geobacillus stearothermophilus improved its activity and stability

Amino acids along the conformational motion pathway of the enzyme molecule correlated to its flexibility and rigidity. To enhance the enzyme activity and thermal stability, the motion pathway of Geobacillus stearothermophilus α-amylase has been identified and molecularly modified by using the neural relational inference model and deep learning tool. The significant differences in substrate specificity, enzymatic kinetics, optimal temperature, and thermal stability were observed among the mutants with modified amino acids along the pathway. Mutants especially the P44E demonstrated enhanced hydrolytic activity and catalytic efficiency (kcat/KM) than the wild-type enzyme to 95.0% and 93.8% respectively, with the optimum temperature increased to 90°C. This mutation from proline to glutamic acid has increased the number and the radius of the bottleneck of the channels, which might facilitate transporting large starch substrates into the enzyme. The mutation could also optimize the hydrogen bonding network of the catalytic center, and diminish the spatial hindering to the substrate entry and exit from the catalytic center.

Module-Based Polyketide Synthase Engineering for de Novo Polyketide Biosynthesis

Polyketide retrobiosynthesis, where the biosynthetic pathway of a given polyketide can be reversibly engineered due to the colinearity of the polyketide synthase (PKS) structure and function, has the potential to produce millions of organic molecules. Mixing and matching modules from natural PKSs is one of the routes to produce many of these molecules. Evolutionary analysis of PKSs suggests that traditionally used module boundaries may not lead to the most productive hybrid PKSs and that new boundaries around and within the ketosynthase domain may be more active when constructing hybrid PKSs. As this is still a nascent area of research, the generality of these design principles based on existing engineering efforts remains inconclusive. Recent advances in structural modeling and synthetic biology present an opportunity to accelerate PKS engineering by re-evaluating insights gained from previous engineering efforts with cutting edge tools.

Mining cancer genomes for change-of-metabolic-function mutations

Enzymes with novel functions are needed to enable new organic synthesis techniques. Drawing inspiration from gain-of-function cancer mutations that functionally alter proteins and affect cellular metabolism, we developed METIS (Mutated Enzymes from Tumors In silico Screen). METIS identifies metabolism-altering cancer mutations using mutation recurrence rates and protein structure. We used METIS to screen 298,517 cancer mutations and identify 48 candidate mutations, including those previously identified to alter enzymatic function. Unbiased metabolomic profiling of cells exogenously expressing a candidate mutant (OGDHLp.A400T) supports an altered phenotype that boosts in vitro production of xanthosine, a pharmacologically useful chemical that is currently produced using unsustainable, water-intensive methods. We then applied METIS to 49 million cancer mutations, yielding a refined set of candidates that may impart novel enzymatic functions or contribute to tumor progression. Thus, METIS can be used to identify and catalog potentially-useful cancer mutations for green chemistry and therapeutic applications.

Machine Learning-Guided Protein Engineering

Recent progress in engineering highly promising biocatalysts has increasingly involved machine learning methods. These methods leverage existing experimental and simulation data to aid in the discovery and annotation of promising enzymes, as well as in suggesting beneficial mutations for improving known targets. The field of machine learning for protein engineering is gathering steam, driven by recent success stories and notable progress in other areas. It already encompasses ambitious tasks such as understanding and predicting protein structure and function, catalytic efficiency, enantioselectivity, protein dynamics, stability, solubility, aggregation, and more. Nonetheless, the field is still evolving, with many challenges to overcome and questions to address. In this Perspective, we provide an overview of ongoing trends in this domain, highlight recent case studies, and examine the current limitations of machine learning-based methods. We emphasize the crucial importance of thorough experimental validation of emerging models before their use for rational protein design. We present our opinions on the fundamental problems and outline the potential directions for future research.

Discovering pathways through ribozyme fitness landscapes using information theoretic quantification of epistasis

The identification of catalytic RNAs is typically achieved through primarily experimental means. However, only a small fraction of sequence space can be analyzed even with high-throughput techniques. Methods to extrapolate from a limited data set to predict additional ribozyme sequences, particularly in a human-interpretable fashion, could be useful both for designing new functional RNAs and for generating greater understanding about a ribozyme fitness landscape. Using information theory, we express the effects of epistasis (i.e., deviations from additivity) on a ribozyme. This representation was incorporated into a simple model of the epistatic fitness landscape, which identified potentially exploitable combinations of mutations. We used this model to theoretically predict mutants of high activity for a self-aminoacylating ribozyme, identifying potentially active triple and quadruple mutants beyond the experimental data set of single and double mutants. The predictions were validated experimentally, with nine out of nine sequences being accurately predicted to have high activity. This set of sequences included mutants that form a previously unknown evolutionary "bridge" between two ribozyme families that share a common motif. Individual steps in the method could be examined, understood, and guided by a human, combining interpretability and performance in a simple model to predict ribozyme sequences by extrapolation.

Advancing Enzyme's Stability and Catalytic Efficiency through Synergy of Force-Field Calculations, Evolutionary Analysis, and Machine Learning

Thermostability is an essential requirement for the use of enzymes in the bioindustry. Here, we compare different protein stabilization strategies using a challenging target, a stable haloalkane dehalogenase DhaA115. We observe better performance of automated stabilization platforms FireProt and PROSS in designing multiple-point mutations over the introduction of disulfide bonds and strengthening the intra- and the inter-domain contacts by in silico saturation mutagenesis. We reveal that the performance of automated stabilization platforms was still compromised due to the introduction of some destabilizing mutations. Notably, we show that their prediction accuracy can be improved by applying manual curation or machine learning for the removal of potentially destabilizing mutations, yielding highly stable haloalkane dehalogenases with enhanced catalytic properties. A comparison of crystallographic structures revealed that current stabilization rounds were not accompanied by large backbone re-arrangements previously observed during the engineering stability of DhaA115. Stabilization was achieved by improving local contacts including protein-water interactions. Our study provides guidance for further improvement of automated structure-based computational tools for protein stabilization.

Design of SC PEP with enhanced stability against pepsin digestion and increased activity by machine learning and structural parameters modeling

Prolyl endopeptidases from Sphingomonas capsulata (SC PEP) has attracted much attention as promising oral therapy candidate for celiac sprue, however, its low stability in the gastric environment leads to unsatisfactory clinical results. Therefore, improving its stability against pepsin digestion at low pH is crucial for clinical applications, but challenging. In this study, machine learning and physical parameter model were combined to design SC PEP mutants. After iterations, 20 mutants had higher hydrolysis activity in stomach environment, which was up to 14.1-fold compared with wild-type SC PEP. Mutant M24 involving stable and active mutations and pegylated M24 (M24-PEG) had higher activity of hydrolyzing immunogen in bread than wild-type SC PEP in vitro and in vivo, and residual immunogens in simulated gastric environment were only 1/8 and 1/10 of that in the wild-type SC PEP group. The total residual immunogens in the gastrointestinal tract of mice in the M24 and M24-PEG groups were <20 ppm, reaching the standard of non-toxic food. Our results indicate that the combination of M24 (or M24-PEG) with EP-B2 may be a promising candidate for celiac disease, and the strategies developed in this study provide a paradigm for the design of SC PEP stability mutants.

Current advances in the structural biology and molecular engineering of PETase

Poly(ethylene terephthalate) (PET) is a highly useful synthetic polyester plastic that is widely used in daily life. However, the increase in postconsumer PET as plastic waste that is recalcitrant to biodegradation in landfills and the natural environment has raised worldwide concern. Currently, traditional PET recycling processes with thermomechanical or chemical methods also result in the deterioration of the mechanical properties of PET. Therefore, it is urgent to develop more efficient and green strategies to address this problem. Recently, a novel mesophilic PET-degrading enzyme (IsPETase) from Ideonella sakaiensis was found to streamline PET biodegradation at 30°C, albeit with a lower PET-degrading activity than chitinase or chitinase-like PET-degrading enzymes. Consequently, the molecular engineering of more efficient PETases is still required for further industrial applications. This review details current knowledge on IsPETase, MHETase, and IsPETase-like hydrolases, including the structures, ligand‒protein interactions, and rational protein engineering for improved PET-degrading performance. In particular, applications of the engineered catalysts are highlighted, including metabolic engineering of the cell factories, enzyme immobilization or cell surface display. The information is expected to provide novel insights for the biodegradation of complex polymers.

Engineering the catalytic activity of an Antarctic PET-degrading enzyme by loop exchange

Several hydrolases have been described to degrade polyethylene terephthalate (PET) at moderate temperatures ranging from 25°C to 40°C. These mesophilic PET hydrolases (PETases) are less efficient in degrading this plastic polymer than their thermophilic homologs and have, therefore, been the subject of many protein engineering campaigns. However, enhancing their enzymatic activity through rational design or directed evolution poses a formidable challenge due to the need for exploring a large number of mutations. Additionally, evaluating the improvements in both activity and stability requires screening numerous variants, either individually or using high-throughput screening methods. Here, we utilize instead the design of chimeras as a protein engineering strategy to increase the activity and stability of Mors1, an Antarctic PETase active at 25°C. First, we obtained the crystal structure of Mors1 at 1.6 Å resolution, which we used as a scaffold for structure- and sequence-based chimeric design. Then, we designed a Mors1 chimera via loop exchange of a highly divergent active site loop from the thermophilic leaf-branch compost cutinase (LCC) into the equivalent region in Mors1. After restitution of an active site disulfide bond into this chimera, the enzyme exhibited a shift in optimal temperature for activity to 45°C and an increase in fivefold in PET hydrolysis when compared with wild-type Mors1 at 25°C. Our results serve as a proof of concept of the utility of chimeric design to further improve the activity and stability of PETases active at moderate temperatures.

Two sequence- and two structure-based ML models have learned different aspects of protein biochemistry

Deep learning models are seeing increased use as methods to predict mutational effects or allowed mutations in proteins. The models commonly used for these purposes include large language models (LLMs) and 3D Convolutional Neural Networks (CNNs). These two model types have very different architectures and are commonly trained on different representations of proteins. LLMs make use of the transformer architecture and are trained purely on protein sequences whereas 3D CNNs are trained on voxelized representations of local protein structure. While comparable overall prediction accuracies have been reported for both types of models, it is not known to what extent these models make comparable specific predictions and/or generalize protein biochemistry in similar ways. Here, we perform a systematic comparison of two LLMs and two structure-based models (CNNs) and show that the different model types have distinct strengths and weaknesses. The overall prediction accuracies are largely uncorrelated between the sequence- and structure-based models. Overall, the two structure-based models are better at predicting buried aliphatic and hydrophobic residues whereas the two LLMs are better at predicting solvent-exposed polar and charged amino acids. Finally, we find that a combined model that takes the individual model predictions as input can leverage these individual model strengths and results in significantly improved overall prediction accuracy.

Two sequence- and two structure-based ML models have learned different aspects of protein biochemistry

Deep learning models are seeing increased use as methods to predict mutational effects or allowed mutations in proteins. The models commonly used for these purposes include large language models (LLMs) and 3D Convolutional Neural Networks (CNNs). These two model types have very different architectures and are commonly trained on different representations of proteins. LLMs make use of the transformer architecture and are trained purely on protein sequences whereas 3D CNNs are trained on voxelized representations of local protein structure. While comparable overall prediction accuracies have been reported for both types of models, it is not known to what extent these models make comparable specific predictions and/or generalize protein biochemistry in similar ways. Here, we perform a systematic comparison of two LLMs and two structure-based models (CNNs) and show that the different model types have distinct strengths and weaknesses. The overall prediction accuracies are largely uncorrelated between the sequence- and structure-based models. Overall, the two structure-based models are better at predicting buried aliphatic and hydrophobic residues whereas the two LLMs are better at predicting solvent-exposed polar and charged amino acids. Finally, we find that a combined model that takes the individual model predictions as input can leverage these individual model strengths and results in significantly improved overall prediction accuracy.

Understanding structure-guided variant effect predictions using 3D convolutional neural networks

Predicting pathogenicity of missense variants in molecular diagnostics remains a challenge despite the available wealth of data, such as evolutionary information, and the wealth of tools to integrate that data. We describe DeepRank-Mut, a configurable framework designed to extract and learn from physicochemically relevant features of amino acids surrounding missense variants in 3D space. For each variant, various atomic and residue-level features are extracted from its structural environment, including sequence conservation scores of the surrounding amino acids, and stored in multi-channel 3D voxel grids which are then used to train a 3D convolutional neural network (3D-CNN). The resultant model gives a probabilistic estimate of whether a given input variant is disease-causing or benign. We find that the performance of our 3D-CNN model, on independent test datasets, is comparable to other widely used resources which also combine sequence and structural features. Based on the 10-fold cross-validation experiments, we achieve an average accuracy of 0.77 on the independent test datasets. We discuss the contribution of the variant neighborhood in the model's predictive power, in addition to the impact of individual features on the model's performance. Two key features: evolutionary information of residues in the variant neighborhood and their solvent accessibilities were observed to influence the predictions. We also highlight how predictions are impacted by the underlying disease mechanisms of missense mutations and offer insights into understanding these to improve pathogenicity predictions. Our study presents aspects to take into consideration when adopting deep learning approaches for protein structure-guided pathogenicity predictions.

Metal3D: a general deep learning framework for accurate metal ion location prediction in proteins

Metal ions are essential cofactors for many proteins and play a crucial role in many applications such as enzyme design or design of protein-protein interactions because they are biologically abundant, tether to the protein using strong interactions, and have favorable catalytic properties. Computational design of metalloproteins is however hampered by the complex electronic structure of many biologically relevant metals such as zinc . In this work, we develop two tools - Metal3D (based on 3D convolutional neural networks) and Metal1D (solely based on geometric criteria) to improve the location prediction of zinc ions in protein structures. Comparison with other currently available tools shows that Metal3D is the most accurate zinc ion location predictor to date with predictions within 0.70 ± 0.64 Å of experimental locations. Metal3D outputs a confidence metric for each predicted site and works on proteins with few homologes in the protein data bank. Metal3D predicts a global zinc density that can be used for annotation of computationally predicted structures and a per residue zinc density that can be used in protein design workflows. Currently trained on zinc, the framework of Metal3D is readily extensible to other metals by modifying the training data.

OPUS-Mut: Studying the Effect of Protein Mutation through Side-Chain Modeling

Predicting the effect of protein mutation is crucial in many applications such as protein design, protein evolution, and genetic disease analysis. Structurally, mutation is basically the replacement of the side chain of a particular residue. Therefore, accurate side-chain modeling is useful in studying the effect of mutation. Here, we propose a computational method, namely, OPUS-Mut, which significantly outperforms other backbone-dependent side-chain modeling methods including our previous method OPUS-Rota4. We evaluate OPUS-Mut by four case studies on Myoglobin, p53, HIV-1 protease, and T4 lysozyme. The results show that the predicted structures of side chains of different mutants are consistent well with their experimentally determined results. In addition, when the residues with significant structural shifts upon the mutation are considered, it is found that the extent of the predicted structural shift of these affected residues can be correlated reasonably well with the functional changes of the mutant measured by experiments. OPUS-Mut can also help one to identify the harmful and benign mutations and thus may guide the construction of a protein with relatively low sequence homology but with a similar structure.

SESNet: sequence-structure feature-integrated deep learning method for data-efficient protein engineering

Deep learning has been widely used for protein engineering. However, it is limited by the lack of sufficient experimental data to train an accurate model for predicting the functional fitness of high-order mutants. Here, we develop SESNet, a supervised deep-learning model to predict the fitness for protein mutants by leveraging both sequence and structure information, and exploiting attention mechanism. Our model integrates local evolutionary context from homologous sequences, the global evolutionary context encoding rich semantic from the universal protein sequence space and the structure information accounting for the microenvironment around each residue in a protein. We show that SESNet outperforms state-of-the-art models for predicting the sequence-function relationship on 26 deep mutational scanning datasets. More importantly, we propose a data augmentation strategy by leveraging the data from unsupervised models to pre-train our model. After that, our model can achieve strikingly high accuracy in prediction of the fitness of protein mutants, especially for the higher order variants (> 4 mutation sites), when finetuned by using only a small number of experimental mutation data (< 50). The strategy proposed is of great practical value as the required experimental effort, i.e., producing a few tens of experimental mutation data on a given protein, is generally affordable by an ordinary biochemical group and can be applied on almost any protein.

Using machine learning to predict the effects and consequences of mutations in proteins

Machine and deep learning approaches can leverage the increasingly available massive datasets of protein sequences, structures, and mutational effects to predict variants with improved fitness. Many different approaches are being developed, but systematic benchmarking studies indicate that even though the specifics of the machine learning algorithms matter, the more important constraint comes from the data availability and quality utilized during training. In cases where little experimental data are available, unsupervised and self-supervised pre-training with generic protein datasets can still perform well after subsequent refinement via hybrid or transfer learning approaches. Overall, recent progress in this field has been staggering, and machine learning approaches will likely play a major role in future breakthroughs in protein biochemistry and engineering.

Data-driven enzyme engineering to identify function-enhancing enzymes

Identifying function-enhancing enzyme variants is a 'holy grail' challenge in protein science because it will allow researchers to expand the biocatalytic toolbox for late-stage functionalization of drug-like molecules, environmental degradation of plastics and other pollutants, and medical treatment of food allergies. Data-driven strategies, including statistical modeling, machine learning, and deep learning, have largely advanced the understanding of the sequence-structure-function relationships for enzymes. They have also enhanced the capability of predicting and designing new enzymes and enzyme variants for catalyzing the transformation of new-to-nature reactions. Here, we reviewed the recent progresses of data-driven models that were applied in identifying efficiency-enhancing mutants for catalytic reactions. We also discussed existing challenges and obstacles faced by the community. Although the review is by no means comprehensive, we hope that the discussion can inform the readers about the state-of-the-art in data-driven enzyme engineering, inspiring more joint experimental-computational efforts to develop and apply data-driven modeling to innovate biocatalysts for synthetic and pharmaceutical applications.

Protein engineering via Bayesian optimization-guided evolutionary algorithm and robotic experiments

Directed protein evolution applies repeated rounds of genetic mutagenesis and phenotypic screening and is often limited by experimental throughput. Through in silico prioritization of mutant sequences, machine learning has been applied to reduce wet lab burden to a level practical for human researchers. On the other hand, robotics permits large batches and rapid iterations for protein engineering cycles, but such capacities have not been well exploited in existing machine learning-assisted directed evolution approaches. Here, we report a scalable and batched method, Bayesian Optimization-guided EVOlutionary (BO-EVO) algorithm, to guide multiple rounds of robotic experiments to explore protein fitness landscapes of combinatorial mutagenesis libraries. We first examined various design specifications based on an empirical landscape of protein G domain B1. Then, BO-EVO was successfully generalized to another empirical landscape of an Escherichia coli kinase PhoQ, as well as simulated NK landscapes with up to moderate epistasis. This approach was then applied to guide robotic library creation and screening to engineer enzyme specificity of RhlA, a key biosynthetic enzyme for rhamnolipid biosurfactants. A 4.8-fold improvement in producing a target rhamnolipid congener was achieved after examining less than 1% of all possible mutants after four iterations. Overall, BO-EVO proves to be an efficient and general approach to guide combinatorial protein engineering without prior knowledge.

Improved Bst DNA Polymerase Variants Derived via a Machine Learning Approach

The DNA polymerase I from Geobacillus stearothermophilus (also known as Bst DNAP) is widely used in isothermal amplification reactions, where its strand displacement ability is prized. More robust versions of this enzyme should be enabled for diagnostic applications, especially for carrying out higher temperature reactions that might proceed more quickly. To this end, we appended a short fusion domain from the actin-binding protein villin that improved both stability and purification of the enzyme. In parallel, we have developed a machine learning algorithm that assesses the relative fit of individual amino acids to their chemical microenvironments at any position in a protein and applied this algorithm to predict sequence substitutions in Bst DNAP. The top predicted variants had greatly improved thermotolerance (heating prior to assay), and upon combination, the mutations showed additive thermostability, with denaturation temperatures up to 2.5 °C higher than the parental enzyme. The increased thermostability of the enzyme allowed faster loop-mediated isothermal amplification assays to be carried out at 73 °C, where both Bst DNAP and its improved commercial counterpart Bst 2.0 are inactivated. Overall, this is one of the first examples of the application of machine learning approaches to the thermostabilization of an enzyme.

Engineering DszC Mutants from Transition State Macrodipole Considerations and Evolutionary Sequence Analysis

We describe an approach to identify enzyme mutants with increased turnover using the enzyme DszC as a case study. Our approach is based on recalculating the barriers of alanine mutants through single-point energy calculations at the hybrid QM/MM level in the wild-type reactant and transition state geometries. We analyze the difference in the electron density between the reactant and transition state to identify sites/residues where electrostatic interactions stabilize the transition state over the reactants. We also assess the insertion of a unit probe charge to identify positions in which the introduction of charged residues lowers the barrier.

Synthetic Biology Meets Machine Learning

This chapter outlines the myriad applications of machine learning (ML) in synthetic biology, specifically in engineering cell and protein activity, and metabolic pathways. Though by no means comprehensive, the chapter highlights several prominent computational tools applied in the field and their potential use cases. The examples detailed reinforce how ML algorithms can enhance synthetic biology research by providing data-driven insights into the behavior of living systems, even without detailed knowledge of their underlying mechanisms. By doing so, ML promises to increase the efficiency of research projects by modeling hypotheses in silico that can then be tested through experiments. While challenges related to training dataset generation and computational costs remain, ongoing improvements in ML tools are paving the way for smarter and more streamlined synthetic biology workflows that can be readily employed to address grand challenges across manufacturing, medicine, engineering, agriculture, and beyond.

Logistic Regression-Guided Identification of Cofactor Specificity-Contributing Residues in Enzyme with Sequence Datasets Partitioned by Catalytic Properties

Changing the substrate/cofactor specificity of an enzyme requires multiple mutations at spatially adjacent positions around the substrate pocket. However, this is challenging when solely based on crystal structure information because enzymes undergo dynamic conformational changes during the reaction process. Herein, we proposed a method for estimating the contribution of each amino acid residue to substrate specificity by deploying a phylogenetic analysis with logistic regression. Since this method can estimate the candidate amino acids for mutation by ranking, it is readable and can be used in protein engineering. We demonstrated our concept using redox cofactor conversion of the Escherichia coli malic enzyme as a model, which still lacks crystal structure elucidation. The use of logistic regression with amino acid sequences classified by cofactor specificity showed that the NADP⁺-dependent malic enzyme completely switched cofactor specificity to NAD⁺ dependence without the need for a practical screening step. The model showed that surrounding residues made a greater contribution to cofactor specificity than those in the interior of the substrate pocket. These residues might be difficult to identify from crystal structure observations. We show that a highly accurate and inferential machine learning model was obtained using amino acid sequences of structurally homologous and functionally distinct enzymes as input data.

Improved compound-protein interaction site and binding affinity prediction using self-supervised protein embeddings

BACKGROUND

Compound-protein interaction site and binding affinity predictions are crucial for drug discovery and drug design. In recent years, many deep learning-based methods have been proposed for predications related to compound-protein interaction. For protein inputs, how to make use of protein primary sequence and tertiary structure information has impact on prediction results.

RESULTS

In this study, we propose a deep learning model based on a multi-objective neural network, which involves a multi-objective neural network for compound-protein interaction site and binding affinity prediction. We used several kinds of self-supervised protein embeddings to enrich our protein inputs and used convolutional neural networks to extract features from them. Our results demonstrate that our model had improvements in terms of interaction site prediction and affinity prediction compared to previous models. In a case study, our model could better predict binding sites, which also showed its effectiveness.

CONCLUSION

These results suggest that our model could be a helpful tool for compound-protein related predictions.

Molecular Dynamics Simulation of Poly(Ether Ether Ketone) (PEEK) Polymer to Analyze Intermolecular Ordering by Low Wavenumber Raman Spectroscopy and X-ray Diffraction

Poly(ether ether ketone) (PEEK) is an important engineering plastic and evaluation of its local crystallinity in composites is critical for producing strong and reliable mechanical parts. Low wavenumber Raman spectroscopy and X-ray diffraction are promising techniques for the analysis of crystal ordering but a detailed understanding of the spectra has not been established. Here, we use molecular dynamics combined with a newly developed approximation to simulate local vibrational features to understand the effect of intermolecular ordering in the Raman spectra. We found that intermolecular ordering does affect the low wavenumber Raman spectra and the X-ray diffraction as observed in the experiment. Raman spectroscopy of intermolecular vibration modes is a promising technique to evaluate the local crystallinity of PEEK and other engineering plastics, and the present technique offers an estimation without requiring heavy computational resources.

A patent-based consideration of latest platforms in the art of directed evolution: a decade long untold story

Directed (or in vitro) evolution of proteins and metabolic pathways requires tools for creating genetic diversity and identifying protein variants with new or improved functional properties. Besides simplicity, reliability, speed, versatility, universal applicability and economy of the technique, the new science of synthetic biology requires improved means for construction of smart and high-quality mutant libraries to better navigate the sequence diversity. In vitro CRISPR/Cas9-mediated mutagenic (ICM) system and machine-learning (ML)-assisted approaches to directed evolution are now in the field to achieve the goal. This review describes the gene diversification strategies, screening and selection methods, in silico (computer-aided), Cas9-mediated and ML-based approaches to mutagenesis, developed especially in the last decade, and their patent position. The objective behind is to emphasize researchers the need for noting which mutagenesis, screening or selection method is patented and then selecting a suitable restriction-free approach to sequence diversity. Techniques and evolved products subject to patent rights need commercial license if their use is for purposes other than private or experimental research.

Principles and practical applications of structure-based vaccine design

Viral proteins fold into a variety of structures as they perform their functions. Structure-based vaccine design aims to exploit knowledge of an antigen’s architecture to stabilize it in a vulnerable conformation. We summarize the general principles of structure-based vaccine design, with a focus on the major types of sequence modifications: proline, disulfide, cavity-filling, electrostatic and hydrogen-bond substitution, as well as domain deletion. We then review recent applications of these principles to vaccine-design efforts across five viral families: Coronaviridae, Orthomyxoviridae, Paramyxoviridae, Pneumoviridae, and Filoviridae. Outstanding challenges include continued application of proven design principles to pathogens of interest, as well as development of new strategies for those pathogens that resist traditional techniques.

Protein Science Meets Artificial Intelligence: A Systematic Review and a Biochemical Meta-Analysis of an Inter-Field

Proteins are some of the most fascinating and challenging molecules in the universe, and they pose a big challenge for artificial intelligence. The implementation of machine learning/AI in protein science gives rise to a world of knowledge adventures in the workhorse of the cell and proteome homeostasis, which are essential for making life possible. This opens up epistemic horizons thanks to a coupling of human tacit–explicit knowledge with machine learning power, the benefits of which are already tangible, such as important advances in protein structure prediction. Moreover, the driving force behind the protein processes of self-organization, adjustment, and fitness requires a space corresponding to gigabytes of life data in its order of magnitude. There are many tasks such as novel protein design, protein folding pathways, and synthetic metabolic routes, as well as protein-aggregation mechanisms, pathogenesis of protein misfolding and disease, and proteostasis networks that are currently unexplored or unrevealed. In this systematic review and biochemical meta-analysis, we aim to contribute to bridging the gap between what we call binomial artificial intelligence (AI) and protein science (PS), a growing research enterprise with exciting and promising biotechnological and biomedical applications. We undertake our task by exploring “the state of the art” in AI and machine learning (ML) applications to protein science in the scientific literature to address some critical research questions in this domain, including What kind of tasks are already explored by ML approaches to protein sciences? What are the most common ML algorithms and databases used? What is the situational diagnostic of the AI–PS inter-field? What do ML processing steps have in common? We also formulate novel questions such as Is it possible to discover what the rules of protein evolution are with the binomial AI–PS? How do protein folding pathways evolve? What are the rules that dictate the folds? What are the minimal nuclear protein structures? How do protein aggregates form and why do they exhibit different toxicities? What are the structural properties of amyloid proteins? How can we design an effective proteostasis network to deal with misfolded proteins? We are a cross-functional group of scientists from several academic disciplines, and we have conducted the systematic review using a variant of the PICO and PRISMA approaches. The search was carried out in four databases (PubMed, Bireme, OVID, and EBSCO Web of Science), resulting in 144 research articles. After three rounds of quality screening, 93 articles were finally selected for further analysis. A summary of our findings is as follows: regarding AI applications, there are mainly four types: 1) genomics, 2) protein structure and function, 3) protein design and evolution, and 4) drug design. In terms of the ML algorithms and databases used, supervised learning was the most common approach (85%). As for the databases used for the ML models, PDB and UniprotKB/Swissprot were the most common ones (21 and 8%, respectively). Moreover, we identified that approximately 63% of the articles organized their results into three steps, which we labeled pre-process, process, and post-process. A few studies combined data from several databases or created their own databases after the pre-process. Our main finding is that, as of today, there are no research road maps serving as guides to address gaps in our knowledge of the AI–PS binomial. All research efforts to collect, integrate multidimensional data features, and then analyze and validate them are, so far, uncoordinated and scattered throughout the scientific literature without a clear epistemic goal or connection between the studies. Therefore, our main contribution to the scientific literature is to offer a road map to help solve problems in drug design, protein structures, design, and function prediction while also presenting the “state of the art” on research in the AI–PS binomial until February 2021. Thus, we pave the way toward future advances in the synthetic redesign of novel proteins and protein networks and artificial metabolic pathways, learning lessons from nature for the welfare of humankind. Many of the novel proteins and metabolic pathways are currently non-existent in nature, nor are they used in the chemical industry or biomedical field.

DLPacker: Deep learning for prediction of amino acid side chain conformations in proteins

Prediction of side chain conformations of amino acids in proteins (also termed "packing") is an important and challenging part of protein structure prediction with many interesting applications in protein design. A variety of methods for packing have been developed but more accurate ones are still needed. Machine learning (ML) methods have recently become a powerful tool for solving various problems in diverse areas of science, including structural biology. In this study, we evaluate the potential of deep neural networks (DNNs) for prediction of amino acid side chain conformations. We formulate the problem as image-to-image transformation and train a U-net style DNN to solve the problem. We show that our method outperforms other physics-based methods by a significant margin: reconstruction RMSDs for most amino acids are about 20% smaller compared to SCWRL4 and Rosetta Packer with RMSDs for bulky hydrophobic amino acids Phe, Tyr, and Trp being up to 50% smaller.

Machine learning-aided engineering of hydrolases for PET depolymerization

Plastic waste poses an ecological challenge^1-3 and enzymatic degradation offers one, potentially green and scalable, route for polyesters waste recycling⁴. Poly(ethylene terephthalate) (PET) accounts for 12% of global solid waste⁵, and a circular carbon economy for PET is theoretically attainable through rapid enzymatic depolymerization followed by repolymerization or conversion/valorization into other products^6-10. Application of PET hydrolases, however, has been hampered by their lack of robustness to pH and temperature ranges, slow reaction rates and inability to directly use untreated postconsumer plastics¹¹. Here, we use a structure-based, machine learning algorithm to engineer a robust and active PET hydrolase. Our mutant and scaffold combination (FAST-PETase: functional, active, stable and tolerant PETase) contains five mutations compared to wild-type PETase (N233K/R224Q/S121E from prediction and D186H/R280A from scaffold) and shows superior PET-hydrolytic activity relative to both wild-type and engineered alternatives¹² between 30 and 50 °C and a range of pH levels. We demonstrate that untreated, postconsumer-PET from 51 different thermoformed products can all be almost completely degraded by FAST-PETase in 1 week. FAST-PETase can also depolymerize untreated, amorphous portions of a commercial water bottle and an entire thermally pretreated water bottle at 50 ºC. Finally, we demonstrate a closed-loop PET recycling process by using FAST-PETase and resynthesizing PET from the recovered monomers. Collectively, our results demonstrate a viable route for enzymatic plastic recycling at the industrial scale.

Charge Engineering Improves the Performance of Bst DNA Polymerase Fusions

The charge states of proteins can greatly influence their stabilities and interactions with substrates, and the addition of multiple charges (supercharging) has been shown to be a successful approach for engineering protein stability and function. The addition of a fast-folding fusion domain to the Bacillus stearothermophilus DNA polymerase improved its functionality in isothermal amplification assays, and further charge engineering of this domain has increased both protein stability and diagnostics performance. When combined with mutations that stabilize the core of the protein, the charge-engineered fusion domain leads to the ability to carry out loop-mediated isothermal amplification (LAMP) at temperatures up to 74° C or in the presence of high concentrations of urea, with detection times under 10 min. Adding both positive and negative charges to the fusion domain led to changes in the relative reverse transcriptase and DNA polymerase activities of the polymerase. Overall, the development of a modular fusion domain whose charged surface can be modified at will should prove to be of use in the engineering of other polymerases and, in general, may prove useful for protein stabilization.

Protein sequence design with a learned potential

The task of protein sequence design is central to nearly all rational protein engineering problems, and enormous effort has gone into the development of energy functions to guide design. Here, we investigate the capability of a deep neural network model to automate design of sequences onto protein backbones, having learned directly from crystal structure data and without any human-specified priors. The model generalizes to native topologies not seen during training, producing experimentally stable designs. We evaluate the generalizability of our method to a de novo TIM-barrel scaffold. The model produces novel sequences, and high-resolution crystal structures of two designs show excellent agreement with in silico models. Our findings demonstrate the tractability of an entirely learned method for protein sequence design.

Rational protein design to achieve a given protein backbone conformation is needed to engineer specific functions. Here Anand et al. describe a machine learning method using a learned neural network potential for fixed-backbone protein design.

Machine Learning-driven Protein Library Design: A Path Toward Smarter Libraries

Proteins are small yet valuable biomolecules that play a versatile role in therapeutics and diagnostics. The intricate sequence-structure-function paradigm in the realm of proteins opens the possibility for directly mapping amino acid sequence to function. However, the rugged nature of the protein fitness landscape and an astronomical number of possible mutations even for small proteins make navigating this system a daunting task. Moreover, the scarcity of functional proteins and the ease with which deleterious mutations are introduced, due to complex epistatic relationships, compound the existing challenges. This highlights the need for auxiliary tools in current techniques such as rational design and directed evolution. To that end, the state-of-the-art machine learning can offer time and cost efficiency in finding high fitness proteins, circumventing unnecessary wet-lab experiments. In the context of improving library design, machine learning provides valuable insights via its unique features such as high adaptation to complex systems, multi-tasking, and parallelism, and the ability to capture hidden trends in input data. Finally, both the advancements in computational resources and the rapidly increasing number of sequences in protein databases will allow more promising and detailed insights delivered from machine learning to protein library design. In this chapter, fundamental concepts and a method for machine learning-driven library design leveraging deep sequencing datasets will be discussed. We elaborate on (1) basic knowledge about machine learning algorithms, (2) the benefit of machine learning in library design, and (3) methodology for implementing machine learning in library design.

Structure-based protein design with deep learning

Since the first revelation of proteins functioning as macromolecular machines through their three dimensional structures, researchers have been intrigued by the marvelous ways the biochemical processes are carried out by proteins. The aspiration to understand protein structures has fueled extensive efforts across different scientific disciplines. In recent years, it has been demonstrated that proteins with new functionality or shapes can be designed via structure-based modeling methods, and the design strategies have combined all available information - but largely piece-by-piece - from sequence derived statistics to the detailed atomic-level modeling of chemical interactions. Despite the significant progress, incorporating data-derived approaches through the use of deep learning methods can be a game changer. In this review, we summarize current progress, compare the arc of developing the deep learning approaches with the conventional methods, and describe the motivation and concepts behind current strategies that may lead to potential future opportunities.