Ensuring scientific reproducibility in bio-macromolecular modeling via extensive, automated benchmarks

Each year vast international resources are wasted on irreproducible research. The scientific community has been slow to adopt standard software engineering practices, despite the increases in high-dimensional data, complexities of workflows, and computational environments. Here we show how scientific software applications can be created in a reproducible manner when simple design goals for reproducibility are met. We describe the implementation of a test server framework and 40 scientific benchmarks, covering numerous applications in Rosetta bio-macromolecular modeling. High performance computing cluster integration allows these benchmarks to run continuously and automatically. Detailed protocol captures are useful for developers and users of Rosetta and other macromolecular modeling tools. The framework and design concepts presented here are valuable for developers and users of any type of scientific software and for the scientific community to create reproducible methods. Specific examples highlight the utility of this framework, and the comprehensive documentation illustrates the ease of adding new tests in a matter of hours.

Development and Evaluation of GlycanDock: A Protein-Glycoligand Docking Refinement Algorithm in Rosetta

Carbohydrate chains are ubiquitous in the complex molecular processes of life. These highly diverse chains are recognized by a variety of protein receptors, enabling glycans to regulate many biological functions. High-resolution structures of protein-glycoligand complexes reveal the atomic details necessary to understand this level of molecular recognition and inform application-focused scientific and engineering pursuits. When experimental challenges hinder high-throughput determination of quality structures, computational tools can, in principle, fill the gap. In this work, we introduce GlycanDock, a residue-centric protein-glycoligand docking refinement algorithm developed within the Rosetta macromolecular modeling and design software suite. We performed a benchmark docking assessment using a set of 109 experimentally determined protein-glycoligand complexes as well as 62 unbound protein structures. The GlycanDock algorithm can sample and discriminate among protein-glycoligand models of native-like structural accuracy with statistical reliability from starting structures of up to 7 Å root-mean-square deviation in the glycoligand ring atoms. We show that GlycanDock-refined models qualitatively replicated the known binding specificity of a bacterial carbohydrate-binding module. Finally, we present a protein-glycoligand docking pipeline for generating putative protein-glycoligand complexes when only the glycoligand sequence and unbound protein structure are known. In combination with other carbohydrate modeling tools, the GlycanDock docking refinement algorithm will accelerate research in the glycosciences.

Structural basis for peptide substrate specificities of glycosyltransferase GalNAc-T2

The polypeptide N-acetylgalactosaminyl transferase (GalNAc-T) enzyme family initiates O-linked mucin-type glycosylation. The family constitutes 20 isoenzymes in humans. GalNAc-Ts exhibit both redundancy and finely tuned specificity for a wide range of peptide substrates. In this work, we deciphered the sequence and structural motifs that determine the peptide substrate preferences for the GalNAc-T2 isoform. Our approach involved sampling and characterization of peptide-enzyme conformations obtained from Rosetta Monte Carlo-minimization-based flexible docking. We computationally scanned 19 amino acid residues at positions -1 and +1 of an eight-residue peptide substrate, which comprised a dataset of 361 (19x19) peptides with previously characterized experimental GalNAc-T2 glycosylation efficiencies. The calculations recapitulated experimental specificity data, successfully discriminating between glycosylatable and non-glycosylatable peptides with a probability of 96.5% (ROC-AUC score), a balanced accuracy of 85.5% and a false positive rate of 7.3%. The glycosylatable peptide substrates viz. peptides with proline, serine, threonine, and alanine at the -1 position of the peptide preferentially exhibited cognate sequon-like conformations. The preference for specific residues at the -1 position of the peptide was regulated by enzyme residues R362, K363, Q364, H365 and W331, which modulate the pocket size and specific enzyme-peptide interactions. For the +1 position of the peptide, enzyme residues K281 and K363 formed gating interactions with aromatics and glutamines at the +1 position of the peptide, leading to modes of peptide-binding sub-optimal for catalysis. Overall, our work revealed enzyme features that lead to the finely tuned specificity observed for a broad range of peptide substrates for the GalNAc-T2 enzyme. We anticipate that the key sequence and structural motifs can be extended to analyze specificities of other isoforms of the GalNAc-T family and can be used to guide design of variants with tailored specificity.

Computational design of mixed chirality peptide macrocycles with internal symmetry

Cyclic symmetry is frequent in protein and peptide homo‐oligomers, but extremely rare within a single chain, as it is not compatible with free N‐ and C‐termini. Here we describe the computational design of mixed‐chirality peptide macrocycles with rigid structures that feature internal cyclic symmetries or improper rotational symmetries inaccessible to natural proteins. Crystal structures of three C2‐ and C3‐symmetric macrocycles, and of six diverse S2‐symmetric macrocycles, match the computationally‐designed models with backbone heavy‐atom RMSD values of 1 Å or better. Crystal structures of an S4‐symmetric macrocycle (consisting of a sequence and structure segment mirrored at each of three successive repeats) designed to bind zinc reveal a large‐scale zinc‐driven conformational change from an S4‐symmetric apo‐state to a nearly inverted S4‐symmetric holo‐state almost identical to the design model. These symmetric structures provide promising starting points for applications ranging from design of cyclic peptide based metal organic frameworks to creation of high affinity binders of symmetric protein homo‐oligomers. More generally, this work demonstrates the power of computational design for exploring symmetries and structures not found in nature, and for creating synthetic switchable systems.

PDB Code(s): 6UFU, 6UG2, 6UG3, 6UG6, 6UGB, 6UGC, 6UCX, 6UD9, 6UDR, 6UDW, 6UDZ, 6UF4, 6UF7, 6UF8, 6UFA and 6UF9;

Novel sampling strategies and a coarse-grained score function for docking homomers, flexible heteromers, and oligosaccharides using Rosetta in CAPRI rounds 37-45

Critical Assessment of PRediction of Interactions (CAPRI) rounds 37 through 45 introduced larger complexes, new macromolecules, and multistage assemblies. For these rounds, we used and expanded docking methods in Rosetta to model 23 target complexes. We successfully predicted 14 target complexes and recognized and refined near-native models generated by other groups for two further targets. Notably, for targets T110 and T136, we achieved the closest prediction of any CAPRI participant. We created several innovative approaches during these rounds. Since round 39 (target 122), we have used the new RosettaDock 4.0, which has a revamped coarse-grained energy function and the ability to perform conformer selection during docking with hundreds of pregenerated protein backbones. Ten of the complexes had some degree of symmetry in their interactions, so we tested Rosetta SymDock, realized its shortcomings, and developed the next-generation symmetric docking protocol, SymDock2, which includes docking of multiple backbones and induced-fit refinement. Since the last CAPRI assessment, we also developed methods for modeling and designing carbohydrates in Rosetta, and we used them to successfully model oligosaccharide-protein complexes in round 41. Although the results were broadly encouraging, they also highlighted the pressing need to invest in (a) flexible docking algorithms with the ability to model loop and linker motions and in (b) new sampling and scoring methods for oligosaccharide-protein interactions.

Macromolecular modeling and design in Rosetta: recent methods and frameworks

The Rosetta software for macromolecular modeling, docking and design is extensively used in laboratories worldwide. During two decades of development by a community of laboratories at more than 60 institutions, Rosetta has been continuously refactored and extended. Its advantages are its performance and interoperability between broad modeling capabilities. Here we review tools developed in the last 5 years, including over 80 methods. We discuss improvements to the score function, user interfaces and usability. Rosetta is available at http://www.rosettacommons.org.

Better together: Elements of successful scientific software development in a distributed collaborative community

Many scientific disciplines rely on computational methods for data analysis, model generation, and prediction. Implementing these methods is often accomplished by researchers with domain expertise but without formal training in software engineering or computer science. This arrangement has led to underappreciation of sustainability and maintainability of scientific software tools developed in academic environments. Some software tools have avoided this fate, including the scientific library Rosetta. We use this software and its community as a case study to show how modern software development can be accomplished successfully, irrespective of subject area. Rosetta is one of the largest software suites for macromolecular modeling, with 3.1 million lines of code and many state-of-the-art applications. Since the mid 1990s, the software has been developed collaboratively by the RosettaCommons, a community of academics from over 60 institutions worldwide with diverse backgrounds including chemistry, biology, physiology, physics, engineering, mathematics, and computer science. Developing this software suite has provided us with more than two decades of experience in how to effectively develop advanced scientific software in a global community with hundreds of contributors. Here we illustrate the functioning of this development community by addressing technical aspects (like version control, testing, and maintenance), community-building strategies, diversity efforts, software dissemination, and user support. We demonstrate how modern computational research can thrive in a distributed collaborative community. The practices described here are independent of subject area and can be readily adopted by other software development communities.

Glycoengineering of Esterase Activity through Metabolic Flux-Based Modulation of Sialic Acid

This report describes the metabolic glycoengineering (MGE) of intracellular esterase activity in human colon cancer (LS174T) and Chinese hamster ovary (CHO) cells. In silico analysis of carboxylesterases CES1 and CES2 suggested that these enzymes are modified with sialylated N-glycans, which are proposed to stabilize the active multimeric forms of these enzymes. This premise was supported by treating cells with butanolylated ManNAc to increase sialylation, which in turn increased esterase activity. By contrast, hexosamine analogues not targeted to sialic acid biosynthesis (e.g., butanoylated GlcNAc or GalNAc) had minimal impact. Measurement of mRNA and protein confirmed that esterase activity was controlled through glycosylation and not through transcription or translation. Azide-modified ManNAc analogues widely used in MGE also enhanced esterase activity and provided a way to enrich targeted glycoengineered proteins (such as CES2), thereby providing unambiguous evidence that the compounds were converted to sialosides and installed into the glycan structures of esterases as intended. Overall, this study provides a pioneering example of the modulation of intracellular enzyme activity through MGE, which expands the value of this technology from its current status as a labeling strategy and modulator of cell surface biological events.

The Rosetta All-Atom Energy Function for Macromolecular Modeling and Design

Over the past decade, the Rosetta biomolecular modeling suite has informed diverse biological questions and engineering challenges ranging from interpretation of low-resolution structural data to design of nanomaterials, protein therapeutics, and vaccines. Central to Rosetta's success is the energy function: a model parametrized from small-molecule and X-ray crystal structure data used to approximate the energy associated with each biomolecule conformation. This paper describes the mathematical models and physical concepts that underlie the latest Rosetta energy function, called the Rosetta Energy Function 2015 (REF15). Applying these concepts, we explain how to use Rosetta energies to identify and analyze the features of biomolecular models. Finally, we discuss the latest advances in the energy function that extend its capabilities from soluble proteins to also include membrane proteins, peptides containing noncanonical amino acids, small molecules, carbohydrates, nucleic acids, and other macromolecules.

Residue-centric modeling and design of saccharide and glycoconjugate structures

The RosettaCarbohydrate framework is a new tool for modeling a wide variety of saccharide and glycoconjugate structures. This report describes the development of the framework and highlights its applications. The framework integrates with established protocols within the Rosetta modeling and design suite, and it handles the vast complexity and variety of carbohydrate molecules, including branching and sugar modifications. To address challenges of sampling and scoring, RosettaCarbohydrate can sample glycosidic bonds, side-chain conformations, and ring forms, and it utilizes a glycan-specific term within its scoring function. Rosetta can work with standard PDB, GLYCAM, and GlycoWorkbench (.gws) file formats. Saccharide residue-specific chemical information is stored internally, permitting glycoengineering and design. Carbohydrate-specific applications described herein include virtual glycosylation, loop-modeling of carbohydrates, and docking of glyco-ligands to antibodies. Benchmarking data are presented and compared to other studies, demonstrating Rosetta's ability to predict glyco-ligand binding. The framework expands the tools available to glycoscientists and engineers. © 2016 Wiley Periodicals, Inc.

Structural Diversity in the Type IV Pili of Multidrug-resistant Acinetobacter

Acinetobacter baumannii is a Gram-negative coccobacillus found primarily in hospital settings that has recently emerged as a source of hospital-acquired infections. A. baumannii expresses a variety of virulence factors, including type IV pili, bacterial extracellular appendages often essential for attachment to host cells. Here, we report the high resolution structures of the major pilin subunit, PilA, from three Acinetobacter strains, demonstrating that A. baumannii subsets produce morphologically distinct type IV pilin glycoproteins. We examine the consequences of this heterogeneity for protein folding and assembly as well as host-cell adhesion by Acinetobacter Comparisons of genomic and structural data with pilin proteins from other species of soil gammaproteobacteria suggest that these structural differences stem from evolutionary pressure that has resulted in three distinct classes of type IVa pilins, each found in multiple species.

A comprehensive, high-resolution map of a gene's fitness landscape

Mutations are central to evolution, providing the genetic variation upon which selection acts. A mutation’s effect on the suitability of a gene to perform a particular function (gene fitness) can be positive, negative, or neutral. Knowledge of the distribution of fitness effects (DFE) of mutations is fundamental for understanding evolutionary dynamics, molecular-level genetic variation, complex genetic disease, the accumulation of deleterious mutations, and the molecular clock. We present comprehensive DFEs for point and codon mutants of the Escherichia coli TEM-1 β-lactamase gene and missense mutations in the TEM-1 protein. These DFEs provide insight into the inherent benefits of the genetic code’s architecture, support for the hypothesis that mRNA stability dictates codon usage at the beginning of genes, an extensive framework for understanding protein mutational tolerance, and evidence that mutational effects on protein thermodynamic stability shape the DFE. Contrary to prevailing expectations, we find that deleterious effects of mutation primarily arise from a decrease in specific protein activity and not cellular protein levels.

Extending RosettaDock with water, sugar, and pH for prediction of complex structures and affinities for CAPRI rounds 20-27

Rounds 20-27 of the Critical Assessment of PRotein Interactions (CAPRI) provided a testing platform for computational methods designed to address a wide range of challenges. The diverse targets drove the creation of and new combinations of computational tools. In this study, RosettaDock and other novel Rosetta protocols were used to successfully predict four of the 10 blind targets. For example, for DNase domain of Colicin E2-Im2 immunity protein, RosettaDock and RosettaLigand were used to predict the positions of water molecules at the interface, recovering 46% of the native water-mediated contacts. For α-repeat Rep4-Rep2 and g-type lysozyme-PliG inhibitor complexes, homology models were built and standard and pH-sensitive docking algorithms were used to generate structures with interface RMSD values of 3.3 Å and 2.0 Å, respectively. A novel flexible sugar-protein docking protocol was also developed and used for structure prediction of the BT4661-heparin-like saccharide complex, recovering 71% of the native contacts. Challenges remain in the generation of accurate homology models for protein mutants and sampling during global docking. On proteins designed to bind influenza hemagglutinin, only about half of the mutations were identified that affect binding (T55: 54%; T56: 48%). The prediction of the structure of the xylanase complex involving homology modeling and multidomain docking pushed the limits of global conformational sampling and did not result in any successful prediction. The diversity of problems at hand requires computational algorithms to be versatile; the recent additions to the Rosetta suite expand the capabilities to encompass more biologically realistic docking problems.

NMR detection and study of hydrolysis of HNO-derived sulfinamides

Nitroxyl (HNO), a potential heart failure therapeutic, is known to post-translationally modify cysteine residues. Among reactive nitrogen oxide species, the modification of cysteine residues to sulfinamides [RS(O)NH2] is unique to HNO. We have applied (15)N-edited (1)H NMR techniques to detect the HNO-induced thiol to sulfinamide modification in several small organic molecules, peptides, and the cysteine protease, papain. Relevant reactions of sulfinamides involve reduction to free thiols in the presence of excess thiol and hydrolysis to form sulfinic acids [RS(O)OH]. We have investigated sulfinamide hydrolysis at physiological pH and temperature. Studies with papain and a related model peptide containing the active site thiol suggest that sulfinamide hydrolysis can be enhanced in a protein environment. These findings are also supported by modeling studies. In addition, analysis of peptide sulfinamides at various pH values suggests that hydrolysis becomes more facile under acidic conditions.

Adding diverse noncanonical backbones to rosetta: enabling peptidomimetic design

Peptidomimetics are classes of molecules that mimic structural and functional attributes of polypeptides. Peptidomimetic oligomers can frequently be synthesized using efficient solid phase synthesis procedures similar to peptide synthesis. Conformationally ordered peptidomimetic oligomers are finding broad applications for molecular recognition and for inhibiting protein-protein interactions. One critical limitation is the limited set of design tools for identifying oligomer sequences that can adopt desired conformations. Here, we present expansions to the ROSETTA platform that enable structure prediction and design of five non-peptidic oligomer scaffolds (noncanonical backbones), oligooxopiperazines, oligo-peptoids, -peptides, hydrogen bond surrogate helices and oligosaccharides. This work is complementary to prior additions to model noncanonical protein side chains in ROSETTA. The main purpose of our manuscript is to give a detailed description to current and future developers of how each of these noncanonical backbones was implemented. Furthermore, we provide a general outline for implementation of new backbone types not discussed here. To illustrate the utility of this approach, we describe the first tests of the ROSETTA molecular mechanics energy function in the context of oligooxopiperazines, using quantum mechanical calculations as comparison points, scanning through backbone and side chain torsion angles for a model peptidomimetic. Finally, as an example of a novel design application, we describe the automated design of an oligooxopiperazine that inhibits the p53-MDM2 protein-protein interaction. For the general biological and bioengineering community, several noncanonical backbones have been incorporated into web applications that allow users to freely and rapidly test the presented protocols (http://rosie.rosettacommons.org). This work helps address the peptidomimetic community's need for an automated and expandable modeling tool for noncanonical backbones.

Autoproteolytic activation of ThnT results in structural reorganization necessary for substrate binding and catalysis

cis-Autoproteolysis is a post-translational modification necessary for the function of ThnT, an enzyme involved in the biosynthesis of the β-lactam antibiotic thienamycin. This modification generates an N-terminal threonine nucleophile that is used to hydrolyze the pantetheinyl moiety of its natural substrate. We determined the crystal structure of autoactivated ThnT to 1.8Å through X-ray crystallography. Comparison to a mutationally inactivated precursor structure revealed several large conformational rearrangements near the active site. To probe the relevance of these transitions, we designed a pantetheine-like chloromethyl ketone inactivator and co-crystallized it with ThnT. Although this class of inhibitor has been in use for several decades, the mode of inactivation had not been determined for an enzyme that uses an N-terminal nucleophile. The co-crystal structure revealed the chloromethyl ketone bound to the N-terminal nucleophile of ThnT through an ether linkage, and analysis suggests inactivation through a direct displacement mechanism. More importantly, this inactivated complex shows that three regions of ThnT that are critical to the formation of the substrate binding pocket undergo rearrangement upon autoproteolysis. Comparison of ThnT with other autoproteolytic enzymes of disparate evolutionary lineage revealed a high degree of similarity within the proenzyme active site, reflecting shared chemical constraints. However, after autoproteolysis, many enzymes, like ThnT, are observed to rearrange in order to accommodate their specific substrate. We propose that this is a general phenomenon, whereby autoprocessing systems with shared chemistry may possess similar structural features that dissipate upon rearrangement into a mature state.

Engineering the synthetic potential of β-lactam synthetase and the importance of catalytic loop dynamics

The 2-azetidinone ring of the Class A and D β-lactamase inhibitor clavulanic acid (1) is synthesized by the ATP-utilizing enzyme β-lactam synthetase (βLS). A hydroxyethyl group attached to C-6 of 1 in the (S) configuration markedly enhances the efficacy of this compound against Class C β-lactamases. Guided by a series of X-ray structures of βLS, we have engineered this enzyme to act upon a methylated substrate analogue to give selectively the (3S)-methyl β-lactam core, which, upon closure of the second ring of the bicyclic system of 1, would lead to the (6S)-methylated clavulanic acid derivative.

Structural basis for biosynthetic programming of fungal aromatic polyketide cyclization

Polyketides are a class of natural products with diverse structures and biological activities. The structural variability of aromatic products of fungal nonreducing, multidomain iterative polyketide synthases (NR-PKS group of IPKSs) results from regiospecific cyclizations of reactive poly-beta-keto intermediates. How poly-beta-keto species are synthesized and stabilized, how their chain lengths are determined, and, in particular, how specific cyclization patterns are controlled have been largely inaccessible and functionally unknown until recently. A product template (PT) domain is responsible for controlling specific aldol cyclization and aromatization of these mature polyketide precursors, but the mechanistic basis is unknown. Here we present the 1.8 A crystal structure and mutational studies of a dissected PT monodomain from PksA, the NR-PKS that initiates the biosynthesis of the potent hepatocarcinogen aflatoxin B(1) in Aspergillus parasiticus. Despite having minimal sequence similarity to known enzymes, the structure displays a distinct 'double hot dog' (DHD) fold. Co-crystal structures with palmitate or a bicyclic substrate mimic illustrate that PT can bind both linear and bicyclic polyketides. Docking and mutagenesis studies reveal residues important for substrate binding and catalysis, and identify a phosphopantetheine localization channel and a deep two-part interior binding pocket and reaction chamber. Sequence similarity and extensive conservation of active site residues in PT domains suggest that the mechanistic insights gleaned from these studies will prove general for this class of IPKSs, and lay a foundation for defining the molecular rules controlling NR-PKS cyclization specificity.