VMD as a Platform for Interactive Small Molecule Preparation and Visualization in Quantum and Classical Simulations

Modeling and simulation of small molecules such as drugs and biological cofactors have been both a major focus of computational chemistry for decades and a growing need among computational biophysicists who seek to investigate the interaction of different types of ligands with biomolecules. Of particular interest in this regard are quantum mechanical (QM) calculations that are used to more accurately describe such small molecules, which can be of heterogeneous structures and chemistry, either in purely QM calculations or in hybrid QM/molecular mechanics (MM) simulations. QM programs are also used to develop MM force field parameters for small molecules to be used along with established force fields for biomolecules in classical simulations. With this growing need in mind, here we report a set of software tools developed and closely integrated within the broadly used molecular visualization/analysis program, VMD, that allow the user to construct, modify, and parametrize small molecules and prepare them for QM, hybrid QM/MM, or classical simulations. The tools also provide interactive analysis and visualization capabilities in an easy-to-use and integrated environment. In this paper, we briefly report on these tools and their major features and capabilities, along with examples of how they can facilitate molecular research in computational biophysics that might be otherwise prohibitively complex.

Dynamics of chromosome organization in a minimal bacterial cell

Computational models of cells cannot be considered complete unless they include the most fundamental process of life, the replication and inheritance of genetic material. By creating a computational framework to model systems of replicating bacterial chromosomes as polymers at 10 bp resolution with Brownian dynamics, we investigate changes in chromosome organization during replication and extend the applicability of an existing whole-cell model (WCM) for a genetically minimal bacterium, JCVI-syn3A, to the entire cell-cycle. To achieve cell-scale chromosome structures that are realistic, we model the chromosome as a self-avoiding homopolymer with bending and torsional stiffnesses that capture the essential mechanical properties of dsDNA in Syn3A. In addition, the conformations of the circular DNA must avoid overlapping with ribosomes identitied in cryo-electron tomograms. While Syn3A lacks the complex regulatory systems known to orchestrate chromosome segregation in other bacteria, its minimized genome retains essential loop-extruding structural maintenance of chromosomes (SMC) protein complexes (SMC-scpAB) and topoisomerases. Through implementing the effects of these proteins in our simulations of replicating chromosomes, we find that they alone are sufficient for simultaneous chromosome segregation across all generations within nested theta structures. This supports previous studies suggesting loop-extrusion serves as a near-universal mechanism for chromosome organization within bacterial and eukaryotic cells. Furthermore, we analyze ribosome diffusion under the influence of the chromosome and calculate in silico chromosome contact maps that capture inter-daughter interactions. Finally, we present a methodology to map the polymer model of the chromosome to a Martini coarse-grained representation to prepare molecular dynamics models of entire Syn3A cells, which serves as an ultimate means of validation for cell states predicted by the WCM.

Application Experiences on a GPU-Accelerated Arm-based HPC Testbed

This paper assesses and reports the experience of ten teams working to port, validate, and benchmark several High Performance Computing applications on a novel GPU-accelerated Arm testbed system. The testbed consists of eight NVIDIA Arm HPC Developer Kit systems, each one equipped with a server-class Arm CPU from Ampere Computing and two data center GPUs from NVIDIA Corp. The systems are connected together using InfiniBand interconnect. The selected applications and mini-apps are written using several programming languages and use multiple accelerator-based programming models for GPUs such as CUDA, OpenACC, and OpenMP offloading. Working on application porting requires a robust and easy-to-access programming environment, including a variety of compilers and optimized scientific libraries. The goal of this work is to evaluate platform readiness and assess the effort required from developers to deploy well-established scientific workloads on current and future generation Arm-based GPU-accelerated HPC systems. The reported case studies demonstrate that the current level of maturity and diversity of software and tools is already adequate for large-scale production deployments.

Intelligent resolution: Integrating Cryo-EM with AI-driven multi-resolution simulations to observe the severe acute respiratory syndrome coronavirus-2 replication-transcription machinery in action

The severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) replication transcription complex (RTC) is a multi-domain protein responsible for replicating and transcribing the viral mRNA inside a human cell. Attacking RTC function with pharmaceutical compounds is a pathway to treating COVID-19. Conventional tools, e.g., cryo-electron microscopy and all-atom molecular dynamics (AAMD), do not provide sufficiently high resolution or timescale to capture important dynamics of this molecular machine. Consequently, we develop an innovative workflow that bridges the gap between these resolutions, using mesoscale fluctuating finite element analysis (FFEA) continuum simulations and a hierarchy of AI-methods that continually learn and infer features for maintaining consistency between AAMD and FFEA simulations. We leverage a multi-site distributed workflow manager to orchestrate AI, FFEA, and AAMD jobs, providing optimal resource utilization across HPC centers. Our study provides unprecedented access to study the SARS-CoV-2 RTC machinery, while providing general capability for AI-enabled multi-resolution simulations at scale.

py-MCMD: Python Software for Performing Hybrid Monte Carlo/Molecular Dynamics Simulations with GOMC and NAMD

py-MCMD, an open-source Python software, provides a robust workflow layer that manages communication of relevant system information between the simulation engines NAMD and GOMC and generates coherent thermodynamic properties and trajectories for analysis. To validate the workflow and highlight its capabilities, hybrid Monte Carlo/molecular dynamics (MC/MD) simulations are performed for SPC/E water in the isobaric-isothermal (NPT) and grand canonical (GC) ensembles as well as with Gibbs ensemble Monte Carlo (GEMC). The hybrid MC/MD approach shows close agreement with reference MC simulations and has a computational efficiency that is 2 to 136 times greater than traditional Monte Carlo simulations. MC/MD simulations performed for water in a graphene slit pore illustrate significant gains in sampling efficiency when the coupled-decoupled configurational-bias MC (CD-CBMC) algorithm is used compared with simulations using a single unbiased random trial position. Simulations using CD-CBMC reach equilibrium with 25 times fewer cycles than simulations using a single unbiased random trial position, with a small increase in computational cost. In a more challenging application, hybrid grand canonical Monte Carlo/molecular dynamics (GCMC/MD) simulations are used to hydrate a buried binding pocket in bovine pancreatic trypsin inhibitor. Water occupancies produced by GCMC/MD simulations are in close agreement with crystallographically identified positions, and GCMC/MD simulations have a computational efficiency that is 5 times better than MD simulations. py-MCMD is available on GitHub at https://github.com/GOMC-WSU/py-MCMD.

Online psychological interventions to reduce symptoms of depression, anxiety, and general distress in those with chronic health conditions: a systematic review and meta-analysis of randomized controlled trials

BACKGROUND

Over the past 15 years, there has been substantial growth in web-based psychological interventions. We summarize evidence regarding the efficacy of web-based self-directed psychological interventions on depressive, anxiety and distress symptoms in people living with a chronic health condition.

METHOD

We searched Medline, PsycINFO, CINAHL, EMBASE databases and Cochrane Database from 1990 to 1 May 2019. English language papers of randomized controlled trials (usual care or waitlist control) of web-based psychological interventions with a primary or secondary aim to reduce anxiety, depression or distress in adults with a chronic health condition were eligible. Results were assessed using narrative synthases and random-effects meta-analyses.

RESULTS

In total 70 eligible studies across 17 health conditions [most commonly: cancer (k = 20), chronic pain (k = 9), arthritis (k = 6) and multiple sclerosis (k = 5), diabetes (k = 4), fibromyalgia (k = 4)] were identified. Interventions were based on CBT principles in 46 (66%) studies and 42 (60%) included a facilitator. When combining all chronic health conditions, web-based interventions were more efficacious than control conditions in reducing symptoms of depression g = 0.30 (95% CI 0.22-0.39), anxiety g = 0.19 (95% CI 0.12-0.27), and distress g = 0.36 (95% CI 0.23-0.49).

CONCLUSION

Evidence regarding effectiveness for specific chronic health conditions was inconsistent. While self-guided online psychological interventions may help to reduce symptoms of anxiety, depression and distress in people with chronic health conditions in general, it is unclear if these interventions are effective for specific health conditions. More high-quality evidence is needed before definite conclusions can be made.

Lessons Learned from Responsive Molecular Dynamics Studies of the COVID-19 Virus

Over the past 18 months, the need to perform atomic detail molecular dynamics simulations of the SARS-CoV-2 virion, its spike protein, and other structures related to the viral infection cycle has led biomedical researchers worldwide to urgently seek out all available biomolecular structure information, appropriate molecular modeling and simulation software, and the necessary computing resources to conduct their work. We describe our experiences from several COVID-19 research collaborations and the challenges they presented in terms of our molecular modeling software development and support efforts, our laboratory's local computing environment, and our scientists' use of non-traditional HPC hardware platforms such as public clouds for large scale parallel molecular dynamics simulations.

AI-driven multiscale simulations illuminate mechanisms of SARS-CoV-2 spike dynamics

We develop a generalizable AI-driven workflow that leverages heterogeneous HPC resources to explore the time-dependent dynamics of molecular systems. We use this workflow to investigate the mechanisms of infectivity of the SARS-CoV-2 spike protein, the main viral infection machinery. Our workflow enables more efficient investigation of spike dynamics in a variety of complex environments, including within a complete SARS-CoV-2 viral envelope simulation, which contains 305 million atoms and shows strong scaling on ORNL Summit using NAMD. We present several novel scientific discoveries, including the elucidation of the spike's full glycan shield, the role of spike glycans in modulating the infectivity of the virus, and the characterization of the flexible interactions between the spike and the human ACE2 receptor. We also demonstrate how AI can accelerate conformational sampling across different systems and pave the way for the future application of such methods to additional studies in SARS-CoV-2 and other molecular systems.

AI-Driven Multiscale Simulations Illuminate Mechanisms of SARS-CoV-2 Spike Dynamics

We develop a generalizable AI-driven workflow that leverages heterogeneous HPC resources to explore the time-dependent dynamics of molecular systems. We use this workflow to investigate the mechanisms of infectivity of the SARS-CoV-2 spike protein, the main viral infection machinery. Our workflow enables more efficient investigation of spike dynamics in a variety of complex environments, including within a complete SARS-CoV-2 viral envelope simulation, which contains 305 million atoms and shows strong scaling on ORNL Summit using NAMD. We present several novel scientific discoveries, including the elucidation of the spike's full glycan shield, the role of spike glycans in modulating the infectivity of the virus, and the characterization of the flexible interactions between the spike and the human ACE2 receptor. We also demonstrate how AI can accelerate conformational sampling across different systems and pave the way for the future application of such methods to additional studies in SARS-CoV-2 and other molecular systems.

Scalable Analysis of Authentic Viral Envelopes on FRONTERA

Enveloped viruses, such as SARS-CoV-2, infect cells via fusion of their envelope with the host membrane. By employing molecular simulations to characterize viral envelopes, researchers can gain insights into key determinants of infection. Here, the Frontera supercomputer is leveraged for large-scale modeling and analysis of authentic viral envelopes, whose lipid compositions are complex and realistic. Visual Molecular Dynamics (VMD) with support for MPI is employed, overcoming previous computational limitations and enabling investigation into virus biology at an unprecedented scale. The techniques applied here to an authentic HIV-1 envelope at two levels of spatial resolution (29 million particles and 280 million atoms) are broadly applicable to the study of other viruses. The authors are actively employing these techniques to develop and characterize an authentic SARS-CoV-2 envelope. A general framework for carrying out scalable analysis of simulation trajectories on Frontera is presented, expanding the utility of the machine in humanity’s ongoing fight against infectious diseases.

Scalable molecular dynamics on CPU and GPU architectures with NAMD

NAMDis a molecular dynamics program designed for high-performance simulations of very large biological objects on CPU- and GPU-based architectures. NAMD offers scalable performance on petascale parallel supercomputers consisting of hundreds of thousands of cores, as well as on inexpensive commodity clusters commonly found in academic environments. It is written in C++ and leans on Charm++ parallel objects for optimal performance on low-latency architectures. NAMD is a versatile, multipurpose code that gathers state-of-the-art algorithms to carry out simulations in apt thermodynamic ensembles, using the widely popular CHARMM, AMBER, OPLS, and GROMOS biomolecular force fields. Here, we review the main features of NAMD that allow both equilibrium and enhanced-sampling molecular dynamics simulations with numerical efficiency. We describe the underlying concepts utilized by NAMD and their implementation, most notably for handling long-range electrostatics; controlling the temperature, pressure, and pH; applying external potentials on tailored grids; leveraging massively parallel resources in multiple-copy simulations; and hybrid quantum-mechanical/molecular-mechanical descriptions. We detail the variety of options offered by NAMD for enhanced-sampling simulations aimed at determining free-energy differences of either alchemical or geometrical transformations and outline their applicability to specific problems. Last, we discuss the roadmap for the development of NAMD and our current efforts toward achieving optimal performance on GPU-based architectures, for pushing back the limitations that have prevented biologically realistic billion-atom objects to be fruitfully simulated, and for making large-scale simulations less expensive and easier to set up, run, and analyze. NAMD is distributed free of charge with its source code at www.ks.uiuc.edu.

0433 Targeting Light Sensitivity Parameters to Optimize Circadian Phase Predictions

Introduction

Existing models of the human circadian clock accurately predict phase at group-level but not at individual-level. Interindividual variability in light sensitivity is not currently accounted for in these models and may be a practical approach to improving individual-level predictions. Using the gold-standard predictive model, we (i) identified whether varying light sensitivity parameters produces meaningful changes in predicted phase in field conditions; and (ii) tested whether optimizing parameters can significantly improve accuracy of circadian phase prediction.

Methods

Healthy participants (n=12, 7 women, aged 18-26) underwent continuous light and activity monitoring for 3 weeks (Actiwatch Spectrum). Salivary dim light melatonin onset (DLMO) was measured each week. A model of the human circadian clock and its response to light was used to predict the three weekly DLMO times using the individual’s light data. A sensitivity analysis was performed varying three model parameters within physiological ranges: (i) amplitude of the light response [p]; (ii) advance vs. delay bias of the light response [K]; and (iii) intrinsic circadian period [tau]. These parameters were then fitted using least squares estimation to obtain optimal predictions of DLMO for each individual. Accuracy was compared between optimized parameters and default parameters.

Results

The default model predicted DLMO with mean absolute error of 1.02h. Sensitivity analysis showed the average range of variation in predicted DLMOs across participants was 0.65h for p, 4.28h for K and 3.26h for tau. Fitting parameters independently, we found mean absolute error of 0.85h for p, 0.71h for K and 0.75h for tau. Fitting p and K together reduced mean absolute error to 0.57h.

Conclusion

Light sensitivity parameters capture similar or greater variability in phase as intrinsic circadian period, indicating they are a viable option for individualising circadian phase predictions. Future prospective work is needed using measures of light sensitivity to validate this approach.

Support

N/A

0289 What is the Optimal Duration to Sleep in on Weekends?

Introduction

Most individuals in the workforce exhibit differing sleep/wake patterns between work days and weekends. Work days are typically characterized by shorter and earlier sleep. On weekends, sleep debt is repaid by sleeping later and longer, often due to evening events. While social jet-lag (the mismatch in work vs. free sleep timing) is associated with poor health outcomes, repaying sleep debt is beneficial to health. The degree to which individuals should sleep in on weekends is currently unknown.

Methods

We used a mathematical model of human sleep/wake timing, which has been validated for predicting sleep/wake patterns in a variety of field/lab conditions. Sleep timing constraints are inputs, and the model generates predicted sleep/wake patterns and alertness levels. We simulated a traditional 7-day work week, with 7am rise times on week days. Inter-individual differences in chronotype were modeled by varying intrinsic circadian period. The model was applied to two conditions: (i) free choice of sleep onset times on weekends; or (ii) late nights on weekends (2am bedtime). Weekend rise time was systematically varied to optimize predicted daytime alertness.

Results

Optimal weekend rise times varied as a function of chronotype. With free choice sleep onset times, the model predicted optimal rise time was later for late types than early types, ranging from 7:20 to 8:40am across individuals. Sleeping later than optimal was associated with poorer performance due to misaligned circadian phase. The same trend was observed in the late-night condition, but with later optimal rise times, ranging from 8:30 to 9:50am.

Conclusion

Although individuals should maintain a consistent sleep/wake pattern on all days of the week, they often do not, due to work or social commitments. Within real-world constraints, we provided the first objective recommendations for sleep timing on the weekend, finding a compromise between repaying sleep debt and avoiding circadian misalignment.

Support

N/A

Atoms to Phenotypes: Molecular Design Principles of Cellular Energy Metabolism

We report a 100-million atom-scale model of an entire cell organelle, a photosynthetic chromatophore vesicle from a purple bacterium, that reveals the cascade of energy conversion steps culminating in the generation of ATP from sunlight. Molecular dynamics simulations of this vesicle elucidate how the integral membrane complexes influence local curvature to tune photoexcitation of pigments. Brownian dynamics of small molecules within the chromatophore probe the mechanisms of directional charge transport under various pH and salinity conditions. Reproducing phenotypic properties from atomistic details, a kinetic model evinces that low-light adaptations of the bacterium emerge as a spontaneous outcome of optimizing the balance between the chromatophore's structural integrity and robust energy conversion. Parallels are drawn with the more universal mitochondrial bioenergetic machinery, from whence molecular-scale insights into the mechanism of cellular aging are inferred. Together, our integrative method and spectroscopic experiments pave the way to first-principles modeling of whole living cells.

Multiscale modeling and cinematic visualization of photosynthetic energy conversion processes from electronic to cell scales

Conversion of sunlight into chemical energy, namely photosynthesis, is the primary energy source of life on Earth. A visualization depicting this process, based on multiscale computational models from electronic to cell scales, is presented in the form of an excerpt from the fulldome show Birth of Planet Earth. This accessible visual narrative shows a lay audience, including children, how the energy of sunlight is captured, converted, and stored through a chain of proteins to power living cells. The visualization is the result of a multi-year collaboration among biophysicists, visualization scientists, and artists, which, in turn, is based on a decade-long experimental-computational collaboration on structural and functional modeling that produced an atomic detail description of a bacterial bioenergetic organelle, the chromatophore. Software advancements necessitated by this project have led to significant performance and feature advances, including hardware-accelerated cinematic ray tracing and instanced visualizations for efficient cell-scale modeling. The energy conversion steps depicted feature an integration of function from electronic to cell levels, spanning nearly 12 orders of magnitude in time scales. This atomic detail description uniquely enables a modern retelling of one of humanity's earliest stories-the interplay between light and life.

High-Performance Analysis of Biomolecular Containers to Measure Small-Molecule Transport, Transbilayer Lipid Diffusion, and Protein Cavities

Compartmentalization is a central theme in biology. Cells are composed of numerous membrane-enclosed structures, evolved to facilitate specific biochemical processes; viruses act as containers of genetic material, optimized to drive infection. Molecular dynamics simulations provide a mechanism to study biomolecular containers and the influence they exert on their environments; however, trajectory analysis software generally lacks knowledge of container interior versus exterior. Further, many relevant container analyses involve large-scale particle tracking endeavors, which may become computationally prohibitive with increasing system size. Here, a novel method based on 3-D ray casting is presented, which rapidly classifies the space surrounding biomolecular containers of arbitrary shape, enabling fast determination of the identities and counts of particles (e.g., solvent molecules) found inside and outside. The method is broadly applicable to the study of containers and enables high-performance characterization of properties such as solvent density, small-molecule transport, transbilayer lipid diffusion, and topology of protein cavities. The method is implemented in VMD, a widely used simulation analysis tool that supports personal computers, clouds, and parallel supercomputers, including ORNL’s Summit and Titan and NCSA’s Blue Waters, where the method can be employed to efficiently analyze trajectories encompassing millions of particles. The ability to rapidly characterize the spatial relationships of particles relative to a biomolecular container over many trajectory frames, irrespective of large particle counts, enables analysis of containers on a scale that was previously unfeasible, at a level of accuracy that was previously unattainable.

Scalable Molecular Dynamics with NAMD on the Summit System

NAMD (NAnoscale Molecular Dynamics) is a parallel molecular dynamics application that has been used to make breakthroughs in understanding the structure and dynamics of large biomolecular complexes, such as viruses like HIV and various types of influenza. State-of-the-art biomolecular simulations often require integration of billions of timesteps, computing all interatomic forces for each femtosecond timestep. Molecular dynamics simulation of large biomolecular systems and long-timescale biological phenomena requires tremendous computing power. NAMD harnesses the power of thousands of heterogeneous processors to meet this demand. In this paper, we present algorithm improvements and performance optimizations that enable NAMD to achieve high performance on the IBM Newell platform (with POWER9 processors and NVIDIA Volta V100 GPUs) which underpins the Oak Ridge National Laboratory's Summit and Lawrence Livermore National Laboratory's Sierra supercomputers. The Top-500 supercomputers June 2018 list shows Summit at the number one spot with 187 Petaflop/s peak performance and Sierra third with 119 Petaflop/s. Optimizations for NAMD on Summit include: data layout changes for GPU acceleration and CPU vectorization, improving GPU offload efficiency, increasing performance with PAMI support in Charm++, improving efficiency of FFT calculations, improving load balancing, enabling better CPU vectorization and cache performance, and providing an alternative thermostat through stochastic velocity rescaling. We also present performance scaling results on early Newell systems.

Challenges of Integrating Stochastic Dynamics and Cryo-Electron Tomograms in Whole-Cell Simulations

Cryo-electron tomography (cryo-ET) has rapidly emerged as a powerful tool to investigate the internal, three-dimensional spatial organization of the cell. In parallel, the GPU-based technology to perform spatially resolved stochastic simulations of whole cells has arisen, allowing the simulation of complex biochemical networks over cell cycle time scales using data taken from -omics, single molecule experiments, and in vitro kinetics. By using real cell geometry derived from cryo-ET data, we have the opportunity to imbue these highly detailed structural data-frozen in time-with realistic biochemical dynamics and investigate how cell structure affects the behavior of the embedded chemical reaction network. Here we present two examples to illustrate the challenges and techniques involved in integrating structural data into stochastic simulations. First, a tomographic reconstruction of Saccharomyces cerevisiae is used to construct the geometry of an entire cell through which a simple stochastic model of an inducible genetic switch is studied. Second, a tomogram of the nuclear periphery in a HeLa cell is converted directly to the simulation geometry through which we study the effects of cellular substructure on the stochastic dynamics of gene repression. These simple chemical models allow us to illustrate how to build whole-cell simulations using cryo-ET derived geometry and the challenges involved in such a process.

Molecular dynamics-based refinement and validation for sub-5 Å cryo-electron microscopy maps

Two structure determination methods, based on the molecular dynamics flexible fitting (MDFF) paradigm, are presented that resolve sub-5 Å cryo-electron microscopy (EM) maps with either single structures or ensembles of such structures. The methods, denoted cascade MDFF and resolution exchange MDFF, sequentially re-refine a search model against a series of maps of progressively higher resolutions, which ends with the original experimental resolution. Application of sequential re-refinement enables MDFF to achieve a radius of convergence of ~25 Å demonstrated with the accurate modeling of β-galactosidase and TRPV1 proteins at 3.2 Å and 3.4 Å resolution, respectively. The MDFF refinements uniquely offer map-model validation and B-factor determination criteria based on the inherent dynamics of the macromolecules studied, captured by means of local root mean square fluctuations. The MDFF tools described are available to researchers through an easy-to-use and cost-effective cloud computing resource on Amazon Web Services.

DOI:http://dx.doi.org/10.7554/eLife.16105.001

To understand the roles that proteins and other large molecules play inside cells, it is important to determine their structures. One of the techniques that researchers can use to do this is called cryo-electron microscopy (cryo-EM), which rapidly freezes molecules to fix them in position before imaging them in fine detail.

The cryo-EM images are like maps that show the approximate position of atoms. These images must then be processed in order to build a three-dimensional model of the protein that shows how its atoms are arranged relative to each other. One computational approach called Molecular Dynamics Flexible Fitting (MDFF) works by flexibly fitting possible atomic structures into cryo-EM maps. Although this approach works well with relatively undetailed (or ‘low resolution’) cryo-EM images, it struggles to handle the high-resolution cryo-EM maps now being generated.

Singharoy, Teo, McGreevy et al. have now developed two MDFF methods – called cascade MDFF and resolution exchange MDFF – that help to resolve atomic models of biological molecules from cryo-EM images. Each method can refine poorly guessed models into ones that are consistent with the high-resolution experimental images. The refinement is achieved by interpreting a range of images that starts with a ‘fuzzy’ image. The contrast of the image is then progressively improved until an image is produced that has a resolution that is good enough to almost distinguish individual atoms.

The method works because each cryo-EM image shows not just one, but a collection of atomic structures that the molecule can take on, with the fuzzier parts of the image representing the more flexible parts of the molecule. By taking into account this flexibility, the large-scale features of the protein structure can be determined first from the fuzzier images, and increasing the contrast of the images allows smaller-scale refinements to be made to the structure.

The MDFF tools have been designed to be easy to use and are available to researchers at low cost through cloud computing platforms. They can now be used to unravel the structure of many different proteins and protein complexes including those involved in photosynthesis, respiration and protein synthesis.

DOI:http://dx.doi.org/10.7554/eLife.16105.002

Atomic Detail Visualization of Photosynthetic Membranes with GPU-Accelerated Ray Tracing

The cellular process responsible for providing energy for most life on Earth, namely photosynthetic light-harvesting, requires the cooperation of hundreds of proteins across an organelle, involving length and time scales spanning several orders of magnitude over quantum and classical regimes. Simulation and visualization of this fundamental energy conversion process pose many unique methodological and computational challenges. We present, in two accompanying movies, light-harvesting in the photosynthetic apparatus found in purple bacteria, the so-called chromatophore. The movies are the culmination of three decades of modeling efforts, featuring the collaboration of theoretical, experimental, and computational scientists. We describe the techniques that were used to build, simulate, analyze, and visualize the structures shown in the movies, and we highlight cases where scientific needs spurred the development of new parallel algorithms that efficiently harness GPU accelerators and petascale computers.

Multilevel summation method for electrostatic force evaluation

The multilevel summation method (MSM) offers an efficient algorithm utilizing convolution for evaluating long-range forces arising in molecular dynamics simulations. Shifting the balance of computation and communication, MSM provides key advantages over the ubiquitous particle–mesh Ewald (PME) method, offering better scaling on parallel computers and permitting more modeling flexibility, with support for periodic systems as does PME but also for semiperiodic and nonperiodic systems. The version of MSM available in the simulation program NAMD is described, and its performance and accuracy are compared with the PME method. The accuracy feasible for MSM in practical applications reproduces PME results for water property calculations of density, diffusion constant, dielectric constant, surface tension, radial distribution function, and distance-dependent Kirkwood factor, even though the numerical accuracy of PME is higher than that of MSM. Excellent agreement between MSM and PME is found also for interface potentials of air–water and membrane–water interfaces, where long-range Coulombic interactions are crucial. Applications demonstrate also the suitability of MSM for systems with semiperiodic and nonperiodic boundaries. For this purpose, simulations have been performed with periodic boundaries along directions parallel to a membrane surface but not along the surface normal, yielding membrane pore formation induced by an imbalance of charge across the membrane. Using a similar semiperiodic boundary condition, ion conduction through a graphene nanopore driven by an ion gradient has been simulated. Furthermore, proteins have been simulated inside a single spherical water droplet. Finally, parallel scalability results show the ability of MSM to outperform PME when scaling a system of modest size (less than 100 K atoms) to over a thousand processors, demonstrating the suitability of MSM for large-scale parallel simulation.

TopoGromacs: Automated Topology Conversion from CHARMM to GROMACS within VMD

Molecular dynamics (MD) simulation engines use a variety of different approaches for modeling molecular systems with force fields that govern their dynamics and describe their topology. These different approaches introduce incompatibilities between engines, and previously published software bridges the gaps between many popular MD packages, such as between CHARMM and AMBER or GROMACS and LAMMPS. While there are many structure building tools available that generate topologies and structures in CHARMM format, only recently have mechanisms been developed to convert their results into GROMACS input. We present an approach to convert CHARMM-formatted topology and parameters into a format suitable for simulation with GROMACS by expanding the functionality of TopoTools, a plugin integrated within the widely used molecular visualization and analysis software VMD. The conversion process was diligently tested on a comprehensive set of biological molecules in vacuo. The resulting comparison between energy terms shows that the translation performed was lossless as the energies were unchanged for identical starting configurations. By applying the conversion process to conventional benchmark systems that mimic typical modestly sized MD systems, we explore the effect of the implementation choices made in CHARMM, NAMD, and GROMACS. The newly available automatic conversion capability breaks down barriers between simulation tools and user communities and allows users to easily compare simulation programs and leverage their unique features without the tedium of constructing a topology twice.

High Performance Molecular Visualization: In-Situ and Parallel Rendering with EGL

Large scale molecular dynamics simulations produce terabytes of data that is impractical to transfer to remote facilities. It is therefore necessary to perform visualization tasks in-situ as the data are generated, or by running interactive remote visualization sessions and batch analyses co-located with direct access to high performance storage systems. A significant challenge for deploying visualization software within clouds, clusters, and supercomputers involves the operating system software required to initialize and manage graphics acceleration hardware. Recently, it has become possible for applications to use the Embedded-system Graphics Library (EGL) to eliminate the requirement for windowing system software on compute nodes, thereby eliminating a significant obstacle to broader use of high performance visualization applications. We outline the potential benefits of this approach in the context of visualization applications used in the cloud, on commodity clusters, and supercomputers. We discuss the implementation of EGL support in VMD, a widely used molecular visualization application, and we outline benefits of the approach for molecular visualization tasks on petascale computers, clouds, and remote visualization servers. We then provide a brief evaluation of the use of EGL in VMD, with tests using developmental graphics drivers on conventional workstations and on Amazon EC2 G2 GPU-accelerated cloud instance types. We expect that the techniques described here will be of broad benefit to many other visualization applications.

Immersive Molecular Visualization with Omnidirectional Stereoscopic Ray Tracing and Remote Rendering

Immersive molecular visualization provides the viewer with intuitive perception of complex structures and spatial relationships that are of critical interest to structural biologists. The recent availability of commodity head mounted displays (HMDs) provides a compelling opportunity for widespread adoption of immersive visualization by molecular scientists, but HMDs pose additional challenges due to the need for low-latency, high-frame-rate rendering. State-of-the-art molecular dynamics simulations produce terabytes of data that can be impractical to transfer from remote supercomputers, necessitating routine use of remote visualization. Hardware-accelerated video encoding has profoundly increased frame rates and image resolution for remote visualization, however round-trip network latencies would cause simulator sickness when using HMDs. We present a novel two-phase rendering approach that overcomes network latencies with the combination of omnidirectional stereoscopic progressive ray tracing and high performance rasterization, and its implementation within VMD, a widely used molecular visualization and analysis tool. The new rendering approach enables immersive molecular visualization with rendering techniques such as shadows, ambient occlusion lighting, depth-of-field, and high quality transparency, that are particularly helpful for the study of large biomolecular complexes. We describe ray tracing algorithms that are used to optimize interactivity and quality, and we report key performance metrics of the system. The new techniques can also benefit many other application domains.

Evaluation of Emerging Energy-Efficient Heterogeneous Computing Platforms for Biomolecular and Cellular Simulation Workloads

Many of the continuing scientific advances achieved through computational biology are predicated on the availability of ongoing increases in computational power required for detailed simulation and analysis of cellular processes on biologically-relevant timescales. A critical challenge facing the development of future exascale supercomputer systems is the development of new computing hardware and associated scientific applications that dramatically improve upon the energy efficiency of existing solutions, while providing increased simulation, analysis, and visualization performance. Mobile computing platforms have recently become powerful enough to support interactive molecular visualization tasks that were previously only possible on laptops and workstations, creating future opportunities for their convenient use for meetings, remote collaboration, and as head mounted displays for immersive stereoscopic viewing. We describe early experiences adapting several biomolecular simulation and analysis applications for emerging heterogeneous computing platforms that combine power-efficient system-on-chip multi-core CPUs with high-performance massively parallel GPUs. We present low-cost power monitoring instrumentation that provides sufficient temporal resolution to evaluate the power consumption of individual CPU algorithms and GPU kernels. We compare the performance and energy efficiency of scientific applications running on emerging platforms with results obtained on traditional platforms, identify hardware and algorithmic performance bottlenecks that affect the usability of these platforms, and describe avenues for improving both the hardware and applications in pursuit of the needs of molecular modeling tasks on mobile devices and future exascale computers.

Runtime and Architecture Support for Efficient Data Exchange in Multi-Accelerator Applications

Heterogeneous parallel computing applications often process large data sets that require multiple GPUs to jointly meet their needs for physical memory capacity and compute throughput. However, the lack of high-level abstractions in previous heterogeneous parallel programming models force programmers to resort to multiple code versions, complex data copy steps and synchronization schemes when exchanging data between multiple GPU devices, which results in high software development cost, poor maintainability, and even poor performance. This paper describes the HPE runtime system, and the associated architecture support, which enables a simple, efficient programming interface for exchanging data between multiple GPUs through either interconnects or cross-node network interfaces. The runtime and architecture support presented in this paper can also be used to support other types of accelerators. We show that the simplified programming interface reduces programming complexity. The research presented in this paper started in 2009. It has been implemented and tested extensively in several generations of HPE runtime systems as well as adopted into the NVIDIA GPU hardware and drivers for CUDA 4.0 and beyond since 2011. The availability of real hardware that support key HPE features gives rise to a rare opportunity for studying the effectiveness of the hardware support by running important benchmarks on real runtime and hardware. Experimental results show that in a exemplar heterogeneous system, peer DMA and double-buffering, pinned buffers, and software techniques can improve the inter-accelerator data communication bandwidth by 2×. They can also improve the execution speed by 1.6× for a 3D finite difference, 2.5× for 1D FFT, and 1.6× for merge sort, all measured on real hardware. The proposed architecture support enables the HPE runtime to transparently deploy these optimizations under simple portable user code, allowing system designers to freely employ devices of different capabilities. We further argue that simple interfaces such as HPE are needed for most applications to benefit from advanced hardware features in practice.

Stable small quantum dots for synaptic receptor tracking on live neurons

We developed a coating method to produce functionalized small quantum dots (sQDs), about 9 nm in diameter, that were stable for over a month. We made sQDs in four emission wavelengths, from 527 to 655 nm and with different functional groups. AMPA receptors on live neurons were labeled with sQDs and postsynaptic density proteins were visualized with super-resolution microscopy. Their diffusion behavior indicates that sQDs access the synaptic clefts significantly more often than commercial QDs.

GPU-accelerated analysis and visualization of large structures solved by molecular dynamics flexible fitting

Hybrid structure fitting methods combine data from cryo-electron microscopy and X-ray crystallography with molecular dynamics simulations for the determination of all-atom structures of large biomolecular complexes. Evaluating the quality-of-fit obtained from hybrid fitting is computationally demanding, particularly in the context of a multiplicity of structural conformations that must be evaluated. Existing tools for quality-of-fit analysis and visualization have previously targeted small structures and are too slow to be used interactively for large biomolecular complexes of particular interest today such as viruses or for long molecular dynamics trajectories as they arise in protein folding. We present new data-parallel and GPU-accelerated algorithms for rapid interactive computation of quality-of-fit metrics linking all-atom structures and molecular dynamics trajectories to experimentally-determined density maps obtained from cryo-electron microscopy or X-ray crystallography. We evaluate the performance and accuracy of the new quality-of-fit analysis algorithms vis-à-vis existing tools, examine algorithm performance on GPU-accelerated desktop workstations and supercomputers, and describe new visualization techniques for results of hybrid structure fitting methods.

Methodologies for the analysis of instantaneous lipid diffusion in MD simulations of large membrane systems

Interactions between lipids and membrane proteins play a key role in determining the nanoscale dynamic and structural properties of biological membranes. Molecular dynamics (MD) simulations provide a valuable tool for studying membrane models, complementing experimental approaches. It is now possible to simulate large membrane systems, such as simplified models of bacterial and viral envelope membranes. Consequently, there is a pressing need to develop tools to visualize and quantify the dynamics of these immense systems, which typically comprise millions of particles. To tackle this issue, we have developed visual and quantitative analyses of molecular positions and their velocity field using path line, vector field and streamline techniques. This allows us to highlight large, transient flow-like movements of lipids and to better understand crowding within the lipid bilayer. The current study focuses on visualization and analysis of lipid dynamics. However, the methods are flexible and can be readily applied to e.g. proteins and nanoparticles within large complex membranes. The protocols developed here are readily accessible both as a plugin for the molecular visualization program VMD and as a module for the MDAnalysis library.

Simulation of reaction diffusion processes over biologically relevant size and time scales using multi-GPU workstations

Simulation of in vivo cellular processes with the reaction-diffusion master equation (RDME) is a computationally expensive task. Our previous software enabled simulation of inhomogeneous biochemical systems for small bacteria over long time scales using the MPD-RDME method on a single GPU. Simulations of larger eukaryotic systems exceed the on-board memory capacity of individual GPUs, and long time simulations of modest-sized cells such as yeast are impractical on a single GPU. We present a new multi-GPU parallel implementation of the MPD-RDME method based on a spatial decomposition approach that supports dynamic load balancing for workstations containing GPUs of varying performance and memory capacity. We take advantage of high-performance features of CUDA for peer-to-peer GPU memory transfers and evaluate the performance of our algorithms on state-of-the-art GPU devices. We present parallel e ciency and performance results for simulations using multiple GPUs as system size, particle counts, and number of reactions grow. We also demonstrate multi-GPU performance in simulations of the Min protein system in E. coli. Moreover, our multi-GPU decomposition and load balancing approach can be generalized to other lattice-based problems.

Lattice Microbes: high-performance stochastic simulation method for the reaction-diffusion master equation

Spatial stochastic simulation is a valuable technique for studying reactions in biological systems. With the availability of high-performance computing (HPC), the method is poised to allow integration of data from structural, single-molecule and biochemical studies into coherent computational models of cells. Here, we introduce the Lattice Microbes software package for simulating such cell models on HPC systems. The software performs either well-stirred or spatially resolved stochastic simulations with approximated cytoplasmic crowding in a fast and efficient manner. Our new algorithm efficiently samples the reaction-diffusion master equation using NVIDIA graphics processing units and is shown to be two orders of magnitude faster than exact sampling for large systems while maintaining an accuracy of !0.1%. Display of cell models and animation of reaction trajectories involving millions of molecules is facilitated using a plug-in to the popular VMD visualization platform. The Lattice Microbes software is open source and available for download at http://www.scs.illinois.edu/schulten/lm

Fast Analysis of Molecular Dynamics Trajectories with Graphics Processing Units-Radial Distribution Function Histogramming

The calculation of radial distribution functions (RDFs) from molecular dynamics trajectory data is a common and computationally expensive analysis task. The rate limiting step in the calculation of the RDF is building a histogram of the distance between atom pairs in each trajectory frame. Here we present an implementation of this histogramming scheme for multiple graphics processing units (GPUs). The algorithm features a tiling scheme to maximize the reuse of data at the fastest levels of the GPU's memory hierarchy and dynamic load balancing to allow high performance on heterogeneous configurations of GPUs. Several versions of the RDF algorithm are presented, utilizing the specific hardware features found on different generations of GPUs. We take advantage of larger shared memory and atomic memory operations available on state-of-the-art GPUs to accelerate the code significantly. The use of atomic memory operations allows the fast, limited-capacity on-chip memory to be used much more efficiently, resulting in a fivefold increase in performance compared to the version of the algorithm without atomic operations. The ultimate version of the algorithm running in parallel on four NVIDIA GeForce GTX 480 (Fermi) GPUs was found to be 92 times faster than a multithreaded implementation running on an Intel Xeon 5550 CPU. On this multi-GPU hardware, the RDF between two selections of 1,000,000 atoms each can be calculated in 26.9 seconds per frame. The multi-GPU RDF algorithms described here are implemented in VMD, a widely used and freely available software package for molecular dynamics visualization and analysis.

GPU-accelerated molecular modeling coming of age

Graphics processing units (GPUs) have traditionally been used in molecular modeling solely for visualization of molecular structures and animation of trajectories resulting from molecular dynamics simulations. Modern GPUs have evolved into fully programmable, massively parallel co-processors that can now be exploited to accelerate many scientific computations, typically providing about one order of magnitude speedup over CPU code and in special cases providing speedups of two orders of magnitude. This paper surveys the development of molecular modeling algorithms that leverage GPU computing, the advances already made and remaining issues to be resolved, and the continuing evolution of GPU technology that promises to become even more useful to molecular modeling. Hardware acceleration with commodity GPUs is expected to benefit the overall computational biology community by bringing teraflops performance to desktop workstations and in some cases potentially changing what were formerly batch-mode computational jobs into interactive tasks.

OpenCL: A Parallel Programming Standard for Heterogeneous Computing Systems

We provide an overview of the key architectural features of recent microprocessor designs and describe the programming model and abstractions provided by OpenCL, a new parallel programming standard targeting these architectures.

An asymmetric distributed shared memory model for heterogeneous parallel systems

Heterogeneous computing combines general purpose CPUs with accelerators to efficiently execute both sequential control-intensive and data-parallel phases of applications. Existing programming models for heterogeneous computing rely on programmers to explicitly manage data transfers between the CPU system memory and accelerator memory.

This paper presents a new programming model for heterogeneous computing, called Asymmetric Distributed Shared Memory (ADSM), that maintains a shared logical memory space for CPUs to access objects in the accelerator physical memory but not vice versa. The asymmetry allows light-weight implementations that avoid common pitfalls of symmetrical distributed shared memory systems. ADSM allows programmers to assign data objects to performance critical methods. When a method is selected for accelerator execution, its associated data objects are allocated within the shared logical memory space, which is hosted in the accelerator physical memory and transparently accessible by the methods executed on CPUs.

We argue that ADSM reduces programming efforts for heterogeneous computing systems and enhances application portability. We present a software implementation of ADSM, called GMAC, on top of CUDA in a GNU/Linux environment. We show that applications written in ADSM and running on top of GMAC achieve performance comparable to their counterparts using programmer-managed data transfers. This paper presents the GMAC system and evaluates different design choices. We further suggest additional architectural support that will likely allow GMAC to achieve higher application performance than the current CUDA model.

Visualisation of cyclic and multi-branched molecules with VMD

We report the addition of two visualisation algorithms, termed PaperChain and Twister, to the freely available Visual Molecular Dynamics (VMD) package. These algorithms produce visualisations of complex cyclic molecules and multi-branched polysaccharides and are a generalization and optimization of those we previously developed in a standalone package for carbohydrates. PaperChain highlights each ring in a molecular structure with a polygon, which is coloured according to the ring pucker. Twister traces glycosidic bonds with a ribbon that twists according to the relative orientation of successive sugar residues. Combination of these novel algorithms and new ring selection statements with the large set of visualisations already available in VMD allows for unprecedented flexibility in the level of detail displayed for glycoconjugate, glycoprotein and carbohydrate-binding protein structures, as well as other cyclic structures. We highlight the efficacy of these algorithms with selected illustrative examples, clearly demonstrating the value of the new visualisations, not only for structure validation, but also for facilitating insights into molecular structure and mechanism.

Multilevel Summation of Electrostatic Potentials Using Graphics Processing Units

Physical and engineering practicalities involved in microprocessor design have resulted in flat performance growth for traditional single-core microprocessors. The urgent need for continuing increases in the performance of scientific applications requires the use of many-core processors and accelerators such as graphics processing units (GPUs). This paper discusses GPU acceleration of the multilevel summation method for computing electrostatic potentials and forces for a system of charged atoms, which is a problem of paramount importance in biomolecular modeling applications. We present and test a new GPU algorithm for the long-range part of the potentials that computes a cutoff pair potential between lattice points, essentially convolving a fixed 3-D lattice of "weights" over all sub-cubes of a much larger lattice. The implementation exploits the different memory subsystems provided on the GPU to stream optimally sized data sets through the multiprocessors. We demonstrate for the full multilevel summation calculation speedups of up to 26 using a single GPU and 46 using multiple GPUs, enabling the computation of a high-resolution map of the electrostatic potential for a system of 1.5 million atoms in under 12 seconds.

Using VMD: an introductory tutorial

VMD (Visual Molecular Dynamics) is a molecular visualization and analysis program designed for biological systems such as proteins, nucleic acids, lipid bilayer assemblies, etc. This unit will serve as an introductory VMD tutorial. We will present several step-by-step examples of some of VMD's most popular features, including visualizing molecules in three dimensions with different drawing and coloring methods, rendering publication-quality figures, animating and analyzing the trajectory of a molecular dynamics simulation, scripting in the text-based Tcl/Tk interface, and analyzing both sequence and structure data for proteins.

Accelerating molecular modeling applications with graphics processors

Molecular mechanics simulations offer a computational approach to study the behavior of biomolecules at atomic detail, but such simulations are limited in size and timescale by the available computing resources. State-of-the-art graphics processing units (GPUs) can perform over 500 billion arithmetic operations per second, a tremendous computational resource that can now be utilized for general purpose computing as a result of recent advances in GPU hardware and software architecture. In this article, an overview of recent advances in programmable GPUs is presented, with an emphasis on their application to molecular mechanics simulations and the programming techniques required to obtain optimal performance in these cases. We demonstrate the use of GPUs for the calculation of long-range electrostatics and nonbonded forces for molecular dynamics simulations, where GPU-based calculations are typically 10-100 times faster than heavily optimized CPU-based implementations. The application of GPU acceleration to biomolecular simulation is also demonstrated through the use of GPU-accelerated Coulomb-based ion placement and calculation of time-averaged potentials from molecular dynamics trajectories. A novel approximation to Coulomb potential calculation, the multilevel summation method, is introduced and compared with direct Coulomb summation. In light of the performance obtained for this set of calculations, future applications of graphics processors to molecular dynamics simulations are discussed.

Intratumoral oxygenation of invasive squamous cell carcimoma of the vulva is not correlated with regional lymph node metastasis

INTRODUCTION

Tumour hypoxia has been found to be associated with tumour aggressiveness. Our primary aim was to explore the relationship between pretreatment tumour oxygenation in primary vulvar carcinoma and nodal status. Our secondary objective was to assess if there was a relationship between the clinical and biological variables.

METHODS

20 women with ISCC of the vulva were assessed with pretreatment primary tumour oxygenation with an Eppendorf pO2 probe. Patients underwent standard surgical management. Pathological assessment of the primary and nodal tissues was then performed. Primary tumour specimens were also stained for microvessel density and carbonic anhydrase IX. The relationship between smoking, preoperative Hgb, tumour CAIX expression, MVD, and Eppendorf pO2 measurements vs nodal metastasis and between these clinical and biological variables was assessed.

RESULTS

Seven patients had positive lymph nodes, 13 had negative nodes. While neither current smoking status, tumour size, tumour oxygen measurements, MVD and CAIX expression correlated with metastatic nodal disease, a low preoperative Hgb correlated with pathological nodal status (p < 0.027).

CONCLUSIONS

Although this analysis failed to demonstrate a strong correlation between various measures of tumour oxygenation with nodal metastasis, it may be due to the small number of patients. Only preoperative anaemia is correlated with nodal metastasis in early ISCC of the vulva.

Cost-effective strategy for the serological investigation of coeliac disease

Increased numbers of requests for serological investigation of coeliac disease, and a local trend to request both anti-gliadin antibodies (AGA) and anti-endomysium antibodies (AEA) simultaneously, resulted in cost pressures that prompted a review of our practice. Serology results from all patients (771 children, 511 adults) investigated for coeliac disease over a 3-year period were compared with small intestine histology where available. IgG AGA and IgA AGA were measured by enzyme-linked immunosorbent assay (in-house), IgA AEA by immunofluorescence (send-away contract). Overall diagnostic performance was as follows: AGA sensitivity 84%, specificity 88%, positive predictive value (PPV) 24%, negative predictive value (NPV) 99%; AEA sensitivity 88%, specificity 97%, PPV 65%, NPV 99%. Results showed AGA, with its high NPV, to be a suitable first-line test to exclude coeliac disease. The high specificity of AEA makes it a suitable confirmatory test when AGA is positive. Introduction of this step-wise approach to coeliac disease investigation resulted in cost savings of at least Pound Sterling 5000 per year without detriment to the clinical service.

Multiple roles of Spo11 in meiotic chromosome behavior

Spo11, a type II topoisomerase, is likely to be required universally for initiation of meiotic recombination. However, a dichotomy exists between budding yeast and the animals Caenorhabditis elegans and Drosophila melanogaster with respect to additional roles of Spo11 in meiosis. In Saccharomyces cerevisiae, Spo11 is required for homolog pairing, as well as axial element (AE) and synaptonemal complex (SC) formation. All of these functions are Spo11 independent in C.elegans and D.melanogaster. We examined Spo11 function in a multicellular fungus, Coprinus cinereus. The C.cinereus spo11-1 mutant shows high levels of homolog pairing and occasionally forms full-length AEs, but no SC. In C.cinereus, Spo11 is also required for maintenance of meiotic chromosome condensation and proper spindle formation. Meiotic progression in spo11-1 is aberrant; late in meiosis basidia undergo programmed cell death (PCD). To our knowledge, this is the first example of meiotic PCD outside the animal kingdom. Ionizing radiation can partially rescue spo11-1 for both AE and SC formation and viable spore production, suggesting that the double-strand break function of Spo11 is conserved and is required for these functions.

Rapid early onset lymphocyte cell death in mice resistant, but not susceptible to Leishmania major infection

Leishmania major (Lm) infection in mice is a prototypical model for the role of immune deviation in disease resistance. Resistant strains of mice develop a Th1 response to Lm infection, distinguished by secretion of IL-12 and interferon gamma. In contrast, susceptible strains display sustained IL-4 expression characteristic of a Th2 response. However, when mechanisms of cell death are blocked, mice display a susceptible phenotype even in the presence of a strong Th1 response, suggesting that cell death, and not cytokine bias, may be an important factor in disease resistance. Here, we investigated this hypothesis by comparing lymphocyte cellularity, cell death and Fas expression in resistant CBA and susceptible BALB/c mice during the course of Lm infection. We found that delayed onset of cell death and late Fas induction correlated with massive lymphocyte accumulation and susceptibility to leishmaniasis, while early cell death and rapid Fas induction occurred in resistant mice.