Towards the spatial resolution of metalloprotein charge states by detailed modeling of XFEL crystallographic diffraction

Deep residual networks for crystallography trained on synthetic data

The use of artificial intelligence to process diffraction images is challenged by the need to assemble large and precisely designed training data sets. To address this, a codebase called Resonet was developed for synthesizing diffraction data and training residual neural networks on these data. Here, two per-pattern capabilities of Resonet are demonstrated: (i) interpretation of crystal resolution and (ii) identification of overlapping lattices. Resonet was tested across a compilation of diffraction images from synchrotron experiments and X-ray free-electron laser experiments. Crucially, these models readily execute on graphics processing units and can thus significantly outperform conventional algorithms. While Resonet is currently utilized to provide real-time feedback for macromolecular crystallography users at the Stanford Synchrotron Radiation Lightsource, its simple Python-based interface makes it easy to embed in other processing frameworks. This work highlights the utility of physics-based simulation for training deep neural networks and lays the groundwork for the development of additional models to enhance diffraction collection and analysis.

Interpreting macromolecular diffraction through simulation

This chapter discusses the use of diffraction simulators to improve experimental outcomes in macromolecular crystallography, in particular for future experiments aimed at diffuse scattering. Consequential decisions for upcoming data collection include the selection of either a synchrotron or free electron laser X-ray source, rotation geometry or serial crystallography, and fiber-coupled area detector technology vs. pixel-array detectors. The hope is that simulators will provide insights to make these choices with greater confidence. Simulation software, especially those packages focused on physics-based calculation of the diffraction, can help to predict the location, size, shape, and profile of Bragg spots and diffuse patterns in terms of an underlying physical model, including assumptions about the crystal's mosaic structure, and therefore can point to potential issues with data analysis in the early planning stages. Also, once the data are collected, simulation may offer a pathway to improve the measurement of diffraction, especially with weak data, and might help to treat problematic cases such as overlapping patterns.

Self-Supervised Deep Learning for Model Correction in the Computational Crystallography Toolbox

The Computational Crystallography Toolbox (cctbx) is open-source software that allows for processing of crystallographic data, including from serial femtosecond crystallography (SFX), for macromolecular structure determination. We aim to use the modules in cctbx to determine the oxidation state of individual metal atoms in a macromolecule. Changes in oxidation state are reflected in small shifts of the atom's X-ray absorption edge. These energy shifts can be extracted from the diffraction images recorded in serial femtosecond crystallography, given knowledge of a forward physics model. However, as the diffraction changes only slightly due to the absorption edge shift, inaccuracies in the forward physics model make it extremely challenging to observe the oxidation state. In this work, we describe the potential impact of using self-supervised deep learning to correct the scientific model in cctbx and provide uncertainty quantification. We provide code for forward model simulation and data analysis, built from cctbx modules, at https://github.com/gigantocypris/SPREAD, which can be integrated with machine learning. We describe open questions in algorithm development to help spur advances through dialog between crystallographers and machine learning researchers. New methods could help elucidate charge transfer processes in many reactions, including key events in photosynthesis.

Serial femtosecond crystallography approaches to understanding catalysis in iron enzymes

Enzymes with iron-containing active sites play crucial roles in catalysing a myriad of oxidative reactions essential to aerobic life. Defining the three-dimensional structures of iron enzymes in resting, oxy-bound intermediate and substrate-bound states is particularly challenging, not least because of the extreme susceptibility of the Fe(III) and Fe(IV) redox states to radiation-induced chemistry caused by intense X-ray or electron beams. The availability of novel sources such as X-ray free electron lasers has enabled structures that are effectively free of the effects of radiation-induced chemistry and allows time-resolved structures to be determined. Important to both applications is the ability to obtain in crystallo spectroscopic data to identify the redox state of the iron in any particular structure or timepoint.

Serial synchrotron and XFEL crystallography for studies of metalloprotein catalysis

An estimated half of all proteins contain a metal, with these being essential for a tremendous variety of biological functions. X-ray crystallography is the major method for obtaining structures at high resolution of these metalloproteins, but there are considerable challenges to obtain intact structures due to the effects of radiation damage. Serial crystallography offers the prospect of determining low-dose synchrotron or effectively damage free XFEL structures at room temperature and enables time-resolved or dose-resolved approaches. Complementary spectroscopic data can validate redox and or ligand states within metalloprotein crystals. In this opinion, we discuss developments in the application of serial crystallographic approaches to metalloproteins and comment on future directions.

Resonant X-ray emission spectroscopy from broadband stochastic pulses at an X-ray free electron laser

Hard X-ray spectroscopy is an element specific probe of electronic state, but signals are weak and require intense light to study low concentration samples. Free electron laser facilities offer the highest intensity X-rays of any available light source. The light produced at such facilities is stochastic, with spikey, broadband spectra that change drastically from shot to shot. Here, using aqueous ferrocyanide, we show that the resonant X-ray emission (RXES) spectrum can be inferred by correlating for each shot the fluorescence intensity from the sample with spectra of the fluctuating, self-amplified spontaneous emission (SASE) source. We obtain resolved narrow and chemically rich information in core-to-valence transitions of the pre-edge region at the Fe K-edge. Our approach avoids monochromatization, provides higher photon flux to the sample, and allows non-resonant signals like elastic scattering to be simultaneously recorded. The spectra obtained match well with spectra measured using a monochromator. We also show that inaccurate measurements of the stochastic light spectra reduce the measurement efficiency of our approach.

Dynamic Structural Biology Experiments at XFEL or Synchrotron Sources

Macromolecular crystallography (MX) leverages the methods of physics and the language of chemistry to reveal fundamental insights into biology. Often beautifully artistic images present MX results to support profound functional hypotheses that are vital to entire life science research community. Over the past several decades, synchrotrons around the world have been the workhorses for X-ray diffraction data collection at many highly automated beamlines. The newest tools include X-ray-free electron lasers (XFELs) located at facilities in the USA, Japan, Korea, Switzerland, and Germany that deliver about nine orders of magnitude higher brightness in discrete femtosecond long pulses. At each of these facilities, new serial femtosecond crystallography (SFX) strategies exploit slurries of micron-size crystals by rapidly delivering individual crystals into the XFEL X-ray interaction region, from which one diffraction pattern is collected per crystal before it is destroyed by the intense X-ray pulse. Relatively simple adaptions to SFX methods produce time-resolved data collection strategies wherein reactions are triggered by visible light illumination or by chemical diffusion/mixing. Thus, XFELs provide new opportunities for high temporal and spatial resolution studies of systems engaged in function at physiological temperature. In this chapter, we summarize various issues related to microcrystal slurry preparation, sample delivery into the X-ray interaction region, and some emerging strategies for time-resolved SFX data collection.

Beyond integration: modeling every pixel to obtain better structure factors from stills

Most crystallographic data processing methods use pixel integration. In serial femtosecond crystallography (SFX), the intricate interaction between the reciprocal lattice point and the Ewald sphere is integrated out by averaging symmetrically equivalent observations recorded across a large number (104-106) of exposures. Although sufficient for generating biological insights, this approach converges slowly, and using it to accurately measure anomalous differences has proved difficult. This report presents a novel approach for increasing the accuracy of structure factors obtained from SFX data. A physical model describing all observed pixels is defined to a degree of complexity such that it can decouple the various contributions to the pixel intensities. Model dependencies include lattice orientation, unit-cell dimensions, mosaic structure, incident photon spectra and structure factor amplitudes. Maximum likelihood estimation is used to optimize all model parameters. The application of prior knowledge that structure factor amplitudes are positive quantities is included in the form of a reparameterization. The method is tested using a synthesized SFX dataset of ytterbium(III) lysozyme, where each X-ray laser pulse energy is centered at 9034 eV. This energy is 100 eV above the Yb3+ L-III absorption edge, so the anomalous difference signal is stable at 10 electrons despite the inherent energy jitter of each femtosecond X-ray laser pulse. This work demonstrates that this approach allows the determination of anomalous structure factors with very high accuracy while requiring an order-of-magnitude fewer shots than conventional integration-based methods would require to achieve similar results.

Pixel modelling - a new age in SFX data analysis

A new program, diffBragg, employs per-pixel maximum likelihood optimization of X-ray pulse and crystal parameters to improve the accuracy of structure factor amplitudes attainable in SFX experiments.

Advances in methods for atomic resolution macromolecular structure determination

Recent technical advances have dramatically increased the power and scope of structural biology. New developments in high-resolution cryo-electron microscopy, serial X-ray crystallography, and electron diffraction have been especially transformative. Here we highlight some of the latest advances and current challenges at the frontiers of atomic resolution methods for elucidating the structures and dynamical properties of macromolecules and their complexes.