Refinement procedure for the image alignment in high-resolution electron tomography

Markerauto2: A fast and robust fully automatic fiducial marker-based tilt series alignment software for electron tomography

Cryoelectron tomography (cryo-ET) has become an indispensable technology for visualizing in situ biological ultrastructures, where the tilt series alignment is the key step to obtain a high-resolution three-dimensional reconstruction. Specifically, with the advent of high-throughput cryo-ET data collection, there is an increasing demand for high-accuracy and fully automatic tilt series alignment, to enable efficient data processing. Here, we propose Markerauto2, a fast and robust fully automatic software that enables accurate fiducial marker-based tilt series alignment. Markerauto2 implements the following novel pipelines: (1) an accelerated high-precision fiducial marker detection with wavelet multiscale template, (2) an ultra-fast and robust fiducial marker tracking supported by hashed geometric features, (3) a high-angle fiducial marker supplementation strategy to produce more complete tracks, and (4) a precise and robust calibration of projection parameters with group-weighted parameter optimization. Comprehensive experiments conducted on both simulated and real-world datasets demonstrate the robustness, efficiency, and effectiveness of the proposed software.

Quantitative 3D structural analysis of small colloidal assemblies under native conditions by liquid-cell fast electron tomography

Electron tomography has become a commonly used tool to investigate the three-dimensional (3D) structure of nanomaterials, including colloidal nanoparticle assemblies. However, electron microscopy is typically done under high-vacuum conditions, requiring sample preparation for assemblies obtained by wet colloid chemistry methods. This involves solvent evaporation and deposition on a solid support, which consistently alters the nanoparticle organization. Here, we suggest using electron tomography to study nanoparticle assemblies in their original colloidal liquid environment. To address the challenges related to electron tomography in liquid, we devise a method that combines fast data acquisition in a commercial liquid-cell with a dedicated alignment and reconstruction workflow. We present the advantages of this methodology in accurately characterizing two different systems. 3D reconstructions of assemblies comprising polystyrene-capped Au nanoparticles encapsulated in polymeric shells reveal less compact and more distorted configurations for experiments performed in a liquid medium compared to their dried counterparts. A similar expansion can be observed in quantitative analysis of the surface-to-surface distances of self-assembled Au nanorods in water rather than in a vacuum, in agreement with bulk measurements. This study, therefore, emphasizes the importance of developing high-resolution characterization tools that preserve the native environment of colloidal nanostructures.

ClusterAlign: A fiducial tracking and tilt series alignment tool for thick sample tomography

Thick specimens, as encountered in cryo-scanning transmission electron tomography, offer special challenges to conventional reconstruction workflows. The visibility of features, including gold nanoparticles introduced as fiducial markers, varies strongly through the tilt series. As a result, tedious manual refinement may be required in order to produce a successful alignment. Information from highly tilted views must often be excluded to the detriment of axial resolution in the reconstruction. We introduce here an approach to tilt series alignment based on identification of fiducial particle clusters that transform coherently in rotation, essentially those that lie at similar depth. Clusters are identified by comparison of tilted views with a single untilted reference, rather than with adjacent tilts. The software, called ClusterAlign, proves robust to poor signal to noise ratio and varying visibility of the individual fiducials and is successful in carrying the alignment to the ends of the tilt series where other methods tend to fail. ClusterAlign may be used to generate a list of tracked fiducials, to align a tilt series, or to perform a complete 3D reconstruction. Tools to evaluate alignment error by projection matching are included. Execution involves no manual intervention, and adherence to standard file formats facilitates an interface with other software, particularly IMOD/etomo, tomo3d, and tomoalign.

Electrostatic co-assembly of nanoparticles with oppositely charged small molecules into static and dynamic superstructures

Coulombic interactions can be used to assemble charged nanoparticles into higher-order structures, but the process requires oppositely charged partners that are similarly sized. The ability to mediate the assembly of such charged nanoparticles using structurally simple small molecules would greatly facilitate the fabrication of nanostructured materials and harnessing their applications in catalysis, sensing and photonics. Here we show that small molecules with as few as three electric charges can effectively induce attractive interactions between oppositely charged nanoparticles in water. These interactions can guide the assembly of charged nanoparticles into colloidal crystals of a quality previously only thought to result from their co-crystallization with oppositely charged nanoparticles of a similar size. Transient nanoparticle assemblies can be generated using positively charged nanoparticles and multiply charged anions that are enzymatically hydrolysed into mono- and/or dianions. Our findings demonstrate an approach for the facile fabrication, manipulation and further investigation of static and dynamic nanostructured materials in aqueous environments.

Mesoscale Anisotropy in Porous Media Made of Clay Minerals. A Numerical Study Constrained by Experimental Data

The anisotropic properties of clay-rich porous media have significant impact on the directional dependence of fluids migration in environmental and engineering sciences. This anisotropy, linked to the preferential orientation of flat anisometric clay minerals particles, is studied here on the basis of the simulation of three-dimensional packings of non-interacting disks, using a sequential deposition algorithm under a gravitational field. Simulations show that the obtained porosities fall onto a single master curve when plotted against the anisotropy value. This finding is consistent with results from sedimentation experiments using polytetrafluoroethylene (PTFE) disks and subsequent extraction of particle anisotropy through X-ray microtomography. Further geometrical analyses of computed porous media highlight that both particle orientation and particle aggregation are responsible of the evolution of porosity as a function of anisotropy. Moreover, morphological analysis of the porous media using chord length measurements shows that the anisotropy of the pore and solid networks can be correlated with particle orientation. These results indicate that computed porous media, mimicking the organization of clay minerals, can be used to shed light on the anisotropic properties of fluid transfer in clay-based materials.

Metallic Nanocrystal Ripening on Inorganic Surfaces

In this paper, we demonstrate the formation of hybrid nanostructures consisting of two distinctive components mainly in a one-to-one ratio. Thermolysis of inorganic nanotubes (INT) and closed-cage, inorganic fullerene-like (IF) nanoparticles decorated with a dense coating of metallic nanoparticles (M = Au, Ag, Pd) results in migration of relatively small NPs or surface-enhanced diffusion of atoms or clusters, generating larger particles (ripening). AuNP growth on the surface of INTs has been captured in real time using in situ electron microscopy measurements. Reaction of the AuNP-decorated INTs with an alkylthiol results in a chemically induced NP fusion process at room temperature. The NPs do not dissociate from the surfaces of the INTs and IFs, but for proximate IFs we observed fusion between AuNPs originating from different IFs.

Improved Three-Dimensional (3D) Resolution of Electron Tomograms Using Robust Mathematical Data-Processing Techniques

Electron tomography has become an essential tool for three-dimensional (3D) characterization of nanomaterials. In recent years, advances have been made in specimen preparation and mounting, acquisition geometries, and reconstruction algorithms. All of these components work together to optimize the resolution and clarity of an electron tomogram. However, one important component of the data-processing has received less attention: the 2D tilt series alignment. This is challenging for a number of reasons, namely because the nature of the data sets and the need to be coherently aligned over the full range of angles. An inaccurate alignment may be difficult to identify, yet can significantly limit the final 3D resolution. In this work, we present an improved center-of-mass alignment model that allows us to overcome discrepancies from unwanted objects that enter the imaging area throughout the tilt series. In particular, we develop an approach to overcome changes in the total mass upon rotation of the imaging area. We apply our approach to accurately recover small Pt nanoparticles embedded in a zeolite that may otherwise go undetected both in the 2D microscopy images and the 3D reconstruction. In addition to this, we highlight the particular effectiveness of the compressed sensing methods with this data set.

Automated angular and translational tomographic alignment and application to phase-contrast imaging

X-ray computerized tomography (CT) is a 3D imaging technique that makes use of x-ray illumination and image reconstruction techniques to reproduce the internal cross-sections of a sample. Tomographic projection data usually require an initial relative alignment or knowledge of the exact object position and orientation with respect to the detector. As tomographic imaging reaches increasingly better resolution, thermal drifts, mechanical instabilities, and equipment limitations are becoming the main dominant factors contributing to sample positioning uncertainties that will further introduce reconstruction artifacts and limit the attained resolution in the final tomographic reconstruction. Alignment algorithms that require manual interaction impede data analysis with ever-increasing data acquisition rates, supplied by more brilliant sources. We present in this paper an iterative reconstruction algorithm for wrapped phase projection data and an alignment algorithm that automatically takes 5 degrees of freedom, including the possible linear and angular motion errors, into consideration. The presented concepts are applied to simulated and real measured phase-contrast data, exhibiting a possible improvement in the reconstruction resolution. A MATLAB implementation is made publicly available and will allow robust analysis of large volumes of phase-contrast tomography data.

Rapid alignment of nanotomography data using joint iterative reconstruction and reprojection

As x-ray and electron tomography is pushed further into the nanoscale, the limitations of rotation stages become more apparent, leading to challenges in the alignment of the acquired projection images. Here we present an approach for rapid post-acquisition alignment of these projections to obtain high quality three-dimensional images. Our approach is based on a joint estimation of alignment errors, and the object, using an iterative refinement procedure. With simulated data where we know the alignment error of each projection image, our approach shows a residual alignment error that is a factor of a thousand smaller, and it reaches the same error level in the reconstructed image in less than half the number of iterations. We then show its application to experimental data in x-ray and electron nanotomography.

Single crystalline superstructured stable single domain magnetite nanoparticles

Magnetite nanoparticles exhibit magnetic properties that are size and organization dependent and, for applications that rely on their magnetic state, they usually have to be monodisperse. Forming such particles, however, has remained a challenge. Here, we synthesize 40 nm particles of magnetite in the presence of polyarginine and show that they are composed of 10 nm building blocks, yet diffract like single crystals. We use both bulk magnetic measurements and magnetic induction maps recorded from individual particles using off-axis electron holography to show that each 40 nm particle typically contains a single magnetic domain. The magnetic state is therefore determined primarily by the size of the superstructure and not by the sizes of the constituent sub-units. Our results fundamentally demonstrate the structure – property relationship in a magnetic mesoparticle.

Simultaneous determination of sample thickness, tilt, and electron mean free path using tomographic tilt images based on Beer-Lambert law

Cryo-electron tomography (cryo-ET) is an emerging technique that can elucidate the architecture of macromolecular complexes and cellular ultrastructure in a near-native state. Some important sample parameters, such as thickness and tilt, are needed for 3-D reconstruction. However, these parameters can currently only be determined using trial 3-D reconstructions. Accurate electron mean free path plays a significant role in modeling image formation process essential for simulation of electron microscopy images and model-based iterative 3-D reconstruction methods; however, their values are voltage and sample dependent and have only been experimentally measured for a limited number of sample conditions. Here, we report a computational method, tomoThickness, based on the Beer-Lambert law, to simultaneously determine the sample thickness, tilt and electron inelastic mean free path by solving an overdetermined nonlinear least square optimization problem utilizing the strong constraints of tilt relationships. The method has been extensively tested with both stained and cryo datasets. The fitted electron mean free paths are consistent with reported experimental measurements. The accurate thickness estimation eliminates the need for a generous assignment of Z-dimension size of the tomogram. Interestingly, we have also found that nearly all samples are a few degrees tilted relative to the electron beam. Compensation of the intrinsic sample tilt can result in horizontal structure and reduced Z-dimension of tomograms. Our fast, pre-reconstruction method can thus provide important sample parameters that can help improve performance of tomographic reconstruction of a wide range of samples.

Rapid low dose electron tomography using a direct electron detection camera

We demonstrate the ability to record a tomographic tilt series containing 3487 images in only 3.5 s by using a direct electron detector in a transmission electron microscope. The electron dose is lower by at least one order of magnitude when compared with that used to record a conventional tilt series of fewer than 100 images in 15-60 minutes and the overall signal-to-noise ratio is greater than 4. Our results, which are illustrated for an inorganic nanotube, are important for ultra-low-dose electron tomography of electron-beam-sensitive specimens and real-time dynamic electron tomography of nanoscale objects with sub-ms temporal resolution.

Self-adapting denoising, alignment and reconstruction in electron tomography in materials science

An automatic procedure for electron tomography is presented. This procedure is adapted for specimens that can be fashioned into a needle-shaped sample and has been evaluated on inorganic samples. It consists of self-adapting denoising, automatic and accurate alignment including detection and correction of tilt axis, and 3D reconstruction. We propose the exploitation of a large amount of information of an electron tomography acquisition to achieve robust and automatic mixed Poisson-Gaussian noise parameter estimation and denoising using undecimated wavelet transforms. The alignment is made by mixing three techniques, namely (i) cross-correlations between neighboring projections, (ii) common line algorithm to get a precise shift correction in the direction of the tilt axis and (iii) intermediate reconstructions to precisely determine the tilt axis and shift correction in the direction perpendicular to that axis. Mixing alignment techniques turns out to be very efficient and fast. Significant improvements are highlighted in both simulations and real data reconstructions of porous silicon in high angle annular dark field mode and agglomerated silver nanoparticles in incoherent bright field mode. 3D reconstructions obtained with minimal user-intervention present fewer artefacts and less noise, which permits easier and more reliable segmentation and quantitative analysis. After careful sample preparation and data acquisition, the denoising procedure, alignment and reconstruction can be achieved within an hour for a 3D volume of about a hundred million voxels, which is a step toward a more routine use of electron tomography.

Physically motivated global alignment method for electron tomography

Electron tomography is widely used for nanoscale determination of 3-D structures in many areas of science. Determining the 3-D structure of a sample from electron tomography involves three major steps: acquisition of sequence of 2-D projection images of the sample with the electron microscope, alignment of the images to a common coordinate system, and 3-D reconstruction and segmentation of the sample from the aligned image data. The resolution of the 3-D reconstruction is directly influenced by the accuracy of the alignment, and therefore, it is crucial to have a robust and dependable alignment method. In this paper, we develop a new alignment method which avoids the use of markers and instead traces the computed paths of many identifiable ‘local’ center-of-mass points as the sample is rotated. Compared with traditional correlation schemes, the alignment method presented here is resistant to cumulative error observed from correlation techniques, has very rigorous mathematical justification, and is very robust since many points and paths are used, all of which inevitably improves the quality of the reconstruction and confidence in the scientific results.

Understanding the formation mechanism and the 3D structure of Mo(SxSe1−x)2 nanoflowers

Colloidal synthesis of MoS₂, MoSe₂ and their alloys produces fine nanoflowers with tunable composition. Their reaction mechanism produces homogeneous solid solutions, beneficial for designing specific properties.

Advanced electron microscopy for advanced materials

The idea of this Review is to introduce newly developed possibilities of advanced electron microscopy to the materials science community. Over the last decade, electron microscopy has evolved into a full analytical tool, able to provide atomic scale information on the position, nature, and even the valency atoms. This information is classically obtained in two dimensions (2D), but can now also be obtained in 3D. We show examples of applications in the field of nanoparticles and interfaces.

Correlating electron tomography and plasmon spectroscopy of single noble metal core-shell nanoparticles

The 3D structure reconstruction of gold core-silver shell nanoparticles by electron tomography is combined with optical dark-field spectroscopy. Electron tomography allows segmentation of the particles into core and shell subvolumes and facilitates avoiding Bragg diffraction artifacts inherent in 2D images. This advantage proves essential for accurate correlation of plasmon spectra and structure. We find that for the nanoparticles of near-spherical shape studied here the plasmon resonances depend on the relative size of the core and shell, rather than on their exact shapes and concentricity. A remarkable dependence of the spectral shape on the permittivity of the surrounding medium is also demonstrated, suggesting that core-shell nanoparticles can be used as ratiometric sensors with a very high dynamic range.

Automatic alignment and reconstruction of images for soft X-ray tomography

Soft X-ray tomography (SXT) is a powerful imaging technique that generates quantitative, 3D images of the structural organization of whole cells in a near-native state. SXT is also a high-throughput imaging technique. At the National Center for X-ray Tomography (NCXT), specimen preparation and image collection for tomographic reconstruction of a whole cell require only minutes. Aligning and reconstructing the data, however, take significantly longer. Here we describe a new component of the high throughput computational pipeline used for processing data at the NCXT. We have developed a new method for automatic alignment of projection images that does not require fiducial markers or manual interaction with the software. This method has been optimized for SXT data sets, which routinely involve full rotation of the specimen. This software gives users of the NCXT SXT instrument a new capability - virtually real-time initial 3D results during an imaging experiment, which can later be further refined. The new code, Automatic Reconstruction 3D (AREC3D), is also fast, reliable, and robust. The fundamental architecture of the code is also adaptable to high performance GPU processing, which enables significant improvements in speed and fidelity.