The Effective Fragment Molecular Orbital Method: Achieving High Scalability and Accuracy for Large Systems

The effective fragment molecular orbital (EFMO) method has been developed to predict the total energy of a very large molecular system accurately (with respect to the underlying quantum mechanical method) and efficiently by taking advantage of the locality of strong chemical interactions and employing a two-level hierarchical parallelism. The accuracy of the EFMO method is partly attributed to the accurate and robust intermolecular interaction prediction between distant fragments, in particular, the many-body polarization and dispersion effects, which require the generation of static and dynamic polarizability tensors by solving the coupled perturbed Hartree-Fock (CPHF) and time-dependent HF (TDHF) equations, respectively. Solving the CPHF and TDHF equations is the main EFMO computational bottleneck due to the inefficient (serial) and I/O-intensive implementation of the CPHF and TDHF solvers. In this work, the efficiency and scalability of the EFMO method are significantly improved with a new CPU memory-based implementation for solving the CPHF and TDHF equations that are parallelized by either message passing interface (MPI) or hybrid MPI/OpenMP. The accuracy of the EFMO method is demonstrated for both covalently bonded systems and noncovalently bound molecular clusters by systematically examining the effects of basis sets and a key distance-related cutoff parameter, Rcut. Rcut determines whether a fragment pair (dimer) is treated by the chosen ab initio method or calculated using the effective fragment potential (EFP) method (separated dimers). Decreasing the value of Rcut increases the number of separated (EFP) dimers, thereby decreasing the computational effort. It is demonstrated that excellent accuracy (<1 kcal/mol error per fragment) can be achieved when using a sufficiently large basis set with diffuse functions coupled with a small Rcut value. With the new parallel implementation, the total EFMO wall time is substantially reduced, especially with a high number of MPI ranks. Given a sufficient workload, nearly ideal strong scaling is achieved for the CPHF and TDHF parts of the calculation. For the first time, EFMO calculations with the inclusion of long-range polarization and dispersion interactions on a hydrated mesoporous silica nanoparticle with explicit water solvent molecules (more than 15k atoms) are achieved on a massively parallel supercomputer using nearly 1000 physical nodes. In addition, EFMO calculations on the carbinolamine formation step of an amine-catalyzed aldol reaction at the nanoscale with explicit solvent effects are presented.

Prediction of stability constants of metal-ligand complexes by machine learning for the design of ligands with optimal metal ion selectivity

The new LOGKPREDICT program integrates HostDesigner molecular design software with the machine learning (ML) program Chemprop. By supplying HostDesigner with predicted log K values, LOGKPREDICT enhances the computer-aided molecular design process by ranking ligands directly by metal-ligand binding strength. Harnessing reliable experimental data from a historic National Institute of Standards and Technology (NIST) database and data from the International Union of Pure and Applied Chemistry (IUPAC), we train message passing neural net algorithms. The multi-metal NIST-based ML model has a root mean square error (RMSE) of 0.629 ± 0.044 (R2 of 0.960 ± 0.006), while two versions of lanthanide-only IUPAC-based ML models have, respectively, RMSE of 0.764 ± 0.073 (R2 of 0.976 ± 0.005) and 0.757 ± 0.071 (R2 of 0.959 ± 0.007). For relative log K predictions on an out-of-sample set of six ligands, demonstrating metal ion selectivity, the RMSE value reaches a commendably low 0.25. We showcase the use of LOGKPREDICT in identifying ligands with high selectivity for lanthanides in aqueous solutions, a finding supported by recent experimental evidence. We also predict new ligands yet to be verified experimentally. Therefore, our ML models implemented through LOGKPREDICT and interfaced with the ligand design software HostDesigner pave the way for designing new ligands with predetermined selectivity for competing metal ions in an aqueous solution.

R-8 Dispersion Interaction: Derivation and Application to the Effective Fragment Potential Method

The anisotropic and isotropic R-8 dispersion contributions (disp8) are derived and implemented within the framework of the effective fragment potential (EFP) method formulated with imaginary frequency-dependent Cartesian polarizability tensors distributed at the centroids of the localized molecular orbitals (LMOs). Two forms of damping functions, intermolecular overlap-based and Tang-Toennies, are extended for disp8. To obtain LMO polarizability tensors centered at LMO centroids, an origin-shifting transformation is derived and implemented for the dipole-octopole polarizability tensor and the quadrupole-quadrupole polarizability tensor. The analytic gradient is derived and implemented for the isotropic disp8 contribution. Relative to the previously implemented empirical EFP disp8 energy, the isotropic disp8 component of the interaction energy improves the overall agreement of the EFP dispersion energies with the symmetry-adapted perturbation theory (SAPT) benchmarks, reducing the mean absolute errors (MAEs) and mean absolute percentage errors for most of the databases examined in this work. While the anisotropic disp8 can further enhance the accuracy of the EFP dispersion energy and yield smaller MAEs, significantly overbound dispersion energies are predicted by the anisotropic disp8 when the maximum element in the intermolecular overlap matrix is greater than 0.1, possibly due to the breakdown of the approximations made in the EFP dispersion derivation at a short range. For potential energy scan databases, the newly developed EFP dispersion model with isotropic disp8 yields the overall correct curvature and good agreement with SAPT benchmarks around equilibrium and longer but overestimates the dispersion interactions at a short range. While the overlap-based dispersion-damping functions produce better MAEs than Tang-Toennies damping functions, further improvement is needed to better screen the large attractive dispersion energies at a short range (overlap >0.1).

Spin-orbit coupling of electrons on separate lanthanide atoms of Pr2O2 and its singly charged cation

Although it plays a critical role in the photophysics and catalysis of lanthanides, spin-orbit coupling of electrons on individual lanthanide atoms in small clusters is not well understood. The major objective of this work is to probe such coupling of the praseodymium (Pr) 4f and 6s electrons in Pr2O2 and Pr2O2+. The approach combines mass-analyzed threshold ionization spectroscopy and spin-orbit multiconfiguration second-order quasi-degenerate perturbation theory. The energies of six ionization transitions are precisely measured; the adiabatic ionization energy of the neutral cluster is 38 045 (5) cm-1. Most of the electronic states involved in these transitions are identified as spin-orbit coupled states consisting of two or more electron spins. The electron configurations of these states are 4f46s2 for the neutral cluster and 4f46s for the singly charged cation, both in planar rhombus-type structures. The spin-orbit splitting due to the coupling of the electrons on the separate Pr atoms is on the order of hundreds of wavenumbers.

Intermolecular interactions in clusters of ethylammonium nitrate and 1-amino-1,2,3-triazole

The intermolecular interaction energies, including hydrogen bonds (H-bonds), of clusters of the ionic liquid ethylammonium nitrate (EAN) and 1-amino-1,2,3-triazole (1-AT) based deep eutectic propellants (DeEP) are examined. 1-AT is introduced as a neutral hydrogen bond donor (HBD) to EAN in order to form a eutectic mixture. The effective fragment potential (EFP) is used to examine the bonding interactions in the DeEP clusters. The resolution of the Identity (RI) approximated second order Møller-Plesset perturbation theory (RI-MP2) and coupled cluster theory (RI-CCSD(T)) are used to validate the EFP results. The EFP method predicts that there are significant polarization and charge transfer effects in the EAN:1-AT complexes, along with Coulombic, dispersion and exchange repulsion interactions. The EFP interaction energies are in good agreement with the RI-MP2 and RI-CCSD(T) results. The quasi-atomic orbital (QUAO) bonding and kinetic bond order (KBO) analyses are additionally used to develop a conceptual and semi-quantitative understanding of the H-bonding interactions as a function of the size of the system. The QUAO and KBO analyses suggest that the H-bonds in the examined clusters follow the characteristic hydrogen bonding three-center four electron interactions. The strongest H-bonding interactions between the (EAN)1:(1-AT)n and (EAN)2:(1-AT)n (n = 1-5) complexes are observed internally within EAN; that is, between the ethylammonium cation [EA]+ and the nitrate anion ([NO3]-). The weakest H-bonding interactions occur between [NO3]- and 1-AT. Consequently, the average strengths of the H-bonds within a given (EAN)x:(1-AT)n complex decrease as more 1-AT molecules are introduced into the EAN monomer and EAN dimer. The QUAO bonding analysis suggests that 1-AT in (EAN)x:(1-AT)n can act as both a HBD and a hydrogen bond acceptor simultaneously. It is observed that two 1-AT molecules can form H-bonds to each other. Although the KBOs that correspond to H-bonding interactions in [EA]+:1-AT, [NO3]-:1-AT and between two 1-AT molecules are weaker than the H-bonds in EAN, those weak H-bond networks with 1-AT could be important to form a stable DeEP.

Accelerating Coupled-Cluster Calculations with GPUs: An Implementation of the Density-Fitted CCSD(T) Approach for Heterogeneous Computing Architectures Using OpenMP Directives

An algorithm is presented for the coupled-cluster singles, doubles, and perturbative triples correction [CCSD(T)] method based on the density fitting or the resolution-of-the-identity (RI) approximation for performing calculations on heterogeneous computing platforms composed of multicore CPUs and graphics processing units (GPUs). The directive-based approach to GPU offloading offered by the OpenMP application programming interface has been employed to adapt the most compute-intensive terms in the RI-CCSD amplitude equations with computational costs scaling as O ( N O 2 N V 4 ) , O ( N O 3 N V 3 ) , and O ( N O 4 N V 2 ) (where NO and NV denote the numbers of correlated occupied and virtual orbitals, respectively) and the perturbative triples correction to execute on GPU architectures. The pertinent tensor contractions are performed using an accelerated math library such as cuBLAS or hipBLAS. Optimal strategies are discussed for splitting large data arrays into tiles to fit them into the relatively small memory space of the GPUs, while also minimizing the low-bandwidth CPU-GPU data transfers. The performance of the hybrid CPU-GPU RI-CCSD(T) code is demonstrated on pre-exascale supercomputers composed of heterogeneous nodes equipped with NVIDIA Tesla V100 and A100 GPUs and on the world's first exascale supercomputer named "Frontier", the nodes of which consist of AMD MI250X GPUs. Speedups within the range 4-8× relative to the recently reported CPU-only algorithm are obtained for the GPU-offloaded terms in the RI-CCSD amplitude equations. Applications to polycyclic aromatic hydrocarbons containing 16-66 carbon atoms demonstrate that the acceleration of the hybrid CPU-GPU code for the perturbative triples correction relative to the CPU-only code increases with the molecule size, attaining a speedup of 5.7× for the largest circumovalene molecule (C66H20). The GPU-offloaded code enables the computation of the perturbative triples correction for the C60 molecule using the cc-pVDZ/aug-cc-pVTZ-RI basis sets in 7 min on Frontier when using 12,288 AMD GPUs with a parallel efficiency of 83.1%.

The General Atomic and Molecular Electronic Structure System (GAMESS): Novel Methods on Novel Architectures

The primary focus of GAMESS over the last 5 years has been the development of new high-performance codes that are able to take effective and efficient advantage of the most advanced computer architectures, both CPU and accelerators. These efforts include employing density fitting and fragmentation methods to reduce the high scaling of well-correlated (e.g., coupled-cluster) methods as well as developing novel codes that can take optimal advantage of graphical processing units and other modern accelerators. Because accurate wave functions can be very complex, an important new functionality in GAMESS is the quasi-atomic orbital analysis, an unbiased approach to the understanding of covalent bonds embedded in the wave function. Best practices for the maintenance and distribution of GAMESS are also discussed.

Analysis of the bonding in tetrahedrane and phosphorus-substituted tetrahedranes

The bonding structures of tetrahedrane, phosphatetrahedrane, diphosphatetrahedrane and triphosphatetrahedrane are studied by employing an intrinsic quasi-atomic orbital analysis. Ethane, cyclopropane and tetrahedral P4 are employed as reference systems. The orbital analysis is paired with the computation of strain energies via isodesmic reactions. The results show that the increase in geometric strain upon transition from ethane to cyclopropane to tetrahedrane weakens the CC bonds, despite leading to shorter C-C interatomic distances. With the increase in strain, the orbitals centered on C and involved in the bonding of the cage structure are observed to have elevated p-character, and the orbital structure of C deviates from sp3 hybridization. The systematic substitution of CH groups by P atoms in the cage structure of tetrahedrane leads to stronger CC bonds, larger angles in the cage structures of the resulting phosphatetrahedranes, lower p-character in the orbitals involved in the bonding of the cages, and lower strain energies. It is found that P is more amenable to strained molecular arrangements than is C, and that the propensity of a given atom to hybridize s and p functions, or the lack thereof, has implications in the stability of molecules with strained geometries. The combination of the calculations presented here with the existing literature provides insight into the apparent propensity of tetrahedrane and P4 to 'break' their tetrahedral structures. Trends in the bonding interactions, such as bond strengths, s- and p-orbital characters and charge transfer are identified and related to the strain energy observed in each of the analyzed systems.

Toward an extreme-scale electronic structure system

Electronic structure calculations have the potential to predict key matter transformations for applications of strategic technological importance, from drug discovery to material science and catalysis. However, a predictive physicochemical characterization of these processes often requires accurate quantum chemical modeling of complex molecular systems with hundreds to thousands of atoms. Due to the computationally demanding nature of electronic structure calculations and the complexity of modern high-performance computing hardware, quantum chemistry software has historically failed to operate at such large molecular scales with accuracy and speed that are useful in practice. In this paper, novel algorithms and software are presented that enable extreme-scale quantum chemistry capabilities with particular emphasis on exascale calculations. This includes the development and application of the multi-Graphics Processing Unit (GPU) library LibCChem 2.0 as part of the General Atomic and Molecular Electronic Structure System package and of the standalone Extreme-scale Electronic Structure System (EXESS), designed from the ground up for scaling on thousands of GPUs to perform high-performance accurate quantum chemistry calculations at unprecedented speed and molecular scales. Among various results, we report that the EXESS implementation enables Hartree-Fock/cc-pVDZ plus RI-MP2/cc-pVDZ/cc-pVDZ-RIFIT calculations on an ionic liquid system with 623 016 electrons and 146 592 atoms in less than 45 min using 27 600 GPUs on the Summit supercomputer with a 94.6% parallel efficiency.

Enabling Fortran Standard Parallelism in GAMESS for Accelerated Quantum Chemistry Calculations

The performance of Fortran 2008 DO CONCURRENT (DC) relative to OpenACC and OpenMP target offloading (OTO) with different compilers is studied for the GAMESS quantum chemistry application. Specifically, DC and OTO are used to offload the Fock build, which is a computational bottleneck in most quantum chemistry codes, to GPUs. The DC Fock build performance is studied on NVIDIA A100 and V100 accelerators and compared with the OTO versions compiled by the NVIDIA HPC, IBM XL, and Cray Fortran compilers. The results show that DC can speed up the Fock build by 3.0× compared with that of the OTO model. With similar offloading efforts, DC is a compelling programming model for offloading Fortran applications to GPUs.

High-performance strategies for the recent MRSF-TDDFT in GAMESS

Multiple ERI (Electron Repulsion Integral) tensor contractions (METC) with several matrices are ubiquitous in quantum chemistry. In response theories, the contraction operation, rather than ERI computations, can be the major bottleneck, as its computational demands are proportional to the multiplicatively combined contributions of the number of excited states and the kernel pre-factors. This paper presents several high-performance strategies for METC. Optimal approaches involve either the data layout reformations of interim density and Fock matrices, the introduction of intermediate ERI quartet buffer, and loop-reordering optimization for a higher cache hit rate. The combined strategies remarkably improve the performance of the MRSF (mixed reference spin flip)-TDDFT (time-dependent density functional theory) by nearly 300%. The results of this study are not limited to the MRSF-TDDFT method and can be applied to other METC scenarios.

Porting fragmentation methods to GPUs using an OpenMP API: Offloading the resolution-of-the-identity second-order Møller-Plesset perturbation method

Using an OpenMP Application Programming Interface, the resolution-of-the-identity second-order Møller-Plesset perturbation (RI-MP2) method has been off-loaded onto graphical processing units (GPUs), both as a standalone method in the GAMESS electronic structure program and as an electron correlation energy component in the effective fragment molecular orbital (EFMO) framework. First, a new scheme has been proposed to maximize data digestion on GPUs that subsequently linearizes data transfer from central processing units (CPUs) to GPUs. Second, the GAMESS Fortran code has been interfaced with GPU numerical libraries (e.g., NVIDIA cuBLAS and cuSOLVER) for efficient matrix operations (e.g., matrix multiplication, matrix decomposition, and matrix inversion). The standalone GPU RI-MP2 code shows an increasing speedup of up to 7.5× using one NVIDIA V100 GPU with one IBM 42-core P9 CPU for calculations on fullerenes of increasing size from 40 to 260 carbon atoms using the 6-31G(d)/cc-pVDZ-RI basis sets. A single Summit node with six V100s can compute the RI-MP2 correlation energy of a cluster of 175 water molecules using the correlation consistent basis sets cc-pVDZ/cc-pVDZ-RI containing 4375 atomic orbitals and 14 700 auxiliary basis functions in ∼0.85 h. In the EFMO framework, the GPU RI-MP2 component shows near linear scaling for a large number of V100s when computing the energy of an 1800-atom mesoporous silica nanoparticle in a bath of 4000 water molecules. The parallel efficiencies of the GPU RI-MP2 component with 2304 and 4608 V100s are 98.0% and 96.1%, respectively.

Porting Fragmentation Methods to Graphical Processing Units Using an OpenMP Application Programming Interface: Offloading the Fock Build for Low Angular Momentum Functions

A framework to offload four-index two-electron repulsion integrals to graphical processing units (GPUs) using OpenMP is discussed. The method has been applied to the Fock build for low angular momentum s and p functions in both the restricted Hartree-Fock (RHF) and in the effective fragment molecular orbital (EFMO) framework. Benchmark calculations for the GPU code for the pure RHF method show an increasing speedup relative to the existing OpenMP CPU code in GAMESS from 1.04 to 52× for clusters of 70-569 water molecules. The parallel efficiency on 24 NVIDIA V100 GPU boards also increases when increasing the system size: from 75 to 94% for water clusters that contain 303-1120 molecules. In the EFMO framework, the GPU Fock build shows a high linear scalability up to 4608 V100s with a parallel efficiency of 96% for calculations on a solvated mesoporous silica nanoparticle system with ∼67,000 basis functions.

Quantum Chemical Modeling of Propellant Degradation

An ab initio quantum chemical approach for the modeling of propellant degradation is presented. Using state-of-the-art bonding analysis techniques and composite methods, a series of potential degradation reactions are devised for a sample hydroxyl-terminated-polybutadiene (HTPB) type solid fuel. By applying thermochemical procedures and isodesmic reactions, accurate thermochemical quantities are obtained using a modified G3 composite method based on the resolution of the identity. The calculated heats of formation for the different structures produced presents an ∼2 kcal/mol average error when compared against experimental values.

General, Rigorous Approach for the Treatment of Interfragment Covalent Bonds

A generalized, projection-based transformation of the method-agnostic Fock operator in various ab initio fragment-based quantum chemistry methods has been developed for the treatment of interfragment covalent bonds. This transformation freezes the relevant localized molecular orbital associated with each interfragment bond, thereby restricting the variational subspace of the fragment wave functions, in order to maintain the proper physical characteristics of the involved covalent bonds. In addition, sets of orbitals that would lead to multiple occupancy of certain orbitals are explicitly removed from the variational space. The transformation is developed for the specific case of mutually orthonormal frozen and unfrozen orbitals within each fragment. The newly developed approach is then used to study model systems with two popular ab initio fragment-based methods, and the results of these calculations are compared to those obtained by existing methodologies. Analysis is focused on both quantitative and qualitative accuracy as well as computational scalability and stability. Other methods for which the developed formalisms are appropriate are outlined, and future extensions of the methods are discussed.

Coarse-Grained Water Model Development for Accurate Dynamics and Structure Prediction

Several coarse-graining (CG) methods have been combined to develop a CG model of water capable of the accurate prediction of structure and dynamics properties. The multiscale coarse-graining (MS-CG) method based on force matching and the PDF-based coarse-graining method were used for accurate dynamics prediction. The iterative Boltzmann inversion (IBI) method was added for accurate structure representation. The approach is applied to bulk water, and the results show close reproduction of the CG structure when compared with the reference atomistic data. The combination of MS-CG and IBI methods facilitates the development of CG force fields at different temperatures based on a single MS-CG coarse-graining procedure. The dynamic properties of the CG water model closely match those obtained from the reference atomistic system. The general application of this approach to any existing coarse-graining methods is discussed.

Molecular interactions in diffusion-controlled aldol condensation with mesoporous silica nanoparticles

The aldol reaction of p-nitrobenzaldehyde in amino-catalyzed mesoporous silica nanoparticles (MSN) has revealed varying catalytic activity with the size of the pores of MSN. The pore size dependence related to the reactivity indicates that the diffusion process is important. A detailed molecular-level analysis for understanding diffusion requires assessment of the noncovalent interactions of the molecular species involved in the aldol reaction with each other, with the solvent, and with key functional groups on the pore surface. Such an analysis is presented here based upon the effective fragment potential (EFP). The EFP method can calculate the intermolecular interactions, decomposed into Coulomb, polarization, dispersion, exchange-repulsion, and charge-transfer interactions. In this study, the potential energy surfaces corresponding to each intermolecular interaction are analyzed for homo- and hetero-dimers with various configurations. The monomers that compose dimers are five molecules such as p-nitrobenzaldehyde, acetone, n-hexane, propylamine, and silanol. The results illustrate that the dispersion interaction is crucial in most dimers.

A Task-Based Approach to Parallel Restricted Hartree-Fock Calculations

In recent years, parallelism via multithreading has become extremely important to the optimization of high-performance electronic structure theory codes. Such multithreading is generally achieved via OpenMP constructs, using a fork-join threading model to enable thread-level data parallelism within the code. An alternative approach to multithreading is task-based parallelism, which displays multiple benefits relative to fork-join thread parallelism. A novel Restricted Hartree-Fock (RHF) algorithm, utilizing task-based parallelism to achieve optimal performance, was developed and implemented into the JuliaChem electronic structure theory software package. The new RHF algorithm utilizes a unique method of shell quartet batch creation, enabling construction and distribution of fine-grained shell quartet batches in a load-balanced manner using the Julia task construct. These shell quartet batches are then distributed statically across message-passing interface (MPI) ranks and dynamically across threads within an MPI rank, requiring no explicit inter-rank or interthread synchronization to do so. Compared to the hybrid MPI/OpenMP RHF algorithm present in the GAMESS software package, the task-based algorithm demonstrates speedups of up to ∼40% for systems in the S22(3) test set of molecules, with system sizes up to ∼1000 basis functions. The JuliaChem algorithm demonstrates the viability of both the task-based parallelism model and the Julia programming language for construction of performant electronic structure theory codes targeting systems of a size of chemical interest.

Rotational and translational diffusion of liquid n-hexane: EFP-based molecular dynamics analysis

Molecular Dynamics (MD) simulations based on the Effective Fragment Potential (EFP) method are utilized to provide a comprehensive assessment of diffusion in liquid n-hexane. We decompose translational diffusion into components along and orthogonal to the long axis of the molecule. Rotational diffusion is decomposed into tumbling and spinning motions about this axis. Our analysis yields four corresponding diffusion coefficients which are related to diagonal entries in the complete 6 × 6 diffusion tensor accounting for the three rotational and three translational degrees of freedom and for the potential coupling between them. However, coupling between different degrees of freedom is expected to be minimal for a natural choice of the molecular body-fixed axis, so then off-diagonal entries in the tensor are negligible. This expectation is supported by a hydrodynamic analysis of the diffusion tensor which treats the liquid surrounding the molecule being tracked as a viscous continuum. Thus, the EFP MD analysis provides a comprehensive characterization of diffusion and also reveals expected shortcomings of the hydrodynamic treatment, particularly for rotational diffusion, when applied to neat liquids.

Excited states of lutetium oxide and its singly charged cation

Vibronic spectra of lutetium oxide (LuO) seeded in supersonic molecule beams are investigated with mass-analyzed threshold ionization (MATI) spectroscopy and second-order multiconfigurational quasi-degenerate perturbation (MCQDPT2) theory. Six states of LuO and four states of LuO+ are located by the MCQDPT2 calculations, and an a3Π(LuO+) ← C2Σ+ (LuΟ) transition is observed by the MATI measurement. The vibronic spectra show abnormal vibrational intervals for both the neural and cation excited states, and the abnormality is attributed to vibrational perturbations induced by interactions with neighboring states.

Quantum Chemistry Common Driver and Databases (QCDB) and Quantum Chemistry Engine (QCEngine): Automation and interoperability among computational chemistry programs

Community efforts in the computational molecular sciences (CMS) are evolving toward modular, open, and interoperable interfaces that work with existing community codes to provide more functionality and composability than could be achieved with a single program. The Quantum Chemistry Common Driver and Databases (QCDB) project provides such capability through an application programming interface (API) that facilitates interoperability across multiple quantum chemistry software packages. In tandem with the Molecular Sciences Software Institute and their Quantum Chemistry Archive ecosystem, the unique functionalities of several CMS programs are integrated, including CFOUR, GAMESS, NWChem, OpenMM, Psi4, Qcore, TeraChem, and Turbomole, to provide common computational functions, i.e., energy, gradient, and Hessian computations as well as molecular properties such as atomic charges and vibrational frequency analysis. Both standard users and power users benefit from adopting these APIs as they lower the language barrier of input styles and enable a standard layout of variables and data. These designs allow end-to-end interoperable programming of complex computations and provide best practices options by default.

Faster Self-Consistent Field (SCF) Calculations on GPU Clusters

A novel implementation of the self-consistent field (SCF) procedure specifically designed for high-performance execution on multiple graphics processing units (GPUs) is presented. The algorithm offloads to GPUs the three major computational stages of the SCF, namely, the calculation of one-electron integrals, the calculation and digestion of electron repulsion integrals, and the diagonalization of the Fock matrix, including SCF acceleration via DIIS. Performance results for a variety of test molecules and basis sets show remarkable speedups with respect to the state-of-the-art parallel GAMESS CPU code and relative to other widely used GPU codes for both single and multi-GPU execution. The new code outperforms all existing multi-GPU implementations when using eight V100 GPUs, with speedups relative to Terachem ranging from 1.2× to 3.3× and speedups of up to 28× over QUICK on one GPU and 15× using eight GPUs. Strong scaling calculations show nearly ideal scalability up to 8 GPUs while retaining high parallel efficiency for up to 18 GPUs.

Electronic Structure Theory Calculations Using Modern Architectures: KNL vs Haswell

The time to solution and parallel efficiency of several commonly used electronic structure methods (Hartree-Fock, density functional theory, second order perturbation theory, resolution of the identity second order perturbation theory, coupled cluster) are evaluated on both the Intel Xeon Haswell and the Intel Xeon Phi Knights Landing (KNL) architectures. The Haswell completes the benchmark calculations with a faster time to solution than the KNL for all molecules and methods tested. While the Haswell exhibits an average speedup of at least 3.5 relative to the KNL for all nonthreaded computations, the KNL has a better parallel efficiency than the Haswell with increasing core counts. The architectures are further tested using a more computationally costly coupled cluster method on a transition state reaction. The Haswell appears to be the best choice to minimize the time to solution, though for very large systems and high levels of theory that require memory intensive processes the superior memory hierarchy and larger on node memory of the KNL can make it a better choice. These results are used to showcase aspects of novel architectures that will increase efficiency for quantum chemistry applications.

PDG: A Composite Method Based on the Resolution of the Identity

The Gaussian-3 (G3) composite approach for thermochemical properties is revisited in light of the enhanced computational efficiency and reduced memory costs by applying the resolution-of-the-identity (RI) approximation for two-electron repulsion integrals (ERIs) to the computationally demanding component methods in the G3 model: the energy and gradient computations via the second-order Møller-Plesset perturbation theory (MP2) and the energy computations using the coupled-cluster singles-doubles method augmented with noniterative triples corrections [CCSD(T)]. Efficient implementation of the RI-based methods is achieved by employing a hybrid distributed/shared memory model based on MPI and OpenMP. The new variant of the G3 composite approach based on the RI approximation is termed the RI-G3 scheme, or alternatively the PDG method. The accuracy of the new RI-G3/PDG scheme is compared to the "standard" G3 composite approach that employs the memory-expensive four-center ERIs in the MP2 and CCSD(T) calculations. Taking the computation of the heats of formation of the closed-shell molecules in the G3/99 test set as a test case, it is demonstrated that the RI approximation introduces negligible changes to the mean absolute errors relative to the standard G3 model (less than 0.1 kcal/mol), while the standard deviations remain unaltered. The efficiency and memory requirements for the RI-MP2 and RI-CCSD(T) methods are compared to the standard MP2 and CCSD(T) approaches, respectively. The hybrid MPI/OpenMP-based RI-MP2 energy plus gradient computation is found to attain a 7.5× speedup over the standard MP2 calculations. For the most demanding CCSD(T) calculations, the application of the RI approximation is found to nearly halve the memory demand, confer about a 4-5× speedup for the CCSD iterations, and reduce the computational time for the compute-intensive triples correction step by several hours.

Scalable ab initio fragmentation methods based on a truncated expansion of the non-orthogonal molecular orbital model

An alternative formulation of the non-orthogonal molecular orbital model of electronic structure theory is developed based on the expansion of the inverse molecular orbital overlap matrix. From this model, a hierarchy of ab initio fragment-based quantum chemistry methods, referred to as the nth-order expanded non-orthogonal molecular orbital methods, are developed using a minimal number of approximations, each of which is frequently employed in intermolecular interaction theory. These novel methods are compared to existing fragment-based quantum chemistry methods, and the implications of those significant differences, where they exist, between the methods developed herein and those already existing methods are examined in detail. Computational complexities and theoretical scaling are also analyzed and discussed. Future extensions for the hierarchy of methods, to account for additional intrafragment and interfragment interactions, are outlined.

Bonding analysis of water clusters using quasi-atomic orbitals

The quasi-atomic orbital (QUAO) bonding analysis introduced by Ruedenberg and co-workers is used to develop an understanding of the hydrogen bonds in small water clusters, from the dimer through the hexamer (bag, boat, book, cyclic, prism and cage conformers). Using kinetic bond orders as a metric, it is demonstrated that as the number of waters in simple cyclic clusters increases, the hydrogen bonds strengthen, from the dimer through the cyclic hexamer. However, for the more complex hexamer isomers, the strength of the hydrogen bonds varies, depending on whether the cluster contains double acceptors and/or double donors. The QUAO analysis also reveals the three-center bonding nature of hydrogen bonds in water clusters.

Model protein excited states: MRCI calculations with large active spaces vs CC2 method

Benchmarking calculations on excited states of models of phenylalanine protein chains are presented to assess the ability of alternative methods to the standard and most commonly used multiconfigurational wave function-based method, the complete active space self-consistent field (CASSCF), in recovering the non-dynamical correlation for systems that become not affordable by the CASSCF. The exploration of larger active spaces beyond the CASSCF limit is benchmarked through three strategies based on the reduction in the number of determinants: the restricted active space self-consistent field, the generalized active space self-consistent field (GASSCF), and the occupation-restricted multiple active space (ORMAS) schemes. The remaining dynamic correlation effects are then added by the complete active space second-order perturbation theory and by the multireference difference dedicated configuration interaction methods. In parallel, the approximate second-order coupled cluster (CC2), already proven to be successful for small building blocks of model proteins in one of our previous works [Ben Amor et al., J. Chem. Phys. 148, 184105 (2018)], is investigated to assess its performances for larger systems. Among the different alternative strategies to CASSCF, our results highlight the greatest efficiency of the GASSCF and ORMAS schemes in the systematic reduction of the configuration interaction expansion without loss of accuracy in both nature and excitation energies of both singlet ππ^* and nπ^* _CO excited states with respect to the equivalent CASSCF calculations. Guidelines for an optimum applicability of this scheme to systems requiring active spaces beyond the complete active space limit are then proposed. Finally, the extension of the CC2 method to such large systems without loss of accuracy is demonstrated, highlighting the great potential of this method to treat accurately excited states, mainly single reference, of very large systems.

A Massively Parallel Implementation of the CCSD(T) Method Using the Resolution-of-the-Identity Approximation and a Hybrid Distributed/Shared Memory Parallelization Model

A parallel algorithm is described for the coupled-cluster singles and doubles method augmented with a perturbative correction for triple excitations [CCSD(T)] using the resolution-of-the-identity (RI) approximation for two-electron repulsion integrals (ERIs). The algorithm bypasses the storage of four-center ERIs by adopting an integral-direct strategy. The CCSD amplitude equations are given in a compact quasi-linear form by factorizing them in terms of amplitude-dressed three-center intermediates. A hybrid MPI/OpenMP parallelization scheme is employed, which uses the OpenMP-based shared memory model for intranode parallelization and the MPI-based distributed memory model for internode parallelization. Parallel efficiency has been optimized for all terms in the CCSD amplitude equations. Two different algorithms have been implemented for the rate-limiting terms in the CCSD amplitude equations that entail O(NO2NV4) and O(NO3NV3)-scaling computational costs, where N_O and N_V denote the number of correlated occupied and virtual orbitals, respectively. One of the algorithms assembles the four-center ERIs requiring N_V⁴ and N_O²N_V²-scaling memory costs in a distributed manner on a number of MPI ranks, while the other algorithm completely bypasses the assembling of quartic memory-scaling ERIs and thus largely reduces the memory demand. It is demonstrated that the former memory-expensive algorithm is faster on a few hundred cores, while the latter memory-economic algorithm shows a better strong scaling in the limit of a few thousand cores. The program is shown to exhibit a near-linear scaling, in particular for the compute-intensive triples correction step, on up to 8000 cores. The performance of the program is demonstrated via calculations involving molecules with 24-51 atoms and up to 1624 atomic basis functions. As the first application, the complete basis set (CBS) limit for the interaction energy of the π-stacked uracil dimer from the S66 data set has been investigated. This work reports the first calculation of the interaction energy at the CCSD(T)/aug-cc-pVQZ level without local orbital approximation. The CBS limit for the CCSD correlation contribution to the interaction energy was found to be -8.01 kcal/mol, which agrees very well with the value -7.99 kcal/mol reported by Schmitz, Hättig, and Tew [ Phys. Chem. Chem. Phys. 2014, 16, 22167-22178]. The CBS limit for the total interaction energy was estimated to be -9.64 kcal/mol.

Combined quantum Monte Carlo - effective fragment molecular orbital method: fragmentation across covalent bonds

The previously developed combined Quantum Monte Carlo-Effective Fragment Molecular Orbital (QMC-EFMO) method is extended to systems in which the fragmentation process cuts across covalent molecular bonds. The extended QMC-EFMO capability is demonstrated on a few model systems: the glycine tetramer, the diglycine reaction to form a dipeptide, silica-based rings, and polyalanine chains of increasing length. The agreement between full QMC and QMC-EFMO for the correlation energy is within 2 kcal mol^-1 and for the correlation energy differences is within 1 kcal mol^-1.

Multiple Bonding in Rhodium Monoboride. Quasi-atomic Analyses of the Ground and Low-Lying Excited States

The bonding structures of the ground state and the lowest five excited states of rhodium monoboride are identified by determining the quasi-atomic orbitals in full valence space MCSCF wave functions and the interactions between these orbitals. A quadruple bond, namely two π-bonds and two σ-bonds, is identified and characterized for the X¹Σ⁺ ground state, in agreement with a previous report (Cheung J. Phys. Chem. Lett. 2020, 11, 659-663). However, in all excited states, the bonding is predicted to be weaker because, in these states, one of the σ-bonding interactions has a small magnitude. In the a³Δ and A¹Δ states, the bond order is between a triple and quadruple bond. In the b³Σ⁺ state, the Rh-B linkage is a triple bond. In the c³Π and B¹Π states, the atoms are linked by a double bond due to an additional weakening of the two π-bonds. The decreases in the predicted bond strengths are reflected in the decreases of the predicted binding energies and in the increases of the predicted bond lengths from the X¹Σ⁺ ground state to the c³Π and the B¹Π excited states. Notably, the 5pσ orbital of rhodium, which is vacant in the ground state of the atom, plays a significant role in the molecule.

Effective Fragment Potential-Based Molecular Dynamics Studies of Diffusion in Acetone and Hexane

To facilitate more reliable descriptions of transport properties in liquids, molecular dynamics (MD) simulations are performed based on the effective fragment potential (EFP) method derived from first-principles quantum mechanics (in contrast to MD based upon empirically fitted potentials). The EFP method describes molecular interactions in terms of Coulomb, polarization/induction, dispersion, exchange-repulsion, and charge-transfer interactions. The EFP MD simulations described in this paper, performed on hexane and acetone, are able to track the mean-square displacement of molecules for sufficient time to reliably extract translational diffusion coefficients. The results reported here are in reasonable agreement with experiment.

Computation of host-guest binding free energies with a new quantum mechanics based mining minima algorithm

A new method called QM-VM2 is presented that efficiently combines statistical mechanics with quantum mechanical (QM) energy potentials in order to calculate noncovalent binding free energies of host-guest systems. QM-VM2 efficiently couples the use of semi-empirical QM (SEQM) energies and geometry optimizations with an underlying molecular mechanics (MM) based conformational search, to find low SEQM energy minima, and allows for processing of these minima at higher levels of ab initio QM theory. A progressive geometry optimization scheme is introduced as a means to increase conformational sampling efficiency. The newly implemented QM-VM2 is used to compute the binding free energies of the host molecule cucurbit[7]uril and a set of 15 guest molecules. The results are presented along with comparisons to experimentally determined binding affinities. For the full set of 15 host-guest complexes, which have a range of formal charges from +1 to +3, SEQM-VM2 based binding free energies show poor correlation with experiment, whereas for the ten +1 complexes only, a significant correlation (R² = 0.8) is achieved. SEQM-VM2 generation of conformers followed by single-point ab initio QM calculations at the dispersion corrected restricted Hartree-Fock-D3(BJ) and TPSS-D3(BJ) levels of theory, as post-processing corrections, yields a reasonable correlation with experiment for the full set of host-guest complexes (R² = 0.6 and R² = 0.7, respectively) and an excellent correlation for the +1 formal charge set (R² = 1.0 and R² = 0.9, respectively), as long as a sufficiently large basis set (triple-zeta quality) is employed. The importance of the inclusion of configurational entropy, even at the MM level, for the achievement of good correlation with experiment was demonstrated by comparing the calculated ΔE values with experiment and finding a considerably poorer correlation with experiment than for the calculated free energy ΔE - TΔS. For the complete set of host-guest systems with the range of formal charges, it was observed that the deviation of the predicted binding free energy from experiment correlates somewhat with the net charge of the systems. This observation leads to a simple empirical interpolation scheme to improve the linear regression of the full set.

Many-Body Dispersion

A broad range of approaches to many-body dispersion are discussed, including empirical approaches with multiple fitted parameters, augmented density functional-based approaches, symmetry adapted perturbation theory, and a supermolecule approach based on coupled cluster theory. Differing definitions of "body" are considered, specifically atom-based vs molecule-based approaches.

Stability and Dissociation of Ethylenedione (OCCO)

This work examines the electronic structure and apparent instability of ethylenedione (OCCO), including an analysis of the singlet and triplet potential energy surfaces along the bending vibrations. While the singlet state is inherently unstable due to the Renner-Teller effect, theory predicts the triplet state to have a stable minimum on the potential energy surface. The stability of the triplet state is examined in detail, taking into account spin-orbit interactions. Using multireference quantum chemical methods, the lifetime of the triplet state is estimated to be in the picosecond range, significantly lower than previously computed. A quasi-atomic molecular orbital (QUAO) analysis is also used to elucidate the nature of bonding along the potential energy surface in both the singlet and triplet states. These calculations confirm the transient nature of the OCCO molecule, although they do not fully explain the lack of experimental detection via spectroscopy, which is known have the capability to probe even shorter lifetimes.

Why is Si2H2 Not Linear? An Intrinsic Quasi-Atomic Bonding Analysis

The molecular energy of Si₂H₂ geometric structures increases in the order dibridged < trans-bent < linear, in contrast to acetylene, C₂H₂, for which the linear structure is the global minimum. In this study, the intra-atomic (antibonding) and bonding contributions to the total molecular energy of these valence isoelectronic molecules are computed by expressing the density matrices of the full valence space multiconfiguration self-consistent field wave function in terms of quasi-atomic orbitals. The analysis shows that the intra-atomic contributions to the molecular energy become less favorable in the order dibridged → trans-bent → linear for both C₂H₂ and Si₂H₂. By contrast, the inter-atomic bonding contributions become energetically more favorable in that order for both C₂H₂ and Si₂H₂. The two systems differ as follows. For Si₂H₂, the antibonding intra-atomic energy changes that occur when the dibridged molecule reconstructs into the trans-bent and linear structures prevail over the interatomic interactions that induce bond formation. In contrast, for C₂H₂, the interatomic interactions that create bonds prevail over the intra-atomic energy changes that occur when the dibridged molecule reconstructs into the trans-bent and linear structures. The intra-atomic energy changes that occur in these systems are related to the hybridization of the heavy atoms in an analogous manner to the hybridization of C in CH₄ from (2s)²(2p)² to sp³ hybrid orbitals.

Recent developments in the general atomic and molecular electronic structure system

A discussion of many of the recently implemented features of GAMESS (General Atomic and Molecular Electronic Structure System) and LibCChem (the C++ CPU/GPU library associated with GAMESS) is presented. These features include fragmentation methods such as the fragment molecular orbital, effective fragment potential and effective fragment molecular orbital methods, hybrid MPI/OpenMP approaches to Hartree-Fock, and resolution of the identity second order perturbation theory. Many new coupled cluster theory methods have been implemented in GAMESS, as have multiple levels of density functional/tight binding theory. The role of accelerators, especially graphical processing units, is discussed in the context of the new features of LibCChem, as it is the associated problem of power consumption as the power of computers increases dramatically. The process by which a complex program suite such as GAMESS is maintained and developed is considered. Future developments are briefly summarized.

Development of the FMO/RI-MP2 Fully Analytic Gradient Using a Hybrid-Distributed/Shared Memory Programming Model

The fully analytic gradient of the second-order Møller-Plesset perturbation theory (MP2) with the resolution-of-the-identity (RI) approximation in the fragment molecular orbital (FMO) framework is derived and implemented using a hybrid multilevel parallel programming model, a combination of the general distributed data interface (GDDI) and the OpenMP API. The FMO/MP2 analytic gradient contains three parts, i.e., the internal fragment component, the electrostatic potential (ESP) component, and the response terms. The RI approximation is applied to the internal fragment MP2 gradient term, whose MP2 densities and monomer MP2 Lagrangians are shared with the ESP and the response terms. The FMO/RI-MP2 analytic gradient implementation is validated against the numerical gradient (with errors ∼10^-6-10^-5 Hartree/Bohr) and the energy conservation in molecular dynamics (MD) simulations using NVE ensembles. The RI approximation introduces an error of ∼10^-5 Hartree/Bohr with a speedup of 4.0-8.0× compared with the currently available GDDI FMO/MP2 gradient. The node linear scaling of the fragmentation framework due to multilevel parallelism is well-preserved and is demonstrated in single-point gradient calculations of large water clusters (e.g., 1120 and 2165 molecules) using 300-800 KNL compute nodes with a parallel efficiency of more than 90%.

Analytic non-adiabatic couplings for the spin-flip ORMAS method

Analytic non-adiabatic coupling matrix elements (NACME) are derived and implemented for the spin-flip occupation restricted multiple active space configuration interaction (SF-ORMAS-CI) method.

Many-Body Dispersion in Molecular Clusters

Many-body dispersion has gained considerable attention over the past decade, particularly for condensed phase systems. However, quantitatively accurate studies of many-body dispersion have only recently become feasible due to challenges in reliability and accuracy. Currently available methodologies for calculating many-body dispersion have been challenged, with recent evidence suggesting, for example, that dispersion-corrected density functional theory (DFT) schemes cannot consistently predict many-body dispersion accurately. This study evaluates many-body dispersion energies using a composite approach that employs singles and doubles coupled cluster theory with perturbative/noniterative triples, CCSD(T), combined with an extrapolation to the complete basis set (CBS) limit. The combined CCSD(T)/CBS approach is applied to Ar_n and (H₂O)_n, n = 3-10, clusters, and a new data set called S22(3), which includes trimers generated based on the S22 data set. In these systems, the many-body dispersion provides a very small contribution to the total interaction energy of all of the systems studied, generally 3% or less of the total interaction energy. Two-body dispersion is the dominant dispersion contribution and many-body dispersion contributes no more than 5.7% of the total dispersion energy, generally staying below 2%.