Tensor decomposition in post-Hartree–Fock methods. I. Two-electron integrals and MP2

Spatial Signatures of Electron Correlation in Least-Squares Tensor Hypercontraction

Least-squares tensor hypercontraction (LS-THC) has received some attention in recent years as an approach to reduce the significant computational costs of wave function-based methods in quantum chemistry. However, previous work has demonstrated that LS-THC factorization performs disproportionately worse in the description of wave function components (e.g., cluster amplitudes T̂2) than Hamiltonian components (e.g., electron repulsion integrals (pq|rs)). This work develops novel theoretical methods to study the source of these errors in the context of the real-space T̂2 kernel, and reports, for the first time, the existence of a "correlation feature" in the errors of the LS-THC representation of the "exchange-like" correlation energy EX and T̂2 that is remarkably consistent across ten molecular species, three correlated wave functions, and four basis sets. This correlation feature portends the existence of a "pair point kernel" missing in the usual LS-THC representation of the wave function, which critically depends upon pairs of grid points situated close to atoms and with interpair distances between one and two Bohr radii. These findings point the way for future LS-THC developments to address these shortcomings.

Tensor hypercontraction for fully self-consistent imaginary-time GF2 and GWSOX methods: Theory, implementation, and role of the Green's function second-order exchange for intermolecular interactions

We present an efficient MPI-parallel algorithm and its implementation for evaluating the self-consistent correlated second-order exchange term (SOX), which is employed as a correction to the fully self-consistent GW scheme called scGWSOX (GW plus the SOX term iterated to achieve full Green's function self-consistency). Due to the application of the tensor hypercontraction (THC) in our computational procedure, the scaling of the evaluation of scGWSOX is reduced from O(nτnAO5) to O(nτN2nAO2). This fully MPI-parallel and THC-adapted approach enabled us to conduct the largest fully self-consistent scGWSOX calculations with over 1100 atomic orbitals with only negligible errors attributed to THC fitting. Utilizing our THC implementation for scGW, scGF2, and scGWSOX, we evaluated energies of intermolecular interactions. This approach allowed us to circumvent issues related to reference dependence and ambiguity in energy evaluation, which are common challenges in non-self-consistent calculations. We demonstrate that scGW exhibits a slight overbinding tendency for large systems, contrary to the underbinding observed with non-self-consistent RPA. Conversely, scGWSOX exhibits a slight underbinding tendency for such systems. This behavior is both physical and systematic and is caused by exclusion-principle violating diagrams or corresponding corrections. Our analysis elucidates the role played by these different diagrams, which is crucial for the construction of rigorous, accurate, and systematic methods. Finally, we explicitly show that all perturbative fully self-consistent Green's function methods are size-extensive and size-consistent.

Robust Tensor Hypercontraction of the Particle-Particle Ladder Term in Equation-of-Motion Coupled Cluster Theory

One method of representing a high-rank tensor as a (hyper-)product of lower-rank tensors is the tensor hypercontraction (THC) method of Hohenstein et al. This strategy has been found to be useful for reducing the polynomial scaling of coupled-cluster methods by representation of a four-dimensional tensor of electron-repulsion integrals in terms of five two-dimensional matrices. Pierce et al. have already shown that the application of a robust form of THC to the particle-particle ladder (PPL) term reduces the cost of this term in couple-cluster singles and doubles (CCSD) from O ( N 6 ) to O ( N 5 ) with negligible errors in energy with respect to the density-fitted variant. In this work, we have implemented the least-squares variant of THC (LS-THC) which does not require a nonlinear tensor factorization, including the robust form (R-LS-THC), for the calculation of the excitation and electron attachment energies using equation-of-motion coupled cluster methods EOMEE-CCSD and EOMEA-CCSD, respectively. We have benchmarked the effect of the R-LS-THC-PPL approximation on excitation energies using the comprehensive QUEST database and the accuracy of electron attachment energies using the NAB22 database. We find that errors on the order of 1 meV are achievable with a reduction in total calculation time of approximately 5 ×.

Post-Kohn-Sham Random-Phase Approximation and Correction Terms in the Expectation-Value Coupled-Cluster Formulation

Using expectation-value coupled-cluster theory and many-body perturbation theory (MBPT), we formulate a series of corrections to the post-Kohn-Sham (post-KS) random-phase approximation (RPA) energy. The beyond-RPA terms are of two types: those accounting for the non-Hartree-Fock reference and those introducing the coupled-cluster doubles non-ring contractions. The contributions of the former type, introduced via the semicanonical orbital basis, drastically reduce the binding strength in noncovalent systems. The good accuracy is recovered by the attractive third-order doubles correction referred to as Ec2g. The existing RPA approaches based on KS orbitals neglect most of the proposed corrections but can perform well thanks to error cancellation. The proposed method accounts for every contribution in the state-of-the-art renormalized second-order perturbation theory (rPT2) approach but adds additional terms which initially contribute in the third order of MBPT. The cost of energy evaluation scales as noniterative O ( N 4 ) in the implementation with low-rank tensor decomposition. The numerical tests of the proposed approach demonstrate accurate results for noncovalent dimers of polar molecules and for the challenging many-body noncovalent cluster of CH4···(H2O)20.

Efficient Construction of Canonical Polyadic Approximations of Tensor Networks

We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of the network by leveraging its structure in the course of the CP factor optimization. The utility of this technique is demonstrated for the order-4 Coulomb interaction tensor approximated by two order-3 tensors via an approximate generalized square-root (SQ) factorization, such as density fitting or (pivoted) Cholesky. The complexity of constructing a four-way CP decomposition is reduced from O(n4RCP) (for the nonapproximated Coulomb tensor) to O(n3RCP) (for the SQ-factorized Coulomb tensor), where n and R_CP are the basis and CP ranks, respectively. This reduces the cost of constructing the CP approximation of two-body interaction tensors of relevance to accurate many-body electronic structure by up to 2 orders of magnitude for systems with up to 36 atoms studied here. The full four-way CP approximation of the Coulomb interaction tensor is shown to be more accurate than the known approaches which utilize CP-factorizations of the SQ factors (which are also constructed with an O(n3RCP) cost), such as the algebraic pseudospectral and tensor hypercontraction approaches. The CP-decomposed SQ factors can also serve as a robust initial guess for the four-way CP factors.

System-Specific Separable Basis Based on Tucker Decomposition: Application to Density Functional Calculations

For fast density functional calculations, a suitable basis that can accurately represent the orbitals within a reasonable number of dimensions is essential. Here, we propose a new type of basis constructed from Tucker decomposition of a finite-difference (FD) Hamiltonian matrix, which is intended to reflect the system information implied in the Hamiltonian matrix and satisfies orthonormality and separability conditions. By introducing the system-specific separable basis, the computation time for FD density functional calculations for seven two- and three-dimensional periodic systems was reduced by a factor of 2-71 times, while the errors in both the atomization energy per atom and the band gap were limited to less than 0.1 eV. The accuracy and speed of the density functional calculations with the proposed basis can be systematically controlled by adjusting the rank size of Tucker decomposition.

Near-Exact CCSDT Energetics from Rank-Reduced Formalism Supplemented by Non-iterative Corrections

We introduce a non-iterative energy correction, added on top of the rank-reduced coupled-cluster method with single, double, and triple substitutions, that accounts for excitations excluded from the parent triple excitation subspace. The formula for the correction is derived by employing the coupled-cluster Lagrangian formalism, with an additional assumption that the parent excitation subspace is closed under the action of the Fock operator. Owing to the rank-reduced form of the triple excitation amplitudes tensor, the computational cost of evaluating the correction scales as N⁷, where N is the system size. The accuracy and computational efficiency of the proposed method is assessed for both total and relative correlation energies. We show that the non-iterative correction can fulfill two separate roles. If the accuracy level of a fraction of kJ/mol is sufficient for a given system, the correction significantly reduces the dimension of the parent triple excitation subspace needed in the iterative part of the calculations. Simultaneously, it enables reproducing the exact CCSDT results to an accuracy level below 0.1 kJ/mol, with a larger, yet still reasonable, dimension of the parent excitation subspace. This typically can be achieved at a computational cost only several times larger than required for the CCSD(T) method. The proposed method retains the black-box features of the single-reference coupled-cluster theory; the dimension of the parent excitation subspace remains the only additional parameter that has to be specified.

A Massively Parallel Implementation of the CCSD(T) Method Using the Resolution-of-the-Identity Approximation and a Hybrid Distributed/Shared Memory Parallelization Model

A parallel algorithm is described for the coupled-cluster singles and doubles method augmented with a perturbative correction for triple excitations [CCSD(T)] using the resolution-of-the-identity (RI) approximation for two-electron repulsion integrals (ERIs). The algorithm bypasses the storage of four-center ERIs by adopting an integral-direct strategy. The CCSD amplitude equations are given in a compact quasi-linear form by factorizing them in terms of amplitude-dressed three-center intermediates. A hybrid MPI/OpenMP parallelization scheme is employed, which uses the OpenMP-based shared memory model for intranode parallelization and the MPI-based distributed memory model for internode parallelization. Parallel efficiency has been optimized for all terms in the CCSD amplitude equations. Two different algorithms have been implemented for the rate-limiting terms in the CCSD amplitude equations that entail O(NO2NV4) and O(NO3NV3)-scaling computational costs, where N_O and N_V denote the number of correlated occupied and virtual orbitals, respectively. One of the algorithms assembles the four-center ERIs requiring N_V⁴ and N_O²N_V²-scaling memory costs in a distributed manner on a number of MPI ranks, while the other algorithm completely bypasses the assembling of quartic memory-scaling ERIs and thus largely reduces the memory demand. It is demonstrated that the former memory-expensive algorithm is faster on a few hundred cores, while the latter memory-economic algorithm shows a better strong scaling in the limit of a few thousand cores. The program is shown to exhibit a near-linear scaling, in particular for the compute-intensive triples correction step, on up to 8000 cores. The performance of the program is demonstrated via calculations involving molecules with 24-51 atoms and up to 1624 atomic basis functions. As the first application, the complete basis set (CBS) limit for the interaction energy of the π-stacked uracil dimer from the S66 data set has been investigated. This work reports the first calculation of the interaction energy at the CCSD(T)/aug-cc-pVQZ level without local orbital approximation. The CBS limit for the CCSD correlation contribution to the interaction energy was found to be -8.01 kcal/mol, which agrees very well with the value -7.99 kcal/mol reported by Schmitz, Hättig, and Tew [ Phys. Chem. Chem. Phys. 2014, 16, 22167-22178]. The CBS limit for the total interaction energy was estimated to be -9.64 kcal/mol.

Robust Approximation of Tensor Networks: Application to Grid-Free Tensor Factorization of the Coulomb Interaction

Approximation of a tensor network by approximating (e.g., factorizing) one or more of its constituent tensors can be improved by canceling the leading-order error due to the constituents' approximation. The utility of such robust approximation is demonstrated for robust canonical polyadic (CP) approximation of a (density-fitting) factorized two-particle Coulomb interaction tensor. The resulting algebraic (grid-free) approximation for the Coulomb tensor, closely related to the factorization appearing in pseudospectral and tensor hypercontraction approaches, is efficient and accurate, with significantly reduced rank compared to the naive (nonrobust) approximation. Application of the robust approximation to the particle-particle ladder term in the coupled-cluster singles and doubles reduces the size complexity from O (N⁶) to O (N⁵) with robustness ensuring negligible errors in chemically relevant energy differences using CP ranks approximately equal to the size of the density-fitting basis.

A critical analysis of least-squares tensor hypercontraction applied to MP3

The least-squares tensor hypercontraction (LS-THC) approach is a promising method of reducing the high polynomial scaling of wavefunction methods, for example, those based on many-body perturbation theory or coupled cluster. Here, we focus on LS-THC-MP3 and identify four variants with differing errors and efficiency characteristics. The performance of LS-THC-MP3 is analyzed for regular test systems with up to 40 first-row atoms. We also analyze the size-extensivity/size-consistency and grid- and basis set dependence of LS-THC-MP3. Overall, the errors observed are favorably small in comparison with standard density fitting, and a more streamlined method of generating grids via pruning is suggested. A practical crossover (the point at which LS-THC-MP3 is cheaper than the canonical method) is achieved around 240 correlated electrons. Despite several drawbacks of LS-THC that have been identified: an initial non-linearity of error when increasing system size, poor description of angular correlation, and a potentially large increase in error with the basis set size, the results show that LS-THC has significant potential for practical application to MP3 and other wavefunction methods.

A straightforward a posteriori method for reduction of density-fitting error in coupled-cluster calculations

We present a simple method for a posteriori removal of a significant fraction of the density-fitting error from the calculated total coupled-cluster energies. The method treats the difference between the exact and density-fitted integrals as a perturbation, and simplified response-like equations allow us to calculate improved amplitudes and the corresponding energy correction. The proposed method is tested at the coupled-cluster singles and doubles level of theory for a diverse set of moderately-sized molecules. On average, error reductions by a factor of approximately 10 and 20 are observed in double-zeta and triple-zeta basis sets, respectively. Similar reductions are observed in calculations of interaction energies of several model complexes. The computational cost of the procedure is small in comparison with the preceding coupled-cluster iterations. The applicability of this method is not limited to the density-fitting approximation; in principle, it can be used in conjunction with an arbitrary decomposition scheme of the electron repulsion integrals.

Wavepacket dynamics and the multi-configurational time-dependent Hartree approach

Multi-configurational time-dependent Hartree (MCTDH) based approaches are efficient, accurate, and versatile methods for high-dimensional quantum dynamics simulations. Applications range from detailed investigations of polyatomic reaction processes in the gas phase to high-dimensional simulations studying the dynamics of condensed phase systems described by typical solid state physics model Hamiltonians. The present article presents an overview of the different areas of application and provides a comprehensive review of the underlying theory. The concepts and guiding ideas underlying the MCTDH approach and its multi-mode and multi-layer extensions are discussed in detail. The general structure of the equations of motion is highlighted. The representation of the Hamiltonian and the correlated discrete variable representation (CDVR), which provides an efficient multi-dimensional quadrature in MCTDH calculations, are discussed. Methods which facilitate the calculation of eigenstates, the evaluation of correlation functions, and the efficient representation of thermal ensembles in MCTDH calculations are described. Different schemes for the treatment of indistinguishable particles in MCTDH calculations and recent developments towards a unified multi-layer MCTDH theory for systems including bosons and fermions are discussed.

A systematic way for the cost reduction of density fitting methods

We present a simple approach for the reduction of the size of auxiliary basis sets used in methods exploiting the density fitting (resolution of identity) approximation for electron repulsion integrals. Starting out of the singular value decomposition of three-center two-electron integrals, new auxiliary functions are constructed as linear combinations of the original fitting functions. The new functions, which we term natural auxiliary functions (NAFs), are analogous to the natural orbitals widely used for the cost reduction of correlation methods. The use of the NAF basis enables the systematic truncation of the fitting basis, and thereby potentially the reduction of the computational expenses of the methods, though the scaling with the system size is not altered. The performance of the new approach has been tested for several quantum chemical methods. It is demonstrated that the most pronounced gain in computational efficiency can be expected for iterative models which scale quadratically with the size of the fitting basis set, such as the direct random phase approximation. The approach also has the promise of accelerating local correlation methods, for which the processing of three-center Coulomb integrals is a bottleneck.

Symmetric tensor decomposition description of fermionic many-body wave functions

The configuration interaction (CI) is a versatile wave function theory for interacting fermions, but it involves an extremely long CI series. Using a symmetric tensor decomposition method, we convert the CI series into a compact and numerically tractable form. The converted series encompasses the Hartree-Fock state in the first term and rapidly converges to the full-CI state, as numerically tested by using small molecules. Provided that the length of the symmetric tensor decomposition CI series grows only moderately with the increasing complexity of the system, the new method will serve as one of the alternative variational methods to achieve full CI with enhanced practicability.

Resolutions of the Coulomb operator. VI. Computation of auxiliary integrals

We discuss the efficient computation of the auxiliary integrals that arise when resolutions of two-electron operators (specifically, the Coulomb operator [T. Limpanuparb, A. T. B. Gilbert, and P. M. W. Gill, J. Chem. Theory Comput. 7, 830 (2011)] and the long-range Ewald operator [T. Limpanuparb and P. M. W. Gill, J. Chem. Theory Comput. 7, 2353 (2011)]) are employed in quantum chemical calculations. We derive a recurrence relation that facilitates the generation of auxiliary integrals for Gaussian basis functions of arbitrary angular momentum and propose a near-optimal algorithm for its use.