Inhomogeneous backflow transformations in quantum Monte Carlo calculations

Beyond Single-Reference Fixed-Node Approximation in Ab Initio Diffusion Monte Carlo Using Antisymmetrized Geminal Power Applied to Systems with Hundreds of Electrons

Diffusion Monte Carlo (DMC) is an exact technique to project out the ground state (GS) of a Hamiltonian. Since the GS is always bosonic, in Fermionic systems, the projection needs to be carried out while imposing antisymmetric constraints, which is a nondeterministic polynomial hard problem. In practice, therefore, the application of DMC on electronic structure problems is made by employing the fixed-node (FN) approximation, consisting of performing DMC with the constraint of having a fixed, predefined nodal surface. How do we get the nodal surface? The typical approach, applied in systems having up to hundreds or even thousands of electrons, is to obtain the nodal surface from a preliminary mean-field approach (typically, a density functional theory calculation) used to obtain a single Slater determinant. This is known as single reference. In this paper, we propose a new approach, applicable to systems as large as the C60 fullerene, which improves the nodes by going beyond the single reference. In practice, we employ an implicitly multireference ansatz (antisymmetrized geminal power wave function constraint with molecular orbitals), initialized on the preliminary mean-field approach, which is relaxed by optimizing a few parameters of the wave function determining the nodal surface by minimizing the FN-DMC energy. We highlight the improvements of the proposed approach over the standard single-reference method on several examples and, where feasible, the computational gain over the standard multireference ansatz, which makes the methods applicable to large systems. We also show that physical properties relying on relative energies, such as binding energies, are affordable and reliable within the proposed scheme.

Toward Large-Scale AFQMC Calculations: Large Time Step Auxiliary-Field Quantum Monte Carlo

We report modifications of the ph-AFQMC algorithm that allow the use of large time steps and reliable time step extrapolation. Our modified algorithm eliminates size-consistency errors present in the standard algorithm when large time steps are employed. We investigate various methods to approximate the exponential of the one-body operator within the AFQMC framework, distinctly demonstrating the superiority of Krylov methods over the conventional Taylor expansion. We assess various propagators within AFQMC and demonstrate that the Split-2 propagator is the optimal method, exhibiting the smallest time-step errors. For the HEAT set molecules, the time-step extrapolated energies deviate on average by only 0.19 kcal/mol from the accurate small time-step energies. For small water clusters, we obtain accurate complete basis-set binding energies using time-step extrapolation with a mean absolute error of 0.07 kcal/mol compared to CCSD(T). Using large time-step ph-AFQMC for the N2 dimer, we show that accurate bond lengths can be obtained while reducing CPU time by an order of magnitude.

Toward Real Chemical Accuracy on Current Quantum Hardware Through the Transcorrelated Method

Quantum computing is emerging as a new computational paradigm with the potential to transform several research fields including quantum chemistry. However, current hardware limitations (including limited coherence times, gate infidelities, and connectivity) hamper the implementation of most quantum algorithms and call for more noise-resilient solutions. We propose an explicitly correlated Ansatz based on the transcorrelated (TC) approach to target these major roadblocks directly. This method transfers, without any approximation, correlations from the wave function directly into the Hamiltonian, thus reducing the resources needed to achieve accurate results with noisy quantum devices. We show that the TC approach allows for shallower circuits and improves the convergence toward the complete basis set limit, providing energies within chemical accuracy to experiment with smaller basis sets and, thus, fewer qubits. We demonstrate our method by computing bond lengths, dissociation energies, and vibrational frequencies close to experimental results for the hydrogen dimer and lithium hydride using two and four qubits, respectively. To demonstrate our approach's current and near-term potential, we perform hardware experiments, where our results confirm that the TC method paves the way toward accurate quantum chemistry calculations already on today's quantum hardware.

Enhanced Twist-Averaging Technique for Magnetic Metals: Applications Using Quantum Monte Carlo

We propose an improved twist-averaging (TA) scheme for quantum Monte Carlo methods that use converged Kohn-Sham or Hartree-Fock orbitals as the reference. This TA technique is tailored to sample the Brillouin zone of magnetic metals, although it naturally extends to nonmagnetic (NM) conducting systems. The proposed scheme aims to reproduce the reference magnetization and achieves charge neutrality by construction, thus avoiding the large energy fluctuations and the postprocessing needed to correct the energies. It shows the most robust convergence of total energy and magnetism to the thermodynamic limit (TDL) when compared to four other TA schemes. Diffusion Monte Carlo applications are shown on NM Al and ferromagnetic α-Fe. The cohesive energy of Al in the TDL shows an excellent agreement with the experimental result. Furthermore, the magnetic moments in α-Fe exhibit rapid convergence with an increasing number of twists.

A Nonstochastic Optimization Algorithm for Neural-Network Quantum States

Neural-network quantum states (NQS) employ artificial neural networks to encode many-body wave functions in a second quantization through variational Monte Carlo (VMC). They have recently been applied to accurately describe electronic wave functions of molecules and have shown the challenges in efficiency compared with traditional quantum chemistry methods. Here, we introduce a general nonstochastic optimization algorithm for NQS in chemical systems, which deterministically generates a selected set of important configurations simultaneously with energy evaluation of NQS. This method bypasses the need for Markov-chain Monte Carlo within the VMC framework, thereby accelerating the entire optimization process. Furthermore, this newly developed nonstochastic optimization algorithm for NQS offers comparable or superior accuracy compared to its stochastic counterpart and ensures more stable convergence. The application of this model to test molecules exhibiting strong electron correlations provides further insight into the performance of NQS in chemical systems and opens avenues for future enhancements.

Highly Accurate Electronic Structure of Metallic Solids from Coupled-Cluster Theory with Nonperturbative Triple Excitations

Coupled-cluster theory with single, double, and perturbative triple excitations (CCSD(T))-often considered the "gold standard" of main-group quantum chemistry-is inapplicable to three-dimensional metals due to an infrared divergence, preventing its application to many important problems in materials science. We study the full, nonperturbative inclusion of triple excitations (CCSDT) and propose a new, iterative method, which we call ring-CCSDT, that resums the essential triple excitations with the same N^{7} run-time scaling as CCSD(T). CCSDT and ring-CCSDT are used to calculate the correlation energy of the uniform electron gas at metallic densities and the structural properties of solid lithium. Inclusion of connected triple excitations is shown to be essential to achieving high accuracy. We also investigate semiempirical CC methods based on spin-component scaling and the distinguishable cluster approximation and find that they enhance the accuracy of their parent ab initio methods.

Averting the Infrared Catastrophe in the Gold Standard of Quantum Chemistry

Coupled-cluster theories can be used to compute ab initio electronic correlation energies of real materials with systematically improvable accuracy. However, the widely used coupled cluster singles and doubles plus perturbative triples [CCSD(T)] method is only applicable to insulating materials. For zero-gap materials the truncation of the underlying many-body perturbation expansion leads to an infrared catastrophe. Here, we present a novel perturbative triples formalism denoted as (cT) that yields convergent correlation energies in metallic systems. Furthermore, the computed correlation energies for the three-dimensional uniform electron gas at metallic densities are in good agreement with quantum Monte Carlo results. At the same time the newly proposed method retains all desirable properties of CCSD(T) such as its accuracy for insulating systems as well as its low computational cost compared to a full inclusion of the triples. This paves the way for ab initio calculations of real metals with chemical accuracy.

Locality error free effective core potentials for 3d transition metal elements developed for the diffusion Monte Carlo method

Pseudopotential locality errors have hampered the applications of the diffusion Monte Carlo (DMC) method in materials containing transition metals, in particular oxides. We have developed locality error free effective core potentials, pseudo-Hamiltonians, for transition metals ranging from Cr to Zn. We have modified a procedure published by some of us in Bennett et al. [J. Chem. Theory Comput. 18, 828 (2022)]. We carefully optimized our pseudo-Hamiltonians and achieved transferability errors comparable to the best semilocal pseudopotentials used with DMC but without incurring in locality errors. Our pseudo-Hamiltonian set (named OPH23) bears the potential to significantly improve the accuracy of many-body-first-principles calculations in fundamental science research of complex materials involving transition metals.

A Quantum Monte Carlo Study of the Structural, Energetic, and Magnetic Properties of Two-Dimensional H and T Phase VSe2

Previous works have controversially claimed near-room-temperature ferromagnetism in two-dimensional (2D) VSe₂, with conflicting results throughout the literature. These discrepancies in magnetic properties between both phases (T and H) of 2D VSe₂ are most likely due to the structural parameters being coupled to the magnetic properties. Specifically, both phases have a close lattice match and similar total energies, which makes it difficult to determine which phase is being observed experimentally. In this study, we used a combination of density functional theory, highly accurate diffusion Monte Carlo (DMC), and a surrogate Hessian line-search optimization technique to resolve the previously reported discrepancy in structural parameters and relative phase stability. With DMC accuracy, we determined the free-standing geometry of both phases and constructed a phase diagram. Our findings demonstrate the successes of the DMC method coupled with the surrogate Hessian structural optimization technique when applied to a 2D magnetic system.

Towards the ground state of molecules via diffusion Monte Carlo on neural networks

Diffusion Monte Carlo (DMC) based on fixed-node approximation has enjoyed significant developments in the past decades and become one of the go-to methods when accurate ground state energy of molecules and materials is needed. However, the inaccurate nodal structure hinders the application of DMC for more challenging electronic correlation problems. In this work, we apply the neural-network based trial wavefunction in fixed-node DMC, which allows accurate calculations of a broad range of atomic and molecular systems of different electronic characteristics. Our method is superior in both accuracy and efficiency compared to state-of-the-art neural network methods using variational Monte Carlo (VMC). We also introduce an extrapolation scheme based on the empirical linearity between VMC and DMC energies, and significantly improve our binding energy calculation. Overall, this computational framework provides a benchmark for accurate solutions of correlated electronic wavefunction and also sheds light on the chemical understanding of molecules.

Systematic DFT+U and Quantum Monte Carlo Benchmark of Magnetic Two-Dimensional (2D) CrX3 (X = I, Br, Cl, F)

The search for two-dimensional (2D) magnetic materials has attracted a great deal of attention because of the experimental synthesis of 2D CrI₃, which has a measured Curie temperature of 45 K. Often times, these monolayers have a higher degree of electron correlation and require more sophisticated methods beyond density functional theory (DFT). Diffusion Monte Carlo (DMC) is a correlated electronic structure method that has been demonstrated to be successful for calculating the electronic and magnetic properties of a wide variety of 2D and bulk systems, since it has a weaker dependence on the Hubbard parameter (U) and density functional. In this study, we designed a workflow that combines DFT +U and DMC in order to treat 2D correlated magnetic systems. We chose monolayer CrX₃ (X = I, Br, Cl, F), with a stronger focus on CrI₃ and CrBr₃, as a case study due to the fact that they have been experimentally realized and have a finite critical temperature. With this DFT+U and DMC workflow and the analytical method of Torelli and Olsen, we estimated a maximum value of 43.56 K for the T_c of CrI₃ and 20.78 K for the T_c of CrBr₃, in addition to analyzing the spin densities and magnetic properties with DMC and DFT+U. We expect that running this workflow for a well-known material class will aid in the future discovery and characterization of lesser known and more complex correlated 2D magnetic materials.

Ab initio calculation of real solids via neural network ansatz

Neural networks have been applied to tackle many-body electron correlations for small molecules and physical models in recent years. Here we propose an architecture that extends molecular neural networks with the inclusion of periodic boundary conditions to enable ab initio calculation of real solids. The accuracy of our approach is demonstrated in four different types of systems, namely the one-dimensional periodic hydrogen chain, the two-dimensional graphene, the three-dimensional lithium hydride crystal, and the homogeneous electron gas, where the obtained results, e.g. total energies, dissociation curves, and cohesive energies, reach a competitive level with many traditional ab initio methods. Moreover, electron densities of typical systems are also calculated to provide physical intuition of various solids. Our method of extending a molecular neural network to periodic systems can be easily integrated into other neural network structures, highlighting a promising future of ab initio solution of more complex solid systems using neural network ansatz, and more generally endorsing the application of machine learning in materials simulation and condensed matter physics.

Quantum Monte Carlo Study of Positron Lifetimes in Solids

We present an analysis of positron lifetimes in solids with unprecedented depth. Instead of modeling correlation effects with density functionals, we study positron-electron wave functions with long-range correlations included. This gives new insight in understanding positron annihilation in metals, insulators, and semiconductors. By using a new quantum Monte Carlo approach for computation of positron lifetimes, an improved accuracy compared to previous computations is obtained for a representative set of materials when compared with experiment. Thus, we present a method without free parameters as a useful alternative to the already existing methods for modeling positrons in solids.

Solving the electronic Schrödinger equation for multiple nuclear geometries with weight-sharing deep neural networks

The Schrödinger equation describes the quantum-mechanical behaviour of particles, making it the most fundamental equation in chemistry. A solution for a given molecule allows computation of any of its properties. Finding accurate solutions for many different molecules and geometries is thus crucial to the discovery of new materials such as drugs or catalysts. Despite its importance, the Schrödinger equation is notoriously difficult to solve even for single molecules, as established methods scale exponentially with the number of particles. Combining Monte Carlo techniques with unsupervised optimization of neural networks was recently discovered as a promising approach to overcome this curse of dimensionality, but the corresponding methods do not exploit synergies that arise when considering multiple geometries. Here we show that sharing the vast majority of weights across neural network models for different geometries substantially accelerates optimization. Furthermore, weight-sharing yields pretrained models that require only a small number of additional optimization steps to obtain high-accuracy solutions for new geometries.

Making the most of data: Quantum Monte Carlo postanalysis revisited

In quantum Monte Carlo (QMC) methods, energy estimators are calculated as (functions of) statistical averages of quantities sampled during a calculation. Associated statistical errors of these averages are often estimated. This error estimation is not straightforward and there are several choices of the error estimation methods. We evaluate the performance of three methods (the Straatsma method, an autoregressive model, and a blocking analysis based on von Neumann's ratio test for randomness) for the energy time series given by three QMC methods [diffusion Monte Carlo, full configuration interaction Quantum Monte Carlo (FCIQMC), and coupled cluster Monte Carlo (CCMC)]. From these analyses, we describe a hybrid analysis method which provides reliable error estimates for a series of various lengths of FCIQMC and CCMC's time series. Equally important is the estimation of the appropriate start point of the equilibrated phase. We establish that a simple mean squared error rule method as described by White [K. P. White, Jr., Simulation 69(6), 323 (1997)10.1177/003754979706900601] can provide reasonable estimations.

Symmetric and antisymmetric kernels for machine learning problems in quantum physics and chemistry

We derive symmetric and antisymmetric kernels by symmetrizing and antisymmetrizing conventional kernels and analyze their properties. In particular, we compute the feature space dimensions of the resulting polynomial kernels, prove that the reproducing kernel Hilbert spaces induced by symmetric and antisymmetric Gaussian kernels are dense in the space of symmetric and antisymmetric functions, and propose a Slater determinant representation of the antisymmetric Gaussian kernel, which allows for an efficient evaluation even if the state space is high-dimensional. Furthermore, we show that by exploiting symmetries or antisymmetries the size of the training data set can be significantly reduced. The results are illustrated with guiding examples and simple quantum physics and chemistry applications.

Quasiparticle Effective Mass of the Three-Dimensional Fermi Liquid by Quantum Monte Carlo

According to Landau's Fermi liquid theory, the main properties of the quasiparticle excitations of an electron gas are embodied in the effective mass m^{*}, which determines the energy of a single quasiparticle, and the Landau interaction function, which indicates how the energy of a quasiparticle is modified by the presence of other quasiparticles. This simple paradigm underlies most of our current understanding of the physical and chemical behavior of metallic systems. The quasiparticle effective mass of the three-dimensional homogeneous electron gas has been the subject of theoretical controversy, and there is a lack of experimental data. In this Letter, we deploy diffusion Monte Carlo (DMC) methods to calculate m^{*} as a function of density for paramagnetic and ferromagnetic three-dimensional homogeneous electron gases. The DMC results indicate that m^{*} decreases when the density is reduced, especially in the ferromagnetic case. The DMC quasiparticle energy bands exclude the possibility of a reduction in the occupied bandwidth relative to that of the free-electron model at density parameter r_{s}=4, which corresponds to Na metal.

Toward quantum Monte Carlo forces on heavier ions: Scaling properties

Quantum Monte Carlo (QMC) forces have been studied extensively in recent decades because of their importance with spectroscopic observables and geometry optimization. Here, we benchmark the accuracy and computational cost of QMC forces. The zero-variance zero-bias (ZVZB) force estimator is used in standard variational and diffusion Monte Carlo simulations with mean-field based trial wavefunctions and atomic pseudopotentials. Statistical force uncertainties are obtained with a recently developed regression technique for heavy tailed QMC data [P. Lopez Rios and G. J. Conduit, Phys. Rev. E 99, 063312 (2019)]. By considering selected atoms and dimers with elements ranging from H to Zn (1 ≤ Z_eff ≤ 20), we assess the accuracy and the computational cost of ZVZB forces as the effective pseudopotential valence charge, Z_eff, increases. We find that the costs of QMC energies and forces approximately follow simple power laws in Z_eff. The force uncertainty grows more rapidly, leading to a best case cost scaling relationship of approximately Z_eff ^6.5(3) for diffusion Monte Carlo. We find that the accessible system size at fixed computational cost scales as Z_eff ^-2, insensitive to model assumptions or the use of the "space warp" variance-reduction technique. Our results predict the practical cost of obtaining forces for a range of materials, such as transition metal oxides where QMC forces have yet to be applied, and underscore the importance of further developing force variance-reduction techniques, particularly for atoms with high Z_eff.

Convergence to the fixed-node limit in deep variational Monte Carlo

Variational quantum Monte Carlo (QMC) is an ab initio method for solving the electronic Schrödinger equation that is exact in principle, but limited by the flexibility of the available Ansätze in practice. The recently introduced deep QMC approach, specifically two deep-neural-network Ansätze PauliNet and FermiNet, allows variational QMC to reach the accuracy of diffusion QMC, but little is understood about the convergence behavior of such Ansätze. Here, we analyze how deep variational QMC approaches the fixed-node limit with increasing network size. First, we demonstrate that a deep neural network can overcome the limitations of a small basis set and reach the mean-field (MF) complete-basis-set limit. Moving to electron correlation, we then perform an extensive hyperparameter scan of a deep Jastrow factor for LiH and H₄ and find that variational energies at the fixed-node limit can be obtained with a sufficiently large network. Finally, we benchmark MF and many-body Ansätze on H₂O, increasing the fraction of recovered fixed-node correlation energy of single-determinant Slater-Jastrow-type Ansätze by half an order of magnitude compared to previous variational QMC results, and demonstrate that a single-determinant Slater-Jastrow-backflow version of the Ansatz overcomes the fixed-node limitations. This analysis helps understand the superb accuracy of deep variational Ansätze in comparison to the traditional trial wavefunctions at the respective level of theory and will guide future improvements of the neural-network architectures in deep QMC.

Quantifying electron-correlation effects in small coinage-metal clusters via ab initio calculations

We investigate many-electron correlation effects in neutral and charged coinage-metal clusters Cun, Agn, and Aun (n = 1-4) via ab initio calculations using fixed-node diffusion Monte Carlo (FN-DMC) simulations, density functional theory (DFT), and the Hartree-Fock (HF) method. From very accurate FN-DMC total energies of the clusters and the HF results in the infinity large complete-basis-set limit, we obtain correlation energies in these strongly correlated many-electron clusters involving d orbitals. The obtained bond lengths of the clusters, atomic binding and dissociation energies, ionization potentials, and electron affinities are in satisfactory agreement with the available experiments. In the analysis, the electron correlation effects on these observable physical quantities are quantified by relative correlation contributions determined by the difference between the calculated FN-DMC and HF results. We show that the correlation contribution is not only significant for the quantities related to electronic structures of the coinage-metal clusters, such as electron affinity, but it is also essential for the stability of the atomic structures of these clusters. For example, the electron correlation contribution is responsible for more than 90% of the atomic binding energies of the small neutral copper clusters. We also demonstrate the orbital-occupation dependence of the correlation energy and electron pairing of the valence electrons in these coinage-metal clusters from the electron correlation-energy gain and spin-multiplicity change in the electron addition processes, which are reflected in their ionization potentials and electron affinities.

Tail-regression estimator for heavy-tailed distributions of known tail indices and its application to continuum quantum Monte Carlo data

Standard statistical analysis is unable to provide reliable confidence intervals on expectation values of probability distributions that do not satisfy the conditions of the central limit theorem. We present a regression-based estimator of an arbitrary moment of a probability distribution with power-law heavy tails that exploits knowledge of the exponents of its asymptotic decay to bypass this issue entirely. Our method is applied to synthetic data and to energy and atomic force data from variational and diffusion quantum Monte Carlo calculations, whose distributions have known asymptotic forms [J. R. Trail, Phys. Rev. E 77, 016703 (2008)PLEEE81539-375510.1103/PhysRevE.77.016703; A. Badinski et al., J. Phys.: Condens. Matter 22, 074202 (2010)JCOMEL0953-898410.1088/0953-8984/22/7/074202]. We obtain convergent, accurate confidence intervals on the variance of the local energy of an electron gas and on the Hellmann-Feynman force on an atom in the all-electron carbon dimer. In each of these cases the uncertainty on our estimator is 45% and 60 times smaller, respectively, than the nominal (ill-defined) standard error.

Backflow Transformations via Neural Networks for Quantum Many-Body Wave Functions

Obtaining an accurate ground state wave function is one of the great challenges in the quantum many-body problem. In this Letter, we propose a new class of wave functions, neural network backflow (NNB). The backflow approach, pioneered originally by Feynman and Cohen [Phys. Rev. 102, 1189 (1956)10.1103/PhysRev.102.1189], adds correlation to a mean-field ground state by transforming the single-particle orbitals in a configuration-dependent way. NNB uses a feed-forward neural network to learn the optimal transformation via variational Monte Carlo calculations. NNB directly dresses a mean-field state, can be systematically improved, and directly alters the sign structure of the wave function. It generalizes the standard backflow [L. F. Tocchio et al., Phys. Rev. B 78, 041101(R) (2008)10.1103/PhysRevB.78.041101], which we show how to explicitly represent as a NNB. We benchmark the NNB on Hubbard models at intermediate doping, finding that it significantly decreases the relative error, restores the symmetry of both observables and single-particle orbitals, and decreases the double-occupancy density. Finally, we illustrate interesting patterns in the weights and bias of the optimized neural network.

Nonlinear Network Description for Many-Body Quantum Systems in Continuous Space

We show that the recently introduced iterative backflow wave function can be interpreted as a general neural network in continuum space with nonlinear functions in the hidden units. Using this wave function in variational Monte Carlo simulations of liquid ^{4}He in two and three dimensions, we typically find a tenfold increase in accuracy over currently used wave functions. Furthermore, subsequent stages of the iteration procedure define a set of increasingly good wave functions, each with its own variational energy and variance of the local energy: extrapolation to zero variance gives energies in close agreement with the exact values. For two dimensional ^{4}He, we also show that the iterative backflow wave function can describe both the liquid and the solid phase with the same functional form-a feature shared with the shadow wave function, but now joined by much higher accuracy. We also achieve significant progress for liquid ^{3}He in three dimensions, improving previous variational and fixed-node energies.

QMCPACK: an open source ab initio quantum Monte Carlo package for the electronic structure of atoms, molecules and solids

QMCPACK is an open source quantum Monte Carlo package for ab initio electronic structure calculations. It supports calculations of metallic and insulating solids, molecules, atoms, and some model Hamiltonians. Implemented real space quantum Monte Carlo algorithms include variational, diffusion, and reptation Monte Carlo. QMCPACK uses Slater-Jastrow type trial wavefunctions in conjunction with a sophisticated optimizer capable of optimizing tens of thousands of parameters. The orbital space auxiliary-field quantum Monte Carlo method is also implemented, enabling cross validation between different highly accurate methods. The code is specifically optimized for calculations with large numbers of electrons on the latest high performance computing architectures, including multicore central processing unit and graphical processing unit systems. We detail the program's capabilities, outline its structure, and give examples of its use in current research calculations. The package is available at http://qmcpack.org.