Artificial Neural Networks Applied as Molecular Wave Function Solvers

Bridging the Gap between Transformer-Based Neural Networks and Tensor Networks for Quantum Chemistry

The neural network quantum state (NNQS) method has demonstrated promising results in ab initio quantum chemistry, achieving remarkable accuracy in molecular systems. However, efficient calculation of systems with large active spaces remains challenging. This study introduces a novel approach that bridges tensor network states with the transformer-based NNQS-Transformer (QiankunNet) to enhance accuracy and convergence for systems with relatively large active spaces. By transforming tensor network states into active space configuration interaction type wave functions, QiankunNet achieves accuracy surpassing both the pretraining density matrix renormalization group (DMRG) results and traditional coupled cluster methods, particularly in strongly correlated regimes. We investigate two configuration transformation methods: the sweep-based direct conversion (Conv.) method and the entanglement-driven genetic algorithm (EDGA) method, with Conv. showing superior efficiency. The effectiveness of this approach is validated on H2O with a large active space (10e, 24o) in the cc-pVDZ basis set, demonstrating an efficient routine between DMRG and QiankunNet and also offering a promising direction for advancing quantum state representation in complex molecular systems.

Transferability Across Different Molecular Systems and Levels of Theory with the Data-Driven Coupled-Cluster Scheme

Machine learning has recently been introduced into the arsenal of tools that are available to computational chemists. In the past few years, we have seen an increase in the applicability of these tools on a plethora of applications, including the automated exploration of a large fraction of the chemical space, the reduction of repetitive computational tasks, the detection of outliers on large databases, and the acceleration of molecular simulations. An attractive application of machine learning in molecular electronic structure theory is the "recycling" of molecular wave functions for faster and more accurate completion of complex quantum chemical calculations. Along these lines, we have developed hybrid quantum chemical/machine learning workflows that utilize information from low-level wave functions for the accurate prediction of higher-level wave functions. The data-driven coupled-cluster (DDCC) family of methods is discussed in this article together with the importance of the inclusion of physical properties in such hybrid workflows. After a short introduction to the philosophy and the capabilities of DDCC, we present our recent progress in extending its applicability to larger and more complex molecular structures and data sets. A significant advantage offered by DDCC is its transferability, with respect to different molecular systems and different excitation levels. As we show here, predicted wave functions at the coupled-cluster singles and doubles level of theory can be used for the accurate prediction of the perturbative triples of the CCSD(T) scheme. We conclude with some personal considerations with respect to future directions related to the development of the next generation of such hybrid quantum chemical/machine learning models.

Machine Learning Force Field for Optimization of Isolated and Supported Transition Metal Particles

Computational modeling is an integral part of catalysis research. With it, new methodologies are being developed and implemented to improve the accuracy of simulations while reducing the computational cost. In particular, specific machine-learning techniques have been applied to build interatomic potential from ab initio results. Here, we report an energy-free machine-learning calculator that combines three individually trained neural networks to predict the energy and atomic forces of metallic particles. The investigated structures were a monometallic Pd nanoparticle, a bimetallic AuPd nanoalloy, and supported Pd metal crystallites on silica. Atomic energies were predicted via a graph neural network, leading to a mean absolute error (MAE) within 0.004 eV from density functional theory (DFT) calculations. The task of predicting atomic forces was split over two feed-forward networks, one predicting the force norm and another its direction. The force prediction resulted in a MAE within 0.080 eV/Å against DFT results. The interpretability of the graph neural network predictions was demonstrated by underlying the physics of the monometallic particle in the form of cohesion energy.

Interpolating numerically exact many-body wave functions for accelerated molecular dynamics

While there have been many developments in computational probes of both strongly-correlated molecular systems and machine-learning accelerated molecular dynamics, there remains a significant gap in capabilities in simulating accurate non-local electronic structure over timescales on which atoms move. We develop an approach to bridge these fields with a practical interpolation scheme for the correlated many-electron state through the space of atomic configurations, whilst avoiding the exponential complexity of these underlying electronic states. With a small number of accurate correlated wave functions as a training set, we demonstrate provable convergence to near-exact potential energy surfaces for subsequent dynamics with propagation of a valid many-body wave function and inference of its variational energy whilst retaining a mean-field computational scaling. This represents a profoundly different paradigm to the direct interpolation of potential energy surfaces in established machine-learning approaches. We combine this with modern electronic structure approaches to systematically resolve molecular dynamics trajectories and converge thermodynamic quantities with a high-throughput of several million interpolated wave functions with explicit validation of their accuracy from only a few numerically exact quantum chemical calculations. We also highlight the comparison to traditional machine-learned potentials or dynamics on mean-field surfaces.

Mott Transition and Volume Law Entanglement with Neural Quantum States

The interplay between delocalization and repulsive interactions can cause electronic systems to undergo a Mott transition between a metal and an insulator. Here we use neural network hidden fermion determinantal states (HFDS) to uncover this transition in the disordered, fully connected Hubbard model. While dynamical mean-field theory (DMFT) provides exact solutions to physical observables of the model in the thermodynamic limit, our method allows us to directly access the wave function for finite system sizes well beyond the reach of exact diagonalization. We demonstrate how HFDS are able to obtain more accurate results in the metallic regime and in the vicinity of the transition than calculations based on a matrix product state (MPS) ansatz, for which the volume law of entanglement exhibited by the system is prohibitive. We use the HFDS method to calculate the energy and double occupancy, the quasiparticle weight and the energy gap and, importantly, the amplitudes of the wave function that provide a novel insight into this model. Our work paves the way for the study of strongly correlated electron systems with neural quantum states.

Improved optimization for the neural-network quantum states and tests on the chromium dimer

The advent of Neural-network Quantum States (NQS) has significantly advanced wave function ansatz research, sparking a resurgence in orbital space variational Monte Carlo (VMC) exploration. This work introduces three algorithmic enhancements to reduce computational demands of VMC optimization using NQS: an adaptive learning rate algorithm, constrained optimization, and block optimization. We evaluate the refined algorithm on complex multireference bond stretches of H2O and N2 within the cc-pVDZ basis set and calculate the ground-state energy of the strongly correlated chromium dimer (Cr2) in the Ahlrichs SV basis set. Our results achieve superior accuracy compared to coupled cluster theory at a relatively modest CPU cost. This work demonstrates how to enhance optimization efficiency and robustness using these strategies, opening a new path to optimize large-scale restricted Boltzmann machine-based NQS more effectively and marking a substantial advancement in NQS's practical quantum chemistry applications.

Entanglement Generation of Polar Molecules via Deep Reinforcement Learning

Polar molecules are a promising platform for achieving scalable quantum information processing because of their long-range electric dipole-dipole interactions. Here, we take the coupled ultracold CaF molecules in an external electric field with gradient as qubits and concentrate on the creation of intermolecular entanglement with the method of deep reinforcement learning (RL). After sufficient training episodes, the educated RL agents can discover optimal time-dependent control fields that steer the molecular systems from separate states to two-qubit and three-qubit entangled states with high fidelities. We analyze the fidelities and the negativities (characterizing entanglement) of the generated states as a function of training episodes. Moreover, we present the population dynamics of the molecular systems under the influence of control fields discovered by the agents. Compared with the schemes for creating molecular entangled states based on optimal control theory, some conditions (e.g., molecular spacing and electric field gradient) adopted in this work are more feasible in the experiment. Our results demonstrate the potential of machine learning to effectively solve quantum control problems in polar molecular systems.

A Nonstochastic Optimization Algorithm for Neural-Network Quantum States

Neural-network quantum states (NQS) employ artificial neural networks to encode many-body wave functions in a second quantization through variational Monte Carlo (VMC). They have recently been applied to accurately describe electronic wave functions of molecules and have shown the challenges in efficiency compared with traditional quantum chemistry methods. Here, we introduce a general nonstochastic optimization algorithm for NQS in chemical systems, which deterministically generates a selected set of important configurations simultaneously with energy evaluation of NQS. This method bypasses the need for Markov-chain Monte Carlo within the VMC framework, thereby accelerating the entire optimization process. Furthermore, this newly developed nonstochastic optimization algorithm for NQS offers comparable or superior accuracy compared to its stochastic counterpart and ensures more stable convergence. The application of this model to test molecules exhibiting strong electron correlations provides further insight into the performance of NQS in chemical systems and opens avenues for future enhancements.

Machine Learning the Quantum Mechanical Wave Function

Strongly correlated systems have been challenging to computational chemists for a long time. To solve these systems, multireference methods have been developed over the years. Recently, with the fast development of machine learning and artificial intelligence methods, these methods have also influenced the quest for optimal wave function ansatz. Machine learning approaches have been used in many different flavors. From this perspective, we will discuss the different milestones achieved in the use of machine learning for solving the quantum many body problem.

Ab initio quantum chemistry with neural-network wavefunctions

Deep learning methods outperform human capabilities in pattern recognition and data processing problems and now have an increasingly important role in scientific discovery. A key application of machine learning in molecular science is to learn potential energy surfaces or force fields from ab initio solutions of the electronic Schrödinger equation using data sets obtained with density functional theory, coupled cluster or other quantum chemistry (QC) methods. In this Review, we discuss a complementary approach using machine learning to aid the direct solution of QC problems from first principles. Specifically, we focus on quantum Monte Carlo methods that use neural-network ansatzes to solve the electronic Schrödinger equation, in first and second quantization, computing ground and excited states and generalizing over multiple nuclear configurations. Although still at their infancy, these methods can already generate virtually exact solutions of the electronic Schrödinger equation for small systems and rival advanced conventional QC methods for systems with up to a few dozen electrons.

Synergy of semiempirical models and machine learning in computational chemistry

Catalyzed by enormous success in the industrial sector, many research programs have been exploring data-driven, machine learning approaches. Performance can be poor when the model is extrapolated to new regions of chemical space, e.g., new bonding types, new many-body interactions. Another important limitation is the spatial locality assumption in model architecture, and this limitation cannot be overcome with larger or more diverse datasets. The outlined challenges are primarily associated with the lack of electronic structure information in surrogate models such as interatomic potentials. Given the fast development of machine learning and computational chemistry methods, we expect some limitations of surrogate models to be addressed in the near future; nevertheless spatial locality assumption will likely remain a limiting factor for their transferability. Here, we suggest focusing on an equally important effort-design of physics-informed models that leverage the domain knowledge and employ machine learning only as a corrective tool. In the context of material science, we will focus on semi-empirical quantum mechanics, using machine learning to predict corrections to the reduced-order Hamiltonian model parameters. The resulting models are broadly applicable, retain the speed of semiempirical chemistry, and frequently achieve accuracy on par with much more expensive ab initio calculations. These early results indicate that future work, in which machine learning and quantum chemistry methods are developed jointly, may provide the best of all worlds for chemistry applications that demand both high accuracy and high numerical efficiency.

Can Neural Quantum States Learn Volume-Law Ground States?

We study whether neural quantum states based on multilayer feed-forward networks can find ground states which exhibit volume-law entanglement entropy. As a testbed, we employ the paradigmatic Sachdev-Ye-Kitaev model. We find that both shallow and deep feed-forward networks require an exponential number of parameters in order to represent the ground state of this model. This demonstrates that sufficiently complicated quantum states, although being physical solutions to relevant models and not pathological cases, can still be difficult to learn to the point of intractability at larger system sizes. Hence, the variational neural network approach offers no benefits over exact diagonalization methods in this case. This highlights the importance of further investigations into the physical properties of quantum states amenable to an efficient neural representation.

Data-Driven Refinement of Electronic Energies from Two-Electron Reduced-Density-Matrix Theory

The exponential computational cost of describing strongly correlated electrons can be mitigated by adopting a reduced-density matrix (RDM)-based description of the electronic structure. While variational two-electron RDM (v2RDM) methods can enable large-scale calculations on such systems, the quality of the solution is limited by the fact that only a subset of known necessary N-representability constraints can be applied to the 2RDM in practical calculations. Here, we demonstrate that violations of partial three-particle (T1 and T2) N-representability conditions, which can be evaluated with knowledge of only the 2RDM, can serve as physics-based features in a machine-learning (ML) protocol for improving energies from v2RDM calculations that consider only two-particle (PQG) conditions. Proof-of-principle calculations demonstrate that the model yields substantially improved energies relative to reference values from configuration-interaction-based calculations.

Data-driven approach for benchmarking DFTB-approximate excited state methods

In this work we propose a chemically-informed data-driven approach to benchmark the approximate density-functional tight-binding (DFTB) excited state (ES) methods that are currently available within the DFTB+ suite. By taking advantage of the large volume of low-detail ES-data in the machine learning (ML) dataset, QM8, we were able to extract valuable insights regarding the limitations of the benchmarked methods in terms of the approximations made to the parent formalism, density-functional theory (DFT), while providing recommendations on how to overcome them. For this benchmark, we compared the first singlet-singlet vertical excitation energies (E₁) predicted by the DFTB-approximate methods with predictions of less approximate methods from the reference ML-dataset. For the nearly 21800 organic molecules in the GDB-8 chemical space, we were able to identify clear trends in the E₁ prediction error distributions, with respect to second-order approximate coupled cluster (CC2), showing a strong dependence on chemical identity.

Machine learning, artificial intelligence, and chemistry: how smart algorithms are reshaping simulation and the laboratory

Machine learning and artificial intelligence are increasingly gaining in prominence through image analysis, language processing, and automation, to name a few applications. Machine learning is also making profound changes in chemistry. From revisiting decades-old analytical techniques for the purpose of creating better calibration curves, to assisting and accelerating traditional in silico simulations, to automating entire scientific workflows, to being used as an approach to deduce underlying physics of unexplained chemical phenomena, machine learning and artificial intelligence are reshaping chemistry, accelerating scientific discovery, and yielding new insights. This review provides an overview of machine learning and artificial intelligence from a chemist’s perspective and focuses on a number of examples of the use of these approaches in computational chemistry and in the laboratory.

A Ranked-Orbital Approach to Select Active Spaces for High-Throughput Multireference Computation

The past decade has seen a great increase in the application of high-throughput computation to a variety of important problems in chemistry. However, one area which has been resistant to the high-throughput approach is multireference wave function methods, in large part due to the technicalities of setting up these calculations and in particular the not always intuitive challenge of active space selection. As we look toward a future of applying high-throughput computation to all areas of chemistry, it is important to prepare these methods for large-scale automation. Here, we propose a ranked-orbital approach to select active spaces with the goal of standardizing multireference methods for high-throughput computation. This method allows for the meaningful comparison of different active space selection schemes and orbital localizations, and we demonstrate the utility of this approach across 1120 multireference calculations for the excitation energies of small molecules. Our results reveal that it is helpful to distinguish the method used to generate orbitals from the method of ranking orbitals in terms of importance for the active space. Additionally, we propose our own orbital ranking scheme that estimates the importance of an orbital for the active space through a pair-interaction framework from orbital energies and features of the Hartree-Fock exchange matrix. We call this new scheme the "approximate pair coefficient" (APC) method and we show that it performs quite well for the test systems presented.