CIDER: An Expressive, Nonlocal Feature Set for Machine Learning Density Functionals with Exact Constraints

Adapting hybrid density functionals with machine learning

Exact exchange contributions significantly affect electronic states, influencing covalent bond formation and breaking. Hybrid density functional approximations, which average exact exchange admixtures empirically, have achieved success but fall short of high-level quantum chemistry accuracy due to delocalization errors. We propose adaptive hybrid functionals, generating optimal exact exchange admixture ratios on the fly using data-efficient quantum machine learning models with negligible overhead. The adaptive Perdew-Burke-Ernzerhof hybrid density functional (aPBE0) improves energetics, electron densities, and HOMO-LUMO gaps in QM9, QM7b, and GMTKN55 benchmark datasets. A model uncertainty-based constraint reduces the method smoothly to PBE0 in extrapolative regimes, ensuring general applicability with limited training. By tuning exact exchange fractions for different spin states, aPBE0 effectively addresses the spin gap problem in open-shell systems such as carbenes. We also present a revised QM9 (revQM9) dataset with more accurate quantum properties, including stronger covalent binding, larger bandgaps, more localized electron densities, and larger dipole moments.

Introduction to machine learning potentials for atomistic simulations

Machine learning potentials have revolutionised the field of atomistic simulations in recent years and are becoming a mainstay in the toolbox of computational scientists. This paper aims to provide an overview and introduction into machine learning potentials and their practical application to scientific problems. We provide a systematic guide for developing machine learning potentials, reviewing chemical descriptors, regression models, data generation and validation approaches. We begin with an emphasis on the earlier generation of models, such as high-dimensional neural network potentials and Gaussian approximation potentials, to provide historical perspective and guide the reader towards the understanding of recent developments, which are discussed in detail thereafter. Furthermore, we refer to relevant expert reviews, open-source software, and practical examples-further lowering the barrier to exploring these methods. The paper ends with selected showcase examples, highlighting the capabilities of machine learning potentials and how they can be applied to push the boundaries in atomistic simulations.

Training Machine-Learned Density Functionals on Band Gaps

The systematic underestimation of band gaps is one of the most fundamental challenges in semilocal density functional theory (DFT). In addition to hindering the application of DFT to predicting electronic properties, the band gap problem is intimately related to self-interaction and delocalization errors, which make the study of charge transfer mechanisms with DFT difficult. To expand the range of available tools for addressing the band gap problem, we design an approach for machine learning density functionals based on Gaussian processes to explicitly fit single-particle energy levels. We also introduce nonlocal features of the density matrix that are expressive enough to fit these single-particle levels. Combining these developments, we train a machine-learned functional for the exact exchange energy that predicts molecular energy gaps and reaction energies of a wide range of molecules in excellent agreement with reference hybrid DFT calculations. In addition, while being trained solely on molecular data, our model predicts reasonable formation energies of polarons in solids, showcasing its transferability and robustness. We discuss how this approach can be generalized to full exchange-correlation functionals, thus paving the way to the design of state-of-the-art functionals for the prediction of electronic properties of molecules and materials.

Machine learning for accuracy in density functional approximations

Machine learning techniques have found their way into computational chemistry as indispensable tools to accelerate atomistic simulations and materials design. In addition, machine learning approaches hold the potential to boost the predictive power of computationally efficient electronic structure methods, such as density functional theory, to chemical accuracy and to correct for fundamental errors in density functional approaches. Here, recent progress in applying machine learning to improve the accuracy of density functional and related approximations is reviewed. Promises and challenges in devising machine learning models transferable between different chemistries and materials classes are discussed with the help of examples applying promising models to systems far outside their training sets.

Self-Consistent Convolutional Density Functional Approximations: Application to Adsorption at Metal Surfaces

The exchange-correlation (XC) functional in density functional theory is used to approximate multi-electron interactions. A plethora of different functionals are available, but nearly all are based on the hierarchy of inputs commonly referred to as "Jacob's ladder." This paper introduces an approach to construct XC functionals with inputs from convolutions of arbitrary kernels with the electron density, providing a route to move beyond Jacob's ladder. We derive the variational derivative of these functionals, showing consistency with the generalized gradient approximation (GGA), and provide equations for variational derivatives based on multipole features from convolutional kernels. A proof-of-concept functional, PBEq, which generalizes the PBE α ${\alpha }$ framework with α ${\alpha }$ being a spatially-resolved function of the monopole of the electron density, is presented and implemented. It allows a single functional to use different GGAs at different spatial points in a system, while obeying PBE constraints. Analysis of the results underlines the importance of error cancellation and the XC potential in data-driven functional design. After testing on small molecules, bulk metals, and surface catalysts, the results indicate that this approach is a promising route to simultaneously optimize multiple properties of interest.

Development of a machine learning finite-range nonlocal density functional

Kohn-Sham density functional theory has been the most popular method in electronic structure calculations. To fulfill the increasing accuracy requirements, new approximate functionals are needed to address key issues in existing approximations. It is well known that nonlocal components are crucial. Current nonlocal functionals mostly require orbital dependence such as in Hartree-Fock exchange and many-body perturbation correlation energy, which, however, leads to higher computational costs. Deviating from this pathway, we describe functional nonlocality in a new approach. By partitioning the total density to atom-centered local densities, a many-body expansion is proposed. This many-body expansion can be truncated at one-body contributions, if a base functional is used and an energy correction is approximated. The contribution from each atom-centered local density is a single finite-range nonlocal functional that is universal for all atoms. We then use machine learning to develop this universal atom-centered functional. Parameters in this functional are determined by fitting to data that are produced by high-level theories. Extensive tests on several different test sets, which include reaction energies, reaction barrier heights, and non-covalent interaction energies, show that the new functional, with only the density as the basic variable, can produce results comparable to the best-performing double-hybrid functionals, (for example, for the thermochemistry test set selected from the GMTKN55 database, BLYP based machine learning functional gives a weighted total mean absolute deviations of 3.33 kcal/mol, while DSD-BLYP-D3(BJ) gives 3.28 kcal/mol) with a lower computational cost. This opens a new pathway to nonlocal functional development and applications.

Machine Learning Density Functionals from the Random-Phase Approximation

Kohn-Sham density functional theory (DFT) is the standard method for first-principles calculations in computational chemistry and materials science. More accurate theories such as the random-phase approximation (RPA) are limited in application due to their large computational cost. Here, we use machine learning to map the RPA to a pure Kohn-Sham density functional. The machine learned RPA model (ML-RPA) is a nonlocal extension of the standard gradient approximation. The density descriptors used as ingredients for the enhancement factor are nonlocal counterparts of the local density and its gradient. Rather than fitting only RPA exchange-correlation energies, we also include derivative information in the form of RPA optimized effective potentials. We train a single ML-RPA functional for diamond, its surfaces, and liquid water. The accuracy of ML-RPA for the formation energies of 28 diamond surfaces reaches that of state-of-the-art van der Waals functionals. For liquid water, however, ML-RPA cannot yet improve upon the standard gradient approximation. Overall, our work demonstrates how machine learning can extend the applicability of the RPA to larger system sizes, time scales, and chemical spaces.

KineticNet: Deep learning a transferable kinetic energy functional for orbital-free density functional theory

Orbital-free density functional theory (OF-DFT) holds promise to compute ground state molecular properties at minimal cost. However, it has been held back by our inability to compute the kinetic energy as a functional of electron density alone. Here, we set out to learn the kinetic energy functional from ground truth provided by the more expensive Kohn-Sham density functional theory. Such learning is confronted with two key challenges: Giving the model sufficient expressivity and spatial context while limiting the memory footprint to afford computations on a GPU and creating a sufficiently broad distribution of training data to enable iterative density optimization even when starting from a poor initial guess. In response, we introduce KineticNet, an equivariant deep neural network architecture based on point convolutions adapted to the prediction of quantities on molecular quadrature grids. Important contributions include convolution filters with sufficient spatial resolution in the vicinity of nuclear cusp, an atom-centric sparse but expressive architecture that relays information across multiple bond lengths, and a new strategy to generate varied training data by finding ground state densities in the face of perturbations by a random external potential. KineticNet achieves, for the first time, chemical accuracy of the learned functionals across input densities and geometries of tiny molecules. For two-electron systems, we additionally demonstrate OF-DFT density optimization with chemical accuracy.

Nonlocal Functionals Inspired by the Strongly Interacting Limit of DFT: Exact Constraints and Implementation

Capturing strong correlation effects remains a key challenge for the development of improved exchange-correlation (XC) functionals in density functional theory. The recently proposed multiple radii functional (MRF) [J. Phys. Chem. Lett. 2017, 8, 2799; J. Chem. Theory Comput. 2019, 15, 3580] was designed to capture strong correlation effects seamlessly, as its mathematical structure draws from that of the exact XC functional in the limit of infinite correlations. The MRF functional provides a framework for building approximations along the density-fixed adiabatic connection, delivers accurate XC energy densities in the standard DFT gauge (same as that of the exact exchange energy density), and is free of one-electron self-interaction errors. To facilitate the development of XC functionals based on the MRF, we examine the behavior of the MRF functional when applied to uniform and scaled densities and consider how it can be made exact for the uniform electron gas. These theoretical insights are then used to build improved forms for the fluctuation function, an object that defines XC energy densities within the MRF framework. We also show how the MRF fluctuation function for physical correlation can be easily readjusted to accurately capture the XC functional in the limit of infinite correlations, demonstrating the versatility of MRF for building approximations for different correlation regimes. We describe the implementation of MRF using densities expanded on Gaussian basis sets, which improves the efficiency of previous grid-based MRF implementations.

Open-Source Machine Learning in Computational Chemistry

The field of computational chemistry has seen a significant increase in the integration of machine learning concepts and algorithms. In this Perspective, we surveyed 179 open-source software projects, with corresponding peer-reviewed papers published within the last 5 years, to better understand the topics within the field being investigated by machine learning approaches. For each project, we provide a short description, the link to the code, the accompanying license type, and whether the training data and resulting models are made publicly available. Based on those deposited in GitHub repositories, the most popular employed Python libraries are identified. We hope that this survey will serve as a resource to learn about machine learning or specific architectures thereof by identifying accessible codes with accompanying papers on a topic basis. To this end, we also include computational chemistry open-source software for generating training data and fundamental Python libraries for machine learning. Based on our observations and considering the three pillars of collaborative machine learning work, open data, open source (code), and open models, we provide some suggestions to the community.

The central role of density functional theory in the AI age

Density functional theory (DFT) plays a pivotal role in chemical and materials science because of its relatively high predictive power, applicability, versatility, and computational efficiency. We review recent progress in machine learning (ML) model developments, which have relied heavily on DFT for synthetic data generation and for the design of model architectures. The general relevance of these developments is placed in a broader context for chemical and materials sciences. DFT-based ML models have reached high efficiency, accuracy, scalability, and transferability and pave the way to the routine use of successful experimental planning software within self-driving laboratories.

The fourth-order expansion of the exchange hole and neural networks to construct exchange–correlation functionals

The curvature Q σ of spherically averaged exchange (X) holes ρX, σ(r, u) is one of the crucial variables for the construction of approximations to the exchange–correlation energy of Kohn–Sham theory, the most prominent example being the Becke–Roussel model [A. D. Becke and M. R. Roussel, Phys. Rev. A 39, 3761 (1989)]. Here, we consider the next higher nonzero derivative of the spherically averaged X hole, the fourth-order term T σ. This variable contains information about the nonlocality of the X hole and we employ it to approximate hybrid functionals, eliminating the sometimes demanding calculation of the exact X energy. The new functional is constructed using machine learning; having identified a physical correlation between T σ and the nonlocality of the X hole, we employ a neural network to express this relation. While we only modify the X functional of the Perdew–Burke–Ernzerhof functional [Perdew et al., Phys. Rev. Lett. 77, 3865 (1996)], a significant improvement over this method is achieved.