1
|
Wolpert DH, Korbel J, Lynn CW, Tasnim F, Grochow JA, Kardeş G, Aimone JB, Balasubramanian V, De Giuli E, Doty D, Freitas N, Marsili M, Ouldridge TE, Richa AW, Riechers P, Roldán É, Rubenstein B, Toroczkai Z, Paradiso J. Is stochastic thermodynamics the key to understanding the energy costs of computation? Proc Natl Acad Sci U S A 2024; 121:e2321112121. [PMID: 39471216 PMCID: PMC11551414 DOI: 10.1073/pnas.2321112121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2024] Open
Abstract
The relationship between the thermodynamic and computational properties of physical systems has been a major theoretical interest since at least the 19th century. It has also become of increasing practical importance over the last half-century as the energetic cost of digital devices has exploded. Importantly, real-world computers obey multiple physical constraints on how they work, which affects their thermodynamic properties. Moreover, many of these constraints apply to both naturally occurring computers, like brains or Eukaryotic cells, and digital systems. Most obviously, all such systems must finish their computation quickly, using as few degrees of freedom as possible. This means that they operate far from thermal equilibrium. Furthermore, many computers, both digital and biological, are modular, hierarchical systems with strong constraints on the connectivity among their subsystems. Yet another example is that to simplify their design, digital computers are required to be periodic processes governed by a global clock. None of these constraints were considered in 20th-century analyses of the thermodynamics of computation. The new field of stochastic thermodynamics provides formal tools for analyzing systems subject to all of these constraints. We argue here that these tools may help us understand at a far deeper level just how the fundamental thermodynamic properties of physical systems are related to the computation they perform.
Collapse
Affiliation(s)
- David H. Wolpert
- Santa Fe Institute, Santa Fe, NM87501
- Complexity Science Hub Vienna, Vienna1080, Austria
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ85287
- The Abdus Salam International Centre for Theoretical Physics, Trieste34151, Italy
- Albert Einstein Institute for Advanced Study in the Life Sciences, New York, NY10467
| | - Jan Korbel
- Complexity Science Hub Vienna, Vienna1080, Austria
- Institute for the Science of Complex Systems, Center for Medical Data Science (CeDAS), Medical University of Vienna, Vienna1090, Austria
| | - Christopher W. Lynn
- Center for the Physics of Biological Function, Princeton University, Princeton, NJ08544
- Center for the Physics of Biological Function, City University of New York, New York, NY10017
- Department of Physics, Yale University, New Haven, CT06520
| | | | - Joshua A. Grochow
- Department of Computer Science, University of Colorado Boulder, Boulder, CO80309
| | - Gülce Kardeş
- Santa Fe Institute, Santa Fe, NM87501
- Department of Computer Science, University of Colorado Boulder, Boulder, CO80309
| | | | - Vijay Balasubramanian
- Santa Fe Institute, Santa Fe, NM87501
- David Rittenhouse Laboratory, University of Pennsylvania, Philadelphia, PA19104
- Rudolf Peierls Centre for Theoretical Physics, University of Oxford, OX1 3PU, Oxford, United Kingdom
| | - Eric De Giuli
- Department of Physics, Toronto Metropolitan University, M5B 2K3, Toronto, ON, Canada
| | - David Doty
- Department of Computer Science, University of California, 95616, Davis, CA
| | - Nahuel Freitas
- Department of Physics, University of Buenos Aires, C1053, Buenos Aires, Argentina
| | - Matteo Marsili
- The Abdus Salam International Centre for Theoretical Physics, Trieste34151, Italy
| | - Thomas E. Ouldridge
- Department of Bioengineering, Imperial College London, SW7 2AZ, London, United Kingdom
- Centre for Synthetic Biology, Imperial College London, SW7 2AZ, London, United Kingdom
| | - Andréa W. Richa
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ85287
| | - Paul Riechers
- School of Physical and Mathematical Sciences, Nanyang Quantum Hub, Nanyang Technological University, Singapore639798, Singapore
| | - Édgar Roldán
- The Abdus Salam International Centre for Theoretical Physics, Trieste34151, Italy
| | | | - Zoltan Toroczkai
- Department of Physics and Astronomy, University of Notre Dame, Notre Dame, IN46556
| | - Joseph Paradiso
- Massachusetts Institute of Technology Media Lab, Massachusetts Institute of Technology, Cambridge, MA02139
| |
Collapse
|
2
|
Gallinger C, Popovic L. Asymmetric autocatalytic reactions and their stationary distribution. ROYAL SOCIETY OPEN SCIENCE 2024; 11:231878. [PMID: 39679357 PMCID: PMC11639166 DOI: 10.1098/rsos.231878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 05/23/2024] [Accepted: 06/26/2024] [Indexed: 12/17/2024]
Abstract
We consider a general class of autocatalytic reactions, which has been shown to display stochastic switching behaviour (discreteness-induced transitions (DITs)) in some parameter regimes. This behaviour was shown to occur either when the overall species count is low or when the rate of inflow and outflow of species is relatively much smaller than the rate of autocatalytic reactions. The long-term behaviour of this class was analysed in Bibbona et al. (Bibbona et al. 2020 J. R. Soc. Interface 17, 20200243 (doi:10.1098/rsif.2020.0243)) with an analytic formula for the stationary distribution in the symmetric case. We focus on the case of asymmetric autocatalytic reactions and provide a formula for an approximate stationary distribution of the model. We show this distribution has different properties corresponding to the distinct behaviour of the process in the three parameter regimes; in the DIT regime, the formula provides the fraction of time spent at each of the stable points.
Collapse
Affiliation(s)
- Cameron Gallinger
- Department of Mathematics and Statistics, Concordia University, Montreal, QuebecH3G 1M8, Canada
| | - Lea Popovic
- Department of Mathematics and Statistics, Concordia University, Montreal, QuebecH3G 1M8, Canada
| |
Collapse
|
3
|
Kriukov DV, Huskens J, Wong ASY. Exploring the programmability of autocatalytic chemical reaction networks. Nat Commun 2024; 15:8289. [PMID: 39333532 PMCID: PMC11436770 DOI: 10.1038/s41467-024-52649-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 09/17/2024] [Indexed: 09/29/2024] Open
Abstract
Networks of chemical reactions exhibit emergent properties under out-of-equilibrium conditions. Recent advances in systems chemistry demonstrate that networks with sufficient chemical complexity can be harnessed to emulate properties important for neuromorphic computing. In all examples, autocatalysis appears an essential element for facilitating the nonlinear integration of the input and self-regulatory abilities in the output. How this chemical analogue of a positive feedback mechanism can be controlled in a programmable manner is, however, unexplored. Here, we develop a strategy that uses metal ions (Ca2+, La3+, and Nd3+) to control the rate of a trypsin-catalysed autocatalytic reaction network. We demonstrate that this type of control allows for tuning the kinetics in the network, thereby changing the nature of the positive feedback. The simulations and experiments reveal that an input with one or more metal ions allow for temporal and history-dependent outputs that can be mapped onto a variety of mathematical functions.
Collapse
Affiliation(s)
- Dmitrii V Kriukov
- Department of Molecules and Materials, Faculty of Science and Technology, University of Twente, Enschede, the Netherlands
- MESA+ Institute, University of Twente, Enschede, the Netherlands
- BRAINS (Center for Brain-inspired Nano Systems), University of Twente, Enschede, the Netherlands
| | - Jurriaan Huskens
- Department of Molecules and Materials, Faculty of Science and Technology, University of Twente, Enschede, the Netherlands
- MESA+ Institute, University of Twente, Enschede, the Netherlands
| | - Albert S Y Wong
- Department of Molecules and Materials, Faculty of Science and Technology, University of Twente, Enschede, the Netherlands.
- MESA+ Institute, University of Twente, Enschede, the Netherlands.
- BRAINS (Center for Brain-inspired Nano Systems), University of Twente, Enschede, the Netherlands.
| |
Collapse
|
4
|
Agiza A, Marriott S, Rosenstein JK, Kim E, Reda S. pH-Controlled enzymatic computing for digital circuits and neural networks. Phys Chem Chem Phys 2024; 26:20898-20907. [PMID: 39045608 DOI: 10.1039/d4cp02039a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/25/2024]
Abstract
Unconventional computing paradigms explore new methods for processing information beyond the capabilities of traditional electronic architectures. In this work, we present our approach to digital computation through enzymatic reactions in chemically buffered environments. A key aspect of this approach is its reliance on pH-sensitive enzymatic reactions, with the direction of the reaction controlled by maintaining pH levels within a specific range. When the pH crosses a defined threshold, the reaction moves forward and vice versa, akin to the switching action of electronic switches in digital circuits. The binary signals (0 and 1) are encoded as different concentrations of strong acids or bases, offering a bio-inspired method for computation. The final readout is done using UV-vis spectroscopy after applying detection reactions to indicate whether the output is 1 (indicated by the presence of the enzymatic reaction's product) or 0 (indicated by the absence of the enzymatic reaction's product). We build and evaluate a set of digital circuits in the lab using our proposed methodology to model the circuits using chemical reactions. In addition, we demonstrate the implementation of a neural network classifier using our framework.
Collapse
Affiliation(s)
- Ahmed Agiza
- Computer Science Department, Brown University, Providence, RI, USA.
| | | | | | - Eunsuk Kim
- Department of Chemistry, Brown University, Providence, RI, USA
| | - Sherief Reda
- School of Engineering, Brown University, Providence, RI, USA
| |
Collapse
|
5
|
Krasecki V, Sharma A, Cavell AC, Forman C, Guo SY, Jensen ET, Smith MA, Czerwinski R, Friederich P, Hickman RJ, Gianneschi N, Aspuru-Guzik A, Cronin L, Goldsmith RH. The Role of Experimental Noise in a Hybrid Classical-Molecular Computer to Solve Combinatorial Optimization Problems. ACS CENTRAL SCIENCE 2023; 9:1453-1465. [PMID: 37521801 PMCID: PMC10375572 DOI: 10.1021/acscentsci.3c00515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Indexed: 08/01/2023]
Abstract
Chemical and molecular-based computers may be promising alternatives to modern silicon-based computers. In particular, hybrid systems, where tasks are split between a chemical medium and traditional silicon components, may provide access and demonstration of chemical advantages such as scalability, low power dissipation, and genuine randomness. This work describes the development of a hybrid classical-molecular computer (HCMC) featuring an electrochemical reaction on top of an array of discrete electrodes with a fluorescent readout. The chemical medium, optical readout, and electrode interface combined with a classical computer generate a feedback loop to solve several canonical optimization problems in computer science such as number partitioning and prime factorization. Importantly, the HCMC makes constructive use of experimental noise in the optical readout, a milestone for molecular systems, to solve these optimization problems, as opposed to in silico random number generation. Specifically, we show calculations stranded in local minima can consistently converge on a global minimum in the presence of experimental noise. Scalability of the hybrid computer is demonstrated by expanding the number of variables from 4 to 7, increasing the number of possible solutions by 1 order of magnitude. This work provides a stepping stone to fully molecular approaches to solving complex computational problems using chemistry.
Collapse
Affiliation(s)
- Veronica
K. Krasecki
- Department
of Chemistry, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
| | - Abhishek Sharma
- Department
of Chemistry, University of Glasgow, Glasgow, G12 8QQ, United Kingdom
| | - Andrew C. Cavell
- Department
of Chemistry, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
| | - Christopher Forman
- Department
of Chemistry, Northwestern University, Evanston, Illinois 60208, United States
| | - Si Yue Guo
- Department
of Chemistry, University of Toronto, Toronto, Ontario MS5 3H6, Canada
| | - Evan Thomas Jensen
- Department
of Chemistry, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
| | - Mackinsey A. Smith
- Department
of Chemistry, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
| | - Rachel Czerwinski
- Department
of Chemistry, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
| | - Pascal Friederich
- Department
of Chemistry, University of Toronto, Toronto, Ontario MS5 3H6, Canada
| | - Riley J. Hickman
- Department
of Chemistry, University of Toronto, Toronto, Ontario MS5 3H6, Canada
| | - Nathan Gianneschi
- Department
of Chemistry, Northwestern University, Evanston, Illinois 60208, United States
| | - Alán Aspuru-Guzik
- Department
of Chemistry, University of Toronto, Toronto, Ontario MS5 3H6, Canada
| | - Leroy Cronin
- Department
of Chemistry, University of Glasgow, Glasgow, G12 8QQ, United Kingdom
| | - Randall H. Goldsmith
- Department
of Chemistry, University of Wisconsin-Madison, Madison, Wisconsin 53706, United States
| |
Collapse
|
6
|
Agiza AA, Oakley K, Rosenstein JK, Rubenstein BM, Kim E, Riedel M, Reda S. Digital circuits and neural networks based on acid-base chemistry implemented by robotic fluid handling. Nat Commun 2023; 14:496. [PMID: 36717558 PMCID: PMC9887006 DOI: 10.1038/s41467-023-36206-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 01/18/2023] [Indexed: 02/01/2023] Open
Abstract
Acid-base reactions are ubiquitous, easy to prepare, and execute without sophisticated equipment. Acids and bases are also inherently complementary and naturally map to a universal representation of "0" and "1." Here, we propose how to leverage acids, bases, and their reactions to encode binary information and perform information processing based upon the majority and negation operations. These operations form a functionally complete set that we use to implement more complex computations such as digital circuits and neural networks. We present the building blocks needed to build complete digital circuits using acids and bases for dual-rail encoding data values as complementary pairs, including a set of primitive logic functions that are widely applicable to molecular computation. We demonstrate how to implement neural network classifiers and some classes of digital circuits with acid-base reactions orchestrated by a robotic fluid handling device. We validate the neural network experimentally on a number of images with different formats, resulting in a perfect match to the in-silico classifier. Additionally, the simulation of our acid-base classifier matches the results of the in-silico classifier with approximately 99% similarity.
Collapse
Affiliation(s)
| | | | | | | | | | - Marc Riedel
- University of Minnesota, Minneapolis, MN, USA
| | | |
Collapse
|
7
|
Kriukov DV, Koyuncu AH, Wong ASY. History Dependence in a Chemical Reaction Network Enables Dynamic Switching. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2022; 18:e2107523. [PMID: 35257479 DOI: 10.1002/smll.202107523] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Revised: 02/02/2022] [Indexed: 06/14/2023]
Abstract
This work describes an enzymatic autocatalytic network capable of dynamic switching under out-of-equilibrium conditions. The network, wherein a molecular fuel (trypsinogen) and an inhibitor (soybean trypsin inhibitor) compete for a catalyst (trypsin), is kept from reaching equilibria using a continuous flow stirred tank reactor. A so-called 'linear inhibition sweep' is developed (i.e., a molecular analogue of linear sweep voltammetry) to intentionally perturb the competition between autocatalysis and inhibition, and used to demonstrate that a simple molecular system, comprising only three components, is already capable of a variety of essential neuromorphic behaviors (hysteresis, synchronization, resonance, and adaptation). This research provides the first steps in the development of a strategy that uses the principles in systems chemistry to transform chemical reaction networks into platforms capable of neural network computing.
Collapse
Affiliation(s)
- Dmitrii V Kriukov
- Department of Molecules and Materials, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, Enschede, 7522 NH, The Netherlands
| | - A Hazal Koyuncu
- Department of Molecules and Materials, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, Enschede, 7522 NH, The Netherlands
| | - Albert S Y Wong
- Department of Molecules and Materials, Faculty of Science and Technology, University of Twente, Drienerlolaan 5, Enschede, 7522 NH, The Netherlands
- MESA+ Institute for Nanotechnology, University of Twente, Drienerlolaan 5, Enschede, 7522 NH, The Netherlands
- BRAINS (Center for Brain-inspired Nano Systems), University of Twente, Drienerlolaan 5, Enschede, 7522 NH, The Netherlands
| |
Collapse
|
8
|
Sarkar K, Bonnerjee D, Srivastava R, Bagh S. A single layer artificial neural network type architecture with molecular engineered bacteria for reversible and irreversible computing. Chem Sci 2021; 12:15821-15832. [PMID: 35024106 PMCID: PMC8672730 DOI: 10.1039/d1sc01505b] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Accepted: 11/08/2021] [Indexed: 11/21/2022] Open
Abstract
Here, we adapted the basic concept of artificial neural networks (ANNs) and experimentally demonstrate a broadly applicable single layer ANN type architecture with molecular engineered bacteria to perform complex irreversible computing like multiplexing, de-multiplexing, encoding, decoding, majority functions, and reversible computing like Feynman and Fredkin gates. The encoder and majority functions and reversible computing were experimentally implemented within living cells for the first time. We created cellular devices, which worked as artificial neuro-synapses in bacteria, where input chemical signals were linearly combined and processed through a non-linear activation function to produce fluorescent protein outputs. To create such cellular devices, we established a set of rules by correlating truth tables, mathematical equations of ANNs, and cellular device design, which unlike cellular computing, does not require a circuit diagram and the equation directly correlates the design of the cellular device. To our knowledge this is the first adaptation of ANN type architecture with engineered cells. This work may have significance in establishing a new platform for cellular computing, reversible computing and in transforming living cells as ANN-enabled hardware.
Collapse
Affiliation(s)
- Kathakali Sarkar
- Biophysics and Structural Genomics Division, Saha Institute of Nuclear Physics, Homi Bhabha National Institute (HBNI) Block A/F, Sector-I, Bidhannagar Kolkata 700064 India
| | - Deepro Bonnerjee
- Biophysics and Structural Genomics Division, Saha Institute of Nuclear Physics, Homi Bhabha National Institute (HBNI) Block A/F, Sector-I, Bidhannagar Kolkata 700064 India
| | - Rajkamal Srivastava
- Biophysics and Structural Genomics Division, Saha Institute of Nuclear Physics, Homi Bhabha National Institute (HBNI) Block A/F, Sector-I, Bidhannagar Kolkata 700064 India
| | - Sangram Bagh
- Biophysics and Structural Genomics Division, Saha Institute of Nuclear Physics, Homi Bhabha National Institute (HBNI) Block A/F, Sector-I, Bidhannagar Kolkata 700064 India
| |
Collapse
|