1
|
Wolpert DH, Korbel J, Lynn CW, Tasnim F, Grochow JA, Kardeş G, Aimone JB, Balasubramanian V, De Giuli E, Doty D, Freitas N, Marsili M, Ouldridge TE, Richa AW, Riechers P, Roldán É, Rubenstein B, Toroczkai Z, Paradiso J. Is stochastic thermodynamics the key to understanding the energy costs of computation? Proc Natl Acad Sci U S A 2024; 121:e2321112121. [PMID: 39471216 PMCID: PMC11551414 DOI: 10.1073/pnas.2321112121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/01/2024] Open
Abstract
The relationship between the thermodynamic and computational properties of physical systems has been a major theoretical interest since at least the 19th century. It has also become of increasing practical importance over the last half-century as the energetic cost of digital devices has exploded. Importantly, real-world computers obey multiple physical constraints on how they work, which affects their thermodynamic properties. Moreover, many of these constraints apply to both naturally occurring computers, like brains or Eukaryotic cells, and digital systems. Most obviously, all such systems must finish their computation quickly, using as few degrees of freedom as possible. This means that they operate far from thermal equilibrium. Furthermore, many computers, both digital and biological, are modular, hierarchical systems with strong constraints on the connectivity among their subsystems. Yet another example is that to simplify their design, digital computers are required to be periodic processes governed by a global clock. None of these constraints were considered in 20th-century analyses of the thermodynamics of computation. The new field of stochastic thermodynamics provides formal tools for analyzing systems subject to all of these constraints. We argue here that these tools may help us understand at a far deeper level just how the fundamental thermodynamic properties of physical systems are related to the computation they perform.
Collapse
Affiliation(s)
- David H. Wolpert
- Santa Fe Institute, Santa Fe, NM87501
- Complexity Science Hub Vienna, Vienna1080, Austria
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ85287
- The Abdus Salam International Centre for Theoretical Physics, Trieste34151, Italy
- Albert Einstein Institute for Advanced Study in the Life Sciences, New York, NY10467
| | - Jan Korbel
- Complexity Science Hub Vienna, Vienna1080, Austria
- Institute for the Science of Complex Systems, Center for Medical Data Science (CeDAS), Medical University of Vienna, Vienna1090, Austria
| | - Christopher W. Lynn
- Center for the Physics of Biological Function, Princeton University, Princeton, NJ08544
- Center for the Physics of Biological Function, City University of New York, New York, NY10017
- Department of Physics, Yale University, New Haven, CT06520
| | | | - Joshua A. Grochow
- Department of Computer Science, University of Colorado Boulder, Boulder, CO80309
| | - Gülce Kardeş
- Santa Fe Institute, Santa Fe, NM87501
- Department of Computer Science, University of Colorado Boulder, Boulder, CO80309
| | | | - Vijay Balasubramanian
- Santa Fe Institute, Santa Fe, NM87501
- David Rittenhouse Laboratory, University of Pennsylvania, Philadelphia, PA19104
- Rudolf Peierls Centre for Theoretical Physics, University of Oxford, OX1 3PU, Oxford, United Kingdom
| | - Eric De Giuli
- Department of Physics, Toronto Metropolitan University, M5B 2K3, Toronto, ON, Canada
| | - David Doty
- Department of Computer Science, University of California, 95616, Davis, CA
| | - Nahuel Freitas
- Department of Physics, University of Buenos Aires, C1053, Buenos Aires, Argentina
| | - Matteo Marsili
- The Abdus Salam International Centre for Theoretical Physics, Trieste34151, Italy
| | - Thomas E. Ouldridge
- Department of Bioengineering, Imperial College London, SW7 2AZ, London, United Kingdom
- Centre for Synthetic Biology, Imperial College London, SW7 2AZ, London, United Kingdom
| | - Andréa W. Richa
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ85287
| | - Paul Riechers
- School of Physical and Mathematical Sciences, Nanyang Quantum Hub, Nanyang Technological University, Singapore639798, Singapore
| | - Édgar Roldán
- The Abdus Salam International Centre for Theoretical Physics, Trieste34151, Italy
| | | | - Zoltan Toroczkai
- Department of Physics and Astronomy, University of Notre Dame, Notre Dame, IN46556
| | - Joseph Paradiso
- Massachusetts Institute of Technology Media Lab, Massachusetts Institute of Technology, Cambridge, MA02139
| |
Collapse
|
2
|
Bryant SJ, Machta BB. Physical Constraints in Intracellular Signaling: The Cost of Sending a Bit. PHYSICAL REVIEW LETTERS 2023; 131:068401. [PMID: 37625074 PMCID: PMC11146629 DOI: 10.1103/physrevlett.131.068401] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 03/20/2023] [Accepted: 06/09/2023] [Indexed: 08/27/2023]
Abstract
Many biological processes require timely communication between molecular components. Cells employ diverse physical channels to this end, transmitting information through diffusion, electrical depolarization, and mechanical waves among other strategies. Here we bound the energetic cost of transmitting information through these physical channels, in k_{B}T/bit, as a function of the size of the sender and receiver, their spatial separation, and the communication latency. These calculations provide an estimate for the energy costs associated with information processing arising from the physical constraints of the cellular environment, which we find to be many orders of magnitude larger than unity in natural units. From these calculations, we construct a phase diagram indicating where each strategy is most efficient. Our results suggest that intracellular information transfer may constitute a substantial energetic cost. This provides a new tool for understanding tradeoffs in cellular network function.
Collapse
Affiliation(s)
- Samuel J. Bryant
- Department of Physics, Yale University, New Haven, Connecticut 06511, USA
| | - Benjamin B. Machta
- Department of Physics, Yale University and Quantitative Biology Institute, Yale University, New Haven, Connecticut 06511, USA
| |
Collapse
|
3
|
Ohga N, Ito S. Information-geometric structure for chemical thermodynamics: An explicit construction of dual affine coordinates. Phys Rev E 2022; 106:044131. [PMID: 36397558 DOI: 10.1103/physreve.106.044131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 09/08/2022] [Indexed: 06/16/2023]
Abstract
We construct an information-geometric structure for chemical thermodynamics, applicable to a wide range of chemical reaction systems including nonideal and open systems. For this purpose, we explicitly construct dual affine coordinate systems, which completely designate an information-geometric structure, using the extent of reactions and the affinities of reactions as coordinates on a linearly constrained space of amounts of substances. The resulting structure induces a metric and a divergence (a function of two distributions of amounts), both expressed with chemical potentials. These quantities have been partially known for ideal-dilute solutions, but their extensions for nonideal solutions and the complete underlying structure are novel. The constructed geometry is a generalization of dual affine coordinates for stochastic thermodynamics. For example, the metric and the divergence are generalizations of the Fisher information and the Kullback-Leibler divergence. As an application, we identify the chemical-thermodynamic analog of the Hatano-Sasa excess entropy production using our divergence.
Collapse
Affiliation(s)
- Naruo Ohga
- Department of Physics, Graduate School of Science, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Sosuke Ito
- Department of Physics, Graduate School of Science, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| |
Collapse
|