1
|
Jaćimović V. Natural gradient ascent in evolutionary games. Biosystems 2024; 236:105127. [PMID: 38272388 DOI: 10.1016/j.biosystems.2024.105127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 01/20/2024] [Accepted: 01/21/2024] [Indexed: 01/27/2024]
Abstract
We consider evolutionary games with a continuous trait space where the replicator dynamics are restricted to the manifold of multivariate Gaussian distributions. We demonstrate that replicator dynamics are gradient flows with respect to the Fisher information metric. The potential function for these gradient flows is closely related to the mean fitness. Our findings extend previous results on natural gradient ascent in evolutionary games with a finite strategy set. Throughout the paper we pursue an information-geometric point of view on evolutionary games. This sheds a new light on the replicator dynamics as a learning process, realizing the compromise between maximization of the mean fitness and preservation of the diversity.
Collapse
Affiliation(s)
- Vladimir Jaćimović
- Faculty of Natural Sciences and Mathematics University of Montenegro, Cetinjski put bb., 81000 Podgorica, Montenegro.
| |
Collapse
|
2
|
Jaćimović V. The fundamental theorem of natural selection in optimization and games. Biosystems 2023:104956. [PMID: 37331686 DOI: 10.1016/j.biosystems.2023.104956] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 05/22/2023] [Accepted: 06/13/2023] [Indexed: 06/20/2023]
Abstract
The Fisher's fundamental theorem of natural selection (FTNS) is a matter of longstanding debate in the community of mathematical biologists. Many researchers proposed different clarifications and mathematical reconstructions of the Fisher's original statement. The present study is motivated by our opinion that the controversy can be resolved by examining the Fisher's statement within the framework of two mathematical theories that are inspired by the Darwinian formalism: evolutionary game theory (EGT) and evolutionary optimization (EO). We present four rigorous formulations (some of them previously reported) of FTNS in four different setups that come from EGT and EO. Our study demonstrates that FTNS in its original form is correct only in certain setups. In order to be recognized as a universal law, the Fisher's statement should be: (a) clarified and completed and (b) relaxed by replacing the words "is equal to" with "does not exceed". Moreover, the real meaning of FTNS can be best understood from the information-geometric point of view. Such an approach shows that FTNS imposes an upper geometric bound on information flows in evolutionary systems. In this light, FTNS appears to be a statement about the intrinsic time scale of an evolutionary system. This leads to a novel insight: FTNS is an analogue of the time-energy uncertainty relation in physics. This further emphasizes a close relation with results on speed limits in stochastic thermodynamics.
Collapse
Affiliation(s)
- Vladimir Jaćimović
- Faculty of Natural Sciences and Mathematics, University of Montenegro, Cetinjski put bb., 81000 Podgorica, Montenegro.
| |
Collapse
|
3
|
Czégel D, Giaffar H, Tenenbaum JB, Szathmáry E. Bayes and Darwin: How replicator populations implement Bayesian computations. Bioessays 2022; 44:e2100255. [PMID: 35212408 DOI: 10.1002/bies.202100255] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2021] [Revised: 02/01/2022] [Accepted: 02/03/2022] [Indexed: 11/07/2022]
Abstract
Bayesian learning theory and evolutionary theory both formalize adaptive competition dynamics in possibly high-dimensional, varying, and noisy environments. What do they have in common and how do they differ? In this paper, we discuss structural and dynamical analogies and their limits, both at a computational and an algorithmic-mechanical level. We point out mathematical equivalences between their basic dynamical equations, generalizing the isomorphism between Bayesian update and replicator dynamics. We discuss how these mechanisms provide analogous answers to the challenge of adapting to stochastically changing environments at multiple timescales. We elucidate an algorithmic equivalence between a sampling approximation, particle filters, and the Wright-Fisher model of population genetics. These equivalences suggest that the frequency distribution of types in replicator populations optimally encodes regularities of a stochastic environment to predict future environments, without invoking the known mechanisms of multilevel selection and evolvability. A unified view of the theories of learning and evolution comes in sight.
Collapse
Affiliation(s)
- Dániel Czégel
- Institute of Evolution, Centre for Ecological Research, Budapest, Hungary.,Parmenides Foundation, Center for the Conceptual Foundations of Science, Pullach, Germany.,Doctoral School of Biology, Institute of Biology, Eötvös Loránd University, Budapest, Hungary.,Beyond Center for Fundamental Concepts in Science, Arizona State University, Tempe, Arizona, USA
| | - Hamza Giaffar
- Cold Spring Harbor Laboratory, Cold Spring Harbor, New York, USA
| | - Joshua B Tenenbaum
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA.,Center for Brains, Minds and Machines, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA.,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Eörs Szathmáry
- Institute of Evolution, Centre for Ecological Research, Budapest, Hungary.,Parmenides Foundation, Center for the Conceptual Foundations of Science, Pullach, Germany.,Department of Plant Systematics, Ecology and Theoretical Biology, Eötvös Loránd University, Budapest, Hungary
| |
Collapse
|
4
|
Harris T, Cai AQ. Red queen dynamics in specific predator-prey systems. J Math Biol 2014; 71:997-1016. [PMID: 25481510 DOI: 10.1007/s00285-014-0850-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2014] [Revised: 11/07/2014] [Indexed: 11/29/2022]
Abstract
The dynamics of a predator-prey system are studied, with a comparison of discrete and continuous strategy spaces. For a [Formula: see text] system, the average strategies used in the discrete and continuous case are shown to be the same. It is further shown that the inclusion of constant prey switching in the discrete case can have a stabilising effect and reduce the number of available predator types through extinction.
Collapse
Affiliation(s)
- Terence Harris
- School of Mathematics and Statistics, University of New South Wales, Sydney, Australia,
| | | |
Collapse
|
5
|
CSS, NIS and dynamic stability for two-species behavioral models with continuous trait spaces. J Theor Biol 2010; 262:80-9. [PMID: 19769991 DOI: 10.1016/j.jtbi.2009.09.019] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2008] [Revised: 06/29/2009] [Accepted: 09/11/2009] [Indexed: 11/21/2022]
Abstract
Static continuously stable strategy (CSS) and neighborhood invader strategy (NIS) conditions are developed for two-species models of frequency-dependent behavioral evolution when individuals have traits in continuous strategy spaces. These are intuitive stability conditions that predict the eventual outcome of evolution from a dynamic perspective. It is shown how the CSS is related to convergence stability for the canonical equation of adaptive dynamics and the NIS to convergence to a monomorphism for the replicator equation of evolutionary game theory. The CSS and NIS are also shown to be special cases of neighborhood p(*)- superiority for p(*) equal to one half and zero, respectively. The theory is illustrated when each species has a one-dimensional trait space.
Collapse
|
6
|
Apaloo J. Revisiting matrix games: The concept of neighborhood invader strategies. Theor Popul Biol 2006; 69:235-42. [PMID: 16426655 DOI: 10.1016/j.tpb.2005.11.006] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2005] [Revised: 11/21/2005] [Accepted: 11/21/2005] [Indexed: 11/21/2022]
Abstract
We extend the concept of neighborhood invader strategy (NIS) to finite-dimensional matrix games and compare this concept to the evolutionarily stable strategy (ESS) concept. We show that these two concepts are not equivalent in general. Just as ESS's may not be unique, NIS's may also not be unique. However, if there is an ESS and a NIS then these strategies must be the same. We show that an ESNIS (an ESS and NIS) for any matrix game is unique and that a mixed ESS with full support is a NIS. Thus a mixed ESS with full support is not invadable by any pure or mixed strategy and it can invade any pure or mixed strategy. An ESS which is an ESNIS, therefore, has better chance of being established evolutionarily through dynamic selection.
Collapse
Affiliation(s)
- J Apaloo
- Department of Mathematics, Statistics and Computer Science, St. Francis Xavier University, Antigonish, Nova Scotia, Canada B2G 2W5.
| |
Collapse
|