How learning can change the course of evolution

Facilitation of Evolution by Plasticity Scales with Phenotypic Complexity

Developmental plasticity enables organisms to cope with new environmental challenges. If deploying such plasticity is costly in terms of time or energy, the same adaptive behaviour could subsequently evolve through piecemeal genomic reorganisation that replaces the requirement to acquire that adaptation by individual plasticity. Here, we report a new dimension to the way in which plasticity can drive evolutionary change, leading to an ever-greater complexity in biological organisation. Plasticity dramatically accelerates the evolutionary accumulation of adaptive systems in model organisms with relatively low rates of mutation. The effect of plasticity on the evolutionary growth of complexity is even greater when the number of elements needed to construct a functional system is increased. These results suggest that, as the difficulty of challenges from the environment becomes greater, plasticity exerts an ever more powerful role in meeting those challenges and in opening up new avenues for the subsequent evolution of complex adaptations.

The evolutionary consequences of learning under competition

Learning is a taxonomically widespread process by which animals change their behavioural responses to stimuli as a result of experience. In this way, it plays a crucial role in the development of individual behaviour and underpins substantial phenotypic variation within populations. Nevertheless, the impact of learning in social contexts on evolutionary change is not well understood. Here, we develop game theoretical models of competition for resources in small groups (e.g. producer-scrounger and hawk-dove games) in which actions are controlled by reinforcement learning and show that biases in the subjective valuation of different actions readily evolve. Moreover, in many cases, the convergence stable levels of bias exist at fitness minima and therefore lead to disruptive selection on learning rules and, potentially, to the evolution of genetic polymorphisms. Thus, we show how reinforcement learning in social contexts can be a driver of evolutionary diversification. In addition, we consider the evolution of ability in our games, showing that learning can also drive disruptive selection on the ability to perform a task.

Enhancing robot evolution through Lamarckian principles

Evolutionary robot systems offer two principal advantages: an advanced way of developing robots through evolutionary optimization and a special research platform to conduct what-if experiments regarding questions about evolution. Our study sits at the intersection of these. We investigate the question "What if the 18th-century biologist Lamarck was not completely wrong and individual traits learned during a lifetime could be passed on to offspring through inheritance?" We research this issue through simulations with an evolutionary robot framework where morphologies (bodies) and controllers (brains) of robots are evolvable and robots also can improve their controllers through learning during their lifetime. Within this framework, we compare a Lamarckian system, where learned bits of the brain are inheritable, with a Darwinian system, where they are not. Analyzing simulations based on these systems, we obtain new insights about Lamarckian evolution dynamics and the interaction between evolution and learning. Specifically, we show that Lamarckism amplifies the emergence of 'morphological intelligence', the ability of a given robot body to acquire a good brain by learning, and identify the source of this success: newborn robots have a higher fitness because their inherited brains match their bodies better than those in a Darwinian system.

Real-World Robot Evolution: Why Would it (not) Work?

This paper takes a critical look at the concept of real-world robot evolution discussing specific challenges for making it practicable. After a brief review of the state of the art several enablers are discussed in detail. It is noted that sample efficient evolution is one of the key prerequisites and there are various promising directions towards this in different stages of maturity, including learning as part of the evolutionary system, genotype filtering, and hybridizing real-world evolution with simulations in a new way. Furthermore, it is emphasized that an evolutionary system that works in the real world needs robots that work in the real world. Obvious as it may seem, to achieve this significant complexification of the robots and their tasks is needed compared to the current practice. Finally, the importance of not only building but also understanding evolving robot systems is emphasised, stating that in order to have the technology work we also need the science behind it.