Markovian robots: Minimal navigation strategies for active particles

Effect of speed fluctuations on the collective dynamics of active disks

Numerical simulations are performed on the collective dynamics of active disks, whose self-propulsion speed (U) varies in time, and whose orientation evolves according to rotational Brownian motion. Two protocols for the evolution of speed are considered: (i) a deterministic one involving a periodic change in U at a frequency ω; and (ii) a stochastic one in which the speeds are drawn from a power-law distribution at time-intervals governed by a Poissonian process of rate β. In the first case, an increase in ω causes the disks to go from a clustered state to a homogeneous one through an apparent phase-transition, provided that the direction of self-propulsion is allowed to reverse. Similarly, in the second case, for a fixed value of β, the extent of cluster-breakup is larger when reversals in the self-propulsion direction are permitted. Motility-induced phase separation of the disks may therefore be avoided in active matter suspensions in which the constituents are allowed to reverse their self-propulsion direction, immaterial of the precise temporal nature of the reversal (deterministic or stochastic). Equally, our results demonstrate that phase separation could occur even in the absence of a time-averaged motility of an individual active agent, provided that the rate of direction reversals is smaller than the orientational diffusion rate.

Optimal navigation of a smart active particle: directional and distance sensing

We employ Q learning, a variant of reinforcement learning, so that an active particle learns by itself to navigate on the fastest path toward a target while experiencing external forces and flow fields. As state variables, we use the distance and direction toward the target, and as action variables the active particle can choose a new orientation along which it moves with constant velocity. We explicitly investigate optimal navigation in a potential barrier/well and a uniform/ Poiseuille/swirling flow field. We show that Q learning is able to identify the fastest path and discuss the results. We also demonstrate that Q learning and applying the learned policy works when the particle orientation experiences thermal noise. However, the successful outcome strongly depends on the specific problem and the strength of noise.

Kinematics of persistent random walkers with two distinct modes of motion

We study the stochastic motion of active particles that undergo spontaneous transitions between two distinct modes of motion. Each mode is characterized by a velocity distribution and an arbitrary (anti)persistence. We present an analytical formalism to provide a quantitative link between these two microscopic statistical properties of the trajectory and macroscopically observable transport quantities of interest. For exponentially distributed residence times in each state, we derive analytical expressions for the initial anomalous exponent, the characteristic crossover time to the asymptotic diffusive dynamics, and the long-term diffusion constant. We also obtain an exact expression for the time evolution of the mean square displacement over all timescales and provide a recipe to obtain higher displacement moments. Our approach enables us to disentangle the combined effects of velocity, persistence, and switching probabilities between the two states on the kinematics of particles in a wide range of stochastic active or passive processes and to optimize the transport quantities of interest with respect to any of the particle dynamics properties.

Hunting active Brownian particles: Learning optimal behavior

We numerically study active Brownian particles that can respond to environmental cues through a small set of actions (switching their motility and turning left or right with respect to some direction) which are motivated by recent experiments with colloidal self-propelled Janus particles. We employ reinforcement learning to find optimal mappings between the state of particles and these actions. Specifically, we first consider a predator-prey situation in which prey particles try to avoid a predator. Using as reward the squared distance from the predator, we discuss the merits of three state-action sets and show that turning away from the predator is the most successful strategy. We then remove the predator and employ as collective reward the local concentration of signaling molecules exuded by all particles and show that aligning with the concentration gradient leads to chemotactic collapse into a single cluster. Our results illustrate a promising route to obtain local interaction rules and design collective states in active matter.

Information and motility exchange in collectives of active particles

We examine the interplay of motility and information exchange in a model of run-and-tumble active particles where the particle's motility is encoded as a bit of information that can be exchanged upon contact according to the rules of AND and OR logic gates in a circuit. Motile AND particles become non-motile upon contact with a non-motile particle. Conversely, motile OR particles remain motile upon collision with their non-motile counterparts. AND particles that have become non-motile additionally "reawaken", i.e., recover their motility, at a fixed rate μ, as in the SIS (susceptible, infected, susceptible) model of epidemic spreading, where an infected agent can become healthy again, but keeps no memory of the recent infection, hence it is susceptible to a renewed infection. For μ = 0, both AND and OR particles relax irreversibly to absorbing states of all non-motile or all motile particles, respectively. The relaxation kinetics is, however, faster for OR particles that remain active throughout the process. At finite μ, the AND dynamics is controlled by the interplay between reawakening and collision rates. The system evolves to a state of all motile particles (an absorbing state in the language of absorbing phase transitions) for μ > μc and to a mixed state with coexisting motile and non-motile particles (an active state in the language of absorbing phase transitions) for μ < μc. The final state exhibits a rich structure controlled by motility-induced aggregation. Our work can be relevant to biochemical signaling in motile bacteria, the spreading of epidemics and of social consensus, as well as light-controlled organization of active colloids.

Run-and-tumble particles in two dimensions: Marginal position distributions

We study a set of run-and-tumble particle (RTP) dynamics in two spatial dimensions. In the first case of the orientation θ of the particle can assume a set of n possible discrete values, while in the second case θ is a continuous variable. We calculate exactly the marginal position distributions for n=3,4 and the continuous case and show that in all cases the RTP shows a crossover from a ballistic to diffusive regime. The ballistic regime is a typical signature of the active nature of the systems and is characterized by nontrivial position distributions which depend on the specific model. We also show that the signature of activity at long times can be found in the atypical fluctuations, which we also characterize by computing the large deviation functions explicitly.

Chemotaxis strategies of bacteria with multiple run modes

Bacterial chemotaxis-a fundamental example of directional navigation in the living world-is key to many biological processes, including the spreading of bacterial infections. Many bacterial species were recently reported to exhibit several distinct swimming modes-the flagella may, for example, push the cell body or wrap around it. How do the different run modes shape the chemotaxis strategy of a multimode swimmer? Here, we investigate chemotactic motion of the soil bacterium Pseudomonas putida as a model organism. By simultaneously tracking the position of the cell body and the configuration of its flagella, we demonstrate that individual run modes show different chemotactic responses in nutrition gradients and, thus, constitute distinct behavioral states. On the basis of an active particle model, we demonstrate that switching between multiple run states that differ in their speed and responsiveness provides the basis for robust and efficient chemotaxis in complex natural habitats.

Chemokinetic Scattering, Trapping, and Avoidance of Active Brownian Particles

We present a theory of chemokinetic search agents that regulate directional fluctuations according to distance from a target. A dynamic scattering effect reduces the probability to penetrate regions with high fluctuations and thus reduces search success for agents that respond instantaneously to positional cues. In contrast, agents with internal states that initially suppress chemokinesis can exploit scattering to increase their probability to find the target. Using matched asymptotics between the case of diffusive and ballistic search, we obtain analytic results beyond Fox colored noise approximation.

Chemotaxis in external fields: Simulations for active magnetic biological matter

The movement of microswimmers is often described by active Brownian particle models. Here we introduce a variant of these models with several internal states of the swimmer to describe stochastic strategies for directional swimming such as run and tumble or run and reverse that are used by microorganisms for chemotaxis. The model includes a mechanism to generate a directional bias for chemotaxis and interactions with external fields (e.g., gravity, magnetic field, fluid flow) that impose forces or torques on the swimmer. We show how this modified model can be applied to various scenarios: First, the run and tumble motion of E. coli is used to establish a paradigm for chemotaxis and investigate how it is affected by external forces. Then, we study magneto-aerotaxis in magnetotactic bacteria, which is biased not only by an oxygen gradient towards a preferred concentration, but also by magnetic fields, which exert a torque on an intracellular chain of magnets. We study the competition of magnetic alignment with active reorientation and show that the magnetic orientation can improve chemotaxis and thereby provide an advantage to the bacteria, even at rather large inclination angles of the magnetic field relative to the oxygen gradient, a case reminiscent of what is expected for the bacteria at or close to the equator. The highest gain in chemotactic velocity is obtained for run and tumble with a magnetic field parallel to the gradient, but in general a mechanism for reverse motion is necessary to swim against the magnetic field and a run and reverse strategy is more advantageous in the presence of a magnetic torque. This finding is consistent with observations that the dominant mode of directional changes in magnetotactic bacteria is reversal rather than tumbles. Moreover, it provides guidance for the design of future magnetic biohybrid swimmers.

In this paper, we propose a modified Active Brownian particle model to describe bacterial swimming behavior under the influence of external forces and torques, in particular of a magnetic torque. This type of interaction is particularly important for magnetic biohybrids (i.e. motile bacteria coupled to a synthetic magnetic component) and for magnetotactic bacteria (i.e. bacteria with a natural intracellular magnetic chain), which perform chemotaxis to swim along chemical gradients, but are also directed by an external magnetic field. The model allows us to investigate the benefits and disadvantages of such coupling between two different directionality mechanisms. In particular we show that the magnetic torque can speed chemotaxis up in some conditions, while it can hinder it in other cases. In addition to an understanding of the swimming strategies of naturally magnetotactic organisms, the results may guide the design of future biomedical devices.