Colony-level cognition

Magnitude-sensitivity: rethinking decision-making

Magnitude-sensitivity refers to the result that performance in decision-making, across domains and organisms, is affected by the total value of the possible alternatives. This simple result offers a window into fundamental issues in decision-making and has led to a reconsideration of ecological decision-making, prominent computational models of decision-making, and optimal decision-making. Moreover, magnitude-sensitivity has inspired the design of new robotic systems that exploit natural solutions and apply optimal decision-making policies. In this article, we review the key theoretical and empirical results about magnitude-sensitivity and highlight the importance that this phenomenon has for the understanding of decision-making. Furthermore, we discuss open questions and ideas for future research.

Neural Correlates of Social Behavior in Mushroom Body Extrinsic Neurons of the Honeybee Apis mellifera

The social behavior of honeybees (Apis mellifera) has been extensively investigated, but little is known about its neuronal correlates. We developed a method that allowed us to record extracellularly from mushroom body extrinsic neurons (MB ENs) in a freely moving bee within a small but functioning mini colony of approximately 1,000 bees. This study aimed to correlate the neuronal activity of multimodal high-order MB ENs with social behavior in a close to natural setting. The behavior of all bees in the colony was video recorded. The behavior of the recorded animal was compared with other hive mates and no significant differences were found. Changes in the spike rate appeared before, during or after social interactions. The time window of the strongest effect on spike rate changes ranged from 1 s to 2 s before and after the interaction, depending on the individual animal and recorded neuron. The highest spike rates occurred when the experimental animal was situated close to a hive mate. The variance of the spike rates was analyzed as a proxy for high order multi-unit processing. Comparing randomly selected time windows with those in which the recorded animal performed social interactions showed a significantly increased spike rate variance during social interactions. The experimental set-up employed for this study offers a powerful opportunity to correlate neuronal activity with intrinsically motivated behavior of socially interacting animals. We conclude that the recorded MB ENs are potentially involved in initiating and controlling social interactions in honeybees.

Food-burying behavior in red imported fire ants (Hymenoptera: Formicidae)

The food-burying behavior has been reported in many mammals and birds, but was rarely observed in invertebrates. The red imported fire ants, Solenopsis invicta Buren, is an invasive pest in many areas of the world that usually performing food-burying during the foraging processes. However, the impacted factors and measureable patterns of this behavior is largely unknown. In the present study, food-burying vs food-transport behaviors of Solenopsis invicta were observed under laboratory and field conditions. When starved (no food was provided for 37 days) in the laboratory, food (sausage) was consumed by large numbers of ants, and few burying behaviors were observed. However, when food was provided until satiation of the colonies, food-transport was suppressed and significantly more soil particles were relocated on the food and graph paper square (where the food was placed) when compared with these colonies exposed to starved conditions. Videotapes showed that soil particles (1.47 ± 0.09 mm²) were preferentially placed adjacent to (in contact with) the food items at the beginning; and after the edges were covered, ants transported significantly smaller soil particles (1.13 ± 0.06 mm²) to cover the food. Meanwhile, larger particles (1.96 ± 0.08 mm²) were pulled/dragged around (but not in contact with) the food. Interestingly, only a small number of ants, mainly the small workers, were involved in food-burying, and the ants tended to repeatedly transport soil particles. A total of 12 patterns of particle transport were identified, and soil particles were most frequently picked from the foraging arena and subsequently placed adjacent to the food. In the field, almost all released food was actively transported by Solenopsis invicta workers, and no burying behavior was observed. Our results show that the food-burying behavior of Solenopsis invicta may be associated with the suppressed foraging activity, and the burying task may be carried out by certain groups of workers.

Regulation of harvester ant foraging as a closed-loop excitable system

Ant colonies regulate activity in response to changing conditions without using centralized control. Desert harvester ant colonies forage for seeds, and regulate foraging to manage a tradeoff between spending and obtaining water. Foragers lose water while outside in the dry air, but ants obtain water by metabolizing the fats in the seeds they eat. Previous work shows that the rate at which an outgoing forager leaves the nest depends on its recent rate of brief antennal contacts with incoming foragers carrying food. We examine how this process can yield foraging rates that are robust to uncertainty and responsive to temperature and humidity across minute-to-hour timescales. To explore possible mechanisms, we develop a low-dimensional analytical model with a small number of parameters that captures observed foraging behavior. The model uses excitability dynamics to represent response to interactions inside the nest and a random delay distribution to represent foraging time outside the nest. We show how feedback from outgoing foragers returning to the nest stabilizes the incoming and outgoing foraging rates to a common value determined by the volatility of available foragers. The model exhibits a critical volatility above which there is sustained foraging at a constant rate and below which foraging stops. To explain how foraging rates adjust to temperature and humidity, we propose that foragers modify their volatility after they leave the nest and become exposed to the environment. Our study highlights the importance of feedback in the regulation of foraging activity and shows how modulation of volatility can explain how foraging activity responds to conditions and varies across colonies. Our model elucidates the role of feedback across many timescales in collective behavior, and may be generalized to other systems driven by excitable dynamics, such as neuronal networks.

Parallel vs. comparative evaluation of alternative options by colonies and individuals of the ant Temnothorax rugatulus

Both a single ant and the colony to which it belongs can make decisions, but the underlying mechanisms may differ. Colonies are known to be less susceptible than lone ants to “choice overload”, whereby decision quality deteriorates with increasing number of options. We probed the basis of this difference, using the model system of nest-site selection by the ant Temnothorax rugatulus. We tested the applicability of two competing models originally developed to explain information-processing mechanisms in vertebrates. The Tug of War model states that concurrent alternatives are directly compared, so that choosing between two alternatives takes longer than accepting a single one. In contrast, the Sequential Choice Model assumes that options are examined in parallel, and action takes place once any option reaches a decision criterion, so that adding more options shortens time to act. We found that single ants matched the Tug of War model while colonies fitted the Sequential Choice model. Our study shows that algorithmic models for decision-making can serve to investigate vastly different domains, from vertebrate individuals to both individuals and colonies of social insects.

Psychophysical Laws and the Superorganism

Through theoretical analysis, we show how a superorganism may react to stimulus variations according to psychophysical laws observed in humans and other animals. We investigate an empirically-motivated honeybee house-hunting model, which describes a value-sensitive decision process over potential nest-sites, at the level of the colony. In this study, we show how colony decision time increases with the number of available nests, in agreement with the Hick-Hyman law of psychophysics, and decreases with mean nest quality, in agreement with Piéron’s law. We also show that colony error rate depends on mean nest quality, and difference in quality, in agreement with Weber’s law. Psychophysical laws, particularly Weber’s law, have been found in diverse species, including unicellular organisms. Our theoretical results predict that superorganisms may also exhibit such behaviour, suggesting that these laws arise from fundamental mechanisms of information processing and decision-making. Finally, we propose a combined psychophysical law which unifies Hick-Hyman’s law and Piéron’s law, traditionally studied independently; this unified law makes predictions that can be empirically tested.

The Psychology of Superorganisms: Collective Decision Making by Insect Societies

Under the superorganism concept, insect societies are so tightly integrated that they possess features analogous to those of single organisms, including collective cognition. If so, colony function might fruitfully be studied using methods developed to understand individual animals. Here, we review research that uses psychological approaches to understand decision making by colonies. The application of neural models to collective choice shows fundamental similarities between how brains and colonies balance speed/accuracy trade-offs in decision making. Experimental analyses have explored collective rationality, cognitive capacity, and perceptual discrimination at both individual and colony levels. A major theme is the emergence of improved colony-level function from interactions among relatively less capable individuals. However, colonies also encounter performance costs due to their reliance on positive feedback, which generates consensus but can also amplify errors. Collective learning is a nascent field for the further application of psychological methods to colonies. The research strategy reviewed here shows how the superorganism concept can serve as more than an illustrative analogy.

Decision-making without a brain: how an amoeboid organism solves the two-armed bandit

Several recent studies hint at shared patterns in decision-making between taxonomically distant organisms, yet few studies demonstrate and dissect mechanisms of decision-making in simpler organisms. We examine decision-making in the unicellular slime mould Physarum polycephalum using a classical decision problem adapted from human and animal decision-making studies: the two-armed bandit problem. This problem has previously only been used to study organisms with brains, yet here we demonstrate that a brainless unicellular organism compares the relative qualities of multiple options, integrates over repeated samplings to perform well in random environments, and combines information on reward frequency and magnitude in order to make correct and adaptive decisions. We extend our inquiry by using Bayesian model selection to determine the most likely algorithm used by the cell when making decisions. We deduce that this algorithm centres around a tendency to exploit environments in proportion to their reward experienced through past sampling. The algorithm is intermediate in computational complexity between simple, reactionary heuristics and calculation-intensive optimal performance algorithms, yet it has very good relative performance. Our study provides insight into ancestral mechanisms of decision-making and suggests that fundamental principles of decision-making, information processing and even cognition are shared among diverse biological systems.

Model of the best-of-N nest-site selection process in honeybees

The ability of a honeybee swarm to select the best nest site plays a fundamental role in determining the future colony's fitness. To date, the nest-site selection process has mostly been modeled and theoretically analyzed for the case of binary decisions. However, when the number of alternative nests is larger than two, the decision-process dynamics qualitatively change. In this work, we extend previous analyses of a value-sensitive decision-making mechanism to a decision process among N nests. First, we present the decision-making dynamics in the symmetric case of N equal-quality nests. Then, we generalize our findings to a best-of-N decision scenario with one superior nest and N-1 inferior nests, previously studied empirically in bees and ants. Whereas previous binary models highlighted the crucial role of inhibitory stop-signaling, the key parameter in our new analysis is the relative time invested by swarm members in individual discovery and in signaling behaviors. Our new analysis reveals conflicting pressures on this ratio in symmetric and best-of-N decisions, which could be solved through a time-dependent signaling strategy. Additionally, our analysis suggests how ecological factors determining the density of suitable nest sites may have led to selective pressures for an optimal stable signaling ratio.

A context-dependent alarm signal in the ant Temnothorax rugatulus

Because collective cognition emerges from local signaling among group members, deciphering communication systems is critical to understanding underlying mechanisms. Alarm signals are widespread in the social insects and can elicit a variety of behavioral responses to danger, but the functional plasticity of these signals has not been well studied. Here we report an alarm pheromone in the ant Temnothorax rugatulus that elicits two different behaviors depending on context. When an ant was tethered inside an unfamiliar nest site and unable to move freely, she released a pheromone from her mandibular gland that signaled other ants to reject this nest as a potential new home, presumably to avoid potential danger. When the same pheromone was presented near the ants' home nest, they were instead attracted to it, presumably to respond to a threat to the colony. We used coupled gas chromatography/mass spectrometry to identify candidate compounds from the mandibular gland and tested each one in a nest choice bioassay. We found that 2,5-dimethylpyrazine was sufficient to induce rejection of a marked new nest and also to attract ants when released at the home nest. This is the first detailed investigation of chemical communication in the leptothoracine ants. We discuss the possibility that this pheromone's deterrent function can improve an emigrating colony's nest site selection performance.

A mechanism for value-sensitive decision-making

We present a dynamical systems analysis of a decision-making mechanism inspired by collective choice in house-hunting honeybee swarms, revealing the crucial role of cross-inhibitory 'stop-signalling' in improving the decision-making capabilities. We show that strength of cross-inhibition is a decision-parameter influencing how decisions depend both on the difference in value and on the mean value of the alternatives; this is in contrast to many previous mechanistic models of decision-making, which are typically sensitive to decision accuracy rather than the value of the option chosen. The strength of cross-inhibition determines when deadlock over similarly valued alternatives is maintained or broken, as a function of the mean value; thus, changes in cross-inhibition strength allow adaptive time-dependent decision-making strategies. Cross-inhibition also tunes the minimum difference between alternatives required for reliable discrimination, in a manner similar to Weber's law of just-noticeable difference. Finally, cross-inhibition tunes the speed-accuracy trade-off realised when differences in the values of the alternatives are sufficiently large to matter. We propose that the model, and the significant role of the values of the alternatives, may describe other decision-making systems, including intracellular regulatory circuits, and simple neural circuits, and may provide guidance in the design of decision-making algorithms for artificial systems, particularly those functioning without centralised control.

Groups have a larger cognitive capacity than individuals

Increasing the number of options can paradoxically lead to worse decisions, a phenomenon known as cognitive overload [1]. This happens when an individual decision-maker attempts to digest information exceeding its processing capacity. Highly integrated groups, such as social insect colonies, make consensus decisions that combine the efforts of many members, suggesting that these groups can overcome individual limitations [2-4]. Here we report that an ant colony choosing a new nest site is less vulnerable to cognitive overload than an isolated ant making this decision on her own. We traced this improvement to differences in individual behavior. In whole colonies, each ant assesses only a small subset of available sites, and the colony combines their efforts to thoroughly explore all options. An isolated ant, on the other hand, must personally assess a larger number of sites to approach the same level of option coverage. By sharing the burden of assessment, the colony avoids overtaxing the abilities of its members.

A simple threshold rule is sufficient to explain sophisticated collective decision-making

Decision-making animals can use slow-but-accurate strategies, such as making multiple comparisons, or opt for simpler, faster strategies to find a 'good enough' option. Social animals make collective decisions about many group behaviours including foraging and migration. The key to the collective choice lies with individual behaviour. We present a case study of a collective decision-making process (house-hunting ants, Temnothorax albipennis), in which a previously proposed decision strategy involved both quality-dependent hesitancy and direct comparisons of nests by scouts. An alternative possible decision strategy is that scouting ants use a very simple quality-dependent threshold rule to decide whether to recruit nest-mates to a new site or search for alternatives. We use analytical and simulation modelling to demonstrate that this simple rule is sufficient to explain empirical patterns from three studies of collective decision-making in ants, and can account parsimoniously for apparent comparison by individuals and apparent hesitancy (recruitment latency) effects, when available nests differ strongly in quality. This highlights the need to carefully design experiments to detect individual comparison. We present empirical data strongly suggesting that best-of-n comparison is not used by individual ants, although individual sequential comparisons are not ruled out. However, by using a simple threshold rule, decision-making groups are able to effectively compare options, without relying on any form of direct comparison of alternatives by individuals. This parsimonious mechanism could promote collective rationality in group decision-making.

Nestmate recognition in social insects: overcoming physiological constraints with collective decision making

Social insects rank among the most abundant and influential terrestrial organisms. The key to their success is their ability to form tightly knit social groups that perform work cooperatively, and effectively exclude non-members from the colony. An extensive body of research, both empirical and theoretical, has explored how optimal acceptance thresholds could evolve in individuals, driven by the twin costs of inappropriately rejecting true nestmates and erroneously accepting individuals from foreign colonies. Here, in contrast, we use agent-based modeling to show that strong nestmate recognition by individuals is often unnecessary. Instead, highly effective nestmate recognition can arise as a colony-level property from a collective of individually poor recognizers. Essentially, although an intruder can get by one defender when their odor cues are similar, it is nearly impossible to get past many defenders if there is the slightest difference in cues. The results of our models match observed rejection rates in studies of ants, wasps, and bees. We also show that previous research in support of the optimal threshold theory approach to the problem of nestmate recognition can be alternatively viewed as evidence in favor of the collective formation of a selectively permeable barrier that allows in nestmates (at a significant cost) while rejecting non-nestmates. Finally, this work shows that nestmate recognition has a stronger task allocation component than previously thought, as colonies can nearly always achieve perfect nestmate recognition if it is cost effective for them to do so at the colony level.

Modeling the Adaptive Role of Negative Signaling in Honey Bee Intraspecific Competition

Collective decision making in the social insects often proceeds via feedback cycles based on positive signaling. Negative signals have, however, been found in a few contexts in which costs exist for paying attention to no longer useful information. Here we incorporate new research on the specificity and context of the negative stop signal into an agent based model of honey bee foraging to explore the adaptive basis of negative signaling in the dance language. Our work suggests that the stop signal, by acting as a counterbalance to the waggle dance, allows colonies to rapidly shut down attacks on other colonies. This could be a key adaptation, as the costs of attacking a colony strong enough to defend itself are significant. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1007/s10905-010-9229-5) contains supplementary material, which is available to authorized users.