A social insect perspective on the evolution of social learning mechanisms

An associative account of collective learning

Associative learning is an important adaptive mechanism that is well conserved among a broad range of species. Although it is typically studied in isolated animals, associative learning can occur in the presence of conspecifics in nature. Although many social aspects of individual learning have received much attention, the study of collective learning-the acquisition of knowledge in groups of animals through shared experience-has a much shorter history. Consequently, the conditions under which collective learning emerges and the mechanisms that underlie such emergence are still largely unexplored. Here, we develop a parsimonious model of collective learning based on the complementary integration of associative learning and collective intelligence. The model assumes (i) a simple associative learning rule, based on the Rescorla-Wagner model, in which the actions of conspecifics serve as cues and (ii) a horse-race action selection rule. Simulations of this model show no benefit of group training over individual training in a simple discrimination task (A+/B-). However, a group-training advantage emerges after the discrimination task is reversed (A-/B+). Model predictions suggest that, in a dynamic environment, tracking the actions of conspecifics that are solving the same problem can yield superior learning to individual animals and enhanced performance to the group.

Current predation risk has opposing effects on social learning of foraging locations across two guppy populations

Social learning, where animals learn from other individuals, occurs in many diverse species. The influential but debated 'costly information' hypothesis posits that animals will rely more on social information in high-risk contexts, such as under increased predation risk. We examined and compared the effects of perceived predation risk on social learning of foraging sites in female Trinidadian guppies from wild and domestic populations raised in common-garden environments. We used a demonstrator-observer pairing where a subject could observe conspecific 'demonstrators' feeding from one of two feeders, and measured whether the observer subsequently spent more time at a demonstrated or non-demonstrated feeder. We manipulated perceived predation risk using alarm cue (conspecific skin extract). Stress responses and social learning differed between the two populations. Most notably, high predation risk enhanced social learning in the wild-type guppies, but depressed it in the domestic guppies. Thus, fish from both populations were able to socially learn, but under opposing contexts. These results suggest social learning propensities are the product of multiple interacting systems, and biases to favour social learning can emerge dependent on evolutionary history and current conditions.

Bumblebee social learning outcomes correlate with their flower-facing behaviour

Previous studies suggest that social learning in bumblebees can occur through second-order conditioning, with conspecifics functioning as first-order reinforcers. However, the behavioural mechanisms underlying bumblebees' acquisition of socially learned associations remain largely unexplored. Investigating these mechanisms requires detailed quantification and analysis of the observation process. Here we designed a new 2D paradigm suitable for simple top-down high-speed video recording and analysed bumblebees' observational learning process using a deep-learning-based pose-estimation framework. Two groups of bumblebees observed live conspecifics foraging from either blue or yellow flowers during a single foraging bout, and were subsequently tested for their socially learned colour preferences. Both groups successfully learned the colour indicated by the demonstrators and spent more time facing rewarding flowers-whether occupied by demonstrators or not-compared to non-rewarding flowers. While both groups showed a negative correlation between time spent facing non-rewarding flowers and learning outcomes, the observer bees in the blue group benefited from time spent facing occupied rewarding flowers, whereas the yellow group showed that time facing unoccupied rewarding flowers by the observer bees positively correlated with their learning outcomes. These results suggest that socially influenced colour preferences are shaped by the interplay of different types of observations rather than merely by observing a conspecific at a single colour. Together, these findings provide direct evidence of the dynamical viewing process of observer bees during social observation, opening up new opportunities for exploring the details of more complex social learning in bumblebees and other insects.

Connecting and integrating cooperation within and between species

There has long been a fundamental divide in the study of cooperation: researchers focus either on cooperation within species, including but not limited to sociality, or else on cooperation between species, commonly termed mutualism. Here, we explore the ecologically and evolutionarily significant ways in which within- and between-species cooperation interact. We highlight two primary cross-linkages. First, cooperation of one type can change the context in which cooperation of the other type functions, and thus potentially its outcome. We delineate three possibilities: (i) within-species cooperation modulates benefits for a heterospecific partner; (ii) between-species cooperation affects the dynamics of within-species cooperation; and (iii) both processes take place interactively. The second type of cross-linkage emerges when resources or services that cooperation makes available are obtainable either from members of the same species or from different species. This brings cooperation at the two levels into direct interaction, to some extent obscuring the distinction between them. We expand on these intersections between within- and between-species cooperation in a diversity of taxa and interaction types. These interactions have the potential to weave together social networks and trophic dynamics, contributing to the structure and functioning of ecological communities in ways that are just beginning to be explored. This article is part of the theme issue 'Connected interactions: enriching food web research by spatial and social interactions'.

Bumblebees show capacity for behavioral traditions

A new study shows that bumblebees learn socially, and this resulted in a novel behavior becoming dominant across a group. These findings highlight the opportunity going forward to use social insects to address how simple cognitive mechanisms can underpin the development of complex behavioral phenomena.

Social demonstration of colour preference improves the learning of associated demonstrated actions

We studied how different types of social demonstration improve house sparrows' (Passer domesticus) success in solving a foraging task that requires both operant learning (opening covers) and discrimination learning (preferring covers of the rewarding colour). We provided learners with either paired demonstration (of both cover opening and colour preference), action-only demonstration (of opening white covers only), or no demonstration (a companion bird eating without covers). We found that sparrows failed to learn the two tasks with no demonstration, and learned them best with a paired demonstration. Interestingly, the action of cover opening was learned faster with paired rather than action-only demonstration despite being equally demonstrated in both. We also found that only with paired demonstration, the speed of operant (action) learning was related to the demonstrator's level of activity. Colour preference (i.e. discrimination learning) was eventually acquired by all sparrows that learned to open covers, even without social demonstration of colour preference. Thus, adding a demonstration of colour preference was actually more important for operant learning, possibly as a result of increasing the similarity between the demonstrated and the learned tasks, thereby increasing the learner's attention to the actions of the demonstrator. Giving more attention to individuals in similar settings may be an adaptive strategy directing social learners to focus on ecologically relevant behaviours and on tasks that are likely to be learned successfully.

Mate copying requires the coincidence detector Rutabaga in the mushroom bodies of Drosophila melanogaster

Mate choice constitutes a major fitness-affecting decision often involving social learning leading to copying the preference of other individuals (i.e., mate copying). While mate copying exists in many taxa, its underlying neurobiological mechanisms remain virtually unknown. Here, we show in Drosophila melanogaster that the rutabaga gene is necessary to support mate copying. Rutabaga encodes an adenylyl cyclase (AC-Rut+) acting as a coincidence detector in associative learning. Since the brain localization requirements for AC-Rut+ expression differ in classical and operant learning, we determine the functional localization of AC-Rut+ for mate copying by artificially rescuing the expression of AC-Rut+ in neural subsets of a rutabaga mutant. We found that AC-Rut+ has to be expressed in the mushroom bodies' Kenyon cells (KCs), specifically in the γ-KCs subset. Thus, this form of discriminative social learning requires the same KCs as non-social Pavlovian learning, suggesting that pathways of social and asocial learning overlap significantly.

Ecological and evolutionary consequences of selective interspecific information use

Recent work has shown that animals frequently use social information from individuals of their own species as well as from other species; however, the ecological and evolutionary consequences of this social information use remain poorly understood. Additionally, information users may be selective in their social information use, deciding from whom and how to use information, but this has been overlooked in an interspecific context. In particular, the intentional decision to reject a behaviour observed via social information has received less attention, although recent work has indicated its presence in various taxa. Based on existing literature, we explore in which circumstances selective interspecific information use may lead to different ecological and coevolutionary outcomes between two species, such as explaining observed co-occurrences of putative competitors. The initial ecological differences and the balance between the costs of competition and the benefits of social information use potentially determine whether selection may lead to trait divergence, convergence or coevolutionary arms race between two species. We propose that selective social information use, including adoption and rejection of behaviours, may have far-reaching fitness consequences, potentially leading to community-level eco-evolutionary outcomes. We argue that these consequences of selective interspecific information use may be much more widespread than has thus far been considered.

Judgement bias may be explained by shifts in stimulus response curves

Judgement bias, or 'optimism' and 'pessimism', has been demonstrated across many taxa, yet the cognitive mechanisms underlying this behaviour remain unclear. In an optimism paradigm, animals are trained to an association, and, if given a positive experience, behave more favourably towards 'ambiguous' stimuli. We tested whether this effect could be explained by changes to stimulus response gradients by giving bees a task where their response was tested across a wider gradient of stimuli than typically tested. In line with previous work, we found that bees given a positive experience demonstrated judgement bias, being more likely to visit ambiguous stimuli. However, bees were also less likely to visit a stimulus on the other side of the rewarded stimulus (S+), and as such had a shifted stimulus response curve, showing a diminished peak shift response. In two follow-up experiments we tested the hypothesis that our manipulation altered bees' stimulus response curves via changes to the peak shift response by reducing peak shift in controls. We found that, in support of our hypothesis, elimination of peak shift also eliminated differences between treatments. Our results point towards a cognitive explanation of 'optimistic' behaviour in non-human animals and offer a new paradigm for considering emotion-like states.

Learning and memory in the orange head cockroach (Eublaberus posticus)

This paper describes two experiments aimed at establishing the orange head cockroach (Eublaberus posticus) as a model organism for behavioral research. While many invertebrate models are available, cockroaches have several benefits over others that show impressive behavioral abilities. Most notably, cockroaches are long-lived generalists that can be maintained in controlled indoor laboratory conditions. While the most popular cockroaches in behavioral research, Periplaneta americana and Blattella germanica, have the potential to become domestic pests, our E. posticus is extremely unlikely to escape or infest a human environment, making it a very practical species. In our first experiment, we investigated the ability of E. posticus to associate novel odors with appetitive and aversive solutions. They quickly learned to approach odors associated with a dog food sucrose solution and learned to avoid odors associated with salt water. The second experiment repeated the methods of the first experiment, while also testing retained preferences for conditioned odors, from 15 to 1,215 minutes after the conditioning procedure ended. We found that preferences for odors associated with food were strongest 45 minutes after training, then decreased as a function of time. Our work is the first to show associative learning and memory in the orange head cockroach. Findings are discussed in comparison to other invertebrate models as well as to other cockroach research.

Female fruit flies copy the acceptance, but not the rejection, of a mate

Acceptance and avoidance can be socially transmitted, especially in the case of mate choice. When a Drosophila melanogaster female observes a conspecific female (called demonstrator female) choosing to mate with one of two males, the former female (called observer female) can memorize and copy the latter female’s choice. Traditionally in mate-copying experiments, demonstrations provide two types of information to observer females, namely, the acceptance (positive) of one male and the rejection of the other male (negative). To disentangle the respective roles of positive and negative information in Drosophila mate copying, we performed experiments in which demonstrations provided only one type of information at a time. We found that positive information alone is sufficient to trigger mate copying. Observer females preferred males of phenotype A after watching a female mating with a male of phenotype A in the absence of any other male. Contrastingly, negative information alone (provided by a demonstrator female actively rejecting a male of phenotype B) did not affect future observer females’ mate choice. These results suggest that the informative part of demonstrations in Drosophila mate-copying experiments lies mainly, if not exclusively, in the positive information provided by the copulation with a given male. We discuss the reasons for such a result and suggest that Drosophila females learn to prefer the successful males, implying that the underlying learning mechanisms may be shared with those of appetitive memory in non-social associative learning.

Interindividual variation in the use of social information during learning in honeybees

Slow-fast differences in cognition among individuals have been proposed to be an outcome of the speed-accuracy trade-off in decision-making. Based on the different costs associated with acquiring information via individual and social learning, we hypothesized that slow-fast cognitive differences would also be tied to the adoption of these different learning modes. Since foragers in honeybee colonies likely have both these information acquisition modes available to them, we chose to test them for interindividual differences in individual and social learning. By measuring performance on a learning task with and without a social cue and quantifying learning rate and maximum accuracy in these two tasks, our results show the existence of a speed-accuracy trade-off in both the individual and the social learning contexts. However, the trade-off is steeper during individual learning, which was slower than social learning but led to higher accuracy. Most importantly, our results also show that bees that attained high accuracy on the individual learning task had low accuracy on the social learning task and vice versa. We discuss how these two information acquisition strategies tie to slow-fast differences in cognitive phenotypes and how they might contribute to division of labour and social behaviour.

Beyond social learning

Cultural evolution requires the social transmission of information. For this reason, scholars have emphasized social learning when explaining how and why culture evolves. Yet cultural evolution results from many mechanisms operating in concert. Here, we argue that the emphasis on social learning has distracted scholars from appreciating both the full range of mechanisms contributing to cultural evolution and how interactions among those mechanisms and other factors affect the output of cultural evolution. We examine understudied mechanisms and other factors and call for a more inclusive programme of investigation that probes multiple levels of the organization, spanning the neural, cognitive-behavioural and populational levels. To guide our discussion, we focus on factors involved in three core topics of cultural evolution: the emergence of culture, the emergence of cumulative cultural evolution and the design of cultural traits. Studying mechanisms across levels can add explanatory power while revealing gaps and misconceptions in our knowledge. This article is part of the theme issue 'Foundations of cultural evolution'.

Foraging Bumblebees Selectively Attend to Other Types of Bees Based on Their Reward-Predictive Value

Using social information can be an efficient strategy for learning in a new environment while reducing the risks associated with trial-and-error learning. Whereas social information from conspecifics has long been assumed to be preferentially attended by animals, heterospecifics can also provide relevant information. Because different species may vary in their informative value, using heterospecific social information indiscriminately can be ineffective and even detrimental. Here, we evaluated how selective use of social information might arise at a proximate level in bumblebees (Bombus terrestris) as a result of experience with demonstrators differing in their visual appearance and in their informative value as reward predictors. Bumblebees were first trained to discriminate rewarding from unrewarding flowers based on which type of "heterospecific" (one of two differently painted model bees) was next to each flower. Subsequently, these bumblebees were exposed to a novel foraging context with two live painted bees. In this novel context, observer bumblebees showed significantly more social information-seeking behavior towards the type of bees that had predicted reward during training. Bumblebees were not attracted by paint-marked small wooden balls (moved via magnets) or paint-marked non-pollinating heterospecifics (woodlice; Porcellio laevis) in the novel context, indicating that bees did not simply respond to conditioned color cues nor to irrelevant social cues, but rather had a "search image" of what previously constituted a valuable, versus invaluable, information provider. The behavior of our bumblebees suggests that their use of social information is governed by learning, is selective, and extends beyond conspecifics.

Social learning exploits the available auditory or visual cues

The ability to acquire a behavior can be facilitated by exposure to a conspecific demonstrator. Such social learning occurs under a range of conditions in nature. Here, we tested the idea that social learning can benefit from any available sensory cue, thereby permitting learning under different natural conditions. The ability of naïve gerbils to learn a sound discrimination task following 5 days of exposure adjacent to a demonstrator gerbil was tested in the presence or absence of visual cues. Naïve gerbils acquired the task significantly faster in either condition, as compared to controls. We also found that exposure to a demonstrator was more potent in facilitating learning, as compared to exposure to the sounds used to perform the discrimination task. Therefore, social learning was found to be flexible and equally efficient in the auditory or visual domains.

Route learning during tandem running in the rock ant Temnothorax albipennis

Many animals use information from conspecifics to change their behavior in adaptive ways. When a rock ant, Temnothorax albipennis, finds food, she returns to her colony and uses a method called tandem running to lead nestmates, one at a time, from the nest to the food. In this way, naive ants can learn the location of a food source. Less clear is whether they also learn navigational cues that guide them from nest to food, although this is often assumed. We tested this idea by tracing the routes of individually marked ants as they followed tandem runs to a feeder, returned to the nest, and later traveled independently back to the food. Our results show, for the first time, that tandem run followers learn specific routes from their leaders. Independent journeys back to the food source were significantly more similar to the routes on which the ants had been led, compared with the routes taken by other tandem runs. In contrast, the homeward journey did not resemble the tandem run route. These results are consistent with followers memorizing visual cues during the tandem run that are useful for recapitulating the outward journey, but not as effective when facing in the opposite direction on the homeward journey. We further showed that foraging routes improved through individual experience over multiple trips but not through the social transfer of route information via tandem running. We discuss our findings in relation to social learning and integration of individual and social information in ants.

The neural and computational systems of social learning

Learning the value of stimuli and actions from others - social learning - adaptively contributes to individual survival and plays a key role in cultural evolution. We review research across species targeting the neural and computational systems of social learning in both the aversive and appetitive domains. Social learning generally follows the same principles as self-experienced value-based learning, including computations of prediction errors and is implemented in brain circuits activated across task domains together with regions processing social information. We integrate neural and computational perspectives of social learning with an understanding of behaviour of varying complexity, from basic threat avoidance to complex social learning strategies and cultural phenomena.

The multi-dimensional nature of information drives prioritization of private over social information in ants

When personally gathered and socially acquired information conflict, animals often prioritize private information. We propose that this is because private information often contains details that social information lacks. We test this idea in an ant model. Ants using a food source learn its location and quality rapidly (private information), whereas pheromone trails (social information) provide good directional information, but lack reliable information about food quality. If this lack is indeed responsible for the choice of memory over pheromone trails, adding information that better food is available should cause foragers to switch their priority to social information. We show it does: while ants follow memory rather than pheromones when they conflict, adding unambiguous information about a better potential food source (a 2 µl droplet of good food) reverses this pattern, from 60% of ants following their memory to 75% following the pheromone trail. Using fluorescence microscopy, we demonstrate that food (and thus information) flows from fed workers to outgoing foragers, explaining the frequent contacts of ants on trails. Ants trained to poor food that contact nest-mates fed with good food are more likely to follow a trail than ants which received information about poor food. We conclude that social information may often be ignored because it lacks certain crucial dimensions, suggesting that information content is crucial for understanding how and when animals prioritize social and private information.

How does cognition shape social relationships?

The requirements of living in social groups, and forming and maintaining social relationships are hypothesized to be one of the major drivers behind the evolution of cognitive abilities. Most empirical studies investigating the relationships between sociality and cognition compare cognitive performance between species living in systems that differ in social complexity. In this review, we ask whether and how individuals benefit from cognitive skills in their social interactions. Cognitive abilities, such as perception, attention, learning, memory, and inhibitory control, aid in forming and maintaining social relationships. We investigate whether there is evidence that individual variation in these abilities influences individual variation in social relationships. We then consider the evolutionary consequences of the interaction between sociality and cognitive ability to address whether bi-directional relationships exist between the two, such that cognition can both shape and be shaped by social interactions and the social environment. In doing so, we suggest that social network analysis is emerging as a powerful tool that can be used to test for directional causal relationships between sociality and cognition. Overall, our review highlights the importance of investigating individual variation in cognition to understand how it shapes the patterns of social relationships.This article is part of the theme issue 'Causes and consequences of individual differences in cognitive abilities'.

Considerations for Insect Learning in Integrated Pest Management

The past 100 yr have seen dramatic philosophical shifts in our approach to controlling or managing pest species. The introduction of integrated pest management in the 1970s resulted in the incorporation of biological and behavioral approaches to preserve ecosystems and reduce reliance on synthetic chemical pesticides. Increased understanding of the local ecosystem, including its structure and the biology of its species, can improve efficacy of integrated pest management strategies. Pest management strategies incorporating insect learning paradigms to control insect pests or to use insects to control other pests can mediate risk to nontarget insects, including pollinators. Although our understanding of insect learning is in its early stages, efforts to integrate insect learning into pest management strategies have been promising. Due to considerable differences in cognitive abilities among insect species, a case-by-case assessment is needed for each potential application of insect learning within a pest management strategy.

The reach of gene-culture coevolution in animals

Culture (behaviour based on socially transmitted information) is present in diverse animal species, yet how it interacts with genetic evolution remains largely unexplored. Here, we review the evidence for gene-culture coevolution in animals, especially birds, cetaceans and primates. We describe how culture can relax or intensify selection under different circumstances, create new selection pressures by changing ecology or behaviour, and favour adaptations, including in other species. Finally, we illustrate how, through culturally mediated migration and assortative mating, culture can shape population genetic structure and diversity. This evidence suggests strongly that animal culture plays an important evolutionary role, and we encourage explicit analyses of gene-culture coevolution in nature.

Social foraging extends associative odor-food memory expression in an automated learning assay for Drosophila

Animals socially interact during foraging and share information about the quality and location of food sources. The mechanisms of social information transfer during foraging have been mostly studied at the behavioral level, and its underlying neural mechanisms are largely unknown. Fruit flies have become a model for studying the neural bases of social information transfer, because they provide a large genetic toolbox to monitor and manipulate neuronal activity, and they show a rich repertoire of social behaviors. Fruit flies aggregate, they use social information for choosing a suitable mating partner and oviposition site, and they show better aversive learning when in groups. However, the effects of social interactions on associative odor-food learning have not yet been investigated. Here we present an automated learning and memory assay for walking flies that allows studying the effect of group size on social interactions and on the formation and expression of associative odor-food memories. We found that both inter-fly attraction and the duration of odor-food memory expression increase with group size. We discuss possible behavioral and neural mechanisms of this social effect on odor-food memory expression. This study opens up opportunities to investigate how social interactions during foraging are relayed in the neural circuitry of learning and memory expression.

Rethinking foundations of language from a multidisciplinary perspective

The issue of language foundations has been of great controversy ever since it was first raised in Lenneberg's (1967) monograph Biological Foundations of Language. Based on a survey of recent findings relevant to the study of language acquisition and evolution, we propose that: (i) the biological predispositions for language are largely domain-general, not necessarily language-specific or human-unique; (ii) the socio-cultural environment of language serves as another important foundation of language, which helps shape language components, induce and drive language shift; and (iii) language must have coevolved with the cognitive mechanisms associated with it through intertwined biological and cultural evolution. In addition to theoretical issues, this paper also evaluates the primary approaches recently joining the endeavor of studying language foundations and evolution, including human experiments and computer simulations. Most of the evidence surveyed in this paper comes from a variety of disciplines, and methodology therein complements each other to form a global picture of language foundations. These reflect the complexity of the issue of language foundations and the necessity of taking a multidisciplinary perspective to address it.

Incubation environment impacts the social cognition of adult lizards

Recent work exploring the relationship between early environmental conditions and cognition has shown that incubation environment can influence both brain anatomy and performance in simple operant tasks in young lizards. It is currently unknown how it impacts other, potentially more sophisticated, cognitive processes. Social-cognitive abilities, such as gaze following and social learning, are thought to be highly adaptive as they provide a short-cut to acquiring new information. Here, we investigated whether egg incubation temperature influenced two aspects of social cognition, gaze following and social learning in adult reptiles (Pogona vitticeps). Incubation temperature did not influence the gaze following ability of the bearded dragons; however, lizards incubated at colder temperatures were quicker at learning a social task and faster at completing that task. These results are the first to show that egg incubation temperature influences the social cognitive abilities of an oviparous reptile species and that it does so differentially depending on the task. Further, the results show that the effect of incubation environment was not ephemeral but lasted long into adulthood. It could thus have potential long-term effects on fitness.

The evolution of cognitive mechanisms in response to cultural innovations

When humans and other animals make cultural innovations, they also change their environment, thereby imposing new selective pressures that can modify their biological traits. For example, there is evidence that dairy farming by humans favored alleles for adult lactose tolerance. Similarly, the invention of cooking possibly affected the evolution of jaw and tooth morphology. However, when it comes to cognitive traits and learning mechanisms, it is much more difficult to determine whether and how their evolution was affected by culture or by their use in cultural transmission. Here we argue that, excluding very recent cultural innovations, the assumption that culture shaped the evolution of cognition is both more parsimonious and more productive than assuming the opposite. In considering how culture shapes cognition, we suggest that a process-level model of cognitive evolution is necessary and offer such a model. The model employs relatively simple coevolving mechanisms of learning and data acquisition that jointly construct a complex network of a type previously shown to be capable of supporting a range of cognitive abilities. The evolution of cognition, and thus the effect of culture on cognitive evolution, is captured through small modifications of these coevolving learning and data-acquisition mechanisms, whose coordinated action is critical for building an effective network. We use the model to show how these mechanisms are likely to evolve in response to cultural phenomena, such as language and tool-making, which are associated with major changes in data patterns and with new computational and statistical challenges.