Aversive learning reduces aversive-reinforcer sensitivity in honey bees

Research on associative learning typically focuses on behavioral and neural changes in response to learned stimuli. In Pavlovian conditioning, changes in responsiveness to conditioned stimuli are crucial for demonstrating learning. A less explored, but equally important, question is whether learning can induce changes not only in the processing of conditioned stimuli but also in the processing of unconditioned stimuli. In this study, we addressed this question by combining reinforcer-sensitivity assays with Pavlovian conditioning in honey bees. We focused on aversive shock responsiveness, measuring the sting extension response to electric shocks of increasing voltage, and examined the effect of aversive olfactory conditioning-where bees learn to associate an odor with shock-on shock responsiveness. After experiencing electric shocks during conditioning, the bees showed a persistent decrease in responsiveness to lower voltages, observable three days after conditioning, indicating reduced shock sensitivity. This effect was specific to electric shock, as appetitive conditioning involving a sucrose reinforcer did not alter shock responsiveness, leaving shock sensitivity unchanged. These findings highlight a previously unexplored effect of associative learning on reinforcer sensitivity, demonstrating a lasting decrease of responsiveness to reinforcer intensities perceived as less relevant than that encountered during conditioning.

When the society dictates food search - Neural signalling underlying appetitive motivation in honey bees

In honey bees, appetitive motivation is primarily driven by the needs of the colony rather than individual needs. The regulation of appetitive behavior is achieved through the coordinated action of neuropeptides, hormones and biogenic amines, which integrate multiple signals to ensure appropriate appetitive responses. Dopamine signalling underpins a food-related wanting system that is sensitive to aversive experiences. The short neuropeptide F (sNPF) enhances appetitive responsiveness, food intake and behavioral and neural responsiveness to food-related odorants. Additionally, it facilitates appetitive learning and memory. On the contrary, tachykinin-related peptides (TRPs) inhibit appetitive responses. Physiological changes during the transition to the foraging state lead to distinct patterns of insulin and adipokinetic hormone (AKH) signaling, different from those seen in solitary insects, indicating that social life had significant consequences on the systems controlling appetitive motivation. Overall, studying the neural bases of appetitive behavior in bees reveals unique aspects that arise from their social lifestyle.

Dual roles of dopaminergic pathways in olfactory learning and memory in the oriental fruit fly, Bactrocera dorsalis

Dopamine (DA) is a key regulator of associative learning and memory in both vertebrates and invertebrates, and it is widely believed that DA plays a key role in aversive conditioning in invertebrates. However, the idea that DA is involved only in aversive conditioning has been challenged in recent studies on the fruit fly (Drosophila melanogaster), ants and crabs, suggesting diverse functions of DA modulation on associative plasticity. Here, we present the results of DA modulation in aversive olfactory conditioning with DEET punishment and appetitive olfactory conditioning with sucrose reward in the oriental fruit fly, Bactrocera dorsalis. Injection of DA receptor antagonist fluphenazine or chlorpromazine into these flies led to impaired aversive learning, but had no effect on the appetitive learning. DA receptor antagonists impaired both aversive and appetitive long-term memory retention. Interestingly, the impairment on appetitive memory was rescued not only by DA but also by octopamine (OA). Blocking the OA receptors also impaired the appetitive memory retention, but this impairment could only be rescued by OA, not by DA. Thus, we conclude that in B. dorsalis, OA and DA pathways mediate independently the appetitive and aversive learning, respectively. These two pathways, however, are organized in series in mediating appetitive memory retrieval with DA pathway being at upstream. Thus, OA and DA play dual roles in associative learning and memory retrieval, but their pathways are organized differently in these two cognitive processes - parallel organization for learning acquisition and serial organization for memory retrieval.

Sensing fear: fast and precise threat evaluation in human sensory cortex

Animal models of threat processing have evolved beyond the amygdala to incorporate a distributed neural network. In human research, evidence has intensified in recent years to challenge the canonical threat circuitry centered on the amygdala, urging revision of threat conceptualization. A strong surge of research into threat processing in the sensory cortex in the past decade has generated particularly useful insights to inform the reconceptualization. Here, synthesizing findings from both animal and human research, we highlight sensitive, specific, and adaptable threat representations in the sensory cortex, arising from experience-based sculpting of sensory coding networks. We thus propose that the human sensory cortex can drive smart (fast and precise) threat evaluation, producing threat-imbued sensory afferents to elicit network-wide threat responses.

A Sublethal Concentration of Sulfoxaflor Has Minimal Impact on Buff-Tailed Bumblebee (Bombus terrestris) Locomotor Behaviour under Aversive Conditioning

Pesticide exposure has been cited as a key threat to insect pollinators. Notably, a diverse range of potential sublethal effects have been reported in bee species, with a particular focus on effects due to exposure to neonicotinoid insecticides. Here, a purpose-built thermal-visual arena was used in a series of pilot experiments to assess the potential impact of approximate sublethal concentrations of the next generation sulfoximine insecticide sulfoxaflor (5 and 50 ppb) and the neonicotinoid insecticides thiacloprid (500 ppb) and thiamethoxam (10 ppb), on the walking trajectory, navigation and learning abilities of the buff-tailed bumblebee (Bombus terrestris audax) when subjected to an aversive conditioning task. The results suggest that only thiamethoxam prevents forager bees from improving in key training parameters (speed and distanced travelled) within the thermal visual arena. Power law analyses further revealed that a speed-curvature power law, previously reported as being present in the walking trajectories of bumblebees, is potentially disrupted under thiamethoxam (10 ppb) exposure, but not under sulfoxaflor or thiacloprid exposure. The pilot assay described provides a novel tool with which to identify subtle sublethal pesticide impacts, and their potential causes, on forager bees, that current ecotoxicological tests are not designed to assess.

Drug effect and addiction research with insects - From Drosophila to collective reward in honeybees

Animals and humans share similar reactions to the effects of addictive substances, including those of their brain networks to drugs. Our review focuses on simple invertebrate models, particularly the honeybee (Apis mellifera), and on the effects of drugs on bee behaviour and brain functions. The drug effects in bees are very similar to those described in humans. Furthermore, the honeybee community is a superorganism in which many collective functions outperform the simple sum of individual functions. The distribution of reward functions in this superorganism is unique - although sublimated at the individual level, community reward functions are of higher quality. This phenomenon of collective reward may be extrapolated to other animal species living in close and strictly organised societies, i.e. humans. The relationship between sociality and reward, based on use of similar parts of the neural network (social decision-making network in mammals, mushroom body in bees), suggests a functional continuum of reward and sociality in animals.

Honey bees can store and retrieve independent memory traces after complex experiences that combine appetitive and aversive associations

Real-world experiences do often mix appetitive and aversive events. Understanding the ability of animals to extract, store and use this information is an important issue in neurobiology. We used honey bees as model organism to study learning and memory after a differential conditioning that combines appetitive and aversive training trials. First of all, we describe an aversive conditioning paradigm that constitutes a clear opposite of the well known appetitive olfactory conditioning of the proboscis extension response. A neutral odour is presented paired with the bitter substance quinine. Aversive memory is evidenced later as an odour-specific impairment in appetitive conditioning. Then we tested the effect of mixing appetitive and aversive conditioning trials distributed along the same training session. Differential conditioning protocols like this were used before to study the ability to discriminate odours, however they were not focused on whether appetitive and aversive memories are formed. We found that after a differential conditioning, honey bees establish independent appetitive and aversive memories that do not interfere with each other during acquisition or storage. Finally, we moved the question forward to retrieval and memory expression to evaluate what happens when appetitive and the aversive learned odours are mixed during test. Interestingly, opposite memories compete in a way that they do not cancel each other out. Honey bees showed the ability to switch from expressing appetitive to aversive memory depending on their satiation level.

The disturbance leg-lift response (DLR): an undescribed behavior in bumble bees

BACKGROUND

Bumble bees, primarily Bombus impatiens and B. terrestris, are becoming increasingly popular organisms in behavioral ecology and comparative psychology research. Despite growing use in foraging and appetitive conditioning experiments, little attention has been given to innate antipredator responses and their ability to be altered by experience. In this paper, we discuss a primarily undescribed behavior, the disturbance leg-lift response (DLR). When exposed to a presumably threatening stimulus, bumble bees often react by lifting one or multiple legs. We investigated DLR across two experiments.

METHODS

In our first experiment, we investigated the function of DLR as a prerequisite to later conditioning research. We recorded the occurrence and sequence of DLR, biting and stinging in response to an approaching object that was either presented inside a small, clear apparatus containing a bee, or presented directly outside of the subject's apparatus. In our second experiment, we investigated if DLR could be altered by learning and experience in a similar manner to many other well-known bee behaviors. We specifically investigated habituation learning by repeatedly presenting a mild visual stimulus to samples of captive and wild bees.

RESULTS

The results of our first experiment show that DLR and other defensive behaviors occur as a looming object approaches, and that the response is greater when proximity to the object is lower. More importantly, we found that DLR usually occurs first, rarely precedes biting, and often precedes stinging. This suggests that DLR may function as a warning signal that a sting will occur. In our second experiment, we found that DLR can be altered as a function of habituation learning in both captive and wild bees, though the captive sample initially responded more. This suggests that DLR may be a suitable response for many other conditioning experiments.

Drosophila reward system - A summary of current knowledge

The fruit fly Drosophila melanogaster brain is the most extensively investigated model of a reward system in insects. Drosophila can discriminate between rewarding and punishing environmental stimuli and consequently undergo associative learning. Functional models, especially those modelling mushroom bodies, are constantly being developed using newly discovered information, adding to the complexity of creating a simple model of the reward system. This review aims to clarify whether its reward system also includes a hedonic component. Neurochemical systems that mediate the 'wanting' component of reward in the Drosophila brain are well documented, however, the systems that mediate the pleasure component of reward in mammals, including those involving the endogenous opioid and endocannabinoid systems, are unlikely to be present in insects. The mushroom body components exhibit differential developmental age and different functional processes. We propose a hypothetical hierarchy of the levels of reinforcement processing in response to particular stimuli, and the parallel processes that take place concurrently. The possible presence of activity-silencing and meta-satiety inducing levels in Drosophila should be further investigated.

Degradation of an appetitive olfactory memory via devaluation of sugar reward is mediated by 5-HT signaling in the honey bee

Conditioned taste aversion (CTA) learning induces the devaluation of a preferred food through its pairing with a stimulus inducing internal illness. In invertebrates, it is still unclear how this aversive learning impairs the memories of stimuli that had been associated with the appetitive food prior to its devaluation. Here we studied this phenomenon in the honey bee and characterized its neural underpinnings. We first trained bees to associate an odorant (conditioned stimulus, CS) with appetitive fructose solution (unconditioned stimulus, US) using a Pavlovian olfactory conditioning. We then subjected the bees that learned the association to a CTA training during which the antennal taste of fructose solution was contingent or not to the ingestion of quinine solution, which induces malaise a few hours after ingestion. Only the group experiencing contingent fructose stimulation and quinine-based malaise exhibited a decrease in responses to the fructose and a concomitant decrease in odor-specific retention in tests performed 23 h after the original odor conditioning. Furthermore, injection of dopamine- and serotonin-receptor antagonists after CTA learning revealed that this long-term decrease was mediated by serotonergic signaling as its blockade rescued both the responses to fructose and the odor-specific memory 23 h after conditioning. The impairment of a prior CS memory by subsequent CTA conditioning confirms that bees retrieve a devaluated US representation when presented with the CS. Our findings further highlight the importance of serotonergic signaling in aversive learning in the bee and uncover mechanisms underlying aversive memories induced by internal illness in invertebrates.

Honeybees generalize among pollen scents from plants flowering in the same seasonal period

When honey bees (Apis mellifera) feed on flowers, they extend their proboscis to absorb the nectar, i.e. they perform the proboscis extension response (PER). The presence of pollen and/or nectar can be associated with odors, colors or visual patterns, which allows honey bees to recognize food sources in the environment. Honey bees can associate similar, though different, stimuli with the presence of food; i.e. honey bees discriminate and generalize among stimuli. Here, we evaluated generalization among pollen scents from six different plant species. Experiments were based on the PER conditioning protocol over two phases: (1) conditioning, in which honey bees associated the scent of each pollen type with sucrose, and (2) test, in which honey bees were presented with a novel scent, to evaluate generalization. Generalization was evinced by honey bees extending their proboscis to a novel scent. The level of PER increased over the course of the conditioning phase for all pollen scents. Honey bees generalized pollen from Pyracantha coccinea and from Hypochaeris radicata These two plants have different amounts of protein and are not taxonomically related. We observed that the flowering period influences the olfactory perceptual similarity and we suggest that both pollen types may share volatile compounds that play key roles in perception. Our results highlight the importance of analyzing the implications of the generalization between pollen types of different nutritional quality. Such studies could provide valuable information for beekeepers and agricultural producers, as the generalization of a higher quality pollen can benefit hive development, and increase pollination and honey production.

Inhibitory learning of phototaxis by honeybees in a passive-avoidance task

Honeybees are a standard model for the study of appetitive learning and memory. Yet, fewer attempts have been performed to characterize aversive learning and memory in this insect and uncover its molecular underpinnings. Here, we took advantage of the positive phototactic behavior of bees kept away from the hive in a dark environment and established a passive-avoidance task in which they had to suppress positive phototaxis. Bees placed in a two-compartment box learned to inhibit spontaneous attraction to a compartment illuminated with blue light by associating and entering into that chamber with shock delivery. Inhibitory learning resulted in an avoidance memory that could be retrieved 24 h after training and that was specific to the punished blue light. The memory was mainly operant but involved a Pavlovian component linking the blue light and the shock. Coupling conditioning with transcriptional analyses in key areas of the brain showed that inhibitory learning of phototaxis leads to an up-regulation of the dopaminergic receptor gene Amdop1 in the calyces of the mushroom bodies, consistently with the role of dopamine signaling in different forms of aversive learning in insects. Our results thus introduce new perspectives for uncovering further cellular and molecular underpinnings of aversive learning and memory in bees. Overall, they represent an important step toward comparative learning studies between the appetitive and the aversive frameworks.

Aversive Training of Honey Bees in an Automated Y-Maze

Honeybees have remarkable learning abilities given their small brains, and have thus been established as a powerful model organism for the study of learning and memory. Most of our current knowledge is based on appetitive paradigms, in which a previously neutral stimulus (e.g., a visual, olfactory, or tactile stimulus) is paired with a reward. Here, we present a novel apparatus, the yAPIS, for aversive training of walking honey bees. This system consists in three arms of equal length and at 120° from each other. Within each arm, colored lights (λ = 375, 465 or 520 nm) or odors (here limonene or linalool) can be delivered to provide conditioned stimuli (CS). A metal grid placed on the floor and roof delivers the punishment in the form of mild electric shocks (unconditioned stimulus, US). Our training protocol followed a fully classical procedure, in which the bee was exposed sequentially to a CS paired with shocks (CS+) and to another CS not punished (CS-). Learning performance was measured during a second phase, which took advantage of the Y-shape of the apparatus and of real-time tracking to present the bee with a choice situation, e.g., between the CS+ and the CS-. Bees reliably chose the CS- over the CS+ after only a few training trials with either colors or odors, and retained this memory for at least a day, except for the shorter wavelength (λ = 375 nm) that produced mixed results. This behavior was largely the result of the bees avoiding the CS+, as no evidence was found for attraction to the CS-. Interestingly, trained bees initially placed in the CS+ spontaneously escaped to a CS- arm if given the opportunity, even though they could never do so during the training. Finally, honey bees trained with compound stimuli (color + odor) later avoided either components of the CS+. Thus, the yAPIS is a fast, versatile and high-throughput way to train honey bees in aversive paradigms. It also opens the door for controlled laboratory experiments investigating bimodal integration and learning, a field that remains in its infancy.

Foraging Experiences Durably Modulate Honey Bees' Sucrose Responsiveness and Antennal Lobe Biogenic Amine Levels

Foraging exposes organisms to rewarding and aversive events, providing a selective advantage for maximizing the former while minimizing the latter. Honey bees (Apis mellifera) associate environmental stimuli with appetitive or aversive experiences, forming preferences for scents, locations, and visual cues. Preference formation is influenced by inter-individual variation in sensitivity to rewarding and aversive stimuli, which can be modulated by pharmacological manipulation of biogenic amines. We propose that foraging experiences act on biogenic amine pathways to induce enduring changes to stimulus responsiveness. To simulate varied foraging conditions, freely-moving bees were housed in cages where feeders offered combinations of sucrose solution, floral scents, and aversive electric shock. Transient effects were excluded by providing bees with neutral conditions for three days prior to all subsequent assays. Sucrose responsiveness was reduced in bees that had foraged for scented rather than unscented sucrose under benign conditions. This was not the case under aversive foraging conditions, suggesting an adaptive tuning process which maximizes preference for high quality, non-aversive floral sites. Foraging conditions also influenced antennal lobe octopamine and serotonin, neuromodulators involved in stimulus responsiveness and foraging site evaluation. Our results suggest that individuals’ foraging experiences durably modify neurochemistry and shape future foraging behaviour.

One-trial learning in larval Drosophila

Animals of many species are capable of “small data” learning, that is, of learning without repetition. Here we introduce larval Drosophila melanogaster as a relatively simple study case for such one-trial learning. Using odor-food associative conditioning, we first show that a sugar that is both sweet and nutritious (fructose) and sugars that are only sweet (arabinose) or only nutritious (sorbitol) all support appetitive one-trial learning. The same is the case for the optogenetic activation of a subset of dopaminergic neurons innervating the mushroom body, the memory center of the insects. In contrast, no one-trial learning is observed for an amino acid reward (aspartic acid). As regards the aversive domain, one-trial learning is demonstrated for high-concentration sodium chloride, but is not observed for a bitter tastant (quinine). Second, we provide follow-up, parametric analyses of odor-fructose learning. Specifically, we ascertain its dependency on the number and duration of training trials, the requirements for the behavioral expression of one-trial odor-fructose memory, its temporal stability, and the feasibility of one-trial differential conditioning. Our results set the stage for a neurogenetic analysis of one-trial learning and define the requirements for modeling mnemonic processes in the larva.

Aversive Foraging Conditions Modulate Downstream Social Food Sharing

Eusocial insects divide their labour so that individuals working inside the nest are affected by external conditions through a cascade of social interactions. Honey bees (Apis mellifera) transfer food and information via mouth-to-mouth social feeding, ie trophallaxis, a process known to be modulated by the rate of food flow at feeders and familiarity of food's scent. Little is understood about how aversive foraging conditions such as predation and con-specific competition affect trophallaxis. We hypothesized that aversive conditions have an impact on food transfer inside the colony. Here we explore the effect of foragers' aversive experience on downstream trophallaxis in a cage paradigm. Each cage contained one group of bees that was separated from feeders by mesh and allowed to feed only through trophallaxis, and another group that had access to feeders and self-specialized to either forage or distribute food. Our results show that aversive foraging conditions increase non-foragers' trophallaxis with bees restricted from feeder access when food is scented, and have the opposite effect when food is unscented. We discuss potential behavioural mechanisms and implications for the impact of aversive conditions such as malaise inducing toxins, predation, and con-specific competition.

Connectomics and function of a memory network: the mushroom body of larval Drosophila

The Drosophila larva is a relatively simple, 10 000-neuron study case for learning and memory with enticing analytical power, combining genetic tractability, the availability of robust behavioral assays, the opportunity for single-cell transgenic manipulation, and an emerging synaptic connectome of its complete central nervous system. Indeed, although the insect mushroom body is a much-studied memory network, the connectome revealed that more than half of the classes of connection within the mushroom body had escaped attention. The connectome also revealed circuitry that integrates, both within and across brain hemispheres, higher-order sensory input, intersecting valence signals, and output neurons that instruct behavior. Further, it was found that activating individual dopaminergic mushroom body input neurons can have a rewarding or a punishing effect on olfactory stimuli associated with it, depending on the relative timing of this activation, and that larvae form molecularly dissociable short-term, long-term, and amnesia-resistant memories. Together, the larval mushroom body is a suitable study case to achieve a nuanced account of molecular function in a behaviorally meaningful memory network.

Associative Learning of Stimuli Paired and Unpaired With Reinforcement: Evaluating Evidence From Maggots, Flies, Bees, and Rats

Finding rewards and avoiding punishments are powerful goals of behavior. To maximize reward and minimize punishment, it is beneficial to learn about the stimuli that predict their occurrence, and decades of research have provided insight into the brain processes underlying such associative reinforcement learning. In addition, it is well known in experimental psychology, yet often unacknowledged in neighboring scientific disciplines, that subjects also learn about the stimuli that predict the absence of reinforcement. Here we evaluate evidence for both these learning processes. We focus on two study cases that both provide a baseline level of behavior against which the effects of associative learning can be assessed. Firstly, we report pertinent evidence from Drosophila larvae. A re-analysis of the literature reveals that through paired presentations of an odor A and a sugar reward (A+) the animals learn that the reward can be found where the odor is, and therefore show an above-baseline preference for the odor. In contrast, through unpaired training (A/+) the animals learn that the reward can be found precisely where the odor is not, and accordingly these larvae show a below-baseline preference for it (the same is the case, with inverted signs, for learning through taste punishment). In addition, we present previously unpublished data demonstrating that also during a two-odor, differential conditioning protocol (A+/B) both these learning processes take place in larvae, i.e., learning about both the rewarded stimulus A and the non-rewarded stimulus B (again, this is likewise the case for differential conditioning with taste punishment). Secondly, after briefly discussing published evidence from adult Drosophila, honeybees, and rats, we report an unpublished data set showing that relative to baseline behavior after truly random presentations of a visual stimulus A and punishment, rats exhibit memories of opposite valence upon paired and unpaired training. Collectively, the evidence conforms to classical findings in experimental psychology and suggests that across species animals associatively learn both through paired and through unpaired presentations of stimuli with reinforcement – with opposite valence. While the brain mechanisms of unpaired learning for the most part still need to be uncovered, the immediate implication is that using unpaired procedures as a mnemonically neutral control for associative reinforcement learning may be leading analyses astray.

Nociceptive Biology of Molluscs and Arthropods: Evolutionary Clues About Functions and Mechanisms Potentially Related to Pain

Important insights into the selection pressures and core molecular modules contributing to the evolution of pain-related processes have come from studies of nociceptive systems in several molluscan and arthropod species. These phyla, and the chordates that include humans, last shared a common ancestor approximately 550 million years ago. Since then, animals in these phyla have continued to be subject to traumatic injury, often from predators, which has led to similar adaptive behaviors (e.g., withdrawal, escape, recuperative behavior) and physiological responses to injury in each group. Comparisons across these taxa provide clues about the contributions of convergent evolution and of conservation of ancient adaptive mechanisms to general nociceptive and pain-related functions. Primary nociceptors have been investigated extensively in a few molluscan and arthropod species, with studies of long-lasting nociceptive sensitization in the gastropod, Aplysia, and the insect, Drosophila, being especially fruitful. In Aplysia, nociceptive sensitization has been investigated as a model for aversive memory and for hyperalgesia. Neuromodulator-induced, activity-dependent, and axotomy-induced plasticity mechanisms have been defined in synapses, cell bodies, and axons of Aplysia primary nociceptors. Studies of nociceptive sensitization in Drosophila larvae have revealed numerous molecular contributors in primary nociceptors and interacting cells. Interestingly, molecular contributors examined thus far in Aplysia and Drosophila are largely different, but both sets overlap extensively with those in mammalian pain-related pathways. In contrast to results from Aplysia and Drosophila, nociceptive sensitization examined in moth larvae (Manduca) disclosed central hyperactivity but no obvious peripheral sensitization of nociceptive responses. Squid (Doryteuthis) show injury-induced sensitization manifested as behavioral hypersensitivity to tactile and especially visual stimuli, and as hypersensitivity and spontaneous activity in nociceptor terminals. Temporary blockade of nociceptor activity during injury subsequently increased mortality when injured squid were exposed to fish predators, providing the first demonstration in any animal of the adaptiveness of nociceptive sensitization. Immediate responses to noxious stimulation and nociceptive sensitization have also been examined behaviorally and physiologically in a snail (Helix), octopus (Adopus), crayfish (Astacus), hermit crab (Pagurus), and shore crab (Hemigrapsus). Molluscs and arthropods have systems that suppress nociceptive responses, but whether opioid systems play antinociceptive roles in these phyla is uncertain.

Smoke Conditions Affect the Release of the Venom Droplet Accompanying Sting Extension in Honey Bees (Hymenoptera: Apidae)

Honey bees (Apis mellifera) (Hymenoptera: Apidae) are social insects that have evolved a coordinated defensive response to ensure colony survival. Their nests may contain valuable resources such as pollen and nectar that are attractive to a range of insect and mammalian intruders and need protecting. With sufficient provocation, honey bees will mobilize and sting intruders, who are likely to incur additional stings. To inspect and manage their colonies, beekeepers apply smoke to decrease the likelihood of being stung. The use of smoke is a ubiquitous beekeeping practice, but the reasons behind its efficacy remain unknown. In this study, we examined the effects of smoke on honey bee defensive behavior by assessing individual sting extension responses under smoke conditions. We applied a brief voltage to the bee, ranging from a mild to a strong perturbation, and assessed four components of the sting extension reflex using two types of smoke. We found that smoke did not influence the probability of sting extension, but it did affect whether a venom droplet was released with the stinger. The venom droplet was more likely to be released at higher voltage levels, but this effect was significantly reduced under smoke conditions. Based on these results, we propose that the venom droplet coincides with greater agitation in individual bees; and smoke reduces the probability of its release. We speculate that the venom droplet serves to amplify the sting alarm pheromone, and smoke, in its ability to reduce droplet formation, may indicate that less alarm pheromone is released.

Pheromones modulate responsiveness to a noxious stimulus in honey bees

Pheromones are chemical substances released into the environment by an individual, which trigger stereotyped behaviors and/or physiological processes in individuals of the same species. Yet, a novel hypothesis has suggested that pheromones not only elicit innate responses but also contribute to behavioral plasticity by affecting the subjective evaluation of appetitive or aversive stimuli. To test this hypothesis, we exposed bees to three pheromonal components whose valence was either negative (i.e. associated with aversive events: isopentyl acetate and 2-heptanone) or positive (i.e. associated with appetitive events: geraniol). We then determined the effect of this exposure on the subjective evaluation of aversive stimuli by quantifying responsiveness to a series of increasing electric shock voltages before and after exposure. Two experiments were conducted varying the time lapse between shock series (15 min in experiment 1, and 24 h in experiment 2). In experiment 1, we observed a general decrease of shock responsiveness caused by fatigue, due to the short lapse of time between the two series of shocks. This decrease could only be counteracted by isopentyl acetate. The enhancing effect of isopentyl acetate on shock responsiveness was also found in experiment 2. Conversely, geraniol decreased aversive responsiveness in this experiment; 2-heptanone did not affect aversive responsiveness in any experiment. Overall, our results demonstrate that certain pheromones modulate the salience of aversive stimuli according to their valence. In this way, they would affect the motivation to engage in aversive responses, thus acting as modulators of behavioral plasticity.

Visual discrimination transfer and modulation by biogenic amines in honeybees

For more than a century, visual learning and memory has been studied in the honeybee Apis mellifera using operant appetitive conditioning. Although honeybees show impressive visual learning capacities in this well-established protocol, operant training of free-flying animals can hardly be combined with invasive protocols for studying the neurobiological basis of visual learning. In view of that, different efforts have been made to develop new classical conditioning protocols for studying visual learning in harnessed honeybees, though learning performances remain considerably poorer than those obtained in free-flying animals. Here we investigated the ability of honeybees to use visual information acquired during classical conditioning in a new operant context. We performed differential visual conditioning of the proboscis extension reflex (PER) followed by visual orientation tests in Y-maze. Classical conditioning and Y-maze retention tests were performed using a same pair of perceptually isoluminant monochromatic stimuli, to avoid the influence of phototaxis during free-flying orientation. Visual discrimination transfer was clearly observed, with pre-trained honeybees significantly orienting their flights towards the former positive conditioned stimulus (CS+). We thus show that visual memories acquired by honeybees are resistant to context changes between conditioning and retention test. We combined this visual discrimination approach with selective pharmacological injections to evaluate the effect of dopamine and octopamine in appetitive visual learning. Both octopaminergic and dopaminergic antagonists impaired visual discrimination performances, suggesting that both these biogenic amines modulate appetitive visual learning in honeybees. Our study brings new insights into cognitive and neurobiological mechanisms underlying visual learning in honeybees.

A Tyrosine-Hydroxylase Characterization of Dopaminergic Neurons in the Honey Bee Brain

Dopamine (DA) plays a fundamental role in insect behavior as it acts both as a general modulator of behavior and as a value system in associative learning where it mediates the reinforcing properties of unconditioned stimuli (US). Here we aimed at characterizing the dopaminergic neurons in the central nervous system of the honey bee, an insect that serves as an established model for the study of learning and memory. We used tyrosine hydroxylase (TH) immunoreactivity (ir) to ensure that the neurons detected synthesize DA endogenously. We found three main dopaminergic clusters, C1-C3, which had been previously described; the C1 cluster is located in a small region adjacent to the esophagus (ES) and the antennal lobe (AL); the C2 cluster is situated above the C1 cluster, between the AL and the vertical lobe (VL) of the mushroom body (MB); the C3 cluster is located below the calyces (CA) of the MB. In addition, we found a novel dopaminergic cluster, C4, located above the dorsomedial border of the lobula, which innervates the visual neuropils of the bee brain. Additional smaller processes and clusters were found and are described. The profuse dopaminergic innervation of the entire bee brain and the specific connectivity of DA neurons, with visual, olfactory and gustatory circuits, provide a foundation for a deeper understanding of how these sensory modules are modulated by DA, and the DA-dependent value-based associations that occur during associative learning.

Pavlovian Conditioning of Larval Drosophila: An Illustrated, Multilingual, Hands-On Manual for Odor-Taste Associative Learning in Maggots

Larval Drosophila offer a study case for behavioral neurogenetics that is simple enough to be experimentally tractable, yet complex enough to be worth the effort. We provide a detailed, hands-on manual for Pavlovian odor-reward learning in these animals. Given the versatility of Drosophila for genetic analyses, combined with the evolutionarily shared genetic heritage with humans, the paradigm has utility not only in behavioral neurogenetics and experimental psychology, but for translational biomedicine as well. Together with the upcoming total synaptic connectome of the Drosophila nervous system and the possibilities of single-cell-specific transgene expression, it offers enticing opportunities for research. Indeed, the paradigm has already been adopted by a number of labs and is robust enough to be used for teaching in classroom settings. This has given rise to a demand for a detailed, hands-on manual directed at newcomers and/or at laboratory novices, and this is what we here provide.

The paradigm and the present manual have a unique set of features:

The present manual can thus foster science education at an earlier age and enable research by a broader community than has been the case to date.

In search of evidence for the experience of pain in honeybees: A self-administration study

Despite their common use as model organisms in scientific experiments, pain and suffering in insects remains controversial and poorly understood. Here we explore potential pain experience in honeybees (Apis mellifera) by testing the self-administration of an analgesic drug. Foragers were subjected to two different types of injuries: (i) a clip that applied continuous pressure to one leg and (ii) amputation of one tarsus. The bees were given a choice between two feeders, one offering pure sucrose solution, the other sucrose solution plus morphine. We found that sustained pinching had no effect on the amount of morphine consumed, and hence is unlikely to be experienced as painful. The amputated bees did not shift their relative preference towards the analgesic either, but consumed more morphine and more solution in total compared to intact controls. While our data do not provide evidence for the self-administration of morphine in response to pain, they suggest that injured bees increase their overall food intake, presumably to meet the increased energy requirements for an immune response caused by wounding. We conclude that further experiments are required to gain insights into potential pain-like states in honeybees and other insects.

Losing without Fighting - Simple Aversive Stimulation Induces Submissiveness Typical for Social Defeat via the Action of Nitric Oxide, but Only When Preceded by an Aggression Priming Stimulus

Losing a fight (social defeat) induces submissiveness and behavioral depression in many animals, but the mechanisms are unclear. Here we investigate how the social defeat syndrome can be established as a result of experiencing aversive stimuli and the roles of neuromodulators in the process. While biogenic amines and nitric oxide (NO) are associated with reduced aggression in mammals and insects, their specific actions during conflict are unknown. Although the social defeat syndrome normally results from complex interactions, we could induce it in male crickets simply by applying aversive stimuli (AS) in an aggressive context. Aggressive crickets became immediately submissive and behaved like losers after experiencing two brief AS (light wind puffs to the cerci), but only when preceded by a priming stimulus (PS, stroking the antenna with another male antenna). Notably, submissiveness was not induced when the PS preceded the AS by more than 1 min, or when the PS followed the AS, or using a female antenna as the preceding stimulus. These findings suggest that any potentially detrimental stimulus can acquire the attribute of an aversive agonistic signal when experienced in an aggressive context. Crickets, it seems, need only to evaluate their net sensory impact rather than the qualities of a variety of complex agonistic signals. Selective drug treatments revealed that NO, but not serotonin, dopamine or octopamine, is necessary to establish the submissive status following pairing of the priming and aversive stimuli. Moreover, treatment with an NO donor also induced the social defeat syndrome, but only when combined with the PS. This confirms our hypothesis that aversive agonistic experiences accumulated by crickets during fighting invoke social defeat via the action of NO and illustrates that a relatively simple mechanism underlies the seemingly complex social decision to flee. The simple stimulus regime described here for inducing social defeat opens new avenues for investigating the cellular control of subordinate behavior and post-conflict depression.

Aversive learning of odor-heat associations in ants

Ants have recently emerged as useful models for the study of olfactory learning. In this framework, the development of a protocol for the appetitive conditioning of the maxilla-labium extension response (MaLER) provided the possibility of studying Pavlovian odor-food learning in a controlled environment. Here we extend these studies by introducing the first Pavlovian aversive learning protocol for harnessed ants in the laboratory. We worked with carpenter ants Camponotus aethiops and first determined the capacity of different temperatures applied to the body surface to elicit the typical aversive mandible opening response (MOR). We determined that 75°C is the optimal temperature to induce MOR and chose the hind legs as the stimulated body region due to their high sensitivity. We then studied the ability of ants to learn and remember odor-heat associations using 75°C as unconditioned stimulus. We studied learning and short-term retention after absolute (one odor paired with heat) and differential conditioning (a punished odor versus an unpunished odor). Our results show that ants successfully learn the odor-heat association under a differential-conditioning regime and thus exhibit conditioned MOR to the punished odor. Yet, their performance under an absolute-conditioning regime is poor. These results demonstrate that ants are capable of aversive learning and confirm previous findings about the different attentional resources solicited by differential and absolute conditioning in general.

Operant Conditioning in Honey Bees (Apis mellifera L.): The Cap Pushing Response

The honey bee has been an important model organism for studying learning and memory. More recently, the honey bee has become a valuable model to understand perception and cognition. However, the techniques used to explore psychological phenomena in honey bees have been limited to only a few primary methodologies such as the proboscis extension reflex, sting extension reflex, and free flying target discrimination-tasks. Methods to explore operant conditioning in bees and other invertebrates are not as varied as with vertebrates. This may be due to the availability of a suitable response requirement. In this manuscript we offer a new method to explore operant conditioning in honey bees: the cap pushing response (CPR). We used the CPR to test for difference in learning curves between novel auto-shaping and more traditional explicit-shaping. The CPR protocol requires bees to exhibit a novel behavior by pushing a cap to uncover a food source. Using the CPR protocol we tested the effects of both explicit-shaping and auto-shaping techniques on operant conditioning. The goodness of fit and lack of fit of these data to the Rescorla-Wagner learning-curve model, widely used in classical conditioning studies, was tested. The model fit well to both control and explicit-shaping results, but only for a limited number of trials. Learning ceased rather than continuing to asymptotically approach the physiological most accurate possible. Rate of learning differed between shaped and control bee treatments. Learning rate was about 3 times faster for shaped bees, but for all measures of proficiency control and shaped bees reached the same level. Auto-shaped bees showed one-trial learning rather than the asymptotic approach to a maximal efficiency. However, in terms of return-time, the auto-shaped bees’ learning did not carry over to the covered-well test treatments.

Appetitive but not aversive olfactory conditioning modifies antennal movements in honeybees

In honeybees, two olfactory conditioning protocols allow the study of appetitive and aversive Pavlovian associations. Appetitive conditioning of the proboscis extension response (PER) involves associating an odor, the conditioned stimulus (CS) with a sucrose solution, the unconditioned stimulus (US). Conversely, aversive conditioning of the sting extension response (SER) involves associating the odor CS with an electric or thermal shock US. Each protocol is based on the measure of a different behavioral response (proboscis versus sting) and both only provide binary responses (extension or not of the proboscis or sting). These limitations render the measure of the acquired valence of an odor CS difficult without testing the animals in a freely moving situation. Here, we studied the effects of both olfactory conditioning protocols on the movements of the antennae, which are crucial sensory organs for bees. As bees' antennae are highly mobile, we asked whether their movements in response to an odorant change following appetitive or aversive conditioning and if so, do odor-evoked antennal movements contain information about the acquired valence of the CS? We implemented a tracking system for harnessed bees' antennal movements based on a motion capture principle at a high frequency rate. We observed that differential appetitive conditioning had a strong effect on antennal movements. Bees responded to the reinforced odorant with a marked forward motion of the antennae and a strong velocity increase. Conversely, differential aversive conditioning had no associative effect on antennal movements. Rather than revealing the acquired valence of an odorant, antennal movements may represent a novel conditioned response taking place during appetitive conditioning and may provide a possible advantage to bees when foraging in natural situations.

Heat Perception and Aversive Learning in Honey Bees: Putative Involvement of the Thermal/Chemical Sensor AmHsTRPA

The recent development of the olfactory conditioning of the sting extension response (SER) has provided new insights into the mechanisms of aversive learning in honeybees. Until now, very little information has been gained concerning US detection and perception. In the initial version of SER conditioning, bees learned to associate an odor CS with an electric shock US. Recently, we proposed a modified version of SER conditioning, in which thermal stimulation with a heated probe is used as US. This procedure has the advantage of allowing topical US applications virtually everywhere on the honeybee body. In this study, we made use of this possibility and mapped thermal responsiveness on the honeybee body, by measuring workers' SER after applying heat on 41 different structures. We then show that bees can learn the CS-US association even when the heat US is applied on body structures that are not prominent sensory organs, here the vertex (back of the head) and the ventral abdomen. Next, we used a neuropharmalogical approach to evaluate the potential role of a recently described Transient Receptor Potential (TRP) channel, HsTRPA, on peripheral heat detection by bees. First, we applied HsTRPA activators to assess if such activation is sufficient for triggering SER. Second, we injected HsTRPA inhibitors to ask whether interfering with this TRP channel affects SER triggered by heat. These experiments suggest that HsTRPA may be involved in heat detection by bees, and represent a potential peripheral detection system in thermal SER conditioning.

Steep Decline and Cessation in Seed Dispersal by Myrmica rubra Ants

Myrmecochorous diaspores bear a nutrient-rich appendage, the elaiosome, attractive to ant workers that retrieve them into the nest, detach the elaiosome and reject the seed intact. While this interaction is beneficial for the plant partner by ensuring its seed dispersal, elaiosome consumption has various effects −positive, negative or none − on ants’ demography and survival, depending on both the ant/plant species involved. In this context, the contribution of ants to seed dispersal strongly varies according to the ant/plant pairs considered. In this paper, we investigate whether the dynamics of myrmecochory also vary on a temporal scale, for a given pair of partners: Myrmica rubra ants and Viola odorata seeds. During their first encounter with seeds, ants collect all the diaspores and eat the majority of elaiosomes. Both the harvesting effort and the elaiosome consumption decline when seeds are offered on the next week and completely cease for the following weeks. This is related to a decrease in the number of foragers reaching the food source, as well as to a reduced probability for an ant contacting a seed to retrieve it. Seed retrieval is not reactivated after seven weeks without any encounter with V. odorata seeds. By contrast, naive ant colonies only fed with fruit flies do not show a decline of prey harvesting of which the speed of retrieval even increases over the successive weeks. Myrmecochory may thus be labile at the scale of a fruiting season due to the ability of ants to steeply tune and cease for several months the harvesting of these seemingly poorly rewarding items and to maintain cessation of seed exploitation. The present study emphasizes the importance of a long-lasting follow up of the myrmecochory process, to assess the stability of this ant-plant partnership and to identify mechanisms of adaptive harvesting in ants.

Non-mammalian models in behavioral neuroscience: consequences for biological psychiatry

Current models in biological psychiatry focus on a handful of model species, and the majority of work relies on data generated in rodents. However, in the same sense that a comparative approach to neuroanatomy allows for the identification of patterns of brain organization, the inclusion of other species and an adoption of comparative viewpoints in behavioral neuroscience could also lead to increases in knowledge relevant to biological psychiatry. Specifically, this approach could help to identify conserved features of brain structure and behavior, as well as to understand how variation in gene expression or developmental trajectories relates to variation in brain and behavior pertinent to psychiatric disorders. To achieve this goal, the current focus on mammalian species must be expanded to include other species, including non-mammalian taxa. In this article, we review behavioral neuroscientific experiments in non-mammalian species, including traditional "model organisms" (zebrafish and Drosophila) as well as in other species which can be used as "reference." The application of these domains in biological psychiatry and their translational relevance is considered.

The neonicotinoid imidacloprid impairs honey bee aversive learning of simulated predation

Neonicotinoid insecticides can impair bee learning and memory--cognitive features that play a key role in colony fitness because they facilitate foraging. For example, the commonly used neonicotinoid imidacloprid reduces honey bee olfactory learning. However, no studies have previously determined whether imidacloprid can impair aversive associative learning, although such learning should enhance bee survival by allowing bees to avoid dangerous foraging sites. To mimic attempted predation of foragers, we developed an electro-mechanical predator that consistently attacked foragers with a pinching bite at a fixed force and elicited aversive olfactory learning in a sting extension response (SER) assay. We show that chronic exposure to a sublethal concentration of imidacloprid (25.6 µg l(-1)=20.8 ppb) over 4 days (mean of 1.5 ng per bee day(-1)), significantly impaired aversive short-term learning and memory retention. Imidacloprid treatment reduced short-term learning by 87% and memory retention by 85% in comparison with control bees. Imidacloprid therefore impairs the ability of honey bees to associate a naturalistic predation stimulus--biting--with floral odor compounds. Such learning should enhance bee survival, suggesting that xenobiotics could alter more complex ecological interactions such as predator-prey relationships.

The concepts of representation and information in explanatory theories of human behavior

Focusing in experimental study of human behavior, this article discusses the concepts of information and mental representation aiming the integration of their biological, computational, and semantic aspects. Assuming that the objective of any communication process is ultimately to modify the receiver's state, the term correlational information is proposed as a measure of how changes occurring in external world correlate with changes occurring inside an individual. Mental representations are conceptualized as a special case of information processing in which correlational information is received, recorded, but also modified by a complex emergent process of associating new elements. In humans, the acquisition of information and creation of mental representations occurs in a two-step process. First, a sufficiently complex brain structure is necessary to establishing internal states capable to co-vary with external events. Second, the validity or meaning of these representations must be gradually achieved by confronting them with the environment. This contextualization can be considered as part of the process of ascribing meaning to information and representations. The hypothesis introduced here is that the sophisticated psychological constructs classically associated with the concept of mental representation are essentially of the same nature of simple interactive behaviors. The capacity of generating elaborated mental phenomena like beliefs and desires emerges gradually during evolution and, in a given individual, by learning and social interaction.

Ethanol-induced effects on sting extension response and punishment learning in the western honey bee (Apis mellifera)

Acute ethanol administration is associated with sedation and analgesia as well as behavioral disinhibition and memory loss but the mechanisms underlying these effects remain to be elucidated. During the past decade, insects have emerged as important model systems to understand the neural and genetic bases of alcohol effects. However, novel assays to assess ethanol's effects on complex behaviors in social or isolated contexts are necessary. Here we used the honey bee as an especially relevant model system since bees are typically exposed to ethanol in nature when collecting standing nectar crop of flowers, and there is recent evidence for independent biological significance of this exposure for social behavior. Bee's inhibitory control of the sting extension response (SER) and a conditioned-place aversion assay were used to study ethanol effects on analgesia, behavioral disinhibition, and associative learning. Our findings indicate that although ethanol, in a dose-dependent manner, increases SER thresholds (analgesic effects), it disrupts the ability of honey bees to inhibit SER and to associate aversive stimuli with their environment. These results suggest that ethanol's effects on analgesia, behavioral disinhibition and associative learning are common across vertebrates and invertebrates. These results add to the use of honey bees as an ethanol model to understand ethanol's effects on complex, socially relevant behaviors.

Genotypic influence on aversive conditioning in honeybees, using a novel thermal reinforcement procedure

In Pavlovian conditioning, animals learn to associate initially neutral stimuli with positive or negative outcomes, leading to appetitive and aversive learning respectively. The honeybee (Apis mellifera) is a prominent invertebrate model for studying both versions of olfactory learning and for unraveling the influence of genotype. As a queen bee mates with about 15 males, her worker offspring belong to as many, genetically-different patrilines. While the genetic dependency of appetitive learning is well established in bees, it is not the case for aversive learning, as a robust protocol was only developed recently. In the original conditioning of the sting extension response (SER), bees learn to associate an odor (conditioned stimulus - CS) with an electric shock (unconditioned stimulus - US). This US is however not a natural stimulus for bees, which may represent a potential caveat for dissecting the genetics underlying aversive learning. We thus first tested heat as a potential new US for SER conditioning. We show that thermal stimulation of several sensory structures on the bee’s body triggers the SER, in a temperature-dependent manner. Moreover, heat applied to the antennae, mouthparts or legs is an efficient US for SER conditioning. Then, using microsatellite analysis, we analyzed heat sensitivity and aversive learning performances in ten worker patrilines issued from a naturally inseminated queen. We demonstrate a strong influence of genotype on aversive learning, possibly indicating the existence of a genetic determinism of this capacity. Such determinism could be instrumental for efficient task partitioning within the hive.

Individual responsiveness to shock and colony-level aggression in honey bees: evidence for a genetic component

The phenotype of the social group is related to phenotypes of individuals that form that society. We examined how honey bee colony aggressiveness relates to individual response of male drones and foraging workers. Although the natural focus in colony aggression has been on the worker caste, the sterile females engaged in colony maintenance and defense, males carry the same genes. We measured aggressiveness scores of colonies and examined components of individual aggressive behavior in workers and haploid sons of workers from the same colony. We describe for the first time, that males, although they have no stinger, do bend their abdomen (abdominal flexion) in a posture similar to stinging behavior of workers in response to electric shock. Individual worker sting response and movement rates in response to shock were significantly correlated with colony scores. In the case of drones, sons of workers from the same colonies, abdominal flexion significantly correlated but their movement rates did not correlate with colony aggressiveness. Furthermore, the number of workers responding at increasing levels of voltage exhibits a threshold-like response, whereas the drones respond in increasing proportion to shock. We conclude that there are common and caste-specific components to aggressive behavior in honey bees. We discuss implications of these results on social and behavioral regulation and genetics of aggressive response.

Pharmacological modulation of aversive responsiveness in honey bees

Within a honey bee colony, individuals performing different tasks exhibit different sensitivities to noxious stimuli. Noxious-stimulus sensitivity can be quantified in harnessed bees by measuring the sting extension response (SER) to a series of increasing voltages. Biogenic amines play a crucial role in the control of insect responsiveness. Whether or not these neurotransmitters affect the central control of aversive responsiveness, and more specifically of electric-shock responsiveness, remains unknown. Here we studied the involvement of the biogenic amines octopamine, dopamine and serotonin, and of the ecdysteroid 20-hydroxyecdisone in the central control of sting responsiveness to electric shocks. We injected pharmacological antagonists of these signaling pathways into the brain of harnessed bees and determined the effect of blocking these different forms of neurotransmission on shock responsiveness. We found that both octopamine and 20-hydroxyecdisone are dispensable for shock responsiveness while dopamine and serotonin act as down-regulators of sting responsiveness. As a consequence, antagonists of these two biogenic amines induce an increase in shock responsiveness to shocks of intermediate voltage; serotonin, can also increase non-specific responsiveness. We suggest that different classes of dopaminergic neurons exist in the bee brain and we define at least two categories: an instructive class mediating aversive labeling of conditioned stimuli in associative learning, and a global gain-control class which down-regulates responsiveness upon perception of noxious stimuli. Serotonergic signaling together with down-regulating dopaminergic signaling may play an essential role in attentional processes by suppressing responses to irrelevant, non-predictive stimuli, thereby allowing efficient behavioral performances.