Roles of octopaminergic and dopaminergic neurons in appetitive and aversive memory recall in an insect

Aversive social learning with a dead conspecific is achieved by Pavlovian conditioning in crickets

Social learning, learning from other individuals, has been demonstrated in many animals, including insects, but its detailed neural mechanisms remain virtually unknown. We showed that crickets (Gryllus bimaculatus) exhibit aversive social learning with a dead conspecific. When a learner cricket was trained to observe a dead cricket on a drinking apparatus, the learner avoided the odor of that apparatus thereafter. Here we investigated the hypothesis that this social learning is achieved by first-order Pavlovian conditioning of an odor (conditioned stimulus) and a dead conspecific (unconditioned stimulus, US). Injection of a dopamine receptor antagonist (flupentixol) before training or testing impaired the learning or execution of the response to the learned odor, as we reported in aversive non-social Pavlovian conditioning in crickets. Moreover, crickets that were trained with a dead conspecific and then received revaluation of the dead conspecific by pairing it with water reward exhibited an appetitive conditioned response (CR) to the odor paired with the dead conspecific. This suggests that execution of the CR is governed by the current value of the US as in non-social Pavlovian conditioning. In addition, we previously suggested that appetitive social learning with a living conspecific is based on second-order conditioning (SOC), and here we showed that SOC is achieved when crickets experienced pairing of a dead conspecific with water reward before experiencing social learning training with a dead conspecific. We conclude that social learning with a dead conspecific is based on Pavlovian conditioning and that this learning can be extended to second-order social learning.

Visuo-spatial compound stimuli discrimination with (Gryllus pennsylvanicus) in two-choices rewarding learning tasks

This paper proposes an experimental protocol allowing Gryllus pennsylvanicus to discriminate an A-A and A-B motif pairs of compound visual stimuli. Specifically, this study consists in an operant conditioning procedure including a dichotomous Y-maze, two different pairs of compound visual colored cues and a water reward. Results are conclusive for this visuo-spatial regularities study,(Gryllus pennsylvanicus) were able to significantly discriminate between the two compound visual patterns and learned the association with the reinforcer.

Goal-directed behavior in Tenebrio molitor larvae

Can signs of intentional behavior be traced in an insect larva, traditionally thought to be driven only by mere reflexes? We trained Tenebrio molitor coleoptera larvae in a uniform Y-maze to prefer one target branch to get access to food, observing their ability to learn and retain access to the reward-associated side for up to 24 h. During reward devaluation, the reward food (experimental group) and a different food (control group) were paired with an aversive stimulus in a new environment. When tested again in the Y-maze, mealworms of the experimental group significantly reduced their visits to the target branch, whereas mealworms of the control group did not. Importantly, we found that the larvae did not have to experience the unpleasant consequences directly in the target branch to halt their behavior, as the exposure to the aversive taste occurred in a separate unfamiliar context. This is evidence that the mealworms formed a mental representation of action-consequence relationships, demonstrating flexible control of their actions to achieve desired outcomes at an early stage of their development.

Independent operations of appetitive and aversive conditioning systems lead to simultaneous production of conflicting memories in an insect

Pavlovian conditioning is a ubiquitous form of associative learning that enables animals to remember appetitive and aversive experiences. Animals possess appetitive and aversive conditioning systems that memorize and retrieve appetitive and aversive experiences. Here, we addressed a question of whether integration of competing appetitive and aversive information takes place during the encoding of the experience or during memory retrieval. We developed novel experimental procedures to address this question using crickets (Gryllus bimaculatus), which allowed selective blockade of the expression of appetitive and aversive memories by injecting octopamine and dopamine receptor antagonists. We conditioned an odour (conditioned stimulus 1, CS1) with water and then with sodium chloride solution. At 24 h after conditioning, crickets retained both appetitive and aversive memories, and the memories were integrated to produce a conditioned response (CR). Importantly, when a visual pattern (CS2) was conditioned with CS1, appetitive and aversive memories formed simultaneously. This indicates that appetitive and aversive second-order conditionings are achieved at the same time. The memories were integrated for producing a conditioned response. We conclude that appetitive and aversive conditioning systems operate independently to form parallel appetitive and aversive memories, which compete to produce learned behaviour in crickets.

Octopamine in the mushroom body circuitry for learning and memory

Octopamine, the functional analog of noradrenaline, modulates many different behaviors and physiological processes in invertebrates. In the central nervous system, a few octopaminergic neurons project throughout the brain and innervate almost all neuropils. The center of memory formation in insects, the mushroom bodies, receive octopaminergic innervations in all insects investigated so far. Different octopamine receptors, either increasing or decreasing cAMP or calcium levels in the cell, are localized in Kenyon cells, further supporting the release of octopamine in the mushroom bodies. In addition, different mushroom body (MB) output neurons, projection neurons, and dopaminergic PAM cells are targets of octopaminergic neurons, enabling the modulation of learning circuits at different neural sites. For some years, the theory persisted that octopamine mediates rewarding stimuli, whereas dopamine (DA) represents aversive stimuli. This simple picture has been challenged by the finding that DA is required for both appetitive and aversive learning. Furthermore, octopamine is also involved in aversive learning and a rather complex interaction between these biogenic amines seems to modulate learning and memory. This review summarizes the role of octopamine in MB function, focusing on the anatomical principles and the role of the biogenic amine in learning and memory.

Roles of feedback and feed-forward networks of dopamine subsystems: insights from Drosophila studies

Across animal species, dopamine-operated memory systems comprise anatomically segregated, functionally diverse subsystems. Although individual subsystems could operate independently to support distinct types of memory, the logical interplay between subsystems is expected to enable more complex memory processing by allowing existing memory to influence future learning. Recent comprehensive ultrastructural analysis of the Drosophila mushroom body revealed intricate networks interconnecting the dopamine subsystems-the mushroom body compartments. Here, we review the functions of some of these connections that are beginning to be understood. Memory consolidation is mediated by two different forms of network: A recurrent feedback loop within a compartment maintains sustained dopamine activity required for consolidation, whereas feed-forward connections across compartments allow short-term memory formation in one compartment to open the gate for long-term memory formation in another compartment. Extinction and reversal of aversive memory rely on a similar feed-forward circuit motif that signals omission of punishment as a reward, which triggers plasticity that counteracts the original aversive memory trace. Finally, indirect feed-forward connections from a long-term memory compartment to short-term memory compartments mediate higher-order conditioning. Collectively, these emerging studies indicate that feedback control and hierarchical connectivity allow the dopamine subsystems to work cooperatively to support diverse and complex forms of learning.

Dual roles of dopaminergic pathways in olfactory learning and memory in the oriental fruit fly, Bactrocera dorsalis

Dopamine (DA) is a key regulator of associative learning and memory in both vertebrates and invertebrates, and it is widely believed that DA plays a key role in aversive conditioning in invertebrates. However, the idea that DA is involved only in aversive conditioning has been challenged in recent studies on the fruit fly (Drosophila melanogaster), ants and crabs, suggesting diverse functions of DA modulation on associative plasticity. Here, we present the results of DA modulation in aversive olfactory conditioning with DEET punishment and appetitive olfactory conditioning with sucrose reward in the oriental fruit fly, Bactrocera dorsalis. Injection of DA receptor antagonist fluphenazine or chlorpromazine into these flies led to impaired aversive learning, but had no effect on the appetitive learning. DA receptor antagonists impaired both aversive and appetitive long-term memory retention. Interestingly, the impairment on appetitive memory was rescued not only by DA but also by octopamine (OA). Blocking the OA receptors also impaired the appetitive memory retention, but this impairment could only be rescued by OA, not by DA. Thus, we conclude that in B. dorsalis, OA and DA pathways mediate independently the appetitive and aversive learning, respectively. These two pathways, however, are organized in series in mediating appetitive memory retrieval with DA pathway being at upstream. Thus, OA and DA play dual roles in associative learning and memory retrieval, but their pathways are organized differently in these two cognitive processes - parallel organization for learning acquisition and serial organization for memory retrieval.

Critical roles of nicotinic acetylcholine receptors in olfactory memory formation and retrieval in crickets

Acetylcholine (ACh) is a major excitatory neurotransmitter in the insect central nervous system, and insect neurons express several types of ACh receptors (AChRs). AChRs are classified into two subgroups, muscarinic AChRs and nicotinic AChRs (nAChRs). nAChRs are also divided into two subgroups by sensitivity to α-bungarotoxin (α-BGT). The cricket Gryllus bimaculatus is one of the useful insects for studying the molecular mechanisms in olfactory learning and memory. However, the roles of nAChRs in olfactory learning and memory of the cricket are still unknown. In the present study, to investigate whether nAChRs are involved in cricket olfactory learning and memory, we tested the effects of two different AChR antagonists on long-term memory (LTM) formation and retrieval in a behavioral assay. The two AChR antagonists that we used are mecamylamine (MEC), an α-BGT-insensitive nAChR antagonist, and methyllycaconitine (MLA), an α-BGT-sensitive nAChR antagonist. In crickets, multiple-trial olfactory conditioning induced 1-day memory (LTM), whereas single-trial olfactory conditioning induced 1-h memory (mid-term memory, MTM) but not 1-day memory. Crickets injected with MEC 20 min before the retention test at 1 day after the multiple-trial conditioning exhibited no memory retrieval. This indicates that α-BGT-insensitive nAChRs participate in memory retrieval. In addition, crickets injected with MLA before the multiple-trial conditioning exhibited MTM but not LTM, indicating that α-BGT-sensitive nAChRs participate in the formation of LTM. Moreover, injection of nicotine (an nAChR agonist) before the single-trial conditioning induced LTM. Finally, the nitric oxide (NO)-cGMP signaling pathway is known to participate in the formation of LTM in crickets, and we conducted co-injection experiments with an agonist or inhibitor of the nAChR and an activator or inhibitor of the NO-cGMP signaling pathway. The results suggest that nAChR works upstream of the NO-cGMP signaling system in the LTM formation process.

Minimal circuit motifs for second-order conditioning in the insect mushroom body

In well-established first-order conditioning experiments, the concurrence of a sensory cue with reinforcement forms an association, allowing the cue to predict future reinforcement. In the insect mushroom body, a brain region central to learning and memory, such associations are encoded in the synapses between its intrinsic and output neurons. This process is mediated by the activity of dopaminergic neurons that encode reinforcement signals. In second-order conditioning, a new sensory cue is paired with an already established one that presumably activates dopaminergic neurons due to its predictive power of the reinforcement. We explored minimal circuit motifs in the mushroom body for their ability to support second-order conditioning using mechanistic models. We found that dopaminergic neurons can either be activated directly by the mushroom body's intrinsic neurons or via feedback from the output neurons via several pathways. We demonstrated that the circuit motifs differ in their computational efficiency and robustness. Beyond previous research, we suggest an additional motif that relies on feedforward input of the mushroom body intrinsic neurons to dopaminergic neurons as a promising candidate for experimental evaluation. It differentiates well between trained and novel stimuli, demonstrating robust performance across a range of model parameters.

Roles of octopamine neurons in the vertical lobe of the mushroom body for the execution of a conditioned response in cockroaches

Aminergic neurons mediate reward signals in mammals and insects. In crickets, we showed that blockade of synaptic transmission from octopamine neurons (OANs) impairs conditioning of an odor (conditioned stimulus, CS) with water or sucrose (unconditioned stimulus, US) and execution of a conditioned response (CR) to the CS. It has not yet been established, however, whether findings in crickets can be applied to other species of insects. In this study, we investigated the roles of OANs in conditioning of salivation, monitored by activities of salivary neurons, and in execution of the CR in cockroaches (Periplaneta americana). We showed that injection of epinastine (an OA receptor antagonist) into the head hemolymph impaired both conditioning and execution of the CR, in accordance with findings in crickets. Moreover, local injection of epinastine into the vertical lobes of the mushroom body (MB), the center for associative learning and control of the CR, impaired execution of the CR, whereas injection of epinastine into the calyces of the MB or the antennal lobes (primary olfactory centers) did not. We propose that OANs in the MB vertical lobes play critical roles in the execution of the CR in cockroaches. This is analogous to the fact that midbrain dopamine neurons govern execution of learned actions in mammals.

Octopamine neurons mediate reward signals in social learning in an insect

Social learning is found in many animals, but its mechanisms are not understood. We previously showed that a cricket that was trained to observe a conspecific staying at a drinking apparatus exhibited an increased preference for the odor of that drinking apparatus. Here we investigated a hypothesis that this learning is achieved by second-order conditioning (SOC), i.e., by associating conspecifics at a drinking bottle with water reward during group drinking in the rearing stage and then associating an odor with a conspecific in training. Injection of an octopamine receptor antagonist before training or testing impaired the learning or response to the learned odor, as we reported for SOC, thereby supporting the hypothesis. Notably, the SOC hypothesis predicts that octopamine neurons that respond to water in the group-rearing stage also respond to a conspecific in training, without the learner itself drinking water, and such mirror-like activities mediate social learning. This awaits future investigation.

Hierarchical architecture of dopaminergic circuits enables second-order conditioning in Drosophila

Dopaminergic neurons with distinct projection patterns and physiological properties compose memory subsystems in a brain. However, it is poorly understood whether or how they interact during complex learning. Here, we identify a feedforward circuit formed between dopamine subsystems and show that it is essential for second-order conditioning, an ethologically important form of higher-order associative learning. The Drosophila mushroom body comprises a series of dopaminergic compartments, each of which exhibits distinct memory dynamics. We find that a slow and stable memory compartment can serve as an effective 'teacher' by instructing other faster and transient memory compartments via a single key interneuron, which we identify by connectome analysis and neurotransmitter prediction. This excitatory interneuron acquires enhanced response to reward-predicting odor after first-order conditioning and, upon activation, evokes dopamine release in the 'student' compartments. These hierarchical connections between dopamine subsystems explain distinct properties of first- and second-order memory long known by behavioral psychologists.

Octopaminergic neurons function in appetitive but not aversive olfactory learning and memory in Bactrocera dorsalis

The biogenic amine octopamine (OA, invertebrate counterpart of noradrenaline) plays critical roles in the regulation of olfactory behavior. Historically, OA has been thought to mediate appetitive but not aversive learning in honeybees, fruit flies (Drosophila), and crickets. However, this viewpoint has recently been challenged because OA activity through a β-adrenergic-like receptor drives both appetitive and aversive learning. Here, we explored the roles of OA neurons in olfactory learning and memory retrieval in Bactrocera dorsalis. We trained flies to associate an orange odor with a sucrose reward or to associate methyl eugenol, a male lure, with N,N-diethyl-3-methyl benzoyl amide (DEET) punishment. We then treated flies with OA receptor antagonists before appetitive or aversive conditioning and a memory retention test. Injection of OA receptor antagonist mianserin or epinastine into the abdomen of flies led to impaired of appetitive learning and memory retention with a sucrose reward, while aversive learning and memory retention with DEET punishment remained intact. Our results suggest that the OA signaling participates in appetitive but not aversive learning and memory retrieval in B. dorsalis through OA receptors.

Silencing tyrosine hydroxylase or dopa decarboxylase gene disrupts cuticle tanning during larva-pupa-adult transformation in Henosepilachna vigintioctopunctata

BACKGROUND

The 28-spotted potato ladybird, Henosepilachna vigintioctopunctata, is a notorious defoliator of many solanaceous and cucurbitaceous plants. Tyrosine hydroxylase (TH) and dopa decarboxylase (DDC) are responsible for cuticle tanning pathway in insects.

RESULTS

We identified HvTH and HvDDC in H. vigintioctopunctata, and found that high levels of them were accumulated just before or right after molting. Injection of dsHvTH or feeding 3-iodo-tyrosine (3-IT) at the third instar larval stage repressed tanning of the larval cuticle, reduced larval feeding, inhibited larval growth, and consequently caused 100% of larval mortality. Knockdown of HvDDC at the third instar larval stage hardly affected the coloration of larval head, and partially inhibited pigmentation of larval bodies and around 80% of the HvDDC RNAi larvae developed into albino pupae and adults. Moreover, depletion of HvTH or HvDDC at the fourth instar larval stage resulted in albino pupae and adults. The HvTH or HvDDC hypomorph adults fully or partially failed to remove the larval/pupal exuviae, possessed pale and abnormal wings, and poorly tanned heads and bodies, and eventually, struggled for several days without feeding on leaves before death.

CONCLUSION

These results show that TH and DDC play key roles in larval and adult cuticle tanning and development in H. vigintioctopunctata. Also, these findings suggest that dopa- and dopamine-originated pigments are essential for larval and adult feeding behavior and the molting process during emergence. © 2022 Society of Chemical Industry.

Conceptual framework for the insect metamorphosis from larvae to pupae by transcriptomic profiling, a case study of Helicoverpa armigera (Lepidoptera: Noctuidae)

BACKGROUND

Insect metamorphosis from larvae to pupae is one of the most important stages of insect life history. Relatively comprehensive information related to gene transcription profiles during lepidopteran metamorphosis is required to understand the molecular mechanism underlying this important stage. We conducted transcriptional profiling of the brain and fat body of the cotton bollworm Helicoverpa armigera (Lepidoptera: Noctuidae) during its transition from last instar larva into pupa to explore the physiological processes associated with different phases of metamorphosis.

RESULTS

During metamorphosis, the differences in gene expression patterns and the number of differentially expressed genes in the fat body were found to be greater than those in the brain. Each stage had a specific gene expression pattern, which contributed to different physiological changes. A decrease in juvenile hormone levels at the feeding stage is associated with increased expression levels of two genes (juvenile hormone esterase, juvenile hormone epoxide hydrolase). The expression levels of neuropeptides were highly expressed at the feeding stage and the initiation of the wandering stage and less expressed at the prepupal stage and the initiation of the pupal stage. The transcription levels of many hormone (or neuropeptide) receptors were specifically increased at the initiation of the wandering stage in comparison with other stages. The expression levels of many autophagy-related genes in the fat body were found to be gradually upregulated during metamorphosis. The activation of apoptosis was probably related to enhanced expression of many key genes (Apaf1, IAP-binding motif 1 like, cathepsins, caspases). Active proliferation might be associated with enhanced expression levels in several factors (JNK pathway: jun-D; TGF-β pathway: decapentaplegic, glass bottom boat; insulin pathway: insulin-like peptides from the fat body; Wnt pathway: wntless, TCF/Pangolin).

CONCLUSIONS

This study revealed several vital physiological processes and molecular events of metamorphosis and provided valuable information for illustrating the process of insect metamorphosis from larvae to pupae.

What Is Learned in Pavlovian Conditioning in Crickets? Revisiting the S-S and S-R Learning Theories

In Pavlovian conditioning in mammals, two theories have been proposed for associations underlying conditioned responses (CRs). One theory, called S-S theory, assumes an association between a conditioned stimulus (CS) and internal representation of an unconditioned stimulus (US), allowing the animal to adjust the CR depending on the current value of the US. The other theory, called S-R theory, assumes an association or connection between the CS center and the CR center, allowing the CS to elicit the CR. Whether these theories account for Pavlovian conditioning in invertebrates has remained unclear. In this article, results of our studies in the cricket Gryllus bimaculatus are reviewed. We showed that after a standard amount of Pavlovian training, crickets exhibited no response to odor CS when water US was devalued by providing it until satiation, whereas after extended training, they exhibited a CR after US devaluation. An increase of behavioral automaticity by extended training has not been reported in Pavlovian conditioning in any other animals, but it has been documented in instrumental conditioning in mammals. Our pharmacological analysis suggested that octopamine neurons mediate US (water) value signals and control execution of the CR after standard training. The control, however, diminishes with extension of training and hence the CR becomes insensitive to the US value. We also found that the nature of the habitual response after extended Pavlovian training in crickets is not the same as that after extended instrumental training in mammals concerning the context specificity. Adaptive significance and evolutionary implications for our findings are discussed.

Drosophila reward system - A summary of current knowledge

The fruit fly Drosophila melanogaster brain is the most extensively investigated model of a reward system in insects. Drosophila can discriminate between rewarding and punishing environmental stimuli and consequently undergo associative learning. Functional models, especially those modelling mushroom bodies, are constantly being developed using newly discovered information, adding to the complexity of creating a simple model of the reward system. This review aims to clarify whether its reward system also includes a hedonic component. Neurochemical systems that mediate the 'wanting' component of reward in the Drosophila brain are well documented, however, the systems that mediate the pleasure component of reward in mammals, including those involving the endogenous opioid and endocannabinoid systems, are unlikely to be present in insects. The mushroom body components exhibit differential developmental age and different functional processes. We propose a hypothetical hierarchy of the levels of reinforcement processing in response to particular stimuli, and the parallel processes that take place concurrently. The possible presence of activity-silencing and meta-satiety inducing levels in Drosophila should be further investigated.

Reduction of contextual control of conditioned responses by extended Pavlovian training in an insect

The effect of repetitive training on learned behavior has been an important subject in neuroscience. In instrumental conditioning in mammals, learned action early in training is often goal-driven and controlled by outcome expectancy, but as training progresses, it becomes more habitual and insensitive to outcome devaluation. Similarly, we recently showed in Pavlovian conditioning in crickets (Gryllus bimaculatus) that a conditioned response (CR) is initially sensitive to devaluation of the unconditioned stimulus but becomes insensitive to it after extended training. It is known that habitual responses after extended instrumental training are characterized by a higher context specificity than are initial goal-directed actions in mammals. In this study, we investigated whether this is applicable to Pavlovian conditioning in crickets. In crickets that received a standard amount of training to associate an odor with water reward under illumination, CR under illumination was stronger than that in the dark. In crickets that received extended training under illumination, on the other hand, the level of CR did not differ in different light conditions. Further experiments confirmed that context specificity decreases with the development of behavioral automaticity by extended training, as opposed to findings in instrumental training in mammals. We conclude that the nature of habitual behaviors after extended training differs in different learning systems of animals.

Appetitive and aversive social learning with living and dead conspecifics in crickets

Many animals acquire biologically important information from conspecifics. Social learning has been demonstrated in many animals, but there are few experimental paradigms that are suitable for detailed analysis of its associative processes. We established procedures for appetitive and aversive social learning with living and dead conspecifics in well-controlled stimulus arrangements in crickets, Gryllus bimaculatus. A thirsty demonstrator cricket was released in a demonstrator room and allowed to visit two drinking apparatuses that contained water or saltwater and emitted apple or banana odour, and a thirsty learner was allowed to observe the demonstrator room through a net. In the post-training test, the learner preferred the odour of the water-containing apparatus at which the demonstrator stayed. When a dead cricket was placed on one of the two apparatuses, the learner avoided the odour of that apparatus. Further experiments suggested that a living conspecific can be recognized by either visual or olfactory cues for appetitive social learning, whereas olfactory cues are needed to recognize a dead conspecific for aversive social learning, and that different associative processes underlie social learning with living and dead conspecifics. The experimental paradigms described here will pave the way for detailed research on the neural basis of social learning.

Role of Biogenic Amines in Oviposition by the Diamondback Moth, Plutella xylostella L

Oviposition is an important reproductive behavior that is triggered by mating in insects, and biogenic amines might be involved in its regulation. The effects of biogenic amines on oviposition have only been studied in a few insect species, and the findings to date have not been conclusive. In addition, there are few studies on the effects of biogenic amines on oviposition of the diamondback moth, Plutella xylostella L. Here, we tested how mating and biogenic amines regulate oviposition of P. xylostella by injecting amines and amine receptor antagonists into virgin and mated females and counting the number of eggs laid afterward. Biogenic amines of octopamine and tyramine could induce virgin adults of P. xylostella to lay eggs, while dopamine and serotonin had no such effect on oviposition. Furthermore, the octopamine antagonists mianserin, epinastine, and phentolamine inhibited oviposition by mated females. The tyramine antagonist yohimbine, dopamine antagonist SCH23390, and serotonin antagonist ketanserin did not block oviposition by mated females, and octopamine and tyramine-inducing oviposition by virgin females could be inhibited by the octopamine antagonists mianserin and epinastine instead of the tyramine antagonist yohimbine. We conclude that octopamine and its receptors are involved in mating-triggered oviposition in P. xylostella, while tyramine acts as a subsidiary. Further, the inducing effect of tyramine on oviposition is achieved via octopamine receptors instead of tyramine receptors. This experiment is helpful to further understand the role of biogenic amines in mating regulation and to provide a new strategy for controlling P. xylostella.

Development of behavioural automaticity by extended Pavlovian training in an insect

The effect of repetitive training on learned actions has been a major subject in behavioural neuroscience. Many studies of instrumental conditioning in mammals, including humans, suggested that learned actions early in training are goal-driven and controlled by outcome expectancy, but they become more automatic and insensitive to reduction in the value of the outcome after extended training. It was unknown, however, whether the development of value-insensitive behaviour also occurs by extended training of Pavlovian conditioning in any animals. Here we show that crickets Gryllus bimaculatus that had received minimal training to associate an odour with water (unconditioned stimulus, US) did not exhibit conditioned response (CR) to the odour when they were given water until satiation before the test, but those that had received extended training exhibited CR even when they were satiated with water. Further pharmacological experiments suggested that octopamine neurons, the invertebrate counterparts of noradrenaline neurons, mediate US value signals and control execution of CR after minimal training, but the control diminishes with the progress of training and hence the CR becomes insensitive to US devaluation. The results suggest that repetitive sensory experiences can lead to a change from a goal-driven response to a more automatic one in crickets.

Responsiveness to Sugar Solutions in the Moth Agrotis ipsilon: Parameters Affecting Proboscis Extension

Adult moths need energy and nutrients for reproducing and obtain them mainly by consuming flower nectar (a solution of sugars and other compounds). Gustatory perception gives them information on the plants they feed on. Feeding and food perception are integrated in the proboscis extension response, which occurs when their antennae touch a sugar solution. We took advantage of this reflex to explore moth sugar responsiveness depending on different parameters (i.e., sex, age, satiety, site of presentation, and composition of the solution). We observed that starvation but not age induced higher response rates to sucrose. Presentation of sucrose solutions in a randomized order confirmed that repeated sugar stimulations did not affect the response rate; however, animals were sometimes sensitized to water, indicating sucrose presentation might induce non-associative plasticity. Leg stimulation was much less efficient than antennal stimulation to elicit a response. Quinine prevented and terminated sucrose-elicited proboscis extension. Males but not females responded slightly more to sucrose than to fructose. Animals of either sex rarely reacted to glucose, but curiously, mixtures in which half sucrose or fructose were replaced by glucose elicited the same response rate than sucrose or fructose alone. Fructose synergized the response when mixed with sucrose in male but not female moths. This is consistent with the fact that nectars consumed by moths in nature are mixtures of these three sugars, which suggests an adaptation to nectar perception.

Inhibitory learning of phototaxis by honeybees in a passive-avoidance task

Honeybees are a standard model for the study of appetitive learning and memory. Yet, fewer attempts have been performed to characterize aversive learning and memory in this insect and uncover its molecular underpinnings. Here, we took advantage of the positive phototactic behavior of bees kept away from the hive in a dark environment and established a passive-avoidance task in which they had to suppress positive phototaxis. Bees placed in a two-compartment box learned to inhibit spontaneous attraction to a compartment illuminated with blue light by associating and entering into that chamber with shock delivery. Inhibitory learning resulted in an avoidance memory that could be retrieved 24 h after training and that was specific to the punished blue light. The memory was mainly operant but involved a Pavlovian component linking the blue light and the shock. Coupling conditioning with transcriptional analyses in key areas of the brain showed that inhibitory learning of phototaxis leads to an up-regulation of the dopaminergic receptor gene Amdop1 in the calyces of the mushroom bodies, consistently with the role of dopamine signaling in different forms of aversive learning in insects. Our results thus introduce new perspectives for uncovering further cellular and molecular underpinnings of aversive learning and memory in bees. Overall, they represent an important step toward comparative learning studies between the appetitive and the aversive frameworks.

A critical role for Dop1-mediated dopaminergic signaling in the plasticity of behavioral and neuronal responses to sex pheromone in a moth

Most animal species, including insects, are able to modulate their responses to sexual chemosignals and this flexibility originates from the remodeling of olfactory areas under the influence of dopaminergic system. In the moth Agrotis ipsilon, the behavioral response of males to the female-emitted sex pheromone increases throughout adult life and after a prior exposure to pheromone signal and this change is accompanied by an increase in neuronal sensitivity within the primary olfactory centers, the antennal lobes (ALs). To identify the underlying neuromodulatory mechanisms, we examined whether this age- and experience-dependent olfactory plasticity is mediated by dopamine (DA) through the Dop1 receptor, an ortholog of the vertebrate D1-type dopamine receptors, which is positively coupled to adenylyl cyclase. We cloned A. ipsilon Dop1 (AiDop1) which is expressed predominantly in brain and especially in ALs and its knockdown induced decreased AL cAMP amounts and altered sex pheromone-orientated flight. The levels of DA, AiDop1 expression and cAMP in ALs increased from the third day of adult life and at 24h and 48h following pre-exposure to sex pheromone and the dynamic of these changes correlated with the increased responsiveness to sex pheromone. These results demonstrate that Dop1 is required for the display of male sexual behavior and that age- and experience-related neuronal and behavioral changes are sustained by DA-Dop1 signaling that operates within ALs probably through cAMP-dependent mechanisms in A. ipsilon. Thus, this study expands our understanding of the neuromodulatory mechanisms underlying olfactory plasticity, mechanisms that appear to be highly conserved between insects and mammals.

Tyrosine hydroxylase-immunoreactive neurons in the mushroom body of the field cricket, Gryllus bimaculatus

The mushroom body of the insect brain participates in processing and integrating multimodal sensory information and in various forms of learning. In the field cricket, Gryllus bimaculatus, dopamine plays a crucial role in aversive memory formation. However, the morphologies of dopamine neurons projecting to the mushroom body and their potential target neurons, the Kenyon cells, have not been characterized. Golgi impregnations revealed two classes of Kenyon cells (types I and II) and five different types of extrinsic fibers in the mushroom body. Type I cells, which are further divided into two subtypes (types I core and I surface), extend their dendrites into the anterior calyx, whereas type II cells extend many bushy dendritic branches into the posterior calyx. Axons of the two classes bifurcate between the pedunculus and lobes to form the vertical, medial and γ lobes. Immunocytochemistry to tyrosine hydroxylase (TH), a rate-limiting enzyme in dopamine biosynthesis, revealed the following four distinct classes of neurons: (1) TH-SLP projecting to the distal vertical lobe; (2) TH-IP1 extending to the medial and γ lobes; (3) TH-IP2 projecting to the basal vertical lobe; and (4) a multiglomerular projection neuron invading the anterior calyx and the lateral horn (TH-MPN). We previously proposed a model in the field cricket in which the efficiency of synapses from Kenyon cells transmitting a relevant sensory stimulus to output neurons commanding an appropriate behavioral reaction can be modified by dopaminergic neurons mediating aversive signals and here, we provide putative neural substrates for the cricket's aversive learning. These will be instrumental in understanding the principle of aversive memory formation in this model species.

Application of a Prediction Error Theory to Pavlovian Conditioning in an Insect

Elucidation of the conditions in which associative learning occurs is a critical issue in neuroscience and comparative psychology. In Pavlovian conditioning in mammals, it is thought that the discrepancy, or error, between the actual reward and the predicted reward determines whether learning occurs. This theory stems from the finding of Kamin’s blocking effect, in which after pairing of a stimulus with an unconditioned stimulus (US), conditioning of a second stimulus is blocked when the two stimuli are presented in compound and paired with the same US. Whether this theory is applicable to any species of invertebrates, however, has remained unknown. We first showed blocking and one-trial blocking of Pavlovian conditioning in the cricket Gryllus bimaculatus, which supported the Rescorla–Wagner model but not attentional theories, the major competitive error-correction learning theories to account for blocking. To match the prediction error theory, a neural circuit model was proposed, and prediction from the model was tested: the results were consistent with the Rescorla–Wagner model but not with the retrieval theory, another competitive theory to account for blocking. The findings suggest that the Rescorla–Wagner model best accounts for Pavlovian conditioning in crickets and that the basic computation rule underlying Pavlovian conditioning in crickets is the same to those suggested in mammals. Moreover, results of pharmacological studies in crickets suggested that octopamine and dopamine mediate prediction error signals in appetitive and aversive conditioning, respectively. This was in contrast to the notion that dopamine mediates appetitive prediction error signals in mammals. The functional significance and evolutionary implications of these findings are discussed.

Signaling Pathways for Long-Term Memory Formation in the Cricket

Unraveling the molecular mechanisms underlying memory formation in insects and a comparison with those of mammals will contribute to a further understanding of the evolution of higher-brain functions. As it is for mammals, insect memory can be divided into at least two distinct phases: protein-independent short-term memory and protein-dependent long-term memory (LTM). We have been investigating the signaling pathway of LTM formation by behavioral-pharmacological experiments using the cricket Gryllus bimaculatus, whose olfactory learning and memory abilities are among the highest in insect species. Our studies revealed that the NO-cGMP signaling pathway, CaMKII and PKA play crucial roles in LTM formation in crickets. These LTM formation signaling pathways in crickets share a number of attributes with those of mammals, and thus we conclude that insects, with relatively simple brain structures and neural circuitry, will also be beneficial in exploratory experiments to predict the molecular mechanisms underlying memory formation in mammals.

Visual discrimination transfer and modulation by biogenic amines in honeybees

For more than a century, visual learning and memory has been studied in the honeybee Apis mellifera using operant appetitive conditioning. Although honeybees show impressive visual learning capacities in this well-established protocol, operant training of free-flying animals can hardly be combined with invasive protocols for studying the neurobiological basis of visual learning. In view of that, different efforts have been made to develop new classical conditioning protocols for studying visual learning in harnessed honeybees, though learning performances remain considerably poorer than those obtained in free-flying animals. Here we investigated the ability of honeybees to use visual information acquired during classical conditioning in a new operant context. We performed differential visual conditioning of the proboscis extension reflex (PER) followed by visual orientation tests in Y-maze. Classical conditioning and Y-maze retention tests were performed using a same pair of perceptually isoluminant monochromatic stimuli, to avoid the influence of phototaxis during free-flying orientation. Visual discrimination transfer was clearly observed, with pre-trained honeybees significantly orienting their flights towards the former positive conditioned stimulus (CS+). We thus show that visual memories acquired by honeybees are resistant to context changes between conditioning and retention test. We combined this visual discrimination approach with selective pharmacological injections to evaluate the effect of dopamine and octopamine in appetitive visual learning. Both octopaminergic and dopaminergic antagonists impaired visual discrimination performances, suggesting that both these biogenic amines modulate appetitive visual learning in honeybees. Our study brings new insights into cognitive and neurobiological mechanisms underlying visual learning in honeybees.

Roles of Octopamine and Dopamine Neurons for Mediating Appetitive and Aversive Signals in Pavlovian Conditioning in Crickets

Revealing neural systems that mediate appetite and aversive signals in associative learning is critical for understanding the brain mechanisms controlling adaptive behavior in animals. In mammals, it has been shown that some classes of dopamine neurons in the midbrain mediate prediction error signals that govern the learning process, whereas other classes of dopamine neurons control execution of learned actions. In this review, based on the results of our studies on Pavlovian conditioning in the cricket Gryllus bimaculatus and by referring to the findings in honey bees and fruit-flies, we argue that comparable aminergic systems exist in the insect brain. We found that administrations of octopamine (the invertebrate counterpart of noradrenaline) and dopamine receptor antagonists impair conditioning to associate an olfactory or visual conditioned stimulus (CS) with water or sodium chloride solution (appetitive or aversive unconditioned stimulus, US), respectively, suggesting that specific octopamine and dopamine neurons mediate appetitive and aversive signals, respectively, in conditioning in crickets. These findings differ from findings in fruit-flies. In fruit-flies, appetitive and aversive signals are mediated by different dopamine neuron subsets, suggesting diversity in neurotransmitters mediating appetitive signals in insects. We also found evidences of “blocking” and “auto-blocking” phenomena, which suggested that the prediction error, the discrepancy between actual US and predicted US, governs the conditioning in crickets and that octopamine neurons mediate prediction error signals for appetitive US. Our studies also showed that activations of octopamine and dopamine neurons are needed for the execution of an appetitive conditioned response (CR) and an aversive CR, respectively, and we, thus, proposed that these neurons mediate US prediction signals that drive appetitive and aversive CRs. Our findings suggest that the basic principles of functioning of aminergic systems in associative learning, i.e., to transmit prediction error signals for conditioning and to convey US prediction signals for execution of CR, are conserved among insects and mammals, on account of the fact that the organization of the insect brain is much simpler than that of the mammalian brain. Further investigation of aminergic systems that govern associative learning in insects should lead to a better understanding of commonalities and diversities of computational rules underlying associative learning in animals.

Roles of dopamine neurons in mediating the prediction error in aversive learning in insects

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. The prediction error theory has been proposed to account for the finding of a blocking phenomenon, in which pairing of a stimulus X with an unconditioned stimulus (US) could block subsequent association of a second stimulus Y to the US when the two stimuli were paired in compound with the same US. Evidence for this theory, however, has been imperfect since blocking can also be accounted for by competitive theories. We recently reported blocking in classical conditioning of an odor with water reward in crickets. We also reported an "auto-blocking" phenomenon in appetitive learning, which supported the prediction error theory and rejected alternative theories. The presence of auto-blocking also suggested that octopamine neurons mediate reward prediction error signals. Here we show that blocking and auto-blocking occur in aversive learning to associate an odor with salt water (US) in crickets, and our results suggest that dopamine neurons mediate aversive prediction error signals. We conclude that the prediction error theory is applicable to both appetitive learning and aversive learning in insects.

Male Psyllids Differentially Learn in the Context of Copulation

In the Asian citrus psyllid, Diaphorina citri Kuwayama, stimulatory cuticular hydrocarbons act as sex pheromone attractants. Male psyllids locate aggregations of females using those olfactory cues, as well as vibrational communication on the plant surface. Although previous research has indicated that learning plays a role in modulating female reproductive behaviors in psyllids, it is unknown whether males similarly use learning to increase the likelihood of copulatory success. We used an olfactometer-based bio-assay to study the effects of experience on male response to female odor. First, we compared male attraction to female odor in virgin and previously mated males. Second, we tested the effect of several modes of experience with a novel odor, vanillin, to determine whether mating, feeding, or general environmental exposure elicited a learned response. We found that male attraction to female odor significantly increased after mating experience. In addition, we found that males learn about odor specifically in the context of mating, rather than feeding or general exposure. Electrophysiological measurements of antennal response to odorants confirmed that mating status did not affect the sensitivity of the peripheral nervous system to volatile stimuli implicating learning at the level of the central nervous system. These results suggest that male response to female odor is not an entirely innate behavior. Males may require mating experience with female conspecifics to develop attraction to those olfactory cues produced by the female and in association with the female’s habitat. This adaptive plasticity may allow males to detect females in an ever-changing environment and promote diversification and further specialization on different host genotypes.

Aversive learning of odor-heat associations in ants

Ants have recently emerged as useful models for the study of olfactory learning. In this framework, the development of a protocol for the appetitive conditioning of the maxilla-labium extension response (MaLER) provided the possibility of studying Pavlovian odor-food learning in a controlled environment. Here we extend these studies by introducing the first Pavlovian aversive learning protocol for harnessed ants in the laboratory. We worked with carpenter ants Camponotus aethiops and first determined the capacity of different temperatures applied to the body surface to elicit the typical aversive mandible opening response (MOR). We determined that 75°C is the optimal temperature to induce MOR and chose the hind legs as the stimulated body region due to their high sensitivity. We then studied the ability of ants to learn and remember odor-heat associations using 75°C as unconditioned stimulus. We studied learning and short-term retention after absolute (one odor paired with heat) and differential conditioning (a punished odor versus an unpunished odor). Our results show that ants successfully learn the odor-heat association under a differential-conditioning regime and thus exhibit conditioned MOR to the punished odor. Yet, their performance under an absolute-conditioning regime is poor. These results demonstrate that ants are capable of aversive learning and confirm previous findings about the different attentional resources solicited by differential and absolute conditioning in general.

Activation of NO-cGMP Signaling Rescues Age-Related Memory Impairment in Crickets

Age-related memory impairment (AMI) is a common feature and a debilitating phenotype of brain aging in many animals. However, the molecular mechanisms underlying AMI are still largely unknown. The cricket Gryllus bimaculatus is a useful experimental animal for studying age-related changes in learning and memory capability; because the cricket has relatively short life-cycle and a high capability of olfactory learning and memory. Moreover, the molecular mechanisms underlying memory formation in crickets have been examined in detail. In the present study, we trained male crickets of different ages by multiple-trial olfactory conditioning to determine whether AMI occurs in crickets. Crickets 3 weeks after the final molt (3-week-old crickets) exhibited levels of retention similar to those of 1-week-old crickets at 30 min or 2 h after training; however they showed significantly decreased levels of 1-day retention, indicating AMI in long-term memory (LTM) but not in anesthesia-resistant memory (ARM) in olfactory learning of crickets. Furthermore, 3-week-old crickets injected with a nitric oxide (NO) donor, a cyclic GMP (cGMP) analog or a cyclic AMP (cAMP) analog into the hemolymph before conditioning exhibited a normal level of LTM, the same level as that in 1-week-old crickets. The rescue effect by NO donor or cGMP analog injection was absent when the crickets were injected after the conditioning. For the first time, an NO donor and a cGMP analog were found to antagonize the age-related impairment of LTM formation, suggesting that deterioration of NO synthase (NOS) or molecules upstream of NOS activation is involved in brain-aging processes.

Dopamine- and Tyrosine Hydroxylase-Immunoreactive Neurons in the Brain of the American Cockroach, Periplaneta americana

The catecholamine dopamine plays several vital roles in the central nervous system of many species, but its neural mechanisms remain elusive. Detailed neuroanatomical characterization of dopamine neurons is a prerequisite for elucidating dopamine’s actions in the brain. In the present study, we investigated the distribution of dopaminergic neurons in the brain of the American cockroach, Periplaneta americana, using two antisera: 1) an antiserum against dopamine, and 2) an antiserum against tyrosine hydroxylase (TH, an enzyme required for dopamine synthesis), and identified about 250 putatively dopaminergic neurons. The patterns of dopamine- and TH-immunoreactive neurons were strikingly similar, suggesting that both antisera recognize the same sets of “dopaminergic” neurons. The dopamine and TH antibodies intensively or moderately immunolabeled prominent brain neuropils, e.g. the mushroom body (memory center), antennal lobe (first-order olfactory center) and central complex (motor coordination center). All subdivisions of the mushroom body exhibit both dopamine and TH immunoreactivity. Comparison of immunolabeled neurons with those filled by dye injection revealed that a group of immunolabeled neurons with cell bodies near the calyx projects into a distal region of the vertical lobe, which is a plausible site for olfactory memory formation in insects. In the antennal lobe, ordinary glomeruli as well as macroglomeruli exhibit both dopamine and TH immunoreactivity. It is noteworthy that the dopamine antiserum labeled tiny granular structures inside the glomeruli whereas the TH antiserum labeled processes in the marginal regions of the glomeruli, suggesting a different origin. In the central complex, all subdivisions excluding part of the noduli and protocerebral bridge exhibit both dopamine and TH immunoreactivity. These anatomical findings will accelerate our understanding of dopaminergic systems, specifically in neural circuits underlying aversive memory formation and arousal, in insects.

Roles of OA1 octopamine receptor and Dop1 dopamine receptor in mediating appetitive and aversive reinforcement revealed by RNAi studies

Revealing reinforcing mechanisms in associative learning is important for elucidation of brain mechanisms of behavior. In mammals, dopamine neurons are thought to mediate both appetitive and aversive reinforcement signals. Studies using transgenic fruit-flies suggested that dopamine neurons mediate both appetitive and aversive reinforcements, through the Dop1 dopamine receptor, but our studies using octopamine and dopamine receptor antagonists and using Dop1 knockout crickets suggested that octopamine neurons mediate appetitive reinforcement and dopamine neurons mediate aversive reinforcement in associative learning in crickets. To fully resolve this issue, we examined the effects of silencing of expression of genes that code the OA1 octopamine receptor and Dop1 and Dop2 dopamine receptors by RNAi in crickets. OA1-silenced crickets exhibited impairment in appetitive learning with water but not in aversive learning with sodium chloride solution, while Dop1-silenced crickets exhibited impairment in aversive learning but not in appetitive learning. Dop2-silenced crickets showed normal scores in both appetitive learning and aversive learning. The results indicate that octopamine neurons mediate appetitive reinforcement via OA1 and that dopamine neurons mediate aversive reinforcement via Dop1 in crickets, providing decisive evidence that neurotransmitters and receptors that mediate appetitive reinforcement indeed differ among different species of insects.

Knockout crickets for the study of learning and memory: Dopamine receptor Dop1 mediates aversive but not appetitive reinforcement in crickets

Elucidation of reinforcement mechanisms in associative learning is an important subject in neuroscience. In mammals, dopamine neurons are thought to play critical roles in mediating both appetitive and aversive reinforcement. Our pharmacological studies suggested that octopamine and dopamine neurons mediate reward and punishment, respectively, in crickets, but recent studies in fruit-flies concluded that dopamine neurons mediates both reward and punishment, via the type 1 dopamine receptor Dop1. To resolve the discrepancy between studies in different insect species, we produced Dop1 knockout crickets using the CRISPR/Cas9 system and found that they are defective in aversive learning with sodium chloride punishment but not appetitive learning with water or sucrose reward. The results suggest that dopamine and octopamine neurons mediate aversive and appetitive reinforcement, respectively, in crickets. We suggest unexpected diversity in neurotransmitters mediating appetitive reinforcement between crickets and fruit-flies, although the neurotransmitter mediating aversive reinforcement is conserved. This study demonstrates usefulness of the CRISPR/Cas9 system for producing knockout animals for the study of learning and memory.

Roles of octopamine and dopamine in appetitive and aversive memory acquisition studied in olfactory conditioning of maxillary palpi extension response in crickets

Elucidation of reinforcing mechanisms for associative learning is an important subject in neuroscience. Based on results of our previous pharmacological studies in crickets, we suggested that octopamine and dopamine mediate reward and punishment signals, respectively, in associative learning. In fruit-flies, however, it was concluded that dopamine mediates both appetitive and aversive reinforcement, which differs from our suggestion in crickets. In our previous studies, the effect of conditioning was tested at 30 min after training or later, due to limitations of our experimental procedures, and thus the possibility that octopamine and dopamine were not needed for initial acquisition of learning was not ruled out. In this study we first established a conditioning procedure to enable us to evaluate acquisition performance in crickets. Crickets extended their maxillary palpi and vigorously swung them when they perceived some odors, and we found that crickets that received pairing of an odor with water reward or sodium chloride punishment exhibited an increase or decrease in percentages of maxillary palpi extension responses to the odor. Using this procedure, we found that octopamine and dopamine receptor antagonists impair acquisition of appetitive and aversive learning, respectively. This finding suggests that neurotransmitters mediating appetitive reinforcement differ in crickets and fruit-flies.

Characterization of a tyramine receptor type 2 from hemocytes of rice stem borer, Chilo suppressalis

Calcium acts as a second messenger in many cell types, including insect hemocytes. Intracellular calcium level has a definite role in innate and adaptive immune signaling. Biogenic amines such as octopamine (OA), tyramine (TA), dopamine (DA) and serotonin (5-HT) play various important physiological roles in insects by activating distinct G-protein-coupled receptors (GPCRs) that share a putative seven transmembrane domain structure. OA and 5-HT have been shown that can mediate insect hemocytic immune reactions to infections and invasions. Here, we showed that TA increase hemocyte spreading in the rice stem borer, Chilo suppressalis. Furthermore, we cloned a cDNA encoding a tyramine receptor type 2 from the hemocytes in the C. suppressalis, viz., CsTA2, which shares high sequence similarity to members of the invertebrate tyramine receptor family. The CsTA2 receptor was stably expressed in human embryonic kidney (HEK) 293 cells, and its ligand response has been examined. Receptor activation with TA induced a dose-dependent increase in intracellular Ca(2+) concentration ([Ca(2+)]i) in cells, with an EC50 value of 18.7±5.3 nM, whereas OA, DA, 5-HT and other potential agonists did not have this response. The mRNA is present in various tissues including nerve cord, hemocytes, fat body, midgut, Malpighian tubules, and epidermis in the larval stage. Western blot analysis and immunohistochemistry assay displayed that CsTA2 was detected and presented on hemocytes. We also showed that TA induced Ca(2+) release from the hemocytes of C. suppressalis.

Critical evidence for the prediction error theory in associative learning

In associative learning in mammals, it is widely accepted that the discrepancy, or error, between actual and predicted reward determines whether learning occurs. Complete evidence for the prediction error theory, however, has not been obtained in any learning systems: Prediction error theory stems from the finding of a blocking phenomenon, but blocking can also be accounted for by other theories, such as the attentional theory. We demonstrated blocking in classical conditioning in crickets and obtained evidence to reject the attentional theory. To obtain further evidence supporting the prediction error theory and rejecting alternative theories, we constructed a neural model to match the prediction error theory, by modifying our previous model of learning in crickets, and we tested a prediction from the model: the model predicts that pharmacological intervention of octopaminergic transmission during appetitive conditioning impairs learning but not formation of reward prediction itself, and it thus predicts no learning in subsequent training. We observed such an "auto-blocking", which could be accounted for by the prediction error theory but not by other competitive theories to account for blocking. This study unambiguously demonstrates validity of the prediction error theory in associative learning.

Toward elucidating diversity of neural mechanisms underlying insect learning

Insects are widely used as models to study neural mechanisms of learning and memory. Our recent studies on crickets, together with reports on other insect species, suggest that some fundamental differences exist in neural and molecular mechanisms of learning and memory among different species of insects, particularly between crickets and fruit flies. First, we suggested that in crickets octopamine (OA) and dopamine (DA) neurons convey reward and punishment signals, respectively, in associated learning. On the other hand, it has been reported that in fruit flies different sets of DA neurons convey reward or punishment signals. Secondly, we have suggested that in crickets OA and DA neurons participate in the retrieval of appetitive and aversive memories, respectively, while this is not the case in fruit flies. Thirdly, cyclic AMP signaling is critical for short-term memory formation in fruit flies, but not in crickets. Finally, nitric oxide-cyclic GMP signaling and calcium-calmodulin signaling are critical for long-term memory (LTM) formation in crickets, but such roles have not been reported in fruit flies. Not all of these differences can be ascribed to different experimental methods used in studies. We thus suggest that there are unexpected diversities in basic mechanisms of learning and memory among different insect species, especially between crickets and fruit flies. Studies on a larger number of insect species will help clarify the diversity of learning and memory mechanisms in relation to functional adaptation to the environment and evolutionary history.

Roles of calcium/calmodulin-dependent kinase II in long-term memory formation in crickets

Ca²⁺/calmodulin (CaM)-dependent protein kinase II (CaMKII) is a key molecule in many systems of learning and memory in vertebrates, but roles of CaMKII in invertebrates have not been characterized in detail. We have suggested that serial activation of NO/cGMP signaling, cyclic nucleotide-gated channel, Ca²⁺/CaM and cAMP signaling participates in long-term memory (LTM) formation in olfactory conditioning in crickets, and here we show participation of CaMKII in LTM formation and propose its site of action in the biochemical cascades. Crickets subjected to 3-trial conditioning to associate an odor with reward exhibited memory that lasts for a few days, which is characterized as protein synthesis-dependent LTM. In contrast, animals subjected to 1-trial conditioning exhibited memory that lasts for only several hours (mid-term memory, MTM). Injection of a CaMKII inhibitor prior to 3-trial conditioning impaired 1-day memory retention but not 1-hour memory retention, suggesting that CaMKII participates in LTM formation but not in MTM formation. Animals injected with a cGMP analogue, calcium ionophore or cAMP analogue prior to 1-trial conditioning exhibited 1-day retention, and co-injection of a CaMKII inhibitor impaired induction of LTM by the cGMP analogue or that by the calcium ionophore but not that by the cAMP analogue, suggesting that CaMKII is downstream of cGMP production and Ca²⁺ influx and upstream of cAMP production in biochemical cascades for LTM formation. Animals injected with an adenylyl cyclase (AC) activator prior to 1-trial conditioning exhibited 1-day retention. Interestingly, a CaMKII inhibitor impaired LTM induction by the AC activator, although AC is expected to be a downstream target of CaMKII. The results suggest that CaMKII interacts with AC to facilitate cAMP production for LTM formation. We propose that CaMKII serves as a key molecule for interplay between Ca²⁺ signaling and cAMP signaling for LTM formation, a new role of CaMKII in learning and memory.

A fighter's comeback: dopamine is necessary for recovery of aggression after social defeat in crickets

Social defeat, i.e. losing an agonistic dispute with a conspecific, is followed by a period of suppressed aggressiveness in many animal species, and is generally regarded as a major stressor, which may play a role in psychiatric disorders such as depression and post-traumatic stress disorder. Despite numerous animal models, the mechanisms underlying loser depression and subsequent recovery are largely unknown. This study on crickets is the first to show that a neuromodulator, dopamine (DA), is necessary for recovery of aggression after social defeat. Crickets avoid any conspecific male just after defeat, but regain their aggressiveness over 3 h. This recovery was prohibited after depleting nervous stores of DA and octopamine (OA, the invertebrate analogue of noradrenaline) with α-methyl-tyrosine (AMT). Loser recovery was also prohibited by the insect DA-receptor (DAR) antagonist fluphenazine, but not the OA-receptor (OAR) blocker epinastine, or yohimbine, which blocks receptors for OA's precursor tyramine. Conversely, aggression was restored prematurely in both untreated and amine depleted losers given either chlordimeform (CDM), a tissue permeable OAR-agonist, or the DA-metabolite homovanillyl alcohol (HVA), a component of the honeybee queen mandibular pheromone. As in honeybees, HVA acts in crickets as a DAR-agonist since its aggression promoting effect on losers was selectively blocked by the DAR-antagonist, but not by the OAR-antagonist. Conversely, CDM's aggression promoting effect was selectively blocked by the OAR-antagonist, but not the DAR-antagonist. Hence, only DA is necessary for recovery of aggressiveness after social defeat, although OA can promote loser aggression independently to enable experience dependent adaptive responses.

Shared mushroom body circuits underlie visual and olfactory memories in Drosophila

In nature, animals form memories associating reward or punishment with stimuli from different sensory modalities, such as smells and colors. It is unclear, however, how distinct sensory memories are processed in the brain. We established appetitive and aversive visual learning assays for Drosophila that are comparable to the widely used olfactory learning assays. These assays share critical features, such as reinforcing stimuli (sugar reward and electric shock punishment), and allow direct comparison of the cellular requirements for visual and olfactory memories. We found that the same subsets of dopamine neurons drive formation of both sensory memories. Furthermore, distinct yet partially overlapping subsets of mushroom body intrinsic neurons are required for visual and olfactory memories. Thus, our results suggest that distinct sensory memories are processed in a common brain center. Such centralization of related brain functions is an economical design that avoids the repetition of similar circuit motifs.

DOI:http://dx.doi.org/10.7554/eLife.02395.001

Animals tend to associate good and bad things with certain visual scenes, smells and other kinds of sensory information. If we get food poisoning after eating a new food, for example, we tend to associate the taste and smell of the new food with feelings of illness. This is an example of a negative ‘associative memory’, and it can persist for months, even when we know that our sickness was not caused by the new food itself but by some foreign body that should not have been in the food. The same is true for positive associative memories.

It is known that many associative memories contain information from more than one of the senses. Our memory of a favorite food, for instance, includes its scent, color and texture, as well as its taste. However, little is known about the ways in which information from the different senses is processed in the brain. Does each sense have its own dedicated memory circuit, or do multiple senses converge to the same memory circuit?

A number of studies have used olfactory (smell) and visual stimuli to study the basic neuroscience that underpins associative memories in fruit flies. The olfactory experiments traditionally use sugar and electric shocks to induce positive and negative associations with various scents. However, the visual experiments use other methods to induce associations with colors. This means that it is difficult to combine and compare the results of olfactory and visual experiments.

Now, Vogt, Schnaitmann et al. have developed a transparent grid that can be used to administer electric shocks in visual experiments. This allows direct comparisons to be made between the neuronal processing of visual associative memories and the neural processing of olfactory associative memories.

Vogt, Schnaitmann et al. showed that both visual and olfactory stimuli are modulated in the same subset of dopamine neurons for positive associative memories. Similarly, another subset of dopamine neurons was found to drive negative memories of both the visual and olfactory stimuli. The work of Vogt, Schnaitmann et al. shows that associative memories are processed by a centralized circuit that receives both visual and olfactory inputs, thus reducing the number of memory circuits needed for such memories.

DOI:http://dx.doi.org/10.7554/eLife.02395.002

Contrasting Effects of Histone Deacetylase Inhibitors on Reward and Aversive Olfactory Memories in the Honey Bee

Much of what we have learnt from rodent models about the essential role of epigenetic processes in brain plasticity has made use of aversive learning, yet the role of histone acetylation in aversive memory in the honey bee, a popular invertebrate model for both memory and epigenetics, was previously unknown. We examined the effects of histone deacetylase (HDAC) inhibition on both aversive and reward olfactory associative learning in a discrimination proboscis extension reflex (PER) assay. We report that treatment with the HDAC inhibitors APHA compound 8 (C8), phenylbutyrate (PB) or sodium butyrate (NaB) impaired discrimination memory due to impairment of aversive memory in a dose-dependent manner, while simultaneously having no effect on reward memory. Treatment with C8 1 h before training, 1 h after training or 1 h before testing, impaired aversive but not reward memory at test. C8 treatment 1 h before training also improved aversive but not reward learning during training. PB treatment only impaired aversive memory at test when administered 1 h after training, suggesting an effect on memory consolidation specifically. Specific impairment of aversive memory (but not reward memory) by HDAC inhibiting compounds was robust, reproducible, occurred following treatment with three drugs targeting the same mechanism, and is likely to be genuinely due to alterations to memory as sucrose sensitivity and locomotion were unaffected by HDAC inhibitor treatment. This pharmacological dissection of memory highlights the involvement of histone acetylation in aversive memory in the honey bee, and expands our knowledge of epigenetic control of neural plasticity in invertebrates.