Insect olfactory memory in time and space

Analysis of Genes Associated with Feeding Preference and Detoxification in Various Developmental Stages of Aglais urticae

Herbivorous insects and host plants have developed a close and complex relationship over a long period of co-evolution. Some plants provide nutrients for insects, but plants' secondary metabolites also influence their growth and development. Urtica cannabina roots and leaves are poisonous, yet Aglais urticae larvae feed on them, so we aimed to clarify the mechanism enabling this interaction. At present, studies on the detoxification mechanism of the A. urticae are rare. In our study, first, we used the A. urticae larval odor selection behavior bioassay and choice feeding preference assay to analyze the feeding preferences of A. urticae on its host plant, U. cannabina. Next, we used transcriptome sequencing to obtain the unigenes annotated and classified by various databases, such as KEGG and GO. In this study, we found that U. cannabina could attract A. urticae larvae to feed via scent, and the feeding preference assay confirmed that larvae preferred U. cannabina leaves over three other plants: Cirsium japonicum, Cannabis sativa, and Arctium lappa. The activity of detoxifying enzymes GST and CarE changed in larvae that had consumed U. cannabina. Furthermore, through transcriptomic sequencing analysis, 77,624 unigenes were assembled from raw reads. The numbers of differentially expressed genes were calculated using pairwise comparisons of all life stages; the expression of detoxification enzyme genes was substantially higher in larvae than in the pupal and adult stages. Finally, we identified and summarized 34 genes associated with detoxification enzymes, such as UDP-glucose 4-epimerase gene, 5 Glutathione S-transferase genes, 4 Carboxylesterase genes, 4 Cytochrome P450 genes, 10 ATP-binding cassette genes, 4 Superoxide dismutase, and Peroxidase. Moreover, we identified 28 genes associated with the development of A. urticae. The qRT-PCR results were nearly consistent with the transcriptomic data, showing an increased expression level of four genes in larvae. Taken together, this study examines the correlation between A. urticae and host plants U. cannabina, uncovering a pronounced preference for A. urticae larvae toward host plants. Consistent with RNA-seq, we investigated the mechanism of A. urticae's interaction with host plants and identified detoxification-related genes. The present study provides theoretical support for studying insect adaptation mechanisms and biological control.

Dopamine activity in projection neurons regulates short-lasting olfactory approach memory in Drosophila

Survival in many animals requires the ability to associate certain cues with danger and others with safety. In a Drosophila melanogaster aversive olfactory conditioning paradigm, flies are exposed to two odours, one presented coincidentally with electrical shocks, and a second presented 45 s after shock cessation. When flies are later given a choice between these two odours, they avoid the shock‐paired odour and prefer the unpaired odour. While many studies have examined how flies learn to avoid the shock‐paired odour through formation of odour‐fear associations, here we demonstrate that conditioning also causes flies to actively approach the second odour. In contrast to fear memories, which are longer lasting and requires activity of D1‐like dopamine receptors only in the mushroom bodies, approach memory is short‐lasting and requires activity of D1‐like dopamine receptors in projection neurons originating from the antennal lobes, primary olfactory centers. Further, while recall of fear memories requires activity of the mushroom bodies, recall of approach memories does not. Our data suggest that olfactory approach memory is formed using different mechanisms in different brain locations compared to aversive and appetitive olfactory memories.

Motor-Skill Learning in an Insect Inspired Neuro-Computational Control System

In nature, insects show impressive adaptation and learning capabilities. The proposed computational model takes inspiration from specific structures of the insect brain: after proposing key hypotheses on the direct involvement of the mushroom bodies (MBs) and on their neural organization, we developed a new architecture for motor learning to be applied in insect-like walking robots. The proposed model is a nonlinear control system based on spiking neurons. MBs are modeled as a nonlinear recurrent spiking neural network (SNN) with novel characteristics, able to memorize time evolutions of key parameters of the neural motor controller, so that existing motor primitives can be improved. The adopted control scheme enables the structure to efficiently cope with goal-oriented behavioral motor tasks. Here, a six-legged structure, showing a steady-state exponentially stable locomotion pattern, is exposed to the need of learning new motor skills: moving through the environment, the structure is able to modulate motor commands and implements an obstacle climbing procedure. Experimental results on a simulated hexapod robot are reported; they are obtained in a dynamic simulation environment and the robot mimicks the structures of Drosophila melanogaster.

A Fly-Inspired Mushroom Bodies Model for Sensory-Motor Control Through Sequence and Subsequence Learning

Classification and sequence learning are relevant capabilities used by living beings to extract complex information from the environment for behavioral control. The insect world is full of examples where the presentation time of specific stimuli shapes the behavioral response. On the basis of previously developed neural models, inspired by Drosophila melanogaster, a new architecture for classification and sequence learning is here presented under the perspective of the Neural Reuse theory. Classification of relevant input stimuli is performed through resonant neurons, activated by the complex dynamics generated in a lattice of recurrent spiking neurons modeling the insect Mushroom Bodies neuropile. The network devoted to context formation is able to reconstruct the learned sequence and also to trace the subsequences present in the provided input. A sensitivity analysis to parameter variation and noise is reported. Experiments on a roving robot are reported to show the capabilities of the architecture used as a neural controller.

Circadian regulation of learning and memory

The study of the relationship between biological clocks and learning and memory in insects goes back to work on Zeitgedachtnis (time memory) in bees originating in the early 1900s when it was shown that bees were able to remember the time of day a specific food source was available. More recent work has expanded on the role of circadian phase in memory acquisition, consolidation, and recall in additional insect species. The results show that the circadian system can modulate the ability of individuals to acquire memories or the ability to retrieve memories; however, questions remain both about the mechanisms by which the circadian system regulates these processes and about the functional/adaptive significance of this novel feature of insect circadian organization.

Computational modeling and experimental validation of odor detection behaviors of classically conditioned parasitic wasp, Microplitis croceipes

A prototype chemical sensor named Wasp hound® that utilizes five classically conditioned parasitoid wasps, Microplitis croceipes (Cresson) (Hymenoptera: Braconidae), to detect volatile odors was successfully implemented in a previous study. To improve the odor-detecting ability of Wasp Hound®, searching behaviors of an individual wasp in a confined area are studied and modeled through stochastic differential equations in this paper. The wasps are conditioned to 20 mg of coffee when associated with food and subsequently, tested to 5, 10, 20, and 40 mg of coffee. A stochastic model is developed and validated based on three positive behavioral responses (walking, rotation around odor source, and self-rotation) from conditioned wasps at four different test dosages. The model is capable to reproducing the behaviors of conditioned wasps, and can be used to improve the ability of Wasp Hound® to assess changes in odor concentration. The model simulation results show the behaviors of conditioned wasps are significantly different when tested at different coffee dosages. We conjecture that the searching behaviors of conditioned wasps are based on the temporal and spatial neuron activity of olfactory receptor neurons and glomeruli, which are strongly correlated to the training dosages. The overall results demonstrate the utility of mathematical models for interpreting experimental observations, gaining novel insights into the dynamic behavior of classically conditioned wasps, as well as broadening the practical uses of Wasp Hound.

Modeling the insect mushroom bodies: application to a delayed match-to-sample task

Despite their small brains, insects show advanced capabilities in learning and task solving. Flies, honeybees and ants are becoming a reference point in neuroscience and a main source of inspiration for autonomous robot design issues and control algorithms. In particular, honeybees demonstrate to be able to autonomously abstract complex associations and apply them in tasks involving different sensory modalities within the insect brain. Mushroom Bodies (MBs) are worthy of primary attention for understanding memory and learning functions in insects. In fact, even if their main role regards olfactory conditioning, they are involved in many behavioral achievements and learning capabilities, as has been shown in honeybees and flies. Owing to the many neurogenetic tools, the fruit fly Drosophila became a source of information for the neuroarchitecture and biochemistry of the MBs, although the MBs of flies are by far simpler in organization than their honeybee orthologs. Electrophysiological studies, in turn, became available on the MBs of locusts and honeybees. In this paper a novel bio-inspired neural architecture is presented, which represents a generalized insect MB with the basic features taken from fruit fly neuroanatomy. By mimicking a number of different MB functions and architecture, we can replace and improve formerly used artificial neural networks. The model is a multi-layer spiking neural network where key elements of the insect brain, the antennal lobes, the lateral horn region, the MBs, and their mutual interactions are modeled. In particular, the model is based on the role of parts of the MBs named MB-lobes, where interesting processing mechanisms arise on the basis of spatio-temporal pattern formation. The introduced network is able to model learning mechanisms like olfactory conditioning seen in honeybees and flies and was found able also to perform more complex and abstract associations, like the delayed matching-to-sample tasks known only from honeybees. A biological basis of the proposed model is presented together with a detailed description of the architecture. Simulation results and remarks on the biological counterpart are also reported to demonstrate the possible applications of the designed computational model. Such neural architecture, able to autonomously learn complex associations is envisaged to be a suitable basis for an immediate implementation within an robot control architecture.

Are mushroom bodies cerebellum-like structures?

The mushroom bodies are distinctive neuropils in the protocerebral brain segments of many protostomes. A defining feature of mushroom bodies is their intrinsic neurons, masses of cytoplasm-poor globuli cells that form a system of lobes with their densely-packed, parallel-projecting axon-like processes. In insects, the role of the mushroom bodies in olfactory processing and associative learning and memory has been studied in depth, but several lines of evidence suggest that the function of these higher brain centers cannot be restricted to these roles. The present account considers whether insight into an underlying function of mushroom bodies may be provided by cerebellum-like structures in vertebrates, which are similarly defined by the presence of masses of tiny granule cells that emit thin parallel fibers forming a dense molecular layer. In vertebrates, the shared neuroarchitecture of cerebellum-like structures has been suggested to underlie a common functional role as adaptive filters for the removal of predictable sensory elements, such as those arising from reafference, from the total sensory input. Cerebellum-like structures include the vertebrate cerebellum, the electrosensory lateral line lobe, dorsal and medial octavolateral nuclei of fish, and the dorsal cochlear nucleus of mammals. The many architectural and physiological features that the insect mushroom bodies share with cerebellum-like structures suggest that it might be fruitful to consider mushroom body function in light of a possible role as adaptive sensory filters. The present account thus presents a detailed comparison of the insect mushroom bodies with vertebrate cerebellum-like structures.

The long-term memory trace formed in the Drosophila α/β mushroom body neurons is abolished in long-term memory mutants

A prior screen identified dozens of Drosophila melanogaster mutants that possess defective long-term memory (LTM). Using spaced olfactory conditioning, we trained 26 of these mutant lines to associate an odor cue with electric shock and then examined the memory of this conditioning 24 h later. All of the mutants tested revealed a deficit in LTM compared to the robust LTM observed in control flies. We used in vivo functional optical imaging to measure the magnitude of a previously characterized LTM trace, which is manifested as increased calcium influx into the axons of α/β mushroom body neurons in response to the conditioned odor. This memory trace was defective in all 26 of the LTM mutants. These observations elevate the significance of this LTM trace given that 26 independent mutants all exhibit a defect in the trace, and further suggest that the calcium trace is a fundamental mechanism underlying Drosophila LTM.

Traces of Drosophila memory

Studies using functional cellular imaging of living flies have identified six memory traces that form in the olfactory nervous system after conditioning with odors. These traces occur in distinct nodes of the olfactory nervous system, form and disappear across different windows of time, and are detected in the imaged neurons as increased calcium influx or synaptic release in response to the conditioned odor. Three traces form at or near acquisition and coexist with short-term behavioral memory. One trace forms with a delay after learning and coexists with intermediate-term behavioral memory. Two traces form many hours after acquisition and coexist with long-term behavioral memory. The transient memory traces may support behavior across the time windows of their existence. The experimental approaches for dissecting memory formation in the fly, ranging from the molecular to the systems, make it an ideal system for elucidating the logic by which the nervous system organizes and stores different temporal forms of memory.

NMDA receptors are not required for pattern completion during associative memory recall

Pattern completion, the ability to retrieve complete memories initiated by subsets of external cues, has been a major focus of many computation models. A previously study reports that such pattern completion requires NMDA receptors in the hippocampus. However, such a claim was derived from a non-inducible gene knockout experiment in which the NMDA receptors were absent throughout all stages of memory processes as well as animal's adult life. This raises the critical question regarding whether the previously described results were truly resulting from the requirement of the NMDA receptors in retrieval. Here, we have examined the role of the NMDA receptors in pattern completion via inducible knockout of NMDA receptors limited to the memory retrieval stage. By using two independent mouse lines, we found that inducible knockout mice, lacking NMDA receptor in either forebrain or hippocampus CA1 region at the time of memory retrieval, exhibited normal recall of associative spatial reference memory regardless of whether retrievals took place under full-cue or partial-cue conditions. Moreover, systemic antagonism of NMDA receptor during retention tests also had no effect on full-cue or partial-cue recall of spatial water maze memories. Thus, both genetic and pharmacological experiments collectively demonstrate that pattern completion during spatial associative memory recall does not require the NMDA receptor in the hippocampus or forebrain.

Roles of glial cells in neural circuit formation: insights from research in insects

Investigators over the years have noted many striking similarities in the structural organization and function of neural circuits in higher invertebrates and vertebrates. In more recent years, the discovery of similarities in the cellular and molecular mechanisms that guide development of these circuits has driven a revolution in our understanding of neural development. Cellular mechanisms discovered to underlie axon pathfinding in grasshoppers have guided productive studies in mammals. Genes discovered to play key roles in the patterning of the fruitfly's central nervous system have subsequently been found to play key roles in mice. The diversity of invertebrate species offers to investigators numerous opportunities to conduct experiments that are harder or impossible to do in vertebrate species, but that are likely to shed light on mechanisms at play in developing vertebrate nervous systems. These experiments elucidate the broad suite of cellular and molecular interactions that have the potential to influence neural circuit formation across species. Here we focus on what is known about roles for glial cells in some of the important steps in neural circuit formation in experimentally advantageous insect species. These steps include axon pathfinding and matching to targets, dendritic patterning, and the sculpting of synaptic neuropils. A consistent theme is that glial cells interact with neurons in two-way, reciprocal interactions. We emphasize the impact of studies performed in insects and explore how insect nervous systems might best be exploited next as scientists seek to understand in yet deeper detail the full repertory of functions of glia in development.

Optogenetics 3.0

Optogenetic methods use light to modulate the activities of target cells in vivo. By improving inter- and intracellular trafficking of light-sensitive switch proteins called opsins, Gradinaru et al. (2010) have developed a new generation of optogenetic tools capable of regulating the activity of targeted neurons with exquisite precision and efficiency.

PKA dynamics in a Drosophila learning center: coincidence detection by rutabaga adenylyl cyclase and spatial regulation by dunce phosphodiesterase

The dynamics of PKA activity in the olfactory learning and memory center, the mushroom bodies (MBs), are still poorly understood. We addressed this issue in vivo using a PKA FRET probe. Application of dopamine, the main neuromodulator involved in aversive learning, resulted in PKA activation specifically in the vertical lobe, whereas octopamine, involved in appetitive learning, stimulated PKA in all MB lobes. Strikingly, MB lobes were homogeneously activated by dopamine in the learning mutant dunce, showing that Dunce phosphodiesterase plays a major role in the spatial regulation of cAMP dynamics. Furthermore, costimulation with acetylcholine and either dopamine or octopamine led to a synergistic activation of PKA in the MBs that depends on Rutabaga adenylyl cyclase. Our results suggest that Rutabaga acts as a coincidence detector and demonstrate the existence of subcellular domains of PKA activity that could underlie the functional specialization of MB lobes in aversive and appetitive learning.

Dynamics of learning-related cAMP signaling and stimulus integration in the Drosophila olfactory pathway

Functional imaging with genetically encoded calcium and cAMP reporters was used to examine the signal integration underlying learning in Drosophila. Dopamine and octopamine modulated intracellular cAMP in spatially distinct patterns in mushroom body neurons. Pairing of neuronal depolarization with subsequent dopamine application revealed a synergistic increase in cAMP in the mushroom body lobes, which was dependent on the rutabaga adenylyl cyclase. This synergy was restricted to the axons of mushroom body neurons, and occurred only following forward pairing with time intervals similar to those required for behavioral conditioning. In contrast, forward pairing of neuronal depolarization and octopamine produced a subadditive effect on cAMP. Finally, elevating intracellular cAMP facilitated calcium transients in mushroom body neurons, suggesting that cAMP elevation is sufficient to induce presynaptic plasticity. These data suggest that rutabaga functions as a coincidence detector in an intact neuronal circuit, with dopamine and octopamine bidirectionally influencing the generation of cAMP.

Growth and pruning of mushroom body Kenyon cell dendrites during worker behavioral development in the paper wasp, Polybia aequatorialis (Hymenoptera: Vespidae)

Adult workers of some social insect species show dramatic behavioral changes as they pass through a sequence of task specializations. In the paper wasp, Polybia aequatorialis, female workers begin adult life within the nest tending brood, progress to maintaining and defending the nest exterior, and ultimately leave the nest to forage. The mushroom body (MB) calyx neuropil increases in volume as workers progress from in-nest to foraging tasks. In other social Hymenoptera (bees and ants), MB Kenyon cell dendrites, axons and synapses change with the transition to foraging, but these neuronal effects had not been studied in wasps. Furthermore, the on-nest worker of Polybia wasps, an intermediate task specialization not identified in bees or ants, provides the opportunity to study pre-foraging worker class transitions. We asked whether Kenyon cell dendritic arborization varies with the task specialization of Polybia workers observed in the field near Monteverde, Costa Rica. Golgi-impregnated arbors in the lip and collar calyces, which receive a predominance of olfactory and visual input, respectively, were quantified using Sholl's concentric circles and a novel application of virtual spherical probes. Arbors of the lip varied in a manner reminiscent of honeybees, with foragers having the largest and in-nest workers having the smallest arbors. In contrast, arbors of the collar were largest in foragers but smallest in on-nest workers. Thus, progression through task specializations in P. aequatorialis involves subregion specific dendritic growth and regression in the MB neuropil. These results may reflect the sensitivity of Kenyon cell dendritic structure to specialization dependent social and sensory experience.

The GABAergic anterior paired lateral neuron suppresses and is suppressed by olfactory learning

GABAergic neurotransmitter systems are important for many cognitive processes, including learning and memory. We identified a single neuron in each hemisphere of the Drosophila brain - the anterior paired lateral (APL) neuron - as a GABAergic neuron that broadly innervated the mushroom bodies. Reducing GABA synthesis in the APL neuron enhanced olfactory learning, suggesting that APL suppressed learning by releasing the inhibitory neurotransmitter GABA. Functional optical imaging experiments revealed that APL responded to both odor and electric shock stimuli presented to the fly with increases of intracellular calcium and released neurotransmitter. More importantly, a memory trace formed in the APL neuron by pairing odor with electric shock. This trace was detected as a reduced calcium response in APL after conditioning specifically to the trained odor. These results demonstrated a mutual suppression between the GABAergic APL neuron and olfactory learning, and functional neuroplasticity of the GABAergic system due to learning.

Tritocerebral tract input to the insect mushroom bodies

Insect mushroom bodies, best known for their role in olfactory processing, also receive sensory input from other modalities. In crickets and grasshoppers, a tritocerebral tract containing afferents from palp mechanosensory and gustatory centers innervates the accessory calyx. The accessory calyx is uniquely composed of Class III Kenyon cells, and was shown by immunohistochemistry to be present sporadically across several insect orders. Neuronal tracers applied to the source of tritocerebral tract axons in several species of insects demonstrated that tritocerebral tract innervation of the mushroom bodies targeted the accessory calyx when present, the primary calyces when an accessory calyx was not present, or both. These results suggest that tritocerebral tract input to the mushroom bodies is likely ubiquitous, reflecting the importance of gustation for insect behavior. The scattered phylogenetic distribution of Class III Kenyon cells is also proposed to represent an example of generative homology, in which the developmental program for forming a structure is retained in all members of a lineage, but the program is not "run" in all branches.

GABAA receptor RDL inhibits Drosophila olfactory associative learning

In both mammals and insects, neurons involved in learning are strongly modulated by the inhibitory neurotransmitter GABA. The GABAA receptor, resistance to dieldrin (Rdl), is highly expressed in the Drosophila mushroom bodies (MBs), a group of neurons playing essential roles in insect olfactory learning. Flies with increased or decreased expression of Rdl in the MBs were generated. Olfactory associative learning tests showed that Rdl overexpression impaired memory acquisition but not memory stability. This learning defect was due to disrupting the physiological state of the adult MB neurons rather than causing developmental abnormalities. Remarkably, Rdl knockdown enhanced memory acquisition but not memory stability. Functional cellular imaging experiments showed that Rdl overexpression abolished the normal calcium responses of the MBs to odors while Rdl knockdown increased these responses. Together, these data suggest that RDL negatively modulates olfactory associative learning, possibly by gating the input of olfactory information into the MBs.