Neuromodulatory control of a goal-directed decision

A peripheral subepithelial network for chemotactile processing in the predatory sea slug Pleurobranchaea californica

Many soft-bodied animals have extensive peripheral nervous systems (PNS) with significant sensory roles. One such, the sea slug Pleurobranchaea californica, uses PNS computations in its chemotactile oral veil (OV) in prey tracking, averaging olfactory stimuli across the OV to target likely source direction, or "stimulus place". This suggests a peripheral subepithelial network (SeN) interconnecting sensory sites to compute the directional average. We pursued anatomy and connectivity of previously described ciliated putative sensory cells on OV papillae. Scanning electron microscopy (SEM) confirmed paddle-shaped cilia in clusters. Anti-tubulin and phalloidin staining showed connections to branching nervelets and muscle fibers for contraction and expansion of papillae. Ciliary cell processes could not be traced into nerves, consistent with sensory transmission to CNS via secondary afferents. Anti-tyrosine hydroxylase-stained ciliated cells in clusters and revealed an at least partially dopaminergic subepithelial network interconnecting clusters near and distant, connections consistent with PNS averaging of multiple stimulated loci. Other, unidentified, SeN neurotransmitters are likely. Confirming chemotactile functions, perfusible suction electrodes recorded ciliary spiking excited by both mechanical and appetitive chemical stimuli. Stimuli induced sensory nerve spiking like that encoding stimulus place. Sensory nerve spikes and cilia cluster spikes were not identifiable as generated by the same neurons. Ciliary clusters likely drive the sensory nerve spikes via SeN, mediating appetitive and stimulus place codes to CNS. These observations may facilitate future analyses of the PNS in odor discrimination and memory, and also suggest such SeNs as potential evolutionary precursors of CNS place-coding circuitry in the segmented, skeletonized protostomes and deuterostomes.

Chemical cognition: chemoconnectomics and convergent evolution of integrative systems in animals

Neurons underpin cognition in animals. However, the roots of animal cognition are elusive from both mechanistic and evolutionary standpoints. Two conceptual frameworks both highlight and promise to address these challenges. First, we discuss evidence that animal neural and other integrative systems evolved more than once (convergent evolution) within basal metazoan lineages, giving us unique experiments by Nature for future studies. The most remarkable examples are neural systems in ctenophores and neuroid-like systems in placozoans and sponges. Second, in addition to classical synaptic wiring, a chemical connectome mediated by hundreds of signal molecules operates in tandem with neurons and is the most information-rich source of emerging properties and adaptability. The major gap-dynamic, multifunctional chemical micro-environments in nervous systems-is not understood well. Thus, novel tools and information are needed to establish mechanistic links between orchestrated, yet cell-specific, volume transmission and behaviors. Uniting what we call chemoconnectomics and analyses of the cellular bases of behavior in basal metazoan lineages arguably would form the foundation for deciphering the origins and early evolution of elementary cognition and intelligence.

A common modular design of nervous systems originating in soft-bodied invertebrates

Nervous systems of vertebrates and invertebrates show a common modular theme in the flow of information for cost-benefit decisions. Sensory inputs are incentivized by integrating stimulus qualities with motivation and memory to affect appetitive state, a system of homeostatic drives, and labelled for directionality. Appetitive state determines action responses from a repertory of possibles and transmits the decision to a premotor system that frames the selected action in motor arousal and appropriate postural and locomotion commands. These commands are then sent to the primary motor pattern generators controlling the motorneurons, with feedback at each stage. In the vertebrates, these stages are mediated by forebrain pallial derivatives for incentive and directionality (olfactory bulb, cerebral cortex, pallial amygdala, etc.) interacting with hypothalamus (homeostasis, motivation, and reward) for action selection in the forebrain basal ganglia, the mid/hindbrain reticular formation as a premotor translator for posture, locomotion, and arousal state, and the spinal cord and cranial nuclei as primary motor pattern generators. Gastropods, like the predatory sea slug Pleurobranchaea californica, show a similar organization but with differences that suggest how complex brains evolved from an ancestral soft-bodied bilaterian along with segmentation, jointed skeletons, and complex exteroceptors. Their premotor feeding network combines functions of hypothalamus and basal ganglia for homeostasis, motivation, presumed reward, and action selection for stimulus approach or avoidance. In Pleurobranchaea, the premotor analogy to the vertebrate reticular formation is the bilateral "A-cluster" of cerebral ganglion neurons that controls posture, locomotion, and serotonergic motor arousal. The A-cluster transmits motor commands to the pedal ganglia analogs of the spinal cord, for primary patterned motor output. Apparent pallial precursors are not immediately evident in Pleurobranchaea's central nervous system, but a notable candidate is a subepithelial nerve net in the peripheral head region that integrates chemotactile stimuli for incentive and directionality. Evolutionary centralization of its computational functions may have led to the olfaction-derived pallial forebrain in the ancestor's vertebrate descendants and their analogs in arthropods and annelids.

Coordination of Locomotion by Serotonergic Neurons in the Predatory Gastropod Pleurobranchaea californica

Similar design characterizes neuronal networks for goal-directed motor control across the complex, segmented vertebrates, insects, and polychaete annelids with jointed appendages. Evidence is lacking for whether this design evolved independently in those lineages, evolved in parallel with segmentation and appendages, or could have been present in a soft-bodied common ancestor. We examined coordination of locomotion in an unsegmented, ciliolocomoting gastropod, the sea slug Pleurobranchaea californica, which may better resemble the urbilaterian ancestor. Previously, bilateral A-cluster neurons in cerebral ganglion lobes were found to compose a multifunctional premotor network controlling the escape swim and feeding suppression, and mediating action selection for approach or avoidance turns. Serotonergic As interneurons of this cluster were critical elements for swimming, turning, and behavioral arousal. Here, known functions were extended to show that the As2/3 cells of the As group drove crawling locomotion via descending signals to pedal ganglia effector networks for ciliolocomotion and were inhibited during fictive feeding and withdrawal. Crawling was suppressed in aversive turns, defensive withdrawal, and active feeding, but not during stimulus-approach turns or prebite proboscis extension. Ciliary beating was not inhibited during escape swimming. These results show how locomotion is adaptively coordinated in tracking, handling, and consuming resources, and in defense. Taken with previous results, they also show that the A-cluster network acts similarly to the vertebrate reticular formation with its serotonergic raphe nuclei in facilitating locomotion, postural movements, and motor arousal. Thus, the general scheme controlling locomotion and posture might well have preceded the evolution of segmented bodies and articulated appendages.SIGNIFICANCE STATEMENT Similar design in the neuronal networks for goal-directed motor control is seen across the complex, segmented vertebrates, insects, and polychaete annelids with jointed appendages. Whether that design evolved independently or in parallel with complexity in body and behavior has been unanswered. Here it is shown that a simple sea slug, with primitive ciliary locomotion and lacking segmentation and appendages, has similar modular design in network coordination as vertebrates for posture in directional turns and withdrawal, locomotion, and general arousal. This suggests that a general neuroanatomical framework for the control of locomotion and posture could have arisen early during the evolution of bilaterians.

Understanding the effects of serotonin in the brain through its role in the gastrointestinal tract

The neuromodulatory arousal system imbues the nervous system with the flexibility and robustness required to facilitate adaptive behaviour. While there are well-understood mechanisms linking dopamine, noradrenaline and acetylcholine to distinct behavioural states, similar conclusions have not been as readily available for serotonin. Fascinatingly, despite clear links between serotonergic function and cognitive capacities as diverse as reward processing, exploration, and the psychedelic experience, over 95% of the serotonin in the body is released in the gastrointestinal tract, where it controls digestive muscle contractions (peristalsis). Here, we argue that framing neural serotonin as a rostral extension of the gastrointestinal serotonergic system dissolves much of the mystery associated with the central serotonergic system. Specifically, we outline that central serotonin activity mimics the effects of a digestion/satiety circuit mediated by hypothalamic control over descending serotonergic nuclei in the brainstem. We review commonalities and differences between these two circuits, with a focus on the heterogeneous expression of different classes of serotonin receptors in the brain. Much in the way that serotonin-induced peristalsis facilitates the work of digestion, serotonergic influences over cognition can be reframed as performing the work of cognition. Extending this analogy, we argue that the central serotonergic system allows the brain to arbitrate between different cognitive modes as a function of serotonergic tone: low activity facilitates cognitive automaticity, whereas higher activity helps to identify flexible solutions to problems, particularly if and when the initial responses fail. This perspective sheds light on otherwise disparate capacities mediated by serotonin, and also helps to understand why there are such pervasive links between serotonergic pathology and the symptoms of psychiatric disorders.

Effects of Thryptophan Hydroxylase Blockade by P-Chlorophenylalanine on Contextual Memory Reconsolidation after Training of Different Intensity

The processes of memory formation and its storage are extremely dynamic. Therefore, the determination of the nature and temporal evolution of the changes that underlie the molecular mechanisms of retrieval and cause reconsolidation of memory is the key to understanding memory formation. Retrieval induces the plasticity, which may result in reconsolidation of the original memory and needs critical molecular events to stabilize the memory or its extinction. 4-Chloro-DL-phenylalanine (P-chlorophenylalanine-PCPA) depresses the most limiting enzyme of serotonin synthesis the tryptophan hydroxylase. It is known that PCPA reduces the serotonin content in the brain up to 10 times in rats (see Methods). We hypothesized that the PCPA could behave the similar way in snails and could reduce the content of serotonin in snails. Therefore, we investigated the effect of PCPA injection on contextual memory reconsolidation using a protein synthesis blocker in snails after training according to two protocols of different intensities. The results obtained in training according to the first protocol using five electrical stimuli per day for 5 days showed that reminding the training environment against the background of injection of PCPA led to a significant decrease in contextual memory. At the same time, the results obtained in training according to the second protocol using three electrical stimuli per day for 5 days showed that reminding the training environment against the injection of PCPA did not result in a significant change in contextual memory. The obtain results allowed us to conclude that the mechanisms of processes developed during the reconsolidation of contextual memory after a reminding depend both on the intensity of learning and on the state of the serotonergic system.

Hunger and satiety determine foraging decissions in land snails: Evidence from the invasive species Theba pisana

The foraging behaviour of gastropod molluscs usually involves complex decisions that provide a model for the study of high-order cognitive processes. Land snails tested for food-finding in the laboratory, however, have shown an invariable feeding pattern: novel foods are mostly missed (i.e. just found by chance) whilst familiar foods, due to a type of conditioned attraction, are always located and ingested. This effect, known as Food-attraction conditioning, has led to the conclusion that, regardless of their hunger level, land snails are both willing to eat anything at any moment and also blind to the odours of novel foods. An alternative account of these findings emerges from the fact that the snails are usually tested whilst in a moderate state of hunger, so that they benefit from feeding on known foods but not from taking the risk of feeding on those that are unknown. The present experiments suggest that it is the case. Snails of the invasive species Theba pisana were tested for food-finding according to their seasonal cycle in a laboratory located in their native Mediterranean region. Subjects collected at the beginning of their aestivation period succeed in locating novel food items after being deprived for a long period (45 days), but ignored a conditioned food when they were sated with this food at the end of their lethargy. The results allow us to conclude that the feeding behaviour of snails is the product of a complex cost-benefit analysis in which their motivational state and the stimuli they perceive (and the memory of such stimuli), are evaluated. Finally, we anticipate that these results will be of use in increasing the efficiency of current baits employed for the protection of crops.

Olfactory navigation in aquatic gastropods

Gastropod diversity is substantial in marine and freshwater habitats, and many aquatic slugs and snails use olfactory cues to guide their navigation behaviour. Examples include finding prey or avoiding predators based on kairomones, or finding potential mates using pheromones. Here, I review the diversity of navigational behaviours studied across the major aquatic taxa of gastropods. I then synthesize evidence for the different theoretical navigation strategies the animals may use. It is likely that gastropods regularly use either chemotaxis or odour-gated rheotaxis (or both) during olfactory-based navigation. Finally, I collate the patchwork of research conducted on relevant proximate mechanisms that could produce navigation behaviours. Although the tractability of several gastropod species for neurophysiological experimentation has generated some valuable insight into how turning behaviour is triggered by contact chemoreception, there remain many substantial gaps in our understanding for how navigation relative to more distant odour sources is controlled in gastropods. These gaps include little information on the chemoreceptors and mechanoreceptors (for detecting flow) found in the peripheral nervous system and the central (or peripheral) processing circuits that integrate that sensory input. In contrast, past studies do provide information on motor neurons that control the effectors that produce crawling (both forward locomotion and turning). Thus, there is plenty of scope for further research on olfactory-based navigation, exploiting the tractability of gastropods for neuroethology to better understand how the nervous system processes chemosensory input to generate movement towards or away from distant odour sources.

A role for dopamine in the peripheral sensory processing of a gastropod mollusc

Histological evidence points to the presence of dopamine (DA) in the cephalic sensory organs of multiple gastropod molluscs, suggesting a possible sensory role for the neurotransmitter. We investigated the sensory function of DA in the nudipleuran Pleurobranchaea californica, in which the central neural correlates of sensation and foraging behavior have been well characterized. Tyrosine hydroxylase-like immunoreactivity (THli), a signature of the dopamine synthetic pathway, was similar to that found in two other opisthobranchs and two pulmonates previously studied: 1) relatively few (<100) THli neuronal somata were observed in the central ganglia, with those observed found in locations similar to those documented in the other snails but varying in number, and 2) the vast majority of THli somata were located in the peripheral nervous system, were associated with ciliated, putative primary sensory cells, and were highly concentrated in chemotactile sensory organs, giving rise to afferent axons projecting to the central nervous system. We extended these findings by observing that applying a selective D₂/D₃ receptor antagonist to the chemo- and mechanosensory oral veil-tentacle complex of behaving animals significantly delayed feeding behavior in response to an appetitive stimulus. A D₁ blocker had no effect. Recordings of the two major cephalic sensory nerves, the tentacle and large oral veil nerves, in a deganglionated head preparation revealed a decrease of stimulus-evoked activity in the former nerve following application of the same D₂/D₃ antagonist. Broadly, our results implicate DA in sensation and engender speculation regarding the foraging-based decisions the neurotransmitter may serve in the nervous system of Pleurobranchaea and, by extension, other gastropods.

Implementing Goal-Directed Foraging Decisions of a Simpler Nervous System in Simulation

Economic decisions arise from evaluation of alternative actions in contexts of motivation and memory. In the predatory sea-slug Pleurobranchaea the economic decisions of foraging are found to occur by the workings of a simple, affectively controlled homeostat with learning abilities. Here, the neuronal circuit relations for approach-avoidance choice of Pleurobranchaea are expressed and tested in the foraging simulation Cyberslug. Choice is organized around appetitive state as a moment-to-moment integration of sensation, motivation (satiation/hunger), and memory. Appetitive state controls a switch for approach vs. avoidance turn responses to sensation. Sensory stimuli are separately integrated for incentive value into appetitive state, and for prey location (stimulus place) into mapping motor response. Learning interacts with satiation to regulate prey choice affectively. The virtual predator realistically reproduces the decisions of the real one in varying circumstances and satisfies optimal foraging criteria. The basic relations are open to experimental embellishment toward enhanced neural and behavioral complexity in simulation, as was the ancestral bilaterian nervous system in evolution.

Responses of Withdrawal Interneurons to Serotonin Applications in Naïve and Learned Snails Are Different

Long-term changes in membrane potential after associative training were described previously in identified premotor interneurons for withdrawal of the terrestrial snail Helix. Serotonin was shown to be a major transmitter involved in triggering the long-term changes in mollusks. In the present study we compared the changes in electrophysiological characteristics of identifiable premotor interneurons for withdrawal in response to bath applications of serotonin (5-HT) or serotonin precursor 5-hydroxytryptophan (5-HTP) in preparations from naïve, neurotoxin-injected or associatively trained snails. It was found that 5-HT or 5-HTP applications caused a significant decrease of membrane potential in premotor interneurons of naïve snails, associatively trained snails and snails with impaired serotonergic system by injection of a selective neurotoxin 5,7-dihydroxytryptamine (5,7-DHT) 1 week before the experiments. Applications of 5-HT or 5-HTP did not cause significant changes in the action potential (AP) threshold potential of these neurons in naïve snails. Conversely, applications of 5-HT or 5-HTP to the premotor interneurons of previously trained or 5,7-DHT-injected snails caused a significant increase in the firing threshold potential in spite of a depolarizing shift of the resting membrane potential. Results demonstrate that responsiveness of premotor interneurons to extracellularly applied 5-HT or 5-HTP changes for days after the associative training or serotonin depletion. Similarity of the effects in trained and 5,7-DHT-injected animals may be due to massive release of serotonin elicited by 5,7-DHT injection. Our results suggest that serotonin release due to aversive conditionining or elicited by the neurotoxin administration triggers similar changes in resting membrane potential and AP threshold in response to bath applications of 5-HT or its precursor 5-HTP.

Rat intersubjective decisions are encoded by frequency-specific oscillatory contexts

INTRODUCTION

It is unknown how the brain coordinates decisions to withstand personal costs in order to prevent other individuals' distress. Here we test whether local field potential (LFP) oscillations between brain regions create "neural contexts" that select specific brain functions and encode the outcomes of these types of intersubjective decisions.

METHODS

Rats participated in an "Intersubjective Avoidance Test" (IAT) that tested rats' willingness to enter an innately aversive chamber to prevent another rat from getting shocked. c-Fos immunoreactivity was used to screen for brain regions involved in IAT performance. Multi-site local field potential (LFP) recordings were collected simultaneously and bilaterally from five brain regions implicated in the c-Fos studies while rats made decisions in the IAT. Local field potential recordings were analyzed using an elastic net penalized regression framework.

RESULTS

Rats voluntarily entered an innately aversive chamber to prevent another rat from getting shocked, and c-Fos immunoreactivity in brain regions known to be involved in human empathy-including the anterior cingulate, insula, orbital frontal cortex, and amygdala-correlated with the magnitude of "intersubjective avoidance" each rat displayed. Local field potential recordings revealed that optimal accounts of rats' performance in the task require specific frequencies of LFP oscillations between brain regions in addition to specific frequencies of LFP oscillations within brain regions. Alpha and low gamma coherence between spatially distributed brain regions predicts more intersubjective avoidance, while theta and high gamma coherence between a separate subset of brain regions predicts less intersubjective avoidance. Phase relationship analyses indicated that choice-relevant coherence in the alpha range reflects information passed from the amygdala to cortical structures, while coherence in the theta range reflects information passed in the reverse direction.

CONCLUSION

These results indicate that the frequency-specific "neural context" surrounding brain regions involved in social cognition encodes outcomes of decisions that affect others, above and beyond signals from any set of brain regions in isolation.

Impairment of the serotonergic neurons underlying reinforcement elicits extinction of the repeatedly reactivated context memory

We analyzed changes in the activity of individually identifiable neurons involved in the networks underlying feeding and withdrawal behaviors in snails before, during, and after aversive learning in vitro. Responses to food in the “reinforcing” serotonergic neurons involved in withdrawal changed significantly after training, implying that these serotonergic cells participate in the reactivation of memory and are involved in the reconsolidation process. In behavioral experiments it was shown that impairment of the functioning of the serotonergic system with the selective neurotoxin 5,7-DiHT did not change the memory, when tested once, but resulted in a complete extinction of the contextual memory after repeated reactivation of memory. Conversely, the cued memory to a specific type of food was significantly reduced but still present. Thus, we conclude that it is only for the context memory, that participation of the “reinforcing” serotonergic neurons in memory retrieval may be the gate condition for the choice between extinction/reconsolidation.

The Sea Slug, Pleurobranchaea californica: A Signpost Species in the Evolution of Complex Nervous Systems and Behavior

How and why did complex brain and behavior evolve? Clues emerge from comparative studies of animals with simpler morphology, nervous system, and behavioral economics. The brains of vertebrates, arthropods, and some annelids have highly derived executive structures and function that control downstream, central pattern generators (CPGs) for locomotion, behavioral choice, and reproduction. For the vertebrates, these structures-cortex, basal ganglia, and hypothalamus-integrate topographically mapped sensory inputs with motivation and memory to transmit complex motor commands to relay stations controlling CPG outputs. Similar computations occur in the central complex and mushroom bodies of the arthropods, and in mammals these interactions structure subjective thought and socially based valuations. The simplest model systems available for comparison are opisthobranch molluscs, which have avoided selective pressure for complex bodies, brain, and behavior through potent chemical defenses. In particular, in the sea-slug Pleurobranchaea californica the functions of vertebrates' olfactory bulb and pallium are performed in the peripheral nervous system (PNS) of the chemotactile oral veil. Functions of hypothalamus and basal ganglia are combined in Pleurobranchaea's feeding motor network. The actions of basal ganglia on downstream locomotor regions and spinal CPGs are analogous to Pleurobranchaea's feeding network actions on CPGs for agonist and antagonist behaviors. The nervous systems of opisthobranch and pulmonate gastropods may conserve or reflect relations of the ancestral urbilaterian. Parallels and contrasts in neuronal circuits for action selection in Pleurobranchaea and vertebrates suggest how a basic set of decision circuitry was built upon in evolving segmentation, articulated skeletons, sociality, and highly invested reproductive strategies. They suggest (1) an origin of olfactory bulb and pallium from head-region PNS; (2) modularization of an ancestral feeding network into discrete but interacting executive modules for incentive comparison and decision (basal ganglia), and homeostatic functions (hypothalamus); (3) modification of a multifunctional premotor network for turns and locomotion, and its downstream targets for mid-brain and hind-brain motor areas and spinal CPGs; (4) condensation of a distributed serotonergic network for arousal into the raphe nuclei, with superimposed control by a peptidergic hypothalamic network mediating appetite and arousal; (5) centralization and condensation of the dopaminergic sensory afferents of the PNS, and/or the disperse dopaminergic elements of central CPGs, into the brain nuclei mediating valuation, reward, and motor arousal; and (6) the urbilaterian possessed the basic circuit relations integrating sensation, internal state, and learning for cost-benefit approach-avoidance decisions.

The activity of isolated neurons and the modulatory state of an isolated nervous system represent a recent behavioural state

Behavioural/motivational state is known to influence nearly all aspects of physiology and behaviour. The cellular basis of behavioural state control is only partially understood. Our investigation, performed on the pond snail Lymnaea stagnalis whose nervous system is useful for work on completely isolated neurons, provided several results related to this problem. First, we demonstrated that the behavioural state can produce long-term changes in individual neurons that persist even after neuron isolation from the nervous system. Specifically, we found that pedal serotonergic neurons that control locomotion show higher activity and lower membrane potential after being isolated from the nervous systems of hungry animals. Second, we showed that the modulatory state (the chemical neuroactive microenvironment of the central ganglia) changes in accordance with the nutritional state of an animal and produces predicted changes in single isolated locomotor neurons. Third, we report that observed hunger-induced effects can be explained by the increased synthesis of serotonin in pedal serotonergic neurons, which has an impact on the electrical activity of isolated serotonergic neurons and the intensity of extrasynaptic serotonin release from the pedal ganglia.