Evidence for opioid involvement in the regulation of song production in male European starlings (Sturnus vulgaris)

Delta opioid receptors affect acoustic features of song during vocal learning in zebra finches

Delta-opioid receptors (δ-ORs) are known to be involved in associative learning and modulating motivational states. We wanted to study if they were also involved in naturally-occurring reinforcement learning behaviors such as vocal learning, using the zebra finch model system. Zebra finches learn to vocalize early in development and song learning in males is affected by factors such as the social environment and internal reward, both of which are modulated by endogenous opioids. Pairs of juvenile male siblings (35-day-old) were systemically administered a δ-OR-selective antagonist naltrindole or vehicle (controls) for a period of 10 days. The acoustic structure of songs differed across treated and control groups at adulthood (120 days). Naltrindole-treated birds had a significantly lower pitch, mean frequency, and frequency modulation than controls, whereas there was no difference in the number of songs in naltrindole-treated and control siblings. Since the opioid and dopaminergic systems interact, we decided to study whether blocking δ-ORs during the sensitive period led to changes in dopaminoceptive neurons in Area X, a song control nucleus in the basal ganglia. Interestingly, compared with controls, naltrindole-treated birds had higher numbers of DARPP-32-positive medium spiny neurons and potentially excitatory synapses in Area X. We show that manipulating δ-OR signaling during the learning phase resulted in alterations in the acoustic features of song and had long term effects on dopaminergic targets within the basal ganglia in adulthood. Our results suggest that endogenous opioids regulate the development of cognitive processes and the underlying neural circuitry during the sensitive period for learning.

Using seasonality and birdsong to understand mechanisms underlying context-appropriate shifts in social motivation and reward

Social motivation and reward are dynamic and flexible, shifting adaptively across contexts to meet changing social demands. This is exceptionally apparent when seasonal contexts are considered in seasonally breeding songbirds as they cycle from periods of sexual motivation and reward during the breeding season to periods of extreme gregariousness outside the breeding season when non-sexual social interactions gain reward value, motivating birds to form flocks. Here we review evidence demonstrating a key integrative role for the medial preoptic area (mPOA) in the seasonally-appropriate adjustment of behaviors, with seasonal changes in dopamine activity in mPOA adjusting social motivation and changes in opioid activity modifying social reward. Experiments demonstrate that dramatic seasonal fluctuations in steroid hormone concentrations alter patterns of opioid- and dopamine-related protein and gene expression in mPOA to modify social motivation and reward to meet seasonal changes in social demands. These studies of birdsong and seasonality provide new insights into neural and endocrine mechanisms underlying adaptive changes in social motivation and reward and highlight an underappreciated, evolutionarily conserved role for the mPOA in important social behaviors in non-reproductive contexts.

The Role of the Endogenous Opioid System in the Vocal Behavior of Songbirds and Its Possible Role in Vocal Learning

The opioid system in the brain is responsible for processing affective states such as pain, pleasure, and reward. It consists of three main receptors, mu- (μ-ORs), delta- (δ-ORs), and kappa- (κ-ORs), and their ligands – the endogenous opioid peptides. Despite their involvement in the reward pathway, and a signaling mechanism operating in synergy with the dopaminergic system, fewer reports focus on the role of these receptors in higher cognitive processes. Whereas research on opioids is predominated by studies on their addictive properties and role in pain pathways, recent studies suggest that these receptors may be involved in learning. Rodents deficient in δ-ORs were poor at recognizing the location of novel objects in their surroundings. Furthermore, in chicken, learning to avoid beads coated with a bitter chemical from those without the coating was modulated by δ-ORs. Similarly, μ-ORs facilitate long term potentiation in hippocampal CA3 neurons in mammals, thereby having a positive impact on spatial learning. Whereas these studies have explored the role of opioid receptors on learning using reward/punishment-based paradigms, the role of these receptors in natural learning processes, such as vocal learning, are yet unexplored. In this review, we explore studies that have established the expression pattern of these receptors in different brain regions of birds, with an emphasis on songbirds which are model systems for vocal learning. We also review the role of opioid receptors in modulating the cognitive processes associated with vocalizations in birds. Finally, we discuss the role of these receptors in regulating the motivation to vocalize, and a possible role in modulating vocal learning.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients (“undirected singing”). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

μ-Opioid Receptor Stimulation in the Nucleus Accumbens Increases Vocal-Social Interactions in Flocking European Starlings, Sturnus Vulgaris

Social connections in gregarious species are vital for safety and survival. For these reasons, many bird species form large flocks outside the breeding season. It has been proposed that such large social groups may be maintained via reward induced by positive interactions with conspecifics and via the reduction of a negative affective state caused by social separation. Moreover, within a flock optimal social spacing between conspecifics is important, indicating that individuals may optimize spacing to be close but not too close to conspecifics. The μ-opioid receptors (MORs) in the nucleus accumbens (NAc) are well known for their role in both reward and the reduction of negative affective states, suggesting that MOR stimulation in NAc may play a critical role in flock cohesion. To begin to test this hypothesis, social and nonsocial behaviors were examined in male and female European starlings (Sturnus vulgaris) in nonbreeding flocks after intra-NAc infusion of saline and three doses of the selective MOR agonist d-Ala²-N-Me-Phe⁴-Glycol⁵-enkephalin (DAMGO). DAMGO in NAc dose-dependently increased singing behavior and facilitated social approaches while at the same time promoting displacements potentially used to maintain social spacing. These findings support the hypothesis that MORs in NAc promote social interactions important for group cohesion in nonsexual contexts and suggest the possibility that MORs in the NAc play a role in optimizing the pull of joining a flock with the push of potential agonistic encounters.

Endogenous opioids facilitate intrinsically-rewarded birdsong

Many songbirds sing in non-reproductive contexts while in flocks. Singing in such gregarious contexts is critical for maintaining and learning songs; however, song is not directed towards other individuals and has no obvious, immediate social consequences. Studies using conditioned place preference (CPP) tests of reward indicate that song production in gregarious contexts correlates positively with a bird’s intrinsic reward state and with opioid markers in the medial preoptic nucleus (mPOA). However, the causal involvement of opioids in gregarious song is unknown. Here we report that the selective mu opioid receptor (MOR) agonist fentanyl dose-dependently facilitates gregarious song and reduces stress/anxiety-related behavior in male and female European starlings. Furthermore, infusion of siRNA targeting MORs specifically in mPOA both suppresses gregarious song and disrupts the positive association between affective state and singing behavior, as revealed using CPP tests of song-associated reward. Results strongly implicate opioids in gregarious song and suggest that endogenous opioids in the mPOA may facilitate song by influencing an individual’s intrinsic reward state.

Why Do Birds Flock? A Role for Opioids in the Reinforcement of Gregarious Social Interactions

The formation of social groups provides safety and opportunities for individuals to develop and practice important social skills. However, joining a social group does not result in any form of obvious, immediate reinforcement (e.g., it does not result in immediate copulation or a food reward), and individuals often remain in social groups despite agonistic responses from conspecifics. Much is known about neural and endocrine mechanisms underlying the motivation to perform mate- or offspring-directed behaviors. In contrast, relatively little is known about mechanisms underlying affiliative behaviors outside of these primary reproductive contexts. Studies on flocking behavior in songbirds are beginning to fill this knowledge gap. Here we review behavioral evidence that supports the hypothesis that non-sexual affiliative, flocking behaviors are both (1) rewarded by positive social interactions with conspecifics, and (2) reinforced because affiliative contact reduces a negative affective state caused by social isolation. We provide evidence from studies in European starlings, Sturnus vulgaris, that mu opioid receptors in the medial preoptic nucleus (mPOA) play a central role in both reward and the reduction of a negative affective state induced by social interactions in flocks, and discuss potential roles for nonapeptide/opioid interactions and steroid hormones. Finally, we develop the case that non-sexual affiliative social behaviors may be modified by two complementary output pathways from mPOA, with a projection from mPOA to the periaqueductal gray integrating information during social interactions that reduces negative affect and a projection from mPOA to the ventral tegmental area integrating information leading to social approach and reward.

Behavioral evidence for sex steroids hypersensitivity in castrated male canaries

In seasonally breeding songbirds such as canaries, singing behavior is predominantly under the control of testosterone and its metabolites. Short daylengths in the fall that break photorefractoriness are followed by increasing daylengths in spring that activate singing via both photoperiodic and hormonal mechanisms. However, we observed in a group of castrated male Fife fancy canaries maintained for a long duration under a short day photoperiod a large proportion of subjects that sang at high rates. This singing rate was not correlated with variation in the low circulating concentrations of testosterone. Treatment of these actively singing castrated male canaries with a combination of an aromatase inhibitor (ATD) and an androgen receptor blocker (flutamide) only marginally decreased this singing activity as compared to control untreated birds and did not affect various measures of song quality. The volumes of HVC and of the medial preoptic nucleus (POM) were also unaffected by these treatments but were relatively large and similar to volumes in testosterone-treated males. In contrast, peripheral androgen-sensitive structures such as the cloacal protuberance and syrinx mass were small, similar to what is observed in castrates. Together these data suggest that after a long-term steroid deprivation singing behavior can be activated by very low concentrations of testosterone. Singing normally depends on the activation by testosterone and its metabolites of multiple downstream neurochemical systems such as catecholamines, nonapeptides or opioids. These transmitter systems might become hypersensitive to steroid action after long term castration as they probably are at the end of winter during the annual cycle in seasonally breeding temperate zone species.

Song practice as a rewarding form of play in songbirds

In adult songbirds, the primary functions of song are mate attraction and territory defense; yet, many songbirds sing at high rates as juveniles and outside these primary contexts as adults. Singing outside primary contexts is critical for song learning and maintenance, and ultimately necessary for breeding success. However, this type of singing (i.e., song "practice") occurs even in the absence of immediate or obvious extrinsic reinforcement; that is, it does not attract mates or repel competitors. Here we review studies that support the hypothesis that song practice is stimulated and maintained by intrinsic reward mechanisms (i.e., that it is associated with a positive affective state). Additionally, we propose that song practice can be considered a rewarding form of play behavior similar to forms of play observed in multiple young animals as they practice sequences of motor events that are used later in primary adult reproductive contexts. This review highlights research suggesting at least partially overlapping roles for neural reward systems in birdsong and mammalian play and evidence that steroid hormones modify these systems to shift animals from periods of intrinsically rewarded motor exploration (i.e., singing in birds and play in mammals) to the use of similar motor patterns in primary reproductive contexts.

Song-associated reward correlates with endocannabinoid-related gene expression in male European starlings (Sturnus vulgaris)

Vocal communication is required for successful social interactions in numerous species. During the breeding season, songbirds produce songs that are reinforced by behavioral consequences (e.g., copulation). However, some songbirds also produce songs not obviously directed at other individuals. The consequences maintaining or reinforcing these songs are less obvious and the neural mechanisms associated with undirected communication are not well-understood. Previous studies indicate that undirected singing is intrinsically rewarding and mediated by opioid or dopaminergic systems; however, endocannabinoids are also involved in regulating reward and singing behavior. We used a conditioned place preference paradigm to examine song-associated reward in European starlings and quantitative real-time PCR to measure expression of endocannabinoid-related neural markers (CB₁, FABP7, FABP5, FAAH, DAGLα), in brain regions involved in social behavior, reward and motivation (ventral tegmental area [VTA], periaqueductal gray [PAG], and medial preoptic nucleus [POM]), and a song control region (Area X). Our results indicate that starlings producing high rates of song developed a conditioned place preference, suggesting that undirected song is associated with a positive affective state. We found a significant positive relationship between song-associated reward and CB₁ receptors in VTA and a significant negative relationship between song-associated reward and CB₁ in PAG. There was a significant positive relationship between reward and the cannabinoid transporter FABP7 in POM and a significant negative relationship between reward and FABP7 in PAG. In Area X, FABP5 and DAGLα correlated positively with singing. These results suggest a role for endocannabinoid signaling in vocal production and reward associated with undirected communication.

Differential relationships between D1 and D2 dopamine receptor expression in the medial preoptic nucleus and sexually-motivated song in male European starlings (Sturnus vulgaris)

Converging data in songbirds support a central role for the medial preoptic nucleus (POM) in motivational aspects of vocal production. Recent data suggest that dopamine in the POM plays a complex modulatory role in the production of sexually-motivated song and that an optimal level of dopamine D1 receptor stimulation is required to facilitate singing behavior. To further explore this possibility, we used quantitative real-time PCR to examine relationships between mRNA expression of D1 as well as D2 receptors in the POM (and also the lateral septum and Area X) and sexually-motivated singing behavior in male European starlings. Results showed that both males with the highest and lowest D1 expression in the POM sang significantly less than males with intermediate levels of expression. Furthermore, singing behavior rose linearly in association with increasing levels of D1 expression in POM but dropped abruptly, such that individuals with D1 expression values higher than the mean sang very little. Analysis of birds with low and intermediate levels of D1 expression in POM revealed strong positive correlations between D1 expression and song but negative relationships between D2 receptor expression and song. These findings support prior work suggesting an optimal level of POM D1 receptor stimulation best facilitates sexually-motivated singing behavior. Results also suggest that D2 receptors may work in opposition to D1 receptors in POM to modify vocal production.

Diurnal oscillation of vocal development associated with clustered singing by juvenile songbirds

Spaced practice affects learning efficiency in humans and other animals. However, it is not well understood how spaced practice contributes to learning during development. Here, we show the behavioral significance of singing frequency in song development in a songbird, the zebra finch. Songbirds learn a complex song pattern by trial-and-error vocalizations as self-motivated practice, which is executed over a thousand times per day during the sensitive period of vocal learning. Notably, juveniles generate songs with a high frequency of singing in clusters with dense singing, whereas adults sing with low frequency in short clusters. This juvenile-specific clustered singing was characterized by clear separations of daily time for intense practice and rest. During the epochs of vocal practice in juveniles, the song structure approached that of song produced at the end of the day. In contrast, during the epochs of vocal rest, the structure of juvenile songs regressed toward that of songs produced at the beginning of the day, indicating a dynamic progression and regression of song development over the course of the day. When the singing frequency was manipulated to decrease it at the juvenile stage, the oscillation rate of song development was dramatically reduced. Although the juvenile-specific clustered singing occurred in non-tutored socially isolated birds or those with auditory deprivation, the diurnal oscillation of vocal development was only observed in non-tutored isolated juveniles. These results show the impact of 'self-motivated' vocal practice on diurnal song developmental plasticity, modulated by the amount of vocal output and auditory feedback.

Sexually-motivated song is predicted by androgen-and opioid-related gene expression in the medial preoptic nucleus of male European starlings (Sturnus vulgaris)

Across vertebrates, communication conveys information about an individual's motivational state, yet little is known about the neuroendocrine regulation of motivational aspects of communication. For seasonally breeding songbirds, increases in testosterone in spring stimulate high rates of sexually-motivated courtship song, though not all birds sing at high rates. It is generally assumed that testosterone or its metabolites act within the medial preoptic nucleus (POM) to stimulate the motivation to sing. In addition to androgen receptors (ARs) and testosterone, opioid neuropeptides in the POM influence sexually-motivated song production, and it has been proposed that testosterone may in part regulate song by modifying opioid systems. To gain insight into a possible role for androgen-opioid interactions in the regulation of communication we examined associations between sexually-motivated song and relative expression of ARs, mu opioid receptors (muORs), and preproenkephalin (PENK) in the POM (and other regions) of male European starlings using qPCR. Both AR and PENK expression in POM correlated positively with singing behavior, whereas muOR in POM correlated negatively with song. Furthermore, the ratio of PENK/muOR expression correlated negatively with AR expression in POM. Finally, in the ventral tegmental area (VTA), PENK expression correlated negatively with singing behavior. Results support the hypothesis that ARs may alter opioid gene expression in POM to fine-tune singing to reflect a male's motivational state. Data also suggest that bidirectional relationships may exist between opioids and ARs in POM and song, and additionally support a role for opioids in the VTA, independent of AR activity in this region.

Reward associated with singing behavior correlates with opioid-related gene expression in the medial preoptic nucleus in male European starlings

Birdsong consists of species-specific learned vocal sequences that are used primarily to attract mates and to repel competitors during the breeding season. However, many birds continue to sing at times when vocal production has no immediate or obvious impact on conspecific behavior. The mechanisms that ensure that animals produce important behaviors in contexts in which the function of these behaviors is not immediate or obvious are not known. One possibility is that animals engage in such behaviors because they are associated with pleasure. Here we examined the hypothesis that male European starlings sing outside of the breeding season in part because the act of singing in this context is facilitated and/or maintained by opioid-mediated reward. We measured song-associated reward using a conditioned place preference (CPP) test in male starlings producing fall, non-breeding season-typical song. We used quantitative real time PCR to measure expression of the enkephalin opioid precursor preproenkephalin (PENK) and mu opioid receptors (MOR) in the medial preoptic nucleus (POM; a region in which opioids are implicated in both reward and starling fall song) and additionally the song control region HVC as a control. Starlings developed a strong preference for a place that had been paired previously with the act of producing fall-typical song, indicating that fall song production was associated with a positive affective state. Both PENK and MOR mRNA expression in the POM, but not HVC, correlated positively with both individual reward state (as reflected in CPP) and undirected singing behavior. These results suggest that singing induces opioid receptor and enkephalin expression in the POM and consequent reward, and/or that opioid release in the POM induced by individual or environmental factors (e.g., the presence of food, safety of a flock or the absence of predators) induces a positive affective state which then facilitates singing behavior.

Mu opioid receptor in spermatozoa, eggs and larvae of gilthead sea bream (Sparus Aurata) and its involvement in stress related to aquaculture

In aquaculture, unfavourable conditions experienced during early development may have strong downstream effects on the adult phenotype and fitness. Sensitivity to stress, leading to disease, reduced growth and mortality, is higher in larvae than in adult fish. In this study, conducted on sea bream (Sparus aurata), we evidenced the presence of the mu opioid receptor in gametes and larvae at different developmental stages. Moreover, we evaluated the possibility of reducing the effects of artificially produced stress, altering temperature, salinity and pH, by naloxone (an opioid antagonist) and calcium. Results evidenced that mu opioid receptor is present in larvae and in gametes of both sexes and that, during larval growth, its expression level changes accordingly; furthermore, naloxone/calcium association is efficacious in increasing the survival period of treated larvae compared to controls. We conclude that in sea bream rearing, the use of naloxone/calcium against stress can improve fish farming techniques by reducing larval mortality and consequently increasing productivity.

Status-appropriate singing behavior, testosterone and androgen receptor immunolabeling in male European starlings (Sturnus vulgaris)

Vocalizations convey information about an individual's motivational, internal, and social status. As circumstances change, individuals respond by adjusting vocal behavior accordingly. In European starlings, a male that acquires a nest site socially dominates other males and dramatically increases courtship song. Although circulating testosterone is associated with social status and vocal production it is possible that steroid receptors fine-tune status-appropriate changes in behavior. Here we explored a possible role for androgen receptors. Male starlings that acquired nest sites produced high rates of courtship song. For a subset of males this occurred even in the absence of elevated circulating testosterone. Immunolabeling for androgen receptors (ARir) was highest in the medial preoptic nucleus (POM) in males with both a nest site and elevated testosterone. For HVC, ARir was higher in dominant males with high testosterone (males that sang longer songs) than dominant males with low testosterone (males that sang shorter songs). ARir in the dorsal medial portion of the nucleus intercollicularis (DM) was elevated in males with high testosterone irrespective of dominance status. Song bout length related positively to ARir in POM, HVC and DM, and testosterone concentrations related positively to ARir in POM and DM. Results suggest that the role of testosterone in vocal behavior differs across brain regions and support the hypothesis that testosterone in POM underlies motivation, testosterone in HVC relates to song quality, and testosterone in DM stimulates vocalizations. Our data also suggest that singing may influence AR independent of testosterone and that alternative androgen-independent pathways regulate status-appropriate singing behavior.

Curvilinear relationships between mu-opioid receptor labeling and undirected song in male European starlings (Sturnus vulgaris)

Female-directed communication in male songbirds has been reasonably well studied; yet, relatively little is known about communication in other social contexts. Songbirds also produce song that is not clearly directed towards another individual (undirected song) when alone or in flocks. Although the precise functions of undirected song may differ across species, this type of song is considered important for flock maintenance, song learning or practice. Past studies show that undirected song is tightly coupled to analgesia and positive affective state, which are both mediated by opioid activity. Furthermore, labeling for the opioid met-enkephalin in the medial preoptic nucleus (POM) correlates positively with undirected song production. We propose that undirected song is facilitated and maintained by opioid receptor activity in the POM and other brain regions involved in affective state, analgesia, and social behavior. To provide insight into this hypothesis, we used immunohistochemistry to examine relationships between undirected song and mu-opioid receptors in male starlings. Polynomial regression analyses revealed significant inverted-U shaped relationships between measures of undirected song and mu-opioid receptor labeling in the POM, medial bed nucleus of the stria terminalis (BSTm), and periaqueductal gray (PAG). These results suggest that low rates of undirected song may stimulate and/or be maintained by mu-opioid receptor activity; however, it may be that sustained levels of mu-opioid receptor activity associated with high rates of undirected song cause mu-opioid receptor down-regulation. The results indicate that mu-opioid receptor activity in POM, BSTm, and PAG may underlie previous links identified between undirected song, analgesia, and affective state.

Modulation of male song by naloxone in the medial preoptic nucleus

Studies in songbirds implicate opioid neuropeptides in singing behavior; however, past results are contradictory. In starlings, the effect of opioid manipulations on sexually motivated courtship song differed in birds naturally singing at low compared to high rates, and mu-opioid receptors were denser in several regions, including the medial preoptic nucleus (POM) in low singing males. In the present study, we found that low singing male starlings also had significantly higher enkephalin (ENK) immunolabeling densities in the POM than high singers. We blocked opioid receptor activity in the POM with naloxone injections and found that this increased both song rate and song bout length in low singers, suggesting that high densities of mu receptors and ENK in the POM actively suppress song in these males. In contrast to its effects on low singers, naloxone in the POM of high singers dose dependently decreased song rate and tended to reduce song bout length. This suggests that at least some level of opioid activity in POM is necessary for song production. Our results are the first to demonstrate that direct administration of naloxone into the POM influences sexually motivated song, and that effects differ depending on an individual's initial rate of song and associated density of ENK. We suggest that differential effects seen in past studies of opioids and song may in part be explained by differences in the natural song rate of subjects and accompanying differences in ENK activity and neural substrate sensitivity to opioids in POM.

Links between breeding readiness, opioid immunolabeling, and the affective state induced by hearing male courtship song in female European starlings (Sturnus vulgaris)

Male courtship vocalizations represent a potent signal designed to attract females; however, not all females find male signals equally attractive. We explored the possibility that the affective state induced by hearing courtship vocalizations depends on the motivational state of a receiver. We used a conditioned place preference test of reward to determine the extent to which the rewarding properties of hearing male courtship song differed in female European starlings categorized as nest box owners (a sign of breeding readiness) or non-owners. Nest box owners developed a preference for a chamber in which they previously heard male courtship song. Non-owners displayed no preference for a chamber in which they previously heard song. Positive correlations were identified between the preference a female developed for the song-paired chamber and female nesting and dominance behaviors observed prior to conditioning (indices of the motivation to breed). Immunolabeling for met-enkephalin (an opioid neuropeptide involved in reward) in the medial preoptic nucleus, ventromedial nucleus of the hypothalamus, nucleus accumbens, and periaqueductal gray was higher in females with compared to those without nest boxes. Both nest box entries and song-induced place preference also correlated positively with met-enkephalin labeling in the ventromedial nucleus of the hypothalamus. These findings indicate that the reward value of vocal signals is linked to individual differences in motivational state; and that differences in enkephalin activity may play a role in modifying an individual's motivational state and/or the reward value of song.

Context-dependent links between song production and opioid-mediated analgesia in male European starlings (Sturnus vulgaris)

Little is known about the neural mechanisms that ensure appropriate vocal behaviors within specific social contexts. Male songbirds produce spontaneous (undirected) songs as well as female-directed courtship songs. Opioid neuropeptide activity in specific brain regions is rewarding, at least in mammals, and past studies suggest that the opioid met-enkephalin in such areas is more tightly linked to undirected than female-directed song. Recent data using a song-associated place preference paradigm further suggest that production of undirected but not directed song is tightly linked to intrinsic reward. Opioids have analgesic properties. Therefore, if production of undirected song is closely linked to opioid-mediated reward, the production of undirected but not directed song should be associated with analgesia. Consistent with this prediction, in male starlings we identified a positive correlation between analgesia (decreased reactivity to a hot water bath) and undirected song (in non-breeding season condition males in affiliative flocks) but not female-directed song (in breeding season condition males presented with females). When breeding condition males were divided according to social status, a negative correlation was found in subordinate males (i.e. males that failed to acquire a nest box). These data are consistent with the hypotheses 1) that the production of undirected song is facilitated or maintained by opioids (and/or other neuromodulators that also induce analgesia) and 2) that production of female-directed song is not linked in the same way to release of the same neuromodulators. Results also demonstrate a link between analgesia and song in subordinate individuals lacking a nesting territory within the breeding season. Overall, the findings indicate that distinct neural mechanisms regulate communication in different social contexts and support the working hypothesis that undirected but not directed song is tightly linked to opioid release.

Reward and vocal production: song-associated place preference in songbirds

Vocal production is crucial for successful social interactions in multiple species. Reward can strongly influence behavior; however, the extent to which reward systems influence vocal behavior is unknown. In songbirds, singing occurs in different contexts. It can be spontaneous and undirected (e.g., song produced alone or as part of a large flock) or directed towards a conspecific (e.g., song used to attract a mate or influence a competitor). In this study, we developed a conditioned place preference paradigm to measure reward associated with different types of singing behavior in two songbird species. Both male zebra finches and European starlings developed a preference for a chamber associated with production of undirected song, suggesting that the production of undirected song is tightly coupled to intrinsic reward. In contrast, neither starlings nor zebra finches developed a place preference in association with directed song; however, male starlings singing directed song that failed to attract a female developed a place aversion. Unsuccessful contact calling behavior was also associated with a place aversion. These findings suggest that directed vocal behavior is not tightly linked to intrinsic reward but may be externally reinforced by social interactions. Data across two species thus support the hypothesis that the production of undirected but not directed song is tightly coupled to intrinsic reward. This study is the first to identify song-associated reward and suggests that reward associated with vocal production differs depending upon the context in which communication occurs. The findings have implications for understanding what motivates animals to engage in social behaviors and ways in which distinct reward mechanisms function to direct socially appropriate behaviors.

The role of motivation and reward neural systems in vocal communication in songbirds

Many vertebrates are highly motivated to communicate, suggesting that the consequences of communication may be rewarding. Past studies show that dopamine and opioids in the medial preoptic nucleus (mPOA) and ventral tegmental area (VTA) play distinct roles in motivation and reward. In songbirds, multiple lines of recent evidence indicate that the roles of dopamine and opioid activity in mPOA and VTA in male birdsong differ depending upon whether song is used to attract females (sexually-motivated) or is produced spontaneously (undirected). Evidence is reviewed supporting the hypotheses that (1) mPOA and VTA interact to influence the context in which a male sings, (2) distinct patterns of dopamine activity underlie the motivation to produce sexually-motivated and undirected song, (3) sexually-motivated communication is externally reinforced by opioids released as part of social interactions, and (4) undirected communication is facilitated and rewarded by immediate opioid release linked to the act of singing.

Seasonal and individual variation in singing behavior correlates with α2-noradrenergic receptor density in brain regions implicated in song, sexual, and social behavior

In seasonally breeding male songbirds, both the function of song and the stimuli that elicit singing behavior change seasonally. The catecholamine norepinephrine (NE) modulates attention and arousal across behavioral states, yet the role of NE in seasonally-appropriate vocal communication has not been well-studied. The present study explored the possibility that seasonal changes in alpha 2-noradrenergic receptors (α(2)-R) within song control regions and brain regions implicated in sexual arousal and social behavior contribute to seasonal changes in song behavior in male European starlings (Sturnus vulgaris). We quantified singing behavior in aviary housed males under spring breeding season conditions and fall conditions. α(2)-R were identified with the selective ligand [(3)H]RX821002 using autoradiographic methods. The densities of α(2)-R in song control regions (HVC and the robust nucleus of the arcopallium [RA]) and the lateral septum (LS) were lower in Spring Condition males. α(2)-R densities in the caudal portion of the medial preoptic nucleus (POM) related negatively to singing behavior. Testosterone concentrations were highest in Spring Condition males and correlated with α(2)-R in LS and POM. Results link persistent seasonal alterations in the structure or function of male song to seasonal changes in NE α(2)-Rs in HVC, RA, and LS. Individual differences in α(2)-R in the POM may in part explain individual differences in song production irrespective of the context in which a male is singing, perhaps through NE modification of male sexual arousal.

Pleasure seeking and birdsong

Songbirds sing at high rates within multiple contexts, suggesting that they are highly motivated to communicate and that the act of singing itself may be rewarding. Little is known about the neural regulation of the motivation to communicate. Dopamine and opioid neuropeptides play a primary role in reward seeking and sensory pleasure. In songbirds, these neurochemicals are found within brain regions implicated in both motivation and reward, including the medial preoptic nucleus (mPOA) and ventral tegmental area (VTA). Several lines of research indicate that dopamine and opioids in these regions play a role in birdsong that differs depending upon whether song is used to attract females (female-directed song) or is not directed towards other individuals (undirected song). Evidence is reviewed supporting the hypotheses: (1) that distinct patterns of dopamine activity influence the motivation to produce undirected and female-directed song, (2) that undirected communication is intrinsically reinforced by immediate release of opioids induced by the act of singing, and (3) that directed communication is socially reinforced by opioids released as part of social interactions.

Mu-opioid receptor densities are depleted in regions implicated in agonistic and sexual behavior in male European starlings (Sturnus vulgaris) defending nest sites and courting females

Social status and resource availability can strongly influence individual behavioral responses to conspecifics. In European starlings, males that acquire nest sites sing in response to females and dominate other males. Males without nest sites sing, but not to females, and they do not interact agonistically with other males. Little is known about the neural regulation of status- or resource-appropriate behavioral responses to conspecifics. Opioid neuropeptides are implicated in birdsong and agonistic behavior, suggesting that opioids may underlie differences in the production of these behaviors in males with and without nest sites. Here, we examined densities of immunolabeled mu-opioid receptors in groups of male starlings. Males that defended nest boxes dominated other males and sang at higher rates when presented with a female than males without nest boxes, independent of testosterone concentrations. Multiple regression analyses showed nest box ownership (not agonistic behavior or singing) predicted the optical density of receptor labeling in the medial bed nucleus of stria terminalis, paraventricular nucleus, ventral tegmental area and the medial preoptic nucleus. Compared to males without nest boxes, males with nest boxes had lower densities of immunolabeled mu-opioid receptors in these regions. Singing additionally predicted the area covered by labeling in the ventral tegmental area. The results suggest that elevated opioid activity in these regions suppresses courtship and agonistic behavioral responses to conspecifics in males without nest boxes. The findings are consistent with a dynamic role for opioid receptors in adjusting social behavior so that it is appropriate given the resources available to an individual.

Photoperiodic differences in a forebrain nucleus involved in vocal plasticity: enkephalin immunoreactivity reveals volumetric variation in song nucleus lMAN but not NIf in male European starlings (Sturnus vulgaris)

Seasonal variation in the volume of various song control nuclei in many passerine species remains one of the best examples of naturally occurring adult neuroplasticity among vertebrates. The lateral portion of the magnocellular nucleus of the anterior nidopallium (lMAN) is a song nucleus that is important for song learning and seems to be critical for inducing variability in the song structure that is later pruned via a feedback process to produce adult crystallized song. To date, lMAN has not been shown to exhibit seasonal changes in volume, probably because it is difficult to resolve the boundaries of lMAN when employing histological methods based on Nissl staining. Here, lMAN(core) volumes were examined in intact photostimulated (i.e., breeding), castrated photostimulated and photorefractory (i.e., nonbreeding) male starlings (Sturnus vulgaris) to investigate the degree of seasonal variation in brain morphology. We present data demonstrating that the volumes of the total MAN and lMAN(core) delineated by enkephalin immunoreactivity are greater in photostimulated male starlings as compared to photorefractory males. Moreover, two other regions associated with the song system that have not been investigated previously in the context of seasonal plasticity namely (i) the medial portion of MAN (mMAN), and (ii) the nucleus interfacialis (NIf) did not display significant volumetric variation. We propose that greater lMAN(core) volumes are associated with the increase in vocal plasticity that is generally observed prior to production of stereotyped song.

Estradiol interacts with an opioidergic network to achieve rapid modulation of a vocal pattern generator

Estrogens rapidly regulate neuronal activity within seconds-to-minutes, yet it is unclear how estrogens interact with neural circuits to rapidly coordinate behavior. This study examines whether 17-beta-estradiol interacts with an opioidergic network to achieve rapid modulation of a vocal control circuit. Adult plainfin midshipman fish emit vocalizations that mainly differ in duration, and rhythmic activity of a hindbrain–spinal vocal pattern generator (VPG) directly establishes the temporal features of midshipman vocalizations. VPG activity is therefore predictive of natural calls, and ‘fictive calls’ can be elicited by electrical microstimulation of the VPG. Prior studies show that intramuscular estradiol injection rapidly (within 5 min) increases fictive call duration in midshipman. Here, we delivered opioid antagonists near the VPG prior to estradiol injection. Rapid estradiol actions on fictive calling were completely suppressed by the broad-spectrum opioid antagonist naloxone and the mu-opioid antagonist beta-funaltrexamine, but were unaffected by the kappa-opioid antagonist nor-binaltorphimine. Unexpectedly, prior to estradiol administration, all three opioid antagonists caused immediate, transient reductions in fictive call duration. Together, our results indicate that: (1) vocal activity is modulated by opioidergic networks, confirming hypotheses from birds and mammals, and (2) the rapid actions of estradiol on vocal patterning depend on interactions with a mu-opioid modulatory network.

Dopaminergic system in birdsong learning and maintenance

Dopamine function in birdsong has been studied extensively in recent years. Several song and auditory nuclei are innervated by midbrain dopaminergic fibers and contain neurons with various dopamine receptors. During sexually motivated singing, activity of midbrain dopaminergic neurons in the ventral tegmental area and dopamine release in the striatal Area X, involved in song learning and maintenance, are higher. In this review we provide an overview of the dopaminergic system and neurotransmission in songbirds and the outline of possible involvement of dopamine in control of song learning, production, and maintenance. Based on both behavioral and computational biology data, we describe several models of song learning and the proposed role of dopamine in them. Special attention is given to possible role of dopamine in incentive salience (wanting) and reward prediction error signaling during song learning and maintenance, as well as the role of dopamine-mediated synaptic plasticity in reward processing. Finally, the role of dopamine in determination of personality traits in relation to birdsong is discussed.

Evidence for opioid involvement in the motivation to sing

Songbirds produce high rates of song within multiple social contexts, suggesting that they are highly motivated to sing and that song production itself may be rewarding. Progress has been made in understanding the neural basis of song learning and sensorimotor processing, however little is known about neurobiological mechanisms regulating the motivation to sing. Neural systems involved in motivation and reward have been conserved across species and in songbirds are neuroanatomically well-positioned to influence the song control system. Opioid neuropeptides within these systems play a primary role in hedonic reward, at least in mammals. In songbirds, opioid neuropeptides and receptors are found throughout the song control system and within several brain regions implicated in both motivation and reward, including the medial preoptic nucleus (POM) and ventral tegmental area (VTA). Growing research shows these regions to play a role in birdsong that differs depending upon whether song is sexually motivated in response to a female, used for territorial defense or sung as part of a flock but not directed towards an individual (undirected song). Opioid pharmacological manipulations and immunocytochemical data demonstrate a role for opioid activity possibly within VTA and POM in the regulation of song production. Although future research is needed, data suggest that opioids may be most critically involved in reinforcing song that does not result in any obvious form of immediate externally mediated reinforcement, such as undirected song produced in large flocks or during song learning. Data are reviewed supporting the idea that dopamine activity underlies the motivation or drive to sing, but that opioid release is what makes song production rewarding.

Lesions to the medial preoptic nucleus affect immediate early gene immunolabeling in brain regions involved in song control and social behavior in male European starlings

The medial preoptic nucleus (POM) is a brain region outside of the song control system of songbirds. It has been implicated in song production, sexual motivation, and the integration of both sensory and hormonal information with appropriate behavioral responses. The POM is well positioned neuroanatomically to interact with multiple regions involved in song, social behavior, and motivation. However, little is known about the brain regions with which the POM directly or indirectly communicates to influence song. To gain insight into the neuronal circuits normally activated in association with POM activity during male song, we compared activity within multiple brain regions using immunolabeling for protein products of immediate early genes (IEGs) zenk (aka egr-1) and c-fos (indirect markers of neuronal activity) in sham and POM-lesioned male European starlings (Sturnus vulgaris). As compared to sham lesions, POM lesions disrupted song and interest in a nest box, and females responded less to POM-lesioned males. POM lesions reduced numbers of IEG-labeled cells and disrupted correlations between numbers of IEG-labeled cells and song within several song control, limbic, hypothalamic and midbrain regions. These results are consistent with the possibility that the POM integrates activity among nuclei involved in song control, social behavior and motivational state that work in concert to promote sexually motivated communication.

D1-like dopamine receptor density in nuclei involved in social behavior correlates with song in a context-dependent fashion in male European starlings

Research in songbirds shows that singing behavior is regulated by both brain areas involved in vocal behavior as well as those involved in social behavior. Interestingly, the precise role of these regions in song can vary as a function of the social, environmental and breeding context. To date, little is known about the neurotransmitters underlying such context-dependent regulation of song. Dopamine (DA) modulates highly motivated, goal-directed behaviors (including sexually motivated song) and emerging data implicate DA in the context-dependent regulation of singing behavior. This study was performed to begin to examine whether differences in DA receptors may underlie, in part, context-dependent differences in song production. We used autoradiographic procedures to label D1-like and D2-like DA receptors to examine the relationship between DA receptor density and singing behavior in multiple contexts in male European starlings (Sturnus vulgaris). Within a breeding context (when testosterone (T) was high), D1-like receptor density in the medial preoptic nucleus (POM) and midbrain central gray (GCt) negatively correlated with song used to attract a female. Additionally in this context, D1-like receptor density in POM, GCt, medial bed nucleus of the stria terminalis (BSTm), and lateral septum (LS) negatively correlated with song likely used to defend a nest box. In contrast, in a non-breeding context (when T was low), D1-like receptor density in POM and LS positively correlated with song used to maintain social flocks. No relationships were identified between song in any context and D2-like receptor densities. Differences in the brain regions and directional relationships between D1-like receptor binding and song suggest that dopaminergic systems play a region and context-specific role in song. These data also suggest that individual variation in singing behavior may, in part, be explained by individual differences in D1-like receptor density in brain regions implicated in social behavior.

Evidence that dopamine within motivation and song control brain regions regulates birdsong context-dependently

Vocal communication is critical for successful social interactions among conspecifics, but little is known about how the brain regulates context-appropriate communication. The neurotransmitter dopamine (DA) is involved in modulating highly motivated, goal-directed behaviors (including sexually motivated singing behavior), and emerging data suggest that the role of DA in vocal communication may differ depending on the context in which it occurs. To address this possibility, relationships between immunolabeled tyrosine hydroxylase (TH, the rate-limiting enzyme in catecholamine synthesis) and song produced within versus outside of a breeding context were explored in male European starlings (Sturnus vulgaris). Immunocytochemistry for dopamine beta-hydroxylase (DBH; the enzyme that converts DA to norepinephrine) was also performed to provide insight into whether relationships between song and TH immunoreactivity reflected dopaminergic or noradrenergic neurotransmission. Measures of TH and DBH were quantified in song control regions (HVC, Area X, robust nucleus of the acropallium) and regions implicated in motivation (medial preoptic nucleus (POM), ventral tegmental area (VTA), and midbrain central gray). In Area X, POM, and VTA measures of TH correlated with song produced within, but not outside of a breeding context. DBH in these regions did not correlate with song in either context. Together, these data suggest DA in both song control and motivation brain regions may be more tightly linked to the regulation of highly goal-directed, sexually motivated vocal behavior.

Lesions to the medial preoptic nucleus differentially affect singing and nest box-directed behaviors within and outside of the breeding season in European starlings (Sturnus vulgaris)

Little is known about how the brain regulates context-appropriate communication. European starlings produce song in various social contexts. During the breeding season, males with nest sites sing high levels of sexually motivated song in response to a female. Outside of this context, song rates are not affected by female presence. The medial preoptic nucleus (POM) regulates male sexual behavior, and studies in songbirds implicate the POM in sexually motivated song. Recent data suggest that the role of the POM might extend to song produced in other contexts as well. To examine this possibility, effects of bilateral electrolytic lesions of the POM on singing and other behaviors in adult male starlings within sexually relevant and nonsexual contexts were studied. Lesions to the POM exclusively reduced song and nest box-directed behaviors within highly sexually relevant contexts. Unexpectedly, POM lesions increased song in a nonsexual context, suggesting an inhibitory role for the POM in this context. These data suggest that the POM interacts with the song control system so that song occurs in an appropriate social context in response to appropriate stimuli.

Endogenous opiates and behavior: 2005

This paper is the 28th consecutive installment of the annual review of research concerning the endogenous opioid system, now spanning over a quarter-century of research. It summarizes papers published during 2005 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides, opioid receptors, opioid agonists and opioid antagonists. The particular topics that continue to be covered include the molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors related to behavior (Section 2), and the roles of these opioid peptides and receptors in pain and analgesia (Section 3); stress and social status (Section 4); tolerance and dependence (Section 5); learning and memory (Section 6); eating and drinking (Section 7); alcohol and drugs of abuse (Section 8); sexual activity and hormones, pregnancy, development and endocrinology (Section 9); mental illness and mood (Section 10); seizures and neurologic disorders (Section 11); electrical-related activity, neurophysiology and transmitter release (Section 12); general activity and locomotion (Section 13); gastrointestinal, renal and hepatic functions (Section 14); cardiovascular responses (Section 15); respiration and thermoregulation (Section 16); immunological responses (Section 17).

The distribution of substance P and met-enkephalin in vocal control nuclei among oscine species and its relation to song complexity

Substance P (SP) and methionine-enkephalin (ENK) have been reported to appear in song control nuclei of oscine species. However, it remains unknown whether or not SP and ENK location in song control nuclei is correlated with song behavior. To address this issue, the present study first measured two variables for song complexity, i.e., song repertoire sizes, and syllable repertoire sizes in 11 oscine species. Then, we examined the distribution of SP and ENK in four control nuclei, two in the motor pathway, i.e., HVC and the robust nucleus of arcopallium (RA), and the other two in the forebrain pathway, i.e., Area X and the lateral magnocellular nucleus of the anterior nidopallium (LMAN). Finally, we measured the relative amounts of immunoreactivity for SP and ENK in song control nuclei, and tested whether they were correlated with song complexity. Our results showed that: (1) SP and ENK were broadly distributed in the song control nuclei of studied species. However, SP immunohistochemistry was more robust in comparison with ENK, and SP is generally more abundant in the two song learning nuclei than those in the two song producing ones; (2) SP and ENK staining patterns in song control nuclei did not show any obvious phylogenetic relationship among studied oscine species; (3) there was a significant correlation between the relative amounts of immunoreactivity for SP and the song and syllable repertoire sizes. Our results suggest that SP or ENK might be involved in song behavior, such as birdsong learning or memory.

Immediate early gene activity in song control nuclei and brain areas regulating motivation relates positively to singing behavior during, but not outside of, a breeding context

In some species, such as songbirds, much is known about how the brain regulates vocal learning, production, and perception. What remains a mystery is what regulates the motivation to communicate. European starlings (Sturnus vulgaris) sing throughout most of the year, but the social and environmental factors that motivate singing behavior differ seasonally. Male song is highly sexually motivated during, but not outside of, the breeding season. Brain areas outside the song control system, such as the medial preoptic nucleus (POM) and ventral tegmental area (VTA), have been implicated in regulating sexually motivated behaviors in birds, including song. The present study was designed to explore whether these regions, as well as three song control nuclei [area X, the high vocal center (HVC), and the robust nucleus of the arcopallium (RA)], might be involved differentially in song produced within compared to outside of a breeding context. We recorded the behavioral responses of breeding and nonbreeding condition male starlings to the introduction of a female conspecific. Males did not show context-dependent differences in the overall amount of song sung. However, immunocytochemistry for the protein product of the immediate early gene cFOS revealed a positive linear relationship between the total amount of songs sung and number of cFOS-labeled cells in POM, VTA, HVC, and RA for birds singing during, but not outside of, a breeding context. These results suggest that these regions differentially regulate male song production depending on reproductive context. Overall the data support the hypothesis that the POM and VTA interact with the song control system, specifically HVC and RA, to regulate sexually motivated vocal communication in songbirds.

In vivo MR imaging of the seasonal volumetric and functional plasticity of song control nuclei in relation to song output in a female songbird

In temperate zone songbird species, seasonal plasticity in the morphological and functional state of brain regions involved in song production occurs in association with seasonal changes in song output. Following MnCl(2)-injections in HVC (used as proper name) of female starlings, in vivo tract-tracing by Manganese Enhanced-Magnetic Resonance Imaging (ME-MRI) provided repeated measures of the volume of two HVC targets, the nucleus robustus arcopallii (RA) and area X, along with measures of the activity of the caudal motor pathway and rostral basal-ganglia pathway that control singing. Mn(2+)-labeling (volume labeled and signal intensity) of both nuclei was dramatically reduced in July (post-breeding season) when birds did not sing, compared to March (breeding season) when birds produced song. Seasonal changes in telencephalon volume did not exceed 4% and were not significant but were surprisingly correlated with individual measures of song rate and song bout length. Although individual song rates were variable in March, all MnCl(2)-injections led to a reliable labeling of area X and RA. In July, delineation of area X was only possible in two birds and RA could be delineated in 50% of the population; its volume had decreased by 46% as compared to March. The birds in which RA could be delineated in July had in March a higher activity of the HVC to area X projection as reflected by the total amount of Mn(2+) accumulated in area X, which suggests unexpected relationships between the two types of HVC projection neurons.