Ten unanswered questions in multimodal communication

Smell throughout the life course

The sense of smell is an important mediator of health and sociality at all stages of life, yet it has received limited attention in our lineage. Olfaction starts in utero and participates in the establishment of social bonds in children, and of romantic and sexual relationships after puberty. Smell further plays a key role in food assessment and danger avoidance; in modern societies, it also guides our consumer behavior. Sensory abilities typically decrease with age and can be impacted by diseases, with repercussions on health and well-being. Here, we critically review our current understanding of human olfactory communication to refute outdated notions that our sense of smell is of low importance. We provide a summary of the biology of olfaction, give a prospective overview of the importance of the sense of smell throughout the life course, and conclude with an outline of the limitations and future directions in this field.

Macaque claustrum, pulvinar and putative dorsolateral amygdala support the cross-modal association of social audio-visual stimuli based on meaning

Social communication draws on several cognitive functions such as perception, emotion recognition and attention. The association of audio-visual information is essential to the processing of species-specific communication signals. In this study, we use functional magnetic resonance imaging in order to identify the subcortical areas involved in the cross-modal association of visual and auditory information based on their common social meaning. We identified three subcortical regions involved in audio-visual processing of species-specific communicative signals: the dorsolateral amygdala, the claustrum and the pulvinar. These regions responded to visual, auditory congruent and audio-visual stimulations. However, none of them was significantly activated when the auditory stimuli were semantically incongruent with the visual context, thus showing an influence of visual context on auditory processing. For example, positive vocalization (coos) activated the three subcortical regions when presented in the context of positive facial expression (lipsmacks) but not when presented in the context of negative facial expression (aggressive faces). In addition, the medial pulvinar and the amygdala presented multisensory integration such that audiovisual stimuli resulted in activations that were significantly higher than those observed for the highest unimodal response. Last, the pulvinar responded in a task-dependent manner, along a specific spatial sensory gradient. We propose that the dorsolateral amygdala, the claustrum and the pulvinar belong to a multisensory network that modulates the perception of visual socioemotional information and vocalizations as a function of the relevance of the stimuli in the social context. SIGNIFICANCE STATEMENT: Understanding and correctly associating socioemotional information across sensory modalities, such that happy faces predict laughter and escape scenes predict screams, is essential when living in complex social groups. With the use of functional magnetic imaging in the awake macaque, we identify three subcortical structures-dorsolateral amygdala, claustrum and pulvinar-that only respond to auditory information that matches the ongoing visual socioemotional context, such as hearing positively valenced coo calls and seeing positively valenced mutual grooming monkeys. We additionally describe task-dependent activations in the pulvinar, organizing along a specific spatial sensory gradient, supporting its role as a network regulator.

Chemical signaling glands are unlinked to species diversification in lizards

Sexual selection has long been thought to increase species diversification. Sexually selected traits, such as sexual signals that contribute to reproductive isolation, were thought to promote diversification. However, studies exploring links between sexually selected traits and species diversification have thus far primarily focused on visual or acoustic signals. Many animals often employ chemical signals (i.e., pheromones) for sexual communications, but large-scale analyses on the role of chemical communications in driving species diversification have been missing. Here, for the first time, we investigate whether traits associated with chemical communications-the presence of follicular epidermal glands-promote diversification across 6,672 lizard species. In most analyses, we found no strong association between the presence of follicular epidermal glands and species diversification rates, either across all lizard species or at lower phylogenetic scales. Previous studies suggest that follicular gland secretions act as species recognition signals that prevent hybridization during speciation in lizards. However, we show that geographic range overlap was no different in sibling species pairs with and without follicular epidermal glands. Together, these results imply that either follicular epidermal glands do not primarily function in sexual communications or sexually selected traits in general (here chemical communication) have a limited effect on species diversification. In our additional analysis accounting for sex-specific differences in glands, we again found no detectable effect of follicular epidermal glands on species diversification rates. Thus, our study challenges the general role of sexually selected traits in broad-scale species diversification patterns.

Alteration of the temporal association between courtship audio and visual components affects female sexual response

Some multimodal signals-that is, occurring in more than one sensory modality-appear to carry additional information which is not present when component signals are presented separately. To understand the function of male ring dove's (Streptopelia risoria) multimodal courtship, we used audiovisual playback of male displays to investigate female response to stimuli differing in their audiovisual timing. From natural courtship recordings, we created a shifted stimulus where audio was shifted relative to video by a fixed value and a jittered stimulus, where each call was moved randomly along the visual channel. We presented 3 groups of females with the same stimulus type, that is, control, shifted, and jittered, for 7 days. We recorded their behavior and assessed pre- and post-test blood estradiol concentration. We found that playback exposure increased estradiol levels, confirming that this technique can be efficiently used to study doves' sexual communication. Additionally, chasing behavior (indicating sexual stimulation) increased over experimental days only in the control condition, suggesting a role of multimodal timing on female response. This stresses the importance of signal configuration in multimodal communication, as additional information is likely to be contained in the temporal association between modalities.

Production of multimodal signals to assert social dominance in white-lipped peccary (Tayassu pecari)

In this study we aimed to examine whether the 'redundancy' (a backup function to ensure the signal transmission) or 'multiple messages' (sensory communication system in combination) hypothesis would explain the function of multimodal communication of white-lipped peccaries (Tayassu pecari-WLPs). We also aimed to assess the individual factors (the social rank and sex of the sender) influencing the production of, and responses to unimodal and multimodal signals. We determined the social rank of 21 WLPs living in two captive groups and quantified the production of unimodal and multimodal signals when displaying threatening and submissive behaviors. WLPs most often produce multimodal signals independent of a previous unimodal signal failure, which suggests that they were adding more information, such as the sender's size, rather than merely increasing efficacy by engaging a different receiver's sensory channel. There was no effect of the sender's sex in the production of, and responses to, multimodal signals. However, the higher the sender's social rank, the greater the production of multimodal signals when WLPs were displaying threatening behaviors; whereas the lower the sender's social rank, the greater the production of multimodal signals when displaying submission behaviors. Multimodal signals elicited more non-aggressive responses than did the unimodal signals when displaying a threat. Moreover, the higher the sender's social rank, the greater the occurrence of non-aggressive responses to multimodal signals when displaying a threat; whereas the opposite occurred when displaying submission. Our findings support the 'multiple messages' hypothesis to explain the function of multimodal signaling during agonistic interactions in WLPs. Additionally, both the production of, and responses to, multimodal signals are related to the sender's social rank. These results allow us to suggest that the production of multimodal signals may have a key role in mitigating conflict and thus promoting group cohesion among white-lipped peccaries.

Tactics of evasion: strategies used by signallers to deter eavesdropping enemies from exploiting communication systems

Eavesdropping predators, parasites and parasitoids exploit signals emitted by their prey and hosts for detection, assessment, localization and attack, and in the process impose strong selective pressures on the communication systems of the organisms they exploit. Signallers have evolved numerous anti-eavesdropper strategies to mitigate the trade-off between the costs imposed from signal exploitation and the need for conspecific communication. Eavesdropper strategies fall along a continuum from opportunistic to highly specialized, and the tightness of the eavesdropper-signaller relationship results in differential pressures on communication systems. A wide variety of anti-eavesdropper strategies mitigate the trade-off between eavesdropper exploitation and conspecific communication. Antagonistic selection from eavesdroppers can result in diverse outcomes including modulation of signalling displays, signal structure, and evolutionary loss or gain of a signal from a population. These strategies often result in reduced signal conspicuousness and in decreased signal ornamentation. Eavesdropping enemies, however, can also promote signal ornamentation. While less common, this alternative outcome offers a unique opportunity to dissect the factors that may lead to different evolutionary pathways. In addition, contrary to traditional assumptions, no sensory modality is completely 'safe' as eavesdroppers are ubiquitous and have a broad array of sensory filters that allow opportunity for signal exploitation. We discuss how anthropogenic change affects interactions between eavesdropping enemies and their victims as it rapidly modifies signalling environments and community composition. Drawing on diverse research from a range of taxa and sensory modalities, we synthesize current knowledge on anti-eavesdropper strategies, discuss challenges in this field and highlight fruitful new directions for future research. Ultimately, this review offers a conceptual framework to understand the diverse strategies used by signallers to communicate under the pressure imposed by their eavesdropping enemies.

Behind the mask(ing): how frogs cope with noise

Albert Feng was a pioneer in the field of auditory neuroethology who used frogs to investigate the neural basis of spectral and temporal processing and directional hearing. Among his many contributions was connecting neural mechanisms for sound pattern recognition and localization to the problems of auditory masking that frogs encounter when communicating in noisy, real-world environments. Feng's neurophysiological studies of auditory processing foreshadowed and inspired subsequent behavioral investigations of auditory masking in frogs. For frogs, vocal communication frequently occurs in breeding choruses, where males form dense aggregations and produce loud species-specific advertisement calls to attract potential mates and repel competitive rivals. In this review, we aim to highlight how Feng's research advanced our understanding of how frogs cope with noise. We structure our narrative around three themes woven throughout Feng's research-spectral, temporal, and directional processing-to illustrate how frogs can mitigate problems of auditory masking by exploiting frequency separation between signals and noise, temporal fluctuations in noise amplitude, and spatial separation between signals and noise. We conclude by proposing future research that would build on Feng's considerable legacy to advance our understanding of hearing and sound communication in frogs and other vertebrates.

Long-distance vocalizations of spotted hyenas contain individual, but not group, signatures

In animal societies, identity signals are common, mediate interactions within groups, and allow individuals to discriminate group-mates from out-group competitors. However, individual recognition becomes increasingly challenging as group size increases and as signals must be transmitted over greater distances. Group vocal signatures may evolve when successful in-group/out-group distinctions are at the crux of fitness-relevant decisions, but group signatures alone are insufficient when differentiated within-group relationships are important for decision-making. Spotted hyenas are social carnivores that live in stable clans of less than 125 individuals composed of multiple unrelated matrilines. Clan members cooperate to defend resources and communal territories from neighbouring clans and other mega carnivores; this collective defence is mediated by long-range (up to 5 km range) recruitment vocalizations, called whoops. Here, we use machine learning to determine that spotted hyena whoops contain individual but not group signatures, and that fundamental frequency features which propagate well are critical for individual discrimination. For effective clan-level cooperation, hyenas face the cognitive challenge of remembering and recognizing individual voices at long range. We show that serial redundancy in whoop bouts increases individual classification accuracy and thus extended call bouts used by hyenas probably evolved to overcome the challenges of communicating individual identity at long distance.

Can you hear/see me? Multisensory integration of signals does not always facilitate mate choice

Females of many species choose mates using multiple sensory modalities. Multimodal noise may arise, however, in dense aggregations of animals communicating via multiple sensory modalities. Some evidence suggests multimodal signals may not always improve receiver decision-making performance. When sensory systems process input from multimodal signal sources, multimodal noise may arise and potentially complicate decision-making due to the demands on cognitive integration tasks. We tested female túngara frog, Physalaemus (=Engystomops) pustulosus, responses to male mating signals in noise from multiple sensory modalities (acoustic and visual). Noise treatments were partitioned into three categories: acoustic, visual, and multimodal. We used natural calls from conspecifics and heterospecifics for acoustic noise. Robotic frogs were employed as either visual signal components (synchronous vocal sac inflation with call) or visual noise (asynchronous vocal sac inflation with call). Females expressed a preference for the typically more attractive call in the presence of unimodal noise. However, during multimodal signal and noise treatments (robofrogs employed with background noise), females failed to express a preference for the typically attractive call in the presence of conspecific chorus noise. We found that social context and temporal synchrony of multimodal signaling components are important for multimodal communication. Our results demonstrate that multimodal signals have the potential to increase the complexity of the sensory scene and reduce the efficacy of female decision making.

A review of the cues used for rejecting foreign eggs from the nest by the Eurasian blackbird ( Turdus merula )

Avian brood parasitism is reproductively costly for hosts and selects for cognitive features enabling anti‐parasitic resistance at multiple stages of the host's breeding cycle. The true thrushes (genus Turdus) represent a nearly worldwide clade of potential hosts of brood parasitism by Cuculus cuckoos in Eurasia and Africa and Molothrus cowbirds in the Americas. The Eurasian blackbird (Turdus merula) builds an open‐cup nest and is common within much of the common cuckoo's (C. canorus) breeding range. While this thrush is known to be parasitized at most only at low rates by this cuckoo, the species is also a strong rejector of nonmimetic foreign eggs in the nest. Given their open‐cup nesting habits, we predict that Eurasian blackbirds primarily use visual cues in making a distinction between own and parasitically or experimentally inserted foreign eggs in the nest. We then provide a comprehensive and quantitative review of the literature on blackbird egg rejection studies. This review corroborates that vision is the primary sensory modality used by blackbirds in assessing eggs, but also brings attention to some other, less commonly studied cues which appear to influence rejection, including predator exposure, individual experience, stage of clutch completion, and maternal hormonal state. Blackbirds are also able to recognize and eject even highly mimetic eggs (including those of conspecifics) at a moderate rate, apparently relying on many of the same sensory cues. Although the cues involved in foreign egg recognition by Eurasian blackbirds do not appear specialized to nonmimetic cuckoo parasitism, we cannot differentiate between the possibility of egg rejection being selected by mostly conspecific parasitism or by the evolutionary ghost of a now‐extinct, mimetic cuckoo host‐race.

How urbanization affects sexual communication

Urbanization is rapidly altering landscapes worldwide, changing environmental conditions, and creating novel selection pressures for many organisms. Local environmental conditions affect the expression and evolution of sexual signals and mating behaviors; changes in such traits have important evolutionary consequences because of their effect on reproduction. In this review, we synthesize research investigating how sexual communication is affected by the environmental changes associated with urbanization-including pollution from noise, light, and heavy metals, habitat fragmentation, impervious surfaces, urban heat islands, and changes in resources and predation. Urbanization often has negative effects on sexual communication through signal masking, altering condition-dependent signal expression, and weakening female preferences. Though there are documented instances of seemingly adaptive shifts in trait expression, the ultimate impact on fitness is rarely tested. The field of urban evolution is still relatively young, and most work has tested whether differences occur in response to various aspects of urbanization. There is limited information available about whether these responses represent phenotypic plasticity or genetic changes, and the extent to which observed shifts in sexual communication affect reproductive fitness. Our understanding of how sexual selection operates in novel, urbanized environments would be bolstered by more studies that perform common garden studies and reciprocal transplants, and that simultaneously evaluate multiple environmental factors to tease out causal drivers of observed phenotypic shifts. Urbanization provides a unique testing ground for evolutionary biologists to study the interplay between ecology and sexual selection, and we suggest that more researchers take advantage of these natural experiments. Furthermore, understanding how sexual communication and mating systems differ between cities and rural areas can offer insights on how to mitigate negative, and accentuate positive, consequences of urban expansion on the biota, and provide new opportunities to underscore the relevance of evolutionary biology in the Anthropocene.

Multiple Sensory Modalities in Diurnal Geckos Is Associated with the Signaling Environment and Evolutionary Constraints

To be effective, animal signals need to be detectable in the environment, but their development and expression require resources. For multimodal communication, investment in elaborating traits in one modality could reduce the elaboration of traits in other modalities. In Cnemaspis geckos, chemical signals for conspecific communication pre-dated the evolution of visual signals, allowing us to examine the potential trade-off in signal elaboration and the current habitat associations with signal use. We studied five species of Cnemaspis and quantified visual (patch size, color characteristics) and chemical (secretory composition) traits in males, as well as key environmental parameters (temperature, humidity, light) in each of their habitats. Within species, we found some trade-off in the elaboration of signals, as the strength of several components in the visual and chemical modalities were negatively associated. Strength of some signal components in each modality was also independently associated with specific environmental parameters that affect their detection (visual traits) and persistence (chemical traits). Specifically, species with larger, brighter, and more saturated color patches were found in habitats where the brightness and chroma of light were lower. Furthermore, environments with higher substrate temperature and higher relative humidity harbored species that produced secretions with a higher percentage of saturated and aromatic compounds. Thus, the elaboration of multimodal signals in this group of Cnemaspis geckos seems to increase the efficiency of communication in the signaling-environment, but the strength of signals in different modalities is constrained by trade-offs in signal expression.

Multisensory modalities increase working memory for mating signals in a treefrog

Animal choruses, such as those found in insects and frogs, are often intermittent. Thus, females sampling males in the chorus might have to remember the location of the potential mates' calls during periods of silence. Although a number of studies have shown that frogs use and prefer multimodal mating signals, usually acoustic plus visual, it is not clear why they do so. Here we tested the hypothesis that preference for multimodal signals over unimodal signals might be due to multimodal signals instantiating longer memories than unimodal signals, particularly during the inter-chorus intervals. We tested this hypothesis in serrate-legged small treefrogs Kurixalus odontotarsus whose males produce advertisement calls accompanied by conspicuous vocal sac inflation. Females were tested with acoustic and acoustic + visual (video of inflating-deflating vocal sac) mating calls. We found that females prefer multimodal calls over unimodal, audio-only calls. Furthermore, multimodal calls are still preferred after a silent period of up to 30 s, a time that spans the average silent period of the chorus. This was not true of unimodal calls. Our results demonstrate that a multimodal signal can engage longer working memory than a unimodal signal, and thus female memory might favour the evolution of multimodal signals in males through sexual selection. Selection might also favour female preference for multimodal signals if longer memory facilitates mate searching and assessment. Our study does not allow us to elucidate the sequence of evolution of this trait and preference.

Talking to Cows: Reactions to Different Auditory Stimuli During Gentle Human-Animal Interactions

The quality of the animal-human relationship and, consequently, the welfare of animals can be improved by gentle interactions such as stroking and talking. The perception of different stimuli during these interactions likely plays a key role in their emotional experience, but studies are scarce. During experiments, the standardization of verbal stimuli could be increased by using a recording. However, the use of a playback might influence the perception differently than "live" talking, which is closer to on-farm practice. Thus, we compared heifers' (n = 28) reactions to stroking while an experimenter was talking soothingly ("live") or while a recording of the experimenter talking soothingly was played ("playback"). Each animal was tested three times per condition and each trial comprised three phases: pre-stimulus, stimulus (stroking and talking) and post-stimulus. In both conditions, similar phrases with positive content were spoken calmly, using long low-pitched vowels. All tests were video recorded and analyzed for behaviors associated with different affective states. Effects on the heifers' cardiac parameters were assessed using analysis of heart rate variability. Independently of the auditory stimuli, longer durations of neck stretching occurred during stroking, supporting our hypothesis of a positive perception of stroking. Observation of ear positions revealed longer durations of the "back up" position and less ear flicking and changes of ear positions during stroking. The predicted decrease in HR during stroking was not confirmed; instead we found a slightly increased mean HR during stroking with a subsequent decrease in HR, which was stronger after stroking with live talking. In combination with differences in HRV parameters, our findings suggest that live talking might have been more pleasurable to the animals and had a stronger relaxing effect than "playback." The results regarding the effects of the degree of standardization of the stimulus on the variability of the data were inconclusive. We thus conclude that the use of recorded auditory stimuli to promote positive affective states during human-animal interactions in experimental settings is possible, but not necessarily preferable.

Male mice adjust courtship behavior in response to female multimodal signals

Multimodal signaling is nearly ubiquitous across animal taxa. While much research has focused on male signal production contributing to female mate-choice or preferences, females often give their own multimodal signals during intersexual communication events. Multimodal signal components are often classified based on whether they contain redundant information (e.g., the backup hypothesis) or non-redundant information (e.g., the multiple messages hypothesis) from the perspective of the receiver. We investigated the role of two different female vocalizations produced by the female house mouse (Mus musculus): the broadband, relatively low-frequency squeaks (broadband vocalizations or BBVs,), and the higher-frequency ultrasonic vocalizations (USVs). These female vocalizations may convey differently valenced information to the male receivers. We paired these vocalizations with and without female urine to examine the influence of combining information across multiple modalities. We found evidence that female urine and vocalizations act as non-redundant multimodal cues as males responded with different behaviors and vocalization rates depending on the female signal presented. Additionally, male mice responded with greater courtship effort to the multimodal combination of female USVs paired with female urine than any other signal combination. These results suggest that the olfactory information contained in female urine provides the context by which males can then evaluate potentially ambiguous female vocalizations.

Multimodal pair-bond maintenance: A review of signaling across modalities in pair-bonded nonhuman primates

Only a handful of primate species exhibit the social relationship of pair-bonding. Efficient communication is critical for behavioral coordination within pair-bonds to maintain proximity and respond appropriately to extra-pair individuals, and possibly coordinate infant care. The use of complex signaling across modalities may help individuals improve communicative outcomes. We review many ways that pair-bonded species use signals to communicate and maintain bonds, though little previous research has taken a truly multimodal approach within a single species. We make a call for further investigation into pair-bonded communication using a multimodal approach to better understand how these species use all their senses to build, maintain, and advertise their bonds.

Optimal multisensory integration

Animals are often confronted with potentially informative stimuli from a variety of sensory modalities. Although there is a large proximate literature demonstrating multisensory integration, no general framework explains why animals integrate. We developed and tested a quantitative model that explains why multisensory integration is not always adaptive and explains why unimodal decision-making might be favored over multisensory integration. We present our model in terms of a prey that must determine the presence or absence of a predator. A greater chance of encountering a predator, a greater benefit of correctly responding to a predator, a lower benefit of correctly foraging, or a greater uncertainty of the second stimulus favors integration. Uncertainty of the first stimulus may either increase or decrease the favorability of integration. In three field studies, we demonstrate how our model can be empirically tested. We evaluated the model with field studies of yellow-bellied marmots (Marmota flaviventer) by presenting marmots with an olfactory-acoustic predator stimulus at a feed station. We found some support for the model's prediction that integration is favored when the second stimulus is less noisy. We hope additional predictions of the model will guide future empirical work that seeks to understand the extent to which multimodal integration might be situation dependent. We suggest that the model is generalizable beyond antipredator contexts and can be applied within or between individuals, populations, or species.

Multisensory integration is often studied from a very proximate view that simply describes the process of integration. We developed a model, the first of its kind, to investigate the situations under which multisensory integration is adaptive. We empirically evaluated the model by investigating the conditions under which yellow-bellied marmots integrated predatory scents and sounds. We found that integration can depend on an animal's situation at a given point in time.

Evolution and function of multimodal courtship displays

Courtship displays are behaviours aimed to facilitate attraction and mating with the opposite sex and are very common across the animal kingdom. Most courtship displays are multimodal, meaning that they are composed of concomitant signals occurring in different sensory modalities. Although courtship often strongly influences reproductive success, the question of why and how males use multimodal courtship to increase their fitness has not yet received much attention. Very little is known about the role of different components of male courtship and their relative importance for females. Indeed, most of the work on courtship displays have focused on effects on female choice, often neglecting other possible roles. Additionally, a number of scientists have recently stressed the importance of considering the complexity of a display and the interactions between its different components in order to grasp all the information contained in those multimodal signals. Unfortunately, these methods have not yet been extensively adapted in courtship studies. The aim of this study was to review what is currently known about the functional significance of courtship displays, particularly about the role of multimodality in the courtship communication context. Emphasis is placed on those cases where a complete picture of the communication system can only be assessed by taking complexity and interaction between different modalities into account.

Multimodal communication and language origins: integrating gestures and vocalizations

The presence of divergent and independent research traditions in the gestural and vocal domains of primate communication has resulted in major discrepancies in the definition and operationalization of cognitive concepts. However, in recent years, accumulating evidence from behavioural and neurobiological research has shown that both human and non-human primate communication is inherently multimodal. It is therefore timely to integrate the study of gestural and vocal communication. Herein, we review evidence demonstrating that there is no clear difference between primate gestures and vocalizations in the extent to which they show evidence for the presence of key language properties: intentionality, reference, iconicity and turn-taking. We also find high overlap in the neurobiological mechanisms producing primate gestures and vocalizations, as well as in ontogenetic flexibility. These findings confirm that human language had multimodal origins. Nonetheless, we note that in great apes, gestures seem to fulfil a carrying (i.e. predominantly informative) role in close-range communication, whereas the opposite holds for face-to-face interactions of humans. This suggests an evolutionary shift in the carrying role from the gestural to the vocal stream, and we explore this transition in the carrying modality. Finally, we suggest that future studies should focus on the links between complex communication, sociality and cooperative tendency to strengthen the study of language origins.

Cross-modal transfer in visual and nonvisual cues in bumblebees

Bumblebees Bombus terrestris are good at learning to distinguish between patterned flowers. They can differentiate between flowers that differ only in their patterning of scent, surface texture, temperature, or electrostatic charge, in addition to visual patterns. As recently shown, bumblebees trained to discriminate between nonvisual scent patterns can transfer this learning to visually patterned flowers that show similar spatial patterning to the learnt scent patterns. Bumblebees can, therefore, transfer learnt patterns between different sensory modalities, without needing to relearn them. We used differential conditioning techniques to explore whether cross-modal transfer of learnt patterns also occurred between visual and temperature patterns. Bumblebees that successfully learnt to distinguish rewarding and unrewarding temperature patterns did not show any preferences for the corresponding unlearnt visual pattern. Similarly, bumblebees that learnt visual patterns did not transfer these to temperature patterns, suggesting that they are unable to transfer learning of temperature and visual patterns. We discuss how cross-modality pattern learning may be limited to modalities that have potentially strong neurological links, such as the previously demonstrated transfer between scent and visual patterns.

Mate choice in a changing world

Human activities by altering environmental conditions are influencing the mate choice of animals. This is by impacts on: (i) the production and expression of traits evaluated by mate choosers; (ii) the transmission of information about potential mates to choosers; (iii) the reception and processing of the information by choosers; and (iv) the final mate choice. Here, I first discuss how these four stages of the mate-choice process can be altered by environmental change, and how these alterations, in turn, can influence individuals, populations, and communities. Much evidence exists for human-induced environmental changes influencing mate choice, but the consequences for the fitness of courters and choosers are less well known, and even less is known about the impact on population dynamics, species interactions and community composition. More evidence exists for altered mate-choice systems influencing interspecific matings and thereby community composition and biodiversity. I then consider whether plastic adjustments and evolutionary changes can rescue adaptive mate-choice systems, and reflect on the possibility of non-adaptive mate-choice systems becoming less maladaptive under environmental change. Much evidence exists for plastic adjustments of mate-choice systems, but whether these are adaptive is seldom known, as is the contribution of genetic changes. Finally, I contemplate the possibility of mate-choice systems rescuing populations from decline in changing environments. I explain how this is context dependent with both positive and negative outcomes possible. In summary, while much evidence exists for human-induced environmental changes influencing mate-choice systems, less is known about the consequences for ecological and evolutionary processes. Considering the importance that mate choice plays in determining individual fitness and population viability, the effects of environmental change on mate-choice systems should be considered in studies on the ecological and evolutionary consequences of human disturbances to habitats.

The evolution of sexual signal modes and associated sensor morphology in fireflies (Lampyridae, Coleoptera)

Animals employ different sexual signal modes (e.g. visual, acoustic, chemical) in different environments and behavioural contexts. If sensory structures are costly, then evolutionary shifts in primary signal mode should be associated with changes in sensor morphology. Further, sex differences are expected if male and female signalling behaviours differ. Fireflies are known for their light displays, but many species communicate exclusively with pheromones, including species that recently lost their light signals. We performed phylogenetically controlled analyses of male eye and antenna size in 46 North American taxa, and found that light signals are associated with larger eyes and shorter antennae. In addition, following a transition from nocturnal light displays to diurnal pheromones, eye size reductions occur more rapidly than antenna size increases. In agreement with the North American taxa, across 101 worldwide firefly taxa in 32 genera, we found light displays are associated with larger eye and smaller antenna sizes in both males and females. For those taxa with both male and female data, we found sex differences in eye size and, for diurnal species, in antenna size.

Synchronization of speed, sound and iridescent color in a hummingbird aerial courtship dive

Many animal signals are complex, often combining multimodal components with dynamic motion. To understand the function and evolution of these displays, it is vital to appreciate their spatiotemporal organization. Male broad-tailed hummingbirds (Selasphorus platycercus) perform dramatic U-shaped courtship dives over females, appearing to combine rapid movement and dive-specific mechanical noises with visual signals from their iridescent gorgets. To understand how motion, sound and color interact in these spectacular displays, we obtained video and audio recordings of dives performed by wild hummingbirds. We then applied a multi-angle imaging technique to estimate how a female would perceive the male's iridescent gorget throughout the dive. We show that the key physical, acoustic and visual aspects of the dive are remarkably synchronized-all occurring within 300 milliseconds. Our results highlight the critical importance of accounting for motion and orientation when investigating animal displays: speed and trajectory affect how multisensory signals are produced and perceived.

Sexually-Relevant Visual and Chemosensory Signals Induce Distinct Behaviors and Neural Activation Patterns in the Social African Cichlid, Astatotilapia burtoni

Across vertebrates, the use of multimodal (multiple sensory modalities) signals has evolved to convey important information to receivers. Information content of multimodal signals can be the same as or different from information in each unimodal signal, and are classified as redundant or non-redundant, respectively, based on receivers' behavioral responses. Despite the prevalence and importance of multimodal signaling across taxa, relatively little is known about how and where these signals are processed in the brains of receivers. We used the social African cichlid fish, Astatotilapia burtoni, to investigate how sexually-relevant visual and chemosensory uni- and multimodal signals from gravid (full of eggs) females influence behavior, brain activation patterns, and physiology in dominant males. We presented both visual and chemosensory signals either alone or together and found that males need sexually-relevant visual signals to engage in stereotypical courtship behaviors such as body quivers, waggles, and leads into spawning territories. However, the number of courtship behaviors was greater when males were exposed to multimodal visual-chemosensory signals, compared to either unimodal signal alone. When a female visual signal was absent, males increased swimming and overall activity in response to female-conditioned water compared to control water, suggesting that female-released chemosensory signals may stimulate male searching behavior and motivation. Importantly, we also tested anosmic (olfactory ablated) males to demonstrate that this behavior is primarily mediated by the olfactory system rather than gustation. Using the immediate early gene cfos as a proxy for neural activation, we also demonstrate differential activation in social and olfactory-relevant brain regions of dominant males exposed to unimodal and multimodal visual-chemosensory signals. We found at least one region that is preferentially activated by reception of signals from each sense, as well as regions that exhibit an additive effect on activation with multimodal visual-chemosensory stimulation. These data provide insight on how multimodal signals are processed in the brain and integrated with internal physiology of receivers to produce social behaviors, and lay the groundwork for future studies on the evolution of sensory perception.

Do male sticklebacks use visual and/or olfactory cues to assess a potential mate's history with predation risk?

Differential allocation occurs when individuals alter their reproductive investment based on their mate's traits. A previous study showed that male threespine sticklebacks, Gasterosteus aculeatus, reduced courtship towards females that had previously been exposed to predation risk compared to unexposed females. This suggests that males can detect a female's previous history with predation risk, but the mechanisms by which males assess a female's history are unknown. To determine whether males use chemical and/or visual cues to detect a female's previous history with predation risk, we compared rates of courtship behaviour in the presence of visual and/or olfactory cues of predator-exposed females versus unexposed females in a 2×2 factorial design. We found that males differentiate between unexposed and predator-exposed females using visual cues: regardless of the olfactory cues present, males performed fewer zigzags (a conspicuous courtship behaviour) when they were exposed to visual cues from predator-exposed females compared to unexposed females. However, males' response to olfactory cues changed over the course of the experiment: initially, males performed fewer courtship displays when they received olfactory cues of predator-exposed females compared to unexposed females, but they did not discriminate between cues from predator-exposed and unexposed females later in the experiment. A follow-up experiment found that levels of cortisol released by both predator-exposed and unexposed females decreased over the course of the experiment. If cortisol is linked to or correlated with olfactory cues of predation risk that are released by females, then this suggests that the olfactory cues became less potent over the course of the experiment. Altogether, these results suggest that males use both visual and olfactory cues to differentiate between unexposed and predator-exposed females, which may help ensure reliable communication in a noisy environment.

The ontogeny of intentional communication in chimpanzees in the wild

The onset of intentional communication in children's first year of life represents a major milestone in human cognitive development. Similarly, it is well established that our closest living relatives, the great apes, communicate with signals characterized by at least first-order intentionality. Despite the well-documented influence of developmental experiences on socio-cognitive abilities in apes, the developmental trajectory of intentional signal use as well as effects of social exposure remain poorly understood under naturalistic conditions. Here, we addressed these issues by studying the ontogeny of intentional communication in chimpanzee infants of two subspecies (Pan troglodytes schweinfurthii/verus) and communities living in their natural environments. Overall, we found that gestures and bimodal signal combinations were most commonly accompanied by markers of intentional communication: audience checking, persistence to the goal, and sensitivity to recipient's attentional state. Within individuals, the proportion of communicative behaviours associated with goal persistence and sensitivity to attention increased with age. Cross-sectional comparisons between infants revealed an age effect on the use of audience checking. Context, interaction partner and site affiliation affected the production of specific markers irrespective of infants' age. The present study provided hitherto undocumented evidence for the development of three important markers of intentional communication in great apes. Moreover, our results suggest that social exposure impacts early intentional signal use.

Vocal plasticity in a reptile

Sophisticated vocal communication systems of birds and mammals, including human speech, are characterized by a high degree of plasticity in which signals are individually adjusted in response to changes in the environment. Here, we present, to our knowledge, the first evidence for vocal plasticity in a reptile. Like birds and mammals, tokay geckos (Gekko gecko) increased the duration of brief call notes in the presence of broadcast noise compared to quiet conditions, a behaviour that facilitates signal detection by receivers. By contrast, they did not adjust the amplitudes of their call syllables in noise (the Lombard effect), which is in line with the hypothesis that the Lombard effect has evolved independently in birds and mammals. However, the geckos used a different strategy to increase signal-to-noise ratios: instead of increasing the amplitude of a given call type when exposed to noise, the subjects produced more high-amplitude syllable types from their repertoire. Our findings demonstrate that reptile vocalizations are much more flexible than previously thought, including elaborate vocal plasticity that is also important for the complex signalling systems of birds and mammals. We suggest that signal detection constraints are one of the major forces driving the evolution of animal communication systems across different taxa.