Multimodal signal variation in space and time: how important is matching a signal with its signaler?

The relationship between spectral signals and retinal sensitivity in dendrobatid frogs

Research on visually driven behavior in anurans has often focused on Dendrobatoidea, a clade with extensive variation in skin reflectance, which is perceived to range from cryptic to conspicuous coloration. Because these skin patterns are important in intraspecific and interspecific communication, we hypothesized that the visual spectral sensitivity of dendrobatids should vary with conspecific skin spectrum. We predicted that the physiological response of frog retinas would be tuned to portions of the visible light spectrum that match their body reflectance. Using wavelength-specific electroretinograms (ERGs; from 350-650 nm), spectrometer measurements, and color-calibrated photography of the skin, we compared retinal sensitivity and reflectance of two cryptic species (Allobates talamancae and Silverstoneia flotator), two intermediate species (Colostethus panamansis and Phyllobates lugubris), and two conspicuous aposematic species (Dendrobates tinctorius and Oophaga pumilio). Consistent with the matched filter hypothesis, the retinae of cryptic and intermediate species were sensitive across the spectrum, without evidence of spectral tuning to specific wavelengths, yielding low-threshold broadband sensitivity. In contrast, spectral tuning was found to be different between morphologically distinct populations of O. pumilio, where frogs exhibited retinal sensitivity better matching their morph's reflectance. This sensory specialization is particularly interesting given the rapid phenotypic divergence exhibited by this species and their behavioral preference for sympatric skin reflectances. Overall, this study suggests that retinal sensitivity is coevolving with reflective strategy and spectral reflectance in dendrobatids.

Sexy fingers: Pheromones in the glands of male dendrobatid frogs

Many animals exchange chemicals during courtship and mating. In some amphibians, sexual chemical communication is mediated by pheromones produced in male breeding glands that are transferred to the female's nostrils during mating. This has been mostly studied in salamanders, despite frogs having similar glands and courtship behaviours suggestive of chemical communication. In Neotropical poison frogs (Dendrobatidae and Aromobatidae), males of many species develop breeding glands in their fingers, causing certain fingers to visibly swell. Many also engage in cephalic amplexus, whereby the male's swollen fingers are placed in close contact with the female's nares during courtship. Here, we investigate the possible roles of swollen fingers in pheromone production using whole-transcriptome sequencing (RNAseq). We examined differential gene expression in the swollen versus non-swollen fingers and toes of two dendrobatid species, Leucostethus brachistriatus and Epipedobates anthonyi, both of which have specialised mucous glands in finger IV, the latter of which has cephalic amplexus. The overwhelming pattern of gene expression in both species was strong upregulation of sodefrin precursor-like factors (SPFs) in swollen fingers, a well-known pheromone system in salamanders. The differentially expressed SPF transcripts in each species were very high (>40), suggesting a high abundance of putative protein pheromones in both species. Overall, the high expression of SPFs in the swollen fingers in both species, combined with cephalic amplexus, supports the hypothesis that these traits, widespread across members of the subfamilies Colostethinae and Hyloxalinae (ca. 141 species), are involved in chemical signalling during courtship.

Concordance of movements and songs enhances receiver responses to multimodal display in the starling

Many animals produce signals that consist of vocalizations and movements to attract mates or deter rivals. We usually consider them as components of a single multimodal signal because they are temporally coordinated. Sometimes, however, this relationship takes on a more complex spatiotemporal character, resembling choreographed music. Timing is important for audio-visual integration, but choreographic concordance requires even more skill and competence from the signaller. Concordance should therefore have a strong impact on receivers; however, little is known about its role in audio-visual perception during natural interactions. We studied the effects of movement and song type concordance in audio-visual displays of the starling, Sturnus vulgaris. Starlings produce two types of movements that naturally appear in specific phrases of songs with a similar temporal structure and amplitude. In an experiment with a taxidermic robotic model, males responded more to concordant audio-visual displays, which are also naturally preferred, than to discordant displays. In contrast, the effect of concordance was independent of the specific combination of movement and song types in a display. Our results indicate that the concordance of movements and songs was critical to the efficacy of the display and suggest that the information that birds gained from concordance could not be obtained by adding information from movements and songs.

Comment on 'Parasite defensive limb movements enhance acoustic signal attraction in male little torrent frogs'

Zhao et al. recently reported results which, they claim, suggest that sexual selection produces the multimodal displays seen in little torrent frogs (Amolops torrentis) by co-opting limb movements that originally evolved to support parasite defense (Zhao et al., 2022). Here, we explain why we believe this conclusion to be premature.

Alteration of the temporal association between courtship audio and visual components affects female sexual response

Some multimodal signals-that is, occurring in more than one sensory modality-appear to carry additional information which is not present when component signals are presented separately. To understand the function of male ring dove's (Streptopelia risoria) multimodal courtship, we used audiovisual playback of male displays to investigate female response to stimuli differing in their audiovisual timing. From natural courtship recordings, we created a shifted stimulus where audio was shifted relative to video by a fixed value and a jittered stimulus, where each call was moved randomly along the visual channel. We presented 3 groups of females with the same stimulus type, that is, control, shifted, and jittered, for 7 days. We recorded their behavior and assessed pre- and post-test blood estradiol concentration. We found that playback exposure increased estradiol levels, confirming that this technique can be efficiently used to study doves' sexual communication. Additionally, chasing behavior (indicating sexual stimulation) increased over experimental days only in the control condition, suggesting a role of multimodal timing on female response. This stresses the importance of signal configuration in multimodal communication, as additional information is likely to be contained in the temporal association between modalities.

A review of the reproductive system in anuran amphibians

Reproductive biology is an important topic that is well explored in many vertebrates, but information about frogs' reproductive mechanisms could be improved. Therefore, this review aims to provide organized and specific information on frog reproduction. First, we developed schemes that illustrate the general information regarding reproductive biological mechanisms in frogs in a specific way. Then, we described the physiological, histological, and morphological mechanisms of each organ of the reproductive system of male and female frogs. Finally, this manuscript may contribute to a broader understanding of anuran reproductive biology. Since, understanding frogs' reproductive system permits one to make a comparison with reproduction with other anurans.

Noise affects mate choice based on visual information via cross-sensory interference

Animal communication is often hampered by noise interference. Noise masking has primarily been studied in terms of its unimodal effect on sound information provision and use, while little is known about its cross-modal effect and how animals weigh unimodal and multimodal courtship cues in noisy environments. Here, we examined the cross-modal effects of background noise on female visual perception of mate choice and female preference for multimodal displays (sound + vocal sac) in a species of treefrog. We tested female mate choices using audio/video playbacks in the presence and absence of noise (white noise band-filtered to match or mismatch female sensitive hearing range, heterospecific chorus). Surprisingly, multimodal displays do not improve receiver performance in noise. The heterospecific chorus and white noise band-filtered to match female sensitive hearing ranges, significantly reduced female responses to the attractive visual stimuli in addition to directly impairing auditory information use. Meanwhile, the cross-modal impacts of background noise are influenced to some extent by whether the noise band matches female sensitive hearing range and the difficulty of distinguishing tasks. Our results add to the evidence for cross-modal effects of noise and are the first to demonstrate that background noise can disrupt female responses to visual information related to mate choice, which may reduce the communication efficiency of audiovisual signals in noisy environments and impose fitness consequences. This study has key ecological and evolutionary implications because it illustrates how noise influences mate choice in wildlife via cross-sensory interference, which is crucial in revealing the function and evolution of multimodal signals in noisy environments as well as informing evidence-based conservation strategies for forecasting and mitigating the multimodal impacts of noise interference on wildlife.

Can you hear/see me? Multisensory integration of signals does not always facilitate mate choice

Females of many species choose mates using multiple sensory modalities. Multimodal noise may arise, however, in dense aggregations of animals communicating via multiple sensory modalities. Some evidence suggests multimodal signals may not always improve receiver decision-making performance. When sensory systems process input from multimodal signal sources, multimodal noise may arise and potentially complicate decision-making due to the demands on cognitive integration tasks. We tested female túngara frog, Physalaemus (=Engystomops) pustulosus, responses to male mating signals in noise from multiple sensory modalities (acoustic and visual). Noise treatments were partitioned into three categories: acoustic, visual, and multimodal. We used natural calls from conspecifics and heterospecifics for acoustic noise. Robotic frogs were employed as either visual signal components (synchronous vocal sac inflation with call) or visual noise (asynchronous vocal sac inflation with call). Females expressed a preference for the typically more attractive call in the presence of unimodal noise. However, during multimodal signal and noise treatments (robofrogs employed with background noise), females failed to express a preference for the typically attractive call in the presence of conspecific chorus noise. We found that social context and temporal synchrony of multimodal signaling components are important for multimodal communication. Our results demonstrate that multimodal signals have the potential to increase the complexity of the sensory scene and reduce the efficacy of female decision making.

Cross-modal facilitation of auditory discrimination in a frog

Stimulation in one sensory modality can affect perception in a separate modality, resulting in diverse effects including illusions in humans. This can also result in cross-modal facilitation, a process where sensory performance in one modality is improved by stimulation in another modality. For instance, a simple sound can improve performance in a visual task in both humans and cats. However, the range of contexts and underlying mechanisms that evoke such facilitation effects remain poorly understood. Here, we demonstrated cross-modal stimulation in wild-caught túngara frogs, a species with well-studied acoustic preferences in females. We first identified that a combined visual and seismic cue (vocal sac movement and water ripple) was behaviourally relevant for females choosing between two courtship calls in a phonotaxis assay. We then found that this combined cross-modal stimulus rescued a species-typical acoustic preference in the presence of background noise that otherwise abolished the preference. These results highlight how cross-modal stimulation can prime attention in receivers to improve performance during decision-making. With this, we provide the foundation for future work uncovering the processes and conditions that promote cross-modal facilitation effects.

Reproductive behaviour, cutaneous morphology, and skin secretion analysis in the anuran Dermatonotus muelleri

Despite the common poison and mucous glands, some amphibian groups have differentiated glands associated with reproduction and usually present on the male ventral surface. Known as breeding glands or sexually dimorphic skin glands (SDSGs), they are related to intraspecific chemical communication during mating. Until recently, reproduction associated with skin glands was recognized only in salamanders and caecilians and remained unexplored among anurans. The Brazilian microhylid Dermatonotus muelleri (Muller's termite frog) is known for its very toxic skin secretion. Despite the slippery body, the male adheres to the female back during reproduction, as they have differentiated ventral glands. In this paper, we have gathered data proposing an integrative approach correlated with the species' biology and biochemical properties of their skin secretions. Furthermore, we suggest that the adhesion phenomenon is related to arm shortening and rounded body that make amplexus inefficient, although constituting important adaptive factors to life underground.

•

Dermatonotus muelleri mating involves peculiar male adherence to the female’s back

•

Adhesion phenomenon is possibly related to arm shortening and round-shaped body

•

Differentiated adhesive glands are distributed in the male’s anterior ventral skin

•

Male skin secretion contains compounds related to the adhesive properties

How signals interact in multimodal displays: Insights from a robotic frog

IN FOCUS

Caldart, M. V., M. B. dos Santos & G. Machado (2021). Function of a multimodal signal: a multiple hypothesis test using a robot frog Journal of Animal Ecology, https://doi.org/10.1111/1365-2656.13620. Animals can communicate using signals perceived by different sensory systems, and many combine multiple sensory modalities in their display repertoires. Why these multimodal displays evolve and how they function to transmit information between individuals are crucial questions in behavioural and evolutionary research. Most empirical studies addressing these questions assume, even if implicitly, that signals of different modalities have independent effects on receiver responses. Nonetheless, the potential for interactions between signals as an explanation for the function of multimodal displays has been recognized for over two decades. Caldart et al. (2021) use a robotic frog and a receiver-based approach to test four alternative hypotheses for the function of multimodal (acoustic + visual) displays in the stream-dwelling frog Crossodactylus schmidti. Their results lend support to an inter-signal interaction mechanism, whereby inclusion of visual signals modifies the context in which an acoustic display is interpreted. In contrast, the results in Caldart et al. (2021) are less consistent with the hypotheses that emphasize the quality-related information encoded in different signal modalities and a hypothesis that focuses on signal transmission across heterogeneous environments. These results showcase how experimental manipulation of different signal modalities and tests of multiple alternative hypotheses are key to clarifying the function of multimodal displays.

Vibrational signalling, an underappreciated mode in cricket communication

Signalling via substrate vibration represents one of the most ubiquitous and ancient modes of insect communication. In crickets (Grylloidea) and other taxa of tympanate Ensifera, production and detection of acoustic and vibrational signals are closely linked functionally and evolutionarily. Male stridulation produces both acoustic and vibrational signal components, the joint perception of which improves song recognition and female orientation towards the signaller. In addition to stridulation, vibrational signalling mainly through body tremulation and/or drumming with body parts on the substrate has long been known to be part of crickets' close-range communication, including courtship, mate guarding and aggression. Such signalling is typically exhibited by males, independently or in conjunction with stridulation, and occurs literally in all cricket lineages and species studied. It is further also part of the aggressive behaviour of females, and in a few cricket groups, females respond vibrationally to acoustic and/or vibrational signals from males. The characteristics and function of these signals have remained largely unexplored despite their prevalence. Moreover, the communication potential and also ubiquity of cricket vibrational signals are underappreciated, limiting our understanding of the function and evolution of the cricket signalling systems. By providing a concise review of the existing knowledge of cricket perception of vibrations and vibrational signalling behaviour, we critically comment on these views, discuss the communication value of the emitted signals and give some methodological advice respecting their registration and control. The review aims to increase awareness, understanding and research interest in this ancient and widespread signalling mode in cricket communication.

Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches

Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues related to sound production might enhance vocal learning. We tested this hypothesis by pairing appropriate, colour-realistic, high frame-rate videos of a singing adult male zebra finch tutor with song playbacks and presenting these stimuli to juvenile zebra finches (Taeniopygia guttata). Juveniles exposed to song playbacks combined with video presentation of a singing bird approached the stimulus more often and spent more time close to it than juveniles exposed to audio playback only or audio playback combined with pixelated and time-reversed videos. However, higher engagement with the realistic audio–visual stimuli was not predictive of better song learning. Thus, although multimodality increased stimulus engagement and biologically relevant video content was more salient than colour and movement equivalent videos, the higher engagement with the realistic audio–visual stimuli did not lead to enhanced vocal learning. Whether the lack of three-dimensionality of a video tutor and/or the lack of meaningful social interaction make them less suitable for facilitating song learning than audio–visual exposure to a live tutor remains to be tested.

Complex sensory environments alter mate choice outcomes

Noise is a common problem in animal communication. We know little, however, about how animals communicate in the presence of noise using multimodal signals. Multimodal signals are hypothesised to be favoured by evolution because they increase the efficacy of detection and discrimination in noisy environments. We tested the hypothesis that female túngara frogs' responses to attractive male advertisement calls are improved in noise when a visual signal component is added to the available choices. We tested this at two levels of decision complexity (two and three choices). In a two-choice test, the presence of noise did not reduce female preferences for attractive calls. The visual component of a calling male, associated with an unattractive call, also did not reduce preference for attractive calls in the absence of noise. In the presence of noise, however, females were more likely to choose an unattractive call coupled with the visual component. In three-choice tests, the presence of noise alone reduced female responses to attractive calls and this was not strongly affected by the presence or absence of visual components. The responses in these experiments fail to support the multimodal signal efficacy hypothesis. Instead, the data suggest that audio-visual perception and cognitive processing, related to mate choice decisions, are dependent on the complexity of the sensory scene.

Reproductive State Modulates Retinal Sensitivity to Light in Female Túngara Frogs

Visual cues are often a vital part of animal communication and courtship. While a plethora of studies have focused on the role that hormones play in acoustic communication of anurans, relatively few have explored hormonal modulation of vision in these animals. Much of what we do know comes from behavioral studies, which show that a frog’s hormonal state can significantly affect both its visual behavior and mating decisions. However, to fully understand how frogs use visual cues to make these mating decisions, we must first understand how their visual system processes these cues, and how hormones affect these processes. To do this, we performed electroretinograms (ERGs) to measure retinal sensitivity of túngara frogs (Physalaemus pustulosus), a neotropical species whose mating behavior includes previously described visual cues. To determine the effect of hormonal state on visual sensitivity, ERGs were recorded under scotopic and photopic conditions in frogs that were either non-reproductive or hormone-treated with human chorionic gonadotropin (hCG) prior to testing. Additionally, measurements of optical anatomy determined how túngara frog eye and retina morphology related to physiological sensitivity. As expected, we found that both sexes display higher visual sensitivity under scotopic conditions compared to photopic conditions. However, hormone injections significantly increased retinal sensitivity of females under scotopic conditions. These results support the hypothesis that hormonal modulation of neural mechanisms, such as those mediating visually guided reproductive behavior in this species, include modulation of the receptor organ: the retina. Thus, our data serve as a starting point for elucidating the mechanism of hormonal modulation of visual sensitivity.

Social and physiological drivers of rapid colour change in a tropical toad

Dynamic sexual dichromatism occurs when males and females differ in colouration for a limited time. Although this trait has been primarily studied in cephalopods, chameleons, and fishes, recent analyses suggest that dynamic dichromatism is prevalent among anurans and may be mediated through sexual selection and sex recognition. Yellow toads, Incilius luetkenii, exhibit dynamic dichromatism during explosive breeding events at the onset of the rainy season: males change from a cryptic brown to a bright yellow and back again during the brief mating event. We tested the hypothesis that dynamic dichromatism in yellow toads is influenced by conspecific interactions and mediated through sex hormones and stress hormones. We placed male toads into one of four social treatments (with three other males, one male, one female, or no other toads). Immediately before and after each one-hour treatment, we quantified male colour with a reflectance spectrometer and we collected a blood sample to assess plasma concentrations of both testosterone and corticosterone. We found that males held with conspecific animals showed the brightest yellow colour and showed little or no change in their corticosterone levels. Across treatments, toads with duller yellow colour had higher levels of corticosterone. Male colour showed no association with testosterone. Interestingly, males showed substantial temporal variation in colour and corticosterone: toads were duller yellow and exhibited greater levels of corticosterone post-treatment across subsequent days at the onset of the rainy season. Our findings reveal that both conspecific interactions and corticosterone are involved in the dynamic colour change of yellow toads.

Assessment of fighting ability in the vocal cichlid Metriaclima zebra in face of incongruent audiovisual information

Information transfer between individuals typically depends on multiple sensory channels. Yet, how multi-sensory inputs shape adaptive behavioural decisions remains largely unexplored. We tested the relative importance of audio and visual sensory modalities in opponent size assessment in the vocal cichlid fish, Metriaclima zebra, by playing back mismatched agonistic sounds mimicking larger or smaller opponents during fights of size-matched males. Trials consisted in three 5-min periods: PRE (visual), PBK (acoustic+visual) and POST (visual). During PBK agonistic sounds of smaller (high frequency or low amplitude) or larger (low frequency or high amplitude) males were played back interactively. As a control, we used white noise and silence. We show that sound frequency but not amplitude affects aggression, indicating that spectral cues reliably signal fighting ability. In addition, males reacted to the contrasting audio-visual information by giving prevalence to the sensory channel signalling a larger opponent. Our results suggest that fish can compare the relevance of information provided by different sensory inputs to make behavioural decisions during fights, which ultimately contributes to their individual fitness. These findings have implications for our understanding of the role of multi-sensory inputs in shaping behavioural output during conflicts in vertebrates.

Summary: Cichlid fish rely on the sensory channel indicating higher risk when facing incongruent visual and acoustic information during opponent assessment.

Multimodal stimuli regulate reproductive behavior and physiology in male túngara frogs

Unlike in terrestrial animals, the boundary between internal (e.g., hormones) and external (e.g., social) stimulation can be blurred for aquatic and amphibious species. When chemicals such as hormones and glandular secretions leach into the water, they can further interact with other signaling systems, creating multimodal stimuli. It is unclear, however, whether water-borne chemical secretions from courting male frogs affect the physiology and behavior of their rivals. In order to address this question we first established non-invasive, continuous sampling methods for simultaneously measuring both hormones and behavior in amphibious species. Then, we examined whether interactions between water-borne chemical secretions and conspecific calls affect reproductive behavior and physiology (testosterone and corticosterone) of courting male túngara frogs. Our results demonstrate that conspecific acoustic stimulation alone increases locomotor activity, decreases latency to call, and increases calling behavior but does not alter the amount of hormones excreted. In response to water containing chemical secretions from rivals, but in the absence of calls from other males, males excrete more testosterone. Interestingly, the combined acoustic and chemical stimulus causes a multiplicative increase in both calling behavior and hormonal excretion. Taken together, our results suggest that a multimodal chemical-acoustic stimulus physiologically primes males for aggressive behavior.

Evolution and function of multimodal courtship displays

Courtship displays are behaviours aimed to facilitate attraction and mating with the opposite sex and are very common across the animal kingdom. Most courtship displays are multimodal, meaning that they are composed of concomitant signals occurring in different sensory modalities. Although courtship often strongly influences reproductive success, the question of why and how males use multimodal courtship to increase their fitness has not yet received much attention. Very little is known about the role of different components of male courtship and their relative importance for females. Indeed, most of the work on courtship displays have focused on effects on female choice, often neglecting other possible roles. Additionally, a number of scientists have recently stressed the importance of considering the complexity of a display and the interactions between its different components in order to grasp all the information contained in those multimodal signals. Unfortunately, these methods have not yet been extensively adapted in courtship studies. The aim of this study was to review what is currently known about the functional significance of courtship displays, particularly about the role of multimodality in the courtship communication context. Emphasis is placed on those cases where a complete picture of the communication system can only be assessed by taking complexity and interaction between different modalities into account.

Quantifying the relationship between optical anatomy and retinal physiological sensitivity: A comparative approach

Light intensity varies 1 million-fold between night and day, driving the evolution of eye morphology and retinal physiology. Despite extensive research across taxa showing anatomical adaptations to light niches, surprisingly few empirical studies have quantified the relationship between such traits and the physiological sensitivity to light. In this study, we employ a comparative approach in frogs to determine the physiological sensitivity of eyes in two nocturnal (Rana pipiens, Hyla cinerea) and two diurnal species (Oophaga pumilio, Mantella viridis), examining whether differences in retinal thresholds can be explained by ocular and cellular anatomy. Scotopic electroretinogram (ERG) analysis of relative b-wave amplitude reveals 10- to 100-fold greater light sensitivity in nocturnal compared to diurnal frogs. Ocular and cellular optics (aperture, focal length, and rod outer segment dimensions) were assessed via the Land equation to quantify differences in optical sensitivity. Variance in retinal thresholds was overwhelmingly explained by Land equation solutions, which describe the optical sensitivity of single rods. Thus, at the b-wave, stimulus-response thresholds may be unaffected by photoreceptor convergence (which create larger, combined collecting areas). Follow-up experiments were conducted using photopic ERGs, which reflect cone vision. Under these conditions, the relative difference in thresholds was reversed, such that diurnal species were more sensitive than nocturnal species. Thus, photopic data suggest that rod-specific adaptations, not ocular anatomy (e.g., aperture and focal distance), drive scotopic thresholds differences. To the best of our knowledge, these data provide the first quantified relationship between optical and physiological sensitivity in vertebrates active in different light regimes.

Multimodal Signal Testing Reveals Gestural Tapping Behavior in Spotted Reed Frogs

In the majority of anuran species, acoustic signals are the dominant mode of inter- and intrasexual communication. Male calls are always accompanied by the movement of a more or less conspicuous vocal sac-a potential visual cue. Reed frogs possess a striking vocal sac with a colorful patch of gland tissue clearly visible once the vocal sac is inflated during acoustic signaling. To investigate the visual signal function of vocal sac and gular gland, we presented male Spotted Reed Frogs (Hyperolius puncticulatus) with unimodal and multimodal signal playbacks of conspecific rivals in their natural habitat and recorded their behavioral responses. We found no difference in receiver response to unimodal advertisement call stimuli and to multimodal stimulus presentations of calls combined with visual signals of an artificial vocal sac with or without a gular patch, moving synchronously or asynchronously with the call playback. The inflations of a vocal sac with a colorful gular patch did not alter receiver response and neither increase nor decrease signal salience during male-male communication. Interestingly, males frequently displayed a novel hind and front foot-tapping behavior in response to all playbacks. Comparison of male responses to advertisement and aggressive call playbacks showed that Spotted Reed Frogs approached the sound source less during aggressive call presentations. Tapping behavior was not influenced by either call playback. We suggest that the gestural tapping behavior might act as vibrational signal and discuss its potential signal function in male contests and courtship for females.

The role of complex cues in social and reproductive plasticity

Phenotypic plasticity can be a key determinant of fitness. The degree to which the expression of plasticity is adaptive relies upon the accuracy with which information about the state of the environment is integrated. This step might be particularly beneficial when environments, e.g. the social and sexual context, change rapidly. Fluctuating temporal dynamics could increase the difficulty of determining the appropriate level of expression of a plastic response. In this review, we suggest that new insights into plastic responses to the social and sexual environment (social and reproductive plasticity) may be gained by examining the role of complex cues (those comprising multiple, distinct sensory components). Such cues can enable individuals to more accurately monitor their environment in order to respond adaptively to it across the whole life course. We briefly review the hypotheses for the evolution of complex cues and then adapt these ideas to the context of social and sexual plasticity. We propose that the ability to perceive complex cues can facilitate plasticity, increase the associated fitness benefits and decrease the risk of costly 'mismatches' between phenotype and environment by (i) increasing the robustness of information gained from highly variable environments, (ii) fine-tuning responses by using multiple strands of information and (iii) reducing time lags in adaptive responses. We conclude by outlining areas for future research that will help to determine the interplay between complex cues and plasticity.

Perceived Synchrony of Frog Multimodal Signal Components Is Influenced by Content and Order

Multimodal signaling is common in communication systems. Depending on the species, individual signal components may be produced synchronously as a result of physiological constraint (fixed) or each component may be produced independently (fluid) in time. For animals that rely on fixed signals, a basic prediction is that asynchrony between the components should degrade the perception of signal salience, reducing receiver response. Male túngara frogs, Physalaemus pustulosus, produce a fixed multisensory courtship signal by vocalizing with two call components (whines and chucks) and inflating a vocal sac (visual component). Using a robotic frog, we tested female responses to variation in the temporal arrangement between acoustic and visual components. When the visual component lagged a complex call (whine + chuck), females largely rejected this asynchronous multisensory signal in favor of the complex call absent the visual cue. When the chuck component was removed from one call, but the robofrog inflation lagged the complex call, females responded strongly to the asynchronous multimodal signal. When the chuck component was removed from both calls, females reversed preference and responded positively to the asynchronous multisensory signal. When the visual component preceded the call, females responded as often to the multimodal signal as to the call alone. These data show that asynchrony of a normally fixed signal does reduce receiver responsiveness. The magnitude and overall response, however, depend on specific temporal interactions between the acoustic and visual components. The sensitivity of túngara frogs to lagging visual cues, but not leading ones, and the influence of acoustic signal content on the perception of visual asynchrony is similar to those reported in human psychophysics literature. Virtually all acoustically communicating animals must conduct auditory scene analyses and identify the source of signals. Our data suggest that some basic audiovisual neural integration processes may be at work in the vertebrate brain.

Temporal variation in acoustic and visual signalling as a function of stream background noise in the Bornean foot-flagging frog, Staurois parvus

High background noise can interfere with signal detection and perception. Bornean foot-flagging frogs,Staurois parvus, live along noisy streams and use both acoustic and visual signals to communicate. It remains unclear why acoustic signalling is retained given that visual signalling appears to have clear advantages under these noisy conditions. We hypothesized that temporal dynamics in stream noise have shaped the multimodal communication system inS. parvuswith acoustic signalling at an advantage under more quiet conditions, whereas visual signals will prevail when the noise of rushing water is high after rains. We found that as predicted, maleS. parvusincreased foot flagging and decreased advertisement calling when presented with playbacks of stream noise compared to less noisy pre-playback conditions. Such context-dependent dynamic-selection regimes are recently gaining wider attention and enhance our understanding of the flexibility seen in the use of multimodal signals inS. parvus.

Booming far: the long-range vocal strategy of a lekking bird

The pressures of selection acting on transmission of information by acoustic signals are particularly high in long-distance communication networks. Males of the North African houbara bustard (Chlamydotis undulata undulata) produce extremely low-frequency vocalizations called 'booms' as a component of their courtship displays. These displays are performed on sites separated by a distance of on average 550 m, constituting exploded leks. Here, we investigate the acoustic features of booms involved in species-specific identity. We first assessed the modifications of acoustic parameters during boom transmission at long range within the natural habitat of the species, finding that the frequency content of booms was reliably transmitted up to 600 m. Additionally, by testing males' behavioural responses to playbacks of modified signals, we found that the presence of the second harmonic and the frequency modulation are the key parameters for species identification, and also that a sequence of booms elicited stronger responses than a single boom. Thus, the coding-decoding process relies on redundant and propagation-resistant features, making the booms particularly well adapted for the long-range transmission of information between males. Moreover, by experimentally disentangling the presentation of visual and acoustic signals, we showed that during the booming phase of courtship, the two sensory modalities act in synergy. The acoustic component is dominant in the context of intra-sexual competition. While the visual component is not necessary to induce agonistic response, it acts as an amplifier and reduces the time of detection of the signaller. The utilization of these adaptive strategies allows houbara males to maximize the active space of vocalizations emitted in exploded leks.

Cross-Modal Correspondences in Non-human Mammal Communication

For both humans and other animals, the ability to combine information obtained through different senses is fundamental to the perception of the environment. It is well established that humans form systematic cross-modal correspondences between stimulus features that can facilitate the accurate combination of sensory percepts. However, the evolutionary origins of the perceptual and cognitive mechanisms involved in these cross-modal associations remain surprisingly underexplored. In this review we outline recent comparative studies investigating how non-human mammals naturally combine information encoded in different sensory modalities during communication. The results of these behavioural studies demonstrate that various mammalian species are able to combine signals from different sensory channels when they are perceived to share the same basic features, either because they can be redundantly sensed and/or because they are processed in the same way. Moreover, evidence that a wide range of mammals form complex cognitive representations about signallers, both within and across species, suggests that animals also learn to associate different sensory features which regularly co-occur. Further research is now necessary to determine how multisensory representations are formed in individual animals, including the relative importance of low level feature-related correspondences. Such investigations will generate important insights into how animals perceive and categorise their environment, as well as provide an essential basis for understanding the evolution of multisensory perception in humans.

Cross-modal integration of multimodal courtship signals in a wolf spider

Cross-modal integration, i.e., cognitive binding of information transmitted in more than one signal mode, is important in animal communication, especially in complex, noisy environments in which signals of many individuals may overlap. Males of the brush-legged wolf spider Schizocosa ocreata (Hentz) use multimodal communication (visual and vibratory signals) in courtship. Because females may be courted by multiple males at the same time, they must evaluate co-occurring male signals originating from separate locations. Moreover, due to environmental complexity, individual components of male signals may be occluded, altering detection of sensory modes by females. We used digital multimodal playback to investigate the effect of spatial and temporal disparity of visual and vibratory components of male courtship signals on female mate choice. Females were presented with male courtship signals with components that varied in spatial location or temporal synchrony. Females responded to spatially disparate signal components separated by ≥90° as though they were separate sources, but responded to disparate signals separated by ≤45° as though they originated from a single source. Responses were seen as evidence for cross-modal integration. Temporal disparity (asynchrony) in signal modes also affected female receptivity. Females responded more to male signals when visual and vibratory modes were in synchrony than either out-of-synch or interleaved/alternated. These findings are consistent with those seen in both humans and other vertebrates and provide insight into how animals overcome communication challenges inherent in a complex environment.

Ontogenetic Change of Signal Brightness in the Foot-Flagging Frog Species Staurois parvus and Staurois guttatus

Adult individuals of several anuran species exhibit conspicuous visual displays during intraspecific communication. While signal properties in adults have been subject to an increasing number of studies, little is known about the variation of visual signals in juveniles and during ontogenetic changes. Foot-flagging signals of the Bornean frogs Staurois guttatus and S. parvus were observed in juveniles a few days after metamorphosis. We investigated color parameters of foot webbings and body coloration of individuals bred at the Vienna Zoo, and their relation to age and body size using spectrophotometry. Our results indicate that the brightness of foot webbings of S. guttatus and S. parvus increased with increasing age. Additionally, we compared the results with measurements of adult individuals from a population in Brunei and discuss possible differences related to diet and age as well as the habitat use of juveniles and adults. We suggest that the ontogenetic increase in foot-webbing brightness enhances visual conspicuousness and the signal-to-noise ratio of the visual signal with sexual maturity and potentially functions as cue to the age of the signaler.

The evolution of speech: vision, rhythm, cooperation

A full account of human speech evolution must consider its multisensory, rhythmic, and cooperative characteristics. Humans, apes, and monkeys recognize the correspondence between vocalizations and their associated facial postures, and gain behavioral benefits from them. Some monkey vocalizations even have a speech-like acoustic rhythmicity but lack the concomitant rhythmic facial motion that speech exhibits. We review data showing that rhythmic facial expressions such as lip-smacking may have been linked to vocal output to produce an ancestral form of rhythmic audiovisual speech. Finally, we argue that human vocal cooperation (turn-taking) may have arisen through a combination of volubility and prosociality, and provide comparative evidence from one species to support this hypothesis.

Crossmodal comparisons of signal components allow for relative-distance assessment

Animals have multiple senses through which they detect their surroundings and often integrate sensory information across different modalities to generate perceptions. Animal communication, likewise, often consists of signals containing stimuli processed by different senses. Stimuli with different physical forms (i.e., from different sensory modalities) travel at different speeds. As a consequence, multimodal stimuli simultaneously emitted at a source can arrive at a receiver at different times. Such differences in arrival time can provide unique information about the distance to the source. Male túngara frogs (Physalaemus pustulosus) call from ponds to attract females and to repel males. Production of the sound incidentally creates ripples on the water surface, providing a multimodal cue. We tested whether male frogs attend to distance-dependent cues created by a calling rival and whether their response depends on crossmodal comparisons. In a first experiment, we showed distance-dependent changes in vocal behavior: males responded more strongly with decreasing distance to a mimicked rival. In a second experiment, we showed that males can discriminate between relatively near and far rivals by using a combination of unimodal cues, specifically amplitude changes of sound and water waves, as well as crossmodal differences in arrival time. Our data reveal that animals can compare the arrival time of simultaneously emitted multimodal cues to obtain information on relative distance to a source. We speculate that communicative benefits from crossmodal comparison may have been an important driver of the evolution of elaborate multimodal displays.

From uni- to multimodality: towards an integrative view on anuran communication

Undeniably, acoustic signals are the predominant mode of communication in frogs and toads. Acoustically active species are found throughout the vast diversity of anuran families. However, additional or alternative signal modalities have gained increasing attention. In several anurans, seismic, visual and chemical communications have convergently evolved due to ecological constraints such as noisy environments. The production of a visual cue, like the inevitably moving vocal sac of acoustically advertising males, is emphasized by conspicuously coloured throats. Limb movements accompanied by dynamic displays of bright colours are additional examples of striking visual signals independent of vocalizations. In some multimodal anuran communication systems, the acoustic component acts as an alert signal, which alters the receiver attention to the following visual display. Recent findings of colourful glands on vocal sacs, producing volatile species-specific scent bouquets suggest the possibility of integration of acoustic, visual and chemical cues in species recognition and mate choice. The combination of signal components facilitates a broadened display repertoire in challenging environmental conditions. Thus, the complexity of the communication systems of frogs and toads may have been underestimated.