Wild chimpanzees' use of single and combined vocal and gestural signals

Age differences in bonobo (Pan paniscus) multimodal communication signals

While spoken language is unique to humans, many features of human communication are shared with great apes, including the use of signals in multiple modalities such as vocalizations, gestures, and facial expressions. Communication signals can be unimodal (involving a single modality) or multimodal (combining multiple modalities simultaneously). Here, we examined age-related differences in bonobo (Pan paniscus) unimodal and multimodal communication signals. We assessed all vocalizations, gestures, facial expressions, and multimodal combinations produced by captive bonobos across a variety of behavioral contexts. All occurrences of communication signals were collected via focal observations from 12 individuals ranging from 6 months to 44 years of age. All individuals produced multimodal communication signals but all bonobos, regardless of age, produced multimodal signals at lower frequencies than unimodal signals. Age had a significant effect with younger bonobos producing more multimodal signals than older individuals (p < 0.001). The infant and juveniles produced the most multimodal signals and there was an approximately 6% increase in unimodal signals per age year increase. These findings indicate a developmental shift toward unimodal signals as bonobos age. Behavioral context was predictive of signal type usage with an increase of multimodal signals in agonistic (p < 0.001), play (p < 0.001), and sexual contexts (p = 0.001). This indicates that context is important for bonobo modality with multimodal signaling occurring more in "high-risk/high-reward" contexts where proper signal comprehension is vital. This study represents an overview of multimodal communication across bonobo life stages, offering further insights into primate communication patterns and developmental trajectories.

Individual variation in the chimpanzee arcuate fasciculus predicts vocal and gestural communication

Whether language has its evolutionary origins in vocal or gestural communication has long been a matter of debate. In humans, the arcuate fasciculus, a major fronto-temporal white matter tract, is left-lateralized, is larger than in nonhuman apes, and is linked to language. However, the extent to which the arcuate fasciculus of nonhuman apes is linked to vocal and/or manual communication is currently unknown. Here, using probabilistic tractography in 67 chimpanzees (45 female, 22 male), we report that the chimpanzee arcuate fasciculus is not left-lateralized at the population level, in marked contrast with humans. However, individual variation in the anatomy and leftward asymmetry of the chimpanzee arcuate fasciculus is associated with individual variation in the use of both communicative gestures and communicative sounds under volitional orofacial motor control. This indicates that the arcuate fasciculus likely supported both vocal and gestural communication in the chimpanzee/human last common ancestor, 6-7 million years ago.

Extensive compositionality in the vocal system of bonobos

Compositionality, the capacity to combine meaningful elements into larger meaningful structures, is a hallmark of human language. Compositionality can be trivial (the combination's meaning is the sum of the meaning of its parts) or nontrivial (one element modifies the meaning of the other element). Recent studies have suggested that animals lack nontrivial compositionality, representing a key discontinuity with language. In this work, using methods borrowed from distributional semantics, we investigated compositionality in wild bonobos and found that not only does each call type of their repertoire occur in at least one compositional combination, but three of these compositional combinations also exhibit nontrivial compositionality. These findings suggest that compositionality is a prominent feature of the bonobo vocal system, revealing stronger parallels with human language than previously thought.

Yawn Contagion and Modality-Matching in the Female-Bonded Society of Geladas (Theropithecus gelada)

Behavioral contagion is widespread in primates, with yawn contagion (YC) being a well-known example. Often associated with ingroup dynamics and synchronization, the possible functions and evolutionary pathways of YC remain subjects of active debate. Among nonhuman animals, geladas (Theropithecus gelada) are the only species known to occasionally emit a distinct vocalization while yawning. Yet, the role of different sensory modalities in YC remains poorly understood. Due to their social and communicative complexity, geladas serve as an excellent model for investigating the effects of multimodality and social factors on behavioral contagion. Here we studied a large zoo-housed colony of geladas (103 subjects, 1422 yawns) and confirm the previous evidence for visual and auditory YC. Hearing, seeing, or hearing and seeing yawns significantly triggered contagious yawning at comparable levels. Additionally, we found no evidence of laterality influencing responses based on the side of detection. While the social bond, measured via grooming, between the trigger and receiver did not correlate with YC, a consistent sex effect emerged. Females responded more frequently to female than to male yawns and were more likely to match modality (i.e., vocalized vs. nonvocalized) and mirror morphology of other females' yawns. Effective female-female communication and affiliation are crucial for maintaining cohesion and fostering strong intra-unit relationships among geladas. Our results underscore the importance of different sensory components in the distribution of YC, particularly for species living in complex social systems. These findings raise further questions about the functional and emotional significance of yawning and potential inter-sexual differences, suggesting that the phenomenon is more complex than previously thought.

Selectivity in Buttress Drumming Tree Properties Among Chimpanzees (Pan troglodytes schweinfurthii) of the Waibira Community in Budongo Forest, Uganda

Wild chimpanzees drum on tree buttresses during dominance displays and travel, generating low-frequency sounds that are audible over distances of more than 1 km. Western chimpanzees (Pan troglodytes verus) in the Nimba Mountains of Guinea selectively choose trees and buttresses when drumming, potentially based on their resonant properties, suggesting that these chimpanzees are optimizing their drumming signals. We investigated whether male eastern chimpanzees (Pan troglodytes schweinfurthii) from the Waibira community in the Budongo Forest, Uganda, also show preferences in tree and buttress choice, exploring whether selectivity is a species-wide feature. We tested chimpanzee preferences for tree species and diameter, number of buttresses, and buttress area and width, by comparing trees and buttresses used in drumming bouts with nearby unused trees and buttresses. Waibira chimpanzees drummed preferentially on two tree species: the tropical hardwood Cynometra alexandrii and the softwood Chrysophyllum albidum. Chimpanzees selected trees with a larger diameter over nearby trees with a smaller diameter, and buttresses were more likely to be used for drumming if they had a larger area or larger width. These results suggest that chimpanzees in the Waibira community select trees and buttresses based on physical properties, most likely related to acoustically relevant characteristics. These findings support the argument that buttress drumming is a goal-directed behavior and contributes to our understanding of chimpanzees' use and optimization of their long-distance acoustic signals.

Multimodal communication and audience directedness in the greeting behaviour of semi-captive African savannah elephants

Many species communicate by combining signals into multimodal combinations. Elephants live in multi-level societies where individuals regularly separate and reunite. Upon reunion, elephants often engage in elaborate greeting rituals, where they use vocalisations and body acts produced with different body parts and of various sensory modalities (e.g., audible, tactile). However, whether these body acts represent communicative gestures and whether elephants combine vocalisations and gestures during greeting is still unknown. Here we use separation-reunion events to explore the greeting behaviour of semi-captive elephants (Loxodonta africana). We investigate whether elephants use silent-visual, audible, and tactile gestures directing them at their audience based on their state of visual attention and how they combine these gestures with vocalisations during greeting. We show that elephants select gesture modality appropriately according to their audience's visual attention, suggesting evidence of first-order intentional communicative use. We further show that elephants integrate vocalisations and gestures into different combinations and orders. The most frequent combination consists of rumble vocalisations with ear-flapping gestures, used most often between females. By showing that a species evolutionarily distant to our own primate lineage shows sensitivity to their audience's visual attention in their gesturing and combines gestures with vocalisations, our study advances our understanding of the emergence of first-order intentionality and multimodal communication across taxa.

Inconsistent effects of components as evidence for non-compositionality in chimpanzee face-gesture combinations? A response to Oña et al (2019)

Using field observations from a sanctuary, Oña and colleagues (DOI: 10.7717/peerj.7623) investigated the semantics of face-gesture combinations in chimpanzees (Pan troglodytes). The response of the animals to these signals was encoded as a binary measure: positive interactions such as approaching or grooming were considered affiliative; ignoring or attacking was considered non-affiliative. The relevant signals are illustrated in Fig. 1 (https://doi.org/10.7717/peerj.7623/fig-1), together with the outcome in terms of average affiliativeness. The authors observe that there seems to be no systematicity in the way the faces modify the responses to the gestures, sometimes reducing affiliativeness, sometimes increasing it. A strong interpretation of this result would be that the meaning of a gesture-face combination cannot be derived from the meaning of the gesture and the meaning of the face, that is, the interpretation of chimpanzees' face-gesture combinations are non compositional in nature. We will revisit this conclusion: we will exhibit simple compositional systems which, after all, may be plausible. At the methodological level, we argue that it is critical to lay out the theoretical options explicitly for a complete comparison of their pros and cons.

Social uncertainty promotes signal complexity during approaches in wild chimpanzees (Pan troglodytes verus) and mangabeys (Cercocebus atys atys)

The social complexity hypothesis for the evolution of communication posits that complex social environments require greater communication complexity for individuals to effectively manage their relationships. We examined how different socially uncertain contexts, reflecting an increased level of social complexity, relate to variation in signalling within and between two species, which display varying levels of fission-fusion dynamics (sympatric-living chimpanzees and sooty mangabeys, Taï National Park, Ivory Coast). Combined signalling may improve message efficacy, notably when involving different perception channels, thus may increase in moments of high social uncertainty. We examined the probability of individuals to emit no signal, single or multisensory or combined (complex) signals, during social approaches which resulted in non-agonistic outcomes. In both species, individuals were more likely to use more combined and multisensory signals in post-conflict approaches with an opponent than in other contexts. The clearest impact of social uncertainty on signalling complexity was observed during chimpanzee fusions, where the likelihood of using complex signals tripled relative to other contexts. Overall, chimpanzees used more multisensory signals than mangabeys. Social uncertainty may shape detected species differences in variation in signalling complexity, thereby supporting the hypothesis that social complexity, particularly associated with high fission-fusion dynamics, promotes signalling complexity.

Vocal functional flexibility in the grunts of young chimpanzees

All living things communicate yet only humans can be said to communicate using language. How this came to be the case is a fundamental mystery unsolved by contemporary science. Within a human lifetime, language emerges from a complex developmental process. As such, understanding chimpanzee vocal development is essential to understanding the evolutionary roots of language. In human development, language is directly built upon the early capacity for "vocal functional flexibility"-the ability to flexibly express the same vocalizations in different ways to achieve different functions. Primate vocalizations, by contrast, have long been believed to be relatively inflexible regarding both production and function. In this paper, we break new ground by providing evidence for vocal functional flexibility in one of the first systematic studies of early chimpanzee vocal production and function. This finding implies the developmental foundations for language are rooted in our primate evolutionary heritage.

Object use in communication of semi-wild chimpanzees

Object interactions play an important role in human communication but the extent to which nonhuman primates incorporate objects in their social interactions remains unknown. To better understand the evolution of object use, this study explored how objects are used in social interactions in semi-wild chimpanzees (Pan troglodytes). We used an observational approach focusing on naturally occurring object actions where we examined their use and tested whether the production of object actions was influenced by the recipients' visual attention as well as by colony membership. The results show that chimpanzees adjusted both the type of object used, and the modality of object actions to match the visual attention of the recipient, as well as colony differences in the use of targeted object actions. These results provide empirical evidence highlighting that chimpanzees use objects in diverse ways to communicate with conspecifics and that their use may be shaped by social factors, contributing to our understanding of the evolution of human nonverbal communication, language, and tool use.

Production of multimodal signals to assert social dominance in white-lipped peccary (Tayassu pecari)

In this study we aimed to examine whether the 'redundancy' (a backup function to ensure the signal transmission) or 'multiple messages' (sensory communication system in combination) hypothesis would explain the function of multimodal communication of white-lipped peccaries (Tayassu pecari-WLPs). We also aimed to assess the individual factors (the social rank and sex of the sender) influencing the production of, and responses to unimodal and multimodal signals. We determined the social rank of 21 WLPs living in two captive groups and quantified the production of unimodal and multimodal signals when displaying threatening and submissive behaviors. WLPs most often produce multimodal signals independent of a previous unimodal signal failure, which suggests that they were adding more information, such as the sender's size, rather than merely increasing efficacy by engaging a different receiver's sensory channel. There was no effect of the sender's sex in the production of, and responses to, multimodal signals. However, the higher the sender's social rank, the greater the production of multimodal signals when WLPs were displaying threatening behaviors; whereas the lower the sender's social rank, the greater the production of multimodal signals when displaying submission behaviors. Multimodal signals elicited more non-aggressive responses than did the unimodal signals when displaying a threat. Moreover, the higher the sender's social rank, the greater the occurrence of non-aggressive responses to multimodal signals when displaying a threat; whereas the opposite occurred when displaying submission. Our findings support the 'multiple messages' hypothesis to explain the function of multimodal signaling during agonistic interactions in WLPs. Additionally, both the production of, and responses to, multimodal signals are related to the sender's social rank. These results allow us to suggest that the production of multimodal signals may have a key role in mitigating conflict and thus promoting group cohesion among white-lipped peccaries.

Dialects in leaf-clipping and other leaf-modifying gestures between neighbouring communities of East African chimpanzees

Dialects are a cultural property of animal communication previously described in the signals of several animal species. While dialects have predominantly been described in vocal signals, chimpanzee leaf-clipping and other 'leaf-modifying' gestures, used across chimpanzee and bonobo communities, have been suggested as a candidate for cultural variation in gestural communication. Here we combine direct observation with archaeological techniques to compare the form and use of leaf-modifying gestures in two neighbouring communities of East African chimpanzees. We found that while both communities used multiple forms, primarily within sexual solicitation, they showed a strong preference for a single, different gesture form. The observed variation in form preference between these neighbouring communities within the same context suggests that these differences are, at least in part, socially derived. Our results highlight an unexplored source of variation and flexibility in gestural communication, opening the door for future research to explore socially derived dialects in non-vocal communication.

Turn-taking skills in mammals: A systematic review into development and acquisition

How human language evolved remains one of the most intriguing questions in science, and different approaches have been used to tackle this question. A recent hypothesis, the Interaction Engine Hypothesis, postulates that language was made possible through the special capacity for social interaction involving different social cognitive skills (e.g., joint attention, common ground) and specific characteristics such as face-to-face interaction, mutual gaze and turn-taking, the exchange of rapid communicative turns. Recently, it has been argued that this turn-taking infrastructure may be a foundational and ancient mechanism of the layered system of language because communicative turn-taking has been found in human infants and across several non-human primate species. Moreover, there is some evidence for turn-taking in different mammalian taxa, especially those capable of vocal learning. Surprisingly, however, the existing studies have mainly focused on turn-taking production of adult individuals, while little is known about its emergence and development in young individuals. Hence, the aim of the current paper was 2-fold: First, we carried out a systematic review of turn-taking development and acquisition in mammals to evaluate possible research bias and existing gaps. Second, we highlight research avenues to spur more research into this domain and investigate if distinct turn-taking elements can be found in other non-human animal species. Since mammals exhibit an extended development period, including learning and strong parental care, they represent an excellent model group in which to investigate the acquisition and development of turn-taking abilities. We performed a systematic review including a wide range of terms and found 21 studies presenting findings on turn-taking abilities in infants and juveniles. Most of these studies were from the last decade, showing an increased interest in this field over the years. Overall, we found a considerable variation in the terminologies and methodological approaches used. In addition, studies investigating turn-taking abilities across different development periods and in relation to different social partners were very rare, thereby hampering direct, systematic comparisons within and across species. Nonetheless, the results of some studies suggested that specific turn-taking elements are innate, while others are acquired during development (e.g., flexibility). Finally, we pinpoint fruitful research avenues and hypotheses to move the field of turn-taking development forward and improve our understanding of the impact of turn-taking on language evolution.

Variable expression of linguistic laws in ape gesture: a case study from chimpanzee sexual solicitation

Two language laws have been identified as consistent patterns shaping animal behaviour, both acting on the organizational level of communicative systems. Zipf's law of brevity describes a negative relationship between behavioural length and frequency. Menzerath's law defines a negative correlation between the number of behaviours in a sequence and average length of the behaviour composing it. Both laws have been linked with the information-theoretic principle of compression, which tends to minimize code length. We investigated their presence in a case study of male chimpanzee sexual solicitation gesture. We failed to find evidence supporting Zipf's law of brevity, but solicitation gestures followed Menzerath's law: longer sequences had shorter average gesture duration. Our results extend previous findings suggesting gesturing may be limited by individual energetic constraints. However, such patterns may only emerge in sufficiently large datasets. Chimpanzee gestural repertoires do not appear to manifest a consistent principle of compression previously described in many other close-range systems of communication. Importantly, the same signallers and signals were previously shown to adhere to these laws in subsets of the repertoire when used in play; highlighting that, in addition to selection on the signal repertoire, ape gestural expression appears shaped by factors in the immediate socio-ecological context.

My life with primates

In this paper I recall some of the significant moments of my career as a primatologist, including some of the intellectual conflicts I encountered between anthropology, sociology and zoology. From an initial interest in ethics and evolution, I undertook research on rhesus monkeys in captivity and then on chimpanzees in the wild. Influenced by Japanese primatology as well as Western approaches, this led to my work on the problems of describing primate behaviour, but this more theoretical approach was superseded by empirical work embodied in the founding of the Budongo Conservation Field Station. I describe the initial creation of the field station in 1990 and some of the research directions we have followed since that time. The paper ends with a focus on conservation, this being of increasing importance as the Budongo Forest faces ever increasing threats from industry.

The social dynamics of complex gestural communication in great and lesser apes (Pan troglodytes, Pongo abelii, Symphalangus syndactylus)

Gestures play an essential role in primate communication. However, little is known about how complexity of gestural use (in terms of repertoire size, intentional use, flexibility and use of gestural sequences) relates to individual and dyadic measures of sociality and whether more complex gestural use is more effective in eliciting a response. We observed 19 captive chimpanzees (Pan troglodytes), 16 Sumatran orangutans (Pongo abelii) and 18 siamangs (Symphalangus syndactylus) to assess the complexity and effectiveness of their gestural use. We found that, beyond interspecies variation, the number of gesture types used in a dyad was higher when individuals had stronger social bonds; the probability of accounting for others' attention increased with age, especially for visual gestures; and sequences were more likely used by younger or socially less integrated individuals. In terms of effectiveness, older individuals and those using fewer sequences were more likely to be responded to, while across dyads, the probability of obtaining a response was higher when both individuals accounted for the other's attention and when they used fewer sequences. Overall, this confirms the link between sociality and complex gestural use and suggests that more complex forms of communication, at least in terms of intentional use, may be more effective at achieving communicative goals. This article is part of the theme issue 'Cognition, communication and social bonds in primates'.

Are ape gestures like words? Outstanding issues in detecting similarities and differences between human language and ape gesture

Opinion piece: ape gestures are made intentionally, inviting parallels with human language; but how similar are their gestures to words? Here we ask this in three ways, considering: flexibility and ambiguity, first- and second-order intentionality, and usage in interactive exchanges. Many gestures are used to achieve several, often very distinct, goals. Such apparent ambiguity in meaning is potentially disruptive for communication, but-as with human language-situational and interpersonal context may largely resolve the intended meaning. Our evidence for first-order intentional use of gesture is abundant, but how might we establish a case for the second-order intentional use critical to language? Finally, words are rarely used in tidy signal-response sequences but are exchanged in back-and-forth interaction. Do gestures share this property? In this paper, we examine these questions and set out ways in which they can be resolved, incorporating data from wild chimpanzees. This article is part of the theme issue 'Cognition, communication and social bonds in primates'.

Visual bodily signals as core devices for coordinating minds in interaction

The view put forward here is that visual bodily signals play a core role in human communication and the coordination of minds. Critically, this role goes far beyond referential and propositional meaning. The human communication system that we consider to be the explanandum in the evolution of language thus is not spoken language. It is, instead, a deeply multimodal, multilayered, multifunctional system that developed-and survived-owing to the extraordinary flexibility and adaptability that it endows us with. Beyond their undisputed iconic power, visual bodily signals (manual and head gestures, facial expressions, gaze, torso movements) fundamentally contribute to key pragmatic processes in modern human communication. This contribution becomes particularly evident with a focus that includes non-iconic manual signals, non-manual signals and signal combinations. Such a focus also needs to consider meaning encoded not just via iconic mappings, since kinematic modulations and interaction-bound meaning are additional properties equipping the body with striking pragmatic capacities. Some of these capacities, or its precursors, may have already been present in the last common ancestor we share with the great apes and may qualify as early versions of the components constituting the hypothesized interaction engine. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

Great ape communication as contextual social inference: a computational modelling perspective

Human communication has been described as a contextual social inference process. Research into great ape communication has been inspired by this view to look for the evolutionary roots of the social, cognitive and interactional processes involved in human communication. This approach has been highly productive, yet it is partly compromised by the widespread focus on how great apes use and understand individual signals. This paper introduces a computational model that formalizes great ape communication as a multi-faceted social inference process that integrates (a) information contained in the signals that make up an utterance, (b) the relationship between communicative partners and (c) the social context. This model makes accurate qualitative and quantitative predictions about real-world communicative interactions between semi-wild-living chimpanzees. When enriched with a pragmatic reasoning process, the model explains repeatedly reported differences between humans and great apes in the interpretation of ambiguous signals (e.g. pointing or iconic gestures). This approach has direct implications for observational and experimental studies of great ape communication and provides a new tool for theorizing about the evolution of uniquely human communication. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

Revisiting the human 'interaction engine': comparative approaches to social action coordination

The evolution of language was likely facilitated by a special predisposition for social interaction, involving a set of communicative and cognitive skills summarized as the 'interaction engine'. This assemblage seems to emerge early in development, to be found universally across cultures, and to enable participation in sophisticated joint action through the addition of spoken language. Yet, new evidence on social action coordination and communication in nonhuman primates warrants an update of the interaction engine hypothesis, particularly with respect to the evolutionary origins of its specific ingredients. However, one enduring problem for comparative research results from a conceptual gulf between disciplines, rendering it difficult to test concepts derived from human interaction research in nonhuman animals. The goal of this theme issue is to make such concepts accessible for comparative research, to promote a fruitful interdisciplinary debate on social action coordination as a new arena of research, and to enable mutual fertilization between human and nonhuman interaction research. In consequence, we here consider relevant theoretical and empirical research within and beyond this theme issue to revisit the interaction engine's shared, convergently derived and uniquely derived ingredients preceding (or perhaps in the last case, succeeding) human language. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

Call combinations in chimpanzees: a social tool?

A growing body of evidence suggests the capacity for animals to combine calls into larger communicative structures is more common than previously assumed. Despite its cross-taxa prevalence, little is known regarding the evolutionary pressures driving such combinatorial abilities. One dominant hypothesis posits that social complexity and vocal complexity are linked, with changes in social structuring (e.g., group size) driving the emergence of ever-more complex vocal abilities, such as call sequencing. In this paper, we tested this hypothesis through investigating combinatoriality in the vocal system of the highly social chimpanzee. Specifically, we predicted combinatoriality to be more common in socially-driven contexts and in females and lower-ranked males (socially challenging contexts and socially challenged individuals respectively). Firstly, through applying methods from computational linguistics (i.e., collocation analyses), we built an objective repertoire of combinatorial structures in this species. Second, we investigated what potential factors influenced call combination production. We show that combinatoriality is predominant in 1) social contexts vs. non-social contexts, 2) females vs. males, and 3) negatively correlates with male rank. Together, these results suggest one function of combinatoriality in chimpanzees may be to help individuals navigate their dynamic social world. More generally, we argue these findings provide support for the hypothesized link between social and vocal complexity and can provide insight into the evolution of our own highly combinatorial communication system, language.

Compositionality in Primate Gestural Communication and Multicomponent Signal Displays

Compositionality is the ability to combine meaningful elements into new combinations with novel meanings, and it has long been considered one of the main hallmarks of human communication. However, very few studies have addressed the compositional aspects of communication in species other than humans, although a comparative approach is essential to understand the evolutionary origins of human compositionality. We review previous research on compositionality in the gestural communication systems of nonhuman primates, with a special focus on the multicomponent aspects of compositionality. We start by discussing the importance of a comparative approach to study the evolution of human language and then compare the current state of the art on compositionality in the vocal, facial, and gestural communication systems of primates and other species. We further discuss alternative approaches to study compositionality in primates, which may help overcome some of the current methodological limitations in this research area. In particular, we 1) highlight the importance of interdisciplinary tools that facilitate the statistical identification of multicomponent and multimodal combinations of signals, 2) discuss different approaches to infer the meaning of signal combinations, with a special focus on the use of contextual cues and meta-communication, and 3) discuss temporal and intentional aspects of compositionality in primates. Finally, we outline possible lines of research for future studies in this area (e.g., more consistent use of terms across research areas, use of different methodological tools and larger datasets, inclusion of developmental approaches), which might shed light into the evolutionary origins of one of the most crucial properties of human communication.

The function and evolution of child-directed communication

Humans communicate with small children in unusual and highly conspicuous ways (child-directed communication (CDC)), which enhance social bonding and facilitate language acquisition. CDC-like inputs are also reported for some vocally learning animals, suggesting similar functions in facilitating communicative competence. However, adult great apes, our closest living relatives, rarely signal to their infants, implicating communication surrounding the infant as the main input for infant great apes and early humans. Given cross-cultural variation in the amount and structure of CDC, we suggest that child-surrounding communication (CSC) provides essential compensatory input when CDC is less prevalent-a paramount topic for future studies.

A socio-ecological perspective on the gestural communication of great ape species, individuals, and social units

Over the last 30 years, most research on non-human primate gestural communication has been produced by psychologists, which has shaped the questions asked and the methods used. These researchers have drawn on concepts from philosophy, linguistics, anthropology, and ethology, but despite these broad influences the field has neglected to situate gestures into the socio-ecological context in which the diverse species, individuals, and social-units exist. In this review, we present current knowledge about great ape gestural communication in terms of repertoires, meanings, and development. We fold this into a conversation about variation in other types of ape social behaviour to identify areas for future research on variation in gestural communication. Given the large variation in socio-ecological factors across species and social-units (and the individuals within these groups), we may expect to find different preferences for specific gesture types; different needs for communicating specific meanings; and different rates of encountering specific contexts. New tools, such as machine-learning based automated movement tracking, may allow us to uncover potential variation in the speed and form of gesture actions or parts of gesture actions. New multi-group multi-generational datasets provide the opportunity to apply analyses, such as Bayesian modelling, which allows us to examine these rich behavioural landscapes. Together, by expanding our questions and our methods, researchers may finally be able to study great ape gestures from the perspective of the apes themselves and explore what this gestural communication system reveals about apes’ thinking and experience of their world.

The face is central to primate multicomponent signals

A wealth of experimental and observational evidence suggests that faces have become increasingly important in the communication system of primates over evolutionary time and that both the static and moveable aspects of faces convey considerable information. Therefore, whenever there is a visual component to any multicomponent signal the face is potentially relevant. However, the role of the face is not always considered in primate multicomponent communication research. We review the literature and make a case for greater focus on the face going forward. We propose that the face can be overlooked for two main reasons: first, due to methodological difficulty. Examination of multicomponent signals in primates is difficult, so scientists tend to examine a limited number of signals in combination. Detailed examination of the subtle and dynamic components of facial signals is particularly hard to achieve in studies of primates. Second, due to a common assumption that the face contains “emotional” content. A priori categorisation of facial behavior as “emotional” ignores the potentially communicative and predictive information present in the face that might contribute to signals. In short, we argue that the face is central to multicomponent signals (and also many multimodal signals) and suggest future directions for investigating this phenomenon.

Operationalizing Intentionality in Primate Communication: Social and Ecological Considerations

An intentional transfer of information is central to human communication. When comparing nonhuman primate communication systems to language, a critical challenge is to determine whether a signal is used in intentional, goal-oriented ways. As it is not possible to directly observe psychological states in any species, comparative researchers have inferred intentionality via behavioral markers derived from studies on prelinguistic human children. Recent efforts to increase consistency in nonhuman primate communication studies undervalue the effect of possible sources of bias: some behavioral markers are not generalizable across certain signal types (gestures, vocalizations, and facial expressions), contexts, settings, and species. Despite laudable attempts to operationalize first-order intentionality across signal types, a true “multimodal” approach requires integration across their sensory components (visual-silent, contact, audible), as a signal from a certain type can comprise more than one sensory component. Here we discuss how the study of intentional communication in nonlinguistic systems is hampered by issues of reliability, validity, consistency, and generalizability. We then highlight future research avenues that may help to understand the use of goal-oriented communication by opting, whenever possible, for reliable, valid, and consistent behavioral markers, but also taking into account sampling biases and integrating detailed observations of intraspecific communicative interactions.

Connecting primate gesture to the evolutionary roots of language: A systematic review

Comparative psychology provides important contributions to our understanding of the origins of human language. The presence of common features in human and nonhuman primate communication can be used to suggest the evolutionary trajectories of potential precursors to language. However, to do so effectively, our findings must be comparable across diverse species. This systematic review describes the current landscape of data available from studies of gestural communication in human and nonhuman primates that make an explicit connection to language evolution. We found a similar number of studies on human and nonhuman primates, but that very few studies included data from more than one species. As a result, evolutionary inferences remain restricted to comparison across studies. We identify areas of focus, bias, and apparent gaps within the field. Different domains have been studied in human and nonhuman primates, with relatively few nonhuman primate studies of ontogeny and relatively few human studies of gesture form. Diversity in focus, methods, and socio-ecological context fill important gaps and provide nuanced understanding, but only where the source of any difference between studies is transparent. Many studies provide some definition for their use of gesture; but definitions of gesture, and in particular, criteria for intentional use, are absent in the majority of human studies. We find systematic differences between human and nonhuman primate studies in the research scope, incorporation of other modalities, research setting, and study design. We highlight eight particular areas in a call to action through which we can strengthen our ability to investigate gestural communication's contribution within the evolutionary roots of human language.

More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension

The ecology of human language is face-to-face interaction, comprising cues such as prosody, co-speech gestures and mouth movements. Yet, the multimodal context is usually stripped away in experiments as dominant paradigms focus on linguistic processing only. In two studies we presented video-clips of an actress producing naturalistic passages to participants while recording their electroencephalogram. We quantified multimodal cues (prosody, gestures, mouth movements) and measured their effect on a well-established electroencephalographic marker of processing load in comprehension (N400). We found that brain responses to words were affected by informativeness of co-occurring multimodal cues, indicating that comprehension relies on linguistic and non-linguistic cues. Moreover, they were affected by interactions between the multimodal cues, indicating that the impact of each cue dynamically changes based on the informativeness of other cues. Thus, results show that multimodal cues are integral to comprehension, hence, our theories must move beyond the limited focus on speech and linguistic processing.

Multicomponent and multisensory communicative acts in orang-utans may serve different functions

From early infancy, human face-to-face communication is multimodal, comprising a plethora of interlinked communicative and sensory modalities. Although there is also growing evidence for this in nonhuman primates, previous research rarely disentangled production from perception of signals. Consequently, the functions of integrating articulators (i.e. production organs involved in multicomponent acts) and sensory channels (i.e. modalities involved in multisensory acts) remain poorly understood. Here, we studied close-range social interactions within and beyond mother-infant pairs of Bornean and Sumatran orang-utans living in wild and captive settings, to examine use of and responses to multicomponent and multisensory communication. From the perspective of production, results showed that multicomponent acts were used more than the respective unicomponent acts when the presumed goal did not match the dominant outcome for a specific communicative act, and were more common among non-mother-infant dyads and Sumatran orang-utans. From the perception perspective, we found that multisensory acts were more effective than the respective unisensory acts, and were used more in wild compared to captive populations. We argue that multisensory acts primarily facilitate effectiveness, whereas multicomponent acts become relevant when interaction outcomes are less predictable. These different functions underscore the importance of distinguishing between production and perception in studies of communication.

Emotion recognition in nonhuman primates: How experimental research can contribute to a better understanding of underlying mechanisms

Recognising conspecifics' emotional expressions is important for nonhuman primates to navigate their physical and social environment. We address two possible mechanisms underlying emotion recognition: emotional contagion, the automatic matching of the observer's emotions to the emotional state of the observed individual, and cognitive empathy, the ability to understand the meaning and cause of emotional expressions while maintaining a distinction between own and others' emotions. We review experimental research in nonhuman primates to gain insight into the evolution of emotion recognition. Importantly, we focus on how emotional contagion and cognitive empathy can be studied experimentally. Evidence for aspects of cognitive empathy in different nonhuman primate lineages suggests that a wider range of primates than commonly assumed can infer emotional meaning from emotional expressions. Possibly, analogous rather than homologous evolution underlies emotion recognition. However, conclusions regarding its exact evolutionary course require more research in different modalities and species.

Must all signals be evolved? A proposal for a new classification of communicative acts

While signals in evolutionary biology are usually defined as "acts or traits that have evolved because of their effect on others", work on gestures and vocalizations in various animal taxa have revealed population- or even individual-specific meanings of social signals. These results strongly suggest that communicative acts that are like signals with regard to both form and function (meaning) can also be acquired ontogenetically, and we discuss direct evidence for such plasticity in captive settings with rich opportunities for repeated social interactions with the same individuals. Therefore, in addition to evolved signals, we can recognize invented signals that are acquired during ontogeny (either through ontogenetic ritualization or social transmission). Thus, both gestures and vocalizations can be inventions or innate adaptations. We therefore propose to introduce innate versus invented signals as major distinct categories, with invented signals subdivided into dyad-specific and cultural signals. We suggest that elements of some signals may have mixed origins, and propose criteria to recognize acquired features of signals. We also suggest that invented signals may be most common in species with intentional communication, consistent with their ubiquity in humans, and that the ability to produce them was a necessary condition for the evolution of language. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Linguistics > Evolution of Language Psychology > Comparative Psychology.

Statistical learning for vocal sequence acquisition in a songbird

Birdsong is a learned communicative behavior that consists of discrete acoustic elements (“syllables”) that are sequenced in a controlled manner. While the learning of the acoustic structure of syllables has been extensively studied, relatively little is known about sequence learning in songbirds. Statistical learning could contribute to the acquisition of vocal sequences, and we investigated the nature and extent of sequence learning at various levels of song organization in the Bengalese finch, Lonchura striata var. domestica. We found that, under semi-natural conditions, pupils (sons) significantly reproduced the sequence statistics of their tutor’s (father’s) songs at multiple levels of organization (e.g., syllable repertoire, prevalence, and transitions). For example, the probability of syllable transitions at “branch points” (relatively complex sequences that are followed by multiple types of transitions) were significantly correlated between the songs of tutors and pupils. We confirmed the contribution of learning to sequence similarities between fathers and sons by experimentally tutoring juvenile Bengalese finches with the songs of unrelated tutors. We also discovered that the extent and fidelity of sequence similarities between tutors and pupils were significantly predicted by the prevalence of sequences in the tutor’s song and that distinct types of sequence modifications (e.g., syllable additions or deletions) followed distinct patterns. Taken together, these data provide compelling support for the role of statistical learning in vocal production learning and identify factors that could modulate the extent of vocal sequence learning.

Multimodality and the origin of a novel communication system in face-to-face interaction

Face-to-face communication is multimodal at its core: it consists of a combination of vocal and visual signalling. However, current evidence suggests that, in the absence of an established communication system, visual signalling, especially in the form of visible gesture, is a more powerful form of communication than vocalization and therefore likely to have played a primary role in the emergence of human language. This argument is based on experimental evidence of how vocal and visual modalities (i.e. gesture) are employed to communicate about familiar concepts when participants cannot use their existing languages. To investigate this further, we introduce an experiment where pairs of participants performed a referential communication task in which they described unfamiliar stimuli in order to reduce reliance on conventional signals. Visual and auditory stimuli were described in three conditions: using visible gestures only, using non-linguistic vocalizations only and given the option to use both (multimodal communication). The results suggest that even in the absence of conventional signals, gesture is a more powerful mode of communication compared with vocalization, but that there are also advantages to multimodality compared to using gesture alone. Participants with an option to produce multimodal signals had comparable accuracy to those using only gesture, but gained an efficiency advantage. The analysis of the interactions between participants showed that interactants developed novel communication systems for unfamiliar stimuli by deploying different modalities flexibly to suit their needs and by taking advantage of multimodality when required.

A stepping stone to compositionality in chimpanzee communication

Compositionality refers to a structural property of human language, according to which the meaning of a complex expression is a function of the meaning of its parts and the way they are combined. Compositionality is a defining characteristic of all human language, spoken and signed. Comparative research into the emergence of human language aims at identifying precursors to such key features of human language in the communication of other primates. While it is known that chimpanzees, our closest relatives, produce a variety of gestures, facial expressions and vocalizations in interactions with their group members, little is known about how these signals combine simultaneously. Therefore, the aim of the current study is to investigate whether there is evidence for compositional structures in the communication of chimpanzees. We investigated two semi-wild groups of chimpanzees, with focus on their manual gestures and their combinations with facial expressions across different social contexts. If there are compositional structures in chimpanzee communication, adding a facial expression to a gesture should convey a different message than the gesture alone, a difference that we expect to be measurable by the recipient's response. Furthermore, we expect context-dependent usage of these combinations. Based on a form-based coding procedure of the collected video footage, we identified two frequently used manual gestures (stretched arm gesture and bent arm gesture) and two facial expression (bared teeth face and funneled lip face). We analyzed whether the recipients' response varied depending on the signaler's usage of a given gesture + face combination and the context in which these were used. Overall, our results suggest that, in positive contexts, such as play or grooming, specific combinations had an impact on the likelihood of the occurrence of particular responses. Specifically, adding a bared teeth face to a gesture either increased the likelihood of affiliative behavior (for stretched arm gesture) or eliminated the bias toward an affiliative response (for bent arm gesture). We show for the first time that the components under study are recombinable, and that different combinations elicit different responses, a property that we refer to as componentiality. Yet our data do not suggest that the components have consistent meanings in each combination-a defining property of compositionality. We propose that the componentiality exhibited in this study represents a necessary stepping stone toward a fully evolved compositional system.

A gestural repertoire of 1- to 2-year-old human children: in search of the ape gestures

When we compare human gestures to those of other apes, it looks at first like there is nothing much to compare at all. In adult humans, gestures are thought to be a window into the thought processes accompanying language, and sign languages are equal to spoken language with all of its features. Some research firmly emphasises the differences between human gestures and those of other apes; however, the question about whether there are any commonalities is rarely investigated, and has mostly been confined to pointing gestures. The gestural repertoires of nonhuman ape species have been carefully studied and described with regard to their form and function-but similar approaches are much rarer in the study of human gestures. This paper applies the methodology commonly used in the study of nonhuman ape gestures to the gestural communication of human children in their second year of life. We recorded (n = 13) children's gestures in a natural setting with peers and caregivers in Germany and Uganda. Children employed 52 distinct gestures, 46 (89%) of which are present in the chimpanzee repertoire. Like chimpanzees, they used them both singly, and in sequences, and employed individual gestures flexibly towards different goals.

Gestural acquisition in great apes: the Social Negotiation Hypothesis

Scientific interest in the acquisition of gestural signalling dates back to the heroic figure of Charles Darwin. More than a hundred years later, we still know relatively little about the underlying evolutionary and developmental pathways involved. Here, we shed new light on this topic by providing the first systematic, quantitative comparison of gestural development in two different chimpanzee (Pan troglodytes verus and Pan troglodytes schweinfurthii) subspecies and communities living in their natural environments. We conclude that the three most predominant perspectives on gestural acquisition-Phylogenetic Ritualization, Social Transmission via Imitation, and Ontogenetic Ritualization-do not satisfactorily explain our current findings on gestural interactions in chimpanzees in the wild. In contrast, we argue that the role of interactional experience and social exposure on gestural acquisition and communicative development has been strongly underestimated. We introduce the revised Social Negotiation Hypothesis and conclude with a brief set of empirical desiderata for instigating more research into this intriguing research domain.

Multimodal communication and language origins: integrating gestures and vocalizations

The presence of divergent and independent research traditions in the gestural and vocal domains of primate communication has resulted in major discrepancies in the definition and operationalization of cognitive concepts. However, in recent years, accumulating evidence from behavioural and neurobiological research has shown that both human and non-human primate communication is inherently multimodal. It is therefore timely to integrate the study of gestural and vocal communication. Herein, we review evidence demonstrating that there is no clear difference between primate gestures and vocalizations in the extent to which they show evidence for the presence of key language properties: intentionality, reference, iconicity and turn-taking. We also find high overlap in the neurobiological mechanisms producing primate gestures and vocalizations, as well as in ontogenetic flexibility. These findings confirm that human language had multimodal origins. Nonetheless, we note that in great apes, gestures seem to fulfil a carrying (i.e. predominantly informative) role in close-range communication, whereas the opposite holds for face-to-face interactions of humans. This suggests an evolutionary shift in the carrying role from the gestural to the vocal stream, and we explore this transition in the carrying modality. Finally, we suggest that future studies should focus on the links between complex communication, sociality and cooperative tendency to strengthen the study of language origins.

Gestural repertoire size is associated with social proximity measures in wild chimpanzees

Studying the communication systems of primates can provide insights into the evolutionary origins of human language. Some theories propose that language evolved to help meet the demands of managing complex social relationships. Examining the associations between sociality and communication in the great apes can help to identify the specific selection pressures that may have been important for language evolution. In particular, gestural communication is believed to be important because it is a relatively recent trait seen only in primates and particularly in the great apes. However, the extent to which more complex gestural communication plays a role in managing social relationships, as compared to less complex gestural communication, is not well understood. Using social network analysis, we examined the association between complex gesturing (indexed as repertoire size) and complexity of social relationships indexed as proximity (the duration of time spent within 10 m, per hour spent in same party) in wild chimpanzees (Pan troglodytes schweinfurthii). Repertoire size (the total number of gesture types a focal subject produced toward other individuals) and dyadic repertoire size (the number of gesture types produced toward the dyad partner, per hour spent within 10 meters) were positively associated with proximity at the level of the group (centrality in the proximity network) and the dyad (proximity duration between dyads), respectively. Further, the repertoire size of visual and auditory short-range gestures was positively associated with proximity, while the repertoire size of tactile gesture was negatively associated with proximity. Overall these results suggest that gestural repertoire size has important implications for maintaining social relationships in wild chimpanzees and more broadly that gestural communication may have played an important role in language evolution.

Persistence in gestural communication predicts sociality in wild chimpanzees

A key challenge for primates is coordinating behaviour with conspecifics in large, complex social groups. Gestures play a key role in this process and chimpanzees show considerable flexibility communicating through single gestures, sequences of gestures interspersed with periods of response waiting (persistence), and rapid sequences where gestures are made in quick succession, too rapid for the response waiting to have occurred. The previous studies examined behavioural reactions to single gestures and sequences, but whether this complexity is associated with more complex sociality at the level of the dyad partner and the group as a whole is not well understood. We used social network analysis to examine how the production of single gestures and sequences of gestures was related to the duration of time spent in proximity and individual differences in proximity in wild East African chimpanzees (Pan troglodytes schweinfurthii). Pairs of chimpanzees that spent a longer duration of time in proximity had higher rates of persistence sequences, but not a higher rate of single gestures or rapid sequences. The duration of time spent in proximity was also related to the rate of responding to gestures, and response to gesture by activity change. These results suggest that communicative persistence and the type of response to gestures may play an important role in regulating social interactions in primate societies.