The emergence of systematicity: How environmental and communicative factors shape a novel communication system

Systematic mappings of sound to meaning: A theoretical review

The form of a word sometimes conveys semantic information. For example, the iconic word gurgle sounds like what it means, and busy is easy to identify as an English adjective because it ends in -y. Such links between form and meaning matter because they help people learn and use language. But gurgle also sounds like gargle and burble, and the -y in busy is morphologically and etymologically unrelated to the -y in crazy and watery. Whatever processing effects gurgle and busy have in common likely stem not from iconic, morphological, or etymological relationships but from systematicity more broadly: the phenomenon whereby semantically related words share a phonological or orthographic feature. In this review, we evaluate corpus evidence that spoken languages are systematic (even when controlling for iconicity, morphology, and etymology) and experimental evidence that systematicity impacts word processing (even in lieu of iconic, morphological, and etymological relationships). We conclude by drawing attention to the relationship between systematicity and low-frequency words and, consequently, the role that systematicity plays in natural language processing.

Iconicity ratings for 14,000+ English words

Iconic words and signs are characterized by a perceived resemblance between aspects of their form and aspects of their meaning. For example, in English, iconic words include peep and crash, which mimic the sounds they denote, and wiggle and zigzag, which mimic motion. As a semiotic property of words and signs, iconicity has been demonstrated to play a role in word learning, language processing, and language evolution. This paper presents the results of a large-scale norming study for more than 14,000 English words conducted with over 1400 American English speakers. We demonstrate the utility of these ratings by replicating a number of existing findings showing that iconicity ratings are related to age of acquisition, sensory modality, semantic neighborhood density, structural markedness, and playfulness. We discuss possible use cases and limitations of the rating dataset, which is made publicly available.

On the semiotic and material constraints of ideographies

Despite obvious advantages, no generalised ideographic codes have evolved through cultural evolution to rely on iconicity. Morin suggests that this is because of missing means of standardisation, which glottographic codes get from natural languages. Although we agree, we also point to the important role of the available media, which might support some forms of reference more effectively than others.

Self-Repair Increases Referential Coordination

When interlocutors repeatedly describe referents to each other, they rapidly converge on referring expressions which become increasingly systematized and abstract as the interaction progresses. Previous experimental research suggests that interactive repair mechanisms in dialogue underpin convergence. However, this research has so far only focused on the role of other-initiated repair and has not examined whether self-initiated repair might also play a role. To investigate this question, we report the results from a computer-mediated maze task experiment. In this task, participants communicate with each other via an experimental chat tool, which selectively transforms participants' private turn-revisions into public self-repairs that are made visible to the other participant. For example, if a participant, A, types "On the top square," and then before sending, A revises the turn to "On the top row," the server automatically detects the revision and transforms the private turn-revisions into a public self-repair, for example, "On the top square umm I meant row." Participants who received these transformed turns used more abstract and systematized referring expressions, but performed worse at the task. We argue that this is due to the artificial self-repairs causing participants to put more effort into diagnosing and resolving the referential coordination problems they face in the task, yielding better grounded spatial semantics and consequently increased use of abstract referring expressions.

Gaps in the Lexicon Restrict Communication

Across languages, words carve up the world of experience in different ways. For example, English lacks an equivalent to the Chinese superordinate noun tiáowèipǐn, which is loosely translated as "ingredients used to season food while cooking." Do such differences matter? A conventional label may offer a uniquely effective way of communicating. On the other hand, lexical gaps may be easily bridged by the compositional power of language. After all, most of the ideas we want to express do not map onto simple lexical forms. We conducted a referential Director/Matcher communication task with adult speakers of Chinese and English. Directors provided a clue that Matchers used to select words from a word grid. The three target words corresponded to a superordinate term (e.g., beverages) in either Chinese or English but not both. We found that Matchers were more accurate at choosing the target words when their language lexicalized the target category. This advantage was driven entirely by the Directors' use/non-use of the intended superordinate term. The presence of a conventional superordinate had no measurable effect on speakers' within- or between-category similarity ratings. These results show that the ability to rely on a conventional term is surprisingly important despite the flexibility languages offer to communicate about non-lexicalized categories.

Aerosols, airflow, and more: examining the interaction of speech and the physical environment

We describe ongoing efforts to better understand the interaction of spoken languages and their physical environments. We begin by briefly surveying research suggesting that languages evolve in ways that are influenced by the physical characteristics of their environments, however the primary focus is on the converse issue: how speech affects the physical environment. We discuss the speech-based production of airflow and aerosol particles that are buoyant in ambient air, based on some of the results in the literature. Most critically, we demonstrate a novel method used to capture aerosol, airflow, and acoustic data simultaneously. This method captures airflow data via a pneumotachograph and aerosol data via an electrical particle impactor. The data are collected underneath a laminar flow hood while participants breathe pure air, thereby eliminating background aerosol particles and isolating those produced during speech. Given the capabilities of the electrical particle impactor, which has not previously been used to analyze speech-based aerosols, the method allows for the detection of aerosol particles at temporal and physical resolutions exceeding those evident in the literature, even enabling the isolation of the role of individual sound types in the production of aerosols. The aerosols detected via this method range in size from 70 nanometers to 10 micrometers in diameter. Such aerosol particles are capable of hosting airborne pathogens. We discuss how this approach could ultimately yield data that are relevant to airborne disease transmission and offer preliminary results that illustrate such relevance. The method described can help uncover the actual articulatory gestures that generate aerosol emissions, as exemplified here through a discussion focused on plosive aspiration and vocal cord vibration. The results we describe illustrate in new ways the unseen and unheard ways in which spoken languages interact with their physical environments.

Visual resemblance and interaction history jointly constrain pictorial meaning

How do drawings-ranging from detailed illustrations to schematic diagrams-reliably convey meaning? Do viewers understand drawings based on how strongly they resemble an entity (i.e., as images) or based on socially mediated conventions (i.e., as symbols)? Here we evaluate a cognitive account of pictorial meaning in which visual and social information jointly support visual communication. Pairs of participants used drawings to repeatedly communicate the identity of a target object among multiple distractor objects. We manipulated social cues across three experiments and a full replication, finding that participants developed object-specific and interaction-specific strategies for communicating more efficiently over time, beyond what task practice or a resemblance-based account alone could explain. Leveraging model-based image analyses and crowdsourced annotations, we further determined that drawings did not drift toward "arbitrariness," as predicted by a pure convention-based account, but preserved visually diagnostic features. Taken together, these findings advance psychological theories of how successful graphical conventions emerge.

Machine Impostors Can Avoid Human Detection and Interrupt the Formation of Stable Conventions by Imitating Past Interactions: A Minimal Turing Test

Interactions between humans and bots are increasingly common online, prompting some legislators to pass laws that require bots to disclose their identity. The Turing test is a classic thought experiment testing humans' ability to distinguish a bot impostor from a real human from exchanging text messages. In the current study, we propose a minimal Turing test that avoids natural language, thus allowing us to study the foundations of human communication. In particular, we investigate the relative roles of conventions and reciprocal interaction in determining successful communication. Participants in our task could communicate only by moving an abstract shape in a 2D space. We asked participants to categorize their online social interaction as being with a human partner or a bot impostor. The main hypotheses were that access to the interaction history of a pair would make a bot impostor more deceptive and interrupt the formation of novel conventions between the human participants. Copying their previous interactions prevents humans from successfully communicating through repeating what already worked before. By comparing bots that imitate behavior from the same or a different dyad, we find that impostors are harder to detect when they copy the participants' own partners, leading to less conventional interactions. We also show that reciprocity is beneficial for communicative success when the bot impostor prevents conventionality. We conclude that machine impostors can avoid detection and interrupt the formation of stable conventions by imitating past interactions, and that both reciprocity and conventionality are adaptive strategies under the right circumstances. Our results provide new insights into the emergence of communication and suggest that online bots mining personal information, for example, on social media, might become indistinguishable from humans more easily.

Compositionality in Different Modalities: A View from Usage-Based Linguistics

The field of linguistics concerns itself with understanding the human capacity for language. Compositionality is a key notion in this research tradition. Compositionality refers to the notion that the meaning of a complex linguistic unit is a function of the meanings of its constituent parts. However, the question as to whether compositionality is a defining feature of human language is a matter of debate: usage-based and constructionist approaches emphasize the pervasive role of idiomaticity in language, and argue that strict compositionality is the exception rather than the rule. We review the major discussion points on compositionality from a usage-based point of view, taking both spoken and signed languages into account. In addition, we discuss theories that aim at accounting for the emergence of compositional language through processes of cultural transmission as well as the debate of whether animal communication systems exhibit compositionality. We argue for a view that emphasizes the analyzability of complex linguistic units, providing a template for accounting for the multimodal nature of human language.

Simultaneity as an Emergent Property of Efficient Communication in Language: A Comparison of Silent Gesture and Sign Language

Sign languages use multiple articulators and iconicity in the visual modality which allow linguistic units to be organized not only linearly but also simultaneously. Recent research has shown that users of an established sign language such as LIS (Italian Sign Language) use simultaneous and iconic constructions as a modality‐specific resource to achieve communicative efficiency when they are required to encode informationally rich events. However, it remains to be explored whether the use of such simultaneous and iconic constructions recruited for communicative efficiency can be employed even without a linguistic system (i.e., in silent gesture) or whether they are specific to linguistic patterning (i.e., in LIS). In the present study, we conducted the same experiment as in Slonimska et al. (2020) with 23 Italian speakers using silent gesture and compared the results of the two studies. The findings showed that while simultaneity was afforded by the visual modality to some extent, its use in silent gesture was nevertheless less frequent and qualitatively different than when used within a linguistic system. Thus, the use of simultaneous and iconic constructions for communicative efficiency constitutes an emergent property of sign languages. The present study highlights the importance of studying modality‐specific resources and their use for linguistic expression in order to promote a more thorough understanding of the language faculty and its modality‐specific adaptive capabilities.

Semantics of European poetry is shaped by conservative forces: The relationship between poetic meter and meaning in accentual-syllabic verse

Recent advances in cultural analytics and large-scale computational studies of art, literature and film often show that long-term change in the features of artistic works happens gradually. These findings suggest that conservative forces that shape creative domains might be underestimated. To this end, we provide the first large-scale formal evidence of the association between poetic meter and semantics in 18-19th century European literatures, using Czech, German and Russian collections with additional data from English poetry and early modern Dutch songs. Our study traces this association through a series of unsupervised classifications using the abstracted semantic features of poems that are inferred for individual texts with the aid of topic modeling. Topics alone enable recognition of the meters in each observed language, as may be seen from the same-meter samples clustering together (median Adjusted Rand Index between 0.48 and 1 across traditions). In addition, this study shows that the strength of the association between form and meaning tends to decrease over time. This may reflect a shift in aesthetic conventions between the 18th and 19th centuries as individual innovation was increasingly favored in literature. Despite this decline, it remains possible to recognize semantics of the meters from past or future, which suggests the continuity in meter-meaning relationships while also revealing the historical variability of conditions across languages. This paper argues that distinct metrical forms, which are often copied in a language over centuries, also maintain long-term semantic inertia in poetry. Our findings highlight the role of the formal features of cultural items in influencing the pace and shape of cultural evolution.

The Seeds of the Noun–Verb Distinction in the Manual Modality: Improvisation and Interaction in the Emergence of Grammatical Categories

The noun–verb distinction has long been considered a fundamental property of human language, and has been found in some form even in the earliest stages of language emergence, including homesign and the early generations of emerging sign languages. We present two experimental studies that use silent gesture to investigate how noun–verb distinctions develop in the manual modality through two key processes: (i) improvising using novel signals by individuals, and (ii) using those signals in the interaction between communicators. We operationalise communicative interaction in two ways: a setting in which members of the dyad were in separate booths and were given a comprehension test after each stimulus vs. a more naturalistic face-to-face conversation without comprehension checks. There were few differences between the two conditions, highlighting the robustness of the paradigm. Our findings from both experiments reflect patterns found in naturally emerging sign languages. Some formal distinctions arise in the earliest stages of improvisation and do not require interaction to develop. However, the full range of formal distinctions between nouns and verbs found in naturally emerging language did not appear with either improvisation or interaction, suggesting that transmitting the language to a new generation of learners might be necessary for these properties to emerge.

How Language Learning and Language Use Create Linguistic Structure

Languages persist through a cycle of learning and use: You learn a language through immersion in the language used in your linguistic community, and in using language to communicate, you produce further linguistic data, which other people might learn from in turn. Languages change over historical time as a result of errors and innovations in these processes of learning and use; this article reviews experimental and computational methods that have been developed to test the hypothesis that those same processes of learning and use are responsible for creating the fundamental structural properties shared by all human languages, including some of the design features that make language such a powerful tool for communication.

Cultural Evolution of Precise and Agreed-Upon Semantic Conventions in a Multiplayer Gaming App

The amount of information conveyed by linguistic conventions depends on their precision, yet the codes that humans and other animals use to communicate are quite ambiguous: they may map several vague meanings to the same symbol. How does semantic precision evolve, and what are the constraints that limit it? We address this question using a multiplayer gaming app, where individuals communicate with one another in a scaled-up referential game. Here, the goal is for a sender to use black and white symbols to communicate colors. We expected that the players' mappings between symbols and colors would grow more specific over time, through a selection process whereby precise mappings are preferentially copied. We found that players become increasingly more precise in their use of symbols over the course of their interactions. This trend did not, however, result from selective copying of precise mappings. We explore the implications of this result for the study of lexical ambiguity, Zipf's Law of Meaning, and disagreements over semantic conventions.

New neighbours make bad fences: Form-based semantic shifts in word learning

The meanings of words sometimes shift towards those of similar-sounding words. For example, expunge is etymologically related to puncture but now connotes "wiping away," and according to the Oxford English Dictionary, this shift "is probably influenced by phonetic association with sponge." However, evidence for such form-based semantic shifts is anecdotal. We therefore conducted two experiments where participants learned novel words in sentence contexts (e.g., The boss embraiched the team's proposal, so they had to start over) and applied the inferred meanings to ambiguous sentences by providing ratings on a 7-point scale (e.g., Carol embraiched Gerald. How pleased was Gerald?). The inferred meanings of novel words that are spelt like existing words (e.g., embraich, like embrace) shifted towards the meanings of those existing words, relative to control novel words learned in identical contexts (e.g., fline; participants rated Gerald as more pleased to be embraiched than to be flined). These experiments provide the first evidence that newly learned words can indeed undergo form-based semantic shifts. We propose that shifts like these occur during word learning, when words activate rather than inhibit similar-sounding words, and we discuss why they seem to be more common in low-frequency words.

Conceptual Similarity and Communicative Need Shape Colexification: An Experimental Study

Colexification refers to the phenomenon of multiple meanings sharing one word in a language. Cross‐linguistic lexification patterns have been shown to be largely predictable, as similar concepts are often colexified. We test a recent claim that, beyond this general tendency, communicative needs play an important role in shaping colexification patterns. We approach this question by means of a series of human experiments, using an artificial language communication game paradigm. Our results across four experiments match the previous cross‐linguistic findings: all other things being equal, speakers do prefer to colexify similar concepts. However, we also find evidence supporting the communicative need hypothesis: when faced with a frequent need to distinguish similar pairs of meanings, speakadjust their colexification preferences to maintain communicative efficiency and avoid colexifying those similar meanings which need to be distinguished in communication. This research provides further evidence to support the argument that languages are shaped by the needs and preferences of their speakers.

The sounds of prehistoric speech

Evidence is reviewed for widespread phonological and phonetic tendencies in contemporary languages. The evidence is based largely on the frequency of sound types in word lists and in phoneme inventories across the world's languages. The data reviewed point to likely tendencies in the languages of the Upper Palaeolithic. These tendencies include the reliance on specific nasal and voiceless stop consonants, the relative dispreference for posterior voiced consonants and the use of peripheral vowels. More tenuous hypotheses related to prehistoric languages are also reviewed. These include the propositions that such languages lacked labiodental consonants and relied more heavily on vowels, when contrasted to many contemporary languages. Such hypotheses suggest speech has adapted to subtle pressures that may in some cases vary across populations. This article is part of the theme issue 'Reconstructing prehistoric languages'.

Iconicity and Diachronic Language Change

Iconicity, the resemblance between the form of a word and its meaning, has effects on behavior in both communicative symbol development and language learning experiments. These results have invited speculation about iconicity being a key feature of the origins of language, yet the presence of iconicity in natural languages seems limited. In a diachronic study of language change, we investigated the extent to which iconicity is a stable property of vocabulary, alongside previously investigated psycholinguistic predictors of change. Analyzing 784 English words with data on their historical forms, we found that stable words are higher in iconicity, longer in length, and earlier acquired during development, but that the role of frequency and grammatical category may be less important than previously suggested. Iconicity is revealed as a feature of ultra-conserved words and potentially also as a property of vocabulary early in the history of language origins.

Constructing a protolanguage: reconstructing prehistoric languages in a usage-based construction grammar framework

Construction grammar is an approach to language that posits that units and structures in language can be exhaustively described as pairings between form and meaning. These pairings are called constructions and can have different degrees of abstraction, i.e. they span the entire range from very concrete (armadillo, avocado) to very abstract constructions such as the ditransitive construction (I gave her a book). This approach has been applied to a wide variety of different areas of research in linguistics, such as how new constructions emerge and change historically. It has also been applied to investigate the evolutionary emergence of modern fully fledged language, i.e. the question of how systems of constructions can arise out of prelinguistic communication. In this paper, we review the contribution of usage-based construction grammar approaches to language change and language evolution to the questions of (i) the structure and nature of prehistoric languages and (ii) how constructions in prehistoric languages emerged out of non-linguistic or protolinguistic communication. In particular, we discuss the possibilities of using constructions as the main unit of analysis both in reconstructing predecessors of existing languages (protolanguages) and in formulating theories of how a potential predecessor of human language in general (protolanguage) must have looked like. This article is part of the theme issue 'Reconstructing prehistoric languages'.

Characterizing the Dynamics of Learning in Repeated Reference Games

The language we use over the course of conversation changes as we establish common ground and learn what our partner finds meaningful. Here we draw upon recent advances in natural language processing to provide a finer-grained characterization of the dynamics of this learning process. We release an open corpus (>15,000 utterances) of extended dyadic interactions in a classic repeated reference game task where pairs of participants had to coordinate on how to refer to initially difficult-to-describe tangram stimuli. We find that different pairs discover a wide variety of idiosyncratic but efficient and stable solutions to the problem of reference. Furthermore, these conventions are shaped by the communicative context: words that are more discriminative in the initial context (i.e., that are used for one target more than others) are more likely to persist through the final repetition. Finally, we find systematic structure in how a speaker's referring expressions become more efficient over time: Syntactic units drop out in clusters following positive feedback from the listener, eventually leaving short labels containing open-class parts of speech. These findings provide a higher resolution look at the quantitative dynamics of ad hoc convention formation and support further development of computational models of learning in communication.

Evolving artificial sign languages in the lab: From improvised gesture to systematic sign

Recent work on emerging sign languages provides evidence for how key properties of linguistic systems are created. Here we use laboratory experiments to investigate the contribution of two specific mechanisms-interaction and transmission-to the emergence of a manual communication system in silent gesturers. We show that the combined effects of these mechanisms, rather than either alone, maintain communicative efficiency, and lead to a gradual increase of regularity and systematic structure. The gestures initially produced by participants are unsystematic and resemble pantomime, but come to develop key language-like properties similar to those documented in newly emerging sign systems.