Common ground at the understanding of demonstrative reference

Are you thinking what I'm thinking? Perspective-taking in a language game

Many theories of communication claim that perspective-taking is a fundamental component of the successful design of utterances for a specific audience. In three experiments, we investigated perspective-taking in a constrained communication situation: Participants played a word guessing game where each trial required them to select a clue word to communicate a single target word to their partner. In many cases, the task requires participants to take the perspective of their partner when generating, evaluating, and selecting potential clue words. For example, if the target word was 'heart', the first word that came to mind might be 'love', but this would not in fact be a very useful clue word. Instead, a word like 'cardiovascular' is much more likely than 'love' to make the partner guess 'heart'. Pairs of participants took turns giving and receiving clues to guess target words, receiving feedback after each trial. In Experiment 1, participants appeared unable to improve their perspective-taking over repeated interactions, despite a baseline performance that suggested strong perspective-taking abilities. In Experiment 2, which included extensive feedback after each trial and only target words for which good clues existed and which required perspective-taking, some measures of perspective-taking showed modest improvements. In Experiment 3, which was conducted online, we used Experiment 2 feedback with Experiment 1 target words. As in Experiment 1, participants did not improve over the course of the game in Experiment 3. The results of these three experiments show quite strong limits on people's ability to adapt and improve perspective-taking without the context provided by interaction history and growing common ground.

Five-year-olds' sensitivity to knowledge discrepancies about object identity during online language comprehension

In everyday communication, children experience situations where their knowledge or perspectives differ from those of their communicative partner. The current study examined this issue in the context of real-time language comprehension, focusing on 5-year-old children's ability to manage knowledge discrepancies about the identity of mutually visible objects. In Experiment 1, we examined 5-year-olds' ability to manage privileged knowledge about an object's identity. Using a referential communication task, we tested children (N = 60) in either a shared knowledge condition, where both the child and the speaker knew the identity of a visually misleading object (e.g., a candle that looks like an apple), or a privileged knowledge condition, where only the child knew the identity of the visually misleading object. Of interest was whether children could suppress private knowledge while processing a phonologically related word (e.g., "Look at the candy"). Results showed that children did not inhibit this knowledge during the early moments of referential interpretation. In Experiment 2 (N = 30), we contrasted the privileged knowledge condition in Experiment 1 with the more traditional scenario used to test common ground use, where the child knows the speaker cannot see certain display objects. Results confirmed a stronger ability to manage discrepancies in the latter case. Together, the findings demonstrate differences in children's ability to manage distinct types of knowledge discrepancies during real-time language comprehension.

What's your point? Insights from virtual reality on the relation between intention and action in the production of pointing gestures

Human communication involves the process of translating intentions into communicative actions. But how exactly do our intentions surface in the visible communicative behavior we display? Here we focus on pointing gestures, a fundamental building block of everyday communication, and investigate whether and how different types of underlying intent modulate the kinematics of the pointing hand and the brain activity preceding the gestural movement. In a dynamic virtual reality environment, participants pointed at a referent to either share attention with their addressee, inform their addressee, or get their addressee to perform an action. Behaviorally, it was observed that these different underlying intentions modulated how long participants kept their arm and finger still, both prior to starting the movement and when keeping their pointing hand in apex position. In early planning stages, a neurophysiological distinction was observed between a gesture that is used to share attitudes and knowledge with another person versus a gesture that mainly uses that person as a means to perform an action. Together, these findings suggest that our intentions influence our actions from the earliest neurophysiological planning stages to the kinematic endpoint of the movement itself.

A New Look at Young Children's Referential Informativeness

In this article, I review experimental evidence for the dependence of 2- to 5-year-olds' linguistic referential informativeness on cues to common ground (CG) and propose a process model. Cues to CG provide evidence for CG, that is, for the shared knowledge, beliefs, and attitudes of interlocutors. The presence of cues to CG (e.g., unimpeded listener line of regard or prior mention) is shown to be associated with less informative reference (e.g., pronouns). In contrast, the absence of cues to CG (e.g., impeded listener line of regard or new mention) is shown to be associated with more informative reference (e.g., nouns). Informativeness is sensitive to linguistic before nonlinguistic cues to CG (i.e., 2.0 vs. 2.5 years old, respectively). Reference is cast as a process of active inference, a formulation of Bayesian belief-guided control in biological systems. Child speakers are hierarchical generative models that, characteristically, expect sensory evidence for the evolved, prior Bayesian belief that interlocutor mental states are aligned (i.e., that CG exists). Referential control emerges as an embodied tool to gather evidence for this prior belief. Bottom-up cues to CG elicited by action drive updates to beliefs about CG. In turn, beliefs about CG guide efficient referential control.

Affordance embeddings for situated language understanding

Much progress in AI over the last decade has been driven by advances in natural language processing technology, in turn facilitated by large datasets and increased computation power used to train large neural language models. These systems demonstrate apparently sophisticated linguistic understanding or generation capabilities, but often fail to transfer their skills to situations they have not encountered before. We argue that computational situated grounding of linguistic information to real or simulated scenarios provide a solution to some of these learning challenges by creating situational representations that both serve as a formal model of the salient phenomena, and contain rich amounts of exploitable, task-appropriate data for training new, flexible computational models. We approach this problem from a neurosymbolic perspective, using multimodal contextual modeling of interactive situations, events, and object properties, particularly afforded behaviors, and habitats, the situations that condition them. These properties are tightly coupled to processes of situated grounding, and herein we discuss we combine neural and symbolic methods with multimodal simulations to create a platform, VoxWorld, for modeling communication in context, and we demonstrate how neural embedding vectors of symbolically-encoded object affordances facilitate transferring knowledge of objects and situations to novel entities, and learning how to recognize and generate linguistic and gestural denotations.

Neural signatures associated with temporal compression in the verbal retelling of past events

When we retell our past experiences, we aim to reproduce some version of the original events; this reproduced version is often temporally compressed relative to the original. However, it is currently unclear how this compression manifests in brain activity. One possibility is that a compressed retrieved memory manifests as a neural pattern which is more dissimilar to the original, relative to a more detailed or vivid memory. However, we argue that measuring raw dissimilarity alone is insufficient, as it confuses a variety of interesting and uninteresting changes. To address this problem, we examine brain pattern changes that are consistent across people. We show that temporal compression in individuals’ retelling of past events predicts systematic encoding-to-recall transformations in several higher associative regions. These findings elucidate how neural representations are not simply reactivated, but can also be transformed due to temporal compression during a universal form of human memory expression: verbal retelling.

Brain patterns measured while participants first watched a movie in the fMRI scanner, then recalled the movie’s key narrative features, demonstrate that temporal compression in individuals’ retelling of past events predicts encoding-to-recall transformations.

Individual Differences in Indirect Speech Act Processing Found Outside the Language Network

Face-to-face communication requires skills that go beyond core language abilities. In dialogue, we routinely make inferences beyond the literal meaning of utterances and distinguish between different speech acts based on, e.g., contextual cues. It is, however, not known whether such communicative skills potentially overlap with core language skills or other capacities, such as theory of mind (ToM). In this functional magnetic resonance imaging (fMRI) study we investigate these questions by capitalizing on individual variation in pragmatic skills in the general population. Based on behavioral data from 199 participants, we selected participants with higher vs. lower pragmatic skills for the fMRI study (N = 57). In the scanner, participants listened to dialogues including a direct or an indirect target utterance. The paradigm allowed participants at the whole group level to (passively) distinguish indirect from direct speech acts, as evidenced by a robust activity difference between these speech acts in an extended language network including ToM areas. Individual differences in pragmatic skills modulated activation in two additional regions outside the core language regions (one cluster in the left lateral parietal cortex and intraparietal sulcus and one in the precuneus). The behavioral results indicate segregation of pragmatic skill from core language and ToM. In conclusion, contextualized and multimodal communication requires a set of interrelated pragmatic processes that are neurocognitively segregated: (1) from core language and (2) partly from ToM.

Referential communication in people with recent-onset schizophrenia-spectrum disorders

People with schizophrenia present with language production impairments, yet very few studies examine language production in the context of collaborative, verbal interaction tasks performed with a real interaction partner. The current study relied on a referential communication paradigm in which participants with schizophrenia (SZ) and healthy controls (HC) presented a series of movie characters to their interaction partner, whose role was to identify and place the characters in the same order. The HC spontaneously provided more information when presenting characters that their interaction partner was unlikely to know than when presenting very well-known characters, and the magnitude of this adjustment was positively correlated with their performance on a theory of mind task. In contrast, people with SZ showed a significantly reduced (absent) adjustment to the likely-known vs. likely-unknown nature of the characters, and no correlation emerged with ToM. Further examination of the verbal productions revealed that HC often combined movie-related information (ex: character's name or movie title) and descriptive information whereas people with SZ more often used description only to present the characters. Overall, this study adds to our knowledge about referential choices in SZ in the context of collaborative verbal interactions with a real interaction partner.

The active role of interpreters in medical discourse - An observational study in emergency medicine

OBJECTIVE

To study communicative tasks executed and related strategies used by patients, health professionals, and medical interpreters.

METHODS

English proficient and limited English proficient emergency department patients were observed. The content of patient-hospital staff communication was documented via pen and paper. Key themes and differences across interpreter types were established through qualitative analysis. Themes and differences across interpreter type were vetted and updated through member checking interviews.

RESULTS

6 English proficient and 9 limited English proficient patients were observed. Key themes in communicative tasks included: establishing, maintaining, updating, and repairing understanding and rapport. All tasks were observed with English proficient and limited English proficient patients. The difference with limited English proficient patients was that medical interpreters played an active role in completing communicative tasks. Telephone-based interpreters faced challenges in facilitating communicative tasks based on thematic comparisons with in-person interpreters, including issues hearing and lost information due to the lack of visual cues.

CONCLUSIONS

Professional interpreters play an important role in communication between language discordant patients and health professionals that goes beyond verbatim translation.

PRACTICAL IMPLICATIONS

Training for interpreters and health professionals, and the design of tools for facilitating language discordant communication, should consider the role of interpreters beyond verbatim translation.

A Survey of Domain Knowledge Elicitation in Applied Machine Learning

Eliciting knowledge from domain experts can play an important role throughout the machine learning process, from correctly specifying the task to evaluating model results. However, knowledge elicitation is also fraught with challenges. In this work, we consider why and how machine learning researchers elicit knowledge from experts in the model development process. We develop a taxonomy to characterize elicitation approaches according to the elicitation goal, elicitation target, elicitation process, and use of elicited knowledge. We analyze the elicitation trends observed in 28 papers with this taxonomy and identify opportunities for adding rigor to these elicitation approaches. We suggest future directions for research in elicitation for machine learning by highlighting avenues for further exploration and drawing on what we can learn from elicitation research in other fields.

Lexical Diversity, Lexical Sophistication, and Predictability for Speech in Multiple Listening Conditions

When talkers anticipate that a listener may have difficulty understanding their speech, they adopt a speaking style typically described as "clear speech." This speaking style includes a variety of acoustic modifications and has perceptual benefits for listeners. In the present study, we examine whether clear speaking styles also include modulation of lexical items selected and produced during naturalistic conversations. Our results demonstrate that talkers do, indeed, modulate their lexical selection, as measured by a variety of lexical diversity and lexical sophistication indices. Further, the results demonstrate that clear speech is not a monolithic construct. Talkers modulate their speech differently depending on the communication situation. We suggest that clear speech should be conceptualized as a set of speaking styles, in which talkers take the listener and communication situation into consideration.

A conceptual framework for the study of demonstrative reference

Language allows us to efficiently communicate about the things in the world around us. Seemingly simple words like this and that are a cornerstone of our capability to refer, as they contribute to guiding the attention of our addressee to the specific entity we are talking about. Such demonstratives are acquired early in life, ubiquitous in everyday talk, often closely tied to our gestural communicative abilities, and present in all spoken languages of the world. Based on a review of recent experimental work, here we introduce a new conceptual framework of demonstrative reference. In the context of this framework, we argue that several physical, psychological, and referent-intrinsic factors dynamically interact to influence whether a speaker will use one demonstrative form (e.g., this) or another (e.g., that) in a given setting. However, the relative influence of these factors themselves is argued to be a function of the cultural language setting at hand, the theory-of-mind capacities of the speaker, and the affordances of the specific context in which the speech event takes place. It is demonstrated that the framework has the potential to reconcile findings in the literature that previously seemed irreconcilable. We show that the framework may to a large extent generalize to instances of endophoric reference (e.g., anaphora) and speculate that it may also describe the specific form and kinematics a speaker's pointing gesture takes. Testable predictions and novel research questions derived from the framework are presented and discussed.

Reading between the lines: Listener's vmPFC simulates speaker cooperative choices in communication games

Humans have a remarkable ability to understand what is and is not being said by conversational partners. It has been hypothesized that listeners decode the intended meaning of a communicative signal by assuming speakers speak cooperatively, rationally simulating the speaker's choice process and inverting it to recover the speaker's most probable meaning. We investigated whether and how rational simulations of speakers are represented in the listener's brain, by combining referential communication games with functional neuroimaging. We show that listeners' ventromedial prefrontal cortex encodes the probabilistic inference of what a cooperative speaker should say given a communicative goal and context, even when such inferences are irrelevant for reference resolution. The listener's striatum encodes the amount of update on intended meaning, consistent with inverting a simulated mental model. These findings suggest a neural generative mechanism, subserved by the frontal-striatal circuits, that underlies our ability to understand communicative and, more generally, social actions.

Common Ground in Demonstrative Reference: The Case of Mano (Mande)

That demonstratives often have endophoric functions marking referents outside the physical space of interaction but accessible through cognition, especially memory, is well-known. These functions are often classified as independent from exophoric ones and are typically seen as secondary with respect to spatial deixis. However, data from multiple languages show that cognitive access to referents functions alongside of perceptual access, including vision. Cognitive access is enabled by prior interactions and prior familiarity with the referents. As a result of such interactions, the interlocutors share a great deal of knowledge about the referents, which facilitates reference to objects in the interactive field. The centrality of common ground in reference to an object at the interactive scene challenges the often assumed classification of demonstrative reference into exophoric and endophoric. I illustrate this idea throughout the paper by using first-hand data from Mano, a Mande language of Guinea. Adding another argument in favor of viewing demonstrative reference as a social, interactive process, the Mano data push the idea of salience of non-spatial parameters further and emphasizes the importance of short and long-term interactional history and cultural knowledge both for the choice of demonstratives in exophoric reference and for the structuring of the demonstrative paradigm.

Common Ground Information Affects Reference Resolution: Evidence From Behavioral Data, ERPs, and Eye-Tracking

One of the most important social cognitive skills in humans is the ability to “put oneself in someone else’s shoes,” that is, to take another person’s perspective. In socially situated communication, perspective taking enables the listener to arrive at a meaningful interpretation of what is said (sentence meaning) and what is meant (speaker’s meaning) by the speaker. To successfully decode the speaker’s meaning, the listener has to take into account which information he/she and the speaker share in their common ground (CG). We here further investigated competing accounts about when and how CG information affects language comprehension by means of reaction time (RT) measures, accuracy data, event-related potentials (ERPs), and eye-tracking. Early integration accounts would predict that CG information is considered immediately and would hence not expect to find costs of CG integration. Late integration accounts would predict a rather late and effortful integration of CG information during the parsing process that might be reflected in integration or updating costs. Other accounts predict the simultaneous integration of privileged ground (PG) and CG perspectives. We used a computerized version of the referential communication game with object triplets of different sizes presented visually in CG or PG. In critical trials (i.e., conflict trials), CG information had to be integrated while privileged information had to be suppressed. Listeners mastered the integration of CG (response accuracy 99.8%). Yet, slower RTs, and enhanced late positivities in the ERPs showed that CG integration had its costs. Moreover, eye-tracking data indicated an early anticipation of referents in CG but an inability to suppress looks to the privileged competitor, resulting in later and longer looks to targets in those trials, in which CG information had to be considered. Our data therefore support accounts that foresee an early anticipation of referents to be in CG but a rather late and effortful integration if conflicting information has to be processed. We show that both perspectives, PG and CG, contribute to socially situated language processing and discuss the data with reference to theoretical accounts and recent findings on the use of CG information for reference resolution.

Demonstratives in Spatial Language and Social Interaction: An Interdisciplinary Review

This paper offers a review of research on demonstratives from an interdisciplinary perspective. In particular, we consider the role of demonstratives in current research on language universals, language evolution, language acquisition, multimodal communication, signed language, language and perception, language in interaction, spatial imagery, and discourse processing. Traditionally, demonstratives are analyzed as a particular class of spatial deictics. Yet, a number of recent studies have argued that space is largely irrelevant to deixis and that demonstratives are primarily used for social and interactive purposes. Synthesizing findings in the literature, we conclude that demonstratives are a very special class of linguistic items that are foundational to both spatial and social aspects of language and cognition.

Possible Objects: Topological Approaches to Individuation

We think of the world around us as divided into physical objects like toasters and daisies, rather than solely as a smear of properties like yellow and smooth. How do we single out these objects? One theory of object concepts uses part-of relations and relations of connectedness. According to this proposal, an object is a connected spatial item of maximal extent: Any other connected item that overlaps (i.e., shares a part with) the object must be a part of that object. This article reports four experiments that test this proposal. Participants see descriptions or diagrams of spatial items that vary across trials in their relative positions. In separate experiments, participants decide whether the items are physical objects, whether they are wholes, or how many objects are present. All experiments find support for connectedness as a contributor to object status, but they find little support for maximality. The results suggest that maximality is not a necessary feature of wholes or of objects.

Deixis, Meta-Perceptive Gaze Practices, and the Interactional Achievement of Joint Attention

The paper investigates the use of gaze along with deictics and embodied pointing to accomplish reference and joint attention in naturally occurring social interaction. It assumes that deixis, in its primordial use in face-to-face interaction, is an embodied phenomenon that involves gestural pointing as well as visual perception, thus giving rise to recurring gaze practices of the participants. The analysis draws on a model of the interactional organization of deictic reference and joint attention that serves as a sequential framework for investigating the functions of eye gaze. The analysis focuses on two meta-perceptive practices: gaze following and gaze monitoring. It shows that the use of these practices in naturally occurring social activities is context dependent, positionally sensitive, tied to participant roles, and temporally fine-tuned to the stream of the participants' verbal and embodied conduct. The sequential analysis of these practices further documents that meta-perceptive gaze practices contribute to the constitution of joint attention as mutually known by the participants. The data for this study were recorded with two pairs of mobile eye tracking glasses and an external camera. Methodologically situated within the framework of conversation analysis and interactional linguistics where video recording is used, the study breaks new ground by employing a technology almost exclusively applied in experimental frameworks to record ordinary social activities "in the wild." In striving for ecologically valid and precise eye gaze data, it also contributes to a refinement of concepts developed in experimental paradigms by adapting them to qualitative research within the field of multimodal conversation analysis and interactional linguistics.

The Influence of Shared Visual Context on the Successful Emergence of Conventions in a Referential Communication Task

Human communication is thoroughly context bound. We present two experiments investigating the importance of the shared context, that is, the amount of knowledge two interlocutors have in common, for the successful emergence and use of novel conventions. Using a referential communication task where black-and-white pictorial symbols are used to convey colors, pairs of participants build shared conventions peculiar to their dyad without experimenter feedback, relying purely on ostensive-inferential communication. Both experiments demonstrate that access to the visual context promotes more successful communication. Importantly, success improves cumulatively, supporting the view that pairs establish conventional ways of using the symbols to communicate. Furthermore, Experiment 2 suggests that dyads with access to the visual context successfully adapt the conventions built for one color space to another color space, unlike dyads lacking it. In linking experimental pragmatics with language evolution, the study illustrates the benefits of exploring the emergence of linguistic conventions using an ostensive-inferential model of communication.

How Experts Adapt Their Gaze Behavior When Modeling a Task to Novices

Domain experts regularly teach novice students how to perform a task. This often requires them to adjust their behavior to the less knowledgeable audience and, hence, to behave in a more didactic manner. Eye movement modeling examples (EMMEs) are a contemporary educational tool for displaying experts’ (natural or didactic) problem‐solving behavior as well as their eye movements to learners. While research on expert‐novice communication mainly focused on experts’ changes in explicit, verbal communication behavior, it is as yet unclear whether and how exactly experts adjust their nonverbal behavior. This study first investigated whether and how experts change their eye movements and mouse clicks (that are displayed in EMMEs) when they perform a task naturally versus teach a task didactically. Programming experts and novices initially debugged short computer codes in a natural manner. We first characterized experts’ natural problem‐solving behavior by contrasting it with that of novices. Then, we explored the changes in experts’ behavior when being subsequently instructed to model their task solution didactically. Experts became more similar to novices on measures associated with experts’ automatized processes (i.e., shorter fixation durations, fewer transitions between code and output per click on the run button when behaving didactically). This adaptation might make it easier for novices to follow or imitate the expert behavior. In contrast, experts became less similar to novices for measures associated with more strategic behavior (i.e., code reading linearity, clicks on run button) when behaving didactically.

Electrophysiological investigation of infants' understanding of understanding

Social cognition might play a critical role in language acquisition and comprehension, as mindreading may be necessary to infer the intended meaning of linguistic expressions uttered by communicative partners. In three electrophysiological experiments, we explored the interplay between belief attribution and language comprehension of 14-month-old infants. First, we replicated our earlier finding: infants produced an N400 effect to correctly labelled objects when the labels did not match a communicative partner's beliefs about the referents. Second, we observed no N400 when we replaced the object with another category member. Third, when we named the objects incorrectly for infants, but congruently with the partner's false belief, we observed large N400 responses, suggesting that infants retained their own perspective in addition to that of the partner. We thus interpret the observed social N400 effect as a communicational expectancy indicator because it was contingent not on the attribution of false beliefs but on semantic expectations by both the self and the communicative partner. Additional exploratory analyses revealed an early, frontal, positive-going electrophysiological response in all three experiments, which was contingent on infants' computing the comprehension of the social partner based on attributed beliefs.

Using second-person neuroscience to elucidate the mechanisms of social interaction

Although a large proportion of our lives are spent participating in social interactions, the investigation of the neural mechanisms supporting these interactions has largely been restricted to situations of social observation - that is, situations in which an individual observes a social stimulus without opportunity for interaction. In recent years, efforts have been made to develop a truly social, or 'second-person', neuroscientific approach to these investigations in which neural processes are examined within the context of a real-time reciprocal social interaction. These developments have helped to elucidate the behavioural and neural mechanisms of social interactions; however, further theoretical and methodological innovations are still needed. Findings to date suggest that the neural mechanisms supporting social interaction differ from those involved in social observation and highlight a role of the so-called 'mentalizing network' as important in this distinction. Taking social interaction seriously may also be particularly important for the advancement of the neuroscientific study of different psychiatric conditions.

The Impact of a Human Figure in a Scene on Spatial Descriptions in Speech, Gesture, and Gesture Alone

The presence of a human figure in a scene appears to change how people describe it. About 20% of participants take the human figure's viewpoint (Tversky and Hard in Cognition 110:124-129, 2009. http://doi.org/10.1016/j.cognition.2008.10.008). Five exploratory studies compare descriptions of a scene with no person to descriptions of a scene with a person. About 20% of participants are predicted to use the person's point of view in the "person" conditions. Study 1 replicates the original pattern. Study 2 shows that the pattern holds when object/scene are changed, and that the figure's gaze towards/away from the object does not change the pattern. Studies 3 and 4 show the pattern holds when the object has different positions and when it is moving. Study 5 shows the pattern holds when the describer is talking to an interlocutor, in both speech and co-speech gesture, and when the person is using gesture alone. The presence of a human figure in a scene appears to be a robust variable in shaping spatial descriptions.

Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches

Crossmodal interaction in situated language comprehension is important for effective and efficient communication. The relationship between linguistic and visual stimuli provides mutual benefit: While vision contributes, for instance, information to improve language understanding, language in turn plays a role in driving the focus of attention in the visual environment. However, language and vision are two different representational modalities, which accommodate different aspects and granularities of conceptualizations. To integrate them into a single, coherent system solution is still a challenge, which could profit from inspiration by human crossmodal processing. Based on fundamental psycholinguistic insights into the nature of situated language comprehension, we derive a set of performance characteristics facilitating the robustness of language understanding, such as crossmodal reference resolution, attention guidance, or predictive processing. Artificial systems for language comprehension should meet these characteristics in order to be able to perform in a natural and smooth manner. We discuss how empirical findings on the crossmodal support of language comprehension in humans can be applied in computational solutions for situated language comprehension and how they can help to mitigate the shortcomings of current approaches.

Overinformative Speakers Are Cooperative: Revisiting the Gricean Maxim of Quantity

A pragmatic account of referential communication is developed which presents an alternative to traditional Gricean accounts by focusing on cooperativeness and efficiency, rather than informativity. The results of four language-production experiments support the view that speakers can be cooperative when producing redundant adjectives, doing so more often when color modification could facilitate the listener's search for the referent in the visual display (Experiment 1a). By contrast, when the listener knew which shape was the target, speakers did not produce redundant color adjectives (Experiment 1b). English speakers used redundant color adjectives more often than Spanish speakers, suggesting that speakers are sensitive to the differential efficiency of prenominal and postnominal modification (Experiment 2). Speakers were also cooperative when using redundant size adjectives (Experiment 3). Overall, these results show how discriminability affects a speaker's choice of referential expression above and beyond considerations of informativity, supporting the view that redundant speakers can be cooperative.

Watching a video together creates social closeness between children and adults

Human social relationships are often formed through shared social activities in which individuals share mental states about external stimuli. Previous work on joint attention has shown that even minimal shared experiences such as watching something together facilitates social closeness between individuals. Here, we examined whether young children already connect with others through joint attention. In the current studies, children sat next to a novel adult who either watched a film with them or was not able to see the film and read a book instead. After the video, we measured children's willingness (i.e., latency) to approach the experimenter holding out a toy. In both studies, the 2.5-year-olds who watched the film together approached more quickly than the other children. These results show that both minimally interactive shared experiences and noninteractive shared experiences lead children to feel more comfortable with a novel adult. This suggests that joint attention interactions, and shared experiences in general, play an important role not only in children's cognitive development but also in their social development and the formation of their social relationships.

Social Pragmatics: Preschoolers Rely on Commonsense Psychology to Resolve Referential Underspecification

Four experiments show that 4- and 5-year-olds (total N = 112) can identify the referent of underdetermined utterances through their Naïve Utility Calculus-an intuitive theory of people's behavior structured around an assumption that agents maximize utilities. In Experiments 1-2, a puppet asked for help without specifying to whom she was talking ("Can you help me?"). In Experiments 3-4, a puppet asked the child to pass an object without specifying what she wanted ("Can you pass me that one?"). Children's responses suggest that they considered cost trade-offs between the members in the interaction. These findings add to a body of work showing that reference resolution is informed by commonsense psychology from early in childhood.

The rare preference effect: Statistical information influences social affiliation judgments

Shared preferences-liking the same things-facilitate and strengthen bonds between individuals. However, not all shared preferences are equally meaningful; sharing a rare preference with someone is often more exciting and meaningful than sharing a common preference. Here we present evidence for the rare preference effect: Participants chose to interact with (Experiment 1), and endorsed interactions between (Experiment 2), individuals who shared a rare preference, rather than those who shared a common preference, and this tendency increased with the relative rarity of the preference. While having a preference usually implies knowing and liking something, the presence of shared knowledge alone was sufficient to give rise to the rare preference effect (Experiments 3 & 4). Further, we find that social affiliation judgments are modulated by the causal process by which individuals came to have shared knowledge: Participants preferred to interact with someone who acquired a shared preference deliberately rather than accidentally (Experiment 5). In addition to the many cultural and emotional factors that drive mutual attraction, these results suggest that people's decisions about with whom to interact are systematically influenced by the statistics of the social environment.

This shoe, that tiger: Semantic properties reflecting manual affordances of the referent modulate demonstrative use

Demonstrative reference is central to human communication. But what influences our choice of demonstrative forms such as “this” and “that” in discourse? Previous literature has mapped the use of such “proximal” and “distal” demonstratives onto spatial properties of referents, such as their distance from the speaker. We investigated whether object semantics, and specifically functional properties of referents, also influence speakers’ choices of either demonstrative form. Over two experiments, we presented English, Danish and Italian speakers with words denoting animate and inanimate objects, differing in size and harmfulness, and asked them to match them with a proximal or a distal demonstrative. Objects that offer more affordances for manipulation (smaller and harmless) elicited significantly more proximal demonstratives. These effects were stronger for inanimate referents, in line with the predictions of sensory-functional views on object semantics. These results suggest that demonstrative use may be partly grounded on manual affordances, and hints at the possibility of using demonstratives as a proxy to investigate the organization of semantic knowledge.

When do Children with Autism Spectrum Disorder Take Common Ground into Account During Communication?

One feature of autism spectrum disorder (ASD) is a deficit in verbal reference production, that is, providing an appropriate amount of verbal information for the listener to refer to things, people, and events. However, very few studies have manipulated whether individuals with ASD can take a speaker's perspective to interpret verbal reference. A critical limitation of all interpretation studies is that comprehension of another's verbal reference required the participant to represent only the other's visual perspective. Yet, many everyday interpretations of verbal reference require knowledge of social perspective (i.e., a consideration of which experiences one has shared with which interlocutor). We investigated whether 22 5;0-7;11-year-old children with ASD and 22 well-matched typically developing (TD) children used social perspective to comprehend (Study 1) and produce (Study 2) verbal reference. Social perspective-taking was manipulated by having children collaboratively complete activities with one of two interlocutors such that for a given activity, one interlocutor was Knowledgeable and one was Naïve. Study 1 found no between-group differences for the interpretation of ambiguous references based on social perspective. In Study 2, when producing referring terms, the ASD group made modifications based on listener needs, but this effect was significantly stronger in the TD group. Overall, the findings suggest that high-functioning children with ASD know with which interlocutor they have previously shared a given experience and can take this information into account to steer verbal reference. Nonetheless, they show clear performance limitations in this regard relative to well-matched controls. Autism Res 2018, 11: 1366-1375. © 2018 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: No one had studied if young children with autism spectrum disorder (ASD) could take into account previous collaboration with particular conversation partners to drive how well they communicate with others. In both their language understanding and spoken language, we found that five to 7-year-olds with ASD were able to consider what they had previously shared with the conversation partner. However, they were impaired when compared to typically developing children in the degree to which they tailored their spoken language for a specific listener.

Language Use in Joint Action: The Means of Referring Expressions

This study examined how human–human collaboration can be achieved through an exchange of verbal information in exchanging information about the referents in a joint action. Knowing other people’s referential intention is fundamental for joint action. Joint action can be achieved verbally by two types of referring expressions, namely, symbolic and deictic referring expressions. Using corpus data, we extracted nouns as typical symbolic references and demonstratives as typical deictic references. We examined whether the word usage of these terms changed when the robot vehicles controlled by the participants repeatedly performed the same collaborative task. We used a novel virtual space for the task because we wanted to control the common ground shared by the participants. The results of the performance indicate that the task completion became more efficient as the participants repeated the task. The referential word use was reduced in both symbolic and deictic references, and this reduction occurred with a grounding process among the collaborators. The study showed that reduction of referential expressions occurs with the grounding process in human–human collaboration and suggests that appropriate collaborative robot systems must deal with the reduction process of referencing in humans.

Using Cognitive Work Analysis to Design Communication Support Tools for Patients with Language Barriers

Patients with language barriers face healthcare disparities associated with access to care, satisfactions with care, and the quality and safety of the care they receive. The central solution to addressing these barriers is through the use of professional interpreters but there are difficulties associated with consistently using these services. This study used cognitive work analysis to identify the goals, constraints and affordances associated with patient communication to develop support requirements for communicating with patients with language barriers. Specific communication support objectives discovered included: supporting various cultural background and levels of health literacy, identifying when information is not properly conveyed, and providing a means to convey the information in a different way to allow for subsequent checks in understanding. These objectives can be utilized as inputs for the development of tools to support communication with patients with language barriers.

The Novelty Penalty

People often tell each other stories about their past experiences. But do they tell the right ones? Speakers and listeners predicted that listeners would enjoy hearing novel stories (i.e., stories about experiences the listeners had never had) more than familiar stories (i.e., stories about experiences the listeners had already had). In fact, listeners enjoyed hearing familiar stories much more than novel ones (Studies 1 and 2). This did not happen because the familiar and novel stories differed in their content or delivery (Study 3). Rather, it happened because human speech is riddled with informational gaps, and familiar stories allow listeners to use their own knowledge to fill in those gaps (Study 4). We discuss reasons why novel stories are more difficult to tell, and why familiar stories are more enjoyable to hear, than either speakers or listeners expect.

Formality of the Chinese collective leadership

We investigated the linguistic patterns in the discourse of four generations of the collective leadership of the Communist Party of China (CPC) from 1921 to 2012. The texts of Mao Zedong, Deng Xiaoping, Jiang Zemin, and Hu Jintao were analyzed using computational linguistic techniques (a Chinese formality score) to explore the persuasive linguistic features of the leaders in the contexts of power phase, the nation's education level, power duration, and age. The study was guided by the elaboration likelihood model of persuasion, which includes a central route (represented by formal discourse) versus a peripheral route (represented by informal discourse) to persuasion. The results revealed that these leaders adopted the formal, central route more when they were in power than before they came into power. The nation's education level was a significant factor in the leaders' adoption of the persuasion strategy. The leaders' formality also decreased with their increasing age and in-power times. However, the predictability of these factors for formality had subtle differences among the different types of leaders. These results enhance our understanding of the Chinese collective leadership and the role of formality in politically persuasive messages.

Salience and Attention in Surprisal-Based Accounts of Language Processing

The notion of salience has been singled out as the explanatory factor for a diverse range of linguistic phenomena. In particular, perceptual salience (e.g., visual salience of objects in the world, acoustic prominence of linguistic sounds) and semantic-pragmatic salience (e.g., prominence of recently mentioned or topical referents) have been shown to influence language comprehension and production. A different line of research has sought to account for behavioral correlates of cognitive load during comprehension as well as for certain patterns in language usage using information-theoretic notions, such as surprisal. Surprisal and salience both affect language processing at different levels, but the relationship between the two has not been adequately elucidated, and the question of whether salience can be reduced to surprisal / predictability is still open. Our review identifies two main challenges in addressing this question: terminological inconsistency and lack of integration between high and low levels of representations in salience-based accounts and surprisal-based accounts. We capitalize upon work in visual cognition in order to orient ourselves in surveying the different facets of the notion of salience in linguistics and their relation with models of surprisal. We find that work on salience highlights aspects of linguistic communication that models of surprisal tend to overlook, namely the role of attention and relevance to current goals, and we argue that the Predictive Coding framework provides a unified view which can account for the role played by attention and predictability at different levels of processing and which can clarify the interplay between low and high levels of processes and between predictability-driven expectation and attention-driven focus.

Ragnar Rommetveit's Approach to Everyday Spoken Dialogue from Within

The following article presents basic concepts and methods of Ragnar Rommetveit's (born 1924) hermeneutic-dialogical approach to everyday spoken dialogue with a focus on both shared consciousness and linguistically mediated meaning. He developed this approach originally in his engagement of mainstream linguistic and psycholinguistic research of the 1960s and 1970s. He criticized this research tradition for its individualistic orientation and its adherence to experimental methodology which did not allow the engagement of interactively established meaning and understanding in everyday spoken dialogue. As a social psychologist influenced by phenomenological philosophy, Rommetveit opted for an alternative conceptualization of such dialogue as a contextualized, partially private world, temporarily co-established by interlocutors on the basis of shared consciousness. He argued that everyday spoken dialogue should be investigated from within, i.e., from the perspectives of the interlocutors and from a psychology of the second person. Hence, he developed his approach with an emphasis on intersubjectivity, perspectivity and perspectival relativity, meaning potential of utterances, and epistemic responsibility of interlocutors. In his methods, he limited himself for the most part to casuistic analyses, i.e., logical analyses of fictitious examples to argue for the plausibility of his approach. After many years of experimental research on language, he pursued his phenomenologically oriented research on dialogue in English-language publications from the late 1980s up to 2003. During that period, he engaged psycholinguistic research on spoken dialogue carried out by Anglo-American colleagues only occasionally. Although his work remained unfinished and open to development, it provides both a challenging alternative and supplement to current Anglo-American research on spoken dialogue and some overlap therewith.

Young children use shared experience to interpret definite reference

We investigated whether children at the ages of two and three years understand that a speaker's use of the definite article specifies a referent that is in common ground between speaker and listener. An experimenter and a child engaged in joint actions in which the experimenter chose one of three similar objects of the same category to perform an action. In subsequent interactions children were asked to get 'the X' or 'a X'. When children were instructed with the definite article they chose the shared object significantly more often than when they were instructed with the indefinite article in which case children's choice was at chance. The findings show that in their third year children use shared experiences to interpret the speaker's communicative intention underlying her referential choice. The results are discussed with respect to children's representation of linguistic categories and the role of joint action for establishing common ground.

Adjustment of speaker's referential expressions to an addressee's likely knowledge and link with theory of mind abilities

To communicate cooperatively, speakers must determine what constitutes the common ground with their addressee and adapt their referential choices accordingly. Assessing another person's knowledge requires a social cognition ability termed theory of mind (ToM). This study relies on a novel referential communication task requiring probabilistic inferences of the knowledge already held by an addressee prior to the study. Forty participants were asked to present 10 movie characters and the addressee, who had the same characters in a random order, was asked to place them in order. ToM and other aspects of social cognition were also assessed. Participants used more information when presenting likely unknown than likely known movie characters. They particularly increased their use of physical descriptors, which most often accompanied movie-related information. Interestingly, a significant relationship emerged between our ToM test and the increased amount of information given for the likely unknown characters. These results suggest that speakers use ToM to infer their addressee's likely knowledge and accordingly adapt their referential expressions.

Virtual bargaining: a theory of social decision-making

An essential element of goal-directed decision-making in social contexts is that agents' actions may be mutually interdependent. However, the most well-developed approaches to such strategic interactions, based on the Nash equilibrium concept in game theory, are sometimes too broad and at other times ‘overlook’ good solutions to fundamental social dilemmas and coordination problems. The authors propose a new theory of social decision-making—virtual bargaining—in which individuals decide among a set of moves on the basis of what they would agree to do if they could openly bargain. The core principles of a formal account are outlined (vis-à-vis the notions of ‘feasible agreement’ and explicit negotiation) and further illustrated with the introduction of a new game, dubbed the ‘Boobytrap game’ (a modification on the canonical Prisoner's Dilemma paradigm). In the first empirical data of how individuals play the Boobytrap game, participants' experimental choices accord well with a virtual bargaining perspective, but do not match predictions from a standard Nash account. Alternative frameworks are discussed, with specific empirical tests between these and virtual bargaining identified as future research directions. Lastly, it is proposed that virtual bargaining underpins a vast range of human activities, from social decision-making to joint action and communication.

Pooling the ground: understanding and coordination in collective sense making

Common ground is most often understood as the sum of mutually known beliefs, knowledge, and suppositions among the participants in a conversation. It explains why participants do not mention things that should be obvious to both. In some accounts of communication, reaching a mutual understanding, i.e., broadening the common ground, is posed as the ultimate goal of linguistic interactions. Yet, congruent with the more pragmatic views of linguistic behavior, in which language is treated as social coordination, understanding each other is not the purpose (or not the sole purpose) of linguistic interactions. This purpose is seen as at least twofold (e.g., Fusaroli et al., 2014): to maintain the systemic character of a conversing dyad and to organize it into a functional synergy in the face of tasks posed for a dyadic system as a whole. It seems that the notion of common ground is not sufficient to address the latter character of interaction. In situated communication, in which meaning is created in a distributed way in the very process of interaction, both common (sameness) and privileged (diversity) information must be pooled task-dependently across participants. In this paper, we analyze the definitions of common and privileged ground and propose a conceptual extension that may facilitate a theoretical account of agents that coordinate via linguistic communication. To illustrate the usefulness of this augmented framework, we apply it to one of the recurrent issues in psycholinguistic research, namely the problem of perspective-taking in dialog, and draw conclusions for the broader problem of audience design.