Gesture and Symbolic Representation in Italian and English-Speaking Canadian 2-Year-Olds

Lexical skills and gesture use: A comparison between expressive and receptive/expressive late talkers

BACKGROUND

Studies on late talkers (LTs) highlighted their heterogeneity and the relevance of describing different communicative profiles.

AIMS

To examine lexical skills and gesture use in expressive (E-LTs) vs. receptive-expressive (R/E-LTs) LTs through a structured task.

METHODS AND PROCEDURES

Forty-six 30-month-old screened LTs were distinguished into E-LTs (n= 35) and R/E-LTs (n= 11) according to their receptive skills. Lexical skills and gesture use were assessed with a Picture Naming Game by coding answer accuracy (correct, incorrect, no response), modality of expression (spoken, spoken-gestural, gestural), type of gestures (deictic, representational), and spoken-gestural answers' semantic relationship (complementary, equivalent, supplementary).

OUTCOMES AND RESULTS

R/E-LTs showed lower scores than E-LTs for noun and predicate comprehension with fewer correct answers, and production with fewer correct and incorrect answers, and more no responses. R/E-LTs also exhibited lower scores in spoken answers, representational gestures, and equivalent spoken-gestural answers for noun production and in all spoken and gestural answers for predicate production.

CONCLUSIONS AND IMPLICATIONS

Findings highlighted more impaired receptive and expressive lexical skills and lower gesture use in R/E-LTs compared to E-LTs, underlying the relevance of assessing both lexical and gestural skills through a structured task, besides parental questionnaires and developmental scales, to describe LTs' communicative profiles.

On the Embodiment of Negation in Italian Sign Language: An Approach Based on Multiple Representation Theories

Negation can be considered a shared social action that develops since early infancy with very basic acts of refusals or rejection. Inspired by an approach to the embodiment of concepts known as Multiple Representation Theories (MRT, henceforth), the present paper explores negation as an embodied action that relies on both sensorimotor and linguistic/social information. Despite the different variants, MRT accounts share the basic ideas that both linguistic/social and sensorimotor information concur to the processes of concepts formation and representation and that the balance between these components depends on the kind of concept, the context, or the performed task. In the present research we will apply the MRT framework for exploring negation in Italian sign language (LIS). The nature of negation in LIS has been explored in continuity with the co-speech gesture where negative elements are encoded through differentiated prosodic and gestural strategies across languages. Data have been collected in naturalistic settings that may allow a much wider understanding of negation both in speech and in spoken language with a semi-structured interview. Five LIS participants with age range 30–80 were recruited and interviewed with the aim of understanding the continuity between gesture and sign in negation. Results highlight that negation utterances mirror the functions of rejection, non-existence and denial that have been described in language acquisition both in deaf and hearing children. These different steps of acquisition of negation show a different balance between sensorimotor, linguistic and social information in the construction of negative meaning that the MRT is able to enlighten.

Pantomimic fossils in modern human communication

Bodily mimesis, the capacity to use the body representationally, was one of the key innovations that allowed early humans to go beyond the 'baseline' of generalized ape communication and cognition. We argue that the original human-specific communication afforded by bodily mimesis was based on signs that involve three entities: an expression that represents an object (i.e. communicated content) for an interpreter. We further propose that the core component of this communication, pantomime, was able to transmit referential information that was not limited to select semantic domains or the 'here-and-now', by means of motivated-most importantly iconic-signs. Pressures for expressivity and economy then led to conventionalization of signs and a growth of linguistic characteristics: semiotic systematicity and combinatorial expression. Despite these developments, both naturalistic and experimental data suggest that the system of pantomime did not disappear and is actively used by modern humans. Its contemporary manifestations, or pantomimic fossils, emerge when language cannot be used, for instance when people do not share a common language, or in situations where the use of (spoken) language is difficult, impossible or forbidden. Under such circumstances, people bootstrap communication by means of pantomime and, when these circumstances persist, newly emergent pantomimic communication becomes increasingly language-like. This article is part of the theme issue 'Reconstructing prehistoric languages'.

Systematic mappings between semantic categories and types of iconic representations in the manual modality: A normed database of silent gesture

An unprecedented number of empirical studies have shown that iconic gestures-those that mimic the sensorimotor attributes of a referent-contribute significantly to language acquisition, perception, and processing. However, there has been a lack of normed studies describing generalizable principles in gesture production and in comprehension of the mappings of different types of iconic strategies (i.e., modes of representation; Müller, 2013). In Study 1 we elicited silent gestures in order to explore the implementation of different types of iconic representation (i.e., acting, representing, drawing, and personification) to express concepts across five semantic domains. In Study 2 we investigated the degree of meaning transparency (i.e., iconicity ratings) of the gestures elicited in Study 1. We found systematicity in the gestural forms of 109 concepts across all participants, with different types of iconicity aligning with specific semantic domains: Acting was favored for actions and manipulable objects, drawing for nonmanipulable objects, and personification for animate entities. Interpretation of gesture-meaning transparency was modulated by the interaction between mode of representation and semantic domain, with some couplings being more transparent than others: Acting yielded higher ratings for actions, representing for object-related concepts, personification for animate entities, and drawing for nonmanipulable entities. This study provides mapping principles that may extend to all forms of manual communication (gesture and sign). This database includes a list of the most systematic silent gestures in the group of participants, a notation of the form of each gesture based on four features (hand configuration, orientation, placement, and movement), each gesture's mode of representation, iconicity ratings, and professionally filmed videos that can be used for experimental and clinical endeavors.

Do you understand what I want to tell you? Early sensitivity in bilinguals' iconic gesture perception and production

Previous research has shown differences in monolingual and bilingual communication. We explored whether monolingual and bilingual pre-schoolers (N = 80) differ in their ability to understand others' iconic gestures (gesture perception) and produce intelligible iconic gestures themselves (gesture production) and how these two abilities are related to differences in parental iconic gesture frequency. In a gesture perception task, the experimenter replaced the last word of every sentence with an iconic gesture. The child was then asked to choose one of four pictures that matched the gesture as well as the sentence. In a gesture production task, children were asked to indicate 'with their hands' to a deaf puppet which objects to select. Finally, parental gesture frequency was measured while parents answered three different questions. In the iconic gesture perception task, monolingual and bilingual children did not differ. In contrast, bilinguals produced more intelligible gestures than their monolingual peers. Finally, bilingual children's parents gestured more while they spoke than monolingual children's parents. We suggest that bilinguals' heightened sensitivity to their interaction partner supports their ability to produce intelligible gestures and results in a bilingual advantage in iconic gesture production.

Do Children With Autism Spectrum Disorders Understand Pantomimic Events?

Impairments of motor representation of actions have been reported as a core component of autism spectrum disorders (ASD). Individuals with ASD have difficulties in a number of functions such as assuming anticipatory postures, imitating body movements, producing and understanding gestures, and recognizing motor intentions. Such cognitive-motor abilities are all involved in pantomime. However, the available evidence on the production and comprehension of pantomime in individuals with ASD is still inconclusive. The current investigation assessed pantomime comprehension in 40 children with high-functioning ASD and 40 children with typical development balanced for age, IQ, level of formal education, and cognitive profile. The participants were asked to watch video recordings of pantomimes representing simple transitive events enacted by actors and match them to the corresponding pictorial representations. Such pantomimes were delivered in two conditions with different levels of information content (i.e., lean or rich). The two groups of children performed similarly on these tasks. Nonetheless, children with ASD who were administered the pantomimes in the lean condition performed worse than participants who were administered the informatively richer pantomimes. The methodological implications for interpretation of previous findings and future studies are discussed.

Natural reference: A phylo- and ontogenetic perspective on the comprehension of iconic gestures and vocalizations

The recognition of iconic correspondence between signal and referent has been argued to bootstrap the acquisition and emergence of language. Here, we study the ontogeny, and to some extent the phylogeny, of the ability to spontaneously relate iconic signals, gestures, and/or vocalizations, to previous experience. Children at 18, 24, and 36 months of age (N = 216) and great apes (N = 13) interacted with two apparatuses, each comprising a distinct action and sound. Subsequently, an experimenter mimicked either the action, the sound, or both in combination to refer to one of the apparatuses. Experiments 1 and 2 found no spontaneous comprehension in great apes and in 18-month-old children. At 24 months of age, children were successful with a composite vocalization-gesture signal but not with either vocalization or gesture alone. At 36 months, children succeeded both with a composite vocalization-gesture signal and with gesture alone, but not with vocalization alone. In general, gestures were understood better compared to vocalizations. Experiment 4 showed that gestures were understood irrespective of how children learned about the corresponding action (through observation or self-experience). This pattern of results demonstrates that iconic signals can be a powerful way to establish reference in the absence of language, but they are not trivial for children to comprehend and not all iconic signals are created equal.

Using the Hands to Represent Objects in Space: Gesture as a Substrate for Signed Language Acquisition

An ongoing issue of interest in second language research concerns what transfers from a speaker's first language to their second. For learners of a sign language, gesture is a potential substrate for transfer. Our study provides a novel test of gestural production by eliciting silent gesture from novices in a controlled environment. We focus on spatial relationships, which in sign languages are represented in a very iconic way using the hands, and which one might therefore predict to be easy for adult learners to acquire. However, a previous study by Marshall and Morgan (2015) revealed that this was only partly the case: in a task that required them to express the relative locations of objects, hearing adult learners of British Sign Language (BSL) could represent objects' locations and orientations correctly, but had difficulty selecting the correct handshapes to represent the objects themselves. If hearing adults are indeed drawing upon their gestural resources when learning sign languages, then their difficulties may have stemmed from their having in manual gesture only a limited repertoire of handshapes to draw upon, or, alternatively, from having too broad a repertoire. If the first hypothesis is correct, the challenge for learners is to extend their handshape repertoire, but if the second is correct, the challenge is instead to narrow down to the handshapes appropriate for that particular sign language. 30 sign-naïve hearing adults were tested on Marshall and Morgan's task. All used some handshapes that were different from those used by native BSL signers and learners, and the set of handshapes used by the group as a whole was larger than that employed by native signers and learners. Our findings suggest that a key challenge when learning to express locative relations might be reducing from a very large set of gestural resources, rather than supplementing a restricted one, in order to converge on the conventionalized classifier system that forms part of the grammar of the language being learned.

The development of iconicity in children's co-speech gesture and homesign

Gesture can illustrate objects and events in the world by iconically reproducing elements of those objects and events. Children do not begin to express ideas iconically, however, until after they have begun to use conventional forms. In this paper, we investigate how children's use of iconic resources in gesture relates to the developing structure of their communicative systems. Using longitudinal video corpora, we compare the emergence of manual iconicity in hearing children who are learning a spoken language (co-speech gesture) to the emergence of manual iconicity in a deaf child who is creating a manual system of communication (homesign). We focus on one particular element of iconic gesture - the shape of the hand (handshape). We ask how handshape is used as an iconic resource in 1-5-year-olds, and how it relates to the semantic content of children's communicative acts. We find that patterns of handshape development are broadly similar between co-speech gesture and homesign, suggesting that the building blocks underlying children's ability to iconically map manual forms to meaning are shared across different communicative systems: those where gesture is produced alongside speech, and those where gesture is the primary mode of communication.