The development of the ability to recognize the meaning of iconic signs

Language development beyond the here-and-now: Iconicity and displacement in child-directed communication

Most language use is displaced, referring to past, future, or hypothetical events, posing the challenge of how children learn what words refer to when the referent is not physically available. One possibility is that iconic cues that imagistically evoke properties of absent referents support learning when referents are displaced. In an audio-visual corpus of caregiver-child dyads, English-speaking caregivers interacted with their children (N = 71, 24-58 months) in contexts in which the objects talked about were either familiar or unfamiliar to the child, and either physically present or displaced. The analysis of the range of vocal, manual, and looking behaviors caregivers produced suggests that caregivers used iconic cues especially in displaced contexts and for unfamiliar objects, using other cues when objects were present.

Individual differences in working memory predict the efficacy of experimenter-manipulated gestures in first-grade children

Why is instructional gesture ineffective in some contexts? And what is it about learners that predicts whether they will learn from gestures? This between-subjects linear measurement training study compares gesture instruction to two controls-operant action and transient action-in a diverse sample of first-grade students (N = 174, Mage  = 7.01 years; Nfemale  = 84; Nmale  = 90, 10% Latinx-identified; 70% White; 6% Black; 6% Asian; 18% multiple racial categories, Mincome  = $59,750, SDincome  ≈ $25,000; data collected 03/16-03/19). Results show that instructor-manipulated gestures may be less effective than demonstrative actions in part because they are iterative and do not leave a lasting trace. Verbal working memory, but not spatial, positively predicted an ability to learn from gesture and transient action in children with the lowest context knowledge.

Neurophysiological effects of frequency, length, phonological neighborhood density, and iconicity on sign recognition

Current theories on lexical recognition are mostly based on studies from spoken languages or their written forms. Much less is known about the process of lexical recognition in sign languages. This study aims to examine the neural correlates of sign recognition by investigating the effects of lexical frequency, length, phonological neighborhood density, and iconicity during Chinese Sign Language comprehension. Twenty-two deaf signers viewed a set of sign videos that varied in the 4 lexical properties and decided if they referred to animals, while event-related potential responses were recorded. Data were analyzed through linear mixed-effects models with the lexical variables treated as continuous measures. The results showed that frequency modulated ERP amplitude as early as around 200 ms and in the late N400 time frame. Sign length invoked effects throughout the process, starting from 200 ms and pertaining to the last epoch. Neighborhood density effects were also observed early around 200 ms and later on the N400 and late positive complex (LPC). Iconicity produced robust effects on the N400 and LPC amplitude. Lexical frequency, length, and neighborhood density influence the neural dynamics of sign recognition in a similar way as to spoken words. Iconicity can confer a processing advantage due to closer form-meaning mappings. The results indicate that lexical recognition engages some mechanisms that are universal across the signed and spoken modality, but it can also be regulated by modality-specific properties such as the prevalent iconicity in sign languages.

Sign learning of hearing children in inclusive day care centers-does iconicity matter?

An increasing number of experimental studies suggest that signs and gestures can scaffold vocabulary learning for children with and without special educational needs and/or disabilities (SEND). However, little research has been done on the extent to which iconicity plays a role in sign learning, particularly in inclusive day care centers. This current study investigated the role of iconicity in the sign learning of 145 hearing children (2;1 to 6;3 years) from inclusive day care centers with educators who started using sign-supported speech after a training module. Children's sign use was assessed via a questionnaire completed by their educators. We found that older children were more likely to learn signs with a higher degree of iconicity, whereas the learning of signs by younger children was less affected by iconicity. Children with SEND did not benefit more from iconicity than children without SEND. These results suggest that whether iconicity plays a role in sign learning depends on the age of the children.

Infants' Use of Iconicity in the Early Periods of Sign/Spoken Word-Learning

The aim of this research was to analyze the use of iconicity during language acquisition of Israeli Sign language and spoken Hebrew. Two bilingual-bimodal infants were observed in a longitudinal study between the ages of 10-26 months. I analyzed infants' production of iconic words, signs, and gestures. The results showed that infants' use of vocal iconicity reached its peak between the ages of 16-20 months. The proportion of imagic iconic signs in the infants' lexicon was also high during that period. In contrast, the infants' use of iconic gestures gradually increased during the study period, as well as their co-production with lexical items. The results suggest that infants' use of lexical and gestural iconicity scaffold the learning of novel labels and fill the gap in their expressive repertoire. It was concluded that teachers/therapists should use iconicity and encourage their students to use it in pedagogical settings.

Alternative Object Use in Adults and Children: Embodied Cognitive Bases of Creativity

Why does one need creativity? On a personal level, improvisation with available resources is needed for online coping with unforeseen environmental stimuli when existing knowledge and apparent action strategies do not work. On a cultural level, the exploitation of existing cultural means and norms for the deliberate production of novel and valuable artifacts is a basis for cultural and technological development and extension of human action possibilities across various domains. It is less clear, however, how creativity develops and how exactly one arrives at generating new action possibilities and producing multiple alternative action strategies using familiar objects. In this theoretical paper, we first consider existing accounts of the creative process in the Alternative Uses Task and then present an alternative interpretation, drawing on sociocultural views and an embodied cognition approach. We explore similarities between the psychological processes underlying the generation of new uses in the Alternative Uses Task and children’s pretend play. We discuss possible cognitive mechanisms and speculate how the generation of new action possibilities for common objects in pretend play can be related to adults’ ability to generate new action strategies associated with object use. Implications for creativity development in humans and embodied artificial agents are discussed.

Do parents modify child-directed signing to emphasize iconicity?

Iconic signs are overrepresented in the vocabularies of young deaf children, but it is unclear why. It is possible that iconic signs are easier for children to learn, but it is also possible that adults use iconic signs in child-directed signing in ways that make them more learnable, either by using them more often than less iconic signs or by lengthening them. We analyzed videos of naturalistic play sessions between parents and deaf children (n = 24 dyads) aged 9-60  months. To determine whether iconic signs are overrepresented during child-directed signing, we compared the iconicity of actual parent productions to the iconicity of simulated vocabularies designed to estimate chance levels of iconicity. For almost all dyads, parent sign types and tokens were not more iconic than the simulated vocabularies, suggesting that parents do not select more iconic signs during child-directed signing. To determine whether iconic signs are more likely to be lengthened, we ran a linear regression predicting sign duration, and found an interaction between age and iconicity: while parents of younger children produced non-iconic and iconic signs with similar durations, parents of older children produced non-iconic signs with shorter durations than iconic signs. Thus, parents sign more quickly with older children than younger children, and iconic signs appear to resist that reduction in sign length. It is possible that iconic signs are perceptually available longer, and their availability is a candidate hypothesis as to why iconic signs are overrepresented in children's vocabularies.

Making sense of sensory language: Acquisition of sensory knowledge by individuals with congenital sensory impairments

The present article provides a narrative review on how language communicates sensory information and how knowledge of sight and sound develops in individuals born deaf or blind. Studying knowledge of the perceptually inaccessible sensory domain for these populations offers a lens into how humans learn about that which they cannot perceive. We first review the linguistic strategies within language that communicate sensory information. Highlighting the power of language to shape knowledge, we next review the detailed knowledge of sensory information by individuals with congenital sensory impairments, limitations therein, and neural representations of imperceptible phenomena. We suggest that the acquisition of sensory knowledge is supported by language, experience with multiple perceptual domains, and cognitive and social abilities which mature over the first years of life, both in individuals with and without sensory impairment. We conclude by proposing a developmental trajectory for acquiring sensory knowledge in the absence of sensory perception.

Gesture Development in Chinese-Speaking Preschool Children With Autism and the Roles of Parental Input and Child-Based Factors

PURPOSE

Children with autism are found to have delayed and heterogeneous gesture abilities. It is important to understand the growth of gesture abilities and the underlying factors affecting its growth. Addressing these issues can help to design effective intervention programs.

METHOD

Thirty-five Chinese-speaking preschoolers with autism spectrum disorder (M _age = 4.89 years, SD = 0.91; four girls) participated in four play sessions with their parents over 9 months. Their child-based factors including autism severity, intellectual functioning, and expressive language abilities were assessed. The gestures (deictic, iconic, and conventional) of the children and their parents were coded. Growth curve analyses were conducted to examine individual growth trajectories and the roles of child-based factors and parental input in shaping the children's gesture development.

RESULTS

Child-based factors and parental input predicted gesture development differently. Parents' gestures positively predicted their children's gestures of the same type. Autism severity negatively predicted iconic and conventional gestures. Overall growth was found in deictic rather than iconic and conventional gestures. Subgroup variation was also found. Specifically, children with better expressive language ability showed a decrease in deictic gestures. An increase in iconic and conventional gestures was found in children with more severe autism and those with poorer expressive language ability and intellectual functioning, respectively.

CONCLUSIONS

Different types of gestures may have different growth trajectories and be predicted by different child-based factors. Particular attention should be given to children who never produced iconic gestures, which is more challenging and may not develop over a short period, and hence require direct instruction.

Can gesture input support toddlers' fast mapping?

Forty-eight toddlers participated in a word-learning task to assess gesture input on mapping nonce words to unfamiliar objects. Receptive fast mapping and expressive naming for target object-word pairs were tested in three conditions - with a point, with a shape gesture, and in a no-gesture, word-only condition. No statistically significant effect of gesture for receptive fast-mapping was found but age was a factor. Two year olds outperformed one year olds for both measures. Only one girl in the one-year-old group correctly named any items. There was a significant interaction between gesture and gender for expressive naming. Two-year-old girls were six times more likely than two-year-old boys to correctly name items given point and shape gestures; whereas, boys named more items taught with the word only than with a point or shape gesture. The role of gesture input remains unclear, particularly for children under two years and for toddler boys.

Situating Language in the Real-World: The Role of Multimodal Iconicity and Indexicality

In the last decade, a growing body of work has convincingly demonstrated that languages embed a certain degree of non-arbitrariness (mostly in the form of iconicity, namely the presence of imagistic links between linguistic form and meaning). Most of this previous work has been limited to assessing the degree (and role) of non-arbitrariness in the speech (for spoken languages) or manual components of signs (for sign languages). When approached in this way, non-arbitrariness is acknowledged but still considered to have little presence and purpose, showing a diachronic movement towards more arbitrary forms. However, this perspective is limited as it does not take into account the situated nature of language use in face-to-face interactions, where language comprises categorical components of speech and signs, but also multimodal cues such as prosody, gestures, eye gaze etc. We review work concerning the role of context-dependent iconic and indexical cues in language acquisition and processing to demonstrate the pervasiveness of non-arbitrary multimodal cues in language use and we discuss their function. We then move to argue that the online omnipresence of multimodal non-arbitrary cues supports children and adults in dynamically developing situational models.

Picture-naming in American Sign Language: an electrophysiological study of the effects of iconicity and structured alignment

A picture-naming task and ERPs were used to investigate effects of iconicity and visual alignment between signs and pictures in American Sign Language (ASL). For iconic signs, half the pictures visually overlapped with phonological features of the sign (e.g., the fingers of CAT align with a picture of a cat with prominent whiskers), while half did not (whiskers are not shown). Iconic signs were produced numerically faster than non-iconic signs and were associated with larger N400 amplitudes, akin to concreteness effects. Pictures aligned with iconic signs were named faster than non-aligned pictures, and there was a reduction in N400 amplitude. No behavioral effects were observed for the control group (English speakers). We conclude that sensory-motoric semantic features are represented more robustly for iconic than non-iconic signs (eliciting a concreteness-like N400 effect) and visual overlap between pictures and the phonological form of iconic signs facilitates lexical retrieval (eliciting a reduced N400).

Key Word Signing Has Higher Iconicity Than Sign Language

Purpose Key word signing (KWS) entails using manual signs to support the natural speech of individuals with normal hearing and who have communication difficulties. While manual signs from the local sign language may be used for this purpose, some KWS systems have opted for a distinct KWS lexicon. Distinct KWS lexicon typically aims for higher sign iconicity or recognizability to make the lexicon more accessible for individuals with intellectual disabilities. We sought to determine if, in the Belgian Dutch context, signs from such a distinct KWS lexicon (Spreken Met Ondersteuning van Gebaren [Speaking With Support of Signs; SMOG]) were indeed more iconic than their Flemish Sign Language (FSL) counterparts. Method Participants were 224 adults with typical development who had no signing experience. They rated the resemblance between a FSL sign and its meaning. Raw data on the iconicity of SMOG from a previous study were used. Translucency was statistically and qualitatively compared between the SMOG lexicon and their FSL counterparts. Results SMOG had an overall higher translucency than FSL and contained a higher number of iconic signs. Conclusion This finding may support the value of a separate sign lexicon over using sign language signs. Nevertheless, other aspects, such as wide availability and inclusion, need to be considered.

Seeing Iconic Gesture Promotes First- and Second-Order Verb Generalization in Preschoolers

This study investigated whether seeing iconic gestures depicting verb referents promotes two types of generalization. We taught 3- to 4-year-olds novel locomotion verbs. Children who saw iconic manner gestures during training generalized more verbs to novel events (first-order generalization) than children who saw interactive gestures (Experiment 1, N = 48; Experiment 2, N = 48) and path-tracing gestures (Experiment 3, N = 48). Furthermore, immediately (Experiments 1 and 3) and after 1 week (Experiment 2), the iconic manner gesture group outperformed the control groups in subsequent generalization trials with different novel verbs (second-order generalization), although all groups saw interactive gestures. Thus, seeing iconic gestures that depict verb referents helps children (a) generalize individual verb meanings to novel events and (b) learn more verbs from the same subcategory.

Integrated Communication System: Gesture and Language Acquisition in Typically Developing Children and Children With LD and DLD

Gesture and language development are strongly connected to each other. Two types of gestures in particular are analyzed regarding their role for language acquisition: pointing and iconic gestures. With the present longitudinal study, the predictive values of index-finger pointing at 12 months and the comprehension of iconic gestures at 3;0 years for later language skills in typically developing (TD) children and in children with a language delay (LD) or developmental language disorder (DLD) are examined. Forty-two monolingual German children and their primary caregivers participated in the study and were followed longitudinally from 1;0 to 6;0 years. Within a total of 14 observation sessions, the gestural and language abilities of the children were measured using standardized as well as ad hoc tests, parent questionnaires and semi-natural interactions between the child and their caregivers. At the age of 2;0 years, 10 of the 42 children were identified as having a LD. The ability to point with the extended index finger at 1;0 year is predictive for language skills at 5;0 and 6;0 years. This predictive effect is mediated by the language skills of the children at 3;0 years. The comprehension of iconic gestures at 3;0 years correlates with index-finger pointing at 1;0 year and also with earlier and later language skills. It mediates the predictive value of index-finger pointing at 1;0 year for grammar skills at 5;0 and 6;0 years. Children with LD develop the ability to understand the iconicity in gestures later than TD children and score lower in language tests until the age of 6;0 years. The language differences between these two groups of children persist partially until the age of 5;0 years even when the two children with manifested DLD within the group of children with LD are excluded from analyses. Beyond that age, no differences in the language skills between children with and without a history of LD are found when children with a manifest DLD are excluded. The findings support the assumption of an integrated speech–gesture communication system, which functions similarly in TD children and children with LD or DLD, but with a time delay.

Degree and not type of iconicity affects sign language vocabulary acquisition

Lexical iconicity-signs or words that resemble their meaning-is overrepresented in children's early vocabularies. Embodied theories of language acquisition predict that symbols are more learnable when they are grounded in a child's firsthand experiences. As such, pantomimic iconic signs, which use the signer's body to represent a body, might be more readily learned than other types of iconic signs. Alternatively, the structure mapping theory of iconicity predicts that learners are sensitive to the amount of overlap between form and meaning. In this exploratory study of early vocabulary development in American Sign Language (ASL), we asked whether type of iconicity predicts sign acquisition above and beyond degree of iconicity. We also controlled for concreteness and relevance to babies, two possible confounding factors. Highly concrete referents and concepts that are germane to babies may be amenable to iconic mappings. We reanalyzed a previously published set of ASL Communicative Development Inventory (CDI) reports from 58 deaf children learning ASL from their deaf parents (Anderson & Reilly, 2002). Pantomimic signs were more iconic than other types of iconic signs (perceptual, both pantomimic and perceptual, or arbitrary), but type of iconicity had no effect on acquisition. Children may not make use of the special status of pantomimic elements of signs. Their vocabularies are, however, shaped by degree of iconicity, which aligns with a structure mapping theory of iconicity, though other explanations are also compatible (e.g., iconicity in child-directed signing). Previously demonstrated effects of type of iconicity may be an artifact of the increased degree of iconicity among pantomimic signs. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Lexical Iconicity is differentially favored under transmission in a new sign language: The effect of type of iconicity

Observations that iconicity diminishes over time in sign languages pose a puzzle--why should something so evidently useful and functional decrease? Using an archival dataset of signs elicited over 15 years from 4 first-cohort and 4 third-cohort signers of an emerging sign language (Nicaraguan Sign Language), we investigated changes in pantomimic (body-to-body) and perceptual (body-to-object) iconicity. We make three key observations: (1) there is greater variability in the signs produced by the first cohort compared to the third; (2) while both types of iconicity are evident, pantomimic iconicity is more prevalent than perceptual iconicity for both groups; and (3) across cohorts, pantomimic elements are dropped to a greater proportion than perceptual elements. The higher rate of pantomimic iconicity in the first-cohort lexicon reflects the usefulness of body-as-body mapping in language creation. Yet, its greater vulnerability to change over transmission suggests that it is less favored by children's language acquisition processes.

How many fingers am I holding up? The answer depends on children's language background

Monolingual English-speaking preschool children tend to process number gestures as unanalyzed wholes rather than use the one-to-one (finger-to-quantity) correspondence. By school age, however, children can use the one-to-one correspondence. The purpose of the present studies was to test whether children learn one-to-one correspondence through exposure to a variety of finger configurations to convey a single quantity. In Study 1, we compared children with exposure to multiple one-to-one configurations, that is, French-English and German-English bilingual children, to English monolingual children who see consistent representations. As predicted, the bilingual children performed better in interpreting unconventional number gestures. In Study 2, we compared Chinese-English bilingual children who knew arbitrary one-handed Chinese numbers gestures for quantities 6-10 to Chinese-English bilingual children who did not know these gestures, as well as to monolingual English speakers. Chinese-English bilinguals who knew the arbitrary gestures were more likely to interpret unconventional gestures arbitrarily (i.e., influenced by the written and/or Chinese gesture forms). These children did not differ from English monolinguals in the interpretation of unconventional gestures. These results are consistent with the argument that children can become sensitive to the one-to-one correspondence in number gestures with exposure to multiple configurations for the same quantity.

Natural reference: A phylo- and ontogenetic perspective on the comprehension of iconic gestures and vocalizations

The recognition of iconic correspondence between signal and referent has been argued to bootstrap the acquisition and emergence of language. Here, we study the ontogeny, and to some extent the phylogeny, of the ability to spontaneously relate iconic signals, gestures, and/or vocalizations, to previous experience. Children at 18, 24, and 36 months of age (N = 216) and great apes (N = 13) interacted with two apparatuses, each comprising a distinct action and sound. Subsequently, an experimenter mimicked either the action, the sound, or both in combination to refer to one of the apparatuses. Experiments 1 and 2 found no spontaneous comprehension in great apes and in 18-month-old children. At 24 months of age, children were successful with a composite vocalization-gesture signal but not with either vocalization or gesture alone. At 36 months, children succeeded both with a composite vocalization-gesture signal and with gesture alone, but not with vocalization alone. In general, gestures were understood better compared to vocalizations. Experiment 4 showed that gestures were understood irrespective of how children learned about the corresponding action (through observation or self-experience). This pattern of results demonstrates that iconic signals can be a powerful way to establish reference in the absence of language, but they are not trivial for children to comprehend and not all iconic signals are created equal.

Actions speak louder than gestures when you are 2 years old

Interpreting iconic gestures can be challenging for children. Here, we explore the features and functions of iconic gestures that make them more challenging for young children to interpret than instrumental actions. In Study 1, we show that 2.5-year-olds are able to glean size information from handshape in a simple gesture, although their performance is significantly worse than 4-year-olds'. Studies 2 to 4 explore the boundary conditions of 2.5-year-olds' gesture understanding. In Study 2, 2.5-year-old children have an easier time interpreting size information in hands that reach than in hands that gesture. In Study 3, we tease apart the perceptual features and functional objectives of reaches and gestures. We created a context in which an action has the perceptual features of a reach (extending the hand toward an object) but serves the function of a gesture (the object is behind a barrier and not obtainable; the hand thus functions to represent, rather than reach for, the object). In this context, children struggle to interpret size information in the hand, suggesting that gesture's representational function (rather than its perceptual features) is what makes it hard for young children to interpret. A distance control (Study 4) in which a person holds a box in gesture space (close to the body) demonstrates that children's difficulty interpreting static gesture cannot be attributed to the physical distance between a gesture and its referent. Together, these studies provide evidence that children's struggle to interpret iconic gesture may stem from its status as representational action. (PsycINFO Database Record

Maternal Depression and Children's Screen Overuse

BACKGROUND

It is known that there are various factors associated with children's screen overuse. The aim of this study was to examine the effect of maternal depression on 2-5-year-old children's overuse of various household screen devices.

METHODS

Participants were from the Internet-Cohort for Understanding of internet addiction Risk factors/Rescue in Early livelihood (I-CURE) study, an observational prospective cohort study in Korea. Screen time for six types of screen devices (smartphone, television, computer, tablet, video gaming console, and portable gaming console) were assessed by parental questionnaire. Maternal depression was measured by the Korean version of the Beck Depression Inventory II. Logistic regression models were run to determine the association between maternal depression and children's screen overuse.

RESULTS

Maternal depression was associated with children's television overuse after adjusting for other factors (odds ratio, 1.954; P = 0.034). Contrary to expectation, the relationship between maternal depression and screen time was not present on other devices such as smartphones, computers and tablets.

CONCLUSION

Maternal depression is related with 2-5-year-old children's television overuse. Interventions in maternal depressive symptoms and the associated changes in parent-child relationship can be useful for preventing children's television overuse.

The comprehensibility of pantomimes produced by people with aphasia

BACKGROUND

People with aphasia (PWA) use pantomime, gesture in absence of speech, differently from non-brain-damaged people (NBDP).

AIMS

To evaluate through an exploratory study the comprehensibility of PWA's pantomimes and to find out whether they can compensate for information PWA are unable to convey in speech.

METHODS & PROCEDURES

A total of 273 naïve observers participated in one of two judgement tasks: forced-choice and open-ended questions. These were used to determine the comprehensibility of pantomimes produced to depict objects by PWA as compared with NBDP. Furthermore, we compared the information conveyed in pantomime with the information in speech. We looked into factors influencing pantomime's comprehensibility: individual factors, manner of depiction and information needed to be depicted.

OUTCOME & RESULTS

Although comprehensibility scores for PWA's pantomimes were lower than for those produced by NBDP, all PWA were able to convey information in pantomime that they could not convey in speech. Comprehensibility of pantomimes was predicted by apraxia. The inability to use the right hand related to slightly lower comprehensibility scores. Objects for which individuals depicted its use were best understood.

CONCLUSION & IMPLICATIONS

Our findings highlight the potential benefit of pantomime for clinical practice. Pantomimes, even though sometimes impaired, can convey information that PWA cannot convey in speech. Clinical implications are discussed.

With Some Help From Others' Hands: Iconic Gesture Helps Semantic Learning in Children With Specific Language Impairment

PURPOSE

Semantic learning under 2 co-speech gesture conditions was investigated in children with specific language impairment (SLI) and typically developing (TD) children. Learning was analyzed between conditions.

METHOD

Twenty children with SLI (aged 4 years), 20 TD children matched for age, and 20 TD children matched for language scores were taught rare nouns and verbs. Children heard the target words while seeing either iconic gestures illustrating a property of the referent or a control gesture focusing children's attention on the word. Following training, children were asked to define the words' meaning. Responses were coded for semantic information provided on each word.

RESULTS

Performance of the SLI and age-matched groups proved superior to that of the language-matched group. Overall, children defined more words taught with iconic gestures than words taught with attention-getting gestures. However, only children with SLI, but not TD children, provided more semantic information on each word taught with iconic gestures. Performance did not differ in terms of word class.

CONCLUSIONS

Results suggest that iconic co-speech gestures help both children with and without SLI learn new words but, in particular, assist children with SLI understand and reflect the words' meaning.

Observing iconic gestures enhances word learning in typically developing children and children with specific language impairment

Research has shown that observing iconic gestures helps typically developing children (TD) and children with specific language impairment (SLI) learn new words. So far, studies mostly compared word learning with and without gestures. The present study investigated word learning under two gesture conditions in children with and without language impairment. Twenty children with SLI (age four), twenty age-matched TD children, and twenty language-matched TD children were taught words that were presented with either iconic or non-iconic gestures. Results showed that children of all groups benefited more successfully from observing iconic gestures for word learning. The iconic gesture advantage was similar across groups. Thus, observing iconic gestures prompts richer encoding and makes word learning more efficient in TD and language impaired children.

The development of iconicity in children's co-speech gesture and homesign

Gesture can illustrate objects and events in the world by iconically reproducing elements of those objects and events. Children do not begin to express ideas iconically, however, until after they have begun to use conventional forms. In this paper, we investigate how children's use of iconic resources in gesture relates to the developing structure of their communicative systems. Using longitudinal video corpora, we compare the emergence of manual iconicity in hearing children who are learning a spoken language (co-speech gesture) to the emergence of manual iconicity in a deaf child who is creating a manual system of communication (homesign). We focus on one particular element of iconic gesture - the shape of the hand (handshape). We ask how handshape is used as an iconic resource in 1-5-year-olds, and how it relates to the semantic content of children's communicative acts. We find that patterns of handshape development are broadly similar between co-speech gesture and homesign, suggesting that the building blocks underlying children's ability to iconically map manual forms to meaning are shared across different communicative systems: those where gesture is produced alongside speech, and those where gesture is the primary mode of communication.

"I use it when I see it": The role of development and experience in Deaf and hearing children's understanding of iconic gesture

Iconicity is prevalent in gesture and in sign languages, yet the degree to which children recognize and leverage iconicity for early language learning is unclear. In Experiment 1 of the current study, we presented sign-naïve 3-, 4- and 5-year-olds (n=87) with iconic shape gestures and no additional scaffolding to ask whether children can spontaneously map iconic gestures to their referents. Four- and five-year-olds, but not three-year-olds, recognized the referents of iconic shape gestures above chance. Experiment 2 asked whether preschoolers (n=93) show an advantage in fast-mapping iconic gestures compared to arbitrary ones. We found that iconicity played a significant role in supporting 4- and 5-year-olds' ability to learn new gestures presented in an explicit pedagogical context, and a lesser role in 3-year-olds' learning. Using similar tasks in Experiment 3, we found that Deaf preschoolers (n=41) exposed to American Sign Language showed a similar pattern of recognition and learning but starting at an earlier age, suggesting that learning a language with rich iconicity may lead to earlier use of iconicity. These results suggest that sensitivity to iconicity is shaped by experience, and while not fundamental to the earliest stages of language development, is a useful tool once children unlock these form-meaning relationships.

Iconicity and Sign Lexical Acquisition: A Review

The study of iconicity, defined as the direct relationship between a linguistic form and its referent, has gained momentum in recent years across a wide range of disciplines. In the spoken modality, there is abundant evidence showing that iconicity is a key factor that facilitates language acquisition. However, when we look at sign languages, which excel in the prevalence of iconic structures, there is a more mixed picture, with some studies showing a positive effect and others showing a null or negative effect. In an attempt to reconcile the existing evidence the present review presents a critical overview of the literature on the acquisition of a sign language as first (L1) and second (L2) language and points at some factor that may be the source of disagreement. Regarding sign L1 acquisition, the contradicting findings may relate to iconicity being defined in a very broad sense when a more fine-grained operationalisation might reveal an effect in sign learning. Regarding sign L2 acquisition, evidence shows that there is a clear dissociation in the effect of iconicity in that it facilitates conceptual-semantic aspects of sign learning but hinders the acquisition of the exact phonological form of signs. It will be argued that when we consider the gradient nature of iconicity and that signs consist of a phonological form attached to a meaning we can discern how iconicity impacts sign learning in positive and negative ways.

How What We See and What We Know Influence Iconic Gesture Production

In face-to-face communication, speakers typically integrate information acquired through different sources, including what they see and what they know, into their communicative messages. In this study, we asked how these different input sources influence the frequency and type of iconic gestures produced by speakers during a communication task, under two degrees of task complexity. Specifically, we investigated whether speakers gestured differently when they had to describe an object presented to them as an image or as a written word (input modality) and, additionally, when they were allowed to explicitly name the object or not (task complexity). Our results show that speakers produced more gestures when they attended to a picture. Further, speakers more often gesturally depicted shape information when attended to an image, and they demonstrated the function of an object more often when they attended to a word. However, when we increased the complexity of the task by forbidding speakers to name the target objects, these patterns disappeared, suggesting that speakers may have strategically adapted their use of iconic strategies to better meet the task’s goals. Our study also revealed (independent) effects of object manipulability on the type of gestures produced by speakers and, in general, it highlighted a predominance of molding and handling gestures. These gestures may reflect stronger motoric and haptic simulations, lending support to activation-based gesture production accounts.

Production and Comprehension of Pantomimes Used to Depict Objects

Pantomime, gesture in absence of speech, has no conventional meaning. Nevertheless, individuals seem to be able to produce pantomimes and derive meaning from pantomimes. A number of studies has addressed the use of co-speech gesture, but little is known on pantomime. Therefore, the question of how people construct and understand pantomimes arises in gesture research. To determine how people use pantomimes, we asked participants to depict a set of objects using pantomimes only. We annotated what representation techniques people produced. Furthermore, using judgment tasks, we assessed the pantomimes' comprehensibility. Analyses showed that similar techniques were used to depict objects across individuals. Objects with a default depiction method were better comprehended than objects for which there was no such default. More specifically, tools and objects depicted using a handling technique were better understood. The open-answer experiment showed low interpretation accuracy. Conversely, the forced-choice experiment showed ceiling effects. These results suggest that across individuals, similar strategies are deployed to produce pantomime, with the handling technique as the apparent preference. This might indicate that the production of pantomimes is based on mental representations which are intrinsically similar. Furthermore, pantomime conveys semantically rich, but ambiguous, information, and its interpretation is much dependent on context. This pantomime database is available online: https://dataverse.nl/dataset.xhtml?persistentId=hdl:10411/QZHO6M. This can be used as a baseline with which we can compare clinical groups.

Gesture as representational action: A paper about function

A great deal of attention has recently been paid to gesture and its effects on thinking and learning. It is well established that the hand movements that accompany speech are an integral part of communication, ubiquitous across cultures, and a unique feature of human behavior. In an attempt to understand this intriguing phenomenon, researchers have focused on pinpointing the mechanisms that underlie gesture production. One proposal--that gesture arises from simulated action (Hostetter & Alibali Psychonomic Bulletin & Review, 15, 495-514, 2008)--has opened up discussions about action, gesture, and the relation between the two. However, there is another side to understanding a phenomenon and that is to understand its function. A phenomenon's function is its purpose rather than its precipitating cause--the why rather than the how. This paper sets forth a theoretical framework for exploring why gesture serves the functions that it does, and reviews where the current literature fits, and fails to fit, this proposal. Our framework proposes that whether or not gesture is simulated action in terms of its mechanism--it is clearly not reducible to action in terms of its function. Most notably, because gestures are abstracted representations and are not actions tied to particular events and objects, they can play a powerful role in thinking and learning beyond the particular, specifically, in supporting generalization and transfer of knowledge.

Developmental change in children's sensitivity to sound symbolism

The current study examined developmental change in children's sensitivity to sound symbolism. Three-, five-, and seven-year-old children heard sound symbolic novel words and foreign words meaning round and pointy and chose which of two pictures (one round and one pointy) best corresponded to each word they heard. Task performance varied as a function of both word type and age group such that accuracy was greater for novel words than for foreign words, and task performance increased with age for both word types. For novel words, children in all age groups reliably chose the correct corresponding picture. For foreign words, 3-year-olds showed chance performance, whereas 5- and 7-year-olds showed reliably above-chance performance. Results suggest increased sensitivity to sound symbolic cues with development and imply that although sensitivity to sound symbolism may be available early and facilitate children's word-referent mappings, sensitivity to subtler sound symbolic cues requires greater language experience.

Arbitrariness, Iconicity, and Systematicity in Language

The notion that the form of a word bears an arbitrary relation to its meaning accounts only partly for the attested relations between form and meaning in the languages of the world. Recent research suggests a more textured view of vocabulary structure, in which arbitrariness is complemented by iconicity (aspects of form resemble aspects of meaning) and systematicity (statistical regularities in forms predict function). Experimental evidence suggests these form-to-meaning correspondences serve different functions in language processing, development, and communication: systematicity facilitates category learning by means of phonological cues, iconicity facilitates word learning and communication by means of perceptuomotor analogies, and arbitrariness facilitates meaning individuation through distinctive forms. Processes of cultural evolution help to explain how these competing motivations shape vocabulary structure.

Iconicity and the Emergence of Combinatorial Structure in Language

In language, recombination of a discrete set of meaningless building blocks forms an unlimited set of possible utterances. How such combinatorial structure emerged in the evolution of human language is increasingly being studied. It has been shown that it can emerge when languages culturally evolve and adapt to human cognitive biases. How the emergence of combinatorial structure interacts with the existence of holistic iconic form-meaning mappings in a language is still unknown. The experiment presented in this paper studies the role of iconicity and human cognitive learning biases in the emergence of combinatorial structure in artificial whistled languages. Participants learned and reproduced whistled words for novel objects with the use of a slide whistle. Their reproductions were used as input for the next participant, to create transmission chains and simulate cultural transmission. Two conditions were studied: one in which the persistence of iconic form-meaning mappings was possible and one in which this was experimentally made impossible. In both conditions, cultural transmission caused the whistled languages to become more learnable and more structured, but this process was slightly delayed in the first condition. Our findings help to gain insight into when and how words may lose their iconic origins when they become part of an organized linguistic system.

What makes a movement a gesture?

Theories of how adults interpret the actions of others have focused on the goals and intentions of actors engaged in object-directed actions. Recent research has challenged this assumption, and shown that movements are often interpreted as being for their own sake (Schachner & Carey, 2013). Here we postulate a third interpretation of movement-movement that represents action, but does not literally act on objects in the world. These movements are gestures. In this paper, we describe a framework for predicting when movements are likely to be seen as representations. In Study 1, adults described one of three scenes: (1) an actor moving objects, (2) an actor moving her hands in the presence of objects (but not touching them) or (3) an actor moving her hands in the absence of objects. Participants systematically described the movements as depicting an object-directed action when the actor moved objects, and favored describing the movements as depicting movement for its own sake when the actor produced the same movements in the absence of objects. However, participants favored describing the movements as representations when the actor produced the movements near, but not on, the objects. Study 2 explored two additional features-the form of an actor's hands and the presence of speech-like sounds-to test the effect of context on observers' classification of movement as representational. When movements are seen as representations, they have the power to influence communication, learning, and cognition in ways that movement for its own sake does not. By incorporating representational gesture into our framework for movement analysis, we take an important step towards developing a more cohesive understanding of action-interpretation.

Comprehension of iconic gestures by chimpanzees and human children

Iconic gestures-communicative acts using hand or body movements that resemble their referent-figure prominently in theories of language evolution and development. This study contrasted the abilities of chimpanzees (N=11) and 4-year-old human children (N=24) to comprehend novel iconic gestures. Participants learned to retrieve rewards from apparatuses in two distinct locations, each requiring a different action. In the test, a human adult informed the participant where to go by miming the action needed to obtain the reward. Children used the iconic gestures (more than arbitrary gestures) to locate the reward, whereas chimpanzees did not. Some children also used arbitrary gestures in the same way, but only after they had previously shown comprehension for iconic gestures. Over time, chimpanzees learned to associate iconic gestures with the appropriate location faster than arbitrary gestures, suggesting at least some recognition of the iconicity involved. These results demonstrate the importance of iconicity in referential communication.

Learning from gesture: How early does it happen?

Iconic gesture is a rich source of information for conveying ideas to learners. However, in order to learn from iconic gesture, a learner must be able to interpret its iconic form-a nontrivial task for young children. Our study explores how young children interpret iconic gesture and whether they can use it to infer a previously unknown action. In Study 1, 2- and 3-year-old children were shown iconic gestures that illustrated how to operate a novel toy to achieve a target action. Children in both age groups successfully figured out the target action more often after seeing an iconic gesture demonstration than after seeing no demonstration. However, the 2-year-olds (but not the 3-year-olds) figured out fewer target actions after seeing an iconic gesture demonstration than after seeing a demonstration of an incomplete-action and, in this sense, were not yet experts at interpreting gesture. Nevertheless, both age groups seemed to understand that gesture could convey information that can be used to guide their own actions, and that gesture is thus not movement for its own sake. That is, the children in both groups produced the action displayed in gesture on the object itself, rather than producing the action in the air (in other words, they rarely imitated the experimenter's gesture as it was performed). Study 2 compared 2-year-olds' performance following iconic vs. point gesture demonstrations. Iconic gestures led children to discover more target actions than point gestures, suggesting that iconic gesture does more than just focus a learner's attention, it conveys substantive information about how to solve the problem, information that is accessible to children as young as 2. The ability to learn from iconic gesture is thus in place by toddlerhood and, although still fragile, allows children to process gesture, not as meaningless movement, but as an intentional communicative representation.

Iconicity as structure mapping

Linguistic and psycholinguistic evidence is presented to support the use of structure-mapping theory as a framework for understanding effects of iconicity on sign language grammar and processing. The existence of structured mappings between phonological form and semantic mental representations has been shown to explain the nature of metaphor and pronominal anaphora in sign languages. With respect to processing, it is argued that psycholinguistic effects of iconicity may only be observed when the task specifically taps into such structured mappings. In addition, language acquisition effects may only be observed when the relevant cognitive abilities are in place (e.g. the ability to make structural comparisons) and when the relevant conceptual knowledge has been acquired (i.e. information key to processing the iconic mapping). Finally, it is suggested that iconicity is better understood as a structured mapping between two mental representations than as a link between linguistic form and human experience.

Do iconic gestures pave the way for children's early verbs?

Children produce a deictic gesture for a particular object (point at dog) approximately three months before they produce the verbal label for that object ("dog") (Iverson & Goldin-Meadow, 2005). Gesture thus paves the way for children's early nouns. We ask here whether the same pattern-gesture preceding and predicting speech-holds for iconic gestures-that is, do gestures that depict actions precede and predict early verbs? We observed spontaneous speech and gestures produced by 40 children (22 girls, 18 boys) from age 14 to 34 months. Children produced their first iconic gestures 6 months later than they produced their first verbs. Thus, unlike the onset of deictic gestures, the onset of iconic gestures conveying action meanings followed, rather than preceded, children's first verbs. However, iconic gestures increased in frequency at the same time as verbs did and, at that time, began to convey meanings not yet expressed in speech. Our findings suggest that children can use gesture to expand their repertoire of action meanings, but only after they have begun to acquire the verb system underlying their language.

The bridge of iconicity: from a world of experience to the experience of language

Iconicity, a resemblance between properties of linguistic form (both in spoken and signed languages) and meaning, has traditionally been considered to be a marginal, irrelevant phenomenon for our understanding of language processing, development and evolution. Rather, the arbitrary and symbolic nature of language has long been taken as a design feature of the human linguistic system. In this paper, we propose an alternative framework in which iconicity in face-to-face communication (spoken and signed) is a powerful vehicle for bridging between language and human sensori-motor experience, and, as such, iconicity provides a key to understanding language evolution, development and processing. In language evolution, iconicity might have played a key role in establishing displacement (the ability of language to refer beyond what is immediately present), which is core to what language does; in ontogenesis, iconicity might play a critical role in supporting referentiality (learning to map linguistic labels to objects, events, etc., in the world), which is core to vocabulary development. Finally, in language processing, iconicity could provide a mechanism to account for how language comes to be embodied (grounded in our sensory and motor systems), which is core to meaningful communication.

Manual signing in adults with intellectual disability: influence of sign characteristics on functional sign vocabulary

PURPOSE

The purpose of this study was to investigate the influence of sign characteristics in a key word signing (KWS) system on the functional use of those signs by adults with intellectual disability (ID).

METHOD

All 507 signs from a Flemish KWS system were characterized in terms of phonological, iconic, and referential characteristics. Phonological and referential characteristics were assigned to the signs by speech-language pathologists. The iconicity (i.e., transparency, guessing the meaning of the sign; and translucency, rating on a 6-point scale) of the signs were tested in 467 students. Sign functionality was studied in 119 adults with ID (mean mental age of 50.54 months) by means of a questionnaire, filled out by a support worker.

RESULTS

A generalized linear model with a negative binomial distribution (with log-link) showed that semantic category was the factor with the strongest influence on sign functionality, with grammatical class, referential concreteness, and translucency also playing a part. No sign phonological characteristics were found to be of significant influence on sign use.

CONCLUSION

The meaning of a sign is the most important factor regarding its functionality (i.e., whether a sign is used in everyday communication). Phonological characteristics seem only of minor importance.

The road to language learning is iconic: evidence from British Sign Language

An arbitrary link between linguistic form and meaning is generally considered a universal feature of language. However, iconic (i.e., nonarbitrary) mappings between properties of meaning and features of linguistic form are also widely present across languages, especially signed languages. Although recent research has shown a role for sign iconicity in language processing, research on the role of iconicity in sign-language development has been mixed. In this article, we present clear evidence that iconicity plays a role in sign-language acquisition for both the comprehension and production of signs. Signed languages were taken as a starting point because they tend to encode a higher degree of iconic form-meaning mappings in their lexicons than spoken languages do, but our findings are more broadly applicable: Specifically, we hypothesize that iconicity is fundamental to all languages (signed and spoken) and that it serves to bridge the gap between linguistic form and human experience.

15-month-old infants fast map words but not representational gestures of multimodal labels

This study investigated whether 15-month-old infants fast map multimodal labels, and, when given the choice of two modalities, whether they preferentially fast map one better than the other. Sixty 15-month-old infants watched films where an actress repeatedly and ostensively labeled two novel objects using a spoken word along with a representational gesture. In the test phase, infants were assigned to one of three conditions: Word, Word + Gesture, or Gesture. The objects appeared in a shelf next to the experimenter and, depending on the condition, infants were prompted with either a word, a gesture, or a multimodal word-gesture combination. Using an infant eye tracker, we determined whether infants made the correct mappings. Results revealed that only infants in the Word condition had learned the novel object labels. When the representational gesture was presented alone or when the verbal label was accompanied by a representational gesture, infants did not succeed in making the correct mappings. Results reveal that 15-month-old infants do not benefit from multimodal labeling and that they prefer words over representational gestures as object labels in multimodal utterances. Findings put into question the role of multimodal labeling in early language development.

Investigation of the effectiveness of traffic sign training in terms of training methods and sign characteristics

OBJECTIVE

This research investigated whether different training methods had any effect on the effectiveness of traffic sign training and whether there were any relationships between traffic sign characteristics and effectiveness of the training.

METHODS

Thirty-six participants were randomly assigned into 4 equal-sized groups (control, paired-associate learning, recall training, and recognition training) to study the learnability of Mainland China traffic signs. In paired-associate learning, participants studied each traffic sign along with a referent describing its meaning. In addition to being informed of the meaning of traffic signs, both recall training and recognition training provided participants with questions and feedback. For recall training, the questioning process was a recall task in which participants had to produce a meaning for a given traffic sign from memory. For recognition training, the questioning process was a recognition task that required participants to identify the most appropriate referent corresponding to a given sign. No traffic sign training was given to the control group.

RESULTS

Each training method significantly improved comprehension of the meaning of traffic signs. Participants from recall training performed better in a posttraining test than those from paired-associate learning and recognition training, indicating that the recall training elicited a deeper level of learning. In addition, questioning and feedback had a positive influence on training effectiveness. Performance in the posttest was found to be better when the questioning process matched the test process. Regarding the traffic sign characteristics, semantic closeness had a long-lasting effect, in terms of the timescale of this experiment on traffic sign comprehension, and traffic signs were perceived as more meaningful after their intended meanings were studied.

CONCLUSIONS

Recall training is more effective in enhancing comprehension of traffic signs than paired-associate learning and recognition training. The findings of this study provide a basis for useful recommendations for designing symbol-training programs to improve road safety for road users.

Iconicity as a general property of language: evidence from spoken and signed languages

Current views about language are dominated by the idea of arbitrary connections between linguistic form and meaning. However, if we look beyond the more familiar Indo-European languages and also include both spoken and signed language modalities, we find that motivated, iconic form-meaning mappings are, in fact, pervasive in language. In this paper, we review the different types of iconic mappings that characterize languages in both modalities, including the predominantly visually iconic mappings found in signed languages. Having shown that iconic mapping are present across languages, we then proceed to review evidence showing that language users (signers and speakers) exploit iconicity in language processing and language acquisition. While not discounting the presence and importance of arbitrariness in language, we put forward the idea that iconicity need also be recognized as a general property of language, which may serve the function of reducing the gap between linguistic form and conceptual representation to allow the language system to "hook up" to motor, perceptual, and affective experience.

Effects of sign characteristics and training methods on safety sign training effectiveness

This study investigated whether or not training methods affected the effectiveness of symbol training and if there were any relationships between sign symbol characteristics and training effectiveness. Altogether, 26 Mainland China industrial safety signs were used and 60 participants were randomly assigned into four equal-sized groups of control, paired-associate learning, recall training and recognition training. The result was that participants from all the training groups showed significantly greater improvement in comprehension performance than those in the control group, indicating that the training methods improved comprehension of the meaning of safety signs. Participants from the recall training group performed better in the post-training test than those from other training groups. It seems that the recall task elicited a deeper level of learning than the recognition task and that questioning and feedback had a positive effect on training effectiveness. The results also showed that sign characteristics had no significant influence on training effectiveness. It was concluded that recall training is more effective in enhancing comprehension of industrial safety signs than paired-associate learning or recognition training. The findings of this study provide a basis for useful guidelines for designing symbol-training programmes and for designing more user-friendly safety signs. STATEMENT OF RELEVANCE: The present study shows that recall training was more effective in improving comprehension of industrial safety signs than paired-associate learning or recognition training and cognitive sign features did not influence training effectiveness. They provide a basis for useful guidelines for designing symbol-training programmes and for designing more user-friendly safety signs.