Kinect-ing the Dots: Using Motion-Capture Technology to Distinguish Sign Language Linguistic From Gestural Expressions

Just as vocalization proceeds in a continuous stream in speech, so too do movements of the hands, face, and body in sign languages. Here, we use motion-capture technology to distinguish lexical signs in sign language from other common types of expression in the signing stream. One type of expression is constructed action, the enactment of (aspects of) referents and events by (parts of) the body. Another is classifier constructions, the manual representation of analogue and gradient motions and locations simultaneously with specified referent morphemes. The term signing is commonly used for all of these, but we show that not all visual signals in sign languages are of the same type. In this study of Israeli Sign Language, we use motion capture to show that the motion of lexical signs differs significantly along several kinematic parameters from that of the two other modes of expression: constructed action and the classifier forms. In so doing, we show how motion-capture technology can help to define the universal linguistic category "word," and to distinguish it from the expressive gestural elements that are commonly found across sign languages.

Simultaneous structures in sign languages: Acquisition and emergence

The visual-gestural modality affords its users simultaneous movement of several independent articulators and thus lends itself to simultaneous encoding of information. Much research has focused on the fact that sign languages coordinate two manual articulators in addition to a range of non-manual articulators to present different types of linguistic information simultaneously, from phonological contrasts to inflection, spatial relations, and information structure. Children and adults acquiring a signed language arguably thus need to comprehend and produce simultaneous structures to a greater extent than individuals acquiring a spoken language. In this paper, we discuss the simultaneous encoding that is found in emerging and established sign languages; we also discuss places where sign languages are unexpectedly sequential. We explore potential constraints on simultaneity in cognition and motor coordination that might impact the acquisition and use of simultaneous structures.

Show Me What You've B/Seen: A Brief History of Depiction

Already at a relatively early stage, modern sign language linguistics focused on the representation of (actions, locations, and motions of) referents (1) through the use of the body and its different articulators and (2) through the use of particular handshapes (in combination with an orientation, location, and/or movement). Early terminology for (1) includes role playing, role shifting, and role taking and for (2) classifier constructions/predicates and verbs of motion and location. More recently, however, new terms, including enactment and constructed action for (1) and depicting signs for (2) have been introduced. This article provides a brief overview of the history of enactment and depiction in the sign linguistic literature but mainly focuses on issues related to terminology (and terminology shifts). First, we consider the relation between role shifting and constructed action. We question the idea that these terms can be used interchangeably and rather suggest that they capture different, but related functions. Subsequently, we zoom in on the conceptualization of depicting signs, indicating verbs, pointing signs and fully lexical signs and the relation between these signs and the method of depicting. Where earlier research often associates depicting with the use of specific types of structures, we promote the idea that depicting is a semiotic diverse practice. In doing so, we show that the conceptualization of the different sign types and the terms that are used to refer to these phenomena do not accurately capture the way these signs are used in actual signed discourse and propose a reconceptualization of the different sign types in the lexico-grammar of Flemish Sign Language (VGT) as composite signs that can describe, depict and indicate meaning in various ways. In this way, this article illustrates (1) the risks that may come with the execution of terminology shifts and (2) the importance of making a clear distinction between form and function, i.e., we show that it is important to be careful with assuming a (too) exclusive relation between a certain function and one or more particular forms.

Acquisition of Classifier Constructions in HKSL by Bimodal Bilingual Deaf Children of Hearing Parents

The current study focuses on the acquisition of classifier constructions in Hong Kong Sign Language (HKSL) by a group of Deaf children of hearing parents, aided or implanted. These children have been mainstreamed together since kindergarten; but their learning environment supports dual language input in Cantonese and HKSL on a daily basis. Classifier constructions were chosen because previous research suggested full mastery at a late age when compared with other verb types, due to their morphosyntactic complexity. Also, crosslinguistic comparison between HKSL and Cantonese reveals differences in verb morphology as well as word order of the structures under investigation. We predicted that verb root and word order were the two domains for crosslingusitic interaction to occur. At the general level, given the specific learning environment and dual input condition, we examined if these Deaf child learners could ultimately acquire classifier constructions. Fifteen Deaf children divided into four groups based on duration of exposure to HKSL participated in the study. Two Deaf children born to Deaf parents and three native HKSL signers served as controls. A picture description task was designed to elicit classifier constructions containing either a transitive, a locative existential or a motion directional predicate. The findings revealed Deaf children's gradual convergence on the adult grammar despite late exposure to HKSL. Evidence of crosslinguistic influence on word order came from the Deaf children's initial adoption of a Cantonese structure for locative existential and motion directional predicates. There was also a prolonged period of adherence to the SVO order across all grades. However, within this SVO structure, the verb revealed increasing morphological complexity as a function of longer duration of exposure. We interpreted the findings using Language Synthesis, arguing that it was the selection of morphosyntactic features in Numeration that triggered crosslinguistic interaction between Cantonese and HKSL with bimodal bilinguals.