Developmental differences in the influence of phonological similarity on spoken word processing in Mandarin Chinese

Tracking the time-course of spoken word recognition of Cantonese Chinese in sentence context: Evidence from eye movements

In this study, we conducted an eye-tracking experiment to investigate the effects of sentence context and tonal information on spoken word recognition processes in Cantonese Chinese. We recruited 60 native Cantonese listeners to participate in the eye-tracking experiment. The target words (phonologically similar words) were manipulated to either (1) a congruent context or (2) an incongruent context in the experiment. The resulting eye-movement patterns in the incongruent context condition clearly revealed that (1) sentence context produced a garden-path effect in the initial stage of the spoken word recognition processes and then (2) the lexical tone of the word (bottom-up information) overrode the contextual effects to help listeners to discriminate between different similar-sounding words during lexical access. In conclusion, the patterns of eye-tracking data show the interactive processes between the lexical tone (an acoustic cue within a Cantonese word) and sentence context played in different phases to the spoken word recognition of Cantonese Chinese.

Evaluating the Relative Perceptual Salience of Linguistic and Emotional Prosody in Quiet and Noisy Contexts

How people recognize linguistic and emotional prosody in different listening conditions is essential for understanding the complex interplay between social context, cognition, and communication. The perception of both lexical tones and emotional prosody depends on prosodic features including pitch, intensity, duration, and voice quality. However, it is unclear which aspect of prosody is perceptually more salient and resistant to noise. This study aimed to investigate the relative perceptual salience of emotional prosody and lexical tone recognition in quiet and in the presence of multi-talker babble noise. Forty young adults randomly sampled from a pool of native Mandarin Chinese with normal hearing listened to monosyllables either with or without background babble noise and completed two identification tasks, one for emotion recognition and the other for lexical tone recognition. Accuracy and speed were recorded and analyzed using generalized linear mixed-effects models. Compared with emotional prosody, lexical tones were more perceptually salient in multi-talker babble noise. Native Mandarin Chinese participants identified lexical tones more accurately and quickly than vocal emotions at the same signal-to-noise ratio. Acoustic and cognitive dissimilarities between linguistic prosody and emotional prosody may have led to the phenomenon, which calls for further explorations into the underlying psychobiological and neurophysiological mechanisms.

ERP Indicators of Phonological Awareness Development in Children: A Systematic Review

Phonological awareness is the ability to correctly recognize and manipulate phonological structures. The role of phonological awareness in reading development has become evident in behavioral research showing that it is inherently tied to measures of phonological processing and reading ability. This has also been shown with ERP research that examined how phonological processing training can benefit reading skills. However, there have not been many attempts to systematically review how phonological awareness itself is developed neurocognitively. In the present review, we screened 224 papers and systematically reviewed 40 papers that have explored phonological awareness and phonological processing using ERP methodology with both typically developing and children with reading problems. This review highlights ERP components that can be used as neurocognitive predictors of early developmental dyslexia and reading disorders in young children. Additionally, we have presented how phonological processing is developed neurocognitively throughout childhood, as well as which phonological tasks can be used to predict the development of phonological awareness prior to developing reading skills. Neurocognitive measures of early phonological processing can serve as supplemental diagnostic sources to behavioral measures of reading abilities because they show different aspects of phonological sensitivity when compared to behavioral measures.

Database of word-level statistics for Mandarin Chinese (DoWLS-MAN)

In this article we present the Database of Word-Level Statistics for Mandarin Chinese (DoWLS-MAN). The database addresses the lack of agreement in phonological syllable segmentation specific to Mandarin by offering phonological features for each lexical item according to 16 schematic representations of the syllable (8 with tone and 8 without tone). Those lexical statistics that differ per phonological word and nonword due to changes in syllable segmentation are of the variant category and include subtitle lexical frequency, phonological neighborhood density measures, homophone density, and network science measures. The invariant characteristics consist of each items' lexical tone, phonological transcription, and syllable structure among others. The goal of DoWLS-MAN is to provide researchers both the ability to choose stimuli that are derived from a segmentation schema that supports an existing model of Mandarin speech processing, and the ability to choose stimuli that allow for the testing of hypotheses on phonological segmentation according to multiple schemas. In an exploratory analysis we illustrate how multiple schematic representations of the phonological mental lexicon can aid in hypothesis generation, specifically in terms of phonological processing when reading Chinese orthography. Users of the database can search among over 92,000 words, over 1600 out-of-vocabulary Chinese characters, and 4300 phonological nonwords according to either Chinese orthography, pinyin, or ASCII phonetic script. Users can also generate a list of phonological words and nonwords according to user-defined ranges and categories of lexical characteristics. DoWLS-MAN is available to the public for search or download at https://dowls.site .

The Roles of Consonant, Rime, and Tone in Mandarin Spoken Word Recognition: An Eye-Tracking Study

This study investigated the relative role of sub-syllabic components (initial consonant, rime, and tone) in spoken word recognition of Mandarin Chinese using an eye-tracking experiment with a visual world paradigm. Native Mandarin speakers (all born and grew up in Beijing) were presented with four pictures and an auditory stimulus. They were required to click the picture according to the sound stimulus they heard, and their eye movements were tracked during this process. For a target word (e.g., tang2 "candy"), nine conditions of competitors were constructed in terms of the amount of their phonological overlap with the target: consonant competitor (e.g., ti1 "ladder"), rime competitor (e.g., lang4 "wave"), tone competitor (e.g., niu2 "cow"), consonant plus rime competitor (e.g., tang1"soup"), consonant plus tone competitor (e.g., tou2 "head"), rime plus tone competitor (e.g., yang2 "sheep"), cohort competitor (e.g., ta3 "tower"), cohort plus tone competitor (e.g., tao2 "peach"), and baseline competitor (e.g., xue3 "snow"). A growth curve analysis was conducted with the fixation to competitors, targets, and distractors, and the results showed that (1) competitors with consonant or rime overlap can be adequately activated, while tone overlap plays a weaker role since additional tonal information can strengthen the competitive effect only when it was added to a candidate that already bears much phonological similarity with the target. (2) Mandarin words are processed in an incremental way in the time course of word recognition since different partially overlapping competitors could be activated immediately; (3) like the pattern found in English, both cohort and rime competitors were activated to compete for lexical activation, but these two competitors were not temporally distinctive and mainly differed in the size of their competitive effects. Generally, the gradation of activation based on the phonological similarity between target and candidates found in this study was in line with the continuous mapping models and may reflect a strategy of native speakers shaped by the informative characteristics of the interaction among different sub-syllabic components.

The temporal dynamics of first and second language processing: ERPs to spoken words in Mandarin-English bilinguals

The dynamics of bilingual spoken word recognition remain poorly characterized, especially for individuals who speak two languages that are highly dissimilar in their phonological and morphological structure. The present study compared first language (L1) and second language (L2) spoken word processing within a group of adult Mandarin-English bilinguals (N = 34; ages 18-25). Event-related potentials (ERPs) were recorded while participants completed the same cross-modal matching task separately in their L1 Mandarin and L2 English. This task consisted of deciding whether spoken words matched pictures of items. Pictures and spoken words either matched (e.g., Mandarin: TANG2-tang2; English: BELL-bell), or differed in word-initial phonemes (e.g., Mandarin: TANG2-lang2; English: BELL-shell), word-final phonemes (e.g., Mandarin: TANG2-tao2; English: BELL-bed), or whole words (e.g., Mandarin: TANG2-xia1: English: BELL-ham). Each mismatch type was associated with a pattern of modulation of the Phonological Mapping Negativity, the N400, and the Late N400 that was distinct from those of the other mismatch types yet similar between the two languages. This was interpreted as evidence of incremental processing with similar temporal dynamics in both languages. These findings support models of spoken word recognition in bilingual individuals that adopt an interactive-activation framework for both L1 and L2 processing.

Phonological P2 or PMN During Spoken Word Recognition in Mandarin Chinese

Abstract. Word-initial phonological mismatches during spoken word recognition often elicit an event-related potential (ERP) component, namely, the phonological mapping negativity (PMN) in cross-modal priming studies or studies using sentence as context. However, recent studies also reported that a phonological P2 but not PMN has been observed for Mandarin Chinese spoken word recognition in unimodal word-matching and meaning-matching experiments, that is, both the prime and target words were presented auditorily. In the present study, the same pairs of disyllabic Mandarin Chinese words as in the prior unimodal studies were used as stimuli to investigate whether or not the phonological P2 effect is modulated by prime modality and can be replicated in a cross-modal design (i.e., written primes followed by spoken targets). Both the phonological and semantic relations between primes and targets were manipulated. Participants were instructed to judge whether the meaning of the two words were same or not. An enhanced PMN between 250 and 320 ms was elicited by word-initial phonological mismatches. In the later time window, centro-parietally distributed early N400 and late N400 were elicited in semantically unrelated conditions. The presence of PMN instead of P2 in the current study implies that ERP markers of word-initial phonological mismatches during spoken word recognition are modulated by the modality of primes at the level of phonological analysis.

Visual attention shift to printed words during spoken word recognition in Chinese: The role of phonological information

The aim of this study was to investigate the extent to which phonological information mediates the visual attention shift to printed Chinese words in spoken word recognition by using an eye-movement technique with a printed-word paradigm. In this paradigm, participants are visually presented with four printed words on a computer screen, which include a target word, a phonological competitor, and two distractors. Participants are then required to select the target word using a computer mouse, and the eye movements are recorded. In Experiment 1, phonological information was manipulated at the full-phonological overlap; in Experiment 2, phonological information at the partial-phonological overlap was manipulated; and in Experiment 3, the phonological competitors were manipulated to share either fulloverlap or partial-overlap with targets directly. Results of the three experiments showed that the phonological competitor effects were observed at both the full-phonological overlap and partial-phonological overlap conditions. That is, phonological competitors attracted more fixations than distractors, which suggested that phonological information mediates the visual attention shift during spoken word recognition. More importantly, we found that the mediating role of phonological information varies as a function of the phonological similarity between target words and phonological competitors.

Encoding lexical tones in jTRACE: a simulation of monosyllabic spoken word recognition in Mandarin Chinese

Despite its prevalence as one of the most highly influential models of spoken word recognition, the TRACE model has yet to be extended to consider tonal languages such as Mandarin Chinese. A key reason for this is that the model in its current state does not encode lexical tone. In this report, we present a modified version of the jTRACE model in which we borrowed on its existing architecture to code for Mandarin phonemes and tones. Units are coded in a way that is meant to capture the similarity in timing of access to vowel and tone information that has been observed in previous studies of Mandarin spoken word recognition. We validated the model by first simulating a recent experiment that had used the visual world paradigm to investigate how native Mandarin speakers process monosyllabic Mandarin words (Malins & Joanisse, 2010). We then subsequently simulated two psycholinguistic phenomena: (1) differences in the timing of resolution of tonal contrast pairs, and (2) the interaction between syllable frequency and tonal probability. In all cases, the model gave rise to results comparable to those of published data with human subjects, suggesting that it is a viable working model of spoken word recognition in Mandarin. It is our hope that this tool will be of use to practitioners studying the psycholinguistics of Mandarin Chinese and will help inspire similar models for other tonal languages, such as Cantonese and Thai.