The Effects of Age, Gender and Test Stimuli on Visual Speech Perception: A Preliminary Study

The effects of watching subtitled videos on the perception of L2 connected speech by L1 Chinese-L2 English speakers

The current study explores whether watching subtitled videos could facilitate L1 Chinese-L2 English speakers' perception of L2 English connected speech. Three hundred ninty seven Chinese college students of L2 English completed a video-based spot dictation task after watching English videos with or without L1/L2 subtitles, featuring various connected speech types (e.g., linking, deletion, and their combinations). Results suggested an overall facilitation effect of watching videos on L2 connected speech perception, which was modulated by proficiency, subtitle form, and the complexity of connected speech. First, subtitled videos were more facilitative than non-subtitled videos in L2 perception. Second, participants with higher L2 proficiency better perceived English connected speech than those with lower proficiency. Third, the more connective devices an item used, the more difficult it was for L2 perception. When this complexity was controlled, the L2 perception was not influenced by connected speech type. Finally, the complexity of connected speech also mediated the subtitle facilitation effects. When the connected speech involved triple connective devices, L2 speakers benefited more from L1 subtitles than L2 subtitles. The findings can provide insights into multi-modal speech perception and English connected speech learning.

Auditory, Visual, and Cognitive Abilities in Normal-Hearing Adults, Hearing Aid Users, and Cochlear Implant Users

OBJECTIVES

Speech understanding is considered a bimodal and bidirectional process, whereby visual information (i.e., speechreading) and also cognitive functions (i.e., top-down processes) are involved. Therefore, the purpose of the present study is twofold: (1) to investigate the auditory (A), visual (V), and cognitive (C) abilities in normal-hearing individuals, hearing aid (HA) users, and cochlear implant (CI) users, and (2) to determine an auditory, visual, cognitive (AVC)-profile providing a comprehensive overview of a person's speech processing abilities, containing a broader variety of factors involved in speech understanding.

DESIGN

Three matched groups of subjects participated in this study: (1) 31 normal-hearing adults (mean age = 58.76), (2) 31 adults with moderate to severe hearing loss using HAs (mean age = 59.31), (3) 31 adults with a severe to profound hearing loss using a CI (mean age = 58.86). The audiological assessments consisted of pure-tone audiometry, speech audiometry in quiet and in noise. For evaluation of the (audio-) visual speech processing abilities, the Test for (Audio) Visual Speech perception was used. The cognitive test battery consisted of the letter-number sequencing task, the letter detection test, and an auditory Stroop test, measuring working memory and processing speed, selective attention, and cognitive flexibility and inhibition, respectively. Differences between the three groups were examined using a one-way analysis of variance or Kruskal-Wallis test, depending on the normality of the variables. Furthermore, a principal component analysis was conducted to determine the AVC-profile.

RESULTS

Normal-hearing individuals scored better for both auditory, and cognitive abilities compared to HA users and CI users, listening in a best aided condition. No significant differences were found for speech understanding in a visual condition, despite a larger audiovisual gain for the HA users and CI users. Furthermore, an AVC-profile was composed based on the different auditory, visual, and cognitive assessments. On the basis of that profile, it is possible to determine one comprehensive score for auditory, visual, and cognitive functioning. In the future, these scores could be used in auditory rehabilitation to determine specific strengths and weaknesses per individual patient for the different abilities related to the process of speech understanding in daily life.

CONCLUSIONS

It is suggested to evaluate individuals with hearing loss from a broader perspective, considering more than only the typical auditory abilities. Also, cognitive and visual abilities are important to take into account to have a more complete overview of the speech understanding abilities in daily life.