Activation of writing-specific brain regions when reading Chinese as a second language. Effects of training modality and transfer to novel characters

Neural representation of sensorimotor features in language-motor areas during auditory and visual perception

Speech processing involves a complex interplay between sensory and motor systems in the brain, essential for early language development. Recent studies have extended this sensory-motor interaction to visual word processing, emphasizing the connection between reading and handwriting during literacy acquisition. Here we show how language-motor areas encode motoric and sensory features of language stimuli during auditory and visual perception, using functional magnetic resonance imaging (fMRI) combined with representational similarity analysis. Chinese-speaking adults completed tasks involving the perception of spoken syllables and written characters, alongside syllable articulation and finger writing tasks to localize speech-motor and writing-motor areas. We found that both language-motor and sensory areas generally encode production-related motoric features across modalities, indicating cooperative interactions between motor and sensory systems. Notably, sensory encoding within sensorimotor areas was observed during auditory speech perception, but not in visual character perception. These findings underscore the dual encoding capacities of language-motor areas, revealing both shared and distinct neural representation patterns across modalities, which may be linked to innate sensory-motor mechanisms and modality-specific processing demands. Our results shed light on the sensorimotor integration mechanisms underlying language perception, highlighting the importance of a cross-modality perspective.

How Characters Are Learned Leaves Its Mark on the Neural Substrates of Chinese Reading

Understanding how the brain functions differently as one learns to read may shed light on the controversial nature of the reading ability of human being. Logographic writing system such as Chinese has been found to rely on specialized neural substrates beyond the reading network of alphabetic languages. The ability to read in Chinese has also been proposed to rely on writing skills. However, it was unclear whether the learning-related alteration of neural responses was language specific or resulted from the more reliance on writing practice during acquisition. This study investigated whether the emergence of typical logographic-specific regions relied on learning by writing. We taught proficient alphabetic language readers Chinese characters and used pre-test and post-test to identify changes in two critical stages of reading, namely, orthographic processing and orthographic-to-phonological mapping. Two typical left hemispheric areas for logographic reading showed increased responses to characters in the brains of proficient alphabetic readers after learning, regardless of whether the learning strategy involved writing practice. Moreover, learning strategy modulated the response magnitude or multivoxel patterns in the left superior parietal lobule, left middle frontal gyrus, and right fusiform gyrus, some of which were task dependent. The findings corroborated a limited role of writing in the emergence of logographic-specific reading network and suggested the heterogeneous nature of different brain regions in this network.

The Differences in the Whole-Brain Functional Network between Cantonese-Mandarin Bilinguals and Mandarin Monolinguals

Cantonese-Mandarin bilinguals are logographic-logographic bilinguals that provide a unique population for bilingual studies. Whole brain functional connectivity analysis makes up for the deficiencies of previous bilingual studies on the seed-based approach and helps give a complete picture of the brain connectivity profiles of logographic-logographic bilinguals. The current study is to explore the effect of the long-term logographic-logographic bilingual experience on the functional connectivity of the whole-brain network. Thirty Cantonese-Mandarin bilingual and 30 Mandarin monolingual college students were recruited in the study. Resting state functional magnetic resonance imaging (rs-fMRI) was performed to investigate the whole-brain functional connectivity differences by network-based statistics (NBS), and the differences in network efficiency were investigated by graph theory between the two groups (false discovery rate corrected for multiple comparisons, q = 0.05). Compared with the Mandarin monolingual group, Cantonese-Mandarin bilinguals increased functional connectivity between the bilateral frontoparietal and temporal regions and decreased functional connectivity in the bilateral occipital cortex and between the right sensorimotor region and bilateral prefrontal cortex. No significant differences in network efficiency were found between the two groups. Compared with the Mandarin monolinguals, Cantonese-Mandarin bilinguals had no significant discrepancies in network efficiency. However, the Cantonese-Mandarin bilinguals developed a more strongly connected subnetwork related to language control, inhibition, phonological and semantic processing, and memory retrieval, whereas a weaker connected subnetwork related to visual and phonology processing, and speech production also developed.

Brain Activity during Visual and Auditory Word Rhyming Tasks in Cantonese-Mandarin-English Trilinguals

It is unclear whether the brain activity during phonological processing of second languages (L2) is similar to that of the first language (L1) in trilingual individuals, especially when the L1 is logographic, and the L2s are logographic and alphabetic, respectively. To explore this issue, this study examined brain activity during visual and auditory word rhyming tasks in Cantonese–Mandarin–English trilinguals. Thirty Chinese college students whose L1 was Cantonese and L2s were Mandarin and English were recruited. Functional magnetic resonance imaging (fMRI) was conducted while subjects performed visual and auditory word rhyming tasks in three languages (Cantonese, Mandarin, and English). The results revealed that in Cantonese–Mandarin–English trilinguals, whose L1 is logographic and the orthography of their L2 is the same as L1—i.e., Mandarin and Cantonese, which share the same set of Chinese characters—the brain regions for the phonological processing of L2 are different from those of L1; when the orthography of L2 is quite different from L1, i.e., English and Cantonese who belong to different writing systems, the brain regions for the phonological processing of L2 are similar to those of L1. A significant interaction effect was observed between language and modality in bilateral lingual gyri. Regions of interest (ROI) analysis at lingual gyri revealed greater activation of this region when using English than Cantonese and Mandarin in visual tasks.

Chinese characters are read using not only visual but also writing motor information

It has been suggested that mature reading systems consist of both a visual analysis decoding system and a motor gesture decoding system that facilitates reading by processing writing motor information. However, there is still uncertainty about the mechanisms and effectiveness of the latter system when reading Chinese characters. This study therefore aimed to provide empirical neural evidence for this phenomenon using a writing video as prompt in a delayed sequential same/different judgment task. We investigated whether and how the orthographic processing of target characters was modulated by the writing direction of the prompt (forward vs. backward) and the character repetition (repeat vs. nonrepeat) between the prompt and target characters. The results indicated that (a) the N170 component was more negative under the forward condition than under the backward condition; and (b) both writing direction and character repetition modulated the centro-parietal N200 component. These writing-direction effects were specific to Chinese characters--they did not apply to Korean characters, which are visually similar to Chinese characters but unfamiliar to the participants. These results suggest that the experience of learning Chinese might establish a motor gesture decoding system for reading, which begins to perform general orthographic representation at an early stage and works together with the visual analysis decoding system to achieve deep orthographic processing.

The role of phonology during visual word learning in adults: An integrative review

Throughout their lifetime, adults learn new words in their native lannguage, and potentially also in a second language. However, they do so with variable levels of success. In the auditory word learning literature, some of this variability has been attributed to phonological skills, including decoding and phonological short-term memory. Here I examine how the relationship between phonological skills and word learning applies to the visual modality. I define the availability of phonology in terms of (1) the extent to which it is biased by the learning environment, (2) the characteristics of the words to be learned, and (3) individual differences in phonological skills. Across these three areas of research, visual word learning improves when phonology is made more available to adult learners, suggesting that phonology can facilitate learning across modalities. However, the facilitation is largely specific to alphabetic languages, which have predictable sublexical correspondences between orthography and phonology. Therefore, I propose that phonology bootstraps visual word learning by providing a secondary code that constrains and refines developing orthographic representations.