1
|
Liu X, Vermeylen L, Wisniewski D, Brysbaert M. The contribution of phonological information to visual word recognition: Evidence from Chinese phonetic radicals. Cortex 2020; 133:48-64. [PMID: 33099075 DOI: 10.1016/j.cortex.2020.09.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 07/09/2020] [Accepted: 09/17/2020] [Indexed: 11/28/2022]
Abstract
Lateralization is a critical characteristic of language production and also plays a role in visual word recognition. However, the neural mechanisms underlying the interactions between visual input and spoken word representations are still unclear. We investigated the contribution of sub-lexical phonological information in visual word processing by exploiting the fact that Chinese characters can contain phonetic radicals in either the left or right half of the character. FMRI data were collected while 39 Chinese participants read words in search of target color words. On the basis of whole-brain analysis and three laterality analyses of regions of interest, we argue that visual information from centrally presented Chinese characters is split in the fovea and projected to the contralateral visual cortex, from which phonological information can be extracted rapidly if the character contains a phonetic radical. Extra activation, suggestive of more effortful processing, is observed when the phonetic radical is situated in the left half of the character and therefore initially sent to the visual cortex in the right hemisphere that is less specialized for language processing. Our results are in line with the proposal that phonological information helps written word processing by means of top-down feedback.
Collapse
Affiliation(s)
- Xiaodong Liu
- Department of Experimental Psychology, Ghent University, Belgium.
| | - Luc Vermeylen
- Department of Experimental Psychology, Ghent University, Belgium
| | - David Wisniewski
- Department of Experimental Psychology, Ghent University, Belgium
| | - Marc Brysbaert
- Department of Experimental Psychology, Ghent University, Belgium
| |
Collapse
|
2
|
Does right hemisphere superiority sufficiently explain the left visual field advantage in face recognition? Atten Percept Psychophys 2019; 82:1205-1220. [DOI: 10.3758/s13414-019-01896-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
3
|
Hsiao JH, Cheung K. Visual Similarity of Words Alone Can Modulate Hemispheric Lateralization in Visual Word Recognition: Evidence From Modeling Chinese Character Recognition. Cogn Sci 2015; 40:351-72. [PMID: 25818722 DOI: 10.1111/cogs.12233] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2013] [Revised: 11/05/2014] [Accepted: 12/19/2014] [Indexed: 11/27/2022]
Abstract
In Chinese orthography, the most common character structure consists of a semantic radical on the left and a phonetic radical on the right (SP characters); the minority, opposite arrangement also exists (PS characters). Recent studies showed that SP character processing is more left hemisphere (LH) lateralized than PS character processing. Nevertheless, it remains unclear whether this is due to phonetic radical position or character type frequency. Through computational modeling with artificial lexicons, in which we implement a theory of hemispheric asymmetry in perception but do not assume phonological processing being LH lateralized, we show that the difference in character type frequency alone is sufficient to exhibit the effect that the dominant type has a stronger LH lateralization than the minority type. This effect is due to higher visual similarity among characters in the dominant type than the minority type, demonstrating the modulation of visual similarity of words on hemispheric lateralization.
Collapse
Affiliation(s)
| | - Kit Cheung
- Department of Computing, Imperial College London
| |
Collapse
|
4
|
Hsiao JH, Cheng L. The modulation of stimulus structure on visual field asymmetry effects: the case of Chinese character recognition. Q J Exp Psychol (Hove) 2013; 66:1739-55. [PMID: 23391072 DOI: 10.1080/17470218.2013.764902] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Recent research suggests that visual field (VF) asymmetry effects in visual recognition may be influenced by information distribution within the stimuli for the recognition task in addition to hemispheric processing differences: Stimuli with more information on the left have a right VF (RVF) advantage because the left part is closer to the centre, where the highest visual acuity is obtained. It remains unclear whether visual complexity distribution of the stimuli also has similar modulation effects. Here we used Chinese characters with contrasting structures-left-heavy, symmetric, and right-heavy, in terms of either visual complexity of components or information distribution defined by location of the phonetic component-and examined participants' naming performance. We found that left-heavy characters had the largest RVF advantage, followed by symmetric and right-heavy characters; this effect was only observed in characters that contrasted in information distribution, in which information for pronunciation was skewed to the phonetic component, but not in those that contrasted only in visual complexity distribution and had no phonetic component. This result provides strong evidence for the influence of information distribution within the stimuli on VF asymmetry effects; in contrast, visual complexity distribution within the stimuli does not have similar modulation effects.
Collapse
Affiliation(s)
- Janet H Hsiao
- a Department of Psychology , University of Hong Kong , Hong Kong
| | | |
Collapse
|
5
|
Yi W, Wu T, Chen W, Yuan TF, Luo B, Shan C, Li J, He S, Weng X. Left hemiparalexia of Chinese characters: neglect dyslexia or disruption of pathway of visual word form processing? Brain Struct Funct 2013; 219:283-92. [DOI: 10.1007/s00429-012-0499-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2012] [Accepted: 12/18/2012] [Indexed: 10/27/2022]
|
6
|
Obregón M, Shillcock R. Foveational complexity in single word identification: contralateral visual pathways are advantaged over ipsilateral pathways. Neuropsychologia 2012; 50:3279-83. [PMID: 22982485 DOI: 10.1016/j.neuropsychologia.2012.09.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2012] [Revised: 07/31/2012] [Accepted: 09/04/2012] [Indexed: 11/15/2022]
Abstract
Recognition of a single word is an elemental task in innumerable cognitive psychology experiments, but involves unexpected complexity. We test a controversial claim that the human fovea is vertically divided, with each half projecting to either the contralateral or ipsilateral hemisphere, thereby influencing foveal word recognition. We report a novel haploscope task: the two halves of a four-letter word were briefly presented to the two eyes in a Both condition (st|ep)(st|ep), a Contralateral condition (st|__)(__|ep), or an Ipsilateral condition (__|ep)(st|__), all yielding the same single word percept (step). The Both condition yielded superior perceptual recognition, followed by the contralateral projection, then the ipsilateral projection. These results demonstrate that the structure of the fovea influences even the recognition of short, foveally presented words. Projecting different parts of the same word to different hemispheres involves unforeseen complexities and opportunities for optimizing hemispheric coordination.
Collapse
Affiliation(s)
- Mateo Obregón
- School of Philosophy, Psychology, and Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK.
| | | |
Collapse
|
7
|
Hsiao JHW. Visual field differences in visual word recognition can emerge purely from perceptual learning: evidence from modeling Chinese character pronunciation. BRAIN AND LANGUAGE 2011; 119:89-98. [PMID: 21620456 DOI: 10.1016/j.bandl.2011.04.003] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2010] [Revised: 03/01/2011] [Accepted: 04/18/2011] [Indexed: 05/30/2023]
Abstract
In Chinese orthography, a dominant character structure exists in which a semantic radical appears on the left and a phonetic radical on the right (SP characters); a minority opposite arrangement also exists (PS characters). As the number of phonetic radical types is much greater than semantic radical types, in SP characters the information is skewed to the right, whereas in PS characters it is skewed to the left. Through training a computational model for SP and PS character recognition that takes into account of the locations in which the characters appear in the visual field during learning, but does not assume any fundamental hemispheric processing difference, we show that visual field differences can emerge as a consequence of the fundamental structural differences in information between SP and PS characters, as opposed to the fundamental processing differences between the two hemispheres. This modeling result is also consistent with behavioral naming performance. This work provides strong evidence that perceptual learning, i.e., the information structure of word stimuli to which the readers have long been exposed, is one of the factors that accounts for hemispheric asymmetry effects in visual word recognition.
Collapse
|
8
|
Luo B, Shan C, Zhu R, Weng X, He S. Functional foveal splitting: evidence from neuropsychological and multimodal MRI investigations in a Chinese patient with a splenium lesion. PLoS One 2011; 6:e23997. [PMID: 21887360 PMCID: PMC3162595 DOI: 10.1371/journal.pone.0023997] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2011] [Accepted: 08/02/2011] [Indexed: 11/27/2022] Open
Abstract
It remains controversial and hotly debated whether foveal information is double-projected to both hemispheres or split at the midline between the two hemispheres. We investigated this issue in a unique patient with lesions in the splenium of the corpus callosum and the left medial occipitotemporal region, through a series of neuropsychological tests and multimodal MRI scans. Behavioral experiments showed that (1) the patient had difficulties in reading simple and compound Chinese characters when they were presented in the foveal but left to the fixation, (2) he failed to recognize the left component of compound characters when the compound characters were presented in the central foveal field, (3) his judgments of the gender of centrally presented chimeric faces were exclusively based on the left half-face and he was unaware that the faces were chimeric. Functional MRI data showed that Chinese characters, only when presented in the right foveal field but not in the left foveal field, activated a region in the left occipitotemporal sulcus in the mid-fusiform, which is recognized as visual word form area. Together with existing evidence in the literature, results of the current study suggest that the representation of foveal stimuli is functionally split at object processing levels.
Collapse
Affiliation(s)
- Benyan Luo
- Department of Neurology, First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chunlei Shan
- Department of Rehabilitation Medicine, First Affiliated Hospital of Nanjing Medical University, Nanjing, China
- * E-mail:
| | - Renjing Zhu
- Department of Neurology, Zhongshan Hospital, Xiamen University, Xiamen, China
| | - Xuchu Weng
- Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- The Center for Human Brain Research, Hangzhou Normal University, Hangzhou, China
| | - Sheng He
- Department of Psychology, University of Minnesota, Minneapolis, Minnesota, United States of America
| |
Collapse
|
9
|
Position of phonetic components may influence how written words are processed in the brain: Evidence from Chinese phonetic compound pronunciation. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2011; 10:552-9. [PMID: 21098814 DOI: 10.3758/cabn.10.4.552] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Previous studies have shown a right-visual-field (RVF)/left-hemisphere (LH) advantage in Chinese phonetic compound pronunciation. Here, we contrast the processing of two phonetic compound types: a dominant structure in which a semantic component appears on the left and a phonetic component on the right (SP characters), and a minority structure with the opposite arrangement (PS characters). We show that this RVF/LH advantage was observed only in SP character pronunciation, but not in PS character pronunciation. This result suggests that SP character processing is more LH lateralized than is PS character processing and is consistent with corresponding ERP N170 data. This effect may be due to the dominance of SP characters in the lexicon, which makes readers opt to obtain phonological information from the right of the characters. This study thus shows that the overall information distribution of word components in the lexicon may influence how written words are processed in the brain. Supplemental materials for this article may be downloaded from http://cabn.psychonomic-journals.org/content/supplemental.
Collapse
|
10
|
Assessing effects of viewing distance on normal Chinese reading: some methodological and theoretical implications. Behav Res Methods 2010; 41:971-6. [PMID: 19897806 DOI: 10.3758/brm.41.4.971] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Viewing distance determines a range of factors affecting reading performance. Previous studies of Chinese-character reading have shown considerable disagreement and inconsistency in their choice of viewing distances, however, with obvious implications for research in this area. The present study aimed to resolve this issue by determining the optimal viewing distance for studies of normal Chinese reading. Stimuli were pages of text that were composed of a standard Chinese typeface (Song) that was presented in a standard size (10.5 pt). Forty reading distances were used, ranging from 2.5 to 100.0 cm. Distances within the range of 7.5-55.0 cm produced faster reading rates than did the distances at either end of the continuum, and a regression model showed that 35 cm was the optimal viewing distance. These findings indicate an optimal range of retinal image sizes between 2.0 degrees and 0.3 degrees per character. The implications of these findings for understanding the processes that are involved in Chinese reading and for the appropriate presentation of Chinese stimuli in experiments are discussed.
Collapse
|
11
|
Jordan TR, Paterson KB. Re-evaluating split-fovea processing in word recognition: A critical assessment of recent research. Neuropsychologia 2009; 47:2341-53. [PMID: 18723038 DOI: 10.1016/j.neuropsychologia.2008.07.020] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2008] [Revised: 07/08/2008] [Accepted: 07/20/2008] [Indexed: 10/21/2022]
|
12
|
|
13
|
Yang J, McCandliss BD, Shu H, Zevin JD. Simulating Language-specific and Language-general Effects in a Statistical Learning Model of Chinese Reading. JOURNAL OF MEMORY AND LANGUAGE 2009; 61:238-257. [PMID: 20161189 PMCID: PMC2728242 DOI: 10.1016/j.jml.2009.05.001] [Citation(s) in RCA: 60] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Many theoretical models of reading assume that different writing systems require different processing assumptions. For example, it is often claimed that print-to-sound mappings in Chinese are not represented or processed sub-lexically. We present a connectionist model that learns the print to sound mappings of Chinese characters using the same functional architecture and learning rules that have been applied to English. The model predicts an interaction between item frequency and print-to-sound consistency analogous to what has been found for English, as well as a language-specific regularity effect particular to Chinese. Behavioral naming experiments using the same test items as the model confirmed these predictions. Corpus properties and the analyses of internal representations that evolved over training revealed that the model was able to capitalize on information in "phonetic components" - sub-lexical structures of variable size that convey probabilistic information about pronunciation. The results suggest that adult reading performance across very different writing systems may be explained as the result of applying the same learning mechanisms to the particular input statistics of writing systems shaped by both culture and the exigencies of communicating spoken language in a visual medium.
Collapse
Affiliation(s)
- Jianfeng Yang
- Sackler Institute, Weill Cornell Medical College, USA
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, China
| | | | - Hua Shu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, China
| | | |
Collapse
|
14
|
Hsiao JHW, Shieh DX, Cottrell GW. Convergence of the visual field split: hemispheric modeling of face and object recognition. J Cogn Neurosci 2008; 20:2298-307. [PMID: 18457514 PMCID: PMC7360338 DOI: 10.1162/jocn.2008.20162] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Anatomical evidence shows that our visual field is initially split along the vertical midline and contralaterally projected to different hemispheres. It remains unclear at which processing stage the split information converges. In the current study, we applied the Double Filtering by Frequency (DFF) theory (Ivry & Robertson, 1998) to modeling the visual field split; the theory assumes a right-hemisphere/low-frequency bias. We compared three cognitive architectures with different timings of convergence and examined their cognitive plausibility to account for the left-side bias effect in face perception observed in human data. We show that the early convergence model failed to show the left-side bias effect. The modeling, hence, suggests that the convergence may take place at an intermediate or late stage, at least after information has been extracted/encoded separately in the two hemispheres, a fact that is often overlooked in computational modeling of cognitive processes. Comparative anatomical data suggest that this separate encoding process that results in differential frequency biases in the two hemispheres may be engaged from V1 up to the level of area V3a and V4v, and converge at least after the lateral occipital region. The left-side bias effect in our model was also observed in Greeble recognition; the modeling, hence, also provides testable predictions about whether the left-side bias effect may also be observed in (expertise-level) object recognition.
Collapse
Affiliation(s)
- Janet Hui-wen Hsiao
- Department of Computer Science and Engineering, University of California, San Diego, La Jolla, CA 92093-0404, USA.
| | | | | |
Collapse
|
15
|
YANG JF. A Connectionist Model of Chinese Characters Reading. ACTA PSYCHOLOGICA SINICA 2008. [DOI: 10.3724/sp.j.1041.2008.00516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
16
|
Hsiao JHW, Shillcock R, Lee CY. Neural correlates of foveal splitting in reading: evidence from an ERP study of Chinese character recognition. Neuropsychologia 2006; 45:1280-92. [PMID: 17098263 PMCID: PMC1876781 DOI: 10.1016/j.neuropsychologia.2006.10.001] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2005] [Revised: 09/30/2006] [Accepted: 10/04/2006] [Indexed: 11/22/2022]
Abstract
Recent research on foveal structure and reading suggests that the two halves of a centrally fixated word seem to be initially projected to, and processed in, different hemispheres. In the current study, we utilize two contrasting structures in Chinese orthography, "SP" (the semantic radical on the left and the phonetic radical on the right) and "PS" characters (the opposite structure), to examine foveal splitting effects in event-related potential (ERP) recordings. We showed that when participants silently named centrally presented characters, there was a significant interaction between character type and hemisphere in N1 amplitude: SP characters elicited larger N1 compared with PS characters in the left hemisphere, whereas the right hemisphere had the opposite pattern. This effect is consistent with the split fovea claim, suggesting that the two halves of a character may be initially projected to and processed in different hemispheres. There was no such interaction observed in an earlier component P1. Also, there was an interaction between character type and sex of the reader in N350 amplitude. This result is consistent with Hsiao and Shillcock's [Hsiao, J. H., & Shillcock, R. (2005b). Foveal splitting causes differential processing of Chinese orthography in the male and female brain. Cognitive Brain Research, 25, 531-536] behavioural study, which showed a similar interaction in naming response time. They argued that this effect was due to a more left-lateralized network for phonological processing in the male brain compared with the female brain. The results hence showed that foveal splitting effects in visual word recognition were observed in N1 the earliest, and could extend far enough to interact with the sex of the reader as revealed in N350.
Collapse
Affiliation(s)
- Janet Hui-wen Hsiao
- Department of Computer Science & Engineering, University of California, San Diego, 9500 Gillman Drive #0404, La Jolla, CA 92093-0404, USA.
| | | | | |
Collapse
|