When is the right hemisphere holistic and when is it not? The case of Chinese character recognition

Chinese holistic processing: Evidence from cognitive mental architecture using Systems Factorial Technology

Previous research has presented conflicting evidence regarding whether Chinese characters are processed holistically. In past work, we applied Systems Factorial Technology (SFT) and discovered that native Chinese speakers exhibited limited capacity when processing characters and words. To pinpoint the source of this limitation, our current research delved further into the mental architecture involved in processing Chinese characters and English words, taking into consideration information from each component. In our current study, participants were directed to make the same/different judgments on characters/words presented sequentially. Our results indicated that participants utilized a parallel self-terminating strategy when both or neither of the left/right components differed (Experiment 1). Faced with the decisional uncertainty that either the left/right component would also differ, most participants processed with a parallel exhaustive architecture, while a few exhibited the coactive architecture (Experiment 2). Taken together, our work provides evidence that in word/character perception, there is weak holistic processing (parallel self-terminating processing) when partial information is sufficient for the decision; robust holistic processing (coactive or parallel exhaustive processing) occurs under decisional uncertainty. Our findings underscore the significant role that the task and presentation context play in visual word processing.

Faces, English words and Chinese characters: a study of dual-task interference in mono-and bilingual speakers

The many-to-many hypothesis suggests that face and visual-word processing tasks share neural resources in the brain, even though they show opposing hemispheric asymmetries in neuroimaging and neuropsychologic studies. Recently it has been suggested that both stimulus and task effects need to be incorporated into the hypothesis. A recent study found dual-task interference between face and text functions that lateralized to the same hemisphere, but not when they lateralized to different hemispheres. However, it is not clear whether a lack of interference between word and face recognition would occur for other languages, particularly those with a morpho-syllabic script, like Chinese, for which there is some evidence of greater right hemispheric involvement. Here, we used the same technique to probe for dual-task interference between English text, Chinese characters and face recognition. We tested 20 subjects monolingual for English and 20 subjects bilingual for Chinese and English. We replicated the prior result for English text and showed similar results for Chinese text with no evidence of interference with faces. We also did not find interference between Chinese and English text. The results support a view in which reading English words, reading Chinese characters and face identification have minimal sharing of neural resources.

How does face mask in COVID-19 pandemic disrupt face learning and recognition in adults with autism spectrum disorder?

Use of face masks is one of the measures adopted by the general community to stop the transmission of disease during this ongoing COVID-19 pandemic. This wide use of face masks has indeed been shown to disrupt day-to-day face recognition. People with autism spectrum disorder (ASD) often have predisposed impairment in face recognition and are expected to be more vulnerable to this disruption in face recognition. Here, we recruited typically developing adult participants and those with ASD, and we measured their non-verbal intelligence, autism spectrum quotient, empathy quotient, and recognition performances of faces with and without a face mask covering the lower halves of the face. When faces were initially learned unobstructed, we showed that participants had a general reduced face recognition performance for masked faces. In contrast, when masked faces were first learned, typically developing adults benefit with an overall advantage in recognizing both masked and unmasked faces; while adults with ASD recognized unmasked faces with a significantly more reduced level of performance than masked faces—this face recognition discrepancy is predicted by a higher level of autistic traits. This paper also discusses how autistic traits influence processing of faces with and without face masks.

Electrophysiological measurements of holistic processing of Chinese characters

Holistic processing (HP) is a marker of perceptual expertise in facial recognition. In the present study, we examined neural responses to the HP of Chinese characters, adopting the composite paradigm. The behavioral results showed that the discrimination of congruent trials was significantly higher than that of incongruent trials, and participants responded faster. Moreover, the congruent trials elicited significantly larger N170 amplitude than the incongruent trials. The HP effect of the N170 component was observed for upright characters, as the configural information of inverted characters and misaligned characters were destroyed. Right-lateralization of processing Chinese characters was observed in the N170 amplitudes and delta-theta band oscillations. The results suggested that Chinese character recognition employed a strategy of HP, and the finding that neural indicators provide a better signal of the strength of HP in Chinese characters than behavioral indicators was also crucial.

The inversion effect in word recognition: the effect of language familiarity and handwriting

Humans have expertise with visual words and faces. One marker of this expertise is the inversion effect. This is attributed to experience with those objects being biased towards a canonical orientation, rather than some inherent property of object structure or perceptual anisotropy. To confirm the role of experience, we measured inversion effects in word matching for familiar and unfamiliar languages. Second, we examined whether there may be more demands on reading expertise with handwritten stimuli rather than computer font, given the greater variability and irregularities in the former, with the prediction of larger inversion effects for handwriting. We recruited two cohorts of subjects, one fluent in Farsi and the other in Punjabi, neither of whom were able to read the other's language. Subjects performed a match-to-sample task with words in either computer fonts or handwritings. Subjects were more accurate and faster with their familiar language, even when it was inverted. Inversion effects were present for the familiar but not the unfamiliar language. The inversion effect in accuracy for handwriting was larger than that for computer fonts in the familiar language. We conclude that the word inversion effect is generated solely by orientation-biased experience, and that demands on this expertise are greater with handwriting than computer font.

Music reading experience modulates eye movement pattern in English reading but not in Chinese reading

Here we tested the hypothesis that in Chinese-English bilinguals, music reading experience may modulate eye movement planning in reading English but not Chinese sentences due to the similarity in perceptual demands on processing sequential symbol strings separated by spaces between music notation and English sentence reading. Chinese–English bilingual musicians and non-musicians read legal, semantically incorrect, and syntactically (and semantically) incorrect sentences in both English and Chinese. In English reading, musicians showed more dispersed eye movement patterns in reading syntactically incorrect sentences than legal sentences, whereas non-musicians did not. This effect was not observed in Chinese reading. Musicians also had shorter saccade lengths when viewing syntactically incorrect than correct musical notations and sentences in an unfamiliar alphabetic language (Tibetan), whereas non-musicians did not. Thus, musicians’ eye movement planning was disturbed by syntactic violations in both music and English reading but not in Chinese reading, and this effect was generalized to an unfamiliar alphabetic language. These results suggested that music reading experience may modulate perceptual processes in reading differentially in bilinguals’ two languages, depending on their processing similarities.

Non-monotonic developmental trend of holistic processing in visual expertise: the case of Chinese character recognition

Holistic processing has been identified as an expertise marker of face and object recognition. By contrast, reduced holistic processing is purportedly an expertise marker in recognising orthographic characters in Chinese. Does holistic processing increase or decrease in expertise development? Is orthographic recognition a domain-specific exception to all other kinds of recognition (e.g. face and objects)? In two studies, we examined the developmental trend of holistic processing in Chinese character recognition in Chinese and non-Chinese children, and its relationship with literacy abilities: Chinese first graders—with emergent Chinese literacy acquired in kindergarten—showed increased holistic processing perhaps as an inchoate expertise marker when compared with kindergartners and non-Chinese first graders; however, the holistic processing effect was reduced in higher-grade Chinese children. These results suggest a non-monotonic inverted U-shape trend of holistic processing in visual expertise development: An increase in holistic processing due to initial reading experience followed by a decrease in holistic processing due to literacy enhancement. This result marks the development of holistic and analytic processing skills, both of which can be essential for mastering visual recognition. This study is the first to investigate the developmental trend of holistic processing in Chinese character recognition using the composite paradigm.

Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia

Faces and words are traditionally assumed to be independently processed. Dyslexia is also traditionally thought to be a non-visual deficit. Counter to both ideas, face perception deficits in dyslexia have been reported. Others report no such deficits. We sought to resolve this discrepancy. 60 adults participated in the study (24 dyslexic, 36 typical readers). Feature-based processing and configural or global form processing of faces was measured with a face matching task. Opposite laterality effects in these tasks, dependent on left-right orientation of faces, supported that they tapped into separable visual mechanisms. Dyslexic readers tended to be poorer than typical readers at feature-based face matching while no differences were found for global form face matching. We conclude that word and face perception are associated when the latter requires the processing of visual features of a face, while processing the global form of faces apparently shares minimal-if any-resources with visual word processing. The current results indicate that visual word and face processing are both associated and dissociated-but this depends on what visual mechanisms are task-relevant. We suggest that reading deficits could stem from multiple factors, and that one such factor is a problem with feature-based processing of visual objects.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Holistic processing of Chinese characters in college students with dyslexia

Expert face recognition has long been marked by holistic processing. Hence, due to the many visual properties shared between face perception and Chinese characters, it has been suggested that Chinese character recognition may induce stronger holistic processing in expert readers than in novices. However, there have been different viewpoints presented about Chinese character recognition, one of which suggests that expertise in this skill involved reduced holistic processing which may be modulated by writing experiences/performances. In this study we examined holistic processing in Chinese character recognition in adults with and without dyslexia, using the complete composite paradigm. Our results showed that the adults with dyslexia recognized Chinese characters with a stronger holistic processing effect than the typical controls. It seems that those with dyslexia relied overly on the visual spatial information of characters and showed deficits in attending selectively to their components when processing Chinese characters, which hindered the development of expert reading and writing skills. This effect was in contrast to previous perceptual expertise studies in which reduced holistic processing marked deficits in face/visual object recognition. This study is also the first to show that Chinese adults with dyslexia had persistent below average performances in Chinese literacy.

Development of Holistic Face Processing From Childhood and Adolescence to Young Adulthood in Chinese Individuals

Previous studies have indicated that holistic face processing is important for the development of face perception. The purpose of this study was to verify the development trajectory of holistic processing, from older childhood to young adulthood, using the complete composite paradigm. Participants from three different age groups (children, adolescents, young adults) were recruited for this study. The results showed that all groups demonstrated the composite effect with similar magnitude. Furthermore, face processing performance improved with age. These results, together with previous results, imply it is a race-general phenomenon that holistic face processing is similar among older children, adolescents, and young adults.

Holistic but with reduced right-hemisphere involvement: The case of dyslexia in Chinese character recognition

Recent research on visual object recognition has suggested that the right hemisphere can engage either holistic or part-based processing depending on whether the recognition relies on configural (exact distances among features) or featural information, respectively. Consistent with this finding, expert Chinese reading has been marked by a left-side bias (an indication of right-hemisphere lateralization) with decreased holistic processing (as assessed using the composite paradigm) due to its reliance on featural information. Here we examine two common perceptual expertise phenomena in object recognition - holistic processing and left-side bias - of Chinese characters in adolescents with developmental dyslexia and matched controls. We found that those with dyslexia showed stronger holistic processing, a weaker left-side bias, and worse performance in Chinese character dictation than controls. This was in contrast to Limited writers (proficient readers with limited writing experience) reported in Tso, Au, and Hsiao (Psychological Science, 25, 1757-1767, 2014), who showed stronger holistic processing and worse dictation performance, but the same level of left-side bias as controls. This result demonstrated two different perceptual mechanisms underlying holistic processing: Limited writers' holistic processing may be due to difficulties in de-emphasizing configural information unimportant to Chinese characters, whereas readers with dyslexia may have deficits selectively attending to character components to form appropriate part-based representations in the right hemisphere.