Universality in eye movements and reading: A trilingual investigation

Universality in eye movements and reading: A replication with increased power

Liversedge, Drieghe, Li, Yan, Bai and Hyönä (2016) reported an eye movement study that investigated reading in Chinese, Finnish and English (languages with markedly different orthographic characteristics). Analyses of the eye movement records showed robust differences in fine grained characteristics of eye movements between languages, however, overall sentence reading times did not differ. Liversedge et al. interpreted the entire set of results across languages as reflecting universal aspects of processing in reading. However, the study has been criticized as being statistically underpowered (Brysbaert, 2019) given that only 19-21 subjects were tested in each language. Also, given current best practice, the original statistical analyses can be considered to be somewhat weak (e.g., no inclusion of random slopes and no formal comparison of performance between the three languages). Finally, the original study did not include any formal statistical model to assess effects across all three languages simultaneously. To address these (and some other) concerns, we tested at least 80 new subjects in each language and conducted formal statistical modeling of our data across all three languages. To do this, we included an index that captured variability in visual complexity in each language. Unlike the original findings, the new analyses showed shorter total sentence reading times for Chinese relative to Finnish and English readers. The other main findings reported in the original study were consistent. We suggest that the faster reading times for Chinese subjects occurred due to cultural changes that have taken place in the decade or so that lapsed between when the original and current subjects were tested. We maintain our view that the results can be taken to reflect universality in aspects of reading and we evaluate the claims regarding a lack of statistical power that were levelled against the original article.

Eye movement corpora in Adyghe and Russian: an eye-tracking study of sentence reading in bilinguals

The present study expands the eye-tracking-while reading research toward less studied languages of different typological classes (polysynthetic Adyghe vs. synthetic Russian) that use a Cyrillic script. In the corpus reading data from the two languages, we confirmed the widely studied effects of word frequency and word length on eye movements in Adyghe-Russian bilingual individuals for both languages. We also confirmed morphological effects in Adyghe reading (part-of-speech class and the number of lexical affixes) that were previously shown in some morphologically-rich languages. Importantly, we demonstrated that bilinguals' reading in Adyghe does differ quantitatively (the effect of language on reading times) and qualitatively (different effects of landing and previous/upcoming words on the eye movements within a current word) from their reading in Russian.

GECO-CN: Ghent Eye-tracking COrpus of sentence reading for Chinese-English bilinguals

The current work presents the very first eye-tracking corpus of natural reading by Chinese-English bilinguals, whose two languages entail different writing systems and orthographies. Participants read an entire novel in these two languages, presented in paragraphs on screen. Half of the participants first read half of the novel in their native language (Simplified Chinese) and then the rest of the novel in their second language (English), while the other half read in the reverse language order. This article presents some important basic descriptive statistics of reading times and compares the difference between reading in the two languages. However, this unique eye-tracking corpus also allows the exploration of theories of language processing and bilingualism. Importantly, it provides a solid and reliable ground for studying the difference between Eastern and Western languages, understanding the impact and consequences of having a completely different first language on bilingual processing. The materials are freely available for use by researchers interested in (bilingual) reading.

Eye movements during reading in beginning and skilled readers: Impact of reading level or physiological maturation?

We begin by presenting and examining relevant data in the literature on eye movements in reading, from childhood to adulthood. In particular, we discuss the differences found in eye movements during reading between children in different age groups and with different reading levels and skilled adult readers in terms of word recognition and sentence processing. We then critically discuss two hypotheses that account for the differences between children and adults' eye movement during reading: one being reading age itself - the changes in eye movement patterns in reading are regulated by the level of reading proficiency and its automatization - and the other being the role of maturation of oculomotor control and, consequently, its possible changes in eye movement patterns during reading. Finally, we list gaps in the research field and suggest that future research will benefit from investigating eye movements during reading in ex-illiterate adults who are in the process of learning to read in order to isolate both reading and maturational factors.

Food word processing in Chinese reading: A study of restrained eaters

Food-related attentional bias refers that individuals typically prioritize rewarding food-related cues (e.g. food words and food images) compared with non-food stimuli; however, the findings are inconsistent for restrained eaters. Traditional paradigms used to test food-related attentional bias, such as visual probe tasks and visual search tasks, may not directly and accurately enough to reflect individuals' food-word processing at different cognitive stages. In this study, we introduced the boundary paradigm to investigate food-word attentional bias for both restrained and unrestrained eaters. Eye movements were recorded when they performed a naturalistic sentence-reading task. The results of later-stage analyses showed that food words were fixated on for less time than non-food words, which indicated a superiority of foveal food-word processing for both restrained and unrestrained eaters. The results of early-stage analyses showed that restrained eaters spent more time on pre-target regions in the food-word valid preview conditions, which indicated a parafoveal food-word processing superiority for restrained eaters (i.e. the parafoveal-on-foveal effect). The superiority of foveal food-word processing provides new insights into explaining food-related attentional bias in general groups. Additionally, the enhanced food-word attentional bias in parafoveal processing for restrained eaters illustrates the importance of individual characteristics in studying word recognition.

Expanding horizons of cross-linguistic research on reading: The Multilingual Eye-movement Corpus (MECO)

Scientific studies of language behavior need to grapple with a large diversity of languages in the world and, for reading, a further variability in writing systems. Yet, the ability to form meaningful theories of reading is contingent on the availability of cross-linguistic behavioral data. This paper offers new insights into aspects of reading behavior that are shared and those that vary systematically across languages through an investigation of eye-tracking data from 13 languages recorded during text reading. We begin with reporting a bibliometric analysis of eye-tracking studies showing that the current empirical base is insufficient for cross-linguistic comparisons. We respond to this empirical lacuna by presenting the Multilingual Eye-Movement Corpus (MECO), the product of an international multi-lab collaboration. We examine which behavioral indices differentiate between reading in written languages, and which measures are stable across languages. One of the findings is that readers of different languages vary considerably in their skipping rate (i.e., the likelihood of not fixating on a word even once) and that this variability is explained by cross-linguistic differences in word length distributions. In contrast, if readers do not skip a word, they tend to spend a similar average time viewing it. We outline the implications of these findings for theories of reading. We also describe prospective uses of the publicly available MECO data, and its further development plans.

The database of eye-movement measures on words in Chinese reading

Eye movements are one of the most fundamental behaviors during reading. A growing number of Chinese reading studies have used eye-tracking techniques in the last two decades. The accumulated data provide a rich resource that can reflect the complex cognitive mechanisms underlying Chinese reading. This article reports a database of eye-movement measures of words during Chinese sentence reading. The database contains nine eye-movement measures of 8,551 Chinese words obtained from 1,718 participants across 57 Chinese sentence reading experiments. All data were collected in the same experimental environment and from homogenous participants, using the same protocols and parameters. This database enables researchers to test their theoretical or computational hypotheses concerning Chinese reading efficiently using a large number of words. The database can also indicate the processing difficulty of Chinese words during text reading, thus providing a way to control or manipulate the difficulty level of Chinese texts.

Eye movements during text reading align with the rate of speech production

Across languages, the speech signal is characterized by a predominant modulation of the amplitude spectrum between about 4.3 and 5.5 Hz, reflecting the production and processing of linguistic information chunks (syllables and words) every ~200 ms. Interestingly, ~200 ms is also the typical duration of eye fixations during reading. Prompted by this observation, we demonstrate that German readers sample written text at ~5 Hz. A subsequent meta-analysis of 142 studies from 14 languages replicates this result and shows that sampling frequencies vary across languages between 3.9 Hz and 5.2 Hz. This variation systematically depends on the complexity of the writing systems (character-based versus alphabetic systems and orthographic transparency). Finally, we empirically demonstrate a positive correlation between speech spectrum and eye movement sampling in low-skilled non-native readers, with tentative evidence from post hoc analysis suggesting the same relationship in low-skilled native readers. On the basis of this convergent evidence, we propose that during reading, our brain's linguistic processing systems imprint a preferred processing rate-that is, the rate of spoken language production and perception-onto the oculomotor system.

Predictability effects and parafoveal processing of compound words in natural Chinese reading

We report a boundary paradigm eye movement experiment to investigate whether the predictability of the second character of a two-character compound word affects how it is processed prior to direct fixation during reading. The boundary was positioned immediately prior to the second character of the target word, which itself was either predictable or unpredictable. The preview was either a pseudocharacter (nonsense preview) or an identity preview. We obtained clear preview effects in all conditions, but more importantly, skipping probability for the second character of the target word and the whole target word from pretarget was greater when it was predictable than when it was not predictable from the preceding context. Interactive effects for later measures on the whole target word (gaze duration and go-past time) were also obtained. These results demonstrate that predictability information from preceding sentential context and information regarding the likely identity of upcoming characters are used concurrently to constrain the nature of lexical processing during natural Chinese reading.

Avoiding potential pitfalls in visual search and eye-movement experiments: A tutorial review

Examining eye-movement behavior during visual search is an increasingly popular approach for gaining insights into the moment-to-moment processing that takes place when we look for targets in our environment. In this tutorial review, we describe a set of pitfalls and considerations that are important for researchers – both experienced and new to the field – when engaging in eye-movement and visual search experiments. We walk the reader through the research cycle of a visual search and eye-movement experiment, from choosing the right predictions, through to data collection, reporting of methodology, analytic approaches, the different dependent variables to analyze, and drawing conclusions from patterns of results. Overall, our hope is that this review can serve as a guide, a talking point, a reflection on the practices and potential problems with the current literature on this topic, and ultimately a first step towards standardizing research practices in the field.

Small temporal asynchronies between the two eyes in binocular reading: Crosslinguistic data and the implications for ocular prevalence

We investigated small temporal nonalignments between the two eyes’ fixations in the reading of English and Chinese. We define nine different patterns of asynchrony and report their spatial distribution across the screen of text. We interpret them in terms of their implications for ocular prevalence—prioritizing the input from one eye over the input from the other eye in higher perception/cognition, even when binocular fusion has occurred. The data are strikingly similar across the two very different orthographies. Asynchronies, in which one eye begins the fixation earlier and/or ends it later, occur most frequently in the hemifield corresponding to that eye. We propose that such small asynchronies cue higher processing to prioritize the input from that eye, during and after binocular fusion.

Improving reading rate prediction with word length information: Evidence from Dutch

Previous research in English has suggested that reading rate predictions can be improved considerably by taking average word length into account. In this study, we investigated whether the same regularity holds for Dutch. The Dutch language is very similar to English, but words are on average half a letter longer: 5.1 letters per word (in non-fiction) instead of 4.6. We collected reading rates of 62 participants reading 12 texts with varying word lengths and examined which change in the English equation accounts for the Dutch findings. We observed that predictions were close to the best-fitting curve as soon as the average English word length was replaced by the average Dutch word length. The equation predicts that Dutch texts with an average word length of 5.1 letters will be read at a rate of 238 words per minute (wpm). Texts with an average word length of 4.5 letters will be read at 270 wpm, and texts with an average word length of 6.0 letters will be read at a rate of 202 wpm. The findings are in line with the assumption that the longer words in Dutch do not slow down silent reading relative to English and that the word length effect observed in each language is due to word processing effort and not to low-level visual factors.

Gaze and Event Tracking for Evaluation of Recommendation-Driven Purchase

Recommendation systems play an important role in e-commerce turnover by presenting personalized recommendations. Due to the vast amount of marketing content online, users are less susceptible to these suggestions. In addition to the accuracy of a recommendation, its presentation, layout, and other visual aspects can improve its effectiveness. This study evaluates the visual aspects of recommender interfaces. Vertical and horizontal recommendation layouts are tested, along with different visual intensity levels of item presentation, and conclusions obtained with a number of popular machine learning methods are discussed. Results from the implicit feedback study of the effectiveness of recommending interfaces for four major e-commerce websites are presented. Two different methods of observing user behavior were used, i.e., eye-tracking and document object model (DOM) implicit event tracking in the browser, which allowed collecting a large amount of data related to user activity and physical parameters of recommending interfaces. Results have been analyzed in order to compare the reliability and applicability of both methods. Observations made with eye tracking and event tracking led to similar results regarding recommendation interface evaluation. In general, vertical interfaces showed higher effectiveness compared to horizontal ones, with the first and second positions working best, and the worse performance of horizontal interfaces probably being connected with banner blindness. Neural networks provided the best modeling results of the recommendation-driven purchase (RDP) phenomenon.

Horizontal vs. Vertical Recommendation Zones Evaluation Using Behavior Tracking

Recommender systems play a vital role in e-commerce by increasing the likelihood of transactions and improving sales thanks to presenting personal recommendations. Due to the marketing habituation effect, users are less and less responsive to this type of content. Visual recommendation presentation, in particular the recommendation zone layout can influence the effectiveness of a recommendation. This study examines human–computer interactions for vertical, horizonal, and mixed layouts of recommending interfaces of four major e-commerce stores, and is based on our document object model events-based behavior analysis tool. Results from this implicit feedback study are presented and analyzed, showing that vertical recommendation zones attracted more attention than horizontal ones.

Is it smart to read on your phone? The impact of reading format and culture on the continued influence of misinformation

Despite advances in digital technology that have resulted in more people accessing information via mobile devices, little is known about reading comprehension on mobile phones. This research investigated the impact of reading format by comparing sensitivity to misinformation presented either in printed texts or in digital format on mobile phones to readers of English versus Chinese. Participants read pairs of short newspaper-style articles containing a critical piece of information that was either retracted or not retracted, and were later assessed on their memory for critical and general details, as well as inferential judgements related to the retracted information. The average results replicated previous evidence that repeating the original misinformation at the time of retraction enhanced memory updating. However, reading on a mobile phone reduced the likelihood that readers noticed the retraction and updated their memory with alternative information in both language groups and reduced the extent to which inferences were modified by the alternative information in readers of Chinese but not English. Chinese readers showed significantly better general memory, but were more affected by the continued influence of the misinformation. These differences between Chinese and English-speaking participants may reflect cultural influences on the tendency to apply a dialectical rather than an analytic reasoning strategy and incorporate contradictory information into the memory representation of a discourse or event.

Deep Learning-Enhanced Framework for Performance Evaluation of a Recommending Interface with Varied Recommendation Position and Intensity Based on Eye-Tracking Equipment Data Processing

The increasing amount of marketing content in e-commerce websites results in the limited attention of users. For recommender systems, the way recommended items are presented becomes as important as the underlying algorithms for product selection. In order to improve the effectiveness of content presentation, marketing experts experiment with the layout and other visual aspects of website elements to find the most suitable solution. This study investigates those aspects for a recommending interface. We propose a framework for performance evaluation of a recommending interface, which takes into consideration individual user characteristics and goals. At the heart of the proposed solution is a deep neutral network trained to predict the efficiency a particular recommendation presented in a selected position and with a chosen degree of intensity. The proposed Performance Evaluation of a Recommending Interface (PERI) framework can be used to automate an optimal recommending interface adjustment according to the characteristics of the user and their goals. The experimental results from the study are based on research-grade measurement electronics equipment Gazepoint GP3 eye-tracker data, together with synthetic data that were used to perform pre-assessment training of the neural network.

The influence of foveal lexical processing load on parafoveal preview and saccadic targeting during Chinese reading

Whether increased foveal load causes a reduction of parafoveal processing remains equivocal. The present study examined foveal load effects on parafoveal processing in natural Chinese reading. Parafoveal preview of a single-character parafoveal target word was manipulated by using the boundary paradigm (Rayner, 1975; pseudocharacter or identity previews) under high foveal load (low-frequency pretarget word) compared with low foveal load (high-frequency pretarget word) conditions. Despite an effective manipulation of foveal processing load, we obtained no evidence of any modulatory influence on parafoveal processing in first-pass reading times. However, our results clearly showed that saccadic targeting, in relation to forward saccade length from the pretarget word and in relation to target word skipping, was influenced by foveal load and this influence occurred independent of parafoveal preview. Given the optimal experimental conditions, these results provide very strong evidence that preview benefit is not modulated by foveal lexical load during Chinese reading.

The findings of the present study show that foveal processing load, as manipulated through lexical frequency, has no modulatory influence on preview benefit for the subsequent word in a sentence during natural Chinese reading. Foveal processing difficulty does, however, influence saccades that determine where the eyes fixate next, and this influence occurs regardless of preview benefit for the following word. These results pertain directly to the Foveal Load Hypothesis that has received significant scrutiny in recent years. They also directly inform current understanding of the complexities of the relationship between the oculomotor control system that is responsible for positioning the point of fixation during reading and the complex cognitive processes that occur during written Chinese language comprehension.

New Perspectives on Serialism and Parallelism in Oculomotor Control During Reading: The Multi-Constituent Unit Hypothesis

Currently there are several computational models of eye movement control that provide a good account of oculomotor behavior during reading of English and other alphabetic languages. I will provide an overview of two dominant models: E-Z Reader and SWIFT, as well as a recently proposed model: OB1-Reader. I will evaluate a critical issue of controversy among models, namely, whether words are lexically processed serially or in parallel. I will then consider reading in Chinese, a character-based, unspaced language with ambiguous word boundaries. Finally, I will evaluate the concepts of serialism and parallelism of process central to these models, and how these models might function in relation to lexical processing that is operationalized over parafoveal multi-constituent units.

Word skipping in Chinese reading: The role of high-frequency preview and syntactic felicity

Two experiments are reported to investigate whether Chinese readers skip a high-frequency preview word without taking the syntax of the sentence context into account. In Experiment 1, we manipulated target word syntactic category, frequency, and preview using the boundary paradigm (Rayner, 1975). For high-frequency verb targets, there were identity and pseudocharacter previews alongside a low-frequency noun preview. For low-frequency verb targets, there were identity and pseudocharacter previews alongside a high-frequency noun preview. Results showed that for high-frequency targets, skipping rates were higher for identical previews compared with the syntactically infelicitous alternative low-frequency preview and pseudocharacter previews, however for low-frequency targets, skipping rates were higher for high-frequency previews (even when they were syntactically infelicitous) compared with the other 2 previews. Furthermore, readers were more likely to skip the target when they had a high-frequency, syntactically felicitous preview compared to a high-frequency, syntactically infelicitous preview. The pattern of felicity effects was statistically robust when readers launched saccades from near the target. In Experiment 2, we assessed whether display change awareness influenced the patterns of results in Experiment 1. Results showed that the overall patterns held in Experiment 2 regardless of some readers being more likely to be aware of the display change than others. These results suggest that decisions to skip a word in Chinese reading are primarily based on parafoveal word familiarity, though the syntactic felicity of a parafoveal word also exerts a robust influence for high-frequency previews.

Modalities of reading acquisition in three siblings with infantile-onset saccade initiation delay (Cogan congenital ocular motor apraxia): A longitudinal study

This study aims to ascertain the impact of congenital ocular motor apraxia (COMA), alternatively called infantile-onset saccade initiation delay (ISID), on reading acquisition. More specifically, the consequence of defective initiation of horizontal saccades during reading acquisition was investigated. Three siblings (A: male, 11y3m at the first time-point of testing (i.e. T1 hereafter); B: female, 7y3m at T1 and C: male, 5y9m at T1) suffering from ISID were assessed longitudinally over 3 years in various reading tests and their eye movements simultaneously registered. At each time-point, they were compared to control participants matched on reading level. Eye movements during reading tasks were markedly abnormal in children with ISID at the beginning of reading acquisition and their reading scores were poor. With time, the number of fixations, small amplitude saccades and their reading abilities became comparable to those of control children. Despite the abnormal eye movements and difficulties in specifically directing the eyes to the appropriate position, children with ISID do not seem to encounter major difficulties during reading acquisition, although mild delays might be observed during the early stages.

Investigating word length effects in Chinese reading

A word’s length in English is fundamental in determining whether readers fixate it, and how long they spend processing it during reading. Chinese is unspaced, and most words are two characters long: Is word length an important cue to eye guidance in Chinese reading? Eye movements were recorded as participants read sentences containing a one-, two-, or three-character word matched for frequency. Results showed that longer words took longer to process (primarily driven by refixations). Furthermore, skips were fewer, incoming saccades longer, and landing positions further to the right of long than short words. Additional analyses of a three-character region (matched stroke number) showed an incremental processing cost when character(s) belonged to different, rather than the same, word. These results demonstrate that word length affects both lexical identification and saccade target selection in Chinese reading.

During reading we make saccadic eye movements in order to fixate words in the high-acuity foveal region of the retina. For each saccade, the oculomotor control system makes decisions about when a saccade should be initiated, and to where the point of fixation should be targeted. Written Chinese does not have spaces between words, and word length is quite short and less variant relative to English text. The present study provides the first well controlled demonstration of word length effects on eye movement control during natural Chinese reading. This study demonstrates that the oculomotor control system is sensitive to Chinese word length information during reading, and Chinese readers are able to use this information in deciding when and where to move the eyes during reading.

Contributions of reader- and text-level characteristics to eye-movement patterns during passage reading

The present research presents a novel method for investigating how characteristics of texts (words, sentences, and passages) and individuals (verbal and general cognitive skills) jointly influence eye-movement patterns over the time-course of reading, as well as comprehension accuracy. Fifty-one proficient readers read passages of varying complexity from the Gray Oral Reading Test, while their eye-movements were recorded. Participants also completed a large battery of tests assessing various components of reading comprehension ability (vocabulary size, decoding, phonological awareness, and experience with print), as well as general cognitive and executive skills. We used the Random Forests nonparametric regression technique to simultaneously estimate relative importance of all predictors. This method enabled us to trace the temporal engagement of individual predictors and entire predictor groups on eye-movements during reading, while avoiding the problems of model overfitting and collinearity, typical of parametric regression methods. Our findings both confirmed well-established results of prior research and pointed to a space of hypotheses that is as yet unexplored. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Reading strategies of good and poor readers of German with different spelling abilities

Reading and spelling abilities are thought to be highly correlated during development, and orthographic knowledge is assumed to underpin both literacy skills. Interestingly, recent studies showed that reading and spelling skills can also dissociate. The current study investigated whether spelling skills (indicating orthographic knowledge) are associated with the application of orthographic strategies during reading. We examined eye movements of 137 third- and fourth-graders who were either good or poor readers with or without a spelling deficit: 43 children with typical reading and spelling skills, 28 with isolated spelling deficits, 28 with isolated reading deficits, and 38 with combined reading and spelling deficits. Although we expected to find reduced reliance on orthographic reading processes among poor spellers, this was evident for the group with combined deficits only. Both isolated deficit groups applied sublexical and lexical processes in a similar amount to typically developing children. Our findings suggest that reading rests on orthographic strategies even if lexical representations are poor as indicated by a deficit in spelling skills. Findings also show that dysfluent reading does not result only from overreliance on decoding.

Russian Sentence Corpus: Benchmark measures of eye movements in reading in Russian

This article introduces a new corpus of eye movements in silent reading-the Russian Sentence Corpus (RSC). Russian uses the Cyrillic script, which has not yet been investigated in cross-linguistic eye movement research. As in every language studied so far, we confirmed the expected effects of low-level parameters, such as word length, frequency, and predictability, on the eye movements of skilled Russian readers. These findings allow us to add Slavic languages using Cyrillic script (exemplified by Russian) to the growing number of languages with different orthographies, ranging from the Roman-based European languages to logographic Asian ones, whose basic eye movement benchmarks conform to the universal comparative science of reading (Share, 2008). We additionally report basic descriptive corpus statistics and three exploratory investigations of the effects of Russian morphology on the basic eye movement measures, which illustrate the kinds of questions that researchers can answer using the RSC. The annotated corpus is freely available from its project page at the Open Science Framework: https://osf.io/x5q2r/ .

Tracking the Eye Movement of Four Years Old Children Learning Chinese Words

Storybook reading is the major source of literacy exposure for beginning readers. The present study tracked 4-year-old Chinese children's eye movements while they were reading simulated storybook pages. Their eye-movement patterns were examined in relation to their word learning gains. The same reading list, consisting of 20 two-character Chinese words, was used in the pretest, 5-min eye-tracking learning session, and posttest. Additionally, visual spatial skill and phonological awareness were assessed in the pretest as cognitive controls. The results showed that the children's attention was attracted quickly by pictures, on which their attention was focused most, with only 13% of the time looking at words. Moreover, significant learning gains in word reading were observed, from the pretest to posttest, from 5-min exposure to simulated storybook pages with words, picture and pronunciation of two-character words present. Furthermore, the children's attention to words significantly predicted posttest reading beyond socioeconomic status, age, visual spatial skill, phonological awareness and pretest reading performance. This eye-movement evidence of storybook reading by children as young as four years, reading a non-alphabetic script (i.e., Chinese), has demonstrated exciting findings that children can learn words effectively with minimal exposure and little instruction; these findings suggest that learning to read requires attention to the basic words itself. The study contributes to our understanding of early reading acquisition with eye-movement evidence from beginning readers.

Commonalities and differences in the neural representations of English, Portuguese, and Mandarin sentences: When knowledge of the brain-language mappings for two languages is better than one

This study extended cross-language semantic decoding (based on a concept's fMRI signature) to the decoding of sentences across three different languages (English, Portuguese and Mandarin). A classifier was trained on either the mapping between words and activation patterns in one language or the mappings in two languages (using an equivalent amount of training data), and then tested on its ability to decode the semantic content of a third language. The model trained on two languages was reliably more accurate than a classifier trained on one language for all three pairs of languages. This two-language advantage was selective to abstract concept domains such as social interactions and mental activity. Representational Similarity Analyses (RSA) of the inter-sentence neural similarities resulted in similar clustering of sentences in all the three languages, indicating a shared neural concept space among languages. These findings identify semantic domains that are common across these three languages versus those that are more language or culture-specific.

Lexical Reading in Dysfluent Readers of German

Dyslexia in consistent orthographies like German is characterized by dysfluent reading, which is often assumed to result from failure to build up an orthographic lexicon and overreliance on decoding. However, earlier evidence indicates effects of lexical processing at least in some German dyslexic readers. We investigated variations in reading style in an eye-tracking paradigm with German dysfluent 3rd and 4th graders. Twenty-six TypFix-readers (fixation counts within the range of 47 age-matched typical readers) were compared with 42 HighFix-readers (increased fixation counts). Both groups showed lexical access: Words were read more efficiently than nonwords and pseudohomophones. TypFix-readers showed stronger reliance on lexical reading than HighFix-readers (smaller length effects for number of fixations and total reading time, stronger lexicality effects for gaze duration, stronger word-pseudohomophone effects for mean saccade amplitude). We conclude that in both groups, sublexical and lexical reading processes were impaired due to inefficient visual-verbal integration.

Differential vergence movements in reading Chinese and English: Greater fixation-initial binocular disparity is advantageous in reading the denser orthography

We explore two aspects of exovergence: we test whether smaller binocular fixation disparities accompany the shorter saccades and longer fixations observed in reading Chinese; we test whether potentially advantageous psychophysical effects of exovergence (cf. Arnold & Schindel, 2010; Kersten & Murray, 2010) transfer to text reading. We report differential exovergence in reading Chinese and English: Chinese readers begin fixations with more binocular disparity, but end fixations with a disparity closely similar to that of the English readers. We conclude that greater fixation-initial binocular fixation disparity can be adaptive in the reading of visually and cognitively denser text.

Character-complexity effects in Chinese reading and visual search: A comparison and theoretical implications

Three eye-movement experiments were conducted to examine how the complexity of characters in Chinese words (i.e., number of strokes per character) influences their processing and eye-movement behaviour. In Experiment 1, English speakers with no significant knowledge of Chinese searched for specific low-, medium-, and high-complexity target characters in a multi-page narrative containing characters of varying complexity (3-16 strokes). Fixation durations and skipping rates were influenced by the visual complexity of both the target characters and the characters being searched even though participants had no knowledge of Chinese. In Experiment 2, native Chinese speakers performed the same character-search task, and a similar pattern of results was observed. Finally, in Experiment 3, a second sample of native Chinese speakers read the same text used in Experiments 1 and 2, with text characters again exhibiting complexity effects. These results collectively suggest that character-complexity effects on eye movements may not be due to lexical processing per se but may instead reflect whatever visual processing is required to know whether or not a character corresponds to an episodically represented target. The theoretical implications of this for our understanding of normal reading are discussed.

Evidence for a global oculomotor program in reading

Recent corpus studies of eye-movements in reading revealed a substantial increase in saccade amplitudes and fixation durations as the eyes move over the first words of a sentence. This start-up effect suggests a global oculomotor program, which operates on the level of an entire line, in addition to the well-established local programs operating within the visual span. The present study investigates the nature of this global program experimentally and examines whether the start-up effect is predicated on generic visual or specific linguistic characteristics and whether it is mainly reflected in saccade amplitudes, fixation durations or both measures. Eye movements were recorded while 38 participants read (a) normal sentences, (b) sequences of randomly shuffled words and (c) sequences of z-strings. The stimuli were, therefore, similar in their visual features, but varied in the amount of syntactic and lexical information. Further, the stimuli were composed of words or strings that either varied naturally in length (Nonequal condition) or were all restricted to a specific length within a sentence (Equal). The latter condition constrained the variability of saccades and served to dissociate effects of word position in line on saccade amplitudes and fixation durations. A robust start-up effect emerged in saccade amplitudes in all Nonequal stimuli, and-in an attenuated form-in Equal sentences. A start-up effect in single fixation durations was observed in Nonequal and Equal normal sentences, but not in z-strings. These findings support the notion of a global oculomotor program in reading particularly for the spatial characteristics of motor planning, which rely on visual rather than linguistic information.