1
|
Li N, Wang S, Kornrumpf F, Sommer W, Dimigen O. Parafoveal and foveal N400 effects in natural reading: A timeline of semantic processing from fixation-related potentials. Psychophysiology 2024; 61:e14524. [PMID: 38297818 DOI: 10.1111/psyp.14524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 12/20/2023] [Accepted: 12/26/2023] [Indexed: 02/02/2024]
Abstract
The depth at which parafoveal words are processed during reading is an ongoing topic of debate. Recent studies using RSVP-with-flanker paradigms have shown that implausible words within sentences elicit an N400 component while they are still in parafoveal vision, suggesting that the semantics of parafoveal words can be accessed to rapidly update the sentence representation. To study this effect in natural reading, we combined the coregistration of eye movements and EEG with the deconvolution modeling of fixation-related potentials (FRPs) to test whether semantic plausibility is processed parafoveally during Chinese sentence reading. For one target word per sentence, both its parafoveal and foveal plausibility were orthogonally manipulated using the boundary paradigm. Consistent with previous eye movement studies, we observed a delayed effect of parafoveal plausibility on fixation durations that only emerged on the foveal word. Crucially, in FRPs aligned to the pretarget fixation, a clear N400 effect emerged already based on parafoveal plausibility, with more negative voltages for implausible previews. Once participants fixated the target, we again observed an N400 effect of foveal plausibility. Interestingly, this foveal N400 was absent whenever the preview had been implausible, indicating that when a word's (im)plausibility is already processed in parafoveal vision, this information is not revised anymore upon direct fixation. Implausible words also elicited a late positive component (LPC), but exclusively when in foveal vision. Our results not only provide convergent neural and behavioral evidence for the parafoveal uptake of semantic information, but also indicate different contributions of parafoveal versus foveal information toward higher level sentence processing.
Collapse
Affiliation(s)
- Nan Li
- School of Foreign Studies, South China Normal University, Guangzhou, China
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University), Ministry of Education, Guangzhou, China
- Center for Language Cognition and Assessment, Guangzhou, China
| | - Suiping Wang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University), Ministry of Education, Guangzhou, China
| | - Florian Kornrumpf
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Werner Sommer
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- Department of Psychology, Zhejiang Normal University, Jin Hua, China
- Department of Physics and Life Sciences Imaging Center, Hong Kong Baptist University, Hong Kong, China
| | - Olaf Dimigen
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- Max-Planck-Institute for Human Development, Berlin, Germany
- University of Groningen, Groningen, The Netherlands
| |
Collapse
|
2
|
Lutz CG, Coraj S, Fraga-González G, Brem S. The odd one out - Orthographic oddball processing in children with poor versus typical reading skills in a fast periodic visual stimulation EEG paradigm. Cortex 2024; 172:185-203. [PMID: 38354469 DOI: 10.1016/j.cortex.2023.12.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 09/17/2023] [Accepted: 12/12/2023] [Indexed: 02/16/2024]
Abstract
The specialization of left ventral occipitotemporal brain regions to automatically process word forms develops with reading acquisition and is diminished in children with poor reading skills (PR). Using a fast periodic visual oddball stimulation (FPVS) design during electroencephalography (EEG), we examined the level of sensitivity and familiarity to word form processing in ninety-two children in 2nd and 3rd grade with varying reading skills (n = 35 for PR, n = 40 for typical reading skills; TR). To test children's level of "sensitivity", false font (FF) and consonant string (CS) oddballs were embedded in base presentations of word (W) stimuli. "Familiarity" was examined by presenting letter string oddballs with increasing familiarity (CS, pseudoword - PW, W) in FF base stimuli. Overall, our results revealed stronger left-hemispheric coarse sensitivity effects ("FF in W" > "CS in W") in TR than in PR in both topographic and oddball frequency analyses. Further, children distinguished between orthographically legal and illegal ("W/PW in FF" > "CS in FF") but not yet between lexical and non-lexical ("W in FF" vs "PW in FF") word forms. Although both TR and PR exhibit visual sensitivity and can distinguish between orthographically legal and illegal letter strings, they still struggle with nuanced lexical distinctions. Moreover, the strength of sensitivity is linked to reading proficiency. Our work adds to established knowledge in the field to characterize the relationship between print tuning and reading skills and suggests differences in the developmental progress to automatically process word forms.
Collapse
Affiliation(s)
- Christina G Lutz
- Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric University Hospital Zurich, University of Zurich, Switzerland; Neuroscience Center Zurich, University of Zurich and ETH Zurich, Switzerland
| | - Seline Coraj
- Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric University Hospital Zurich, University of Zurich, Switzerland; Neuroscience Center Zurich, University of Zurich and ETH Zurich, Switzerland; Family Larsson-Rosenquist Foundation Center for Neurodevelopment, Growth, and Nutrition of the Newborn, Department of Neonatology, University Hospital Zurich, University of Zurich, Switzerland
| | - Gorka Fraga-González
- Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric University Hospital Zurich, University of Zurich, Switzerland
| | - Silvia Brem
- Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric University Hospital Zurich, University of Zurich, Switzerland; Neuroscience Center Zurich, University of Zurich and ETH Zurich, Switzerland; University Research Priority Program (URPP), Adaptive Brain Circuits in Development and Learning (AdaBD), University of Zurich, Switzerland.
| |
Collapse
|
3
|
Le Floch A, Ropars G. Hebbian Control of Fixations in a Dyslexic Reader: A Case Report. Brain Sci 2023; 13:1478. [PMID: 37891845 PMCID: PMC10605338 DOI: 10.3390/brainsci13101478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 09/23/2023] [Accepted: 10/15/2023] [Indexed: 10/29/2023] Open
Abstract
When reading, dyslexic readers exhibit more and longer fixations than normal readers. However, there is no significant difference when dyslexic and control readers perform only visual tasks on a string of letters, showing the importance of cognitive processes in reading. This linguistic and cognitive processing requirement in reading is often perturbed for dyslexic readers by perceived additional letters and word mirror images superposed on the primary images on the primary cortex, inducing internal visual crowding. Here, we show that while for a normal reader, the number and the duration of fixations remain invariant whatever the nature of the lighting, the excess of fixations and total duration of reading can be controlled for a dyslexic reader using the Hebbian mechanisms to erase extra images in optimized pulse-width lighting. In this case, the number of fixations can then be reduced by a factor of about 1.8, recovering the normal reading experiment.
Collapse
Affiliation(s)
- Albert Le Floch
- Laser Physics Laboratory, University of Rennes, CEDEX, 35042 Rennes, France;
- Quantum Electronics and Chiralities Laboratory, 20 Square Marcel Bouget, 35700 Rennes, France
| | - Guy Ropars
- Laser Physics Laboratory, University of Rennes, CEDEX, 35042 Rennes, France;
- Unité de Formation et de Recherche Sciences et Propriétés de la Matière, University of Rennes, CEDEX, 35042 Rennes, France
| |
Collapse
|
4
|
Vajs I, Papić T, Ković V, Savić AM, Janković MM. Accessible Dyslexia Detection with Real-Time Reading Feedback through Robust Interpretable Eye-Tracking Features. Brain Sci 2023; 13:brainsci13030405. [PMID: 36979215 PMCID: PMC10046816 DOI: 10.3390/brainsci13030405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 02/08/2023] [Accepted: 02/24/2023] [Indexed: 03/02/2023] Open
Abstract
Developing reliable, quantifiable, and accessible metrics for dyslexia diagnosis and tracking represents an important goal, considering the widespread nature of dyslexia and its negative impact on education and quality of life. In this study, we observe eye-tracking data from 15 dyslexic and 15 neurotypical Serbian school-age children who read text segments presented on different color configurations. Two new eye-tracking features were introduced that quantify the amount of spatial complexity of the subject’s gaze through time and inherently provide information regarding the locations in the text in which the subject struggled the most. The features were extracted from the raw eye-tracking data (x, y coordinates), from the original data gathered at 60 Hz, and from the downsampled data at 30 Hz, examining the compatibility of features with low-cost or custom-made eye-trackers. The features were used as inputs to machine learning algorithms, and the best-obtained accuracy was 88.9% for 60 Hz and 87.8% for 30 Hz. The features were also used to analyze the influence of background/overlay color on the quality of reading, and it was shown that the introduced features separate the dyslexic and control groups regardless of the background/overlay color. The colors can, however, influence each subject differently, which implies that an individualistic approach would be necessary to obtain the best therapeutic results. The performed study shows promise in dyslexia detection and evaluation, as the proposed features can be implemented in real time as feedback during reading and show effectiveness at detecting dyslexia with data obtained using a lower sampling rate.
Collapse
Affiliation(s)
- Ivan Vajs
- School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia
- Innovation Center, School of Electrical Engineering, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia
- Correspondence: (I.V.); (T.P.); Tel.: +381-11-3218-455 (I.V.); +381-63-1210-489 (T.P.)
| | - Tamara Papić
- Faculty of Technical Sciences, University Singidunum, Danijelova 32, 11000 Belgrade, Serbia
- Correspondence: (I.V.); (T.P.); Tel.: +381-11-3218-455 (I.V.); +381-63-1210-489 (T.P.)
| | - Vanja Ković
- Faculty of Philosophy, University of Belgrade, Čika-Ljubina 18-20, 11000 Belgrade, Serbia
| | - Andrej M. Savić
- School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia
| | - Milica M. Janković
- School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia
| |
Collapse
|
5
|
Nárai Á, Nemecz Z, Vidnyánszky Z, Weiss B. Lateralization of orthographic processing in fixed-gaze and natural reading conditions. Cortex 2022; 157:99-116. [PMID: 36279756 DOI: 10.1016/j.cortex.2022.07.017] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 06/29/2022] [Accepted: 07/27/2022] [Indexed: 12/15/2022]
Abstract
Lateralized processing of orthographic information is a hallmark of proficient reading. However, how this finding obtained for fixed-gaze processing of orthographic stimuli translates to ecologically valid reading conditions remained to be clarified. To address this shortcoming, here we assessed the lateralization of early orthographic processing in fixed-gaze and natural reading conditions using concurrent eye-tracking and EEG data recorded from young adults without reading difficulties. Sensor-space analyses confirmed the well-known left-lateralized negative-going deflection of fixed-gaze EEG activity throughout the period of early orthographic processing. At the same time, fixation-related EEG activity exhibited left-lateralized followed by right-lateralized processing of text stimuli during natural reading. A strong positive relationship was found between the early leftward lateralization in fixed-gaze and natural reading conditions. Using source-space analyses, early left-lateralized brain activity was obtained in lateraloccipital and posterior ventral occipito-temporal cortices reflecting letter-level processing in both conditions. In addition, in the same time interval, left-lateralized source activity was found also in premotor and parietal brain regions during natural reading. While brain activity remained left-lateralized in later stages representing word-level processing in posterior and middle ventral temporal regions in the fixed-gaze condition, fixation-related source activity became stronger in the right hemisphere in medial and more anterior ventral temporal brain regions indicating higher-level processing of orthographic information. Although our results show a strong positive relationship between the lateralization of letter-level processing in the two reading modes and suggest lateralized brain activity as a general marker for processing of orthographic information, they also clearly indicate the need for reading research in ecologically valid conditions to identify the neural basis of visuospatial attentional, oculomotor and higher-level processes specific to natural reading.
Collapse
Affiliation(s)
- Ádám Nárai
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest H-1117, Hungary
| | - Zsuzsanna Nemecz
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest H-1117, Hungary; Doctoral School of Psychology, ELTE Eötvös Loránd University, Budapest H-1064, Hungary; Institute of Psychology, ELTE Eötvös Loránd University, Budapest H-1064, Hungary
| | - Zoltán Vidnyánszky
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest H-1117, Hungary
| | - Béla Weiss
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest H-1117, Hungary.
| |
Collapse
|
6
|
Vajs I, Ković V, Papić T, Savić AM, Janković MM. Spatiotemporal Eye-Tracking Feature Set for Improved Recognition of Dyslexic Reading Patterns in Children. SENSORS 2022; 22:s22134900. [PMID: 35808394 PMCID: PMC9269601 DOI: 10.3390/s22134900] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 06/24/2022] [Accepted: 06/27/2022] [Indexed: 01/27/2023]
Abstract
Considering the detrimental effects of dyslexia on academic performance and its common occurrence, developing tools for dyslexia detection, monitoring, and treatment poses a task of significant priority. The research performed in this paper was focused on detecting and analyzing dyslexic tendencies in Serbian children based on eye-tracking measures. The group of 30 children (ages 7–13, 15 dyslexic and 15 non-dyslexic) read 13 different text segments on 13 different color configurations. For each text segment, the corresponding eye-tracking trail was recorded and then processed offline and represented by nine conventional features and five newly proposed features. The features were used for dyslexia recognition using several machine learning algorithms: logistic regression, support vector machine, k-nearest neighbor, and random forest. The highest accuracy of 94% was achieved using all the implemented features and leave-one-out subject cross-validation. Afterwards, the most important features for dyslexia detection (representing the complexity of fixation gaze) were used in a statistical analysis of the individual color effects on dyslexic tendencies within the dyslexic group. The statistical analysis has shown that the influence of color has high inter-subject variability. This paper is the first to introduce features that provide clear separability between a dyslexic and control group in the Serbian language (a language with a shallow orthographic system). Furthermore, the proposed features could be used for diagnosing and tracking dyslexia as biomarkers for objective quantification.
Collapse
Affiliation(s)
- Ivan Vajs
- School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia; (A.M.S.); (M.M.J.)
- Innovation Center, School of Electrical Engineering in Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia
- Correspondence: ; Tel.: +381-11-3218-455
| | - Vanja Ković
- Faculty of Philosophy, University of Belgrade, Čika-Ljubina 18-20, 11000 Belgrade, Serbia;
| | - Tamara Papić
- Faculty of Technical Sciences, University Singidunum, Danijelova 32, 11000 Belgrade, Serbia;
| | - Andrej M. Savić
- School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia; (A.M.S.); (M.M.J.)
| | - Milica M. Janković
- School of Electrical Engineering, University of Belgrade, Bulevar Kralja Aleksandra 73, 11120 Belgrade, Serbia; (A.M.S.); (M.M.J.)
| |
Collapse
|