1
|
Franceschiello B, Noto TD, Bourgeois A, Murray MM, Minier A, Pouget P, Richiardi J, Bartolomeo P, Anselmi F. Machine learning algorithms on eye tracking trajectories to classify patients with spatial neglect. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 221:106929. [PMID: 35675721 DOI: 10.1016/j.cmpb.2022.106929] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 05/19/2022] [Accepted: 05/31/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND AND OBJECTIVE Eye-movement trajectories are rich behavioral data, providing a window on how the brain processes information. We address the challenge of characterizing signs of visuo-spatial neglect from saccadic eye trajectories recorded in brain-damaged patients with spatial neglect as well as in healthy controls during a visual search task. METHODS We establish a standardized pre-processing pipeline adaptable to other task-based eye-tracker measurements. We use traditional machine learning algorithms together with deep convolutional networks (both 1D and 2D) to automatically analyze eye trajectories. RESULTS Our top-performing machine learning models classified neglect patients vs. healthy individuals with an Area Under the ROC curve (AUC) ranging from 0.83 to 0.86. Moreover, the 1D convolutional neural network scores correlated with the degree of severity of neglect behavior as estimated with standardized paper-and-pencil tests and with the integrity of white matter tracts measured from Diffusion Tensor Imaging (DTI). Interestingly, the latter showed a clear correlation with the third branch of the superior longitudinal fasciculus (SLF), especially damaged in neglect. CONCLUSIONS The study introduces new methods for both the pre-processing and the classification of eye-movement trajectories in patients with neglect syndrome. The proposed methods can likely be applied to other types of neurological diseases opening the possibility of new computer-aided, precise, sensitive and non-invasive diagnostic tools.
Collapse
Affiliation(s)
- Benedetta Franceschiello
- The LINE (Laboratory for Investigative Neurophysiology), Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.; CIBM Center for Biomedical Imaging, Lausanne, Switzerland; Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; The Sense Innovation and Research Center, Lausanne and Sion, Switzerland; School of Engineering, Institute of Systems Engineering, HES-SO Valais-Wallis, Route de L'industrie 23, Sion, Switzerland
| | - Tommaso Di Noto
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Alexia Bourgeois
- Laboratory of Cognitive Neurorehabilitation, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Micah M Murray
- The LINE (Laboratory for Investigative Neurophysiology), Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.; Department of Ophthalmology, Fondation Asile des Aveugles and University of Lausanne, Lausanne, Switzerland; CIBM Center for Biomedical Imaging, Lausanne, Switzerland; Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN, USA; The Sense Innovation and Research Center, Lausanne and Sion, Switzerland
| | - Astrid Minier
- The LINE (Laboratory for Investigative Neurophysiology), Department of Diagnostic and Interventional Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.; Department of Ophthalmology, Fondation Asile des Aveugles and University of Lausanne, Lausanne, Switzerland
| | - Pierre Pouget
- Laboratory of Cognitive Neurorehabilitation, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Jonas Richiardi
- Department of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; The Sense Innovation and Research Center, Lausanne and Sion, Switzerland
| | - Paolo Bartolomeo
- Sorbonne Universite, Inserm, CNRS, Institut du Cerveau - Paris Brain Institute, ICM, Hopital de la Pitie-Salpetriere, Paris, France
| | - Fabio Anselmi
- Center for Neuroscience and Artificial Intelligence, Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA; Center for Brains, Minds, and Machines, McGovern Institute for Brain Research at MIT, Cambridge, MA, USA.
| |
Collapse
|
2
|
Argiuolo A, Somma F, Bartolomeo P, Gigliotta O, Ponticorvo M. Indexes for the E-Baking Tray Task: A Look on Laterality, Verticality and Quality of Exploration. Brain Sci 2022; 12:brainsci12030401. [PMID: 35326356 PMCID: PMC8946214 DOI: 10.3390/brainsci12030401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 03/14/2022] [Accepted: 03/15/2022] [Indexed: 12/01/2022] Open
Abstract
The Baking Tray Task is an ecological task developed for the assessment of unilateral neglect that can also be used for research on neurotypical participants. In this task, participants are asked to place 16 objects inside a board as evenly as possible. In the case of impaired spatial exploration, consequent to right attentional networks damage, asymmetrical object disposition is observed as more objects are placed on the ipsilesional side (typically the right side). The E-BTT is a technology-enhanced version of the Baking Tray Task, implemented with a software platform, E-TAN, which detects the objects and automatically computes their spatial coordinates. This allows a complement to the traditional scoring methods with new measures to extract richer information from the data. In this study, we focus on neurotypical participants to explore if some new indexes, derived from the literature review on similar tasks, can be applied to BTT and E-BTT for research aims. A principal component analysis (PCA) was then performed to verify if these new indexes reflect some common dimensions. Results indicate the emergence of two principal dimensions: spatiality, which summarizes both laterality and verticality, and quality, which regards the explored space and (dis)organization in placing the items.
Collapse
Affiliation(s)
- Antonietta Argiuolo
- Natural and Artificial Cognition Laboratory, Department of Humanistic Studies, University of Naples Federico II, 80133 Naples, Italy; (F.S.); (O.G.); (M.P.)
- Correspondence:
| | - Federica Somma
- Natural and Artificial Cognition Laboratory, Department of Humanistic Studies, University of Naples Federico II, 80133 Naples, Italy; (F.S.); (O.G.); (M.P.)
| | - Paolo Bartolomeo
- Institut du Cerveau—Paris Brain Institute—ICM, Inserm, Hôpital de la Pitié Salpêtrière, Sorbonne Université, 75013 Paris, France;
| | - Onofrio Gigliotta
- Natural and Artificial Cognition Laboratory, Department of Humanistic Studies, University of Naples Federico II, 80133 Naples, Italy; (F.S.); (O.G.); (M.P.)
| | - Michela Ponticorvo
- Natural and Artificial Cognition Laboratory, Department of Humanistic Studies, University of Naples Federico II, 80133 Naples, Italy; (F.S.); (O.G.); (M.P.)
| |
Collapse
|
3
|
Chokron S, Peyrin C, Perez C. Ipsilesional deficit of selective attention in left homonymous hemianopia and left unilateral spatial neglect. Neuropsychologia 2019; 128:305-314. [DOI: 10.1016/j.neuropsychologia.2018.03.013] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2017] [Revised: 03/06/2018] [Accepted: 03/08/2018] [Indexed: 12/23/2022]
|
4
|
Bonato M, Romeo Z, Blini E, Pitteri M, Durgoni E, Passarini L, Meneghello F, Zorzi M. Ipsilesional Impairments of Visual Awareness After Right-Hemispheric Stroke. Front Psychol 2019; 10:697. [PMID: 31024378 PMCID: PMC6465520 DOI: 10.3389/fpsyg.2019.00697] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2018] [Accepted: 03/13/2019] [Indexed: 11/23/2022] Open
Abstract
Unilateral brain damage following stroke frequently hampers the processing of contralesional space. Whether and how it also affects the processing of stimuli appearing on the same side of the lesion is still poorly understood. Three main alternative hypotheses have been proposed, namely that ipsilesional processing is functionally (i) hyperefficient, (ii) impaired, or (iii) spared. Here, we investigated ipsilesional space awareness through a computerized paradigm that exploits a manipulation of concurrent information processing demands (i.e., multitasking). Twelve chronic right-hemisphere stroke patients with a total lack of awareness for the contralesional side of space were administered a task that required the spatial monitoring of two locations within the ipsilesional hemispace. Targets were presented immediately to the right of a central fixation point (3° eccentricity), or farther to the right toward the screen edge (17° eccentricity), or on both locations. Response to target position occurred either in isolation or while performing a concurrent visual or auditory task. Results showed that most errors occurred when two targets were simultaneously presented and patients were faced with additional task demands (in the visual or auditory modalities). In the context of concurrent visual load, ipsilesional targets presented at the rightmost location were omitted more frequently than those presented closer to fixation. This pattern qualifies ipsilesional processing in right-hemisphere stroke patients as functionally impaired, arguing against the notion of ipsilesional hyperperformance, especially when under visual load.
Collapse
Affiliation(s)
- Mario Bonato
- Department of General Psychology and Padova Neuroscience Center, University of Padua, Padua, Italy
| | | | - Elvio Blini
- Integrative Multisensory Perception Action and Cognition Team, University Claude Bernard of Lyon, Lyon, France
| | - Marco Pitteri
- Neurology Section, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | | | | | | | - Marco Zorzi
- Department of General Psychology and Padova Neuroscience Center, University of Padua, Padua, Italy.,IRCCS San Camillo Hospital, Venice, Italy
| |
Collapse
|
5
|
Paladini RE, Diana L, Nyffeler T, Mosimann UP, Nef T, Müri RM, Cazzoli D. The asymmetrical influence of increasing time-on-task on attentional disengagement. Neuropsychologia 2016; 92:107-114. [DOI: 10.1016/j.neuropsychologia.2016.02.026] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2015] [Revised: 02/26/2016] [Accepted: 02/28/2016] [Indexed: 11/24/2022]
|
6
|
Abstract
Based on previous studies demonstrating detrimental effects of reduced alertness on attentional orienting our study seeks to examine covert and overt attentional orienting in different arousal states. We hypothesized an attentional asymmetry with increasing reaction times to stimuli presented to the left visual field in a state of maximally reduced arousal. Eleven healthy participants underwent sleep deprivation and were examined repeatedly every 4 hr over 28 hr in total with two tasks measuring covert and overt orienting of attention. Contrary to our hypothesis, a reduction of arousal did not induce any asymmetry of overt orienting. Even in participants with profound and significant attentional asymmetries in covert orienting no substantial reaction time differences between left- and right-sided targets in the overt orienting task could be observed. This result is not in agreement with assumptions of a tight coupling of covert and overt attentional processes. In conclusion, we found differential effects of lowered arousal induced by sleep deprivation on covert and overt orienting of attention. This pattern of results points to a neuronal non-overlap of brain structures subserving these functions and a differential influence of the norepinephrine system on these modes of spatial attention.
Collapse
|
7
|
Bourgeois A, Chica AB, Migliaccio R, Bayle DJ, Duret C, Pradat-Diehl P, Lunven M, Pouget P, Bartolomeo P. Inappropriate rightward saccades after right hemisphere damage: Oculomotor analysis and anatomical correlates. Neuropsychologia 2015; 73:1-11. [DOI: 10.1016/j.neuropsychologia.2015.04.013] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2014] [Revised: 04/10/2015] [Accepted: 04/15/2015] [Indexed: 10/23/2022]
|
8
|
Orekhova EV, Stroganova TA. Arousal and attention re-orienting in autism spectrum disorders: evidence from auditory event-related potentials. Front Hum Neurosci 2014; 8:34. [PMID: 24567709 PMCID: PMC3915101 DOI: 10.3389/fnhum.2014.00034] [Citation(s) in RCA: 63] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2013] [Accepted: 01/17/2014] [Indexed: 01/16/2023] Open
Abstract
The extended phenotype of autism spectrum disorders (ASD) includes a combination of arousal regulation problems, sensory modulation difficulties, and attention re-orienting deficit. A slow and inefficient re-orienting to stimuli that appear outside of the attended sensory stream is thought to be especially detrimental for social functioning. Event-related potentials (ERPs) and magnetic fields (ERFs) may help to reveal which processing stages underlying brain response to unattended but salient sensory event are affected in individuals with ASD. Previous research focusing on two sequential stages of the brain response-automatic detection of physical changes in auditory stream, indexed by mismatch negativity (MMN), and evaluation of stimulus novelty, indexed by P3a component,-found in individuals with ASD either increased, decreased, or normal processing of deviance and novelty. The review examines these apparently conflicting results, notes gaps in previous findings, and suggests a potentially unifying hypothesis relating the dampened responses to unattended sensory events to the deficit in rapid arousal process. Specifically, "sensory gating" studies focused on pre-attentive arousal consistently demonstrated that brain response to unattended and temporally novel sound in ASD is already affected at around 100 ms after stimulus onset. We hypothesize that abnormalities in nicotinic cholinergic arousal pathways, previously reported in individuals with ASD, may contribute to these ERP/ERF aberrations and result in attention re-orienting deficit. Such cholinergic dysfunction may be present in individuals with ASD early in life and can influence both sensory processing and attention re-orienting behavior. Identification of early neurophysiological biomarkers for cholinergic deficit would help to detect infants "at risk" who can potentially benefit from particular types of therapies or interventions.
Collapse
Affiliation(s)
- Elena V Orekhova
- MEG Centre, Moscow State University of Psychology and Education Moscow, Russia ; MedTech West, Sahlgrenska Academy Gothenburg, Sweden
| | | |
Collapse
|
9
|
Abnormal pre-attentive arousal in young children with autism spectrum disorder contributes to their atypical auditory behavior: an ERP study. PLoS One 2013; 8:e69100. [PMID: 23935931 PMCID: PMC3723785 DOI: 10.1371/journal.pone.0069100] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2013] [Accepted: 06/05/2013] [Indexed: 12/22/2022] Open
Abstract
Auditory sensory modulation difficulties and problems with automatic re-orienting to sound are well documented in autism spectrum disorders (ASD). Abnormal preattentive arousal processes may contribute to these deficits. In this study, we investigated components of the cortical auditory evoked potential (CAEP) reflecting preattentive arousal in children with ASD and typically developing (TD) children aged 3-8 years. Pairs of clicks (‘S1’ and ‘S2’) separated by a 1 sec S1-S2 interstimulus interval (ISI) and much longer (8-10 sec) S1-S1 ISIs were presented monaurally to either the left or right ear. In TD children, the P50, P100 and N1c CAEP components were strongly influenced by temporal novelty of clicks and were much greater in response to the S1 than the S2 click. Irrespective of the stimulation side, the ‘tangential’ P100 component was rightward lateralized in TD children, whereas the ‘radial’ N1c component had higher amplitude contralaterally to the stimulated ear. Compared to the TD children, children with ASD demonstrated 1) reduced amplitude of the P100 component under the condition of temporal novelty (S1) and 2) an attenuated P100 repetition suppression effect. The abnormalities were lateralized and depended on the presentation side. They were evident in the case of the left but not the right ear stimulation. The P100 abnormalities in ASD correlated with the degree of developmental delay and with the severity of auditory sensory modulation difficulties observed in early life. The results suggest that some rightward-lateralized brain networks that are crucially important for arousal and attention re-orienting are compromised in children with ASD and that this deficit contributes to sensory modulation difficulties and possibly even other behavioral deficits in ASD.
Collapse
|
10
|
de Haan B, Karnath HO, Driver J. Mechanisms and anatomy of unilateral extinction after brain injury. Neuropsychologia 2012; 50:1045-53. [DOI: 10.1016/j.neuropsychologia.2012.02.015] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2011] [Revised: 02/14/2012] [Accepted: 02/20/2012] [Indexed: 11/24/2022]
|
11
|
Butler SH, Rossit S, Gilchrist ID, Ludwig CJH, Olk B, Muir K, Reeves I, Harvey M. Non-lateralised deficits in anti-saccade performance in patients with hemispatial neglect. Neuropsychologia 2009; 47:2488-95. [PMID: 19410585 DOI: 10.1016/j.neuropsychologia.2009.04.022] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2008] [Revised: 03/12/2009] [Accepted: 04/24/2009] [Indexed: 11/25/2022]
Abstract
We tested patients suffering from hemispatial neglect on the anti-saccade paradigm to assess voluntary control of saccades. In this task participants are required to saccade away from an abrupt onset target. As has been previously reported, in the pro-saccade condition neglect patients showed increased latencies towards targets presented on the left and their accuracy was reduced as a result of greater undershoot. To our surprise though, in the anti-saccade condition, we found strong bilateral effects: the neglect patients produced large numbers of erroneous pro-saccades to both left and right stimuli. This deficit in voluntary control was present even in patients whose lesions spared the frontal lobes. These results suggest that the voluntary control of action is supported by an integrated network of cortical regions, including more posterior areas. Damage to one or more components within this network may result in impaired voluntary control.
Collapse
Affiliation(s)
- Stephen H Butler
- Department of Psychology, University of Strathclyde, Glasgow, UK
| | | | | | | | | | | | | | | |
Collapse
|
12
|
Ronchi R, Posteraro L, Fortis P, Bricolo E, Vallar G. Perseveration in left spatial neglect: Drawing and cancellation tasks. Cortex 2009; 45:300-12. [PMID: 18708187 DOI: 10.1016/j.cortex.2008.03.012] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2007] [Revised: 11/27/2007] [Accepted: 03/13/2008] [Indexed: 11/28/2022]
Affiliation(s)
- Roberta Ronchi
- Department of Psychology, University of Milano-Bicocca, Milano, Italy
| | | | | | | | | |
Collapse
|
13
|
Abstract
PURPOSE OF REVIEW Left visual neglect is a frequent and dramatic consequence of right hemisphere lesions. Diagnosis is important because behavioural and pharmacological treatments are available. Furthermore, neglect raises important issues concerning the brain mechanisms of consciousness, perception and attention. RECENT FINDINGS Recent behavioural findings and new techniques, such as transcranial magnetic stimulation, direct cortical and subcortical stimulation during brain surgery, and diffusion tensor imaging tractography, have provided evidence relevant to the debate concerning the functional mechanisms and the anatomical bases of neglect. SUMMARY Several component deficits appear to interact in producing different forms of neglect. Rather than lesions at single cortical levels, dysfunction of large-scale brain networks, often induced by white matter disconnection, may constitute the crucial antecedent of neglect signs.
Collapse
Affiliation(s)
- Paolo Bartolomeo
- Inserm Unit 610 and Federation of Neurology, Salpêtrière Hospital, University Pierre and Marie Curie - Paris 6, Paris, France.
| |
Collapse
|
14
|
Semantic processing of neglected numbers. Cortex 2007; 44:673-82. [PMID: 18472037 DOI: 10.1016/j.cortex.2007.02.003] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2006] [Revised: 02/05/2007] [Accepted: 02/08/2007] [Indexed: 11/22/2022]
Abstract
While neglected stimuli can still be processed, few studies have directly addressed the issue of the unconscious access to semantics. In order to clarify this issue, we engaged four patients with unilateral left spatial neglect in a number comparison task. Each target number was preceded by a lateralized number prime, either in the intact or neglected hemifield (HF). Both group analyses and the intensive study of a single patient show that left (neglected) as well as right (consciously perceived) number primes affect performance: primes representing quantities that fall on the same side of the reference as the target lead to faster categorization. This congruency effect is highly suggestive of numerical semantic processing of neglected stimuli. Absence of conscious perception of neglected primes was evaluated using a combination of subjective and objective measures of performance in forced-choice tasks.
Collapse
|
15
|
Abstract
Saccades are rapid eye movements that assist vision by pointing the fovea of the retina, which contains the highest density of photoreceptors, at features of interest in the visual environment. A great deal is now known about the properties and neurobiology of saccades in both health and disease states. They have consequently become a valuable diagnostic and research tool. In this review, we describe the common saccadic disorders and their causes. We also highlight recent insights into the pathophysiologic mechanisms underlying these disorders and discuss how these insights have helped increase our understanding of the saccadic system as a whole.
Collapse
Affiliation(s)
- Matthew J Thurtell
- Department of Neurology, University Hospitals of Cleveland, HAN 5040, 11100 Euclid Avenue, Cleveland, OH 44106, USA
| | | | | |
Collapse
|