1
|
Alexander RG, Venkatakrishnan A, Chanovas J, Ferguson S, Macknik SL, Martinez-Conde S. Why did Rubens add a parrot to Titian's The Fall of Man? A pictorial manipulation of joint attention. J Vis 2024; 24:1. [PMID: 38558160 PMCID: PMC10996941 DOI: 10.1167/jov.24.4.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 01/19/2024] [Indexed: 04/04/2024] Open
Abstract
Almost 400 years ago, Rubens copied Titian's The Fall of Man, albeit with important changes. Rubens altered Titian's original composition in numerous ways, including by changing the gaze directions of the depicted characters and adding a striking red parrot to the painting. Here, we quantify the impact of Rubens's choices on the viewer's gaze behavior. We displayed digital copies of Rubens's and Titian's artworks-as well as a version of Rubens's painting with the parrot digitally removed-on a computer screen while recording the eye movements produced by observers during free visual exploration of each image. To assess the effects of Rubens's changes to Titian's composition, we directly compared multiple gaze parameters across the different images. We found that participants gazed at Eve's face more frequently in Rubens's painting than in Titian's. In addition, gaze positions were more tightly focused for the former than for the latter, consistent with different allocations of viewer interest. We also investigated how gaze fixation on Eve's face affected the perceptual visibility of the parrot in Rubens's composition and how the parrot's presence versus its absence impacted gaze dynamics. Taken together, our results demonstrate that Rubens's critical deviations from Titian's painting have powerful effects on viewers' oculomotor behavior.
Collapse
Affiliation(s)
- Robert G Alexander
- Department of Psychology & Counseling, New York Institute of Technology, New York, NY, USA
| | - Ashwin Venkatakrishnan
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Jordi Chanovas
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
- Graduate Program in Neural and Behavioral Science, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Sophie Ferguson
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Stephen L Macknik
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| |
Collapse
|
2
|
Zhao S, Contadini-Wright C, Chait M. Cross-Modal Interactions Between Auditory Attention and Oculomotor Control. J Neurosci 2024; 44:e1286232024. [PMID: 38331581 PMCID: PMC10941240 DOI: 10.1523/jneurosci.1286-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 01/28/2024] [Accepted: 01/31/2024] [Indexed: 02/10/2024] Open
Abstract
Microsaccades are small, involuntary eye movements that occur during fixation. Their role is debated with recent hypotheses proposing a contribution to automatic scene sampling. Microsaccadic inhibition (MSI) refers to the abrupt suppression of microsaccades, typically evoked within 0.1 s after new stimulus onset. The functional significance and neural underpinnings of MSI are subjects of ongoing research. It has been suggested that MSI is a component of the brain's attentional re-orienting network which facilitates the allocation of attention to new environmental occurrences by reducing disruptions or shifts in gaze that could interfere with processing. The extent to which MSI is reflexive or influenced by top-down mechanisms remains debated. We developed a task that examines the impact of auditory top-down attention on MSI, allowing us to disentangle ocular dynamics from visual sensory processing. Participants (N = 24 and 27; both sexes) listened to two simultaneous streams of tones and were instructed to attend to one stream while detecting specific task "targets." We quantified MSI in response to occasional task-irrelevant events presented in both the attended and unattended streams (frequency steps in Experiment 1, omissions in Experiment 2). The results show that initial stages of MSI are not affected by auditory attention. However, later stages (∼0.25 s postevent onset), affecting the extent and duration of the inhibition, are enhanced for sounds in the attended stream compared to the unattended stream. These findings provide converging evidence for the reflexive nature of early MSI stages and robustly demonstrate the involvement of auditory attention in modulating the later stages.
Collapse
Affiliation(s)
- Sijia Zhao
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| | | | - Maria Chait
- Ear Institute, University College London, London WC1X 8EE, United Kingdom
| |
Collapse
|
3
|
Greene L, Reidy J, Morton N, Atherton A, Barker LA. Dynamic Emotion Recognition and Social Inference Ability in Traumatic Brain Injury: An Eye-Tracking Comparison Study. Behav Sci (Basel) 2023; 13:816. [PMID: 37887466 PMCID: PMC10604615 DOI: 10.3390/bs13100816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 09/22/2023] [Accepted: 09/27/2023] [Indexed: 10/28/2023] Open
Abstract
Emotion recognition and social inference impairments are well-documented features of post-traumatic brain injury (TBI), yet the mechanisms underpinning these are not fully understood. We examined dynamic emotion recognition, social inference abilities, and eye fixation patterns between adults with and without TBI. Eighteen individuals with TBI and 18 matched non-TBI participants were recruited and underwent all three components of The Assessment of Social Inference Test (TASIT). The TBI group were less accurate in identifying emotions compared to the non-TBI group. Individuals with TBI also scored lower when distinguishing sincere and sarcastic conversations, but scored similarly to those without TBI during lie vignettes. Finally, those with TBI also had difficulty understanding the actor's intentions, feelings, and beliefs compared to participants without TBI. No group differences were found for eye fixation patterns, and there were no associations between fixations and behavioural accuracy scores. This conflicts with previous studies, and might be related to an important distinction between static and dynamic stimuli. Visual strategies appeared goal- and stimulus-driven, with attention being distributed to the most diagnostic area of the face for each emotion. These findings suggest that low-level visual deficits may not be modulating emotion recognition and social inference disturbances post-TBI.
Collapse
Affiliation(s)
- Leanne Greene
- Centre for Behavioural Science and Applied Psychology, Department of Psychology, Sociology and Politics, Sheffield Hallam University, Sheffield S10 2BP, UK; (J.R.); (L.A.B.)
| | - John Reidy
- Centre for Behavioural Science and Applied Psychology, Department of Psychology, Sociology and Politics, Sheffield Hallam University, Sheffield S10 2BP, UK; (J.R.); (L.A.B.)
| | - Nick Morton
- Neuro Rehabilitation Outreach Team, Rotherham, Doncaster and South Humber NHS Trust, Doncaster DN4 8QN, UK;
| | - Alistair Atherton
- Consultant Clinical Neuropsychologist, Atherton Neuropsychology Consultancy Ltd. Parkhead Consultancy, 356 Ecclesall Road, Sheffield S11 9PU, UK;
| | - Lynne A. Barker
- Centre for Behavioural Science and Applied Psychology, Department of Psychology, Sociology and Politics, Sheffield Hallam University, Sheffield S10 2BP, UK; (J.R.); (L.A.B.)
| |
Collapse
|
4
|
Mei Chow H, Spering M. Eye movements during optic flow perception. Vision Res 2023; 204:108164. [PMID: 36566560 DOI: 10.1016/j.visres.2022.108164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 11/22/2022] [Accepted: 12/07/2022] [Indexed: 12/24/2022]
Abstract
Optic flow is an important visual cue for human perception and locomotion and naturally triggers eye movements. Here we investigate whether the perception of optic flow direction is limited or enhanced by eye movements. In Exp. 1, 23 human observers localized the focus of expansion (FOE) of an optic flow pattern; in Exp. 2, 18 observers had to detect brief visual changes at the FOE. Both tasks were completed during free viewing and fixation conditions while eye movements were recorded. Task difficulty was varied by manipulating the coherence of radial motion from the FOE (4 %-90 %). During free viewing, observers tracked the optic flow pattern with a combination of saccades and smooth eye movements. During fixation, observers nevertheless made small-scale eye movements. Despite differences in spatial scale, eye movements during free viewing and fixation were similarly directed toward the FOE (saccades) and away from the FOE (smooth tracking). Whereas FOE localization sensitivity was not affected by eye movement instructions (Exp. 1), observers' sensitivity to detect brief changes at the FOE was 27 % higher (p <.001) during free-viewing compared to fixation (Exp. 2). This performance benefit was linked to reduced saccade endpoint errors, indicating the direct beneficial impact of foveating eye movements on performance in a fine-grain perceptual task, but not during coarse perceptual localization.
Collapse
Affiliation(s)
- Hiu Mei Chow
- Dept. of Psychology, St. Thomas University, Fredericton, Canada; Dept. of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada.
| | - Miriam Spering
- Dept. of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada; Djavad Mowafaghian Center for Brain Health, University of British Columbia, Vancouver, Canada; Institute for Computing, Information and Cognitive Systems, University of British Columbia, Vancouver, Canada
| |
Collapse
|
5
|
Eye movements in Parkinson's disease during visual search. J Neurol Sci 2022; 440:120299. [DOI: 10.1016/j.jns.2022.120299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2022] [Revised: 04/30/2022] [Accepted: 05/23/2022] [Indexed: 10/18/2022]
|
6
|
Bowers NR, Gautier J, Lin S, Roorda A. Fixational eye movements in passive versus active sustained fixation tasks. J Vis 2021; 21:16. [PMID: 34677574 PMCID: PMC8556553 DOI: 10.1167/jov.21.11.16] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
Human fixational eye movements are so small and precise that high-speed, accurate tools are needed to fully reveal their properties and functional roles. Where the fixated image lands on the retina and how it moves for different levels of visually demanding tasks is the subject of the current study. An Adaptive Optics Scanning Laser Ophthalmoscope (AOSLO) was used to image, track and present a variety of fixation targets (Maltese cross, disk, concentric circles, Vernier and tumbling-E letter) to healthy subjects. During these different passive (static) or active (discriminating) tasks under natural eye motion, the landing position of the target on the retina was tracked in space and time over the retinal image directly with high spatial (<1 arcmin) and temporal (960 Hz) resolution. We computed both the eye motion and the exact trajectory of the fixated target's motion over the retina. We confirmed that compared to passive tasks, active tasks elicited a partial inhibition of microsaccades, leading to longer drift periods compensated by larger corrective saccades. Consequently, the overall fixation stability during active tasks was on average 57% larger than during passive tasks. The preferred retinal locus of fixation was the same for each task and did not coincide with the location of the peak cone density.
Collapse
Affiliation(s)
- Norick R Bowers
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA.,
| | - Josselin Gautier
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA.,
| | - Samantha Lin
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA.,
| | - Austin Roorda
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, CA, USA.,
| |
Collapse
|
7
|
Raffi M, Trofè A, Perazzolo M, Meoni A, Piras A. Sensory Input Modulates Microsaccades during Heading Perception. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:2865. [PMID: 33799672 PMCID: PMC8000400 DOI: 10.3390/ijerph18062865] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 03/04/2021] [Accepted: 03/07/2021] [Indexed: 11/21/2022]
Abstract
Microsaccades are small eye movements produced during attempted fixation. During locomotion, the eyes scan the environment; the gaze is not always directed to the focus of expansion of the optic flow field. We sought to investigate whether the microsaccadic activity was modulated by eye position during the view of radial optic flow stimuli, and if the presence or lack of a proprioceptive input signal may influence the microsaccade characteristics during self-motion perception. We recorded the oculomotor activity when subjects were either standing or sitting in front of a screen during the view of optic flow stimuli that simulated specific heading directions with different gaze positions. We recorded five trials of each stimulus. Results showed that microsaccade duration, peak velocity, and rate were significantly modulated by optic flow stimuli and trial sequence. We found that the microsaccade rate increased in each condition from trial 1 to trial 5. Microsaccade peak velocity and duration were significantly different across trials. The analysis of the microsaccade directions showed that the different combinations of optic flow and eye position evoked non-uniform directions of microsaccades in standing condition with mean vectors in the upper-left quadrant of the visual field, uncorrelated with optic flow directions and eye positions. In sitting conditions, all stimuli evoked uniform directions of microsaccades. Present results indicate that the proprioceptive signals when the subjects stand up creates a different input that could alter the eye-movement characteristics during heading perceptions.
Collapse
Affiliation(s)
- Milena Raffi
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| | - Aurelio Trofè
- Department of Quality of Life, University of Bologna, 47921 Rimini, Italy;
| | - Monica Perazzolo
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| | - Andrea Meoni
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| | - Alessandro Piras
- Department of Biomedical and Neuromotor Sciences, University of Bologna, 40126 Bologna, Italy; (M.P.); (A.M.); (A.P.)
| |
Collapse
|
8
|
Abstract
Sensory systems often suppress self-generated sensations in order to discriminate them from those arising in the environment. The suppression of visual sensitivity during rapid eye movements is well established, and although functionally beneficial most of the time, it can limit the performance of certain tasks. Here, we show that with repeated practice, mechanisms that suppress visual signals during eye movements can be modified. People trained to detect brief visual patterns learn to turn off suppression around the expected time of the target. These findings demonstrate an elegant form of plasticity, capable of improving the visibility of behaviorally relevant stimuli without compromising the wider functional benefits of suppression. Perceptual stability is facilitated by a decrease in visual sensitivity during rapid eye movements, called saccadic suppression. While a large body of evidence demonstrates that saccadic programming is plastic, little is known about whether the perceptual consequences of saccades can be modified. Here, we demonstrate that saccadic suppression is attenuated during learning on a standard visual detection-in-noise task, to the point that it is effectively silenced. Across a period of 7 days, 44 participants were trained to detect brief, low-contrast stimuli embedded within dynamic noise, while eye position was tracked. Although instructed to fixate, participants regularly made small fixational saccades. Data were accumulated over a large number of trials, allowing us to assess changes in performance as a function of the temporal proximity of stimuli and saccades. This analysis revealed that improvements in sensitivity over the training period were accompanied by a systematic change in the impact of saccades on performance—robust saccadic suppression on day 1 declined gradually over subsequent days until its magnitude became indistinguishable from zero. This silencing of suppression was not explained by learning-related changes in saccade characteristics and generalized to an untrained retinal location and stimulus orientation. Suppression was restored when learned stimulus timing was perturbed, consistent with the operation of a mechanism that temporarily reduces or eliminates saccadic suppression, but only when it is behaviorally advantageous to do so. Our results indicate that learning can circumvent saccadic suppression to improve performance, without compromising its functional benefits in other viewing contexts.
Collapse
|
9
|
Alexander RG, Waite S, Macknik SL, Martinez-Conde S. What do radiologists look for? Advances and limitations of perceptual learning in radiologic search. J Vis 2020; 20:17. [PMID: 33057623 PMCID: PMC7571277 DOI: 10.1167/jov.20.10.17] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2019] [Accepted: 09/14/2020] [Indexed: 12/31/2022] Open
Abstract
Supported by guidance from training during residency programs, radiologists learn clinically relevant visual features by viewing thousands of medical images. Yet the precise visual features that expert radiologists use in their clinical practice remain unknown. Identifying such features would allow the development of perceptual learning training methods targeted to the optimization of radiology training and the reduction of medical error. Here we review attempts to bridge current gaps in understanding with a focus on computational saliency models that characterize and predict gaze behavior in radiologists. There have been great strides toward the accurate prediction of relevant medical information within images, thereby facilitating the development of novel computer-aided detection and diagnostic tools. In some cases, computational models have achieved equivalent sensitivity to that of radiologists, suggesting that we may be close to identifying the underlying visual representations that radiologists use. However, because the relevant bottom-up features vary across task context and imaging modalities, it will also be necessary to identify relevant top-down factors before perceptual expertise in radiology can be fully understood. Progress along these dimensions will improve the tools available for educating new generations of radiologists, and aid in the detection of medically relevant information, ultimately improving patient health.
Collapse
Affiliation(s)
- Robert G Alexander
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Stephen Waite
- Department of Radiology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Stephen L Macknik
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Health Sciences University, Brooklyn, NY, USA
| |
Collapse
|
10
|
Abstract
Despite recent advances on the mechanisms and purposes of fine oculomotor behavior, a rigorous assessment of the precision and accuracy of the smallest saccades is still lacking. Yet knowledge of how effectively these movements shift gaze is necessary for understanding their functions and is helpful in further elucidating their motor underpinnings. Using a combination of high-resolution eye-tracking and gaze-contingent control, here we examined the accuracy and precision of saccades aimed toward targets ranging from [Formula: see text] to [Formula: see text] eccentricity. We show that even small saccades of just 14-[Formula: see text] are very effective in centering the stimulus on the retina. Furthermore, we show that for a target at any given eccentricity, the probability of eliciting a saccade depends on its efficacy in reducing the foveal offset. The pattern of results reported here is consistent with current knowledge on the motor mechanisms of microsaccade production.
Collapse
Affiliation(s)
- Martina Poletti
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA.
- Department of Neuroscience, University of Rochester, Rochester, NY, 14627, USA.
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA.
| | - Janis Intoy
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
- Graduate Program for Neuroscience, Boston University, Boston, MA, 02215, USA
| | - Michele Rucci
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, 14627, USA
- Center for Visual Science, University of Rochester, Rochester, NY, 14627, USA
| |
Collapse
|
11
|
Duchowski AT, Krejtz K, Zurawska J, House DH. Using Microsaccades to Estimate Task Difficulty During Visual Search of Layered Surfaces. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:2904-2918. [PMID: 30835226 DOI: 10.1109/tvcg.2019.2901881] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
We develop an approach to using microsaccade dynamics for the measurement of task difficulty/cognitive load imposed by a visual search task of a layered surface. Previous studies provide converging evidence that task difficulty/cognitive load can influence microsaccade activity. We corroborate this notion. Specifically, we explore this relationship during visual search for features embedded in a terrain-like surface, with the eyes allowed to move freely during the task. We make two relevant contributions. First, we validate an approach to distinguishing between the ambient and focal phases of visual search. We show that this spectrum of visual behavior can be quantified by a single previously reported estimator, known as Krejtz's K coefficient. Second, we use ambient/focal segments based on K as a moderating factor for microsaccade analysis in response to task difficulty. We find that during the focal phase of visual search (a) microsaccade magnitude increases significantly, and (b) microsaccade rate decreases significantly, with increased task difficulty. We conclude that the combined use of K and microsaccade analysis may be helpful in building effective tools that provide an indication of the level of cognitive activity within a task while the task is being performed.
Collapse
|
12
|
Otero-Millan J, Langston RE, Costela F, Macknik SL, Martinez-Conde S. Microsaccade generation requires a foveal anchor. J Eye Mov Res 2020; 12. [PMID: 33828756 PMCID: PMC7962683 DOI: 10.16910/jemr.12.6.14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Visual scene characteristics can affect various aspects of saccade and microsaccade dynamics. For example, blank visual scenes are known to elicit diminished saccade and microsaccade production, compared to natural scenes. Similarly, microsaccades are less frequent in the dark. Yet, the extent to which foveal versus peripheral visual information contribute to microsaccade production remains unclear: because microsaccade directions are biased towards covert attention locations, it follows that peripheral visual stimulation could suffice to produce regular microsaccade dynamics, even without foveal stimulation being present. Here we determined the characteristics of microsaccades as a function of foveal and/or peripheral visual stimulation, while human subjects conducted four types of oculomotor tasks (fixation, free viewing, guided viewing and passive viewing). Foveal information was either available, or made unavailable, by the presentation of simulated scotomas. We found foveal stimulation to be critical for microsaccade production, and peripheral stimulation, by itself, to be insufficient to yield normal microsaccades. In each oculomotor task, microsaccade production decreased when scotomas blocked foveal stimulation. Across comparable foveal stimulation conditions, the type of peripheral stimulation (static versus dynamic) moreover affected microsaccade production, with dynamic backgrounds resulting in lower microsaccadic rates than static backgrounds. These results indicate that a foveal visual anchor is necessary for normal microsaccade generation. Whereas peripheral visual stimulation, on its own, does not suffice for normal microsaccade production, it can nevertheless modulate microsaccadic characteristics. These findings extend our current understanding of the links between visual input and ocular motor control, and may therefore help improve the diagnosis and treatment of ophthalmic conditions that degrade central vision, such as age-related macular degeneration.
Collapse
|
13
|
Alexander RG, Macknik SL, Martinez-Conde S. Microsaccades in Applied Environments: Real-World Applications of Fixational Eye Movement Measurements. J Eye Mov Res 2020; 12:10.16910/jemr.12.6.15. [PMID: 33828760 PMCID: PMC7962687 DOI: 10.16910/jemr.12.6.15] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Across a wide variety of research environments, the recording of microsaccades and other fixational eye movements has provided insight and solutions into practical problems. Here we review the literature on fixational eye movements-especially microsaccades-in applied and ecologically-valid scenarios. Recent technical advances allow noninvasive fixational eye movement recordings in real-world contexts, while observers perform a variety of tasks. Thus, fixational eye movement measures have been obtained in a host of real-world scenarios, such as in connection with driver fatigue, vestibular sensory deprivation in astronauts, and elite athletic training, among others. Here we present the state of the art in the practical applications of fixational eye movement research, examine its potential future uses, and discuss the benefits of including microsaccade measures in existing eye movement detection technologies. Current evidence supports the inclusion of fixational eye movement measures in real-world contexts, as part of the development of new or improved oculomotor assessment tools. The real-world applications of fixational eye movement measurements will only grow larger and wider as affordable high-speed and high-spatial resolution eye trackers become increasingly prevalent.
Collapse
|
14
|
Hauperich AK, Young LK, Smithson HE. What makes a microsaccade? A review of 70 years of research prompts a new detection method. J Eye Mov Res 2020; 12. [PMID: 33828754 PMCID: PMC7962681 DOI: 10.16910/jemr.12.6.13] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
A new method for detecting microsaccades in eye-movement data is presented, following a review of reported microsaccade properties between the 1940s and today. The review focuses on the parameter ranges within which certain physical markers of microsaccades are thought to occur, as well as any features of microsaccades that have been stably reported over time. One feature of microsaccades, their binocularity, drives the new microsaccade detection method. The binocular correlation method for microsaccade detection is validated on two datasets of binocular eye-movements recorded using video-based systems: one collected as part of this study, and one from Nyström et al, 2017. Comparisons between detection methods are made using precision-recall statistics. This confirms that the binocular correlation method performs well when compared to manual coders and performs favourably compared to the commonly used Engbert & Kliegl (2003) method with subsequent modifications (Engbert & Mergenthaler, 2006). The binocular correlation microsaccade detection method is easy to implement and MATLAB code is made available to download.
Collapse
|
15
|
Waite S, Farooq Z, Grigorian A, Sistrom C, Kolla S, Mancuso A, Martinez-Conde S, Alexander RG, Kantor A, Macknik SL. A Review of Perceptual Expertise in Radiology-How it develops, How we can test it, and Why humans still matter in the era of Artificial Intelligence. Acad Radiol 2020; 27:26-38. [PMID: 31818384 DOI: 10.1016/j.acra.2019.08.018] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 08/26/2019] [Accepted: 08/27/2019] [Indexed: 10/25/2022]
Abstract
As the first step in image interpretation is detection, an error in perception can prematurely end the diagnostic process leading to missed diagnoses. Because perceptual errors of this sort-"failure to detect"-are the most common interpretive error (and cause of litigation) in radiology, understanding the nature of perceptual expertise is essential in decreasing radiology's long-standing error rates. In this article, we review what constitutes a perceptual error, the existing models of radiologic image perception, the development of perceptual expertise and how it can be tested, perceptual learning methods in training radiologists, and why understanding perceptual expertise is still relevant in the era of artificial intelligence. Adding targeted interventions, such as perceptual learning, to existing teaching practices, has the potential to enhance expertise and reduce medical error.
Collapse
|
16
|
Roberts MJ, Lange G, Van Der Veen T, Lowet E, De Weerd P. The Attentional Blink is Related to the Microsaccade Rate Signature. Cereb Cortex 2019; 29:5190-5203. [PMID: 30941400 DOI: 10.1093/cercor/bhz058] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2018] [Revised: 02/26/2019] [Accepted: 03/02/2019] [Indexed: 11/15/2022] Open
Abstract
The reduced detectability of a target T2 following discrimination of a preceding target T1 in the attentional blink (AB) paradigm is classically interpreted as a consequence of reduced attention to T2 due to attentional allocation to T1. Here, we investigated whether AB was related to changes in microsaccade rate (MSR). We found a pronounced MSR signature following T1 onset, characterized by MSR suppression from 200 to 328 ms and enhancement from 380 to 568 ms. Across participants, the magnitude of the MSR suppression correlated with the AB effect such that low T2 detectability corresponded to reduced MSR. However, in the same task, T1 error trials coincided with the presence of microsaccades. We discuss this apparent paradox in terms of known neurophysiological correlates of MS whereby cortical excitability is suppressed both during the microsaccade and MSR suppression, in accordance to poor T1 performance with microsaccade occurrence and poor T2 performance with microsaccade absence. Our data suggest a novel low-level mechanism contributing to AB characterized by reduced MSR, thought to cause suppressed visual cortex excitability. This opens the question of whether attention mediates T2 performance suppression independently from MSR, and if not, how attention interacts with MSR to produce the T2 performance suppression.
Collapse
Affiliation(s)
- Mark J Roberts
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Gesa Lange
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Tracey Van Der Veen
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Eric Lowet
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands.,Department of Biology, Boston University, Boston, MA, USA
| | - Peter De Weerd
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands.,Maastricht Centre for Systems Biology (MaCSBio), Faculty of Science and Engineering, Maastricht, The Netherlands
| |
Collapse
|
17
|
Abstract
This work presents a visual analytics approach to explore microsaccade distributions in high-frequency eye tracking data. Research studies often apply filter algorithms and parameter values for microsaccade detection. Even when the same algorithms are employed, different parameter values might be adopted across different studies. In this paper, we present a visual analytics system (VisME) to promote reproducibility in the data analysis of microsaccades. It allows users to interactively vary the parametric values for microsaccade filters and evaluate the resulting influence on microsaccade behavior across individuals and on a group level. In particular, we exploit brushing-and-linking techniques that allow the microsaccadic properties of space, time, and movement direction to be extracted, visualized, and compared across multiple views. We demonstrate in a case study the use of our visual analytics system on data sets collected from natural scene viewing and show in a qualitative usability study the usefulness of this approach for eye tracking researchers. We believe that interactive tools such as VisME will promote greater transparency in eye movement research by providing researchers with the ability to easily understand complex eye tracking data sets; such tools can also serve as teaching systems. VisME is provided as open source software.
Collapse
|
18
|
Tang S, Skelly P, Otero-Millan J, Jacobs J, Murray J, Shaikh AG, Ghasia FF. Effects of visual blur on microsaccades during visual exploration. J Eye Mov Res 2019; 12. [PMID: 33828759 PMCID: PMC7962686 DOI: 10.16910/jemr.12.6.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
Microsaccades shift the image on the fovea and counteract visual fading. They also serve as an optimal
sampling strategy while viewing complex visual scenes. Microsaccade production relies on the amount of
retinal error or acuity demand of a visual task. The goal of this study was to assess the effects of blur induced by uncorrected refractive error on visual search. Eye movements were recorded in fourteen healthy
subjects with uncorrected and corrected refractive error while they performed a) visual fixation b) blankscene viewing c) visual search (spot the difference) tasks. Microsaccades, saccades, correctly identified
differences and reaction times were analyzed. The frequency of microsaccades and correctly identified
differences were lower in the uncorrected refractive error during visual search. No similar change in microsaccades was seen during blank-scene viewing and gaze holding tasks. These findings suggest that visual
blur, hence the precision of an image on the fovea, has an important role in calibrating the amplitude of
microsaccades during visual scanning.
Collapse
Affiliation(s)
- Sherry Tang
- Case Western Reserve University School of Medicine, USA
| | | | - Jorge Otero-Millan
- Vestibular and Ocular Motor Research Laboratory, Johns Hopkins University, USA
| | | | | | | | | |
Collapse
|
19
|
Barnhart AS, Costela FM, Martinez-Conde S, Macknik SL, Goldinger SD. Microsaccades reflect the dynamics of misdirected attention in magic. J Eye Mov Res 2019; 12. [PMID: 33828753 PMCID: PMC7962680 DOI: 10.16910/jemr.12.6.7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
The methods of magicians provide powerful tools for enhancing the ecological validity of laboratory studies of attention. The current research borrows a technique from magic to explore the relationship between microsaccades and covert attention under near-natural viewing conditions. We monitored participants’ eye movements as they viewed a magic trick where a coin placed beneath a napkin vanishes and reappears beneath another napkin. Many participants fail to see the coin move from one location to the other the first time around, thanks to the magician’s misdirection. However, previous research was unable to distinguish whether or not participants were fooled based on their eye movements. Here, we set out to determine if microsaccades may provide a window into the efficacy of the magician’s misdirection. In a multi-trial setting, participants monitored the location of the coin (which changed positions in half of the trials), while engaging in a delayed match-to-sample task at a different spatial location. Microsaccades onset times varied with task difficulty, and microsaccade directions indexed the locus of covert attention. Our combined results indicate that microsaccades may be a useful metric of covert attentional processes in applied and ecologically valid settings.
Collapse
Affiliation(s)
| | - Francisco M Costela
- Schepens Eye Research Institute, Harvard Medical School, Boston, Massachusetts, USA
| | | | | | | |
Collapse
|
20
|
Waite S, Grigorian A, Alexander RG, Macknik SL, Carrasco M, Heeger DJ, Martinez-Conde S. Analysis of Perceptual Expertise in Radiology - Current Knowledge and a New Perspective. Front Hum Neurosci 2019; 13:213. [PMID: 31293407 PMCID: PMC6603246 DOI: 10.3389/fnhum.2019.00213] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2019] [Accepted: 06/07/2019] [Indexed: 12/14/2022] Open
Abstract
Radiologists rely principally on visual inspection to detect, describe, and classify findings in medical images. As most interpretive errors in radiology are perceptual in nature, understanding the path to radiologic expertise during image analysis is essential to educate future generations of radiologists. We review the perceptual tasks and challenges in radiologic diagnosis, discuss models of radiologic image perception, consider the application of perceptual learning methods in medical training, and suggest a new approach to understanding perceptional expertise. Specific principled enhancements to educational practices in radiology promise to deepen perceptual expertise among radiologists with the goal of improving training and reducing medical error.
Collapse
Affiliation(s)
- Stephen Waite
- Department of Radiology, SUNY Downstate Medical Center, Brooklyn, NY, United States
| | - Arkadij Grigorian
- Department of Radiology, SUNY Downstate Medical Center, Brooklyn, NY, United States
| | - Robert G. Alexander
- Department of Ophthalmology, SUNY Downstate Medical Center, Brooklyn, NY, United States
- Department of Neurology, SUNY Downstate Medical Center, Brooklyn, NY, United States
- Department of Physiology/Pharmacology, SUNY Downstate Medical Center, Brooklyn, NY, United States
| | - Stephen L. Macknik
- Department of Ophthalmology, SUNY Downstate Medical Center, Brooklyn, NY, United States
- Department of Neurology, SUNY Downstate Medical Center, Brooklyn, NY, United States
- Department of Physiology/Pharmacology, SUNY Downstate Medical Center, Brooklyn, NY, United States
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, NY, United States
| | - David J. Heeger
- Department of Psychology and Center for Neural Science, New York University, New York, NY, United States
| | - Susana Martinez-Conde
- Department of Ophthalmology, SUNY Downstate Medical Center, Brooklyn, NY, United States
- Department of Neurology, SUNY Downstate Medical Center, Brooklyn, NY, United States
- Department of Physiology/Pharmacology, SUNY Downstate Medical Center, Brooklyn, NY, United States
| |
Collapse
|
21
|
Chen D, Otero-Millan J, Kumar P, Shaikh AG, Ghasia FF. Visual Search in Amblyopia: Abnormal Fixational Eye Movements and Suboptimal Sampling Strategies. Invest Ophthalmol Vis Sci 2019; 59:4506-4517. [PMID: 30208418 DOI: 10.1167/iovs.18-24794] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Purpose Microsaccades shift the image on the fovea and counteract visual fading. They are also thought to serve as an optimal sampling strategy while viewing complex visual scenes. The goal of our study was to assess visual search in amblyopic children. Methods Twenty-one amblyopic children with varying severity of amblyopia and 10 healthy controls were recruited. Eye movements were recorded using infrared video-oculography during amblyopic and fellow eye viewing while the subjects performed (1) visual fixation, (2) exploration of a blank scene, and (3) visual search task (spot the difference between two images). The number of correctly identified picture differences and reaction time were recorded. Microsaccade, saccades, and intersaccadic drifts were analyzed in patients without latent nystagmus (LN). Slow phase velocities were computed for patients with LN. Results Both patients with and without LN were able to spot the same number of differences but took longer during fellow eye viewing compared to controls. The ability to identify differences was diminished during amblyopic eye viewing particularly those with LN and severe amblyopia. We found reduced frequencies of microsaccades and saccades in both amblyopic and fellow eyes during fixation and visual search but not during exploration of blank scene. Across all tasks, amblyopes with LN had increased intersaccadic drifts. Conclusions Our findings suggest that deficient microsaccade and saccadic activity contributes to poorer sampling strategy in amblyopia, which is seen in both amblyopic and fellow eye. These deficits are more notable among subjects who experienced binocular decorrelation earlier in life, with subsequent development of LN.
Collapse
Affiliation(s)
- Dinah Chen
- Department of Ophthalmology, New York University School of Medicine, New York, New York, United States.,Cole Eye Institute, Cleveland Clinic, Cleveland, Ohio, United States
| | - Jorge Otero-Millan
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, United States
| | - Priyanka Kumar
- Department of Ophthalmology, the Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States
| | - Aasef G Shaikh
- Department of Neurology, University Hospitals, Case Western Reserve University, Cleveland, Ohio, United States.,Daroff-Dell'Osso Ocular Motility Laboratory, Cleveland VA Medical Center, Cleveland, Ohio, United States
| | - Fatema F Ghasia
- Cole Eye Institute, Cleveland Clinic, Cleveland, Ohio, United States.,Daroff-Dell'Osso Ocular Motility Laboratory, Cleveland VA Medical Center, Cleveland, Ohio, United States
| |
Collapse
|
22
|
Dalmaso M, Castelli L, Galfano G. Microsaccadic rate and pupil size dynamics in pro-/anti-saccade preparation: the impact of intermixed vs. blocked trial administration. PSYCHOLOGICAL RESEARCH 2019; 84:1320-1332. [PMID: 30603866 DOI: 10.1007/s00426-018-01141-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2018] [Accepted: 12/21/2018] [Indexed: 01/02/2023]
Abstract
Prolonged fixation can lead to the generation of tiny and fast eye movements called microsaccades, whose dynamics can be associated with higher cognitive mechanisms. Saccade preparation is also reflected in microsaccadic activity, but the few studies on this topic provided mixed results. For instance, fewer microsaccades have been observed when participants were asked to prepare for an anti-saccade (i.e., a saccade in the opposite direction to the target) as compared to a pro-saccade (i.e., a saccade executed towards a target), but null results have also been reported. In the attempt to shed new light on this topic, two experiments were carried out in which the context of presentation of pro- and anti-saccade trials was manipulated. Pupil size was also recorded, as a further index of cognitive load. In Experiment 1, participants were asked to prepare and perform pro- and anti-saccades in response to a peripheral target, according to a central instruction cue provided at the beginning of each trial (intermixed condition). In Experiment 2, the same task was employed, but pro- and anti-saccade trials were delivered in two distinct blocks (blocked condition). In both experiments, greater saccadic latencies and lower accuracy emerged for anti- than for pro-saccades. However, in the intermixed condition, a lower microsaccadic rate and a greater pupil size emerged when participants prepared for anti- rather than pro-saccades, whereas these differences disappeared in the blocked condition. These results suggest that contextual factors may play a key role in shaping oculomotor dynamics linked to saccade preparation.
Collapse
Affiliation(s)
- Mario Dalmaso
- Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131, Padua, Italy.
| | - Luigi Castelli
- Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131, Padua, Italy
| | - Giovanni Galfano
- Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131, Padua, Italy
| |
Collapse
|
23
|
Amit R, Abeles D, Yuval-Greenberg S. Transient and sustained effects of stimulus properties on the generation of microsaccades. J Vis 2019; 19:6. [PMID: 30640374 DOI: 10.1167/19.1.6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Saccades shift the gaze rapidly every few hundred milliseconds from one fixated location to the next, producing a flow of visual input into the visual system even in the absence of changes in the environment. During fixation, small saccades called microsaccades are produced 1-3 times per second, generating a flow of visual input. The characteristics of this visual flow are determined by the timings of the saccades and by the characteristics of the visual stimuli on which they are performed. Previous models of microsaccade generation have accounted for the effects of external stimulation on the production of microsaccades, but they have not considered the effects of the prolonged background stimulus on which microsaccades are performed. The effects of this stimulus on the process of microsaccade generation could be sustained, following its prolonged presentation, or transient, through the visual transients produced by the microsaccades themselves. In four experiments, we varied the properties of the constant displays and examined the resulting modulation of microsaccade properties: their sizes, their timings, and the correlations between properties of consecutive microsaccades. Findings show that displays of higher spatial frequency and contrast produce smaller microsaccades and longer minimal intervals between consecutive microsaccades; and smaller microsaccades are followed by smaller and delayed microsaccades. We explain these findings in light of previous models and suggest a conceptual model by which both sustained and transient effects of the stimulus have central roles in determining the generation of microsaccades.
Collapse
Affiliation(s)
- Roy Amit
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Dekel Abeles
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
| | - Shlomit Yuval-Greenberg
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel.,School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
24
|
Lowet E, Gips B, Roberts MJ, De Weerd P, Jensen O, van der Eerden J. Microsaccade-rhythmic modulation of neural synchronization and coding within and across cortical areas V1 and V2. PLoS Biol 2018; 16:e2004132. [PMID: 29851960 PMCID: PMC5997357 DOI: 10.1371/journal.pbio.2004132] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2017] [Revised: 06/12/2018] [Accepted: 05/01/2018] [Indexed: 12/13/2022] Open
Abstract
Primates sample their visual environment actively through saccades and microsaccades (MSs). Saccadic eye movements not only modulate neural spike rates but might also affect temporal correlations (synchrony) among neurons. Neural synchrony plays a role in neural coding and modulates information transfer between cortical areas. The question arises of how eye movements shape neural synchrony within and across cortical areas and how it affects visual processing. Through local field recordings in macaque early visual cortex while monitoring eye position and through neural network simulations, we find 2 distinct synchrony regimes in early visual cortex that are embedded in a 3- to 4-Hz MS-related rhythm during visual fixation. In the period shortly after an MS (“transient period”), synchrony was high within and between cortical areas. In the subsequent period (“sustained period”), overall synchrony dropped and became selective to stimulus properties. Only mutually connected neurons with similar stimulus responses exhibited sustained narrow-band gamma synchrony (25–80 Hz), both within and across cortical areas. Recordings in macaque V1 and V2 matched the model predictions. Furthermore, our modeling provides predictions on how (micro)saccade-modulated gamma synchrony in V1 shapes V2 receptive fields (RFs). We suggest that the rhythmic alternation between synchronization regimes represents a basic repeating sampling strategy of the visual system. During visual exploration, we continuously move our eyes in a quick, coordinated manner several times a second to scan our environment. These movements are called saccades. Even while we fixate on a visual object, we unconsciously execute small saccades that are termed microsaccades (MSs). Despite MSs being relatively small, they are suggested to be critical to maintain and support accurate perception during visual fixation. Here, we studied in macaques the influence of MSs on the synchronization of neural rhythms—which are important to regulate information flow in the brain—in areas of the cerebral cortex that are important for early processing of visual information, and we complemented the analysis with computational modeling. We found that synchronization properties shortly after an MS were distinct from synchronization in the later phase. Specifically, we found an early and spectrally broadband synchronization within and between visual cortices that was broadly tuned over the cortical space and stimulus properties. This was followed by narrow-band synchronization in the gamma range (25–80 Hz) that was spatially and stimulus specific. This suggests that the manner in which information is transmitted and integrated between early visual cortices depends on the timing relative to MSs. We illustrate this in a computational model showing that the receptive field (RF) of neurons in the secondary visual cortex are expected to be different depending on MS timing. Our results highlight the significance of MS timing for understanding cortical dynamics and suggest that the regulation of synchronization might be one mechanism by which MSs support visual perception.
Collapse
Affiliation(s)
- Eric Lowet
- Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands
- * E-mail:
| | - Bart Gips
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands
| | - Mark J. Roberts
- Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands
| | - Peter De Weerd
- Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands
- Maastricht Centre for Systems Biology (MaCSBio), Maastricht University, Maastricht, the Netherlands
| | - Ole Jensen
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
| | - Jan van der Eerden
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands
| |
Collapse
|
25
|
Martinez-Conde S, Macknik SL. Unchanging visions: the effects and limitations of ocular stillness. Philos Trans R Soc Lond B Biol Sci 2017; 372:rstb.2016.0204. [PMID: 28242737 DOI: 10.1098/rstb.2016.0204] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/19/2016] [Indexed: 11/12/2022] Open
Abstract
Scientists have pondered the perceptual effects of ocular motion, and those of its counterpart, ocular stillness, for over 200 years. The unremitting 'trembling of the eye' that occurs even during gaze fixation was first noted by Jurin in 1738. In 1794, Erasmus Darwin documented that gaze fixation produces perceptual fading, a phenomenon rediscovered in 1804 by Ignaz Paul Vital Troxler. Studies in the twentieth century established that Jurin's 'eye trembling' consisted of three main types of 'fixational' eye movements, now called microsaccades (or fixational saccades), drifts and tremor. Yet, owing to the constant and minute nature of these motions, the study of their perceptual and physiological consequences has met significant technological challenges. Studies starting in the 1950s and continuing in the present have attempted to study vision during retinal stabilization-a technique that consists on shifting any and all visual stimuli presented to the eye in such a way as to nullify all concurrent eye movements-providing a tantalizing glimpse of vision in the absence of change. No research to date has achieved perfect retinal stabilization, however, and so other work has devised substitute ways to counteract eye motion, such as by studying the perception of afterimages or of the entoptic images formed by retinal vessels, which are completely stable with respect to the eye. Yet other research has taken the alternative tack to control eye motion by behavioural instruction to fix one's gaze or to keep one's gaze still, during concurrent physiological and/or psychophysical measurements. Here, we review the existing data-from historical and contemporary studies that have aimed to nullify or minimize eye motion-on the perceptual and physiological consequences of perfect versus imperfect fixation. We also discuss the accuracy, quality and stability of ocular fixation, and the bottom-up and top-down influences that affect fixation behaviour.This article is part of the themed issue 'Movement suppression: brain mechanisms for stopping and stillness'.
Collapse
Affiliation(s)
- Susana Martinez-Conde
- Department of Ophthalmology, State University of New York (SUNY) Downstate Medical Center, 450 Clarkson Avenue, Brooklyn, NY 11203, USA
| | - Stephen L Macknik
- Department of Ophthalmology, State University of New York (SUNY) Downstate Medical Center, 450 Clarkson Avenue, Brooklyn, NY 11203, USA
| |
Collapse
|
26
|
Xue L, Huang D, Wang T, Hu Q, Chai X, Li L, Chen Y. Dynamic modulation of the perceptual load on microsaccades during a selective spatial attention task. Sci Rep 2017; 7:16496. [PMID: 29184104 PMCID: PMC5705654 DOI: 10.1038/s41598-017-16629-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2017] [Accepted: 11/15/2017] [Indexed: 11/09/2022] Open
Abstract
Selective spatial attention enhances task performance at restricted regions within the visual field. The magnitude of this effect depends on the level of attentional load, which determines the efficiency of distractor rejection. Mechanisms of attentional load include perceptual selection and/or cognitive control involving working memory. Recent studies have provided evidence that microsaccades are influenced by spatial attention. Therefore, microsaccade activities may be exploited to help understand the dynamic control of selective attention under different load levels. However, previous reports in humans on the effect of attentional load on microsaccades are inconsistent, and it is not clear to what extent these results and the dynamic changes of microsaccade activities are similar in monkeys. We trained monkeys to perform a color detection task in which the perceptual load was manipulated by task difficulty with limited involvement of working memory. Our results indicate that during the task with high perceptual load, the rate and amplitude of microsaccades immediately before the target color change were significantly suppressed. We also found that the occurrence of microsaccades before the monkeys' detection response deteriorated their performance, especially in the hard task. We propose that the activity of microsaccades might be an efficacious indicator of the perceptual load.
Collapse
Affiliation(s)
- Linyan Xue
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.,School of Quality and Technical Supervision, Hebei University, Baoding, 071002, China
| | - Dan Huang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Tong Wang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Qiyi Hu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Xinyu Chai
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Liming Li
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Yao Chen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
| |
Collapse
|
27
|
Gilad A, Oz R, Slovin H. Uncovering the Spatial Profile of Contour Integration from Fixational Saccades: Evidence for Widespread Processing in V1. Cereb Cortex 2017; 27:5261-5273. [PMID: 28334181 DOI: 10.1093/cercor/bhw305] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2016] [Accepted: 09/09/2016] [Indexed: 11/15/2022] Open
Abstract
During contour integration, neuronal populations in the primary visual cortex (V1) enhance their responses to the contour while suppressing their responses to the noisy background. However, the spatial extent and profile of these responses are not fully understood. To investigate this question, 2 monkeys were trained on a contour detection task while we measured population responses in V1 using voltage-sensitive dyes. During stimulus presentation the animals made few fixational saccades, and we used their changing gaze position to image and analyze neuronal responses from large part of the stimulus, encoding multiple contour/background elements. We found that contour enhancement was present over the entire contour-mapped areas. The background suppression increased with distance from the contour, extending into background-mapped areas remotely located from the contour. The spatial profile of enhancement and suppression fitted well with a Gaussian model. These results imply that the divergent cortical responses to contour integration are modulated independently and extend over large areas in V1.
Collapse
Affiliation(s)
- Ariel Gilad
- The Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, 5290002 Ramat Gan, Israel
| | - Roy Oz
- The Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, 5290002 Ramat Gan, Israel
| | - Hamutal Slovin
- The Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, 5290002 Ramat Gan, Israel
| |
Collapse
|
28
|
Piras A, Raffi M, Perazzolo M, Malagoli Lanzoni I, Squatrito S. Microsaccades and interest areas during free-viewing sport task. J Sports Sci 2017; 37:980-987. [DOI: 10.1080/02640414.2017.1380893] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- Alessandro Piras
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Milena Raffi
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Monica Perazzolo
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Ivan Malagoli Lanzoni
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Salvatore Squatrito
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| |
Collapse
|
29
|
Ito J, Yamane Y, Suzuki M, Maldonado P, Fujita I, Tamura H, Grün S. Switch from ambient to focal processing mode explains the dynamics of free viewing eye movements. Sci Rep 2017; 7:1082. [PMID: 28439075 PMCID: PMC5430715 DOI: 10.1038/s41598-017-01076-w] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2016] [Accepted: 03/22/2017] [Indexed: 11/21/2022] Open
Abstract
Previous studies have reported that humans employ ambient and focal modes of visual exploration while they freely view natural scenes. These two modes have been characterized based on eye movement parameters such as saccade amplitude and fixation duration, but not by any visual features of the viewed scenes. Here we propose a new characterization of eye movements during free viewing based on how eyes are moved from and to objects in a visual scene. We applied this characterization to data obtained from freely-viewing macaque monkeys. We show that the analysis based on this characterization gives a direct indication of a behavioral shift from ambient to focal processing mode along the course of free viewing exploration. We further propose a stochastic model of saccade sequence generation incorporating a switch between the two processing modes, which quantitatively reproduces the behavioral features observed in the data.
Collapse
Affiliation(s)
- Junji Ito
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA BRAIN Institute I, Jülich Research Centre, Jülich, Germany.
| | - Yukako Yamane
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
- Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, Osaka, Japan
| | - Mika Suzuki
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
| | - Pedro Maldonado
- BNI, CENEM and Programa de Fisiología y Biofísica, ICBM, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| | - Ichiro Fujita
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
- Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, Osaka, Japan
| | - Hiroshi Tamura
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
- Center for Information and Neural Networks, Osaka University and National Institute of Information and Communications Technology, Osaka, Japan
| | - Sonja Grün
- Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA BRAIN Institute I, Jülich Research Centre, Jülich, Germany
- Graduate School of Frontier Biosciences, Osaka University, Osaka, Japan
- Theoretical Systems Neurobiology, RWTH Aachen University, Aachen, Germany
| |
Collapse
|
30
|
Shaikh AG, Ghasia FF. Fixational saccades are more disconjugate in adults than in children. PLoS One 2017; 12:e0175295. [PMID: 28406944 PMCID: PMC5391133 DOI: 10.1371/journal.pone.0175295] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2016] [Accepted: 03/23/2017] [Indexed: 11/18/2022] Open
Abstract
PURPOSE Fixational eye movements are of particular interest for three reasons. They are critical for preventing visual fading and enhancing visual perception; their disconjugacy allows scanning in three dimensions, and their neural correlates span through the cortico-striatal, striato-collicular and brainstem networks. Fixational eye movements are altered in various pediatric ophthalmologic and neurologic disorders. The goal of this study was to compare the dynamics of fixational eye movements in normal children and adults. METHODS We measured the fixational saccades and inter-saccadic drifts in eye positions using infrared video-oculography in children and adults. We assessed the frequency, amplitude, main-sequence, and disconjugacy of fixational saccades as well as the intra-saccadic drift velocity and variance between these two groups. RESULTS We found a similar frequency but an increase in the amplitude of fixational saccades in children compared to adults. We also found that the fixational saccades were more conjugate in children than in adults. The inter-saccadic drifts were comparable between the two groups. DISCUSSION This study provides normative values of dynamics of fixational eye movement in children and adults. The greater disconjugacy of fixational saccades in adults suggests the existence of neural mechanisms that can independently regulate the movements of two eyes. The differences between adult and pediatric populations could be due to completion of the development of binocularly independent regulation of fixational saccades nearing adulthood. The alternate possibility is that the increased disconjugacy between the two eyes may represent a deficiency in the eye movement performance as a function of increasing age.
Collapse
Affiliation(s)
- Aasef G. Shaikh
- Department of Neurology, Case Western Reserve University, Cleveland, OH, United States of America
- Neurology service, Louis Stokes Cleveland VA medical center, Cleveland, OH, United States of America
- Daroff-Del’Osso Ocular Motility Laboratory, Louis Stokes Cleveland VA medical center, Cleveland, OH, United States of America
| | - Fatema F. Ghasia
- Daroff-Del’Osso Ocular Motility Laboratory, Louis Stokes Cleveland VA medical center, Cleveland, OH, United States of America
- Cole Eye Institute, Cleveland Clinic, Cleveland, OH, United States of America
- * E-mail:
| |
Collapse
|
31
|
|
32
|
Yu G, Yang M, Yu P, Dorris MC. Time compression of visual perception around microsaccades. J Neurophysiol 2017; 118:416-424. [PMID: 28298299 DOI: 10.1152/jn.00029.2017] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2017] [Revised: 03/13/2017] [Accepted: 03/13/2017] [Indexed: 11/22/2022] Open
Abstract
Even during fixation, our eyes are in constant motion. For example, microsaccades are small (typically <1°) eye movements that occur 1~3 times/second. Despite their tiny and transient nature, our percept of visual space is compressed before microsaccades (Hafed ZM, Lovejoy LP, Krauzlis RJ. Eur J Neurosci 37: 1169-1181, 2013). As visual space and time are interconnected at both the physical and physiological levels, we asked whether microsaccades also affect the temporal aspects of visual perception. Here we demonstrate that the perceived interval between transient visual stimuli was compressed if accompanied by microsaccades. This temporal compression extended approximately ±200 ms from microsaccade occurrence, and depending on their particular pattern, multiple microsaccades further enhanced or counteracted this temporal compression. The compression of time surrounding microsaccades resembles that associated with more voluntary macrosaccades (Morrone MC, Ross J, Burr D. Nat Neurosci 8: 950-954, 2005). Our results suggest common neural processes underlying both saccade and microsaccade misperceptions, mediated, likely, through extraretinal mechanisms.NEW & NOTEWORTHY Here we show that humans perceive the duration of visual events as compressed if they are accompanied by microsaccades. Despite the tiny and transient nature of microsaccades, time compression extended more than ±200 ms from their occurrence. Moreover, the number, pattern, and temporal coincidence of microsaccades relative to visual events all contribute to this time misperception. Our results reveal a detailed picture of how our visual time percepts are altered by microsaccades.
Collapse
Affiliation(s)
- Gongchen Yu
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences, Shanghai, China; and.,University of Chinese Academy of Sciences, Shanghai, China
| | - Mingpo Yang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences, Shanghai, China; and
| | - Peng Yu
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences, Shanghai, China; and.,University of Chinese Academy of Sciences, Shanghai, China
| | - Michael Christopher Dorris
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Chinese Academy of Sciences, Shanghai, China; and
| |
Collapse
|
33
|
Waite S, Kolla S, Jeudy J, Legasto A, Macknik SL, Martinez-Conde S, Krupinski EA, Reede DL. Tired in the Reading Room: The Influence of Fatigue in Radiology. J Am Coll Radiol 2016; 14:191-197. [PMID: 27956140 DOI: 10.1016/j.jacr.2016.10.009] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Commonly conflated with sleepiness, fatigue is a distinct multidimensional condition with physical and mental effects. Fatigue in health care providers and any secondary effects on patient care are an important societal concern. As medical image interpretation is highly dependent on visual input, visual fatigue is of particular interest to radiologists. Humans analyze their surroundings with rapid eye movements called saccades, and fatigue decreases saccadic velocity. Oculomotor parameters may, therefore, be an objective and reproducible metric of fatigue and eye movement analysis can provide valuable insight into the etiology of fatigue-related error.
Collapse
Affiliation(s)
- Stephen Waite
- Department of Radiology, SUNY Downstate Medical Center, Brooklyn, New York.
| | - Srinivas Kolla
- Department of Radiology, SUNY Downstate Medical Center, Brooklyn, New York
| | - Jean Jeudy
- Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland Medical Center, Baltimore, Maryland
| | - Alan Legasto
- Department of Radiology, Weill Cornell Medical College, New York, New York
| | - Stephen L Macknik
- Departments of Ophthalmology, Neurology, Physiology, and Pharmacology, SUNY Downstate Medical Center, Brooklyn, New York
| | - Susana Martinez-Conde
- Departments of Ophthalmology, Neurology, Physiology, and Pharmacology, SUNY Downstate Medical Center, Brooklyn, New York
| | | | - Deborah L Reede
- Department of Radiology, SUNY Downstate Medical Center, Brooklyn, New York
| |
Collapse
|
34
|
Craddock M, Oppermann F, Müller MM, Martinovic J. Modulation of microsaccades by spatial frequency during object categorization. Vision Res 2016; 130:48-56. [PMID: 27876511 DOI: 10.1016/j.visres.2016.10.011] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2015] [Revised: 10/20/2016] [Accepted: 10/31/2016] [Indexed: 11/16/2022]
Abstract
The organization of visual processing into a coarse-to-fine information processing based on the spatial frequency properties of the input forms an important facet of the object recognition process. During visual object categorization tasks, microsaccades occur frequently. One potential functional role of these eye movements is to resolve high spatial frequency information. To assess this hypothesis, we examined the rate, amplitude and speed of microsaccades in an object categorization task in which participants viewed object and non-object images and classified them as showing either natural objects, man-made objects or non-objects. Images were presented unfiltered (broadband; BB) or filtered to contain only low (LSF) or high spatial frequency (HSF) information. This allowed us to examine whether microsaccades were modulated independently by the presence of a high-level feature - the presence of an object - and by low-level stimulus characteristics - spatial frequency. We found a bimodal distribution of saccades based on their amplitude, with a split between smaller and larger microsaccades at 0.4° of visual angle. The rate of larger saccades (⩾0.4°) was higher for objects than non-objects, and higher for objects with high spatial frequency content (HSF and BB objects) than for LSF objects. No effects were observed for smaller microsaccades (<0.4°). This is consistent with a role for larger microsaccades in resolving HSF information for object identification, and previous evidence that more microsaccades are directed towards informative image regions.
Collapse
Affiliation(s)
- Matt Craddock
- Institute of Psychology, University of Leipzig, Germany; School of Psychology, University of Leeds, UK
| | - Frank Oppermann
- Institute of Psychology, University of Leipzig, Germany; Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Netherlands
| | | | | |
Collapse
|
35
|
Weyand TG. The multifunctional lateral geniculate nucleus. Rev Neurosci 2016; 27:135-57. [PMID: 26479339 DOI: 10.1515/revneuro-2015-0018] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Accepted: 09/01/2015] [Indexed: 01/22/2023]
Abstract
Providing the critical link between the retina and visual cortex, the well-studied lateral geniculate nucleus (LGN) has stood out as a structure in search of a function exceeding the mundane 'relay'. For many mammals, it is structurally impressive: Exquisite lamination, sophisticated microcircuits, and blending of multiple inputs suggest some fundamental transform. This impression is bolstered by the fact that numerically, the retina accounts for a small fraction of its input. Despite such promise, the extent to which an LGN neuron separates itself from its retinal brethren has proven difficult to appreciate. Here, I argue that whereas retinogeniculate coupling is strong, what occurs in the LGN is judicious pruning of a retinal drive by nonretinal inputs. These nonretinal inputs reshape a receptive field that under the right conditions departs significantly from its retinal drive, even if transiently. I first review design features of the LGN and follow with evidence for 10 putative functions. Only two of these tend to surface in textbooks: parsing retinal axons by eye and functional group and gating by state. Among the remaining putative functions, implementation of the principle of graceful degradation and temporal decorrelation are at least as interesting but much less promoted. The retina solves formidable problems imposed by physics to yield multiple efficient and sensitive representations of the world. The LGN applies context, increasing content, and gates several of these representations. Even if the basic concentric receptive field remains, information transmitted for each LGN spike relative to each retinal spike is measurably increased.
Collapse
|
36
|
Effect of heading perception on microsaccade dynamics. Behav Brain Res 2016; 312:246-52. [DOI: 10.1016/j.bbr.2016.06.030] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2016] [Revised: 06/13/2016] [Accepted: 06/14/2016] [Indexed: 11/30/2022]
|
37
|
Matsuda YT, Myowa-Yamakoshi M, Hirata S. Familiar face + novel face = familiar face? Representational bias in the perception of morphed faces in chimpanzees. PeerJ 2016; 4:e2304. [PMID: 27602275 PMCID: PMC4991860 DOI: 10.7717/peerj.2304] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2015] [Accepted: 07/07/2016] [Indexed: 11/30/2022] Open
Abstract
Highly social animals possess a well-developed ability to distinguish the faces of familiar from novel conspecifics to induce distinct behaviors for maintaining society. However, the behaviors of animals when they encounter ambiguous faces of familiar yet novel conspecifics, e.g., strangers with faces resembling known individuals, have not been well characterised. Using a morphing technique and preferential-looking paradigm, we address this question via the chimpanzee’s facial–recognition abilities. We presented eight subjects with three types of stimuli: (1) familiar faces, (2) novel faces and (3) intermediate morphed faces that were 50% familiar and 50% novel faces of conspecifics. We found that chimpanzees spent more time looking at novel faces and scanned novel faces more extensively than familiar or intermediate faces. Interestingly, chimpanzees looked at intermediate faces in a manner similar to familiar faces with regards to the fixation duration, fixation count, and saccade length for facial scanning, even though the participant was encountering the intermediate faces for the first time. We excluded the possibility that subjects merely detected and avoided traces of morphing in the intermediate faces. These findings suggest a bias for a feeling-of-familiarity that chimpanzees perceive familiarity with an intermediate face by detecting traces of a known individual, as 50% alternation is sufficient to perceive familiarity.
Collapse
Affiliation(s)
| | | | - Satoshi Hirata
- Wildlife Research Center, Kyoto University, Kyoto, Japan
| |
Collapse
|
38
|
Meso AI, Montagnini A, Bell J, Masson GS. Looking for symmetry: fixational eye movements are biased by image mirror symmetry. J Neurophysiol 2016; 116:1250-60. [PMID: 27306681 DOI: 10.1152/jn.01152.2015] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2015] [Accepted: 06/13/2016] [Indexed: 11/22/2022] Open
Abstract
Humans are highly sensitive to symmetry. During scene exploration, the area of the retina with dense light receptor coverage acquires most information from relevant locations determined by gaze fixation. We characterized patterns of fixational eye movements made by observers staring at synthetic scenes either freely (i.e., free exploration) or during a symmetry orientation discrimination task (i.e., active exploration). Stimuli could be mirror-symmetric or not. Both free and active exploration generated more saccades parallel to the axis of symmetry than along other orientations. Most saccades were small (<2°), leaving the fovea within a 4° radius of fixation. Analysis of saccade dynamics showed that the observed parallel orientation selectivity emerged within 500 ms of stimulus onset and persisted throughout the trials under both viewing conditions. Symmetry strongly distorted existing anisotropies in gaze direction in a seemingly automatic process. We argue that this bias serves a functional role in which adjusted scene sampling enhances and maintains sustained sensitivity to local spatial correlations arising from symmetry.
Collapse
Affiliation(s)
- Andrew Isaac Meso
- Institut de Neurosciences de la Timone, UMR 7289 CNRS and Aix-Marseille Université, Marseille, France; School of Psychology, University of Western Australia, Crawley, Western Australia, Australia; and Psychology and Interdisciplinary Neuroscience Research Group, Faculty of Science and Technology, Bournemouth University, Fern Barrow, Poole, United Kingdom
| | - Anna Montagnini
- Institut de Neurosciences de la Timone, UMR 7289 CNRS and Aix-Marseille Université, Marseille, France
| | - Jason Bell
- School of Psychology, University of Western Australia, Crawley, Western Australia, Australia; and
| | - Guillaume S Masson
- Institut de Neurosciences de la Timone, UMR 7289 CNRS and Aix-Marseille Université, Marseille, France
| |
Collapse
|
39
|
Abstract
During steady fixation, observers make small fixational saccades at a rate of around 1–2 per second. Presentation of a visual stimulus triggers a biphasic modulation in fixational saccade rate—an initial inhibition followed by a period of elevated rate and a subsequent return to baseline. Here we show that, during passive viewing, this rate signature is highly sensitive to small changes in stimulus contrast. By training a linear support vector machine to classify trials in which a stimulus is either present or absent, we directly compared the contrast sensitivity of fixational eye movements with individuals' psychophysical judgements. Classification accuracy closely matched psychophysical performance, and predicted individuals' threshold estimates with less bias and overall error than those obtained using specific features of the signature. Performance of the classifier was robust to changes in the training set (novel subjects and/or contrasts) and good prediction accuracy was obtained with a practicable number of trials. Our results indicate a tight coupling between the sensitivity of visual perceptual judgements and fixational eye control mechanisms. This raises the possibility that fixational saccades could provide a novel and objective means of estimating visual contrast sensitivity without the need for observers to make any explicit judgement.
Collapse
Affiliation(s)
- Chris Scholes
- Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham NG7 2RD, UK
| | - Paul V McGraw
- Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham NG7 2RD, UK
| | - Marcus Nyström
- Humanities Laboratory, Lund University, Helgonabacken 12, 22362 Lund, Sweden
| | - Neil W Roach
- Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham NG7 2RD, UK
| |
Collapse
|
40
|
Peel TR, Hafed ZM, Dash S, Lomber SG, Corneil BD. A Causal Role for the Cortical Frontal Eye Fields in Microsaccade Deployment. PLoS Biol 2016; 14:e1002531. [PMID: 27509130 PMCID: PMC4980061 DOI: 10.1371/journal.pbio.1002531] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2016] [Accepted: 07/15/2016] [Indexed: 11/19/2022] Open
Abstract
Microsaccades aid vision by helping to strategically sample visual scenes. Despite the importance of these small eye movements, no cortical area has ever been implicated in their generation. Here, we used unilateral and bilateral reversible inactivation of the frontal eye fields (FEF) to identify a cortical drive for microsaccades. Unexpectedly, FEF inactivation altered microsaccade metrics and kinematics. Such inactivation also impaired microsaccade deployment following peripheral cue onset, regardless of cue side or inactivation configuration. Our results demonstrate that the FEF provides critical top-down drive for microsaccade generation, particularly during the recovery of microsaccades after disruption by sensory transients. Our results constitute the first direct evidence, to our knowledge, for the contribution of any cortical area to microsaccade generation, and they provide a possible substrate for how cognitive processes can influence the strategic deployment of microsaccades. Our eyes are constantly in motion. This study shows that the frontal eye fields (an area of the frontal cortex) contribute to the strategic deployment of microsaccades, which aid vision by precisely translating retinal images by a few photoreceptors. Microsaccades are small, fixational eye movements that precisely relocate the visual axis. Despite evidence that microsaccades can be strategically controlled in high-acuity visual tasks, impacting visual processing, and considerable knowledge about how microsaccades are generated by the oculomotor brainstem, little is known about the cortical substrates that control microsaccades. To address this gap, we examined microsaccades generated by non-human primates before, during, and after large-volume reversible unilateral or bilateral inactivation of the frontal eye fields, a key oculomotor area in the frontal cortex. In support of a role for the frontal eye fields in microsaccades, microsaccade metrics and kinematics were altered during frontal eye fields inactivation. More surprisingly, frontal eye fields inactivation also impaired the generation of microsaccades following presentation of peripheral cues, regardless of the side of the cue or inactivation configuration. To our knowledge, our results constitute the first direct evidence for the contribution of any cortical area to microsaccade generation and suggest that the frontal eye fields can provide the top-down signals to the oculomotor brainstem needed to strategically guide microsaccades.
Collapse
Affiliation(s)
- Tyler R. Peel
- The Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
- Graduate Program in Neuroscience, University of Western Ontario, London, Ontario, Canada
| | - Ziad M. Hafed
- Physiology of Active Vision Laboratory, Werner Reichardt Centre for Integrative Neuroscience, Tuebingen University, Tuebingen, Germany
| | - Suryadeep Dash
- The Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
- Department of Physiology & Pharmacology, University of Western Ontario, London, Ontario, Canada
| | - Stephen G. Lomber
- The Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
- Department of Physiology & Pharmacology, University of Western Ontario, London, Ontario, Canada
- Department of Psychology, University of Western Ontario, London, Ontario, Canada
| | - Brian D. Corneil
- The Brain and Mind Institute, University of Western Ontario, London, Ontario, Canada
- Department of Physiology & Pharmacology, University of Western Ontario, London, Ontario, Canada
- Department of Psychology, University of Western Ontario, London, Ontario, Canada
- Robarts Research Institute, London, Ontario, Canada
- * E-mail:
| |
Collapse
|
41
|
Revealing the time course of signals influencing the generation of secondary saccades using Aalen’s additive hazards model. Vision Res 2016; 124:52-8. [DOI: 10.1016/j.visres.2016.06.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2015] [Revised: 06/14/2016] [Accepted: 06/15/2016] [Indexed: 11/17/2022]
|
42
|
Temporal Asymmetry in Dark-Bright Processing Initiates Propagating Activity across Primary Visual Cortex. J Neurosci 2016; 36:1902-13. [PMID: 26865614 DOI: 10.1523/jneurosci.3235-15.2016] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
UNLABELLED Differences between visual pathways representing darks and lights have been shown to affect spatial resolution and detection timing. Both psychophysical and physiological studies suggest an underlying retinal origin with amplification in primary visual cortex (V1). Here we show that temporal asymmetries in the processing of darks and lights create motion in terms of propagating activity across V1. Exploiting the high spatiotemporal resolution of voltage-sensitive dye imaging, we captured population responses to abrupt local changes of luminance in cat V1. For stimulation we used two neighboring small squares presented on either bright or dark backgrounds. When a single square changed from dark to bright or vice versa, we found coherent population activity emerging at the respective retinal input locations. However, faster rising and decay times were obtained for the bright to dark than the dark to bright changes. When the two squares changed luminance simultaneously in opposite polarities, we detected a propagating wave front of activity that originated at the cortical location representing the darkened square and rapidly expanded toward the region representing the brightened location. Thus, simultaneous input led to sequential activation across cortical retinotopy. Importantly, this effect was independent of the squares' contrast with the background. We suggest imbalance in dark-bright processing as a driving force in the generation of wave-like activity. Such propagation may convey motion signals and influence perception of shape whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders. SIGNIFICANCE STATEMENT An elementary process in vision is the detection of darks and lights through the retina via ON and OFF channels. Psychophysical and physiological studies suggest that differences between these channels affect spatial resolution and detection thresholds. Here we show that temporal asymmetries in the processing of darks and lights create motion signals across visual cortex. Using two neighboring squares, which simultaneously counterchanged luminance, we discovered propagating activity that was strictly drawn out from cortical regions representing the darkened location. Thus, a synchronous stimulus event translated into sequential wave-like brain activation. Such propagation may convey motion signals accessible in higher brain areas, whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.
Collapse
|
43
|
Abstract
UNLABELLED During visual fixation, the eye generates microsaccades and slower components of fixational eye movements that are part of the visual processing strategy in humans. Here, we show that ongoing heartbeat is coupled to temporal rate variations in the generation of microsaccades. Using coregistration of eye recording and ECG in humans, we tested the hypothesis that microsaccade onsets are coupled to the relative phase of the R-R intervals in heartbeats. We observed significantly more microsaccades during the early phase after the R peak in the ECG. This form of coupling between heartbeat and eye movements was substantiated by the additional finding of a coupling between heart phase and motion activity in slow fixational eye movements; i.e., retinal image slip caused by physiological drift. Our findings therefore demonstrate a coupling of the oculomotor system and ongoing heartbeat, which provides further evidence for bodily influences on visuomotor functioning. SIGNIFICANCE STATEMENT In the present study, we show that microsaccades are coupled to heartbeat. Moreover, we revealed a strong modulation of slow eye movements around the R peak in the ECG. These results suggest that heartbeat as a basic physiological signal is related to statistical modulations of fixational eye movements, in particular, the generation of microsaccades. Therefore, our findings add a new perspective on the principles underlying the generation of fixational eye movements. Importantly, our study highlights the need to record eye movements when studying the influence of heartbeat in neuroscience to avoid misinterpretation of eye-movement-related artifacts as heart-evoked modulations of neural processing.
Collapse
|
44
|
Masquelier T, Portelli G, Kornprobst P. Microsaccades enable efficient synchrony-based coding in the retina: a simulation study. Sci Rep 2016; 6:24086. [PMID: 27063867 PMCID: PMC4827057 DOI: 10.1038/srep24086] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2015] [Accepted: 03/15/2016] [Indexed: 11/09/2022] Open
Abstract
It is now reasonably well established that microsaccades (MS) enhance visual perception, although the underlying neuronal mechanisms are unclear. Here, using numerical simulations, we show that MSs enable efficient synchrony-based coding among the primate retinal ganglion cells (RGC). First, using a jerking contrast edge as stimulus, we demonstrate a qualitative change in the RGC responses: synchronous firing, with a precision in the 10 ms range, only occurs at high speed and high contrast. MSs appear to be sufficiently fast to be able reach the synchronous regime. Conversely, the other kinds of fixational eye movements known as tremor and drift both hardly synchronize RGCs because of a too weak amplitude and a too slow speed respectively. Then, under natural image stimulation, we find that each MS causes certain RGCs to fire synchronously, namely those whose receptive fields contain contrast edges after the MS. The emitted synchronous spike volley thus rapidly transmits the most salient edges of the stimulus, which often constitute the most crucial information. We demonstrate that the readout could be done rapidly by simple coincidence-detector neurons without knowledge of the MS landing time, and that the required connectivity could emerge spontaneously with spike timing-dependent plasticity.
Collapse
Affiliation(s)
- Timothée Masquelier
- INSERM, U968, Paris, F-75012, France.,Sorbonne Universités, UPMC Univ Paris 06, UMR_S 968, Institut de la Vision, Paris, F-75012, France.,CNRS, UMR_7210, Paris, F-75012, France
| | | | | |
Collapse
|
45
|
Abstract
BACKGROUND Task (over-)load imposed on surgeons is a main contributing factor to surgical errors. Recent research has shown that gaze metrics represent a valid and objective index to asses operator task load in non-surgical scenarios. Thus, gaze metrics have the potential to improve workplace safety by providing accurate measurements of task load variations. However, the direct relationship between gaze metrics and surgical task load has not been investigated yet. We studied the effects of surgical task complexity on the gaze metrics of surgical trainees. METHODS We recorded the eye movements of 18 surgical residents, using a mobile eye tracker system, during the performance of three high-fidelity virtual simulations of laparoscopic exercises of increasing complexity level: Clip Applying exercise, Cutting Big exercise, and Translocation of Objects exercise. We also measured performance accuracy and subjective rating of complexity. RESULTS Gaze entropy and velocity linearly increased with increased task complexity: Visual exploration pattern became less stereotyped (i.e., more random) and faster during the more complex exercises. Residents performed better the Clip Applying exercise and the Cutting Big exercise than the Translocation of Objects exercise and their perceived task complexity differed accordingly. CONCLUSIONS Our data show that gaze metrics are a valid and reliable surgical task load index. These findings have potential impacts to improve patient safety by providing accurate measurements of surgeon task (over-)load and might provide future indices to assess residents' learning curves, independently of expensive virtual simulators or time-consuming expert evaluation.
Collapse
|
46
|
Deouell LY. Microsaccades mediate a bottom-up mechanism for cross-frequency coupling in early visual cortex (Commentary on Lowet et al.). Eur J Neurosci 2016; 43:1284-5. [PMID: 26790688 DOI: 10.1111/ejn.13181] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Leon Y Deouell
- Department of Psychology and Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 91905, Israel
| |
Collapse
|
47
|
Myachykov A, Cangelosi A, Ellis R, Fischer MH. The oculomotor resonance effect in spatial-numerical mapping. Acta Psychol (Amst) 2015; 161:162-9. [PMID: 26398486 DOI: 10.1016/j.actpsy.2015.09.006] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2014] [Revised: 08/12/2015] [Accepted: 09/08/2015] [Indexed: 11/29/2022] Open
Abstract
We investigated automatic Spatial-Numerical Association of Response Codes (SNARC) effect in auditory number processing. Two experiments continually measured spatial characteristics of ocular drift at central fixation during and after auditory number presentation. Consistent with the notion of a spatially oriented mental number line, we found spontaneous magnitude-dependent gaze adjustments, both with and without a concurrent saccadic task. This fixation adjustment (1) had a small-number/left-lateralized bias and (2) it was biphasic as it emerged for a short time around the point of lexical access and it received later robust representation around following number onset. This pattern suggests a two-step mechanism of sensorimotor mapping between numbers and space - a first-pass bottom-up activation followed by a top-down and more robust horizontal SNARC. Our results inform theories of number processing as well as simulation-based approaches to cognition by identifying the characteristics of an oculomotor resonance phenomenon.
Collapse
Affiliation(s)
- Andriy Myachykov
- Department of Psychology, Northumbria University, Newcastle-upon-Tyne, United Kingdom; Centre for Cognition and Decision Making, National Research University Higher School of Economics, Moscow, Russian Federation.
| | - Angelo Cangelosi
- School of Computing and Mathematics, University of Plymouth, United Kingdom
| | - Rob Ellis
- School of Psychology, University of Plymouth
| | | |
Collapse
|
48
|
O’Hare L, Clarke ADF, Pollux PMJ. VEP Responses to Op-Art Stimuli. PLoS One 2015; 10:e0139400. [PMID: 26422207 PMCID: PMC4589386 DOI: 10.1371/journal.pone.0139400] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2015] [Accepted: 09/10/2015] [Indexed: 12/04/2022] Open
Abstract
Several types of striped patterns have been reported to cause adverse sensations described as visual discomfort. Previous research using op-art-based stimuli has demonstrated that spurious eye movement signals can cause the experience of illusory motion, or shimmering effects, which might be perceived as uncomfortable. Whilst the shimmering effects are one cause of discomfort, another possible contributor to discomfort is excessive neural responses: As striped patterns do not have the statistical redundancy typical of natural images, they are perhaps unable to be encoded efficiently. If this is the case, then this should be seen in the amplitude of the EEG response. This study found that stimuli that were judged to be most comfortable were also those with the lowest EEG amplitude. This provides some support for the idea that excessive neural responses might also contribute to discomfort judgements in normal populations, in stimuli controlled for perceived contrast.
Collapse
Affiliation(s)
- Louise O’Hare
- School of Psychology, University of Lincoln, Lincoln, United Kingdom
- * E-mail:
| | | | | |
Collapse
|
49
|
Joshua M, Tokiyama S, Lisberger SG. Interactions between target location and reward size modulate the rate of microsaccades in monkeys. J Neurophysiol 2015; 114:2616-24. [PMID: 26311180 DOI: 10.1152/jn.00401.2015] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2015] [Accepted: 08/24/2015] [Indexed: 11/22/2022] Open
Abstract
We have studied how rewards modulate the occurrence of microsaccades by manipulating the size of an expected reward and the location of the cue that sets the expectations for future reward. We found an interaction between the size of the reward and the location of the cue. When monkeys fixated on a cue that signaled the size of future reward, the frequency of microsaccades was higher if the monkey expected a large vs. a small reward. When the cue was presented at a site in the visual field that was remote from the position of fixation, reward size had the opposite effect: the frequency of microsaccades was lower when the monkey was expecting a large reward. The strength of pursuit initiation also was affected by reward size and by the presence of microsaccades just before the onset of target motion. The gain of pursuit initiation increased with reward size and decreased when microsaccades occurred just before or after the onset of target motion. The effect of the reward size on pursuit initiation was much larger than any indirect effects reward might cause through modulation of the rate of microsaccades. We found only a weak relationship between microsaccade direction and the location of the exogenous cue relative to fixation position, even in experiments where the location of the cue indicated the direction of target motion. Our results indicate that the expectation of reward is a powerful modulator of the occurrence of microsaccades, perhaps through attentional mechanisms.
Collapse
Affiliation(s)
- Mati Joshua
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel; and
| | - Stefanie Tokiyama
- Department of Neurobiology and Howard Hughes Medical Institute, Duke University, Durham, North Carolina
| | - Stephen G Lisberger
- Department of Neurobiology and Howard Hughes Medical Institute, Duke University, Durham, North Carolina
| |
Collapse
|
50
|
Martinez-Conde S, Macknik SL. From Exploration to Fixation: An Integrative View of Yarbus's Vision. Perception 2015; 44:884-99. [PMID: 26562907 DOI: 10.1177/0301006615594963] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Alfred Lukyanovich Yarbus (1914-1986) pioneered the study of stabilized retinal images, miniature eye movements, and the cognitive influences that act on visual scanning. Yarbus's studies of these different topics have remained fundamentally disconnected and independent of each other, however. In this review, we propose that Yarbus's various research lines are instead deeply and intrinsically interconnected, as are the small eye movements produced during visual fixation and the large-scale scanning patterns associated with visual exploration of objects and scenes. Such apparently disparate viewing behaviors may represent the extremes of a single continuum of oculomotor performance that operates across spatial scales when we search the visual world.
Collapse
Affiliation(s)
- Susana Martinez-Conde
- Department of Ophthalmology, State University of New York, Downstate Medical Center, Brooklyn, NY, USA
| | - Stephen L Macknik
- Department of Ophthalmology, State University of New York, Downstate Medical Center, Brooklyn, NY, USA
| |
Collapse
|