Visual motion processing and sensory-motor integration for smooth pursuit eye movements

Use of the concussion check protocol for concussion assessment in a female soccer team over two consecutive seasons in New Zealand

AIM

Address deficiencies in access to sports sideline medical care by using a Concussion Check Protocol (CCP) for non-medically-trained people.

METHOD

A prospective observational cohort study was undertaken on a single amateur female club-based soccer team over two consecutive years in New Zealand utilising a non-medically trained support person termed a Safety officer. CCP is an extension of the King-Devick test with features such as warning signs and symptoms of concussion built into the application. All players suspected of having a potential concussive injury were tested on the match sideline.

RESULTS

The study overall incidence of match-related concussions was 20.8 (95% CI: 11.8 to 36.6) per 1000 match-hrs, with mean missed-match duration of 31 (95% CI: 27.9 to 34.1) days. Twelve players over the study had a significantly slower post-injury KD (49.9 [44.3 to 64.1]s; χ2(1) = 11.0; p = 0.0009; z = -2.9; p = 0.0033; d = 0.30) and/or reported symptoms, compared with their own baseline (47.2 [44.3 to 64.1]s). CCP had an overall sensitivity of 100% (95% CI: 73.5% to 100.0%), specificity of 100% (95% CI: 69.2% to 100.0%) and positive predictive value (PPV) of 100% (84.6% to 100.0%).

CONCLUSION

Sideline use of CCP was undertaken successfully by non-medically trained people and provided a reliable platform for concussion identification.

Inferring control objectives in a virtual balancing task in humans and monkeys

Natural behaviors have redundancy, which implies that humans and animals can achieve their goals with different strategies. Given only observations of behavior, is it possible to infer the control objective that the subject is employing? This challenge is particularly acute in animal behavior because we cannot ask or instruct the subject to use a particular strategy. This study presents a three-pronged approach to infer an animal's control objective from behavior. First, both humans and monkeys performed a virtual balancing task for which different control strategies could be utilized. Under matched experimental conditions, corresponding behaviors were observed in humans and monkeys. Second, a generative model was developed that represented two main control objectives to achieve the task goal. Model simulations were used to identify aspects of behavior that could distinguish which control objective was being used. Third, these behavioral signatures allowed us to infer the control objective used by human subjects who had been instructed to use one control objective or the other. Based on this validation, we could then infer objectives from animal subjects. Being able to positively identify a subject's control objective from observed behavior can provide a powerful tool to neurophysiologists as they seek the neural mechanisms of sensorimotor coordination.

Form Properties of Moving Targets Bias Smooth Pursuit Target Selection in Monkeys

During natural viewing, we often recognize multiple objects, detect their motion, and select one object as the target to track. It remains to be determined how such behavior is guided by the integration of visual form and motion perception. To address this, we studied how monkeys made a choice to track moving targets with different forms by smooth pursuit eye movements in a two-target task. We found that pursuit responses were biased toward the motion direction of a target with a hole. By computing the relative weighting, we found that the target with a hole exhibited a larger weight for vector computation. The global hole feature dominated other form properties. This dominance failed to account for changes in pursuit responses to a target with different forms moving singly. These findings suggest that the integration of visual form and motion perception can reshape the competition in sensorimotor networks to guide behavioral selection.

Prior expectation enhances sensorimotor behavior by modulating population tuning and subspace activity in sensory cortex

Prior knowledge facilitates our perception and goal-directed behaviors, particularly when sensory input is lacking or noisy. However, the neural mechanisms underlying the improvement in sensorimotor behavior by prior expectations remain unknown. In this study, we examine the neural activity in the middle temporal (MT) area of visual cortex while monkeys perform a smooth pursuit eye movement task with prior expectation of the visual target's motion direction. Prior expectations discriminately reduce the MT neural responses depending on their preferred directions, when the sensory evidence is weak. This response reduction effectively sharpens neural population direction tuning. Simulations with a realistic MT population demonstrate that sharpening the tuning can explain the biases and variabilities in smooth pursuit, suggesting that neural computations in the sensory area alone can underpin the integration of prior knowledge and sensory evidence. State-space analysis further supports this by revealing neural signals of prior expectations in the MT population activity that correlate with behavioral changes.

Frontal-to-visual information flow explains predictive motion tracking

Predictive tracking demonstrates our ability to maintain a line of vision on moving objects even when they temporarily disappear. Models of smooth pursuit eye movements posit that our brain achieves this ability by directly streamlining motor programming from continuously updated sensory motion information. To test this hypothesis, we obtained sensory motion representation from multivariate electroencephalogram activity while human participants covertly tracked a temporarily occluded moving stimulus with their eyes remaining stationary at the fixation point. The sensory motion representation of the occluded target evolves to its maximum strength at the expected timing of reappearance, suggesting a timely modulation of the internal model of the visual target. We further characterize the spatiotemporal dynamics of the task-relevant motion information by computing the phase gradients of slow oscillations. We discovered a predominant posterior-to-anterior phase gradient immediately after stimulus occlusion; however, at the expected timing of reappearance, the axis reverses the gradient, becoming anterior-to-posterior. The behavioral bias of smooth pursuit eye movements, which is a signature of the predictive process of the pursuit, was correlated with the posterior division of the gradient. These results suggest that the sensory motion area modulated by the prediction signal is involved in updating motor programming.

Effects of Astaxanthin, Lutein, and Zeaxanthin on Eye-Hand Coordination and Smooth-Pursuit Eye Movement after Visual Display Terminal Operation in Healthy Subjects: A Randomized, Double-Blind Placebo-Controlled Intergroup Trial

(1) Background: The impairment of eye-hand coordination and smooth-pursuit eye movement caused by visual display terminal (VDT) operation is thought to impair daily living activities, for which no effective methods are currently known. On the other hand, various food ingredients, including astaxanthin, lutein, and zeaxanthin, are known to help improve the eye health of VDT operators. This study aimed to test the hypothesis that the combination of astaxanthin, lutein, and zeaxanthin can prevent the impairment of eye-hand coordination and smooth-pursuit eye movement caused by VDT operation. (2) Methods: We conducted a randomized, placebo-controlled, parallel-group clinical trial. Healthy subjects who regularly worked with VDTs were randomly assigned to the active and placebo groups. All of the subjects took soft capsules containing 6 mg of astaxanthin, 10 mg of lutein, and 2 mg of zeaxanthin or placebo soft capsules once daily for eight weeks. We evaluated the eye-hand coordination, smooth-pursuit eye movements, and macular pigment optical density (MPOD) at 0, two, four, and eight weeks after soft-capsule intake. (3) Results: The active group showed significantly improved eye-hand coordination after VDT operation at eight weeks. However, there was no clear improvement in the effect of the supplementation on smooth-pursuit eye movements. The active group also showed a significant increase in MPOD levels. (4) Conclusions: Consumption of a supplement containing astaxanthin, lutein, and zeaxanthin mitigates the decline of eye-hand coordination after VDT operation.

Object motion influences feedforward motor responses during mechanical stopping of virtual projectiles: a preliminary study

An important window into sensorimotor function is how humans interact and stop moving projectiles, such as stopping a door from closing shut or catching a ball. Previous studies have suggested that humans time the initiation and modulate the amplitude of their muscle activity based on the momentum of the approaching object. However, real-world experiments are constrained by laws of mechanics, which cannot be manipulated experimentally to probe the mechanisms of sensorimotor control and learning. An augmented-reality variant of such tasks allows for experimental manipulation of the relationship between motion and force to obtain novel insights into how the nervous system prepares motor responses to interact with moving stimuli. Existing paradigms for studying interactions with moving projectiles use massless objects and are primarily focused on quantifying gaze and hand kinematics. Here, we developed a novel collision paradigm using a robotic manipulandum where participants mechanically stopped a virtual object moving in the horizontal plane. On each block of trials, we varied the virtual object's momentum by increasing either its velocity or mass. Participants stopped the object by applying a force impulse that matched the object momentum. We observed that hand force increased as a function of object momentum linked to changes in virtual mass or velocity, similar to results from studies involving catching free-falling objects. In addition, increasing object velocity resulted in later onset of hand force relative to the impending time-to-contact. These findings show that the present paradigm can be used to determine how humans process projectile motion for hand motor control.

Multivariate EEG activity reflects the Bayesian integration and the integrated Galilean relative velocity of sensory motion during sensorimotor behavior

Humans integrate multiple sources of information for action-taking, using the reliability of each source to allocate weight to the data. This reliability-weighted information integration is a crucial property of Bayesian inference. In this study, participants were asked to perform a smooth pursuit eye movement task in which we independently manipulated the reliability of pursuit target motion and the direction-of-motion cue. Through an analysis of pursuit initiation and multivariate electroencephalography activity, we found neural and behavioral evidence of Bayesian information integration: more attraction toward the cue direction was generated when the target motion was weak and unreliable. Furthermore, using mathematical modeling, we found that the neural signature of Bayesian information integration had extra-retinal origins, although most of the multivariate electroencephalography activity patterns during pursuit were best correlated with the retinal velocity errors accumulated over time. Our results demonstrated neural implementation of Bayesian inference in human oculomotor behavior.

Effects of psychotropic drugs on ocular parameters relevant to traffic safety: A systematic review

Driving is a complex neurobehavioural task necessitating the rapid selection, uptake, and processing of visual information. Eye movements that are critical for the execution of visually guided behaviour such as driving are also sensitive to the effects of psychotropic substances. The Embase (via Ovid), EBSCOHost, Psynet, Pubmed, Scopus and Web of Science databases were examined from January 01st, 2000 to December 31st, 2021. Study selection, data extraction and Cochrane Risk of Bias (RoB2) assessments were conducted according to PRISMA guidelines. The review was prospectively registered (CRD42021267554). In total, 36 full-text articles examined the effects of six principal psychotropic drug classes on measures of oculomotor parameters relevant to driving. Centrally depressing substances affect oculomotor responses in a dose-dependent manner. Psychostimulants improve maximal speed, but not accuracy, of visual search behaviours. Inhaled Δ-9-tetrahydrocannabinol (THC) increases inattention (saccadic inaccuracy) but does not consistently affect other oculomotor parameters. Alterations to composite ocular parameters due to psychoactive substance usage likely differently compromises performance precision during driving through impaired ability to select and process dynamic visual information.

"What needs to be seen": An exploration into the visual anticipation behaviour of different skill-level football referees while observing long passes on-field

It is well established that elite football referees possess superior anticipatory skills in specific game scenarios such as when assessing foul situations. Referees might also have better anticipatory skills in other important scenarios such as when observing a long pass. In these often-occurring situations, a referee has to use visual information to anticipate the outcome of the pass, in particular to foresee any potential infringements that might occur when players battle for ball possession. However, little is known about if and how football referees might anticipate outcomes in these scenarios. The aim of the current study was therefore to analyse the visual anticipatory behaviour of football referees when long passes occur during actual football matches. Elite (N = 4) and sub-elite referees (N = 12) officiated an actual football match while wearing a mobile eye-tracker to analyse their gaze behaviour when long passes occurred (N = 196). The results revealed differences in the way that the elite and sub-elite referees tracked the ball and anticipated the outcome of the ball trajectories. The elite referees used a lower search rate (1.3 vs 1.8 fix/s; p < .05) and were more likely to direct their gaze towards the ball during the moment of kick (77 vs 52%; p < .05) and the early flight-phase of the pass (68 vs 45%; p < .05), and subsequently produced earlier anticipatory eye movements to the player(s) receiving the ball (at 50% vs 60% of the ball flight; p < .05). This earlier anticipation may help the elite referees to better pick-up relevant information about the receivers that could be vital in making adjudications about any potential infringement when the ball does arrive. Referee education programs can use the current study to highlight the importance of visual search behaviour and help referees to adapt a strategy that is beneficial for long-pass situations.

Art and Perception: Using Empirical Aesthetics in Research on Consciousness

Understanding consciousness is a major frontier in the natural sciences. However, given the nuanced and ambiguous sets of conditions regarding how and when consciousness appears to manifest, it is also one of the most elusive topics for investigation. In this context, we argue that research in empirical aesthetics—specifically on the experience of art—holds strong potential for this research area. We suggest that empirical aesthetics of art provides a more exhaustive description of conscious perception than standard laboratory studies or investigations of the less artificial, more ecological perceptual conditions that dominate this research, leading to novel and better suited designs for natural science research on consciousness. Specifically, we discuss whether empirical aesthetics of art could be used for a more adequate picture of an observer’s attributions in the context of conscious perception. We point out that attributions in the course of conscious perception to (distal) objects versus to media (proximal objects) as origins of the contents of consciousness are typically swift and automatic. However, unconventional or novel object-media relations used in art can bring these attributions to the foreground of the observer’s conscious reflection. This is the reason that art may be ideally suited to study human attributions in conscious perception compared to protocols dedicated only to the most common and conventional perceptual abilities observed under standard laboratory or “natural”/ecological conditions alone. We also conclude that art provides an enormous stock of such unconventional and novel object-media relations, allowing more systematic falsification of tentative conclusions about conscious perception versus research protocols covering more conventional (ecological) perception only. We end with an outline of how this research could be carried out in general.

Perceptual restoration fails to recover unconscious processing for smooth eye movements after occipital stroke

The visual pathways that guide actions do not necessarily mediate conscious perception. Patients with primary visual cortex (V1) damage lose conscious perception but often retain unconscious abilities (e.g. blindsight). Here, we asked if saccade accuracy and post-saccadic following responses (PFRs) that automatically track target motion upon saccade landing are retained when conscious perception is lost. We contrasted these behaviors in the blind and intact fields of 11 chronic V1-stroke patients, and in 8 visually intact controls. Saccade accuracy was relatively normal in all cases. Stroke patients also had normal PFR in their intact fields, but no PFR in their blind fields. Thus, V1 damage did not spare the unconscious visual processing necessary for automatic, post-saccadic smooth eye movements. Importantly, visual training that recovered motion perception in the blind field did not restore the PFR, suggesting a clear dissociation between pathways mediating perceptual restoration and automatic actions in the V1-damaged visual system.

Analysis of smooth pursuit eye movements in a clinical context by tracking the target and eyes

In the evaluation of smooth pursuit eye movements (SPEMs), recording the stimulus onset time is mandatory. In the laboratory, the stimulus onset time is recorded by electrical signal or programming, and video-oculography (VOG) and the visual stimulus are synchronized. Nevertheless, because the examiner must manually move the fixation target, recording the stimulus onset time is challenging in daily clinical practice. Thus, this study aimed to develop an algorithm for evaluating SPEMs while testing the nine-direction eye movements without recording the stimulus onset time using VOG and deep learning–based object detection (single-shot multibox detector), which can predict the location and types of objects in a single image. The algorithm of peak fitting–based detection correctly classified the directions of target orientation and calculated the latencies and gains within the normal range while testing the nine-direction eye movements in healthy individuals. These findings suggest that the algorithm of peak fitting–based detection has sufficient accuracy for the automatic evaluation of SPEM in clinical settings.

Eye Movement and Pupil Measures: A Review

Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first describe the main oculomotor events studied in the literature, and their characteristics exploited by different measures. Next, we review various eye movement and pupil measures from prior literature. Finally, we discuss our observations based on applications of these measures, the benefits and practical challenges involving these measures, and our recommendations on future eye-tracking research directions.

Tracking an occluded visual target with sequences of saccades

Gaze behavior during visual tracking consists of a combination of pursuit and saccadic movements. When the tracked object is intermittently occluded, the role of smooth pursuit is reduced, with a corresponding increase in the role of saccades. However, studies of visual tracking during occlusion have focused only on the first few saccades, usually with occlusion periods of less than 1 second in duration. We investigated tracking on a circular trajectory with random occlusions and found that an occluded object can be tracked reliably for up to several seconds with mainly anticipatory saccades and very little smooth pursuit. Furthermore, we investigated the accumulation of uncertainty in prediction and found that prediction errors seem to accumulate faster when an absolute reference frame is not available during tracking. We suggest that the observed saccadic tracking reflects the use of a time-based internal estimate of object position that is anchored to the environment via fixations.

Global-local consistency benefits memory-guided tracking of a moving target

INTRODUCTION

Previous findings have demonstrated that several Gestalt principles do facilitate VSTM performance in change detection tasks. However, few studies have investigated the role of and time-course of global-local consistency in motion perception.

METHODS

Participants were required to track a moving target surrounded by three different backgrounds: blank, inconsistent, or consistent. Global-local objects were be bound to move together (covariation). During the PMT, participants had to follow the moving target with their eyes and react as fast as possible when the target had just vanished behind the obstruction or would arrive at a predetermined point of interception. Variable error (VE) and constant error (CE) of estimated time-to-contact (TTC) and gain of smooth pursuit eye movements were calculated in various conditions and analyzed qualitatively.

RESULTS

Experiment 1 established the basic finding that VSTM performance could benefit from global-local consistency. Experiment 2 extended this finding by eye-tracking device. Both in visible phase and in occluded phase, CEs were smaller for the target in a consistent background than for the target in an inconsistent background and for the target in a blank background, with both differences significant (ps < .05). However, the difference in VE among three conditions was not significant. At early stage (100-250 ms), later stage (2750-3000 ms), and termination stage (5750-6000 ms) of smooth pursuit, the velocity gains were higher in the trials with consistent backgrounds than in the trials with inconsistent backgrounds and blank backgrounds (ps < .001). With the exception of 100-250 ms phase, the means did not differ between the inconsistent background and the blank background trials (ps > .1).

CONCLUSIONS

Global-local consistency could be activated within the first few hundred milliseconds to prioritize the deployment of attention and eye movement to component target. Meanwhile, it also removes ambiguity from motion tracking and TTC estimation under some unpredictable conditions, leading to the consistency advantage during smooth-pursuit termination phase. Global-local consistency may act as an important information source to TTC estimation and oculomotor response in PMT.

Diffusion and functional MRI findings and their relationship to behaviour in postconcussion syndrome: a scoping review

Postconcussion syndrome (PCS) is a term attributed to the constellation of symptoms that fail to recover after a concussion. PCS is associated with a variety of symptoms such as headaches, concentration deficits, fatigue, depression and anxiety that have an enormous impact on patients' lives. There is currently no diagnostic biomarker for PCS. There have been attempts at identifying structural and functional brain changes in patients with PCS, using diffusion tensor imaging (DTI) and functional MRI (fMRI), respectively, and relate them to specific PCS symptoms. In this scoping review, we appraised, synthesised and summarised all empirical studies that (1) investigated structural or functional brain changes in PCS using DTI or fMRI, respectively, and (2) assessed behavioural alterations in patients with PCS. We performed a literature search in MEDLINE (Ovid), Embase (Ovid) and PsycINFO (Ovid) for primary research articles published up to February 2020. We identified 8306 articles and included 45 articles that investigated the relationship between DTI and fMRI parameters and behavioural changes in patients with PCS: 20 diffusion, 20 fMRI studies and 5 papers with both modalities. Most frequently studied structures were the corpus callosum, superior longitudinal fasciculus in diffusion and the dorsolateral prefrontal cortex and default mode network in the fMRI literature. Although some white matter and fMRI changes were correlated with cognitive or neuropsychiatric symptoms, there were no consistent, converging findings on the relationship between neuroimaging abnormalities and behavioural changes which could be largely due to the complex and heterogeneous presentation of PCS. Furthermore, the heterogeneity of symptoms in PCS may preclude discovery of one biomarker for all patients. Further research should take advantage of multimodal neuroimaging to better understand the brain-behaviour relationship, with a focus on individual differences rather than on group comparisons.

The perceptual dynamics of the contrast induced speed bias

In this article we present a temporal extension of the slow motion prior model to generate predictions regarding the temporal evolution of the contrast induced speed bias. We further tested these predictions using a novel experimental paradigm that allows us to measure the dynamic perceptual difference between stimuli through a series of manual pursuit open loop tasks. Results show good agreement with our model's predictions. The main findings reveal that hand speed dynamics are affected by stimulus contrast in a way that is consistent with a dynamic model of motion perception that assumes a slow motion prior. The proposed model also confirms observations made in previous studies that suggest that motion bias persisted even at high contrast as a consequence of the dynamics of the slow motion prior.

Pupil responses to implied motion in figurative and abstract paintings

Motion can be perceived in static images, such as photos and figurative paintings, representing realistic subjects in motion, with or without directional information (e.g., motion blur or speed lines). Motion impression can be achieved even in non-realistic static images such as motion illusions and abstract paintings. It has been shown that visual motion processing affects the diameter of the pupil, responding differently to real, illusory, and implied motion in photographs (IM). It has been suggested that these different effects might be due to top-down modulations from different cortical areas underlying their processing. It is worthwhile to investigate pupillary response to figurative paintings, since they require an even higher level of interpretation than photos representing the same kind of subjects, given the complexity of cognitive processes involved in the aesthetic experience. Also, pupil responses to abstract paintings allows to study the effect of IM perception in representations devoid of real-life motion cues. We measured pupil responses to IM in figurative and abstract artworks depicting static and dynamic scenes, as rated by a large group of individuals not participating in the following experiment. Since the pupillary response is modulated by the subjective image interpretation, a motion rating test has been used to correct individual pupil data according to whether participants actually perceived the presence of motion in the paintings. Pupil responses to movies showing figurative and abstract subjects, and to motion illusions were also measured, to compare real and illusory motion with painted IM. Movies, both figurative and abstract, elicit the largest pupillary dilation of all static stimuli, whereas motion illusions cause the smallest pupil size, as previously shown. Interestingly, pupil responses to IM depend on the paintings’ style. Figurative paintings depicting moving subjects cause more dilation than those representing static figures, and pupil size increases with the strength of IM, as already found with realistic photos. The opposite effect is obtained with abstract artworks. Abstract paintings depicting motion produce less dilation than those depicting stillness. In any case, these results reflect the individual subjective perception of dynamism, as the very same paintings can induce opposite responses in observer which interpreted it as static or dynamic. Overall, our data show that pupil size depends on high-level interpretation of motion in paintings, even when they do not represent real-world scenes. Our findings further suggest that the pupil is modulated by multiple top-down cortical mechanisms, involving the processing of motion, attention, memory, imagination, and other cognitive functions necessary for enjoying a complete aesthetic experience.

Replicability and reliability of the background and target velocity effects in smooth pursuit eye movements

When we follow a slowly moving target with our eyes, we perform smooth pursuit eye movements (SPEM). Previous investigations point to significantly and robustly reduced SPEM performance in the presence of a stationary background and at higher compared to lower target velocities. However, the reliability of these background and target velocity effects has not yet been investigated systematically. To address this issue, 45 healthy participants (17 m, 28 f) took part in two experimental sessions 7 days apart. In each session, participants were instructed to follow a horizontal SPEM target moving sinusoidally between ±7.89° at three different target velocities, corresponding to frequencies of 0.2, 0.4 and 0.6 Hz. Each target velocity was presented once with and once without a stationary background, resulting in six blocks. The blocks were presented twice per session in order to additionally explore potential task length effects. To assess SPEM performance, velocity gain was calculated as the ratio of eye to target velocity. In line with previous research, detrimental background and target velocity effects were replicated robustly in both sessions with large effect sizes. Good to excellent test-retest reliabilities were obtained at higher target velocities and in the presence of a stationary background, whereas lower reliabilities occurred with slower targets and in the absence of background stimuli. Target velocity and background effects resulted in largely good to excellent reliabilities. These findings not only replicated robust experimental effects of background and target velocity at group level, but also revealed that these effects can be translated into reliable individual difference measures.

Using Dynamics of Eye Movements, Speech Articulation and Brain Activity to Predict and Track mTBI Screening Outcomes

Repeated subconcussive blows to the head during sports or other contact activities may have a cumulative and long lasting effect on cognitive functioning. Unobtrusive measurement and tracking of cognitive functioning is needed to enable preventative interventions for people at elevated risk of concussive injury. The focus of the present study is to investigate the potential for using passive measurements of fine motor movements (smooth pursuit eye tracking and read speech) and resting state brain activity (measured using fMRI) to complement existing diagnostic tools, such as the Immediate Post-concussion Assessment and Cognitive Testing (ImPACT), that are used for this purpose. Thirty-one high school American football and soccer athletes were tracked through the course of a sports season. Hypotheses were that (1) measures of complexity of fine motor coordination and of resting state brain activity are predictive of cognitive functioning measured by the ImPACT test, and (2) within-subject changes in these measures over the course of a sports season are predictive of changes in ImPACT scores. The first principal component of the six ImPACT composite scores was used as a latent factor that represents cognitive functioning. This latent factor was positively correlated with four of the ImPACT composites: verbal memory, visual memory, visual motor speed and reaction speed. Strong correlations, ranging between r = 0.26 and r = 0.49, were found between this latent factor and complexity features derived from each sensor modality. Based on a regression model, the complexity features were combined across sensor modalities and used to predict the latent factor on out-of-sample subjects. The predictions correlated with the true latent factor with r = 0.71. Within-subject changes over time were predicted with r = 0.34. These results indicate the potential to predict cognitive performance from passive monitoring of fine motor movements and brain activity, offering initial support for future application in detection of performance deficits associated with subconcussive events.

Pupillary response to real, illusory, and implied motion

The perception of moving objects (real motion) is a critical function for interacting with a dynamic environment. Motion perception can be also induced by particular structural features of static images (illusory motion) or by photographic images of subjects in motion (implied motion, IM). Many cortical areas are involved in motion processing, particularly the medial temporal cortical area (MT), dedicated to the processing of real, illusory, and implied motion. Recently, there has been a growing interest in the influence of high-level visual processes on pupillary responses. However, just a few studies have measured the effect of motion processing on the pupil, and not always with consistent results. Here we systematically investigate the effects of real, illusory, and implied motion on the pupil diameter for the first time, by showing different types of stimuli (movies, illusions, and photos) with the same average luminance to the same observers. We find different pupillary responses depending on the nature of motion. Real motion elicits a larger pupillary dilation than IM, which in turn induces more dilation than control photos representing static subjects (No-IM). The pupil response is sensitive even to the strength of IM, as photos with enhanced IM (blur, motion streaks, speed lines) induce larger dilation than simple freezed IM (subjects captured in the instant they are moving). Also, the subject represented in the stimulus matters: human figures are interpreted as more dynamic and induce larger dilation than objects/animals. Interestingly, illusory motion induces much less dilation than all the other motion categories, despite being seen as moving. Overall, pupil responses depend on the individual perception of dynamicity, confirming that the pupil is modulated by the subjective interpretation of complex stimuli. We argue that the different pupillary responses to real, illusory, and implied motion reflect the top-down modulations of different cortical areas involved in their processing.

Automatic Recording of the Target Location During Smooth Pursuit Eye Movement Testing Using Video-Oculography and Deep Learning-Based Object Detection

Purpose

To accurately record the movements of a hand-held target together with the smooth pursuit eye movements (SPEMs) elicited with video-oculography (VOG) combined with deep learning-based object detection using a single-shot multibox detector (SSD).

Methods

The SPEMs of 11 healthy volunteers (21.3 ± 0.9 years) were recorded using VOG. The subjects fixated on a moving target that was manually moved at a distance of 1 m by the examiner. An automatic recording system was developed using SSD to predict the type and location of objects in a single image. The 400 images that were taken of one subject using a VOG scene camera were distributed into 2 groups (300 and 100) for training and validation. The testing data included 1100 images of all subjects (100 images/subject). The method achieved 75% average precision (AP75) for the relationship between the location of the fixated target (as calculated by SSD) and the position of each eye (as recorded by VOG).

Results

The AP75 for all subjects was 99.7% ± 0.6%. The horizontal and vertical target locations were significantly and positively correlated with each eye position in the horizontal and vertical directions (adjusted R2 ≥ 0.955, P < 0.001).

Conclusions

The addition of SSD-driven recording of hand-held target positions with VOG allows for quantitative assessment of SPEMs following a target during an SPEM test.

Translational Relevance

The combined methods of VOG and SSD can be used to detect SPEMs with greater accuracy, which can improve the outcome of clinical evaluations.

Computer Vision for Brain Disorders Based Primarily on Ocular Responses

Real-time ocular responses are tightly associated with emotional and cognitive processing within the central nervous system. Patterns seen in saccades, pupillary responses, and spontaneous blinking, as well as retinal microvasculature and morphology visualized via office-based ophthalmic imaging, are potential biomarkers for the screening and evaluation of cognitive and psychiatric disorders. In this review, we outline multiple techniques in which ocular assessments may serve as a non-invasive approach for the early detections of various brain disorders, such as autism spectrum disorder (ASD), Alzheimer's disease (AD), schizophrenia (SZ), and major depressive disorder (MDD). In addition, rapid advances in artificial intelligence (AI) present a growing opportunity to use machine learning-based AI, especially computer vision (CV) with deep-learning neural networks, to shed new light on the field of cognitive neuroscience, which is most likely to lead to novel evaluations and interventions for brain disorders. Hence, we highlight the potential of using AI to evaluate brain disorders based primarily on ocular features.

Using Oculomotor Features to Predict Changes in Optic Nerve Sheath Diameter and ImPACT Scores From Contact-Sport Athletes

There is mounting evidence linking the cumulative effects of repetitive head impacts to neuro-degenerative conditions. Robust clinical assessment tools to identify mild traumatic brain injuries are needed to assist with timely diagnosis for return-to-field decisions and appropriately guide rehabilitation. The focus of the present study is to investigate the potential for oculomotor features to complement existing diagnostic tools, such as measurements of Optic Nerve Sheath Diameter (ONSD) and Immediate Post-concussion Assessment and Cognitive Testing (ImPACT). Thirty-one high school American football and soccer athletes were tracked through the course of a sports season. Given the high risk of repetitive head impacts associated with both soccer and football, our hypotheses were that (1) ONSD and ImPACT scores would worsen through the season and (2) oculomotor features would effectively capture both neurophysiological changes reflected by ONSD and neuro-functional status assessed via ImPACT. Oculomotor features were used as input to Linear Mixed-Effects Regression models to predict ONSD and ImPACT scores as outcomes. Prediction accuracy was evaluated to identify explicit relationships between eye movements, ONSD, and ImPACT scores. Significant Pearson correlations were observed between predicted and actual outcomes for ONSD (Raw = 0.70; Normalized = 0.45) and for ImPACT (Raw = 0.86; Normalized = 0.71), demonstrating the capability of oculomotor features to capture neurological changes detected by both ONSD and ImPACT. The most predictive features were found to relate to motor control and visual-motor processing. In future work, oculomotor models, linking neural structures to oculomotor function, can be built to gain extended mechanistic insights into neurophysiological changes observed through seasons of participation in contact sports.

A passive BCI for monitoring the intentionality of the gaze-based moving object selection

OBJECTIVE

The use of an electroencephalogram (EEG) anticipation-related component, the expectancy wave (E-wave), in brain-machine interaction was proposed more than 50 years ago. This possibility was not explored for decades, but recently it was shown that voluntary attempts to select items using eye fixations, but not spontaneous eye fixations, are accompanied by the E-wave. Thus, the use of the E-wave detection was proposed for the enhancement of gaze interaction technology, which has a strong need for a mean to decide if a gaze behaviour is voluntary or not. Here, we attempted at estimating whether this approach can be used in the context of moving object selection through smooth pursuit eye movements.

APPROACH

18 participants selected, one by one, items which moved on a computer screen, by gazing at them. In separate runs, the participants performed tasks not related to voluntary selection but also provoking smooth pursuit. A low-cost consumer-grade eye tracker was used for item selection.

MAIN RESULTS

A component resembling the E-wave was found in the averaged EEG segments time-locked to voluntary selection events of every participant. Linear discriminant analysis with shrinkage regularization (sLDA) classified the intentional and spontaneous smooth pursuit eye movements, using single-trial 300 ms long EEG segments, significantly above chance in eight participants. When the classifier output was averaged over ten subsequent data segments, median group ROC AUC of 0.75 was achieved.

SIGNIFICANCE

The results suggest the possible usefulness of the E-wave detection in the gaze-based selection of moving items, e.g., in video games. This technique might be more effective when trial data can be averaged, thus it could be considered for use in passive interfaces, for example, in estimating the degree of the user's involvement during gaze-based interaction.

Properties of smooth pursuit and visual motion reaction time to second-order motion stimuli

A large number of psychophysical and neurophysiological studies have demonstrated that smooth pursuit eye movements are tightly related to visual motion perception. This could be due to the fact that visual motion sensitive cortical areas such as meddle temporal (MT), medial superior temporal (MST) areas are involved in motion perception as well as pursuit initiation. Although the directional-discrimination and perceived target velocity tasks are used to evaluate visual motion perception, it is still uncertain whether the speed of visual motion perception, which is determined by visuomotor reaction time (RT) to a small target, is related to pursuit initiation. Therefore, we attempted to determine the relationship between pursuit latency/acceleration and the visual motion RT which was measured to the visual motion stimuli that moved leftward or rightward. The participants were instructed to fixate on a stationary target and press one of the buttons corresponding to the direction of target motion as soon as possible once the target starts to move. We applied five different visual motion stimuli including first- and second-order motion for smooth pursuit and visual motion RT tasks. It is well known that second-order motion induces lower retinal image motion, which elicits weaker responses in MT and MST compared to first-order motion stimuli. Our results showed that pursuit initiation including latency and initial eye acceleration were suppressed by second-order motion. In addition, second-order motion caused a delay in visual motion RT. The better performances in both pursuit initiation and visual motion RT were observed for first-order motion, whereas second-order (theta motion) induced remarkable deficits in both variables. Furthermore, significant Pearson's correlation and within-subjects correlation coefficients were obtained between visual motion RT and pursuit latency/acceleration. Our findings support the suggestion that there is a common neuronal pathway involved in both pursuit initiation and the speed of visual motion perception.

Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution

Novel or unexpected sounds that deviate from an otherwise repetitive sequence of the same sound cause behavioural distraction. Recent work has suggested that distraction also occurs during reading as fixation durations increased when a deviant sound was presented at the fixation onset of words. The present study tested the hypothesis that this increase in fixation durations occurs due to saccadic inhibition. This was done by manipulating the temporal onset of sounds relative to the fixation onset of words in the text. If novel sounds cause saccadic inhibition, they should be more distracting when presented during the second half of fixations when saccade programming usually takes place. Participants read single sentences and heard a 120 ms sound when they fixated five target words in the sentence. On most occasions (p = .9), the same sine wave tone was presented (“standard”), while on the remaining occasions (p = .1) a new sound was presented (“novel”). Critically, sounds were played, on average, either during the first half of the fixation (0 ms delay) or during the second half of the fixation (120 ms delay). Consistent with the saccadic inhibition hypothesis (SIH), novel sounds led to longer fixation durations in the 120 ms compared to the 0 ms delay condition. However, novel sounds did not generally influence the execution of the subsequent saccade. These results suggest that unexpected sounds have a rapid influence on saccade planning, but not saccade execution.

Functional connectivity during smooth pursuit eye movements

Smooth pursuit eye movements (SPEM) hold the image of a slowly moving stimulus on the fovea. The neural system underlying SPEM primarily includes visual, parietal, and frontal areas. In the present study, we investigated how these areas are functionally coupled and how these couplings are influenced by target motion frequency. To this end, healthy participants (n = 57) were instructed to follow a sinusoidal target stimulus moving horizontally at two different frequencies (0.2 Hz, 0.4 Hz). Eye movements and blood oxygen level-dependent (BOLD) activity were recorded simultaneously. Functional connectivity of the key areas of the SPEM network was investigated with a psychophysiological interaction (PPI) approach. How activity in five eye movement-related seed regions (lateral geniculate nucleus, V1, V5, posterior parietal cortex, frontal eye fields) relates to activity in other parts of the brain during SPEM was analyzed. The behavioral results showed clear deterioration of SPEM performance at higher target frequency. BOLD activity during SPEM versus fixation occurred in a geniculo-occipito-parieto-frontal network, replicating previous findings. PPI analysis yielded widespread, partially overlapping networks. In particular, frontal eye fields and posterior parietal cortex showed task-dependent connectivity to large parts of the entire cortex, whereas other seed regions demonstrated more regionally focused connectivity. Higher target frequency was associated with stronger activations in visual areas but had no effect on functional connectivity. In summary, the results confirm and extend previous knowledge regarding the neural mechanisms underlying SPEM and provide a valuable basis for further investigations such as in patients with SPEM impairments and known alterations in brain connectivity.NEW & NOTEWORTHY This study provides a comprehensive investigation of blood oxygen level-dependent (BOLD) functional connectivity during smooth pursuit eye movements. Results from a large sample of healthy participants suggest that key oculomotor regions interact closely with each other but also with regions not primarily associated with eye movements. Understanding functional connectivity during smooth pursuit is important, given its potential role as an endophenotype of psychoses.

Sensorimotor delays in tracking may be compensated by negative feedback control of motion-extrapolated position

Sensorimotor delays dictate that humans act on outdated perceptual information. As a result, continuous manual tracking of an unpredictable target incurs significant response delays. However, no such delays are observed for repeating targets such as the sinusoids. Findings of this kind have led researchers to claim that the nervous system constructs predictive, probabilistic models of the world. However, a more parsimonious explanation is that visual perception of a moving target position is systematically biased by its velocity. The resultant extrapolated position could be compared with the cursor position and the difference canceled by negative feedback control, compensating sensorimotor delays. The current study tested whether a position extrapolation model fit human tracking of sinusoid (predictable) and pseudorandom (less predictable) targets better than the non-biased position control model, Twenty-eight participants tracked these targets and the two computational models were fit to the data at 60 fixed loop delay values (simulating sensorimotor delays). We observed that pseudorandom targets were tracked with a significantly greater phase delay than sinusoid targets. For sinusoid targets, the position extrapolation model simulated tracking results more accurately for loop delays longer than 120 ms, thereby confirming its ability to compensate for sensorimotor delays. However, for pseudorandom targets, this advantage arose only after 300 ms, indicating that velocity information is unlikely to be exploited in this way during the tracking of less predictable targets. We conclude that negative feedback control of position is a parsimonious model for tracking pseudorandom targets and that negative feedback control of extrapolated position is a parsimonious model for tracking sinusoidal targets.

Congenital Deafness Leads to Altered Overt Oculomotor Behaviors

The human brain is highly cross-modal, and sensory information may affect a wide range of behaviors. In particular, there is evidence that auditory functions are implicated in oculomotor behaviors. Considering this apparent auditory-oculomotor link, one might wonder how the loss of auditory input from birth might have an influence on these motor behaviors. Eye movement tracking enables to extract several components, including saccades and smooth pursuit. One study suggested that deafness can alter saccades processing. Oculomotor behaviors have not been examined further in the deaf. The main goal of this study was to examine smooth pursuit following deafness. A pursuit task paradigm was used in this experiment. Participants were instructed to move their eyes to follow a target as it moved. The target movements have a possibility of four different trajectories (horizontal, vertical, elliptic clockwise, and elliptic counter-clockwise). Results indicate a significant reduction in the ability to track a target in both elliptical conditions showing that more complex motion processing differs in deaf individuals. The data also revealed significantly more saccades per trial in the vertical, anti-clockwise, and, to a lesser extent, the clockwise elliptic condition. This suggests that auditory deprivation from birth leads to altered overt oculomotor behaviors.

Artificial Sensory Memory

Sensory memory, formed at the beginning while perceiving and interacting with the environment, is considered a primary source of intelligence. Transferring such biological concepts into electronic implementation aims at achieving perceptual intelligence, which would profoundly advance a broad spectrum of applications, such as prosthetics, robotics, and cyborg systems. Here, the recent developments in the design and fabrication of artificial sensory memory devices are summarized and their applications in recognition, manipulation, and learning are highlighted. The emergence of such devices benefits from recent progress in both bioinspired sensing and neuromorphic engineering technologies and derives from abundant inspiration and benchmarks from an improved understanding of biological sensory processing. Increasing attention to this area would offer unprecedented opportunities toward new hardware architecture of artificial intelligence, which could extend the capabilities of digital systems with emotional/psychological attributes. Pending challenges are also addressed to aspects such as integration level, energy efficiency, and functionality, which would undoubtedly shed light on the future development of translational implementations.

Different mechanisms for modulation of the initiation and steady-state of smooth pursuit eye movements

Smooth pursuit eye movements are used by primates to track moving objects. They are initiated by sensory estimates of target speed represented in the middle temporal (MT) area of extrastriate visual cortex and then supported by motor feedback to maintain steady-state eye speed at target speed. Here, we show that reducing the coherence in a patch of dots for a tracking target degrades the eye speed both at the initiation of pursuit and during steady-state tracking, when eye speed reaches an asymptote well below target speed. The deficits are quantitatively different between the motor-supported steady-state of pursuit and the sensory-driven initiation of pursuit, suggesting separate mechanisms. The deficit in visually guided pursuit initiation could not explain the deficit in steady-state tracking. Pulses of target speed during steady-state tracking revealed lower sensitivities to image motion across the retina for lower values of dot coherence. However, sensitivity was not zero, implying that visual motion should still be driving eye velocity toward target velocity. When we changed dot coherence from 100% to lower values during accurate steady-state pursuit, we observed larger eye decelerations for lower coherences, as expected if motor feedback was reduced in gain. A simple pursuit model accounts for our data based on separate modulation of the strength of visual-motor transmission and motor feedback. We suggest that reduced dot coherence allows us to observe evidence for separate modulations of the gain of visual-motor transmission during pursuit initiation and of the motor corollary discharges that comprise eye velocity memory and support steady-state tracking.NEW & NOTEWORTHY We exploit low-coherence patches of dots to control the initiation and steady state of smooth pursuit eye movements and show that these two phases of movement are modulated separately by the reliability of visual motion signals. We conclude that the neural circuit for pursuit includes separate modulation of the strength of visual-motor transmission for movement initiation and of eye velocity positive feedback to support steady-state tracking.

Presaccadic motion integration drives a predictive postsaccadic following response

Saccadic eye movements sample the visual world and ensure high acuity across the visual field. To compensate for delays in processing, saccades to moving targets require predictions: The eyes must intercept the target's future position to then pursue its direction of motion. Although prediction is crucial to voluntary pursuit, it is unclear whether it is an obligatory feature of saccade planning. Saccade planning involves an involuntary enhanced processing of the target, called presaccadic attention. Does this presaccadic attention recruit smooth eye movements automatically? To test this, we had human participants perform a saccade to one of four apertures, which were static, but each contained a random dot field with motion tangential to the required saccade. In this task, saccades were deviated along the direction of target motion, and the eyes exhibited a following response upon saccade landing. This postsaccadic following response (PFR) increased with spatial uncertainty of the target position and persisted even when we removed the motion stimulus in midflight of the saccade, confirming that it relied on presaccadic information. Motion from 50-100 ms prior to the saccade had the strongest influence on PFR, consistent with the time course of perceptual enhancements reported in presaccadic attention. Finally, the PFR magnitude related linearly to the logarithm of stimulus velocity and generally had low gain, similar to involuntary ocular following movements commonly observed after sudden motion onsets. These results suggest that presaccadic attention selects motion features of targets predictively, presumably to ensure successful immediate tracking of saccade targets in motion.

Smooth Pursuit and Saccades after Sport-Related Concussion

Smooth pursuit eye movements (SPEMs) and saccadic eye movements are both commonly impaired following sport-related concussion (SRC). Typical oculomotor assessments measure individual eye movements in a series of restrictive tests designed to isolate features such as response times. These measures lack ecological validity for athletes because athletes are adept at simple tasks designed for the general population. Yet, because eye movement metrics are sensitive and well-characterized neuroanatomically, it would be valuable to test whether athletes exhibit abnormal eye movements with more challenging tasks. To address this gap in knowledge, we collected eye-tracking data during a sport-like task to gain insight on gaze behavior during active self-motion. SPEMs and saccadic eye movements were recorded during a sport-like visual task within 24-48 h following SRC. Thirty-six Division I student-athletes were divided into SRC and control (CON) groups. All participants completed two blocks of the Wii Fit© soccer heading game (WF) while wearing a monocular infrared eye tracker. Eye movement classification systems quantified saccadic amplitude (SA), velocity (SV), and count (SC); as well as SPEM velocity (SPV) and amplitude (SPA). Separate Mann-Whitney U tests evaluated SPA and SC and found no significant effects (SPA, p = 0.11; SC, p = 0.10). A multi-variate analysis of variance (MANOVA) for remaining variables revealed SPV was significantly greater in CON (p < 0.05), but the SRC group had greater SA and SV (p < 0.05). These findings suggest that during a sport-like task, to maintain foveation SRC subjects used larger amplitude, faster saccades, but exhibited slower SPEMs. Measuring oculomotor function during ecologically valid, sport-like tasks may serve as a concussion biomarker and provide insights into eye movement control after SRC.

Effect of Prior Direction Expectation on the Accuracy and Precision of Smooth Pursuit Eye Movements

The integration of sensory with top–down cognitive signals for generating appropriate sensory–motor behaviors is an important issue in understanding the brain’s information processes. Recent studies have demonstrated that the interplay between sensory and high-level signals in oculomotor behavior could be explained by Bayesian inference. Specifically, prior knowledge for motion speed introduces a bias in the speed of smooth pursuit eye movements. The other important prediction of Bayesian inference is variability reduction by prior expectation; however, there is insufficient evidence in oculomotor behaviors to support this prediction. In the present study, we trained monkeys to switch the prior expectation about motion direction and independently controlled the strength of the motion stimulus. Under identical sensory stimulus conditions, we tested if prior knowledge about the motion direction reduced the variability of open-loop smooth pursuit eye movements. We observed a significant reduction when the prior expectation was strong; this was consistent with the prediction of Bayesian inference. Taking advantage of the open-loop smooth pursuit, we investigated the temporal dynamics of the effect of the prior to the pursuit direction bias and variability. This analysis demonstrated that the strength of the sensory evidence depended not only on the strength of the sensory stimulus but also on the time required for the pursuit system to form a neural sensory representation. Finally, we demonstrated that the variability and directional bias change by prior knowledge were quantitatively explained by the Bayesian observer model.

Motion direction representation in multivariate electroencephalography activity for smooth pursuit eye movements

Visually-guided smooth pursuit eye movements are composed of initial open-loop and later steady-state periods. Feedforward sensory information dominates the motor behavior during the open-loop pursuit, and a more complex feedback loop regulates the steady-state pursuit. To understand the neural representations of motion direction during open-loop and steady-state smooth pursuits, we recorded electroencephalography (EEG) responses from human observers while they tracked random-dot kinematograms as pursuit targets. We estimated population direction tuning curves from multivariate EEG activity using an inverted encoding model. We found significant direction tuning curves as early as about 60 ms from stimulus onset. Direction tuning responses were generalized to later times during the open-loop smooth pursuit, but they became more dynamic during the later steady-state pursuit. The encoding quality of retinal motion direction information estimated from the early direction tuning curves was predictive of trial-by-trial variation in initial pursuit directions. These results suggest that the movement directions of open-loop smooth pursuit are guided by the representation of the retinal motion present in the multivariate EEG activity.

Midair Haptic Pursuit

In human vision, smooth pursuit eye movement is the basic ability to visually follow a moving object by keeping it at the sight center. In this study, we validate that a human hand has a similar ability to track a midair haptic stimulus, i.e., a human palm exposed to a point vibration by a noncontact ultrasound tactile display can follow the continuous movement of the stimulation point. The experimental results show that the trackable velocity limit is 10 cm/s for motion parallel to the palm, when the initial velocity is zero. This ability of motion tracking by hand can be applied to haptic guidance for visually impaired people or for evacuation navigation, where no devices are needed to be equipped by users.

Effect of four weeks of ocular-motor exercises on dynamic visual acuity and stability limit of female basketball players

INTRODUCTION

Visual skills are an integral part of most daily activities and an effective indicator of the functional ability of athletes, particularly in the fields of dynamic sports like basketball. Despite the important role of vision and effect of ocular exercises on functional skills in athletes, a few studies have been conducted in this regard. Thus, this study aimed to investigate the effect of ocular-motor exercises on dynamic visual acuity and stability limit of female basketball players.

METHODS

In this semi-experimental study 30 club elite female basketball players aged between 18 and 24 years, with at least three years of specialized basketball experience, were randomly assigned to two intervention and control groups. The athletes in the intervention group participated in the designed four-week program (six sessions per week) of the oculo_motor exercises. The control group did just their own daily routine exercises. The limit of stability was measured by the Biodex balance system SD and dynamic visual acuity was measured by the PowerPoint, which is for detecting dynamic visual acuity. Also, the SPSS software version 19 was used to analyze the data by using descriptive statistics methods: independent t and Paired t tests, at a significance level of P ≤ 0.05.

RESULTS

The results showed that doing four weeks of the oculo_motor exercises led to a significant increase in the overall stability index (OSI) from 28/66 ± 7/23 to 51/60 ± 6/38 (p = 0.001), as well as in dynamic visual acuity from 29/73 ± 4/19 to 56/20 ± 8/81(p < 0.001); in the intervention group, these changes were also statistically significant in comparison with the control group and before doing the exercise protocol (p < 0.05).

CONCLUSION

According to the obtained results, the oculo_motor exercises can be used to enhance the limit of stability and dynamic visual acuity in basketball players and other dynamic sports.

Disrupted Corollary Discharge in Schizophrenia: Evidence From the Oculomotor System

Corollary discharge (CD) signals are motor-related signals that exert an influence on sensory processing. They allow mobile organisms to predict the sensory consequences of their imminent actions. Among the many functions of CD is to provide a means by which we can distinguish sensory experiences caused by our own actions from those with external causes. In this way, they contribute to a subjective sense of agency. A disruption in the sense of agency is central to many of the clinical symptoms of schizophrenia, and abnormalities in CD signaling have been theorized to underpin particularly those agency-related psychotic symptoms of the illness. Characterizing abnormal CD associated with eye movements in schizophrenia and their resulting influence on visual processing and subsequent action plans may have advantages over other sensory and motor systems. That is because the most robust psychophysiological and neurophysiological data regarding the dynamics and influence of CD as well as the neural circuitry implicated in CD generation and transmission comes from the study of eye movements in humans and nonhuman primates. We review studies of oculomotor CD signaling in the schizophrenia spectrum and possible neurobiological correlates of CD disturbances. We conclude by speculating on the ways in which oculomotor CD dysfunction, specifically, may invoke specific experiences, clinical symptoms, and cognitive impairments. These speculations lay the groundwork for empirical study, and we conclude by outlining potentially fruitful research directions.

Distinct pattern of oculomotor impairment associated with acute sleep loss and circadian misalignment

Key points

Inadequate sleep and irregular work schedules have not only adverse consequences for individual health and well‐being, but also enormous economic and safety implications for society as a whole.

This study demonstrates that visual motion processing and coordinated eye movements are significantly impaired when performed after sleep loss and during the biological night, and thus may be contributing to human error and accidents.

Because affected individuals are often unaware of their sensorimotor and cognitive deficits, there is a critical need for non‐invasive, objective indicators of mild, yet potentially unsafe, impairment due to disrupted sleep or biological rhythms.

Our findings show that a set of eye‐movement measures can be used to provide sensitive and reliable indicators of such mild neural impairments.

Abstract

Sleep loss and circadian misalignment have long been known to impair human cognitive and motor performance with significant societal and health consequences. It is well known that human reaction time to a visual cue is impaired following sleep loss and circadian misalignment, but it has remained unclear how more complex visuomotor control behaviour is altered under these conditions. In this study, we measured 14 parameters of the voluntary ocular tracking response of 12 human participants (six females) to systematically examine the effects of sleep loss and circadian misalignment using a constant routine 24‐h acute sleep‐deprivation paradigm. The combination of state‐of‐the‐art oculometric and sleep‐research methodologies allowed us to document, for the first time, large changes in many components of pursuit, saccades and visual motion processing as a function of time awake and circadian phase. Further, we observed a pattern of impairment across our set of oculometric measures that is qualitatively different from that observed previously with other mild neural impairments. We conclude that dynamic vision and visuomotor control exhibit a distinct pattern of impairment linked with time awake and circadian phase. Therefore, a sufficiently broad set of oculometric measures could provide a sensitive and specific behavioural biomarker of acute sleep loss and circadian misalignment. We foresee potential applications of such oculometric biomarkers assisting in the assessment of readiness‐to‐perform higher risk tasks and in the characterization of sub‐clinical neural impairment in the face of a multiplicity of potential risk factors, including disrupted sleep and circadian rhythms.

Inadequate sleep and irregular work schedules have not only adverse consequences for individual health and well‐being, but also enormous economic and safety implications for society as a whole.

This study demonstrates that visual motion processing and coordinated eye movements are significantly impaired when performed after sleep loss and during the biological night, and thus may be contributing to human error and accidents.

Because affected individuals are often unaware of their sensorimotor and cognitive deficits, there is a critical need for non‐invasive, objective indicators of mild, yet potentially unsafe, impairment due to disrupted sleep or biological rhythms.

Our findings show that a set of eye‐movement measures can be used to provide sensitive and reliable indicators of such mild neural impairments.

The Role of Neuronal Oscillations in Visual Active Sensing

Visual perception is most often studied as a "passive" process in which an observer fixates steadily at point in space so that stimuli can be delivered to the system with spatial precision. Analysis of neuronal signals related to vision is generally keyed to stimulus onset, stimulus movement, etc.; i.e., events external to the observer. In natural "active" vision, however, information is systematically acquired by using eye movements including rapid (saccadic) eye movements, as well as smooth ocular pursuit of moving objects and slower drifts. Here we consider the use of alternating saccades and fixations to gather information from a visual scene. The underlying motor sampling plan contains highly reliable information regarding "where" and "when" the eyes will land, this information can be used predictively to modify firing properties of neurons precisely at the time when this "contextual" information is most useful - when a volley of retinal input enters the system at the onset of each fixation. Analyses focusing on neural events leading to and resulting from shifts in fixation, as well as visual events external to the observer, can provide a more complete and mechanistic understanding of visual information processing. Studies thus far suggest that active vision may be a fundamentally different from that process we usually study with more traditional passive viewing paradigms. In this Perspective we note that active saccadic sampling behavior imposes robust temporal patterning on the activity of neuron ensembles and large-scale neural dynamics throughout the brain's visual pathways whose mechanistic effects on information processing are not yet fully understood. The spatio-temporal sequence of eye movements elicits a succession of temporally predictable quasi-rhythmic sensory inputs, whose encoding is enhanced by entrainment of low frequency oscillations to the rate of eye movements. Review of the pertinent findings underscores the fact that temporal coordination between motor and visual cortices is critical for understanding neural dynamics of active vision and posits that phase entrainment of neuronal oscillations plays a mechanistic role in this process.

Effects of nicotine on smooth pursuit eye movements in healthy non-smokers

RATIONALE

The non-selective nicotinic acetylcholine receptor (nAChR) agonist nicotine has been argued to improve attention via enhanced filtering of irrelevant stimuli. Here, we tested this hypothesis in the context of smooth pursuit eye movements (SPEMs), an oculomotor function previously shown to improve with nicotine in some but not all studies.

OBJECTIVES

In order to test whether nicotine improves performance particularly when the inhibition of distracting stimuli is required, SPEM was elicited in conditions with or without peripheral distractors. Additionally, different target frequencies were employed in order to parametrically vary general processing demands on the SPEM system.

METHODS

Healthy adult non-smokers (N = 18 females, N = 13 males) completed a horizontal sinusoidal SPEM task at different target frequencies (0.2 Hz, 0.4 Hz, 0.6 Hz) in the presence or absence of peripheral distractors in a double-blind, placebo-controlled, cross-over design using a 2 mg nicotine gum.

RESULTS

Nicotine increased peak pursuit gain relative to placebo (p < .001), but an interaction with distractor condition (p = .001) indicated that this effect was most pronounced in the presence of distractors. Catch-up saccade frequency was reduced by nicotine (p = .01), particularly at higher target frequencies (two-way interaction, p = .04). However, a three-way interaction (p = .006) indicated that the reduction with nicotine was strongest at the highest target frequency (0.6 Hz) only without distractors, whereas in the presence of distractors, it was strongest at 0.4-Hz target frequency. There were no effects of nicotine on subjective state measures.

CONCLUSIONS

Together, these findings support a role of both distractor inhibition and general processing load in the effects of nicotine on smooth pursuit.

A striatal interneuron circuit for continuous target pursuit

Most adaptive behaviors require precise tracking of targets in space. In pursuit behavior with a moving target, mice use distance to target to guide their own movement continuously. Here, we show that in the sensorimotor striatum, parvalbumin-positive fast-spiking interneurons (FSIs) can represent the distance between self and target during pursuit behavior, while striatal projection neurons (SPNs), which receive FSI projections, can represent self-velocity. FSIs are shown to regulate velocity-related SPN activity during pursuit, so that movement velocity is continuously modulated by distance to target. Moreover, bidirectional manipulation of FSI activity can selectively disrupt performance by increasing or decreasing the self-target distance. Our results reveal a key role of the FSI-SPN interneuron circuit in pursuit behavior and elucidate how this circuit implements distance to velocity transformation required for the critical underlying computation.

Many natural behaviours involve tracking of a target in space. Here, the authors describe a task to assess this behaviour in mice and use in vivo electrophysiology, calcium imaging, optogenetics, and chemogenetics to investigate the role of the striatum in target pursuit.

Cursive Eye-Writing With Smooth-Pursuit Eye-Movement Is Possible in Subjects With Amyotrophic Lateral Sclerosis

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder causing a progressive motor weakness of all voluntary muscles, whose progression challenges communication modalities such as handwriting or speech. The current study investigated whether ALS subjects can use Eye-On-Line (EOL), a novel eye-operated communication device allowing, after training, to voluntarily control smooth-pursuit eye-movements (SPEM) so as to eye-write in cursive. To that aim, ALS participants (n = 12) with preserved eye-movements but impaired handwriting were trained during six on-site visits. The primary outcome of the study was the recognition of eye-written digits (0-9) from ALS and healthy control subjects by naïve "readers." Changes in oculomotor performance and the safety of EOL were also evaluated. At the end of the program, 69.4% of the eye-written digits from 11 ALS subjects were recognized by naïve readers, similar to the 67.3% found for eye-written digits from controls participants, with however, large inter-individual differences in both groups of "writers." Training with EOL was associated with a transient fatigue leading one ALS subject to drop out the study at the fifth visit. Otherwise, itching eyes was the most common adverse event (3 subjects). This study shows that, despite the impact of ALS on the motor system, most ALS participants could improve their mastering of eye-movements, so as to produce recognizable eye-written digits, although the eye-traces sometimes needed smoothing to ease digit legibility from both ALS subjects and control participants. The capability to endogenously and voluntarily generate eye-traces using EOL brings a novel way to communicate for disabled individuals, allowing creative personal and emotional expression.

The predictability of a target’s motion influences gaze, head, and hand movements when trying to intercept it

Does the predictability of a target’s movement and of the interception location influence how the target is intercepted? In a first experiment, we manipulated the predictability of the interception location. A target moved along a haphazardly curved path, and subjects attempted to tap on it when it entered a hitting zone. The hitting zone was either a large ring surrounding the target’s starting position (ring condition) or a small disk that became visible before the target appeared (disk condition). The interception location gradually became apparent in the ring condition, whereas it was immediately apparent in the disk condition. In the ring condition, subjects pursued the target with their gaze. Their heads and hands gradually moved in the direction of the future tap position. In the disk condition, subjects immediately directed their gaze toward the hitting zone by moving both their eyes and heads. They also moved their hands to the future tap position sooner than in the ring condition. In a second and third experiment, we made the target’s movement more predictable. Although this made the targets easier to pursue, subjects now shifted their gaze to the hitting zone soon after the target appeared in the ring condition. In the disk condition, they still usually shifted their gaze to the hitting zone at the beginning of the trial. Together, the experiments show that predictability of the interception location is more important than predictability of target movement in determining how we move to intercept targets.

NEW & NOTEWORTHY We show that if people are required to intercept a target at a known location, they direct their gaze to the interception point as soon as they can rather than pursuing the target with their eyes for as long as possible. The predictability of the interception location rather than the predictability of the path to that location largely determines how the eyes, head, and hand move.

Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion

In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.

Reinforcement effects in anticipatory smooth eye movements

When predictive information about target motion is available, anticipatory smooth pursuit eye movements (aSPEM) are consistently generated before target appearance, thereby reducing the typical sensorimotor delay between target motion onset and foveation. By manipulating the probability for target motion direction, we were able to bias the direction and mean velocity of aSPEM. This suggests that motion-direction expectancy has a strong effect on the initiation of anticipatory movements. To further understand the nature of anticipatory smooth eye movements, we investigated different effects of reinforcement on aSPEM. In a first experiment, the reinforcement was contingent to a particular anticipatory behavior. A monetary reward was associated to a criterion-matching anticipatory velocity as estimated online during the gap before target motion onset. Our results showed a small but significant effect of behavior-contingent monetary reward on aSPEM. In a second experiment, the proportion of rewarded trials was manipulated across motion directions (right vs. left) independently from participants' behavior. Our results indicate that a bias in expected reward does not systematically affect anticipatory eye movements. Overall, these findings strengthen the notion that anticipatory eye movements can be considered as an operant behavior (similar to visually guided ones), whereas the expectancy for a noncontingent reward cannot efficiently bias them.