Mechanisms that allow cortical preparatory activity without inappropriate movement

Population coding of distinct categories of behavior in the frontal eye field

Brain regions frequently contribute to the control of a range of behaviors. To understand how a brain area controls multiple behaviors, we examined how the frontal eye field (FEF) encodes different eye movements by recording the activity of 1,200 neurons during smooth pursuit, pursuit suppression, and saccade tasks in two female Macaca fascicularis monkeys. Single neurons tended to respond on all tasks. In the absence of task-specific clusters, we analyzed the relationships in directional preference between tasks. The tuning curves during the pursuit and suppression tasks were strongly correlated, unlike the correlations between the pursuit and saccade tasks that were considerably weaker. To study the implications of single neuron coding, we examined the patterns of population activity on the three tasks. We identified the low-dimensional subspaces that captured the most variance in population activity during each task and quantified the extent of overlap between these spaces. The absence of overlap between the subspaces spanned by population activity on the pursuit and saccades tasks prompted an independent linear readout of these tasks. Conversely, pursuit and pursuit suppression showed substantial overlap in their population activity subspaces. This overlap emphasized the predominance of visual motion in pursuit encoding and indicated that the linear readouts accounting for a large part of the variability in the pursuit tasks cannot completely attenuate the activity during suppression. Overall, these results imply that at the population level, FEF is organized predominantly along sensory rather than motor parameters.NEW & NOTEWORTHY We investigated how the frontal eye field (FEF) encodes smooth pursuit, pursuit suppression, and saccade in monkeys. Tuning curves were highly correlated between pursuit and suppression, but the correlation was much weaker in pursuit and saccade. Pursuit and saccade occupied orthogonal subspaces, indicating independent tuning, whereas pursuit and suppression overlapped substantially, emphasizing the predominance of visual motion in pursuit encoding. These findings contribute to a better understanding of the mechanisms underlying the FEF's ability to control multiple behaviors.

A combinatorial neural code for long-term motor memory

Motor skill repertoire can be stably retained over long periods, but the neural mechanism that underlies stable memory storage remains poorly understood1-8. Moreover, it is unknown how existing motor memories are maintained as new motor skills are continuously acquired. Here we tracked neural representation of learned actions throughout a significant portion of the lifespan of a mouse and show that learned actions are stably retained in combination with context, which protects existing memories from erasure during new motor learning. We established a continual learning paradigm in which mice learned to perform directional licking in different task contexts while we tracked motor cortex activity for up to six months using two-photon imaging. Within the same task context, activity driving directional licking was stable over time with little representational drift. When learning new task contexts, new preparatory activity emerged to drive the same licking actions. Learning created parallel new motor memories instead of modifying existing representations. Re-learning to make the same actions in the previous task context re-activated the previous preparatory activity, even months later. Continual learning of new task contexts kept creating new preparatory activity patterns. Context-specific memories, as we observed in the motor system, may provide a solution for stable memory storage throughout continual learning.

Brain-wide dynamics linking sensation to action during decision-making

Perceptual decisions rely on learned associations between sensory evidence and appropriate actions, involving the filtering and integration of relevant inputs to prepare and execute timely responses1,2. Despite the distributed nature of task-relevant representations3-10, it remains unclear how transformations between sensory input, evidence integration, motor planning and execution are orchestrated across brain areas and dimensions of neural activity. Here we addressed this question by recording brain-wide neural activity in mice learning to report changes in ambiguous visual input. After learning, evidence integration emerged across most brain areas in sparse neural populations that drive movement-preparatory activity. Visual responses evolved from transient activations in sensory areas to sustained representations in frontal-motor cortex, thalamus, basal ganglia, midbrain and cerebellum, enabling parallel evidence accumulation. In areas that accumulate evidence, shared population activity patterns encode visual evidence and movement preparation, distinct from movement-execution dynamics. Activity in movement-preparatory subspace is driven by neurons integrating evidence, which collapses at movement onset, allowing the integration process to reset. Across premotor regions, evidence-integration timescales were independent of intrinsic regional dynamics, and thus depended on task experience. In summary, learning aligns evidence accumulation to action preparation in activity dynamics across dozens of brain regions. This leads to highly distributed and parallelized sensorimotor transformations during decision-making. Our work unifies concepts from decision-making and motor control fields into a brain-wide framework for understanding how sensory evidence controls actions.

A combinatorial neural code for long-term motor memory

Motor skill repertoire can be stably retained over long periods, but the neural mechanism underlying stable memory storage remains poorly understood. Moreover, it is unknown how existing motor memories are maintained as new motor skills are continuously acquired. Here we tracked neural representation of learned actions throughout a significant portion of a mouse's lifespan, and we show that learned actions are stably retained in motor memory in combination with context, which protects existing memories from erasure during new motor learning. We used automated home-cage training to establish a continual learning paradigm in which mice learned to perform directional licking in different task contexts. We combined this paradigm with chronic two-photon imaging of motor cortex activity for up to 6 months. Within the same task context, activity driving directional licking was stable over time with little representational drift. When learning new task contexts, new preparatory activity emerged to drive the same licking actions. Learning created parallel new motor memories while retaining the previous memories. Re-learning to make the same actions in the previous task context re-activated the previous preparatory activity, even months later. At the same time, continual learning of new task contexts kept creating new preparatory activity patterns. Context-specific memories, as we observed in the motor system, may provide a solution for stable memory storage throughout continual learning. Learning in new contexts produces parallel new representations instead of modifying existing representations, thus protecting existing motor repertoire from erasure.

Activity map of a cortico-cerebellar loop underlying motor planning

The neocortex and cerebellum interact to mediate cognitive functions. It remains unknown how the two structures organize into functional networks to mediate specific behaviors. Here we delineate activity supporting motor planning in relation to the mesoscale cortico-cerebellar connectome. In mice planning directional licking based on short-term memory, preparatory activity instructing future movement depends on the anterior lateral motor cortex (ALM) and the cerebellum. Transneuronal tracing revealed divergent and largely open-loop connectivity between the ALM and distributed regions of the cerebellum. A cerebellum-wide survey of neuronal activity revealed enriched preparatory activity in hotspot regions with conjunctive input-output connectivity to the ALM. Perturbation experiments show that the conjunction regions were required for maintaining preparatory activity and correct subsequent movement. Other cerebellar regions contributed little to motor planning despite input or output connectivity to the ALM. These results identify a functional cortico-cerebellar loop and suggest the cerebellar cortex selectively establishes reciprocal cortico-cerebellar communications to orchestrate motor planning.

Distinct context- and content-dependent population codes in superior colliculus during sensation and action

Sensorimotor transformation is the process of first sensing an object in the environment and then producing a movement in response to that stimulus. For visually guided saccades, neurons in the superior colliculus (SC) emit a burst of spikes to register the appearance of stimulus, and many of the same neurons discharge another burst to initiate the eye movement. We investigated whether the neural signatures of sensation and action in SC depend on context. Spiking activity along the dorsoventral axis was recorded with a laminar probe as Rhesus monkeys generated saccades to the same stimulus location in tasks that require either executive control to delay saccade onset until permission is granted or the production of an immediate response to a target whose onset is predictable. Using dimensionality reduction and discriminability methods, we show that the subspaces occupied during the visual and motor epochs were both distinct within each task and differentiable across tasks. Single-unit analyses, in contrast, show that the movement-related activity of SC neurons was not different between tasks. These results demonstrate that statistical features in neural activity of simultaneously recorded ensembles provide more insight than single neurons. They also indicate that cognitive processes associated with task requirements are multiplexed in SC population activity during both sensation and action and that downstream structures could use this activity to extract context. Additionally, the entire manifolds associated with sensory and motor responses, respectively, may be larger than the subspaces explored within a certain set of experiments.

Drifting population dynamics with transient resets characterize sensorimotor transformation in the monkey superior colliculus

To produce goal-directed eye movements known as saccades, we must channel sensory input from our environment through a process known as sensorimotor transformation. The behavioral output of this phenomenon (an accurate eye movement) is straightforward, but the coordinated activity of neurons underlying its dynamics is not well understood. We searched for a neural correlate of sensorimotor transformation in the activity patterns of simultaneously recorded neurons in the superior colliculus (SC) of three male rhesus monkeys performing a visually guided, delayed saccade task. Neurons in the intermediate layers produce a burst of spikes both following the appearance of a visual (sensory) stimulus and preceding an eye movement command, but many also exhibit a sustained activity level during the intervening time ("delay period"). This sustained activity could be representative of visual processing or motor preparation, along with countless cognitive processes. Using a novel measure we call the Visuomotor Proximity Index (VMPI), we pitted visual and motor signals against each other by measuring the degree to which each session's population activity (as summarized in a low-dimensional framework) could be considered more visual-like or more motor-like. The analysis highlighted two salient features of sensorimotor transformation. One, population activity on average drifted systematically toward a motor-like representation and intermittently reverted to a visual-like representation following a microsaccade. Two, activity patterns that drift to a stronger motor-like representation by the end of the delay period may enable a more rapid initiation of a saccade, substantiating the idea that this movement initiation mechanism is conserved across motor systems.

Prior expectation enhances sensorimotor behavior by modulating population tuning and subspace activity in sensory cortex

Prior knowledge facilitates our perception and goal-directed behaviors, particularly when sensory input is lacking or noisy. However, the neural mechanisms underlying the improvement in sensorimotor behavior by prior expectations remain unknown. In this study, we examine the neural activity in the middle temporal (MT) area of visual cortex while monkeys perform a smooth pursuit eye movement task with prior expectation of the visual target's motion direction. Prior expectations discriminately reduce the MT neural responses depending on their preferred directions, when the sensory evidence is weak. This response reduction effectively sharpens neural population direction tuning. Simulations with a realistic MT population demonstrate that sharpening the tuning can explain the biases and variabilities in smooth pursuit, suggesting that neural computations in the sensory area alone can underpin the integration of prior knowledge and sensory evidence. State-space analysis further supports this by revealing neural signals of prior expectations in the MT population activity that correlate with behavioral changes.

Interplay between external inputs and recurrent dynamics during movement preparation and execution in a network model of motor cortex

The primary motor cortex has been shown to coordinate movement preparation and execution through computations in approximately orthogonal subspaces. The underlying network mechanisms, and the roles played by external and recurrent connectivity, are central open questions that need to be answered to understand the neural substrates of motor control. We develop a recurrent neural network model that recapitulates the temporal evolution of neuronal activity recorded from the primary motor cortex of a macaque monkey during an instructed delayed-reach task. In particular, it reproduces the observed dynamic patterns of covariation between neural activity and the direction of motion. We explore the hypothesis that the observed dynamics emerges from a synaptic connectivity structure that depends on the preferred directions of neurons in both preparatory and movement-related epochs, and we constrain the strength of both synaptic connectivity and external input parameters from data. While the model can reproduce neural activity for multiple combinations of the feedforward and recurrent connections, the solution that requires minimum external inputs is one where the observed patterns of covariance are shaped by external inputs during movement preparation, while they are dominated by strong direction-specific recurrent connectivity during movement execution. Our model also demonstrates that the way in which single-neuron tuning properties change over time can explain the level of orthogonality of preparatory and movement-related subspaces.

Toward a Biomimetic Neural Circuit Model of Sensory-Motor Processing

Computational models have been a mainstay of research on smooth pursuit eye movements in monkeys. Pursuit is a sensory-motor system that is driven by the visual motion of small targets. It creates a smooth eye movement that accelerates up to target speed and tracks the moving target essentially perfectly. In this review of my laboratory's research, I trace the development of computational models of pursuit eye movements from the early control-theory models to the most recent neural circuit models. I outline a combined experimental and computational plan to move the models to the next level. Finally, I explain why research on nonhuman primates is so critical to the development of the neural circuit models I think we need.

The effect of temporal expectation on the correlations of frontal neural activity with alpha oscillation and sensory-motor latency

In a dynamic environment, we seek to enhance behavioral responses by anticipating future events. Previous studies have shown that the probability distribution of the timing of future events could shape our expectation of event timing; furthermore, the modulation of alpha oscillation is known to be a critical neural factor. However, a link between the modulation of alpha oscillation by temporal expectation and single neural activity is missing. In this study, we investigated how temporal expectation modulated frontal neural activities and behavioral reaction time by recording neural activity from the frontal eye field smooth pursuit eye movement region of monkeys while they performed a smooth pursuit eye movement task. We found that the temporal expectation reduced the coherence between the neural spiking and alpha frequency of the local field potential, along with the trial-by-trial correlation between the neural spiking activity and pursuit latency. This result suggests that the desynchronization of alpha oscillation by temporal expectation would be related to the decorrelation of population neural activity, which could be the neural source of reaction time enhancement by temporal expectation.

Multiregion neuronal activity: the forest and the trees

The past decade has witnessed remarkable advances in the simultaneous measurement of neuronal activity across many brain regions, enabling fundamentally new explorations of the brain-spanning cellular dynamics that underlie sensation, cognition and action. These recently developed multiregion recording techniques have provided many experimental opportunities, but thoughtful consideration of methodological trade-offs is necessary, especially regarding field of view, temporal acquisition rate and ability to guarantee cellular resolution. When applied in concert with modern optogenetic and computational tools, multiregion recording has already made possible fundamental biological discoveries - in part via the unprecedented ability to perform unbiased neural activity screens for principles of brain function, spanning dozens of brain areas and from local to global scales.

Expectations about motion direction affect perception and anticipatory smooth pursuit differently

Smooth pursuit eye movements and visual motion perception rely on the integration of current sensory signals with past experience. Experience shapes our expectation of current visual events and can drive eye movement responses made in anticipation of a target, such as anticipatory pursuit. Previous research revealed consistent effects of expectation on anticipatory pursuit-eye movements follow the expected target direction or speed-and contrasting effects on motion perception, but most studies considered either eye movement or perceptual responses. The current study directly compared effects of direction expectation on perception and anticipatory pursuit within the same direction discrimination task to investigate whether both types of responses are affected similarly or differently. Observers (n = 10) viewed high-coherence random-dot kinematograms (RDKs) moving rightward and leftward with a probability of 50%, 70%, or 90% in a given block of trials to build up an expectation of motion direction. They were asked to judge motion direction of interleaved low-coherence RDKs (0%-15%). Perceptual judgements were compared with changes in anticipatory pursuit eye movements as a function of probability. Results show that anticipatory pursuit velocity scaled with probability and followed direction expectation (attraction bias), whereas perceptual judgments were biased opposite to direction expectation (repulsion bias). Control experiments suggest that the repulsion bias in perception was not caused by retinal slip induced by anticipatory pursuit, or by motion adaptation. We conclude that direction expectation can be processed differently for perception and anticipatory pursuit.NEW & NOTEWORTHY We show that expectations about motion direction that are based on long-term trial history affect perception and anticipatory pursuit differently. Whereas anticipatory pursuit direction was coherent with the expected motion direction (attraction bias), perception was biased opposite to the expected direction (repulsion bias). These opposite biases potentially reveal different ways in which perception and action utilize prior information and support the idea of different information processing for perception and pursuit.