Neural cognitive signals during spontaneous movements in the macaque

The predictive nature of spontaneous brain activity across scales and species

Emerging research suggests the brain operates as a "prediction machine," continuously anticipating sensory, motor, and cognitive outcomes. Central to this capability is the brain's spontaneous activity-ongoing internal processes independent of external stimuli. Neuroimaging and computational studies support that this activity is integral to maintaining and refining mental models of our environment, body, and behaviors, akin to generative models in computation. During rest, spontaneous activity expands the variability of potential representations, enhancing the accuracy and adaptability of these models. When performing tasks, internal models direct brain regions to anticipate sensory and motor states, optimizing performance. This review synthesizes evidence from various species, from C. elegans to humans, highlighting three key aspects of spontaneous brain activity's role in prediction: the similarity between spontaneous and task-related activity, the encoding of behavioral and interoceptive priors, and the high metabolic cost of this activity, underscoring prediction as a fundamental function of brains across species.

Multiplexing of cognitive encoding by oculomotor networks leads to incidental gaze shifts

Humans and other animals are adept at learning to perform cognitively demanding behavioral tasks. Neurophysiological recordings in nonhuman primates during such tasks find that the requisite cognitive variables are encoded strongly in core oculomotor brain regions. Here, we assembled a large dataset-11 monkeys performing an abstract visual categorization task, surveyed across more than 1,000 neural recording sessions-to reveal that this produces a robust but uninstructed behavioral "tell," observed in all subjects and experiments: small, cognitively modulated eye movements. We find that these eye movements are causally linked to activity in SC but not LIP, and that they occur following transient alignment of cognitive and saccadic population coding subspaces in SC. This behavioral signature of oculomotor engagement is absent during a similar task that does not require rule-based categorization, suggesting that abstract task behaviors recruit primate oculomotor networks more strongly than previously understood.

Separating cognitive and motor processes in the behaving mouse

The cognitive processes supporting complex animal behavior are closely associated with movements responsible for critical processes, such as facial expressions or the active sampling of our environments. These movements are strongly related to neural activity across much of the brain and are often highly correlated with ongoing cognitive processes. A fundamental issue for understanding the neural signatures of cognition and movements is whether cognitive processes are separable from related movements or if they are driven by common neural mechanisms. Here we demonstrate how the separability of cognitive and motor processes can be assessed and, when separable, how the neural dynamics associated with each component can be isolated. We designed a behavioral task in mice that involves multiple cognitive processes, and we show that dynamics commonly taken to support cognitive processes are strongly contaminated by movements. When cognitive and motor components are isolated using a novel approach for subspace decomposition, we find that they exhibit distinct dynamical trajectories and are encoded by largely separate populations of cells. Accurately isolating dynamics associated with particular cognitive and motor processes will be essential for developing conceptual and computational models of neural circuit function.

Prefrontal cortex neuronal ensembles dynamically encode task features during associative memory and virtual navigation

Neuronal populations expand their information-encoding capacity using mixed selective neurons. This is particularly prominent in association areas such as the lateral prefrontal cortex (LPFC), which integrate information from multiple sensory systems. However, during conditions that approximate natural behaviors, it is unclear how LPFC neuronal ensembles process space- and time-varying information about task features. Here, we show that, during a virtual reality task with naturalistic elements that requires associative memory, individual neurons and neuronal ensembles in the primate LPFC dynamically mix unconstrained features of the task, such as eye movements, with task-related visual features. Neurons in dorsal regions show more selectivity for space and eye movements, while ventral regions show more selectivity for visual features, representing them in a separate subspace. In summary, LPFC neurons exhibit dynamic and mixed selectivity for unconstrained and constrained task elements, and neural ensembles can separate task features in different subspaces.

Is the impact of spontaneous movements on early visual cortex species specific?

Recent studies in non-human primates do not find pronounced signals related to the animal's own body movements in the responses of neurons in the visual cortex. This is notable because such pronounced signals have been widely observed in the visual cortex of mice. Here, we discuss factors that may contribute to the differences observed between species, such as state, slow neural drift, eccentricity, and changes in retinal input. The interpretation of movement-related signals in the visual cortex also exemplifies the challenge of identifying the sources of correlated variables. Dissecting these sources is central for understanding the functional roles of movement-related signals. We suggest a functional classification of the possible sources, aimed at facilitating cross-species comparative approaches to studying the neural mechanisms of vision during natural behavior.

Analysis methods for large-scale neuronal recordings

Simultaneous recordings from hundreds or thousands of neurons are becoming routine because of innovations in instrumentation, molecular tools, and data processing software. Such recordings can be analyzed with data science methods, but it is not immediately clear what methods to use or how to adapt them for neuroscience applications. We review, categorize, and illustrate diverse analysis methods for neural population recordings and describe how these methods have been used to make progress on longstanding questions in neuroscience. We review a variety of approaches, ranging from the mathematically simple to the complex, from exploratory to hypothesis-driven, and from recently developed to more established methods. We also illustrate some of the common statistical pitfalls in analyzing large-scale neural data.

Slow and steady: auditory features for discriminating animal vocalizations

We propose that listeners can use temporal regularities - spectro-temporal correlations that change smoothly over time - to discriminate animal vocalizations within and between species. To test this idea, we used Slow Feature Analysis (SFA) to find the most temporally regular components of vocalizations from birds (blue jay, house finch, American yellow warbler, and great blue heron), humans (English speakers), and rhesus macaques. We projected vocalizations into the learned feature space and tested intra-class (same speaker/species) and inter-class (different speakers/species) auditory discrimination by a trained classifier. We found that: 1) Vocalization discrimination was excellent (> 95%) in all cases; 2) Performance depended primarily on the ~10 most temporally regular features; 3) Most vocalizations are dominated by ~10 features with high temporal regularity; and 4) These regular features are highly correlated with the most predictable components of animal sounds.

Toward a neuroscience of natural behavior

One of the most exciting new developments in systems neuroscience is the progress being made toward neurophysiological experiments that move beyond simplified laboratory settings and address the richness of natural behavior. This is enabled by technological advances such as wireless recording in freely moving animals, automated quantification of behavior, and new methods for analyzing large data sets. Beyond new empirical methods and data, however, there is also a need for new theories and concepts to interpret that data. Such theories need to address the particular challenges of natural behavior, which often differ significantly from the scenarios studied in traditional laboratory settings. Here, we discuss some strategies for developing such novel theories and concepts and some example hypotheses being proposed.

Low and high beta rhythms have different motor cortical sources and distinct roles in movement control and spatiotemporal attention

Low and high beta frequency rhythms were observed in the motor cortex, but their respective sources and behavioral correlates remain unknown. We studied local field potentials (LFPs) during pre-cued reaching behavior in macaques. They contained a low beta band (<20 Hz) dominant in primary motor cortex and a high beta band (>20 Hz) dominant in dorsal premotor cortex (PMd). Low beta correlated positively with reaction time (RT) from visual cue onset and negatively with uninstructed hand postural micro-movements throughout the trial. High beta reflected temporal task prediction, with selective modulations before and during cues, which were enhanced in moments of increased focal attention when the gaze was on the work area. This double-dissociation in sources and behavioral correlates of motor cortical low and high beta, with respect to both task-instructed and spontaneous behavior, reconciles the largely disparate roles proposed for the beta rhythm, by suggesting band-specific roles in both movement control and spatiotemporal attention.

Top-down modulation of visual cortical stimulus encoding and gamma independent of firing rates

Neurons in primary visual cortex integrate sensory input with signals reflecting the animal's internal state to support flexible behavior. Internal variables, such as expectation, attention, or current goals, are imposed in a top-down manner via extensive feedback projections from higher-order areas. We optogenetically activated a high-order visual area, area 21a, in the lightly anesthetized cat (OptoTD), while recording from neuronal populations in V1. OptoTD induced strong, up to several fold, changes in gamma-band synchronization together with much smaller changes in firing rate, and the two effects showed no correlation. OptoTD effects showed specificity for the features of the simultaneously presented visual stimuli. OptoTD-induced changes in gamma synchronization, but not firing rates, were predictive of simultaneous changes in the amount of encoded stimulus information. Our findings suggest that one important role of top-down signals is to modulate synchronization and the information encoded by populations of sensory neurons.

Population coding of strategic variables during foraging in freely moving macaques

Until now, it has been difficult to examine the neural bases of foraging in naturalistic environments because previous approaches have relied on restrained animals performing trial-based foraging tasks. Here we allowed unrestrained monkeys to freely interact with concurrent reward options while we wirelessly recorded population activity in the dorsolateral prefrontal cortex. The animals decided when and where to forage based on whether their prediction of reward was fulfilled or violated. This prediction was not solely based on a history of reward delivery, but also on the understanding that waiting longer improves the chance of reward. The task variables were continuously represented in a subspace of the high-dimensional population activity, and this compressed representation predicted the animal's subsequent choices better than the true task variables and as well as the raw neural activity. Our results indicate that monkeys' foraging strategies are based on a cortical model of reward dynamics as animals freely explore their environment.

Neural signatures of natural behaviour in socializing macaques

Our understanding of the neurobiology of primate behaviour largely derives from artificial tasks in highly controlled laboratory settings, overlooking most natural behaviours that primate brains evolved to produce1-3. How primates navigate the multidimensional social relationships that structure daily life4 and shape survival and reproductive success5 remains largely unclear at the single-neuron level. Here we combine ethological analysis, computer vision and wireless recording technologies to identify neural signatures of natural behaviour in unrestrained, socially interacting pairs of rhesus macaques. Single-neuron and population activity in the prefrontal and temporal cortex robustly encoded 24 species-typical behaviours, as well as social context. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioural mechanism supporting friendships and alliances6, and neural activity maintained a running account of these social investments. Confronted with an aggressive intruder, behavioural and neural population responses reflected empathy and were buffered by the presence of a partner. Our findings reveal a highly distributed neurophysiological ledger of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

Separating cognitive and motor processes in the behaving mouse

The cognitive processes supporting complex animal behavior are closely associated with ubiquitous movements responsible for our posture, facial expressions, ability to actively sample our sensory environments, and other critical processes. These movements are strongly related to neural activity across much of the brain and are often highly correlated with ongoing cognitive processes, making it challenging to dissociate the neural dynamics that support cognitive processes from those supporting related movements. In such cases, a critical issue is whether cognitive processes are separable from related movements, or if they are driven by common neural mechanisms. Here, we demonstrate how the separability of cognitive and motor processes can be assessed, and, when separable, how the neural dynamics associated with each component can be isolated. We establish a novel two-context behavioral task in mice that involves multiple cognitive processes and show that commonly observed dynamics taken to support cognitive processes are strongly contaminated by movements. When cognitive and motor components are isolated using a novel approach for subspace decomposition, we find that they exhibit distinct dynamical trajectories. Further, properly accounting for movement revealed that largely separate populations of cells encode cognitive and motor variables, in contrast to the 'mixed selectivity' often reported. Accurately isolating the dynamics associated with particular cognitive and motor processes will be essential for developing conceptual and computational models of neural circuit function and evaluating the function of the cell types of which neural circuits are composed.

Visuo-frontal interactions during social learning in freely moving macaques

Social interactions represent a ubiquitous aspect of our everyday life that we acquire by interpreting and responding to visual cues from conspecifics1. However, despite the general acceptance of this view, how visual information is used to guide the decision to cooperate is unknown. Here, we wirelessly recorded the spiking activity of populations of neurons in the visual and prefrontal cortex in conjunction with wireless recordings of oculomotor events while freely moving macaques engaged in social cooperation. As animals learned to cooperate, visual and executive areas refined the representation of social variables, such as the conspecific or reward, by distributing socially relevant information among neurons in each area. Decoding population activity showed that viewing social cues influences the decision to cooperate. Learning social events increased coordinated spiking between visual and prefrontal cortical neurons, which was associated with improved accuracy of neural populations to encode social cues and the decision to cooperate. These results indicate that the visual-frontal cortical network prioritizes relevant sensory information to facilitate learning social interactions while freely moving macaques interact in a naturalistic environment.

Activity in primate visual cortex is minimally driven by spontaneous movements

Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (Macaca mulatta), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals' own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.

Neural signatures of natural behavior in socializing macaques

Our understanding of the neurobiology of primate behavior largely derives from artificial tasks in highly-controlled laboratory settings, overlooking most natural behaviors primate brains evolved to produce1. In particular, how primates navigate the multidimensional social relationships that structure daily life and shape survival and reproductive success remains largely unexplored at the single neuron level. Here, we combine ethological analysis with new wireless recording technologies to uncover neural signatures of natural behavior in unrestrained, socially interacting pairs of rhesus macaques within a larger colony. Population decoding of single neuron activity in prefrontal and temporal cortex unveiled robust encoding of 24 species-typical behaviors, which was strongly modulated by the presence and identity of surrounding monkeys. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioral mechanism supporting friendships and alliances, and neural activity maintained a running account of these social investments. When confronted with an aggressive intruder, behavioral and neural population responses reflected empathy and were buffered by the presence of a partner. Surprisingly, neural signatures in prefrontal and temporal cortex were largely indistinguishable and irreducible to visual and motor contingencies. By employing an ethological approach to the study of primate neurobiology, we reveal a highly-distributed neurophysiological record of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Neural mechanisms underlying uninstructed orofacial movements during reward-based learning behaviors

During reward-based learning tasks, animals make orofacial movements that globally influence brain activity at the timings of reward expectation and acquisition. These orofacial movements are not explicitly instructed and typically appear along with goal-directed behaviors. Here, we show that reinforcing optogenetic stimulation of dopamine neurons in the ventral tegmental area (oDAS) in mice is sufficient to induce orofacial movements in the whiskers and nose without accompanying goal-directed behaviors. Pavlovian conditioning with a sensory cue and oDAS elicited cue-locked and oDAS-aligned orofacial movements, which were distinguishable by a machine-learning model. Inhibition or knockout of dopamine D1 receptors in the nucleus accumbens inhibited oDAS-induced motion but spared cue-locked motion, suggesting differential regulation of these two types of orofacial motions. In contrast, inactivation of the whisker primary motor cortex (wM1) abolished both types of orofacial movements. We found specific neuronal populations in wM1 representing either oDAS-aligned or cue-locked whisker movements. Notably, optogenetic stimulation of wM1 neurons successfully replicated these two types of movements. Our results thus suggest that accumbal D1-receptor-dependent and -independent neuronal signals converge in the wM1 for facilitating distinct uninstructed orofacial movements during a reward-based learning task.