Gain mechanisms for contextually guided visuomotor transformations

Neural geometry from mixed sensorimotor selectivity for predictive sensorimotor control

Although recent studies suggest that activity in the motor cortex, in addition to generating motor outputs, receives substantial information regarding sensory inputs, it is still unclear how sensory context adjusts the motor commands. Here, we recorded population neural activity in the motor cortex via microelectrode arrays while monkeys performed flexible manual interceptions of moving targets. During this task, which requires predictive sensorimotor control, the activity of most neurons in the motor cortex encoding upcoming movements was influenced by ongoing target motion. Single-trial neural states at the movement onset formed staggered orbital geometries, suggesting that target motion modulates peri-movement activity in an orthogonal manner. This neural geometry was further evaluated with a representational model and recurrent neural networks (RNNs) with task-specific input-output mapping. We propose that the sensorimotor dynamics can be derived from neuronal mixed sensorimotor selectivity and dynamic interaction between modulations.

Position- and scale-invariant object-centered spatial localization in monkey frontoparietal cortex dynamically adapts to cognitive demand

Egocentric encoding is a well-known property of brain areas along the dorsal pathway. Different to previous experiments, which typically only demanded egocentric spatial processing during movement preparation, we designed a task where two male rhesus monkeys memorized an on-the-object target position and then planned a reach to this position after the object re-occurred at variable location with potentially different size. We found allocentric (in addition to egocentric) encoding in the dorsal stream reach planning areas, parietal reach region and dorsal premotor cortex, which is invariant with respect to the position, and, remarkably, also the size of the object. The dynamic adjustment from predominantly allocentric encoding during visual memory to predominantly egocentric during reach planning in the same brain areas and often the same neurons, suggests that the prevailing frame of reference is less a question of brain area or processing stream, but more of the cognitive demands.

Spatial representation in the hippocampal formation: a history

Since the first place cell was recorded and the cognitive-map theory was subsequently formulated, investigation of spatial representation in the hippocampal formation has evolved in stages. Early studies sought to verify the spatial nature of place cell activity and determine its sensory origin. A new epoch started with the discovery of head direction cells and the realization of the importance of angular and linear movement-integration in generating spatial maps. A third epoch began when investigators turned their attention to the entorhinal cortex, which led to the discovery of grid cells and border cells. This review will show how ideas about integration of self-motion cues have shaped our understanding of spatial representation in hippocampal-entorhinal systems from the 1970s until today. It is now possible to investigate how specialized cell types of these systems work together, and spatial mapping may become one of the first cognitive functions to be understood in mechanistic detail.

The Importance of Lateral Connections in the Parietal Cortex for Generating Motor Plans

Substantial evidence has highlighted the significant role of associative brain areas, such as the posterior parietal cortex (PPC) in transforming multimodal sensory information into motor plans. However, little is known about how different sensory information, which can have different delays or be absent, combines to produce a motor plan, such as executing a reaching movement. To address these issues, we constructed four biologically plausible network architectures to simulate PPC: 1) feedforward from sensory input to the PPC to a motor output area, 2) feedforward with the addition of an efference copy from the motor area, 3) feedforward with the addition of lateral or recurrent connectivity across PPC neurons, and 4) feedforward plus efference copy, and lateral connections. Using an evolutionary strategy, the connectivity of these network architectures was evolved to execute visually guided movements, where the target stimulus provided visual input for the entirety of each trial. The models were then tested on a memory guided motor task, where the visual target disappeared after a short duration. Sensory input to the neural networks had sensory delays consistent with results from monkey studies. We found that lateral connections within the PPC resulted in smoother movements and were necessary for accurate movements in the absence of visual input. The addition of lateral connections resulted in velocity profiles consistent with those observed in human and non-human primate visually guided studies of reaching, and allowed for smooth, rapid, and accurate movements under all conditions. In contrast, Feedforward or Feedback architectures were insufficient to overcome these challenges. Our results suggest that intrinsic lateral connections are critical for executing accurate, smooth motor plans.

Asymmetric generalization in adaptation to target displacement errors in humans and in a neural network model

Different error signals can induce sensorimotor adaptation during visually guided reaching, possibly evoking different neural adaptation mechanisms. Here we investigate reach adaptation induced by visual target errors without perturbing the actual or sensed hand position. We analyzed the spatial generalization of adaptation to target error to compare it with other known generalization patterns and simulated our results with a neural network model trained to minimize target error independent of prediction errors. Subjects reached to different peripheral visual targets and had to adapt to a sudden fixed-amplitude displacement ("jump") consistently occurring for only one of the reach targets. Subjects simultaneously had to perform contralateral unperturbed saccades, which rendered the reach target jump unnoticeable. As a result, subjects adapted by gradually decreasing reach errors and showed negative aftereffects for the perturbed reach target. Reach errors generalized to unperturbed targets according to a translational rather than rotational generalization pattern, but locally, not globally. More importantly, reach errors generalized asymmetrically with a skewed generalization function in the direction of the target jump. Our neural network model reproduced the skewed generalization after adaptation to target jump without having been explicitly trained to produce a specific generalization pattern. Our combined psychophysical and simulation results suggest that target jump adaptation in reaching can be explained by gradual updating of spatial motor goal representations in sensorimotor association networks, independent of learning induced by a prediction-error about the hand position. The simulations make testable predictions about the underlying changes in the tuning of sensorimotor neurons during target jump adaptation.

Neural model for learning-to-learn of novel task sets in the motor domain

During development, infants learn to differentiate their motor behaviors relative to various contexts by exploring and identifying the correct structures of causes and effects that they can perform; these structures of actions are called task sets or internal models. The ability to detect the structure of new actions, to learn them and to select on the fly the proper one given the current task set is one great leap in infants cognition. This behavior is an important component of the child's ability of learning-to-learn, a mechanism akin to the one of intrinsic motivation that is argued to drive cognitive development. Accordingly, we propose to model a dual system based on (1) the learning of new task sets and on (2) their evaluation relative to their uncertainty and prediction error. The architecture is designed as a two-level-based neural system for context-dependent behavior (the first system) and task exploration and exploitation (the second system). In our model, the task sets are learned separately by reinforcement learning in the first network after their evaluation and selection in the second one. We perform two different experimental setups to show the sensorimotor mapping and switching between tasks, a first one in a neural simulation for modeling cognitive tasks and a second one with an arm-robot for motor task learning and switching. We show that the interplay of several intrinsic mechanisms drive the rapid formation of the neural populations with respect to novel task sets.

A leaky-integrator model as a control mechanism underlying flexible decision making during task switching

The ability to switch between tasks is critical for animals to behave according to context. Although the association between the prefrontal cortex and task switching has been well documented, the ultimate modulation of sensory–motor associations has yet to be determined. Here, we modeled the results of a previous study showing that task switching can be accomplished by communication from distinct populations of sensory neurons. We proposed a leaky-integrator model where relevant and irrelevant information were stored separately in two integrators and task switching was achieved by leaking information from the irrelevant integrator. The model successfully explained both the behavioral and neuronal data. Additionally, the leaky-integrator model showed better performance than an alternative model, where irrelevant information was discarded by decreasing the weight on irrelevant information, when animals initially failed to commit to a task. Overall, we propose that flexible switching is, in part, achieved by actively controlling the amount of leak of relevant and irrelevant information.

Sensorimotor learning biases choice behavior: a learning neural field model for decision making

According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making) should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action selection required for decision making in ambiguous choice situations.

Decision making requires the selection between alternative actions. It has been suggested that action selection is not separate from motor preparation of the according actions, but rather that the selection emerges from the competition between different movement plans. We expand on this idea, and ask how action selection mechanisms interact with the learning of new action choices. We present a neurodynamic model that provides an integrated account of action selection and the learning of sensorimotor associations. The model explains recent electrophysiological findings from monkeys' sensorimotor cortex, and correctly predicted a newly described characteristic pattern of their choice errors. Based on the model, we present a theory of how geometrical sensorimotor mapping rules can be learned by association without the need for an explicit representation of the transformation rule, and how the learning history of these associations can have a direct influence on later decision making.

Sensorimotor integration and psychopathology: motor control abnormalities related to psychiatric disorders

OBJECTIVES

Recent evidence is reviewed to examine relationships among sensorimotor and cognitive aspects in some important psychiatry disorders. This study reviews the theoretical models in the context of sensorimotor integration and the abnormalities reported in the most common psychiatric disorders, such as Alzheimer's disease, autism spectrum disorder and squizophrenia.

METHODS

The bibliographical search used Pubmed/Medline, ISI Web of Knowledge, Cochrane data base and Scielo databases. The terms chosen for the search were: Alzheimer's disease, AD, autism spectrum disorder, and Squizophrenia in combination with sensorimotor integration. Fifty articles published in English and were selected conducted from 1989 up to 2010.

RESULTS

We found that the sensorimotor integration process plays a relevant role in elementary mechanisms involved in occurrence of abnormalities in most common psychiatric disorders, participating in the acquisition of abilities that have as critical factor the coupling of different sensory data which will constitute the basis of elaboration of consciously goal-directed motor outputs. Whether these disorders are associated with an abnormal peripheral sensory input or defective central processing is still unclear, but some studies support a central mechanism.

CONCLUSION

Sensorimotor integration seems to play a significant role in the disturbances of motor control, like deficits in the feedforward mechanism, typically seen in AD, autistic and squizophrenic patients.

Using a compound gain field to compute a reach plan

A gain field, the scaling of a tuned neuronal response by a postural signal, may help support neuronal computation. Here, we characterize eye and hand position gain fields in the parietal reach region (PRR). Eye and hand gain fields in individual PRR neurons are similar in magnitude but opposite in sign to one another. This systematic arrangement produces a compound gain field that is proportional to the distance between gaze location and initial hand position. As a result, the visual response to a target for an upcoming reach is scaled by the initial gaze-to-hand distance. Such a scaling is similar to what would be predicted in a neural network that mediates between eye- and hand-centered representations of target location. This systematic arrangement supports a role of PRR in visually guided reaching and provides strong evidence that gain fields are used for neural computations.

Cognitive neural prosthetics

The cognitive neural prosthetic (CNP) is a very versatile method for assisting paralyzed patients and patients with amputations. The CNP records the cognitive state of the subject, rather than signals strictly related to motor execution or sensation. We review a number of high-level cortical signals and their application for CNPs, including intention, motor imagery, decision making, forward estimation, executive function, attention, learning, and multi-effector movement planning. CNPs are defined by the cognitive function they extract, not the cortical region from which the signals are recorded. However, some cortical areas may be better than others for particular applications. Signals can also be extracted in parallel from multiple cortical areas using multiple implants, which in many circumstances can increase the range of applications of CNPs. The CNP approach relies on scientific understanding of the neural processes involved in cognition, and many of the decoding algorithms it uses also have parallels to underlying neural circuit functions.

Intention, action planning, and decision making in parietal-frontal circuits

The posterior parietal cortex and frontal cortical areas to which it connects are responsible for sensorimotor transformations. This review covers new research on four components of this transformation process: planning, decision making, forward state estimation, and relative-coordinate representations. These sensorimotor functions can be harnessed for neural prosthetic operations by decoding intended goals (planning) and trajectories (forward state estimation) of movements as well as higher cortical functions related to decision making and potentially the coordination of multiple body parts (relative-coordinate representations).

Implementation of spatial transformation rules for goal-directed reaching via gain modulation in monkey parietal and premotor cortex

Planning goal-directed movements requires the combination of visuospatial with abstract contextual information. Our sensory environment constrains possible movements to a certain extent. However, contextual information guides proper choice of action in a given situation and allows flexible mapping of sensory instruction cues onto different motor actions. We used anti-reach tasks to test the hypothesis that spatial motor-goal representations in cortical sensorimotor areas are gain modulated by the behavioral context to achieve flexible remapping of spatial cue information onto arbitrary motor goals. We found that gain modulation of neuronal reach goal representations is commonly induced by the behavioral context in individual neurons of both, the parietal reach region (PRR) and the dorsal premotor cortex (PMd). In addition, PRR showed stronger directional selectivity during the planning of a reach toward a directly cued goal (pro-reach) compared with an inferred target (anti-reach). PMd, however, showed stronger overall activity during reaches toward inferred targets compared with directly cued targets. Based on our experimental evidence, we suggest that gain modulation is the computational mechanism underlying the integration of spatial and contextual information for flexible, rule-driven stimulus-response mapping, and thereby forms an important basis of goal-directed behavior. Complementary contextual effects in PRR versus PMd are consistent with the idea that posterior parietal cortex preferentially represents sensory-driven, "automatic" motor goals, whereas frontal sensorimotor areas are stronger engaged in the representation of rule-based, "inferred" motor goals.