Action Selection in Everyday Activities: The Opportunistic Planning Model

While action selection strategies in well-defined domains have received considerable attention, little is yet known about how people choose what to do next in ill-defined tasks. In this contribution, we shed light on this issue by considering everyday tasks, which in many cases have a multitude of possible solutions (e.g., it does not matter in which order the items are brought to the table when setting a table) and are thus categorized as ill-defined problems. Even if there are no hard constraints on the ordering of subtasks in everyday activities, our research shows that people exhibit specific preferences. We propose that these preferences arise from bounded rationality, that is, people only have limited knowledge and processing power available, which results in a preference to minimize the overall physical and cognitive effort. In the context of everyday activities, this can be achieved by (a) taking properties of the spatial environment into account to use them to one's advantage, and (b) employing a stepwise-optimal action selection strategy. We present the Opportunistic Planning Model as an explanatory cognitive model, which instantiates these assumptions, and show that the model is able to generalize to new everyday tasks, outperforming machine learning models such as neural networks during generalization.

The effect of context and reason on the neural correlates of intentions

Many studies have identified networks in parietal and prefrontal cortex that are involved in intentional action. Yet, our understanding of the way these networks are involved in intentions is still very limited. In this study, we investigate two characteristics of these processes: context- and reason-dependence of the neural states associated with intentions. We ask whether these states depend on the context a person is in and the reasons they have for choosing an action. We used a combination of functional magnetic resonance imaging (fMRI) and multivariate decoding to directly assess the context- and reason-dependency of the neural states underlying intentions. We show that action intentions can be decoded from fMRI data based on a classifier trained in the same context and with the same reason, in line with previous decoding studies. Furthermore, we found that intentions can be decoded across different reasons for choosing an action. However, decoding across different contexts was not successful. We found anecdotal to moderate evidence against context-invariant information in all regions of interest and for all conditions but one. These results suggest that the neural states associated with intentions are modulated by the context of the action.

A biologically inspired decision-making system for the autonomous adaptive behavior of social robots

The decisions made by social robots while they fulfill their tasks have a strong influence on their performance. In these contexts, autonomous social robots must exhibit adaptive and social-based behavior to make appropriate decisions and operate correctly in complex and dynamic scenarios. This paper presents a Decision-Making System for social robots working on long-term interactions like cognitive stimulation or entertainment. The Decision-making System employs the robot's sensors, user information, and a biologically inspired module to replicate how human behavior emerges in the robot. Besides, the system personalizes the interaction to maintain the users' engagement while adapting to their features and preferences, overcoming possible interaction limitations. The system evaluation was in terms of usability, performance metrics, and user perceptions. We used the Mini social robot as the device where we integrated the architecture and carried out the experimentation. The usability evaluation consisted of 30 participants interacting with the autonomous robot in 30 min sessions. Then, 19 participants evaluated their perceptions of robot attributes of the Godspeed questionnaire by playing with the robot in 30 min sessions. The participants rated the Decision-making System with excellent usability (81.08 out of 100 points), perceiving the robot as intelligent (4.28 out of 5), animated (4.07 out of 5), and likable (4.16 out of 5). However, they also rated Mini as unsafe (security perceived as 3.15 out of 5), probably because users could not influence the robot's decisions.

Congruent action context releases Mu rhythm desynchronization when visual objects activate competing action representations

Recent findings demonstrated that object perception is affected by the competition between action representations. Simultaneous activation of distinct structural ("grasp-to-move") and functional ("grasp-to-use") action representations slows down perceptual judgements on objects. At the brain level, competition reduces motor resonance effects during manipulable object perception, reflected by an extinction of μ rhythm desynchronization. However, how this competition is solved in the absence of object-directed action remains unclear. The present study investigates the role of context in the resolution of the competition between conflicting action representations during mere object perception. To this aim, thirty-eight volunteers were instructed to perform a reachability judgment task on 3D objects presented at different distances in a virtual environment. Objects were conflictual objects associated with distinct structural and functional action representations. Verbs were used to provide a neutral or congruent action context prior or after object presentation. Neurophysiological correlates of the competition between action representation were recorded using EEG. The main result showed a release of μ rhythm desynchronization when reachable conflictual objects were presented with a congruent action context. Context influenced μ rhythm desynchronization when the action context was provided prior or after object presentation in a time-window compatible with object-context integration (around 1000 ms after the presentation of the first stimulus). These findings revealed that action context biases competition between co-activated action representations during mere object perception and demonstrated that μ rhythm desynchronization may be an index of activation but also competition between action representations in perception.

Relevant factors for arm choice in reaching movement: a scoping review

[Purpose] Arm choice is an unconscious action selection performed in daily life. Even if hemiparetic stroke patients can use their paretic arm, they compensate for their movements with their non-paretic arm, leading to decreased function of their paretic arm. Therefore, we need to encourage stroke patients to actively use their paretic arm. For this purpose, it is imperative to understand the process of selection of the left or right hand by patients. Here, we conducted a scoping review to summarize the findings of previous studies on factors and brain regions related to choice of arm. [Methods] We used PubMed/Medline, EBSCO, and the Cochrane Library to obtain research literature according to the PRISMA Extension for Scoping Reviews guidelines. [Results] Twenty-five of the 81 articles obtained from the search met the defined criteria. Cost, success, and dominance were investigated as relevant factors for arm choice. We also extracted articles examining the relationship between the posterior parietal and premotor cortex activity and arm choice. [Conclusion] From these results, we considered ways to facilitate the use of the paretic arm, such as the use of virtual reality systems or exoskeletal robots to modulate the reaching cost and success rates, or non-invasive brain stimulation methods to modulate brain activity.

The central extended amygdala guides survival-relevant tradeoffs: Implications for understanding common psychiatric disorders

To thrive in challenging environments, individuals must pursue rewards while avoiding threats. Extensive studies in animals and humans have identified the central extended amygdala (EAc)-which includes the central nucleus of the amygdala (Ce) and bed nucleus of the stria terminalis (BST)-as a conserved substrate for defensive behavior. These studies suggest the EAc influences defensive responding and assembles fearful and anxious states. This has led to the proliferation of a view that the EAc is fundamentally a defensive substrate. Yet mechanistic work in animals has implicated the EAc in numerous appetitive and consummatory processes, yielding fresh insights into the microcircuitry of survival- and emotion-relevant response selection. Coupled with the EAc's centrality in a conserved network of brain regions that encode multisensory environmental and interoceptive information, these findings suggest a broader role for the EAc as an arbiter of survival- and emotion-relevant tradeoffs for action selection. Determining how the EAc optimizes these tradeoffs promises to improve our understanding of common psychiatric illnesses such as anxiety, depression, alcohol- and substance-use disorders, and anhedonia.

Action selection in risk assessment with fuzzy Fine-Kinney-based AHP-TOPSIS approach: a case study in gas plant

In this study, the hazards occurring in a medium-sized gas filling facility were defined, and the risk scores of these hazards were determined by the expert team according to the Fine-Kinney risk analysis method. However, since the same risk significance score is obtained in different combinations of scale values in the classical Fine-Kinney risk analysis method and the characteristics/constraints of the company applied in the risk analysis are not taken into account, the hazards were evaluated using fuzzy Fine-Kinney risk analysis, and the most critical hazards were determined. Action plans are defined for critical hazards determined as a result of fuzzy Fine-Kinney risk analysis. Among the actions that require company resources, the action selection was performed with the TOPSIS method, taking into account their relationship with the hazards by integrating the weights, which was calculated with the AHP method, of affected groups. The effect of operating constraints is included in the last step of the study to calculate the final weights. Calculating the results by including the risk-affected groups and company constraints and ranking the actions reveals that the study is an original, objective, and applicable study.

Neural Control of Action Selection Among Innate Behaviors

Nervous systems must not only generate specific adaptive behaviors, such as reproduction, aggression, feeding, and sleep, but also select a single behavior for execution at any given time, depending on both internal states and external environmental conditions. Despite their tremendous biological importance, the neural mechanisms of action selection remain poorly understood. In the past decade, studies in the model animal Drosophila melanogaster have demonstrated valuable neural mechanisms underlying action selection of innate behaviors. In this review, we summarize circuit mechanisms with a particular focus on a small number of sexually dimorphic neurons in controlling action selection among sex, fight, feeding, and sleep behaviors in both sexes of flies. We also discuss potentially conserved circuit configurations and neuromodulation of action selection in both the fly and mouse models, aiming to provide insights into action selection and the sexually dimorphic prioritization of innate behaviors.

Dorsal visual stream is preferentially engaged during externally guided action selection in Parkinson Disease

OBJECTIVE

In patients with Parkinson Disease (PD), self-imitated or internally cued (IC) actions are thought to be compromised by the disease process, as exemplified by impairments in action initiation. In contrast, externally-cued (EC) actions which are made in response to sensory prompts can restore a remarkable degree of movement capability in PD, particularly alleviating freezing-of-gait. This study investigates the electrophysiological underpinnings of movement facilitation in PD through visuospatial cuing, with particular attention to the dynamics within the posterior parietal cortex (PPC) and lateral premotor cortex (LPMC) axis of the dorsal visual stream.

METHODS

Invasive cortical recordings over the PPC and LPMC were obtained during deep brain stimulation lead implantation surgery. Thirteen PD subjects performed an action selection task, which was constituted by left or right joystick movement with directional visual cuing in the EC condition and internally generated direction selection in the IC condition. Time-resolved neural activities within and between the PPC and LPMC were compared between EC and IC conditions.

RESULTS

Reaction times (RT) were significantly faster in the EC condition relative to the IC condition (paired t-test, p = 0.0015). PPC-LPMC inter-site phase synchrony within the β-band (13-35 Hz) was significantly greater in the EC relative to the IC condition. Greater PPC-LPMC β debiased phase lag index (dwPLI) prior to movement onset was correlated with faster reaction times only in the EC condition. Multivariate granger causality (GC) was greater in the EC condition relative to the IC condition, prior to and during movement.

CONCLUSION

Relative to IC actions, we report relative increase in inter-site phase synchrony and directional PPC to LPMC connectivity in the β-band during preparation and execution of EC actions. Furthermore, increased strength of connectivity is predictive of faster RT, which are pathologically slow in PD patients. Stronger engagement of the PPC-LPMC cortical network by an EC specifically through the channel of β-modulation is implicated in correcting the pathological slowing of action initiation seen in Parkinson's patients.

SIGNIFICANCE

These findings shed light on the electrophysiological mechanisms that underlie motor facilitation in PD patients through visuospatial cuing.

Inferior parietal lobule involved in representation of "what" in a delayed-action Libet task

Intentional motor action is typically characterized by the decision about the timing, and the selection of the action variant, known as the "what" component. We compared free action selection with instructed action, where the movement type was externally cued, in order to investigate the action selection and action representation in a Libet's task. Temporal and spatial locus of these processes was examined using the combination of high-density electroencephalography, topographic analysis of variance, and source reconstruction. Instructed action, engaging representation of the response movement, was associated with distinct negativity at the parietal and centro-parietal channels starting around 750 ms before the movement, which has a source particularly in the bilateral inferior parietal lobule. This suggests that in delayed-action tasks, the process of action representation in the inferior parietal lobule may play an important part in the larger parieto-frontal activity responsible for movement selection.

The cone method: Inferring decision times from single-trial 3D movement trajectories in choice behavior

Ongoing goal-directed movements can be rapidly adjusted following new environmental information, e.g., when chasing pray or foraging. This makes movement trajectories in go-before-you-know decision-making a suitable behavioral readout of the ongoing decision process. Yet, existing methods of movement analysis are often based on statistically comparing two groups of trial-averaged trajectories and are not easily applied to three-dimensional data, preventing them from being applicable to natural free behavior. We developed and tested the cone method to estimate the point of overt commitment (POC) along a single two- or three-dimensional trajectory, i.e., the position where the movement is adjusted towards a newly selected spatial target. In Experiment 1, we established a “ground truth” data set in which the cone method successfully identified the experimentally constrained POCs across a wide range of all but the shallowest adjustment angles. In Experiment 2, we demonstrate the power of the method in a typical decision-making task with expected decision time differences known from previous findings. The POCs identified by cone method matched these expected effects. In both experiments, we compared the cone method’s single trial performance with a trial-averaging method and obtained comparable results. We discuss the advantages of the single-trajectory cone method over trial-averaging methods and possible applications beyond the examples presented in this study. The cone method provides a distinct addition to existing tools used to study decisions during ongoing movement behavior, which we consider particularly promising towards studies of non-repetitive free behavior.

Do restrictions of action selection decrease the sense of agency?

The experience of being an intentional agent is a key component of personal autonomy. Here, we tested how undermining intentional action affects the sense of agency as indexed by intentional binding. In three experiments using the Libet clock paradigm, participants judged the onset of their action (key presses) and resulting effect (auditory stimuli) under conditions of no, partial, or full autonomy over selecting and timing their actions. In all cases, we observed a moderate to strong intentional binding effect. However, we found no evidence for an influence of personal autonomy on intentional binding. These findings thus suggest that being unable to decide how and when to perform actions does not affect the perceived temporal binding between action and effect, a phenomenon suggested to be associated with the implicit sense of agency. We discuss the implications of our findings in the context of research on personal autonomy and goal-directed behavior.

Dorsomedial striatal contributions to different forms of risk/reward decision making

Optimal decision making involving reward uncertainty is integral to adaptive goal-directed behavior. In some instances, these decisions are guided by internal representations of reward history, whereas in other situations, external cues inform a decision maker about how likely certain actions are to yield reward. Different regions of the frontal lobe form distributed networks with striatal and amygdalar regions that facilitate different types of risk/reward decision making. The dorsal medial striatum (DMS) is one key output region of the prefrontal cortex, yet there have been few preclinical studies investigating the involvement of the DMS in different forms of risk/reward decision making. The present study addressed this issue, wherein separate groups of male rats were trained on one of two tasks where they chose between a small/certain or a large/risky reward. In a probabilistic discounting task, reward probabilities changed systematically over blocks of trials (100-6.25% or 6.25-100%), requiring rats to use internal representations of reward history to guide choice. Cue-guided decision-making was assessed with a "Blackjack" task, where different auditory cues indicated the odds associated with the large/risky option (50 or 12.5%). Inactivation of the DMS with GABA agonists impaired adjustments in choice biases during probabilistic discounting, resulting in either increases or decreases in risky choice as the probabilities associated with the large/risky reward decreased or increased over a session. In comparison, DMS inactivation increased risky choices on poor-odds trials on the Blackjack task, which was associated with a reduced impact that non-rewarded choices had on subsequent choices. DMS inactivation also impaired performance of an auditory conditional discrimination. These findings highlight a previously uncharacterized role for the DMS in facilitating flexible action selection during multiple forms of risk/reward decision making.

Psychological mechanisms and functions of 5-HT and SSRIs in potential therapeutic change: Lessons from the serotonergic modulation of action selection, learning, affect, and social cognition

Uncertainty regarding which psychological mechanisms are fundamental in mediating SSRI treatment outcomes and wide-ranging variability in their efficacy has raised more questions than it has solved. Since subjective mood states are an abstract scientific construct, only available through self-report in humans, and likely involving input from multiple top-down and bottom-up signals, it has been difficult to model at what level SSRIs interact with this process. Converging translational evidence indicates a role for serotonin in modulating context-dependent parameters of action selection, affect, and social cognition; and concurrently supporting learning mechanisms, which promote adaptability and behavioural flexibility. We examine the theoretical basis, ecological validity, and interaction of these constructs and how they may or may not exert a clinical benefit. Specifically, we bridge crucial gaps between disparate lines of research, particularly findings from animal models and human clinical trials, which often seem to present irreconcilable differences. In determining how SSRIs exert their effects, our approach examines the endogenous functions of 5-HT neurons, how 5-HT manipulations affect behaviour in different contexts, and how their therapeutic effects may be exerted in humans - which may illuminate issues of translational models, hierarchical mechanisms, idiographic variables, and social cognition.

Reward-driven enhancements in motor control are robust to TMS manipulation

A wealth of evidence describes the strong positive impact that reward has on motor control at the behavioural level. However, surprisingly little is known regarding the neural mechanisms which underpin these effects, beyond a reliance on the dopaminergic system. In recent work, we developed a task that enabled the dissociation of the selection and execution components of an upper limb reaching movement. Our results demonstrated that both selection and execution are concommitently enhanced by immediate reward availability. Here, we investigate what the neural underpinnings of each component may be. To this end, we aimed to alter the cortical excitability of the ventromedial prefrontal cortex and supplementary motor area using continuous theta-burst transcranial magnetic stimulation (cTBS) in a within-participant design (N = 23). Both cortical areas are involved in determining an individual’s sensitivity to reward and physical effort, and we hypothesised that a change in excitability would result in the reward-driven effects on action selection and execution to be altered, respectively. To increase statistical power, participants were pre-selected based on their sensitivity to reward in the reaching task. While reward did lead to enhanced performance during the cTBS sessions and a control sham session, cTBS was ineffective in altering these effects. These results may provide evidence that other areas, such as the primary motor cortex or the premotor area, may drive the reward-based enhancements of motor performance.

The role of different directions of attention on the extent of implicit perception in soccer penalty kicking

The role of different directions of attention on the extent of the off-center effect (penalty takers kick to the bigger side of the goal more often, although they explicitly perceive the goalkeeper in the center of the goal) was investigated for soccer penalty kicking. Regarding the directions of attention of the striker, two conflicting assumptions (attention is paid to the goalkeeper vs. attention is only spent on target) were directly contrasted. Participants viewed a goalkeeper standing either in the middle of the goal or being displaced by different distances to the left or right. In the goal-side-related instruction condition, participants had to indicate the greater goal side and already did so at above chance-level for small displacements of 0.1%, although they were not confident in their perceptual judgments, hinting at the occurrence of the off-center effect. They became mindful of displacements of 0.8% and larger when they indicated the goal side for kicking with greater confidence. In the goalkeeper-related instruction condition, participants were asked to choose a goal side for kicking, but only when they perceived the goalkeeper in the middle of the goal. Participants chose the greater goal side at above chance-level for small displacements of 0.2%. They became mindful of the displacement for a difference of 0.8%. However, when comparing the results of both instruction conditions statistically it turned out that the effect of different directions of attention on the off-center's extent differs from those previously reported. Participants were implicitly influenced by comparably small goalkeeper displacements, but became earlier aware of goalkeeper displacements in the goal-side-related instruction condition.

Computational Dissociation of Dopaminergic and Cholinergic Effects on Action Selection and Inhibitory Control

BACKGROUND

Patients with schizophrenia make more errors than healthy subjects in the antisaccade task. In this paradigm, participants are required to inhibit a reflexive saccade to a target and to select the correct action (a saccade in the opposite direction). While the precise origin of this deficit is not clear, it has been connected to aberrant dopaminergic and cholinergic neuromodulation.

METHODS

To study the impact of dopamine and acetylcholine on inhibitory control and action selection, we administered two selective drugs (levodopa 200 mg/galantamine 8 mg) to healthy volunteers (N = 100) performing the antisaccade task. The computational model SERIA (stochastic early reaction, inhibition, and late action) was employed to separate the contribution of inhibitory control and action selection to empirical reaction times and error rates.

RESULTS

Modeling suggested that levodopa improved action selection (at the cost of increased reaction times) but did not have a significant effect on inhibitory control. By contrast, according to our model, galantamine affected inhibitory control in a dose-dependent fashion, reducing inhibition failures at low doses and increasing them at higher levels. These effects were sufficiently specific that the computational analysis allowed for identifying the drug administered to an individual with 70% accuracy.

CONCLUSIONS

Our results do not support the hypothesis that elevated tonic dopamine strongly impairs inhibitory control. Rather, levodopa improved the ability to select correct actions. However, inhibitory control was modulated by cholinergic drugs. This approach may provide a starting point for future computational assays that differentiate neuromodulatory abnormalities in heterogeneous diseases like schizophrenia.

Reduced competition between tool action neighbors in left hemisphere stroke

When pantomiming the use of tools, patients with limb apraxia after left hemisphere stroke (LCVA) produce more spatiotemporal hand action errors with tools associated with conflicting actions for use versus grasp-to-pick-up (e.g., corkscrew) than tools having a single action for both use and grasp (e.g., hammer). There are two possible accounts for this pattern of results. Reduced performance with 'conflict' tools may simply reflect weakened automaticity of use action activation, which is evident only when the use and grasp actions are not redundant. Alternatively, poor use performance may reflect a reduced ability of appropriate tool use actions to compete with task-inappropriate action representations. To address this issue, we developed a Stroop-like experiment in which 21 LCVA and 8 neurotypical participants performed pantomime actions in blocks containing two tools that were similar ("neighbors") in terms of hand action or function, or were unrelated on either dimension. In a congruent condition, they pantomimed the use action associated with the visually presented tool, whereas in an incongruent condition, they pantomimed the use action for the other tool in the block. Relative to controls and other task conditions, LCVA participants showed reductions in hand action errors in incongruent relative to congruent action trials; furthermore, the degree of reduction in this incongruence effect was related to the participants' susceptibility to grasp-on-use conflict in a separate test of pantomime to the sight of tools. Support vector regression lesion-symptom mapping analyses identified the left inferior frontal gyrus, supramarginal gyrus, and superior longitudinal fasciculus as core neuroanatomical sites associated with abnormal performance. Collectively, the results indicate that weakened activation of tool use actions in limb apraxia gives rise to reduced ability of these actions to compete for task-appropriate selection when competition arises within single tools (grasp-on-use conflict) as well as between two tools (reduced neighborhood effects).

Embodied gestalts: Unstable visual phenomena become stable when they are stimuli for competitive action selection

An animal's environment is rich with affordances. Different possible actions are specified by visual information while competing for dominance over neural dynamics. Affordance competition models account for this in terms of winner-takes-all cross-inhibition dynamics. Multistable phenomena also reveal how the visual system deals with ambiguity. Their key property is spontaneous instability, in forms such as alternating dominance in binocular rivalry. Theoretical models of self-inhibition or self-organized instability posit that the instability is tied to some kind of neural adaptation and that its functional significance is to enable flexible perceptual transitions. We hypothesized that the two perspectives are interlinked. Spontaneous instability is an intrinsic property of perceptual systems, but it is revealed when they are stripped from the constraints of possibilities for action. To test this, we compared a multistable gestalt phenomenon against its embodied version and estimated the neural adaptation and competition parameters of an affordance transition dynamic model. Wertheimer's (Zeitschrift fur Psychologie 61, 161-265, 1912) optimal (β) and pure (φ) forms of apparent motion from a stroboscopic point-light display were endowed with action relevance by embedding the display in a visual object-tracking task. Thus, each mode was complemented by its action, because each perceptual mode uniquely enabled different ways of tracking the target. Perceptual judgment of the traditional apparent motion exhibited spontaneous instabilities, in the form of earlier switching when the frame rate was changed stepwise. In contrast, the embodied version exhibited hysteresis, consistent with affordance transition studies. Consistent with our predictions, the parameter for competition between modes in the affordance transition model increased, and the parameter for self-inhibition vanished.

When robots tell you what to do: Sense of agency in human- and robot-guided actions

The present study investigated the sense of agency (SoA) when actions were determined by another human vs. a humanoid robot as compared to when freely selected. Additionally, perceived robot-autonomy was manipulated via autonomous vs. non-autonomous descriptions of the robot. SoA was assessed by judgment of control ratings and intentional binding (i.e., perceived temporal attraction between voluntary actions and their outcomes). Participants performed free and instructed key presses that produced an auditory tone (Experiment-1) and visual stimuli conveying neutral, positive, or negative valence (Experiment-2). Binding and control ratings were greater in free compared to instructed actions, and comparable between human- and robot-instructed actions. Control ratings were higher for positive compared to neutral and negative outcomes, and positively correlated with ratings of how human-like the robot appeared. These results highlight the role of endogenous processing of action selection and provide preliminary insight into the SoA when actions are guided by artificial agents.

Now and then: Hand choice is influenced by recent action history

Action choices are influenced by recent past and predicted future action states. Here, we demonstrate that recent hand-choice history affects both current hand choices and response times to initiate actions. Participants reach to contact visible targets using one hand. Hand choice is biased in favour of which hand was used recently, in particular, when the biomechanical costs of responding with either hand are similar, and repeated choices lead to reduced response times. These effects are also found to positively correlate. Participants who show strong effects of recent history on hand choice also tend to show strong effects of recent history on response times. The data are consistent with a computational efficiency interpretation whereby repeated action choices confer computational gains in the efficiency of underpinning processes. We discuss our results within the framework of this model, and with respect to balancing predicted gains and losses, and speculate about the possible underlying mechanisms in neural terms.

Preparatory inhibition: Impact of choice in reaction time tasks

By applying transcranial magnetic stimulation (TMS) over primary motor cortex (M1) to elicit motor-evoked potentials (MEPs) in muscles of the contralateral hand during reaction time (RT) tasks, many studies have reported a strong global suppression of motor excitability during action preparation, a phenomenon called preparatory inhibition. Several hypotheses have been put forward regarding the role of this broad suppression, with the predominant view that it reflects inhibitory processes assisting action selection. However, this assumption is still a matter of debate. Here, we aimed at directly addressing this idea by comparing MEPs in a task that required subjects to select a finger response within a set of predefined options (choice RT task: left or right index finger abduction) or when subjects simply had to provide the same finger response on every trial, in the absence of choice (simple RT task). Moreover, we minimized any effect that could be associated with other forms of inhibition. In both versions of the task, TMS was applied on both M1 (double-coil protocol) at several time points between the go signal and the left or right index finger response, eliciting MEPs bilaterally in the prime mover (index finger agonist) and in an irrelevant muscle (pinky agonist). Overall, MEP suppression was moderate in this study compared to past research; it was only found for the irrelevant muscle. As such, MEPs in the index agonist were facilitated when elicited in a responding hand (e.g. left MEPs preceding left responses) and remained mostly unchanged in a non-responding hand (e.g. left MEPs preceding right responses). In contrast, MEPs were almost always suppressed in the pinky muscle when elicited in the non-responding hand. This finding contrasts with previous studies where preparatory inhibition usually concerns both relevant and irrelevant muscles. Yet importantly, the suppression was more consistent in the choice than in the simple RT task, supporting the view that preparatory inhibition may assist action selection.

An examination of the sequential trial effect on experiences of agency in the Simon task

Previous research shows that agency experiences are reduced when response selection is dysfluent. Expanding on this work, we report two experiments addressing the influence of Simon response conflict on agency. Participants responded to congruent and incongruent Simon task trials and indicated their experienced agency after each response. Results show that incongruent trials were related to reduced agency experiences, thus replicating earlier work on the response-selection agency-link. Furthermore, the data further showed an interesting sequence effect: The congruency effect on experienced agency mainly emerged when a trial was preceded by a congruent trial. There was however no congruency effect on experienced agency when a trial was preceded by an incongruent trial. These findings are briefly discussed in the context of research on response selection and experiences of agency.

Roles for globus pallidus externa revealed in a computational model of action selection in the basal ganglia

The basal ganglia are considered vital to action selection - a hypothesis supported by several biologically plausible computational models. Of the several subnuclei of the basal ganglia, the globus pallidus externa (GPe) has been thought of largely as a relay nucleus, and its intrinsic connectivity has not been incorporated in significant detail, in any model thus far. Here, we incorporate newly revealed subgroups of neurons within the GPe into an existing computational model of the basal ganglia, and investigate their role in action selection. Three main results ensued. First, using previously used metrics for selection, the new extended connectivity improved the action selection performance of the model. Second, low frequency theta oscillations were observed in the subpopulation of the GPe (the TA or 'arkypallidal' neurons) which project exclusively to the striatum. These oscillations were suppressed by increased dopamine activity - revealing a possible link with symptoms of Parkinson's disease. Third, a new phenomenon was observed in which the usual monotonic relationship between input to the basal ganglia and its output within an action 'channel' was, under some circumstances, reversed. Thus, at high levels of input, further increase of this input to the channel could cause an increase of the corresponding output rather than the more usually observed decrease. Moreover, this phenomenon was associated with the prevention of multiple channel selection, thereby assisting in optimal action selection. Examination of the mechanistic origin of our results showed the so-called 'prototypical' GPe neurons to be the principal subpopulation influencing action selection. They control the striatum via the arkypallidal neurons and are also able to regulate the output nuclei directly. Taken together, our results highlight the role of the GPe as a major control hub of the basal ganglia, and provide a mechanistic account for its control function.

The neural basis of hand choice: An fMRI investigation of the Posterior Parietal Interhemispheric Competition model

The current study investigates a new neurobiological model of human hand choice: The Posterior Parietal Interhemispheric Competition (PPIC) model. The model specifies that neural populations in bilateral posterior intraparietal and superior parietal cortex (pIP-SPC) encode actions in hand-specific terms, and compete for selection across and within hemispheres. Actions with both hands are encoded bilaterally, but the contralateral hand is overrepresented. We use a novel fMRI paradigm to test the PPIC model. Participants reach to visible targets while in the scanner, and conditions involving free choice of which hand to use (Choice) are compared with when hand-use is instructed. Consistent with the PPIC model, bilateral pIP-SPC is preferentially responsive for the Choice condition, and for actions made with the contralateral hand. In the right pIP-SPC, these effects include anterior intraparietal and superior parieto-occipital cortex. Left dorsal premotor cortex, and an area in the right lateral occipitotemporal cortex show the same response pattern, while the left inferior parietal lobule is preferentially responsive for the Choice condition and when using the ipsilateral hand. Behaviourally, hand choice is biased by target location - for targets near the left/right edges of the display, the hand in ipsilateral hemispace is favoured. Moreover, consistent with a competitive process, response times are prolonged for choices to more ambiguous targets, where hand choice is relatively unbiased, and fMRI responses in bilateral pIP-SPC parallel this pattern. Our data provide support for the PPIC model, and reveal a selective network of brain areas involved in free hand choice, including bilateral posterior parietal cortex, left-lateralized inferior parietal and dorsal premotor cortices, and the right lateral occipitotemporal cortex.

Circuit architecture for somatotopic action selection in invertebrates

Invertebrate species have significantly contributed to neuroscience owing to the accessibility they provide to cellular- and molecular-level understanding of brain functions. Somatotopic action selection is one of the key features of animal behavior, and studying this process in invertebrates is potentially a sweet spot in understanding the general relationship between neuronal morphology, circuit structure, and animal behavior. In this review, we introduce circuit architectures that realize somatotopic action selection, from simple reflexes to patterned motor outputs, in different invertebrate species. We then discuss future directions towards understanding the general principles underlying the development and evolution of the circuit architecture that enables sensorimotor transformation and action selection in the animal kingdom.

A novel assay to evaluate action selection in escape behavior

BACKGROUND

How experience and individuality shape action selection remains a major question in neuroscience. Visually-evoked escape behavior within Drosophila melanogaster provides a robust model to study these mechanisms within neural circuits but requires novel assays to circumvent limitations of current behavior assays.

METHOD

Here we describe and characterize a simple, low to moderate cost, and flexible assay for studying visually-evoked escape responses in tethered flies. This assay consists of a DLP projector, cylindrical rear projection screen, and an automated flight interruption motor all controlled within a MATLAB environment.

RESULTS

We find this assay effectively recapitulates fly behaviors previously observed in free behavior assays, and provides a novel opportunity to investigate the behavior of individual flies over the course of numerous stimulus presentations.

COMPARISON TO EXISTING METHODS

Current Drosophila escape assays do not permit multiple stimulus presentations and can be highly complex and expensive to implement.

CONCLUSIONS

This assay provides an effective system to further identify neural components and mechanisms underlying action selection within parallel sensorimotor pathways.

Specificity of action selection modulates the perceived temporal order of action and sensory events

The perceived temporal order of actions and changes in the environment is crucial for our inferences of causality. Sensory events presented shortly after an action are more likely considered as self-generated compared to the same events occurring before action execution. However, the estimation of when an action or a sensory change occurred is a challenge for the human brain. This estimation is formed from available sensory information combined with internal representations. Researchers suggested that internal signals associated with action preparation drive our awareness of initiating an action. This study aimed to directly investigate this hypothesis. Participants performed a speeded action (left or right key-press) in response to a go-signal (left or right arrow). A flash was presented at different time points around the time of the action, and participants judged whether it was simultaneous with the action or not. To investigate the role of action preparation in time perception, we compared trials where a cue indicated which action to perform in response to a later go signal presentation, and trials with a neutral cue where participants did not know until the time of the go signal which action to perform. We observed that a flash presented before the action was reported as simultaneous with the action more frequently when actions were cued than when they were uncued. This difference was not observed when the action was replaced by a tactile stimulation. These results indicate that precued actions are experienced earlier in time compared to unprepared actions. Further, this difference is not due to mere non-motor expectation of an event. The experience of initiating an action is driven by action preparation process: when we know what to do, actions are perceived ahead of time.

The effects of freedom of choice in action selection on perceived mental effort and the sense of agency

Previous research showed that increasing the number of action alternatives enhances the sense of agency (SoA). Here, we investigated whether choice space could affect subjective judgments of mental effort experienced during action selection and examined the link between subjective effort and the SoA. Participants performed freely selected (among two, three, or four options) and instructed actions that produced pleasant or unpleasant tones. We obtained action-effect interval estimates to quantify intentional binding - the perceived interval compression between actions and outcomes and feeling of control (FoC) ratings. Additionally, participants reported the degree of mental effort they experienced during action selection. We found that both binding and FoC were systematically enhanced with increasing choice-level. Outcome valence did not influence binding, while FoC was stronger for pleasant than unpleasant outcomes. Finally, freely chosen actions were associated with low subjective effort and slow responses (i.e., higher reaction times), and instructed actions were associated with high effort and fast responses. Although the conditions that yielded the greatest and least subjective effort also yielded the greatest and least binding and FoC, there was no significant correlation between subjective effort and SoA measures. Overall, our results raise interesting questions about how agency may be influenced by response selection demands (i.e., indexed by speed of responding) and subjective mental effort. Our work also highlights the importance of understanding how subjective mental effort and response speed are related to popular notions of fluency in response selection.

Contributions of the parietal cortex to increased efficiency of planning-based action selection

Response selection is foundational to adaptive behavior, and considerable attention has been devoted to investigating this behavior under conditions in which the mapping between stimuli and responses is fixed. Results from prior studies implicate the left supramarginal gyrus (SMg), premotor and prefrontal cortices, as well as the cerebellum in this essential function. Yet, many goal-directed motor behaviors have multiple solutions with flexible mappings between stimuli and responses whose solutions are believed to involve prospective planning. Studies of selection under conditions of flexible mappings also reveal involvement of the left SMg, as well as bilateral premotor, superior parietal cortex (SPL) and pre-supplementary motor (pre-SMA) cortices, along with the cerebellum. This evidence is, however, limited by exclusive reliance on tasks that involve selection in the absence of overt action execution and without complete control of possible confounding effects related to differences in stimulus and response processing demands. Here, we address this limitation through use of a novel fMRI repetition suppression (FMRI-RS) paradigm. In our prime-probe design, participants select and overtly pantomime manual object rotation actions when the relationship between stimuli and responses is either flexible (experimental condition) or fixed (control condition). When trials were repeated in prime-probe pairs of the experimental condition, we detected improvements in performance accompanied by a significant suppression of blood oxygen-level dependent (BOLD) responses in: left SMg extending into and along the length of the intraparietal sulcus (IPS), right IPS, bilateral caudal superior parietal lobule (cSPL), dorsal premotor cortex (dPMC), pre-SMA, and in the lateral cerebellum. Further, region-of-interest analyses revealed interaction effects of fMRI-RS in the experimental versus control condition within left SMg and cerebellum, as well as in bilateral caudal SPL. These efficiency effects cannot be attributed to the repetition of stimulus or response processing, but instead are planning-specific and generally consistent with earlier findings from conventional fMRI investigations. We conclude that repetition-related increases in the efficiency of planning-based selection appears to be associated with parieto-cerebellar networks.

Motor decisions are not black and white: selecting actions in the "gray zone"

In many situations, multiple actions are possible to achieve a goal. How do people select a particular action among equally possible alternatives? In six experiments, we determined whether action selection is consistent and biased toward one decision by observing participants' decisions to go over or under a horizontal bar set at varying heights. We assessed the height at which participants transitioned from going over to under the bar within a "gray zone"-the range of bar heights at which going over and under were both possible. In Experiment 1, participants' transition points were consistently located near the upper boundary of the gray zone, indicating a bias to go over rather than under the bar. Moreover, transitional behaviors were clustered tightly into a small region, indicating that decisions were highly consistent. Subsequent experiments examined potential influences on action selection. In Experiment 2, participants wore ankle weights to increase the cost of going over the bar. In Experiment 3, they were tested on a padded surface that made crawling under the bar more comfortable. In Experiment 4, we introduced a secondary task that required participants to crawl immediately after navigating the bar. None of these manipulations altered participants' decisions relative to Experiment 1. In Experiment 5, participants started in a crawling position, which led to significantly lower transition points. In Experiment 6, we tested 5- to 6-year-old children as in Experiment 1 to determine the effects of social pressure on action selection. Children displayed lower transition points, larger transition regions, and reduced ability to go over the bar compared to adults. Across experiments, results indicate that adults have a strong and robust bias for upright locomotion.

Speeded saccadic and manual visuo-motor decisions: Distinct processes but same principles

•

Core architecture of visuo-motor selection model generalises across effectors.

•

Hand and eyes show very different response times, but similar decision times.

•

Longer non-decision time for visuo-manual responses accounts for longer response times.

•

Stronger faster transient visual inputs for saccades account for different selection dynamics.

Action decisions are considered an emergent property of competitive response activations. As such, decision mechanisms are embedded in, and therefore may differ between, different response modalities. Despite this, the saccadic eye movement system is often promoted as a model for all decisions, especially in the fields of electrophysiology and modelling. Other research traditions predominantly use manual button presses, which have different response distribution profiles and are initiated by different brain areas. Here we tested whether core concepts of action selection models (decision and non-decision times, integration of automatic and selective inputs to threshold, interference across response options, noise, etc.) generalise from saccadic to manual domains. Using two diagnostic phenomena, the remote distractor effect (RDE) and ‘saccadic inhibition', we find that manual responses are also sensitive to the interference of visual distractors but to a lesser extent than saccades and during a shorter time window. A biologically-inspired model (DINASAUR, based on non-linear input dynamics) can account for both saccadic and manual response distributions and accuracy by simply adjusting the balance and relative timings of transient and sustained inputs, and increasing the mean and variance of non-decisional delays for manual responses. This is consistent with known neurophysiological and anatomical differences between saccadic and manual networks. Thus core decision principles appear to generalise across effectors, consistent with previous work, but we also conclude that key quantitative differences underlie apparent qualitative differences in the literature, such as effects being robustly reported in one modality and unreliable in another.

Having control over the external world increases the implicit sense of agency

The sense of agency refers to the feeling of control over one's actions, and, through them, over external events. One proposed marker of implicit sense of agency is 'intentional binding'-the tendency to perceive voluntary actions and their outcomes as close in time. Another is attenuation of the sensory consequences of a voluntary action. Here we show that the ability to choose an outcome through action selection contributes to implicit sense of agency. We measured intentional binding and stimulus intensity ratings using painful and non-painful somatosensory outcomes. In one condition, participants chose between two actions with different probabilities of producing high or low intensity outcomes, so action choices were meaningful. In another condition, action selection was meaningless with respect to the outcome. Having control over the outcome increased binding, especially when outcomes were painful. Greater sensory attenuation also tended to be associated with stronger binding of the outcome towards the action that produced it. Previous studies have emphasised the link between sense of agency and initiation of voluntary motor actions. Our study shows that the ability to control outcomes by discriminative action selection is another key element of implicit sense of agency. It also investigates, for the first time, the relation between binding and sensory attenuation for the same events.

Primary motor cortex contributes to the implementation of implicit value-based rules during motor decisions

In the present study, we investigated the functional contribution of the human primary motor cortex (M1) to motor decisions. Continuous theta burst stimulation (cTBS) was used to alter M1 activity while participants performed a decision-making task in which the reward associated with the subjects' responses (right hand finger movements) depended on explicit and implicit value-based rules. Subjects performed the task over two consecutive days and cTBS occurred in the middle of Day 2, once the subjects were just about to implement implicit rules, in addition to the explicit instructions, to choose their responses, as evident in the control group (cTBS over the right somatosensory cortex). Interestingly, cTBS over the left M1 prevented subjects from implementing the implicit value-based rule while its implementation was enhanced in the group receiving cTBS over the right M1. Hence, cTBS had opposite effects depending on whether it was applied on the contralateral or ipsilateral M1. The use of the explicit value-based rule was unaffected by cTBS in the three groups of subject. Overall, the present study provides evidence for a functional contribution of M1 to the implementation of freshly acquired implicit rules, possibly through its involvement in a cortico-subcortical network controlling value-based motor decisions.

Hedonic quality or reward? A study of basic pleasure in homeostasis and decision making of a motivated autonomous robot

We present a robot architecture and experiments to investigate some of the roles that pleasure plays in the decision making (action selection) process of an autonomous robot that must survive in its environment. We have conducted three sets of experiments to assess the effect of different types of pleasure-related versus unrelated to the satisfaction of physiological needs-under different environmental circumstances. Our results indicate that pleasure, including pleasure unrelated to need satisfaction, has value for homeostatic management in terms of improved viability and increased flexibility in adaptive behavior.

Control feedback as the motivational force behind habitual behavior

Motivated behavior is considered to be a product of integration of a behavior's subjective benefits and costs. As such, it is unclear what motivates "habitual behavior" which occurs, by definition, after the outcome's value has diminished. One possible answer is that habitual behavior continues to be selected due to its "intrinsic" worth. Such an explanation, however, highlights the need to specify the motivational system for which the behavior has intrinsic worth. Another key question is how does an activity attain such intrinsically rewarding properties. In an attempt to answer both questions, we suggest that habitual behavior is motivated by the influence it brings over the environment-by the control motivation system, including "control feedback." Thus, when referring to intrinsic worth, we refer to a representation of an activity that has been reinforced due to it being effective in controlling the environment, managing to make something happen. As an answer to when does an activity attain such rewarding properties, we propose that this occurs when the estimated instrumental outcome expectancy of an activity is positive, but the precision of this expectancy is low. This lack of precision overcomes the chronic dominance of outcome feedback over control feedback in determining action selection by increasing the relative weight of the control feedback. Such a state of affairs will lead to repeated selection of control relevant behavior and entails insensitivity to outcome devaluation, thereby producing a habit.

Difficult action decisions reduce the sense of agency: A study using the Eriksen flanker task

The sense of agency refers to the feeling that we are in control of our actions and, through them, of events in the outside world. Much research has focused on the importance of retrospectively matching predicted and actual action outcomes for a strong sense of agency. Yet, recent studies have revealed that a metacognitive signal about the fluency of action selection can prospectively inform our sense of agency. Fluent, or easy, action selection leads to a stronger sense of agency over action outcomes than dysfluent, or difficult, selection. Since these studies used subliminal priming to manipulate action selection, it remained unclear whether supraliminal stimuli affecting action selection would have similar effects. We used supraliminal flankers to manipulate action selection in response to a central target. Experiment 1 revealed that conflict in action selection, induced by incongruent flankers and targets, led to reduced agency ratings over an outcome that followed the participant's response, relative to neutral and congruent flanking conditions. Experiment 2 replicated this result, and extended it to free choice between alternative actions. Finally, Experiment 3 varied the stimulus onset asynchrony (SOA) between flankers and target. Action selection performance varied with SOA. Agency ratings were always lower in incongruent than congruent trials, and this effect did not vary across SOAs. Sense of agency is influenced by a signal that tracks conflict in action selection, regardless of the visibility of stimuli inducing conflict, and even when the timing of the stimuli means that the conflict may not affect performance.

Complex sensorimotor transformation processes required for response selection are facilitated by the striatum

Both fronto-parietal networks and the basal ganglia play an important role in action cascading. It is well-known that cortical structures mediate sensorimotor transformation for this purpose. The striatum receives extensive input from those cortical structures and has been shown to be modulated by the predictability of cortical input. Until today, it has however remained unclear whether the processing of spatial codes or even sensorimotor transformation processes for the purpose of action cascading involve the striatum. We therefore examined this question by means of fMRI using a stop-change task that varied the predictability as well as the complexity of sensorimotor transformations required for correct responding in the context of action cascading. On the behavioral level, we found that the complexity of sensorimotor transformation processes only prolonged reaction times when the requirement for this transformation was predictable. fMRI results matched this effect showing enhanced activity of the caudate in case a complex sensorimotor transformation could be anticipated. Irrespective of the complexity of the required transformations, the putamen was furthermore involved in the prediction of imminent action cascading demands. Taken together, our findings give rise to a conceptual advance regarding basal ganglia function by showing that the anticipation and, more importantly, processing of complex sensorimotor transformation processes involves the striatum.

Increased Reliance on Value-based Decision Processes Following Motor Cortex Disruption

BACKGROUND

During motor decision making, the neural activity in primary motor cortex (M1) encodes dynamically the competition occurring between potential action plans. A common view is that M1 represents the unfolding of the outcome of a decision process taking place upstream. Yet, M1 could also be directly involved in the decision process.

OBJECTIVE

Here we tested this hypothesis by assessing the effect of M1 disruption on a motor decision-making task.

METHODS

We applied continuous theta burst stimulation (cTBS) to inhibit either left or right M1 in different groups of subjects and included a third control group with no stimulation. Following cTBS, participants performed a task that required them to choose between two finger key-presses with the right hand according to both perceptual and value-based information. Effects were assessed by means of generalized linear mixed models and computational simulations.

RESULTS

In all three groups, subjects relied both on perceptual (P < 0.0001) and value-based information (P = 0.003) to reach a decision. Yet, left M1 disruption led to an increased reliance on value-based information (P = 0.03). This result was confirmed by a computational model showing an increased weight of the valued-based process on the right hand finger choices following left M1 cTBS (P < 0.01).

CONCLUSION

These results indicate that M1 is involved in motor decision making, possibly by weighting the final integration of multiple sources of evidence driving motor behaviors.

I control therefore I do: judgments of agency influence action selection

Our sense of being agents, that is of willingly controlling both our own bodies and the external environment is ubiquitous if thin. Empirical and theoretical work on this 'sense of agency' has documented motivational, cognitive and neural influences on implicit (out of awareness) and explicit (conscious) judgments of agency. For example, fluency of action selection processes has been recently shown to affect judgments of one's degree of control over an external event. However, it is an open question whether and how such judgments of agency act as input to other processes. In this study we demonstrate that the opposite relationship between action selection and judgment of agency also exists. Specifically, we show that manipulating one's objective control over the environment influences both the speed and the frequency of performing an action associated with that control. This pattern bears a striking resemblance to the effect that tangible rewards have on action selection and suggests that positive control feedback is rewarding to the organism, consequently affecting action selection. If further corroborated this 'reward from control' may explain everyday addictions such as prolonged engagement in arcade games and pathological behaviors, such as stereotypy.

Spectral Signatures of Saccade Target Selection

Action generation relies on a widely distributed network of brain areas. However, little is known about the spatiotemporal dynamics of neuronal activity in the network that gives rise to voluntary action in humans. Here, we used magnetoencephalography (MEG) and source analysis (n = 15, 7 female subjects) to investigate the spectral signatures of human cortical networks engaged in active and intrinsically motivated viewing behavior. We compared neuronal activity of externally cued saccades with saccades to freely chosen targets. For planning and execution of both saccade types, we found an increase in gamma band (~64-128 Hz) activity and a concurrent decrease in beta band (~12-32 Hz) activity in saccadic control areas, including the intraparietal sulcus and the frontal eye fields. Guided compared to voluntary actions were accompanied by stronger transient increases in the gamma and low frequency (<16 Hz) range immediately following the instructional cue. In contrast, action selection between competing alternatives was reflected by stronger sustained fronto-parietal gamma increases that occurred later in time and persisted until movement execution. This sustained enhancement for free target selection was accompanied by a spatially widespread reduction of lower frequency power (~8-45 Hz) in parietal and extrastriate areas. Our results suggest that neuronal population activity in the gamma frequency band in a distributed network of fronto-parietal areas reflects the intrinsically driven process of selection among competing behavioral alternatives.

The role of prediction and outcomes in adaptive cognitive control

Humans adaptively perform actions to achieve their goals. This flexible behaviour requires two core abilities: the ability to anticipate the outcomes of candidate actions and the ability to select and implement actions in a goal-directed manner. The ability to predict outcomes has been extensively researched in reinforcement learning paradigms, but this work has often focused on simple actions that are not embedded in hierarchical and sequential structures that are characteristic of goal-directed human behaviour. On the other hand, the ability to select actions in accordance with high-level task goals, particularly in the presence of alternative responses and salient distractors, has been widely researched in cognitive control paradigms. Cognitive control research, however, has often paid less attention to the role of action outcomes. The present review attempts to bridge these accounts by proposing an outcome-guided mechanism for selection of extended actions. Our proposal builds on constructs from the hierarchical reinforcement learning literature, which emphasises the concept of reaching and evaluating informative states, i.e., states that constitute subgoals in complex actions. We develop an account of the neural mechanisms that allow outcome-guided action selection to be achieved in a network that relies on projections from cortical areas to the basal ganglia and back-projections from the basal ganglia to the cortex. These cortico-basal ganglia-thalamo-cortical 'loops' allow convergence - and thus integration - of information from non-adjacent cortical areas (for example between sensory and motor representations). This integration is essential in action sequences, for which achieving an anticipated sensory state signals the successful completion of an action. We further describe how projection pathways within the basal ganglia allow selection between representations, which may pertain to movements, actions, or extended action plans. The model lastly envisages a role for hierarchical projections from the striatum to dopaminergic midbrain areas that enable more rostral frontal areas to bias the selection of inputs from more posterior frontal areas via their respective representations in the basal ganglia.

A distributed network critical for selecting among tool-directed actions

Tools pose a challenge to the need to select actions appropriate for task goals and environmental constraints. For many tools (e.g., calculator), actions for "using" and "grasping-to-move" conflict with each other and may compete during selection. To date, little is known about the mechanisms that enable selection between possible tool actions or their neural substrates. The study of patients with chronic left hemisphere stroke, many of whom are deficient in tool-use action (apraxic), provides an opportunity to elucidate these issues. Here, 31 such patients pantomimed or recognized tool use actions for "conflict" and "non-conflict" tools. Voxel-based lesion-symptom mapping (VLSM), lesion subtraction, and tractographic overlap analyses were used to determine brain regions necessary for selecting among tool-directed actions. Lesions to posterior middle temporal gyrus (pMTG) and anterior intraparietal sulcus (aIPS) tended to impair production of use actions similarly for both conflict and non-conflict tools. By contrast, lesions to the supramarginal gyrus (SMG), inferior frontal gyrus (IFG)/anterior insula, and superior longitudinal fasciculus (SLF) specifically impaired production of use actions for conflict tools. Patients' errors on conflict tools suggested inappropriate selection of grasping actions and difficulty selecting single actions. Use/grasp conflict had no effect on action recognition. We suggest that the SMG/SLF/IFG pathway implements biased competition between possible tool actions, while aIPS and pMTG compute the structure-based and skilled use actions, respectively, that constitute input to this competitive process. This is the first study to demonstrate a reliable link between a characteristic of single tools (i.e., their association with different use and grasp actions) and action selection difficulties. Additionally, the data allow us to posit an SMG-involved subtype of apraxia characterized by an inability to resolve action competition.

Dissociating the influence of response selection and task anticipation on corticospinal suppression during response preparation

Motor behavior requires selecting between potential actions. The role of inhibition in response selection has frequently been examined in tasks in which participants are engaged in some advance preparation prior to the presentation of an imperative signal. Under such conditions, inhibition could be related to processes associated with response selection, or to more general inhibitory processes that are engaged in high states of anticipation. In Experiment 1, we manipulated the degree of anticipatory preparation. Participants performed a choice reaction time task that required choosing between a movement of the left or right index finger, and used transcranial magnetic stimulation (TMS) to elicit motor evoked potentials (MEPs) in the left hand agonist. In high anticipation blocks, a non-informative cue (e.g., fixation marker) preceded the imperative; in low anticipation blocks, there was no cue and participants were required to divide their attention between two tasks to further reduce anticipation. MEPs were substantially reduced before the imperative signal in high anticipation blocks. In contrast, in low anticipation blocks, MEPs remained unchanged before the imperative signal but showed a marked suppression right after the onset of the imperative. This effect occurred regardless of whether the imperative had signalled a left or right hand response. After this initial inhibition, left MEPs increased when the left hand was selected and remained suppressed when the right hand was selected. We obtained similar results in Experiment 2 except that the persistent left MEP suppression when the left hand was not selected was attenuated when the alternative response involved a non-homologous effector (right foot). These results indicate that, even in the absence of an anticipatory period, inhibitory mechanisms are engaged during response selection, possibly to prevent the occurrence of premature and inappropriate responses during a competitive selection process.

Selection and stopping in voluntary action: a meta-analysis and combined fMRI study

Voluntary action control requires selection of appropriate responses and stopping of inappropriate responses. Selection and stopping are often investigated separately, but they appear to recruit similar brain regions, including the pre-supplementary motor area (preSMA) and inferior frontal gyrus. We therefore examined the evidence for overlap of selection and stopping using two approaches: a meta-analysis of existing studies of selection and stopping, and a novel within-subject fMRI study in which action selection and a stop signal task were combined factorially. The novel fMRI study also permitted us to investigate hypotheses regarding a common mechanism for selection and stopping. The preSMA was identified by both methods as common to selection and stopping. However, stopping a selected action did not recruit preSMA more than stopping a specified action, nor did stop signal reaction times differ significantly across the two conditions. These findings suggest that the preSMA supports both action selection and stopping, but the two processes may not require access to a common inhibition mechanism. Instead, the preSMA might represent information about potential actions that is used in both action selection and stopping in order to resolve conflict between competing available responses.

Age-related variability in performance of a motor action selection task is related to differences in brain function and structure among older adults

Task performance for behaviors that engage motor cognitive processes may be particularly sensitive to age-related changes. One well-studied model of cognitive motor function involves engagement of action selection (AS) processes. In young adults, task conditions that add AS demands result in increased preparation times and greater engagement of bilateral dorsal premotor (PMd) and parietal cortices. The current study investigated the behavioral and neural response to a change in motor cognitive demands in older adults through the addition of AS to a movement task. Sixteen older adults made a joystick movement under two conditions during functional magnetic resonance imaging. In the AS condition, participants moved right or left based on an abstract rule; in the execution only (EO) condition, participants moved in the same direction on every trial. Across participants, the AS condition, as compared to the EO condition, was associated with longer reaction time and increased activation of left inferior parietal lobule. Variability in behavioral response to the AS task between participants related to differences in brain function and structure. Overall, individuals with poorer AS task performance showed greater activation in left PMd and dorsolateral prefrontal cortex and decreased structural integrity of white matter tracts that connect sensorimotor, frontal, and parietal regions-key regions for AS task performance. Additionally, two distinct patterns of functional connectivity were found. Participants with a pattern of decreased primary motor-PMd connectivity in response to the AS condition, compared to those with a pattern of increased connectivity, were older and had poorer behavioral performance. These neural changes in response to increased motor cognitive demands may be a marker for age-related changes in the motor system and have an impact on the learning of novel, complex motor skills in older adults.