Neural systems underlying the learning of cognitive effort costs

Insights into control over cognitive flexibility from studies of task-switching

Cognitive flexibility denotes the ability to disengage from a current task and shift one's focus to a different activity. An individual's level of flexibility is not fixed; rather, people adapt their readiness to switch tasks to changing circumstances. We here review recent studies in the task-switching literature that have produced new insights into the contextual factors that drive this adaptation of flexibility, as well as proposals regarding the underlying cognitive mechanisms and learning processes. A fast-growing literature suggests that there are several different means of learning the need for, and implementing, changes in one's level of flexibility. These, in turn, have distinct consequences for the degree to which adjustments in cognitive flexibility are transferrable to new stimuli and tasks.

Learning Cognitive Flexibility: Neural Substrates of Adapting Switch-Readiness to Time-varying Demands

An individual's readiness to switch tasks (cognitive flexibility) varies over time, in part, as the result of reinforcement learning based on the statistical structure of the world around them. Consequently, the behavioral cost associated with task-switching is smaller in contexts where switching is frequent than where it is rare, but the underlying brain mechanisms of this adaptation in cognitive flexibility are not well understood. Here, we manipulated the likelihood of switches across blocks of trials in a classic cued task-switching paradigm while participants underwent fMRI. As anticipated, behavioral switch costs decreased as the probability of switching increased, and neural switch costs were observed in lateral and medial frontoparietal cortex. To study moment-by-moment adjustments in cognitive flexibility at the neural level, we first fitted the behavioral RT data with reinforcement learning algorithms and then used the resulting trial-wise prediction error estimate as a regressor in a model-based fMRI analysis. The results revealed that lateral frontal and parietal cortex activity scaled positively with unsigned switch prediction error and that there were no brain regions encoding signed (i.e., switch- or repeat-specific) prediction error. Taken together, this study documents that adjustments in cognitive flexibility to time-varying switch demands are mediated by frontoparietal cortex tracking the likelihood of forthcoming task switches.

Expending effort may share neural responses with reward and evokes high subjective satisfaction

Throughout our daily lives, the levels of effort we invest in various tasks are influenced by reward processing. The subjective expectation after expending effort is a primary factor affecting reward processing. However, recent studies indicate that individual differences in reward anticipation influence this subjective valuation. To better understand the relationship between effort expenditure and the subjective valuation of rewards, in this study, we perform an experiment in which we manipulate effort, control reward expectation implicitly, and measure the subjective valuation of rewards using event-related potentials (ERPs) and physical effort through behavioral measures (number of keystrokes). In the reward-task paradigm, 30 subjects performed effort and control trials, with the reward probability comparable across the effort and control conditions. We also examined the ERPs associated with the valuation of subjective rewards, including reward positivity (RewP) and set reward expectation controlled as the baseline. The results showed that the ERP amplitudes, the number of keystrokes, and explicit satisfaction ratings were all significantly greater in the effort condition than in the control condition. The participants maintained high levels of effort throughout the sessions associated with the experiment. The results of this study suggest that when reward expectations are controlled, effort expenditure evokes neural responses similar to reward feedback being given, which is linked with increased subjective satisfaction.