Rodent models of serial reaction time tasks and their implementation in neurobiological research

Differential effects of bilateral hippocampal CA3 damage on the implicit learning and recognition of complex event sequences

Learning regularities in the environment is a fundament of human cognition, which is supported by a network of brain regions that include the hippocampus. In two experiments, we assessed the effects of selective bilateral damage to human hippocampal subregion CA3, which was associated with autobiographical episodic amnesia extending ~50 years prior to the damage, on the ability to recognize complex, deterministic event sequences presented either in a spatial or a non-spatial configuration. In contrast to findings from related paradigms, modalities, and homologue species, hippocampal damage did not preclude recognition memory for an event sequence studied and tested at four spatial locations, whereas recognition memory for an event sequence presented at a single location was at chance. In two additional experiments, recognition memory for novel single-items was intact, whereas the ability to recognize novel single-items in a different location from that presented at study was at chance. The results are at variance with a general role of the hippocampus in the learning and recognition of complex event sequences based on non-adjacent spatial and temporal dependencies. We discuss the impact of the results on established theoretical accounts of the hippocampal contributions to implicit sequence learning and episodic memory.

Nomen est omen: Serial reaction time task is not a motor but a visuomotor learning task

The serial reaction time task is a widely used task in behavioural and cognitive neuroscience to assess human and animal learning. Many publications refer to this task as a 'motor learning task', but it is also a perceptual learning task. We emphasize here that the incorrect use of the term 'motor learning' misleads researchers and medical doctors by emphasizing the motor cortex's exclusive role. It has the potential to lead to the misinterpretation of neuroscientific, neuroimaging and clinical studies. The domino effect has the potential to generate more flawed hypotheses and theories.

Spontaneous eyeblinks are sensitive to sequential learning

Although sequential learning and spontaneous eyeblink rate (EBR) have both been shown to be tightly related to cerebral dopaminergic activity, they have never been investigated at the same time. In the present study, EBR, taken as an indirect marker of dopaminergic activity, was investigated in two resting state conditions, both before and after visuomotor sequence learning in a serial reaction time task (SRT) and during task practice. Participants' abilities to produce and manipulate their knowledge about the sequential material were probed in a generation task. We hypothesized that the time course of spontaneous EBR might follow the progressive decrease of RTs during the SRT session. Additionally, we manipulated the structure of the transfer blocks as well as their respective order, assuming that (1) fully random trials might generate a larger psychophysiological response than an unlearned but structured material, and (2) a second (final) block of transfer might give rise to larger effects given that the sequential material was better consolidated after further practice. Finally, we tentatively hypothesized that, in addition to their online version, spontaneous EBR recorded during the pre- and post-learning resting sessions might be predictive of (1) the SRT learning curve, (2) the magnitude of the transfer effects, and (3) performance in the generation task. Results showed successful sequence learning with decreased accuracy and increased reaction times (RTs) in transfer blocks featuring a different material (random trials or a structured, novel sequence). In line with our hypothesis that EBR reflects dopaminergic activity associated with sequential learning, we observed increased EBR in random trials as well as when the second transfer block occurred at the end of the learning session. There was a positive relationship between the learning curve (RTs) and the slope of EBR during the SRT session. Additionally, inter-individual differences in resting and real-time EBR predicted the magnitude of accuracy and RTs transfer effects, respectively, but they were not related to participants' performances during the generation task. Notwithstanding, our results suggest that the degree of explicit sequential knowledge modulates the association between the magnitude of the transfer effect in EBR and SRT performance. Overall, the present study provides evidence that EBR may represent a valid indirect psychophysiological correlate of dopaminergic activity coupled to sequential learning.

Behavioral facilitation after hippocampal lesion: A review

When parts of the brain suffer from damage, certain functional deficits or impairments are the expected and typical outcome. A myriad of examples show such negative consequences, which afford the daily tasks of neurologists, neuropsychologists, and also behavioral neuroscientists working with experimental brain lesions. Compared to lesion-induced deficits, examples for functional enhancements or facilitation after brain lesions are rather rare and usually not well studied. Here, the mammalian hippocampus seems to provide an exception, since substantial evidence shows that its damage can have facilitatory behavioral effects under certain conditions. This review will address these effects and their possible mechanisms. It will show that facilitatory effects of hippocampal lesions, although mostly studied in rats, can be found in many mammalian species, that is, they are apparently not species-specific. Furthermore, they can be found with various lesion techniques, from tissue ablation, to neurotoxic damage, and from damage of hippocampal structure itself to damage of fiber systems innervating it. The major emphasis of this review, however, lies on the behavioral effects and their interpretations. Thus, facilitatory effects can be found in several learning paradigms, especially active avoidance, and some forms of Pavlovian and instrumental conditioning. These will be discussed in light of pertinent theories of hippocampal function, such as inhibition, spatial cognition, and multiple memory systems theories, which state that facilitatory effects of hippocampal lesions may reflect the loss of interference between hippocampal spatial and striatal procedural cognition. Using the example of the rat sequential reaction time task, it will also be discussed how such lesions can have direct and indirect consequences on certain behavioral readouts. A final note will advocate considering possible functional facilitation also in neurologic patients, especially those with hippocampal damage, since such a strategy might provide new avenues for therapeutic treatments.

Decoupling Actions from Consequences: Dorsal Hippocampal Lesions Facilitate Instrumental Performance, but Impair Behavioral Flexibility in Rats

The present study is part of a series of experiments, where we analyze why and how damage of the rat's dorsal hippocampus (dHC) can enhance performance in a sequential reaction time task (SRTT). In this task, sequences of distinct visual stimulus presentations are food-rewarded in a fixed-ratio-13-schedule. Our previous study (Busse and Schwarting, 2016) had shown that rats with lesions of the dHC show substantially shorter session times and post-reinforcement pauses (PRPs) than controls, which allows for more practice when daily training is kept constant. Since sequential behavior is based on instrumental performance, a sequential benefit might be secondary to that. In order to test this hypothesis in the present study, we performed two experiments, where pseudorandom rather than sequential stimulus presentation was used in rats with excitotoxic dorsal hippocampal lesions. Again, we found enhanced performance in the lesion-group in terms of shorter session times and PRPs. During the sessions we found that the lesion-group spent less time with non-instrumental behavior (i.e., grooming, sniffing, and rearing) after prolonged instrumental training. Also, such rats showed moderate evidence for an extinction impairment under devalued food reward conditions and significant deficits in a response-outcome (R-O)-discrimination task in comparison to a control-group. These findings suggest that facilitatory effects on instrumental performance after dorsal hippocampal lesions may be primarily a result of complex behavioral changes, i.e., reductions of behavioral flexibility and/or alterations in motivation, which then result in enhanced instrumental learning.

From neurons to nests: nest-building behaviour as a model in behavioural and comparative neuroscience

Despite centuries of observing the nest building of most extant bird species, we know surprisingly little about how birds build nests and, specifically, how the avian brain controls nest building. Here, we argue that nest building in birds may be a useful model behaviour in which to study how the brain controls behaviour. Specifically, we argue that nest building as a behavioural model provides a unique opportunity to study not only the mechanisms through which the brain controls behaviour within individuals of a single species but also how evolution may have shaped the brain to produce interspecific variation in nest-building behaviour. In this review, we outline the questions in both behavioural and comparative neuroscience that nest building could be used to address, summarize recent findings regarding the neurobiology of nest building in lab-reared zebra finches and across species building different nest structures, and suggest some future directions for the neurobiology of nest building.

The study of sequence learning in individuals with schizophrenia: a critical review of the literature

The serial reaction time task (SRTT) has been used extensively to study implicit sequence learning. A number of studies have used the SRTT to examine sequence learning in schizophrenia patients. Despite these studies, it remains unclear whether sequence learning is impaired in patients, whether antipsychotic medications affect sequence learning, and what types of sequential information patients might have difficulty learning. Methodological limitations have made it difficult to obtain good answers to these questions. Methodological innovations from the general SRTT literature that have not yet been adopted in the schizophrenia literature could provide better answers.

Habits, action sequences and reinforcement learning

It is now widely accepted that instrumental actions can be either goal-directed or habitual; whereas the former are rapidly acquired and regulated by their outcome, the latter are reflexive, elicited by antecedent stimuli rather than their consequences. Model-based reinforcement learning (RL) provides an elegant description of goal-directed action. Through exposure to states, actions and rewards, the agent rapidly constructs a model of the world and can choose an appropriate action based on quite abstract changes in environmental and evaluative demands. This model is powerful but has a problem explaining the development of habitual actions. To account for habits, theorists have argued that another action controller is required, called model-free RL, that does not form a model of the world but rather caches action values within states allowing a state to select an action based on its reward history rather than its consequences. Nevertheless, there are persistent problems with important predictions from the model; most notably the failure of model-free RL correctly to predict the insensitivity of habitual actions to changes in the action-reward contingency. Here, we suggest that introducing model-free RL in instrumental conditioning is unnecessary, and demonstrate that reconceptualizing habits as action sequences allows model-based RL to be applied to both goal-directed and habitual actions in a manner consistent with what real animals do. This approach has significant implications for the way habits are currently investigated and generates new experimental predictions.

Sequential learning and rule abstraction in Bengalese finches

The Bengalese finch (Lonchura striata var. domestica) is a species of songbird. Males sing courtship songs with complex note-to-note transition rules, while females discriminate these songs when choosing their mate. The present study uses serial reaction time (RT) to examine the characteristics of the Bengalese finches’ sequential behaviours beyond song production. The birds were trained to produce the sequence with an “A–B–A” structure. After the RT to each key position was determined to be stable, we tested the acquisition of the trained sequential response by presenting novel and random three-term sequences (random test). We also examined whether they could abstract the embedded rule in the trained sequence and apply it to the novel test sequence (abstract test). Additionally, we examined rule abstraction through example training by increasing the number of examples in baseline training from 1 to 5. When considered as (gender) groups, training with 5 examples resulted in no statistically significant differences in the abstract tests, while statistically significant differences were observed in the random tests, suggesting that the male birds learned the trained sequences and transferred the abstract structure they had learned during the training trials. Individual data indicated that males, as opposed to females, were likely to learn the motor pattern of the sequence. The results are consistent with observations that males learn to produce songs with complex sequential rules, whereas females do not.

Importance of the temporal structure of movement sequences on the ability of monkeys to use serial order information

The capacity to acquire motor skills through repeated practice of a sequence of movements underlies many everyday activities. Extensive research in humans has dealt with the importance of spatial and temporal factors on motor sequence learning, standing in contrast to the few studies available in animals, particularly in nonhuman primates. In the present experiments, we studied the effect of the serial order of stimuli and associated movements in macaque monkeys overtrained to make arm-reaching movements in response to spatially distinct visual targets. Under different conditions, the temporal structure of the motor sequence was varied by changing the duration of the interval between successive target stimuli or by adding a cue that reliably signaled the onset time of the forthcoming target stimulus. In each condition, the extent to which the monkeys are sensitive to the spatial regularities was assessed by comparing performance when stimulus locations follow a repeating sequence, as opposed to a random sequence. We observed no improvement in task performance on repeated sequence blocks, compared to random sequence blocks, when target stimuli are relatively distant from each other in time. On the other hand, the shortening of the time interval between successive target stimuli or, more efficiently, the addition of a temporal cue before the target stimulus yielded a performance advantage under repeated sequence, reflected in a decrease in the latency of arm and saccadic eye movements accompanied by an increased tendency for eye movements to occur in an anticipatory manner. Contrary to the effects on movement initiation, the serial order of stimuli and movements did not markedly affect the execution of movement. Moreover, the location of a given target in the random sequence influenced task performance based on the location of the preceding target, monkeys being faster in responding as a result of familiarity caused by extensive practice with some target transitions also used in the repeated sequence. This performance advantage was most prominently detectable when temporal prediction of forthcoming target stimuli was optimized. Taken together, the present findings demonstrate that the monkey's capacity to make use of serial order information to speed task performance was dependent on the temporal structure of the motor sequence.

Motoring ahead with rodents

How neural circuits underlie the acquisition and control of learned motor behaviors has traditionally been explored in monkeys and, more recently, songbirds. The development of genetic tools for functional circuit analysis in rodents, the availability of transgenic animals with well characterized phenotypes, and the relative ease with which rats and mice can be trained to perform various motor tasks, make rodents attractive models for exploring the neural circuit mechanisms underlying the acquisition and production of learned motor skills. Here we discuss the advantages and drawbacks of this approach, review recent trends and results, and outline possible strategies for wider adoption of rodents as a model system for complex motor learning.

The neuropharmacology of implicit learning

Two decades of pharmacologic research on the human capacity to implicitly acquire knowledge as well as cognitive skills and procedures have yielded surprisingly few conclusive insights. We review the empirical literature of the neuropharmacology of implicit learning. We evaluate the findings in the context of relevant computational models related to neurotransmittors such as dopamine, serotonin, acetylcholine and noradrenalin. These include models for reinforcement learning, sequence production, and categorization. We conclude, based on the reviewed literature, that one can predict improved implicit acquisition by moderately elevated dopamine levels and impaired implicit acquisition by moderately decreased dopamine levels. These effects are most prominent in the dorsal striatum. This is supported by a range of behavioral tasks in the empirical literature. Similar predictions can be made for serotonin, although there is yet a lack of support in the literature for serotonin involvement in classical implicit learning tasks. There is currently a lack of evidence for a role of the noradrenergic and cholinergic systems in implicit and related forms of learning. GABA modulators, including benzodiazepines, seem to affect implicit learning in a complex manner and further research is needed. Finally, we identify allosteric AMPA receptors modulators as a potentially interesting target for future investigation of the neuropharmacology of procedural and implicit learning.

6-hydroxydopamine lesions in the rat neostriatum impair sequential learning in a serial reaction time task

Sequential behavior has been intensively investigated in humans using so-called serial reaction time tasks(SRTT), in which visual stimuli are either presented in a random or sequential order. Typically, when the stimulus presentation follows a previously learned sequential order,reaction times are decreased compared to random stimulus presentation and become partly automated. A vast amount of SRTT findings indicates that sequential learning and performance seem to be mediated amongst others by the basal ganglia-especially the striatum-and the neurotransmitter dopamine therein. In this study we used an operant rat version of the human four choice SRTT to investigate the effect of bilateral neostriatal dopamine lesions induced by 6-hydroxydopamine on sequential learning. The rats' task was to respond rapidly to illuminated holes by nose-poking into them. During extensive training, the position of the illuminated hole followed a 12-item sequence. The outcome of this sequential training was also investigated in two tests, namely an interference test, where stimulus presentation switched between this sequential and a pseudo random order every five minutes, and a violation test, in which only one sequence item was eventually skipped. The neurotoxic lesions, which was placed before the start of training, led to the expected sub-total dopamine depletions (i.e. residual levels around 34-56% of controls), especially in the medial neostriatum. These lesions did not lead to general motor deficits in a catalepsy task, but moderate deficits in locomotion in an activity box, which largely recovered with time after lesion. In the SRTT, rats with lesions showed impaired learning, that is, less response accuracy and slower reaction times than the control group.During a subsequent test with alternating phases of sequential and random stimulus presentations, reaction times and accuracy of the control group were superior during sequential as compared to random stimulus phases. In the lesion group, only a moderate advantage in accuracy was observed. In the violation test, another outcome measure, the control group showed an expected increase in reaction times on the violated positions. By contrast, the lesion group showed no such increase, which indicates less automation of sequential behavior in these animals. For one, these findings support previous evidence in showing that neostriatal dopamine plays an important role for instrumental behavior, in general. Furthermore,and most importantly, they suggest that dopaminergic-striatal networks also play an important role in sequential behavior, especially its acquisition.

Learning processing in the basal ganglia: a mosaic of broken mirrors

In the present review we propose a model to explain the role of the basal ganglia in sensorimotor and cognitive functions based on a growing body of behavioural, anatomical, physiological, and neurochemical evidence accumulated over the last decades. This model proposes that the body and its surrounding environment are represented in the striatum in a fragmented and repeated way, like a mosaic consisting of the fragmented images of broken mirrors. Each fragment forms a functional unit representing articulated parts of the body with motion properties, objects of the environment which the subject can approach or manipulate, and locations the subject can move to. These units integrate the sensory properties and movements related to them. The repeated and widespread distribution of such units amplifies the combinatorial power of the associations among them. These associations depend on the phasic release of dopamine in the striatum triggered by the saliency of stimuli and will be reinforced by the rewarding consequences of the actions related to them. Dopamine permits synaptic plasticity in the corticostriatal synapses. The striatal units encoding the same stimulus/action send convergent projections to the internal segment of the globus pallidus (GPi) and to the substantia nigra pars reticulata (SNr) that stimulate or hold the action through a thalamus-frontal cortex pathway. According to this model, this is how the basal ganglia select actions based on environmental stimuli and store adaptive associations as nondeclarative memories such as motor skills, habits, and memories formed by Pavlovian and instrumental conditioning.