Frequency of perseveration in normal subjects

Active reinforcement learning versus action bias and hysteresis: control with a mixture of experts and nonexperts

Active reinforcement learning enables dynamic prediction and control, where one should not only maximize rewards but also minimize costs such as of inference, decisions, actions, and time. For an embodied agent such as a human, decisions are also shaped by physical aspects of actions. Beyond the effects of reward outcomes on learning processes, to what extent can modeling of behavior in a reinforcement-learning task be complicated by other sources of variance in sequential action choices? What of the effects of action bias (for actions per se) and action hysteresis determined by the history of actions chosen previously? The present study addressed these questions with incremental assembly of models for the sequential choice data from a task with hierarchical structure for additional complexity in learning. With systematic comparison and falsification of computational models, human choices were tested for signatures of parallel modules representing not only an enhanced form of generalized reinforcement learning but also action bias and hysteresis. We found evidence for substantial differences in bias and hysteresis across participants-even comparable in magnitude to the individual differences in learning. Individuals who did not learn well revealed the greatest biases, but those who did learn accurately were also significantly biased. The direction of hysteresis varied among individuals as repetition or, more commonly, alternation biases persisting from multiple previous actions. Considering that these actions were button presses with trivial motor demands, the idiosyncratic forces biasing sequences of action choices were robust enough to suggest ubiquity across individuals and across tasks requiring various actions. In light of how bias and hysteresis function as a heuristic for efficient control that adapts to uncertainty or low motivation by minimizing the cost of effort, these phenomena broaden the consilient theory of a mixture of experts to encompass a mixture of expert and nonexpert controllers of behavior.

Evaluation of Error Production in Animal Fluency and Its Relationship to Frontal Tracts in Normal Aging and Mild Alzheimer's Disease: A Combined LDA and Time-Course Analysis Investigation

Semantic verbal fluency (VF), assessed by animal category, is a task widely used for early detection of dementia. A feature not regularly assessed is the occurrence of errors such as perseverations and intrusions. So far, no investigation has analyzed the how and when of error occurrence during semantic VF in aging populations, together with their possible neural correlates. The present study aims to address the issue using a combined methodology based on latent Dirichlet allocation (LDA) analysis for word classification together with a time-course analysis identifying exact time of errors' occurrence. LDA is a modeling technique that discloses hidden semantic structures based on a given corpus of documents. We evaluated a sample of 66 participants divided into a healthy young group (n = 24), healthy older adult group (n = 23), and group of patients with mild Alzheimer's disease (AD) (n = 19). We performed DTI analyses to evaluate the white matter integrity of three frontal tracts purportedly underlying error commission: anterior thalamic radiation, frontal aslant tract, and uncinate fasciculus. Contrasts of DTI metrics were performed on the older groups who were further classified into high-error rate and low-error rate subgroups. Results demonstrated a unique deployment of error commission in the patient group characterized by high incidence of intrusions in the first 15 s and higher rate of perseverations toward the end of the trial. Healthy groups predominantly showed very low incidence of perseverations. The DTI analyses revealed that the patients with AD committing high-error rate presented significantly more degenerated frontal tracts in the left hemisphere. Thus, our findings demonstrated that the appearance of intrusions, together with left hemisphere degeneration of frontal tracts, is a pathognomic trait of mild AD. Furthermore, our data suggest that the error commission of patients with AD arises from executive and working memory impairments related partly to deteriorated left frontal tracts.

Theoretical Modeling of Cognitive Dysfunction in Schizophrenia by Means of Errors and Corresponding Brain Networks

The current evidence of cognitive disturbances and brain alterations in schizophrenia does not provide the plausible explanation of the underlying mechanisms. Neuropsychological studies outlined the cognitive profile of patients with schizophrenia, that embodied the substantial disturbances in perceptual and motor processes, spatial functions, verbal and non-verbal memory, processing speed and executive functioning. Standardized scoring in the majority of the neurocognitive tests renders the index scores or the achievement indicating the severity of the cognitive impairment rather than the actual performance by means of errors. At the same time, the quantitative evaluation may lead to the situation when two patients with the same index score of the particular cognitive test, demonstrate qualitatively different performances. This may support the view why test paradigms that habitually incorporate different cognitive variables associate weakly, reflecting an ambiguity in the interpretation of noted cognitive constructs. With minor exceptions, cognitive functions are not attributed to the localized activity but eventuate from the coordinated activity in the generally dispersed brain networks. Functional neuroimaging has progressively explored the connectivity in the brain networks in the absence of the specific task and during the task processing. The spatio-temporal fluctuations of the activity of the brain areas detected in the resting state and being highly reproducible in numerous studies, resemble the activation and communication patterns during the task performance. Relatedly, the activation in the specific brain regions oftentimes is attributed to a number of cognitive processes. Given the complex organization of the cognitive functions, it becomes crucial to designate the roles of the brain networks in relation to the specific cognitive functions. One possible approach is to identify the commonalities of the deficits across the number of cognitive tests or, common errors in the various tests and identify their common "denominators" in the brain networks. The qualitative characterization of cognitive performance might be beneficial in addressing diffuse cognitive alterations presumably caused by the dysconnectivity of the distributed brain networks. Therefore, in the review, we use this approach in the description of standardized tests in the scope of potential errors in patients with schizophrenia with a subsequent reference to the brain networks.

Multiple stages of learning in perceptual categorization: evidence and neurocomputational theory

Virtually all current theories of category learning assume that humans learn new categories by gradually forming associations directly between stimuli and responses. In information-integration category-learning tasks, this purported process is thought to depend on procedural learning implemented via dopamine-dependent cortical-striatal synaptic plasticity. This article proposes a new, neurobiologically detailed model of procedural category learning that, unlike previous models, does not assume associations are made directly from stimulus to response. Rather, the traditional stimulus-response (S-R) models are replaced with a two-stage learning process. Multiple streams of evidence (behavioral, as well as anatomical and fMRI) are used as inspiration for the new model, which synthesizes evidence of multiple distinct cortical-striatal loops into a neurocomputational theory. An experiment is reported to test a priori predictions of the new model that: (1) recovery from a full reversal should be easier than learning new categories equated for difficulty, and (2) reversal learning in procedural tasks is mediated within the striatum via dopamine-dependent synaptic plasticity. The results confirm the predictions of the new two-stage model and are incompatible with existing S-R models.

Environmentally enriched rearing environments reduce repetitive perseveration in caged mink, but increase spontaneous alternation

Studies spanning 15 species (including American mink, Neovison vison) demonstrate that within similarly-housed populations, individuals displaying high levels of stereotypic behaviour (SB) typically show perseverative responding (e.g. during set-shifting, or reversal/extinction learning). Similar correlations in autism and schizophrenia suggest this indicates captivity-induced cortico-striatal circuit dysfunction. However, this pattern does not prove developmental impairment: SB, perseveration and their inter-correlations also occur in normal humans. We therefore differentially-reared enriched versus non-enriched mink to investigate whether treatments that exacerbate SB correspondingly increase perseveration (Study 1). Enriched-rearing did reduce SB and perseverative response repetition (in two-choice guessing tasks), while increasing spontaneous alternation: a strategy yielding more rewards, and suggesting enhanced hippocampal development. This complements previous research demonstrating cortical/hippocampal impairments and reduced behavioural flexibility in non-enriched animals, with implications for research animals and wild animals captive-raised for reintroduction into nature. Consistent with previous data, highly stereotypic subjects repeated guessing task responses most rapidly, suggesting disinhibition during repetition. However, unexpectedly, SB and perseveration did not co-vary across individuals. We therefore suggest that behavioural changes manifest as increased perseveration are important but do not fully explain captive animals' SBs, possible reasons including the contributory role of differential motivations for underlying source behaviours. Re-analyses of old data (Study 2) confirmed that spontaneous alternation is profitable; and demonstrated that the precise methods used for quantifying perseveration and SB can modify the strength of apparent relationships between them, as can statistically controlling for feeding motivation: as predicted, partialling out motivational effects increased the variance in SB predicted by perseveration.

Young children fail to fully generalize a novel argument structure construction when exposed to the same input as older learners

The present study exposed five-year-olds (M=5 ; 2), seven-year-olds (M=7 ; 6) and adults (M=22 ; 4) to instances of a novel phrasal construction, then used a forced choice comprehension task to evaluate their learning of the construction. The abstractness of participants' acquired representations of the novel construction was evaluated by varying the degree of lexical overlap that test items had with exposure items. We found that both child groups were less proficient than adults, but seven-year-olds showed evidence of across-the-board generalization whereas five-year-olds were sensitive to lexical overlap at test. This outcome is consistent with more conservative, item-based learning of syntactic patterns in younger children. Additionally, unlike adults and seven-year-olds, five-year-olds showed no evidence of having mastered the novel construction's linking rules. Thus, younger learners are less likely to generalize abstract argument structure constructions when exposed to the same systematic input as older learners.

The effects of age, sex and Alzheimer's disease on strategy use during verbal fluency tasks

Clustering and switching strategies during phonemic and semantic verbal fluency tasks were investigated in healthy adults (n = 193, 86 males, 20-90 years) in young, middle-aged, young-old, and old-old age groups (Study 1). Older groups produced fewer total words and lower switching scores; males relied more on clustering and females on switching to produce equivalent output. In Study 2, early Alzheimer's disease participants, compared to healthy older adults, (n = 26 per group) produced fewer total words and smaller average clusters. Sex, age, and clinical differences on switching and clustering strategies support a dual processing model of verbal fluency.

Hormone therapy and cognitive function

BACKGROUND

Clinical trials yield discrepant information about the impact of hormone therapy on verbal memory and executive function. This issue is clinically relevant because declines in verbal memory are the earliest predictor of Alzheimer's disease and declines in executive function are central to some theories of normal, age-related changes in cognition.

METHODS

We conducted a systematic review of randomized clinical trials of hormone therapy (i.e. oral, transdermal, i.m.) and verbal memory, distinguishing studies in younger (i.e. <or=65 years of age; n = 9) versus older (i.e. >65 years; n = 7) women and studies involving estrogen alone versus estrogen plus progestogen. Out of 32 placebo-controlled trials, 17 were included (13 had no verbal memory measures and 2 involved cholinergic manipulations). We also provide a narrative review of 25 studies of executive function (two trials), since there are insufficient clinical trial data for systematic review.

RESULTS

There is some evidence for a beneficial effect of estrogen alone on verbal memory in younger naturally post-menopausal women and more consistent evidence from small-n studies of surgically post-menopausal women. There is stronger evidence of a detrimental effect of conjugated equine estrogen plus medroxyprogesterone acetate on verbal memory in younger and older post-menopausal women. Observational studies and pharmacological models of menopause provide initial evidence of improvements in executive function with hormone therapy.

CONCLUSIONS

Future studies should include measures of executive function and should address pressing clinical questions; including what formulation of combination hormone therapy is cognitively neutral/beneficial, yet effective in treating hot flashes in the early post-menopause.

Perseveration in Alzheimer's disease

BACKGROUND/AIMS AND METHODS

Perseveration is common in Alzheimer's disease (AD). We document the type and quantitative burden of perseveration as cognitive decline progresses from normal aging (n = 30) through mild AD (n = 20) to moderate AD (n = 20) by administering a semantic verbal fluency task.

RESULTS

We found perseveration to increase significantly with increasing severity of AD and different types of perseveration that distinguish the subject groups in a statistically significant manner. Recurrent and continuous perseverations appear early in AD. As the disease progresses in severity into moderate stage, the number of recurrent and continuous perseverations increases, and stuck-in-set perseverations emerge.

CONCLUSION

The different types of perseveration are likely to reflect the progressive deterioration of different brain regions in AD.

Estrogen therapy selectively enhances prefrontal cognitive processes: a randomized, double-blind, placebo-controlled study with functional magnetic resonance imaging in perimenopausal and recently postmenopausal women

OBJECTIVE

Estrogen therapy (ET) seems to differentially effect cognitive processes in younger versus older postmenopausal women, suggesting a window of opportunity when ET is most beneficial. Cognitive improvement in younger postmenopausal women has been attributed to ET's influence on hot flushes and sleep, but empiric examination of the mediating role of menopause symptoms versus direct effects of ET on the brain is limited.

DESIGN

In a double-blind trial, 52 women were randomly assigned to estradiol 0.05 mg/day (n = 26) or placebo transdermal patches (n = 26) for 12 weeks. Women completed tests of memory, learning, and executive functioning, and hot flush and sleep assessments at baseline and study end. A subset of women (five ET treated, six placebo treated) also underwent blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) studies.

RESULTS

Nondepressed perimenopausal and postmenopausal women were studied. The majority had hot flushes and sleep impairment. Compared with placebo, ET selectively reduced errors of perseveration during verbal recall (P = 0.03), a frontal system-mediated function, but did not influence other cognitive processes. Women with baseline hot flushes had greater cognitive benefit with ET (P < 0.05). Cognitive benefit was not associated with sleep problems or its improvement. Measures of fMRI BOLD activation during tests of verbal and spatial working memory showed significant increases in frontal system activity with ET (P < 0.001).

CONCLUSIONS

Estrogen therapy selectively improves executive functioning as demonstrated by reduced perseverative errors and prefrontal cortex activation during verbal recall tasks. Cognitive improvement with ET is associated with hot flushes, but not with sleep, suggesting that ET has a direct central nervous system effect, rather than an indirect effect mediated through improvement of sleep.

I'm sitting here feeling aphasic! A study of recurrent perseverative errors elicited in unimpaired speakers

In this study, the recurrent perseverative errors produced by 44 speakers without impairment were examined in picture naming and reading aloud tasks under a fast response deadline. The proportion of perseverative relative to non-perseverative errors was greater in picture naming, the more error-prone task, than in reading aloud. Additionally, although perseverative errors were less likely to be related to the target than non-perseverative errors, the overall distribution of perseverative and non-perseverative errors in each task was similar. It is concluded that the perseverative errors produced by the participants reflected both the degree and level at which language processing efficiency was reduced in each task. This is consistent with a more recent account of perseveration as a result of normally existing persistent activation overcoming weakened activation of a target at any level of language processing. These results are compared with recent studies of recurrent perseverative errors produced by people with aphasia in light of the cognitive neuropsychological assumption that speakers with and without impairment utilise a common language processing system.

Working Memory and Perseveration in Verbal Fluency

Letter and semantic fluency tasks are often used in neuropsychological assessment and are sensitive to many conditions. Performance is assessed by correct responses and errors, including perseverations. Healthy young adults performed letter and semantic fluency tasks. One group performed these tasks in the conventional manner; 2 other groups performed them while maintaining memory loads. The memory loads consisted either of words from the same category as the fluency task or of words from a different category. The results showed little effect of memory loads on correct responses but significant effects of memory load on perseveration rates: Same-category loads resulted in higher rates, especially in letter fluency. The results are discussed in terms of frontal lobe function in verbal fluency.

Comparability of the Standard WCST and WCST–64 in Traumatic Brain Injury

The aim of this study was to investigate the comparability of the Wisconsin Card Sorting Test short form (WCST-64) to the standard form in a clinical population with documented brain pathology: chronic severe traumatic brain injury (TBI). Participants were 61 patients at least 1 year after severe TBI living at a large residential rehabilitation facility. The WCST was administered in standard fashion with both the standard and 64-card versions scored. All derived scores with norms were examined. Results indicated that the WCST-64 scores were comparable to the standard version, and assigned impairment levels remained relatively stable. These results suggest the WCST-64 is a valid alternative to the standard version in chronic severe TBI.