Strategy-effects in prefrontal cortex during learning of higher-order S–R rules

Belief inference for hierarchical hidden states in spatial navigation

Uncertainty abounds in the real world, and in environments with multiple layers of unobservable hidden states, decision-making requires resolving uncertainties based on mutual inference. Focusing on a spatial navigation problem, we develop a Tiger maze task that involved simultaneously inferring the local hidden state and the global hidden state from probabilistically uncertain observation. We adopt a Bayesian computational approach by proposing a hierarchical inference model. Applying this to human task behaviour, alongside functional magnetic resonance brain imaging, allows us to separate the neural correlates associated with reinforcement and reassessment of belief in hidden states. The imaging results also suggest that different layers of uncertainty differentially involve the basal ganglia and dorsomedial prefrontal cortex, and that the regions responsible are organised along the rostral axis of these areas according to the type of inference and the level of abstraction of the hidden state, i.e. higher-order state inference involves more anterior parts.

Chronology of auditory processing and related co-activation in the orbitofrontal cortex depends on musical expertise

Introduction

The present study aims to explore the extent to which auditory processing is reflected in the prefrontal cortex.

Methods

Using magnetoencephalography (MEG), we investigated the chronology of primary and secondary auditory responses and associated co-activation in the orbitofrontal cortex in a large cohort of 162 participants of various ages. The sample consisted of 38 primary school children, 39 adolescents, 43 younger, and 42 middle-aged adults and was further divided into musically experienced participants and non-musicians by quantifying musical training and aptitude parameters.

Results

We observed that the co-activation in the orbitofrontal cortex [Brodmann-Area 10 (BA10)] strongly depended on musical expertise but not on age. In the musically experienced groups, a systematic coincidence of peak latencies of the primary auditory P1 response and the co-activated response in the orbitofrontal cortex was observed in childhood at the onset of musical education. In marked contrast, in all non-musicians, the orbitofrontal co-activation occurred 25-40 ms later when compared with the P1 response. Musical practice and musical aptitude contributed equally to the observed activation and co-activation patterns in the auditory and orbitofrontal cortex, confirming the reciprocal, interrelated influence of nature, and nurture in the musical brain.

Discussion

Based on the observed ageindependent differences in the chronology and lateralization of neurological responses, we suggest that orbitofrontal functions may contribute to musical learning at an early age.

Different Electrophysiological Responses to Informative Value of Feedback Between Children and Adults

The ability to learn from feedback is important for children's adaptive behavior and school learning. Feedback has two main components, informative value and valence. How to disentangle these two components and what is the developmental neural correlates of using the informative value of feedback is still an open question. In this study, 23 children (7-10 years old) and 19 adults (19-22 years old) were asked to perform a rule induction task, in which they were required to find a rule, based on the informative value of feedback. Behavioral results indicated that the likelihood of correct searching behavior under negative feedback was low for children. Event-related potentials showed that (1) the effect of valence was processed in a wide time window, particularly in the N2 component; (2) the encoding process of the informative value of negative feedback began later for children than for adults; (3) a clear P300 was observed for adults; for children, however, P300 was absent in the frontal region; and (4) children processed the informative value of feedback chiefly in the left sites during the P300 time window, whereas adults did not show this laterality. These results suggested that children were less sensitive to the informative value of negative feedback possibly because of the immature brain.

Visual Category Learning Results in Rapid Changes in Brain Activation Reflecting Sensitivity to the Category Relation between Perceived Objects and to Decision Correctness

Little is known about the time scales in which sensitivity to novel category identity may become evident in visual and executive cortices in visual category learning (VCL) tasks and the nature of such changes in brain activation. We used fMRI to investigate the processing of category information and trial-by-trial feedback information. In each VCL task, stimuli differed in three feature dimensions. In each trial, either two same-category stimuli or two different-categories stimuli were presented. The participant had to learn which feature dimension was relevant for categorization based on the feedback that followed each categorization decision. We contrasted between same-category stimuli trials and different-category trials and between correct and incorrect categorization decision trials. In each trial, brain activation in the visual stimuli processing phase was modeled separately from activation during the later feedback processing phase. We found activation in the lateral occipital complex, indicating sensitivity to the category relation between stimuli, to be evident in VCL within only few learning trials. Specifically, greater lateral occipital complex activation was evident when same-category stimuli were presented than when different-category stimuli were presented. In the feedback processing phase, greater activation in both executive and visual cortices was evident primarily after “misdetections” of same-category stimuli. Implications regarding the contribution of different learning trials to VCL, and the respective role of key brain regions, at the onset of VCL, are discussed.

Gender differences in creative thinking: behavioral and fMRI findings

Gender differences in creativity have been widely studied in behavioral investigations, but this topic has rarely been the focus of neuroscientific research. The current paper presents follow-up analyses of a previous fMRI study (Abraham et al., Neuropsychologia 50(8):1906-1917, 2012b), in which behavioral and brain function during creative conceptual expansion as well as general divergent thinking were explored. Here, we focus on gender differences within the same sample. Conceptual expansion was assessed with the alternate uses task relative to the object location task, whereas divergent thinking was assessed in terms of responses across both the alternate uses and object location tasks relative to n-back working memory tasks. While men and women were indistinguishable in terms of behavioral performance across all tasks, the pattern of brain activity while engaged in the tasks in question was indicative of strategy differences between the genders. Brain areas related to semantic cognition, rule learning and decision making were preferentially engaged in men during conceptual expansion, whereas women displayed higher activity in regions related to speech processing and social perception. During divergent thinking, declarative memory related regions were strongly activated in men, while regions involved in theory of mind and self-referential processing were more engaged in women. The implications of gender differences in adopted strategies or cognitive style when faced with generative tasks are discussed.

Development of abstract thinking during childhood and adolescence: the role of rostrolateral prefrontal cortex

•

Rostral prefrontal cortex (RPFC) supports self-generated, abstract thought processing.

•

Flexibly attending towards and processing abstract thoughts develop in adolescence.

•

RPFC activation becomes more specific to relational integration during development.

•

Prospective memory development remains to be further studied using neuroimaging.

•

Training of abstract thinking, e.g. reasoning, may have implication for education.

Rostral prefrontal cortex (RPFC) has increased in size and changed in terms of its cellular organisation during primate evolution. In parallel emerged the ability to detach oneself from the immediate environment to process abstract thoughts and solve problems and to understand other individuals’ thoughts and intentions. Rostrolateral prefrontal cortex (RLPFC) is thought to play an important role in supporting the integration of abstract, often self-generated, thoughts. Thoughts can be temporally abstract and relate to long term goals, or past or future events, or relationally abstract and focus on the relationships between representations rather than simple stimulus features. Behavioural studies have provided evidence of a prolonged development of the cognitive functions associated with RLPFC, in particular logical and relational reasoning, but also episodic memory retrieval and prospective memory. Functional and structural neuroimaging studies provide further support for a prolonged development of RLPFC during adolescence, with some evidence of increased specialisation of RLPFC activation for relational integration and aspects of episodic memory retrieval. Topics for future research will be discussed, such as the role of medial RPFC in processing abstract thoughts in the social domain, the possibility of training abstract thinking in the domain of reasoning, and links to education.

Invariance detection in the brain: revealed in a stepwise category induction task

A critical sub-process of category learning is detecting the invariance between categorical members. To examine brain activation associated with invariance detection at different steps of category learning, a stepwise category induction task was used in the present study. Within each trial, three stimuli were displayed sequentially, and participants were asked to learn the target category corresponding to the invariance among stimuli. Results revealed that invariance detection activated the fronto-parietal network. However, the frontal and parietal cortices functioned differently throughout the different steps of invariance detection. The left middle frontal gyrus (BA 9) was highly activated in both steps of invariance detection, but the posterior parietal regions, especially the right superior parietal lobule (BA 7), were more active in the final step of invariance detection, reflecting increased attention to the completion of category learning and the preparation for a subsequent response. Furthermore, a psychophysiological interaction analysis (PPI) revealed increased connectivity between the left middle frontal gyrus and the bilateral parietal cortex during the final step of invariance detection. Overall, the present findings imply the necessary role of the fronto-parietal network in variance detection.

When three is not some: on the pragmatics of numerals

Both numerals and quantifiers (like some) have more than one possible interpretation (i.e., weak and strong interpretations). Some studies have found similar behavior for numerals and quantifiers, whereas others have shown critical differences. It is, therefore, debated whether they are processed in the same way. A previous fMRI investigation showed that the left inferior frontal gyrus is linked to the computation of the strong interpretation of quantifiers (derived by a scalar implicature) and that the left middle frontal gyrus and the medial frontal gyrus are linked to processing the mismatch between the strong interpretation of quantifiers and the context in which they are presented. In the current study, we attempted to characterize the similarities and differences between numbers and quantifiers by examining brain activation patterns related to the processing of numerals in these brain regions. When numbers were presented in a mismatch context (i.e., where their strong interpretation did not match the context), they elicited brain activations similar to those previously observed with quantifiers in the same context type. Conversely, in a match context (i.e., where both interpretations of the scalar item matched the context), numbers elicited a different activation pattern than the one observed with quantifiers: Left inferior frontal gyrus activations in response to the match condition showed decrease for numbers (but not for quantifiers). Our results support previous findings suggesting that, although they share some features, numbers and quantifiers are processed differently. We discuss our results in light of various theoretical approaches linked to the representation of numerals.

When some is not every: dissociating scalar implicature generation and mismatch

Making inferences beyond the literal meaning of sentences occurs with certain scalar expressions via scalar implicatures. For example, adults usually interpret some as some but not all. On the basis of behavioral research, it has been suggested that processing implicatures is cognitively costly. However, many studies have used cases where sentences with some did not match the context in which they were presented. Our study aimed to examine whether the processing cost is linked to implicature generation, to the mismatch between the implicature and the context, or to both processes. To do so, we explored the neural patterns of implicature generation and implicature mismatch using fMRI. Thirteen participants performed a sentence-picture matching task (where pictures determined the context) with mismatched implicatures, successful implicatures or no implicature conditions. Several brain regions were identified when comparing cases of implicature mismatch and cases without implicatures. One of these regions, left-IFG, was jointly activated for mismatched and successful implicatures, as observed in a conjunction analysis. By contrast, left-MFG and medial-frontal-gyrus, were identified when comparing cases of implicature mismatch with cases of successful implicatures. Thus, the left IFG can be interpreted as being linked to implicature generation, whereas the other two areas seem to participate in the processing of the mismatch between the implicature and its context. Our results indicate that scalar implicatures induce processing cost in different ways. This should be considered in future research.

Anticipatory regulation of action control in a simon task: behavioral, electrophysiological, and FMRI correlates

With the present study we investigated cue-induced preparation in a Simon task and measured electroencephalogram and functional magnetic resonance imaging (fMRI) data in two within-subjects sessions. Cues informed either about the upcoming (1) spatial stimulus-response compatibility (rule cues), or (2) the stimulus location (position cues), or (3) were non-informative. Only rule cues allowed anticipating the upcoming compatibility condition. Position cues allowed anticipation of the upcoming location of the Simon stimulus but not its compatibility condition. Rule cues elicited fastest and most accurate performance for both compatible and incompatible trials. The contingent negative variation (CNV) in the event-related potential (ERP) of the cue-target interval is an index of anticipatory preparation and was magnified after rule cues. The N2 in the post-target ERP as a measure of online action control was reduced in Simon trials after rule cues. Although compatible trials were faster than incompatible trials in all cue conditions only non-informative cues revealed a compatibility effect in additional indicators of Simon task conflict like accuracy and the N2. We thus conclude that rule cues induced anticipatory re-coding of the Simon task that did not involve cognitive conflict anymore. fMRI revealed that rule cues yielded more activation of the left rostral, dorsal, and ventral prefrontal cortex as well as the pre-SMA as compared to POS and NON-cues. Pre-SMA and ventrolateral prefrontal activation after rule cues correlated with the effective use of rule cues in behavioral performance. Position cues induced a smaller CNV effect and exhibited less prefrontal and pre-SMA contributions in fMRI. Our data point to the importance to disentangle different anticipatory adjustments that might also include the prevention of upcoming conflict via task re-coding.

Electrophysiological correlates of category induction in children and adults

Category induction involves abstraction of features common to two or more stimuli. Event-related potentials (ERPs) during induction and non-induction tasks were recorded for 12 children and 12 adults. We found that (1) ERP waves, except P2 amplitude, decreased significantly with age, (2) Compared to non-induction tasks, induction tasks elicited larger fronto-central N2 components in both age groups, (3) The amplitude of the late positive component was significantly greater in the induction condition than in the non-induction condition, and (4) The difference wave suggested that category induction was mainly located in the left hemisphere in children but was not lateralized in adults.