Decision-making ability, psychopathology, and brain connectivity

A task-invariant prior explains trial-by-trial active avoidance behaviour across gain and loss tasks

Failing to make decisions that would actively avoid negative outcomes is central to helplessness. In a Bayesian framework, deciding whether to act is informed by beliefs about the world that can be characterised as priors. However, these priors have not been previously quantified. Here we administered two tasks in which 279 participants decided whether to attempt active avoidance actions. In both tasks, participants decided between a passive option that would for sure result in a negative outcome of varying size, and a costly active option that allowed them a probability of avoiding the negative outcome. The tasks differed in framing and valence, allowing us to test whether the prior generating biases in behaviour is problem-specific or task-independent and general. We performed extensive comparisons of models offering different structural explanations of the data, finding that a Bayesian model with a task-invariant prior for active avoidance provided the best fit to participants' trial-by-trial behaviour. The parameters of this prior were reliable, and participants' self-rated positive affect was weakly correlated with this prior such that participants with an optimistic prior reported higher levels of positive affect. These results show that individual differences in prior beliefs can explain decisions to engage in active avoidance of negative outcomes, providing evidence for a Bayesian conceptualization of helplessness.

Dorsal-Ventral Reinforcement Learning Network Connectivity and Incentive-Driven Changes in Exploration

Probabilistic reinforcement learning (RL) tasks assay how individuals make decisions under uncertainty. The use of internal models (model-based) or direct learning from experiences (model-free), and the degree of choice stochasticity across alternatives (i.e., exploration), can all be influenced by the state space of the decision-making task. There is considerable individual variation in the balance between model-based and model-free control during decision-making, and this balance is affected by incentive motivation. The effect of variable reward incentives on the arbitration between model-based and model-free learning remains understudied, and individual differences in neural signatures and cognitive traits that moderate the effect of reward on model-free/model-based control are unknown. Here we combined a two-stage decision-making task utilizing differing reward incentives with computational modeling, neuropsychological tests, and neuroimaging to address these questions. Results showed the prospect of greater reward decreased exploration of alternative options and increased the balance toward model-based learning. These behavioral effects were replicated across two independent datasets including both sexes. Individual differences in processing speed and analytical thinking style affected how reward altered the dependence on both systems. Using a systems neuroscience-inspired approach to resting-state functional connectivity, we found reduced exploration of the options during the first stage of our task under high relative to low incentives was predicted by increased cross-network coupling between ventral and dorsal RL circuitry. These findings suggest that integrity of functional connections between stimulus valuation (ventral) and action valuation (dorsal) RL networks is associated with changes in the balance between explore-exploit decisions under changing reward incentives.

Shaping food choices with actions and inactions with and without reward and punishment

Enabling people to reduce their consumption of unhealthy appetitive products can improve their health. Over the last decades, progress has been made by uncovering new ways to change behavior toward appetitive products without feedback incentives (e.g., reward or punishment, as in feedback-driven reinforcement learning), but instead by cueing motor responses (e.g., go vs. no go) toward these products in cognitive training tasks. However, it is unclear how this nonreinforced learning compares to reinforcement learning. Moreover, recent work on reinforcement learning has uncovered a basic learning mechanism, the action-valence asymmetry, which points to the possibility that reward and punishment learning may not always outperform learning without any external reinforcement. Here, we report two well-powered preregistered experiments (experiment 1a: N = 72; experiment 1b: N = 81) that examined when reinforcement learning outperforms nonreinforced learning in modifying people's preferences for food. Our findings show that reinforcement learning notably surpasses nonreinforced learning, but only when active responses (go) are rewarded, and inactions (no-go) are reinforced by avoiding punishments. These results shed light on interventions that combine rewards and punishments to facilitate changes in food preferences.

Brain-Inspired Learning, Perception, and Cognition: A Comprehensive Review

The progress of brain cognition and learning mechanisms has provided new inspiration for the next generation of artificial intelligence (AI) and provided the biological basis for the establishment of new models and methods. Brain science can effectively improve the intelligence of existing models and systems. Compared with other reviews, this article provides a comprehensive review of brain-inspired deep learning algorithms for learning, perception, and cognition from microscopic, mesoscopic, macroscopic, and super-macroscopic perspectives. First, this article introduces the brain cognition mechanism. Then, it summarizes the existing studies on brain-inspired learning and modeling from the perspectives of neural structure, cognitive module, learning mechanism, and behavioral characteristics. Next, this article introduces the potential learning directions of brain-inspired learning from four aspects: perception, cognition, understanding, and decision-making. Finally, the top-ten open problems that brain-inspired learning, perception, and cognition currently face are summarized, and the next generation of AI technology has been prospected. This work intends to provide a quick overview of the research on brain-inspired AI algorithms and to motivate future research by illuminating the latest developments in brain science.

Decrease in decision noise from adolescence into adulthood mediates an increase in more sophisticated choice behaviors and performance gain

Learning and decision-making undergo substantial developmental changes, with adolescence being a particular vulnerable window of opportunity. In adolescents, developmental changes in specific choice behaviors have been observed (e.g., goal-directed behavior, motivational influences over choice). Elevated levels of decision noise, i.e., choosing suboptimal options, were reported consistently in adolescents. However, it remains unknown whether these observations, the development of specific and more sophisticated choice processes and higher decision noise, are independent or related. It is conceivable, but has not yet been investigated, that the development of specific choice processes might be impacted by age-dependent changes in decision noise. To answer this, we examined 93 participants (12 to 42 years) who completed 3 reinforcement learning (RL) tasks: a motivational Go/NoGo task assessing motivational influences over choices, a reversal learning task capturing adaptive decision-making in response to environmental changes, and a sequential choice task measuring goal-directed behavior. This allowed testing of (1) cross-task generalization of computational parameters focusing on decision noise; and (2) assessment of mediation effects of noise on specific choice behaviors. Firstly, we found only noise levels to be strongly correlated across RL tasks. Second, and critically, noise levels mediated age-dependent increases in more sophisticated choice behaviors and performance gain. Our findings provide novel insights into the computational processes underlying developmental changes in decision-making: namely a vital role of seemingly unspecific changes in noise in the specific development of more complex choice components. Studying the neurocomputational mechanisms of how varying levels of noise impact distinct aspects of learning and decision processes may also be key to better understand the developmental onset of psychiatric diseases.

Using recurrent neural network to estimate irreducible stochasticity in human choice behavior

Theoretical computational models are widely used to describe latent cognitive processes. However, these models do not equally explain data across participants, with some individuals showing a bigger predictive gap than others. In the current study, we examined the use of theory-independent models, specifically recurrent neural networks (RNNs), to classify the source of a predictive gap in the observed data of a single individual. This approach aims to identify whether the low predictability of behavioral data is mainly due to noisy decision-making or misspecification of the theoretical model. First, we used computer simulation in the context of reinforcement learning to demonstrate that RNNs can be used to identify model misspecification in simulated agents with varying degrees of behavioral noise. Specifically, both prediction performance and the number of RNN training epochs (i.e., the point of early stopping) can be used to estimate the amount of stochasticity in the data. Second, we applied our approach to an empirical dataset where the actions of low IQ participants, compared with high IQ participants, showed lower predictability by a well-known theoretical model (i.e., Daw's hybrid model for the two-step task). Both the predictive gap and the point of early stopping of the RNN suggested that model misspecification is similar across individuals. This led us to a provisional conclusion that low IQ subjects are mostly noisier compared to their high IQ peers, rather than being more misspecified by the theoretical model. We discuss the implications and limitations of this approach, considering the growing literature in both theoretical and data-driven computational modeling in decision-making science.

Information search under uncertainty across transdiagnostic psychopathology and healthy ageing

When making decisions in everyday life, we often rely on an internally generated sense of confidence to help us revise and direct future behaviours. For instance, confidence directly informs whether further information should be sought prior to commitment to a final decision. Many studies have shown that aging and both clinical and sub-clinical symptoms of psychopathology are associated with systematic alterations in confidence. However, it remains unknown whether these confidence distortions influence information-seeking behaviour. We investigated this question in a large general population sample (N = 908). Participants completed a battery of psychiatric symptom questionnaires and performed a perceptual decision-making task with confidence ratings in which they were offered the option to seek helpful information (at a cost) before committing to a final decision. Replicating previous findings, an 'anxious-depression' (AD) symptom dimension was associated with systematically low confidence, despite no detriment in objective task accuracy. Conversely, a 'compulsive behaviour and intrusive thoughts' (CIT) dimension was associated with impaired task accuracy but paradoxical over-confidence. However, neither symptom dimension was significantly associated with an increased or decreased tendency to seek information. Hence, participants scoring highly for AD or CIT did not use the option to information seek any more than average to either increase their confidence (AD) or improve the accuracy of their decisions (CIT). In contrast, older age was associated with impaired accuracy and decreased confidence initially, but increased information seeking behaviour mediated increases in both accuracy and confidence for final decisions. Hence, older adults used the information seeking option to overcome initial deficits in objective performance and to increase their confidence accordingly. The results show an appropriate use of information seeking to overcome perceptual deficits and low confidence in healthy aging which was not present in transdiagnostic psychopathology.

Beta activity in human anterior cingulate cortex mediates reward biases

The rewards that we get from our choices and actions can have a major influence on our future behavior. Understanding how reward biasing of behavior is implemented in the brain is important for many reasons, including the fact that diminution in reward biasing is a hallmark of clinical depression. We hypothesized that reward biasing is mediated by the anterior cingulate cortex (ACC), a cortical hub region associated with the integration of reward and executive control and with the etiology of depression. To test this hypothesis, we recorded neural activity during a biased judgment task in patients undergoing intracranial monitoring for either epilepsy or major depressive disorder. We found that beta (12-30 Hz) oscillations in the ACC predicted both associated reward and the size of the choice bias, and also tracked reward receipt, thereby predicting bias on future trials. We found reduced magnitude of bias in depressed patients, in whom the beta-specific effects were correspondingly reduced. Our findings suggest that ACC beta oscillations may orchestrate the learning of reward information to guide adaptive choice, and, more broadly, suggest a potential biomarker for anhedonia and point to future development of interventions to enhance reward impact for therapeutic benefit.

Jumping to attributions during social evaluation

Social learning is crucial for human relationships and well-being. Self- and other- evaluations are universal experiences, playing key roles in many psychiatric disorders, particularly anxiety and depression. We aimed to deepen our understanding of the computational mechanisms behind social learning, which have been implicated in internalizing conditions like anxiety and depression. We built on prior work based on the Social Evaluation Learning Task (SELT) and introduced a new computational model to better explain rapid initial inferences and progressive refinement during serial social evaluations. The Social Evaluation Learning Task-Revised (SELT-R) was improved by stakeholder input, making it more engaging and suitable for adolescents. A sample of 130 adults from the UK completed the SELT-R and questionnaires assessing symptoms of depression and anxiety. 'Classify-refine' computational models were compared with previously successful Bayesian models. The 'classify-refine' models performed better, providing insight into how people infer the attributes and motives of others. Parameters of the best fitting model from the SELT-R were correlated with Anxiety factor scores, with higher symptoms associated with greater decision noise and higher (less flexible) policy certainty. Our results replicate findings regarding the classify-refine process and set the stage for future investigations into the cognitive mechanisms of self and other evaluations in internalizing disorders.

Common neural dysfunction of economic decision-making across psychiatric conditions

Adaptive decision-making, which is often impaired in various psychiatric conditions, is essential for well-being. Recent evidence has indicated that decision-making capacity in multiple tasks could be accounted for by latent dimensions, enlightening the question of whether there is a common disruption of brain networks in economic decision-making across psychiatric conditions. Here, we addressed the issue by combining activation/lesion network mapping analyses with a transdiagnostic brain imaging meta-analysis. Our findings indicate that there were transdiagnostic alterations in the thalamus and ventral striatum during the decision or outcome stage of decision-making. The identified regions represent key nodes in a large-scale network, which is composed of multiple heterogeneous brain regions and plays a causal role in motivational functioning. The findings suggest that disturbances in the network associated with emotion- and reward-related processing play a key role in dysfunctions of decision-making observed in various psychiatric conditions. This study provides the first meta-analytic evidence of common neural alterations linked to deficits in economic decision-making.

A cognitive-computational account of mood swings in adolescence

Teenagers have a reputation for being fickle, in both their choices and their moods. This variability may help adolescents as they begin to independently navigate novel environments. Recently, however, adolescent moodiness has also been linked to psychopathology. Here, we consider adolescents' mood swings from a novel computational perspective, grounded in reinforcement learning (RL). This model proposes that mood is determined by surprises about outcomes in the environment, and how much we learn from these surprises. It additionally suggests that mood biases learning and choice in a bidirectional manner. Integrating independent lines of research, we sketch a cognitive-computational account of how adolescents' mood, learning, and choice dynamics influence each other, with implications for normative and psychopathological development.

An item response theory analysis of the matrix reasoning item bank (MaRs-IB)

Matrix reasoning tasks are among the most widely used measures of cognitive ability in the behavioral sciences, but the lack of matrix reasoning tests in the public domain complicates their use. Here, we present an extensive investigation and psychometric validation of the matrix reasoning item bank (MaRs-IB), an open-access set of matrix reasoning items. In a first study, we calibrate the psychometric functioning of the items in the MaRs-IB in a large sample of adult participants (N = 1501). Using additive multilevel item structure models, we establish that the MaRs-IB has many desirable psychometric properties: its items span a wide range of difficulty, possess medium-to-large levels of discrimination, and exhibit robust associations between item complexity and difficulty. However, we also find that item clones are not always psychometrically equivalent and cannot be assumed to be exchangeable. In a second study, we demonstrate how experimenters can use the estimated item parameters to design new matrix reasoning tests using optimal item assembly. Specifically, we design and validate two new sets of test forms in an independent sample of adults (N = 600). We find these new tests possess good reliability and convergent validity with an established measure of matrix reasoning. We hope that the materials and results made available here will encourage experimenters to use the MaRs-IB in their research.

Effort Foraging Task reveals positive correlation between individual differences in the cost of cognitive and physical effort in humans

Effort-based decisions, in which people weigh potential future rewards against effort costs required to achieve those rewards involve both cognitive and physical effort, though the mechanistic relationship between them is not yet understood. Here, we use an individual differences approach to isolate and measure the computational processes underlying effort-based decisions and test the association between cognitive and physical domains. Patch foraging is an ecologically valid reward rate maximization problem with well-developed theoretical tools. We developed the Effort Foraging Task, which embedded cognitive or physical effort into patch foraging, to quantify the cost of both cognitive and physical effort indirectly, by their effects on foraging choices. Participants chose between harvesting a depleting patch, or traveling to a new patch that was costly in time and effort. Participants' exit thresholds (reflecting the reward they expected to receive by harvesting when they chose to travel to a new patch) were sensitive to cognitive and physical effort demands, allowing us to quantify the perceived effort cost in monetary terms. The indirect sequential choice style revealed effort-seeking behavior in a minority of participants (preferring high over low effort) that has apparently been missed by many previous approaches. Individual differences in cognitive and physical effort costs were positively correlated, suggesting that these are perceived and processed in common. We used canonical correlation analysis to probe the relationship of task measures to self-reported affect and motivation, and found correlations of cognitive effort with anxiety, cognitive function, behavioral activation, and self-efficacy, but no similar correlations with physical effort.

The abilities of movie-watching functional connectivity in individual identifications and individualized predictions

Quite a few studies have been performed based on movie-watching functional connectivity (FC). As compared to its resting-state counterpart, however, there is still much to know about its abilities in individual identifications and individualized predictions. To pave the way for appropriate usage of movie-watching FC, we systemically evaluated the minimum number of time points, as well as the exact functional networks, supporting individual identifications and individualized predictions of apparent traits based on it. We performed the study based on the 7T movie-watching fMRI data included in the HCP S1200 Release, and took IQ as the test case for the prediction analyses. The results indicate that movie-watching FC based on only 15 time points can support successful individual identifications (99.47%), and the connectivity contributed more to identifications were much associated with higher-order cognitive processes (the secondary visual network, the frontoparietal network and the posterior multimodal network). For individualized predictions of IQ, it was found that successful predictions necessitated 60 time points (predicted vs. actual IQ correlation significant at P < 0.05, based on 5,000 permutations), and the prediction accuracy increased logarithmically with the number of time points used for connectivity calculation. Furthermore, the connectivity that contributed more to individual identifications exhibited the strongest prediction ability. Collectively, our findings demonstrate that movie-watching FC can capture rich information about human brain function, and its ability in individualized predictions depends heavily on the length of fMRI scans.

Anxiety associated with perceived uncontrollable stress enhances expectations of environmental volatility and impairs reward learning

Unavoidable stress can lead to perceived lack of control and learned helplessness, a risk factor for depression. Avoiding punishment and gaining rewards involve updating the values of actions based on experience. Such updating is however useful only if action values are sufficiently stable, something that a lack of control may impair. We examined whether self-reported stress uncontrollability during the first wave of the COVID-19 pandemic predicted impaired reward-learning. In a preregistered study during the first-wave of the COVID-19 pandemic, we used self-reported measures of depression, anxiety, uncontrollable stress, and COVID-19 risk from 427 online participants to predict performance in a three-armed-bandit probabilistic reward learning task. As hypothesised, uncontrollable stress predicted impaired learning, and a greater proportion of probabilistic errors following negative feedback for correct choices, an effect mediated by state anxiety. A parameter from the best-fitting hidden Markov model that estimates expected beliefs that the identity of the optimal choice will shift across images, mediated effects of state anxiety on probabilistic errors and learning deficits. Our findings show that following uncontrollable stress, anxiety promotes an overly volatile representation of the reward-structure of uncertain environments, impairing reward attainment, which is a potential path to anhedonia in depression.

The decision-making in dribbling: a video analysis study of U10 soccer players' skills and coaches' quality evaluation

INTRODUCTION

Dribbling is an important soccer skill that, when effective, allows players to overcome opponents. It can provide a strong tactical advantage; for this reason, all of its components (sprint, speed, and ball control) are fundamental to the development of young players. Dribbling can also be considered a decision-making process, and due to its characteristics, it is not always easy to study ecologically. Using a video analysis study, this research aimed to determine whether dribbling skills, specifically dribbling choice (i.e., decision-making), were related to U10 soccer players' quality.

METHODS

Several outcomes measures, divided into three categories, were taken during video analyses: (i) measures related to the efficacy of dribbling skill; (ii) measures related to the ability of players without the ball to support the player in possession; and (iii) measures related to ball circulation. These data were retrospectively assessed to whether the coaches had formed the teams in training through an implicit knowledge of the players' dribbling skills.

RESULTS

The percentage of accurate dribbling (that is, the ability to perform correct passes after a successful dribble) was found to be the variable that coaches may have implicitly used in creating the three groups differentiated by technical skills (p < 0.05). In fact, this percentage was 12.9%, 24.0%, and 48.1% for the groups with lower, average, and higher technical skills, respectively.

CONCLUSION

Overall, the results demonstrate that dribbling accuracy has an important weight in the coach's evaluation of the technical skills level of young soccer players.

From Computation to Clinic

Theory-driven and data-driven computational approaches to psychiatry have enormous potential for elucidating mechanism of disease and providing translational linkages between basic science findings and the clinic. These approaches have already demonstrated utility in providing clinically relevant understanding, primarily via back translation from clinic to computation, revealing how specific disorders or symptoms map onto specific computational processes. Nonetheless, forward translation, from computation to clinic, remains rare. In addition, consensus regarding specific barriers to forward translation-and on the best strategies to overcome these barriers-is limited. This perspective review brings together expert basic and computationally trained researchers and clinicians to 1) identify challenges specific to preclinical model systems and clinical translation of computational models of cognition and affect, and 2) discuss practical approaches to overcoming these challenges. In doing so, we highlight recent evidence for the ability of computational approaches to predict treatment responses in psychiatric disorders and discuss considerations for maximizing the clinical relevance of such models (e.g., via longitudinal testing) and the likelihood of stakeholder adoption (e.g., via cost-effectiveness analyses).

Testing hypotheses about the harm that capitalism causes to the mind and brain: a theoretical framework for neuroscience research

In this paper, we will attempt to outline the key ideas of a theoretical framework for neuroscience research that reflects critically on the neoliberal capitalist context. We argue that neuroscience can and should illuminate the effects of neoliberal capitalism on the brains and minds of the population living under such socioeconomic systems. Firstly, we review the available empirical research indicating that the socio-economic environment is harmful to minds and brains. We, then, describe the effects of the capitalist context on neuroscience itself by presenting how it has been influenced historically. In order to set out a theoretical framework that can generate neuroscientific hypotheses with regards to the effects of the capitalist context on brains and minds, we suggest a categorization of the effects, namely deprivation, isolation and intersectional effects. We also argue in favor of a neurodiversity perspective [as opposed to the dominant model of conceptualizing neural (mal-)functioning] and for a perspective that takes into account brain plasticity and potential for change and adaptation. Lastly, we discuss the specific needs for future research as well as a frame for post-capitalist research.

Task fMRI paradigms may capture more behaviorally relevant information than resting-state functional connectivity

Characterizing the optimal fMRI paradigms for detecting behaviorally relevant functional connectivity (FC) patterns is a critical step to furthering our knowledge of the neural basis of behavior. Previous studies suggested that FC patterns derived from task fMRI paradigms, which we refer to as task-based FC, are better correlated with individual differences in behavior than resting-state FC, but the consistency and generalizability of this advantage across task conditions was not fully explored. Using data from resting-state fMRI and three fMRI tasks from the Adolescent Brain Cognitive Development Study ® (ABCD), we tested whether the observed improvement in behavioral prediction power of task-based FC can be attributed to changes in brain activity induced by the task design. We decomposed the task fMRI time course of each task into the task model fit (the fitted time course of the task condition regressors from the single-subject general linear model) and the task model residuals, calculated their respective FC, and compared the behavioral prediction performance of these FC estimates to resting-state FC and the original task-based FC. The FC of the task model fit was better than the FC of the task model residual and resting-state FC at predicting a measure of general cognitive ability or two measures of performance on the fMRI tasks. The superior behavioral prediction performance of the FC of the task model fit was content-specific insofar as it was only observed for fMRI tasks that probed similar cognitive constructs to the predicted behavior of interest. To our surprise, the task model parameters, the beta estimates of the task condition regressors, were equally if not more predictive of behavioral differences than all FC measures. These results showed that the observed improvement of behavioral prediction afforded by task-based FC was largely driven by the FC patterns associated with the task design. Together with previous studies, our findings highlighted the importance of task design in eliciting behaviorally meaningful brain activation and FC patterns.

Computational Mechanisms of Addiction and Anxiety: A Developmental Perspective

A central goal of computational psychiatry is to identify systematic relationships between transdiagnostic dimensions of psychiatric symptomatology and the latent learning and decision-making computations that inform individuals' thoughts, feelings, and choices. Most psychiatric disorders emerge prior to adulthood, yet little work has extended these computational approaches to study the development of psychopathology. Here, we lay out a roadmap for future studies implementing this approach by developing empirically and theoretically informed hypotheses about how developmental changes in model-based control of action and Pavlovian learning processes may modulate vulnerability to anxiety and addiction. We highlight how insights from studies leveraging computational approaches to characterize the normative developmental trajectories of clinically relevant learning and decision-making processes may suggest promising avenues for future developmental computational psychiatry research.

Diminished reinforcement sensitivity in adolescence is associated with enhanced response switching and reduced coding of choice probability in the medial frontal pole

Precisely charting the maturation of core neurocognitive functions such as reinforcement learning (RL) and flexible adaptation to changing action-outcome contingencies is key for developmental neuroscience and adjacent fields like developmental psychiatry. However, research in this area is both sparse and conflicted, especially regarding potentially asymmetric development of learning for different motives (obtain wins vs avoid losses) and learning from valenced feedback (positive vs negative). In the current study, we investigated the development of RL from adolescence to adulthood, using a probabilistic reversal learning task modified to experimentally separate motivational context and feedback valence, in a sample of 95 healthy participants between 12 and 45. We show that adolescence is characterized by enhanced novelty seeking and response shifting especially after negative feedback, which leads to poorer returns when reward contingencies are stable. Computationally, this is accounted for by reduced impact of positive feedback on behavior. We also show, using fMRI, that activity of the medial frontopolar cortex reflecting choice probability is attenuated in adolescence. We argue that this can be interpreted as reflecting diminished confidence in upcoming choices. Interestingly, we find no age-related differences between learning in win and loss contexts.

Investigating associations of delay discounting with brain structure, working memory, and episodic memory

INTRODUCTION

Delay discounting (DD), the preference for smaller and sooner rewards over larger and later ones, is an important behavioural phenomenon for daily functioning of increasing interest within psychopathology. The neurobiological mechanisms behind DD are not well understood and the literature on structural correlates of DD shows inconsistencies.

METHODS

Here we leveraged a large openly available dataset (n = 1196) to investigate associations with memory performance and gray and white matter correlates of DD using linked independent component analysis.

RESULTS

Greater DD was related to smaller anterior temporal gray matter volume. Associations of DD with total cortical volume, subcortical volumes, markers of white matter microscopic organization, working memory, and episodic memory scores were not significant after controlling for education and income.

CONCLUSION

Effects of size comparable to the one we identified would be unlikely to be replicated with sample sizes common in many previous studies in this domain, which may explain the incongruities in the literature. The paucity and small size of the effects detected in our data underscore the importance of using large samples together with methods that accommodate their statistical structure and appropriate control for confounders, as well as the need to devise paradigms with improved task parameter reliability in studies relating brain structure and cognitive abilities with DD.

Efficient stabilization of imprecise statistical inference through conditional belief updating

Statistical inference is the optimal process for forming and maintaining accurate beliefs about uncertain environments. However, human inference comes with costs due to its associated biases and limited precision. Indeed, biased or imprecise inference can trigger variable beliefs and unwarranted changes in behaviour. Here, by studying decisions in a sequential categorization task based on noisy visual stimuli, we obtained converging evidence that humans reduce the variability of their beliefs by updating them only when the reliability of incoming sensory information is judged as sufficiently strong. Instead of integrating the evidence provided by all stimuli, participants actively discarded as much as a third of stimuli. This conditional belief updating strategy shows good test-retest reliability, correlates with perceptual confidence and explains human behaviour better than previously described strategies. This seemingly suboptimal strategy not only reduces the costs of imprecise computations but also, counterintuitively, increases the accuracy of resulting decisions.

The interpretation of computational model parameters depends on the context

Reinforcement Learning (RL) models have revolutionized the cognitive and brain sciences, promising to explain behavior from simple conditioning to complex problem solving, to shed light on developmental and individual differences, and to anchor cognitive processes in specific brain mechanisms. However, the RL literature increasingly reveals contradictory results, which might cast doubt on these claims. We hypothesized that many contradictions arise from two commonly-held assumptions about computational model parameters that are actually often invalid: That parameters generalize between contexts (e.g. tasks, models) and that they capture interpretable (i.e. unique, distinctive) neurocognitive processes. To test this, we asked 291 participants aged 8-30 years to complete three learning tasks in one experimental session, and fitted RL models to each. We found that some parameters (exploration / decision noise) showed significant generalization: they followed similar developmental trajectories, and were reciprocally predictive between tasks. Still, generalization was significantly below the methodological ceiling. Furthermore, other parameters (learning rates, forgetting) did not show evidence of generalization, and sometimes even opposite developmental trajectories. Interpretability was low for all parameters. We conclude that the systematic study of context factors (e.g. reward stochasticity; task volatility) will be necessary to enhance the generalizability and interpretability of computational cognitive models.

Exploration heuristics decrease during youth

Deciding between exploring new avenues and exploiting known choices is central to learning, and this exploration-exploitation trade-off changes during development. Exploration is not a unitary concept, and humans deploy multiple distinct mechanisms, but little is known about their specific emergence during development. Using a previously validated task in adults, changes in exploration mechanisms were investigated between childhood (8-9 y/o, N = 26; 16 females), early (12-13 y/o, N = 38; 21 females), and late adolescence (16-17 y/o, N = 33; 19 females) in ethnically and socially diverse schools from disadvantaged areas. We find an increased usage of a computationally light exploration heuristic in younger groups, effectively accommodating their limited neurocognitive resources. Moreover, this heuristic was associated with self-reported, attention-deficit/hyperactivity disorder symptoms in this population-based sample. This study enriches our mechanistic understanding about how exploration strategies mature during development.

Psychiatrically relevant signatures of domain-general decision-making and metacognition in the general population

Human behaviours are guided by how confident we feel in our abilities. When confidence does not reflect objective performance, this can impact critical adaptive functions and impair life quality. Distorted decision-making and confidence have been associated with mental health problems. Here, utilising advances in computational and transdiagnostic psychiatry, we sought to map relationships between psychopathology and both decision-making and confidence in the general population across two online studies (N's = 344 and 473, respectively). The results revealed dissociable decision-making and confidence signatures related to distinct symptom dimensions. A dimension characterised by compulsivity and intrusive thoughts was found to be associated with reduced objective accuracy but, paradoxically, increased absolute confidence, whereas a dimension characterized by anxiety and depression was associated with systematically low confidence in the absence of impairments in objective accuracy. These relationships replicated across both studies and distinct cognitive domains (perception and general knowledge), suggesting that they are reliable and domain general. Additionally, whereas Big-5 personality traits also predicted objective task performance, only symptom dimensions related to subjective confidence. Domain-general signatures of decision-making and metacognition characterise distinct psychological dispositions and psychopathology in the general population and implicate confidence as a central component of mental health.

Effects of comorbid disorders on reward processing and connectivity in adults with ADHD

ADHD is a neurodevelopmental disorder with a long trajectory into adulthood where it is often comorbid with depression, substance use disorder (SUD) or obesity. Previous studies described a dysregulated dopaminergic system, reflected by abnormal reward processing, both in ADHD as well as in depression, SUD or obesity. No study so far however tested systematically whether pathologies in the brain's reward system explain the frequent comorbidity in adult ADHD. To test this, we acquired MRI scans from 137 participants probing the reward system by a monetary incentive delay task (MIDT) as well as assessing resting-state connectivity with ventral striatum as a seed mask. No differences were found between comorbid disorders, but a significant linear effect pointed toward less left intrastriatal connectivity in patients depending on the number of comorbidities. This points towards a neurobiologically impaired reward- and decision-making ability in patients with more comorbid disorders. This suggests that less intrastriatal connectivity parallels disorder severity but not disorder specificity, while MIDT abnormalities seem mainly to be driven by ADHD.

Decision-making as transdiagnostic construct for mental health research

Transdiagnostic research and linking behavioral, neural, and symptom measures are important endeavors in clinical neuroscience and biological psychiatry. In this issue of Neuron, Moutoussis et al. (2021) describe a new cognitive construct-decision acuity-that is related to mental health symptoms and distinct resting-state networks.