From exploration to exploitation: a shifting mental mode in late life development

Locus coeruleus integrity is related to an exploitation-based decision-making bias in older adulthood

Optimal decision-making balances exploration for new information against exploitation of known rewards, a process mediated by the locus coeruleus and its norepinephrine projections. We predicted that an exploitation-bias that emerges in older adulthood would be associated with lower microstructural integrity of the locus coeruleus. Leveraging in vivo histological methods from quantitative MRI-magnetic transfer saturation-we provide evidence that older age is associated with lower locus coeruleus integrity. Critically, we demonstrate that an exploitation bias in older adulthood, assessed with a foraging task, is sensitive and specific to lower locus coeruleus integrity. Because the locus coeruleus is uniquely vulnerable to Alzheimer's disease pathology, our findings suggest that aging, and a presymptomatic trajectory of Alzheimer's related decline, may fundamentally alter decision-making abilities in later life.

Modeling the neurocognitive dynamics of language across the lifespan

Healthy aging is associated with a heterogeneous decline across cognitive functions, typically observed between language comprehension and language production (LP). Examining resting-state fMRI and neuropsychological data from 628 healthy adults (age 18-88) from the CamCAN cohort, we performed state-of-the-art graph theoretical analysis to uncover the neural mechanisms underlying this variability. At the cognitive level, our findings suggest that LP is not an isolated function but is modulated throughout the lifespan by the extent of inter-cognitive synergy between semantic and domain-general processes. At the cerebral level, we show that default mode network (DMN) suppression coupled with fronto-parietal network (FPN) integration is the way for the brain to compensate for the effects of dedifferentiation at a minimal cost, efficiently mitigating the age-related decline in LP. Relatedly, reduced DMN suppression in midlife could compromise the ability to manage the cost of FPN integration. This may prompt older adults to adopt a more cost-efficient compensatory strategy that maintains global homeostasis at the expense of LP performances. Taken together, we propose that midlife represents a critical neurocognitive juncture that signifies the onset of LP decline, as older adults gradually lose control over semantic representations. We summarize our findings in a novel synergistic, economical, nonlinear, emergent, cognitive aging model, integrating connectomic and cognitive dimensions within a complex system perspective.

Getting LOST: A conceptual framework for supporting and enhancing spatial navigation in aging

Spatial navigation is more difficult and effortful for older than younger individuals, a shift which occurs for a variety of neurological, physical, and cognitive reasons associated with aging. Despite a large body of evidence documenting age-related deficits in spatial navigation, comparatively less research addresses how to facilitate more effective navigation behavior for older adults. Since navigation challenges arise for a variety of reasons in old age, a one-size-fits-all solution is unlikely to work. Here, we introduce a framework for the variety of spatial navigation challenges faced in aging, which we call LOST-Location, Orientation, Spatial mapping, and Transit. The LOST framework builds on evidence from the cognitive neuroscience of spatial navigation, which reveals distinct components underpinning human wayfinding. We evaluate research on navigational aids-devices and depictions-which help people find their way around; and we reflect on how navigation aids solve (or fail to solve) specific wayfinding difficulties faced by older adults. In summary, we emphasize a bespoke approach to improving spatial navigation in aging, which focuses on tailoring navigation solutions to specific navigation challenges. Our hope is that by providing precise support to older navigators, navigation opportunities can facilitate independence and exploration, while minimizing the danger of becoming lost. We conclude by delineating critical knowledge gaps in how to improve older adults' spatial navigation capacities that the novel LOST framework could guide to address. This article is categorized under: Psychology > Development and Aging Neuroscience > Cognition Neuroscience > Behavior.

Exploration versus exploitation decisions in the human brain: A systematic review of functional neuroimaging and neuropsychological studies

Thoughts and actions are often driven by a decision to either explore new avenues with unknown outcomes, or to exploit known options with predictable outcomes. Yet, the neural mechanisms underlying this exploration-exploitation trade-off in humans remain poorly understood. This is attributable to variability in the operationalization of exploration and exploitation as psychological constructs, as well as the heterogeneity of experimental protocols and paradigms used to study these choice behaviours. To address this gap, here we present a comprehensive review of the literature to investigate the neural basis of explore-exploit decision-making in humans. We first conducted a systematic review of functional magnetic resonance imaging (fMRI) studies of exploration-versus exploitation-based decision-making in healthy adult humans during foraging, reinforcement learning, and information search. Eleven fMRI studies met inclusion criterion for this review. Adopting a network neuroscience framework, synthesis of the findings across these studies revealed that exploration-based choice was associated with the engagement of attentional, control, and salience networks. In contrast, exploitation-based choice was associated with engagement of default network brain regions. We interpret these results in the context of a network architecture that supports the flexible switching between externally and internally directed cognitive processes, necessary for adaptive, goal-directed behaviour. To further investigate potential neural mechanisms underlying the exploration-exploitation trade-off we next surveyed studies involving neurodevelopmental, neuropsychological, and neuropsychiatric disorders, as well as lifespan development, and neurodegenerative diseases. We observed striking differences in patterns of explore-exploit decision-making across these populations, again suggesting that these two decision-making modes are supported by independent neural circuits. Taken together, our review highlights the need for precision-mapping of the neural circuitry and behavioural correlates associated with exploration and exploitation in humans. Characterizing exploration versus exploitation decision-making biases may offer a novel, trans-diagnostic approach to assessment, surveillance, and intervention for cognitive decline and dysfunction in normal development and clinical populations.

How does apathy impact exploration-exploitation decision-making in older patients with neurocognitive disorders?

Apathy is a pervasive clinical syndrome in neurocognitive disorders, characterized by a quantitative reduction in goal-directed behaviors. The brain structures involved in the physiopathology of apathy have also been connected to the brain structures involved in probabilistic reward learning in the exploration-exploitation dilemma. This dilemma in question involves the challenge of selecting between a familiar option with a more predictable outcome, and another option whose outcome is uncertain and may yield potentially greater rewards compared to the known option. The aim of this study was to combine experimental procedures and computational modeling to examine whether, in older adults with mild neurocognitive disorders, apathy affects performance in the exploration-exploitation dilemma. Through using a four-armed bandit reinforcement-learning task, we showed that apathetic older adults explored more and performed worse than non-apathetic subjects. Moreover, the mental flexibility assessed by the Trail-making test-B was negatively associated with the percentage of exploration. These results suggest that apathy is characterized by an increased explorative behavior and inefficient decision-making, possibly due to weak mental flexibility to switch toward the exploitation of the more rewarding options. Apathetic participants also took longer to make a choice and failed more often to respond in the allotted time, which could reflect the difficulties in action initiation and selection. In conclusion, the present results suggest that apathy in participants with neurocognitive disorders is associated with specific disturbances in the exploration-exploitation trade-off and sheds light on the disturbances in reward processing in patients with apathy.

Early adversity and the development of explore-exploit tradeoffs

Childhood adversity can have wide-ranging and long-lasting effects on later life. But what are the mechanisms that are responsible for these effects? This article brings together the cognitive science literature on explore-exploit tradeoffs, the empirical literature on early adversity, and the literature in evolutionary biology on 'life history' to explain how early experience influences later life. We propose one potential mechanism: early experiences influence 'hyperparameters' that determine the balance between exploration and exploitation. Adversity might accelerate a shift from exploration to exploitation, with broad and enduring effects on the adult brain and mind. These effects may be produced by life-history adaptations that use early experience to tailor development and learning to the likely future states of an organism and its environment.

The cognitive tenacity of self-directed ageism

Ageism refers to prejudice or discrimination based on a person's age. When ageism is directed at older people, it is unique in two ways: it is socially condoned in a manner that other types of prejudice are not, and the animus is eventually self-directed. Of central interest here is why ageism becomes self-directed in late adulthood, despite its potentially harmful personal costs. We present a cognitive model in which negative ageist beliefs become increasingly accessible and difficult to eliminate owing to broader developmental shifts in mentation. Given that these effects are contingent on our social environment, systemic changes in societal conceptions of age and aging are needed if we are to reduce vulnerability to self-directed ageism.

Age-related differences in Default Mode Network resting-state functional connectivity but not gray matter volume relate to sacrificial moral decision-making and working memory performance

Older adults make fewer utilitarian decisions than younger adults during sacrificial moral dilemmas, which are associated with age-related reductions in Default Mode Network resting-state functional connectivity. Decreases on tasks associated with fluid cognitive abilities, such as working memory capacity, are also associated with age-related Default Mode Network changes. Regions within this network demonstrate some of the greatest age-related gray matter atrophy. Age-related changes in structure and function of the Default Mode Network may be associated with poorer working memory capacity and reduced utilitarian moral decision-making. Alternatively, recent theories suggest that age-related changes to Default Mode Network function may be adaptive in the context of tasks that include socioemotional components. As such, reduced within-network resting-state functional connectivity of the Default Mode Network may be associated with differential outcomes in moral decision-making for younger and older adults. In the present study, there were no age-related differences in working memory capacity. Older adults were less likely than younger adults to indicate the utilitarian option when trials involved Instrumental harm. Generally, increased within-network resting-state functional connectivity of the Default Mode Network was associated with better working memory performance in both groups, and reduced bias to endorse the utilitarian option during Incidental dilemmas compared to Instrumental dilemmas in younger adults. Older adults with similar moral decision-making behavior to younger adults demonstrated increased coupling between Default Mode Network and Salience Network regions. These findings suggest that Default Mode Network functional integrity may be differentially associated with age-related changes to working memory capacity and sacrificial moral decision-making.

Autobiographical event memory and aging: older adults get the gist

We propose that older adults' ability to retrieve episodic autobiographical events, although often viewed through a lens of decline, reveals much about what is preserved and prioritized in cognitive aging. Central to our proposal is the idea that the so-called gist of an autobiographical event is not only spared with normal aging but also well adapted to serve memory-guided behavior in older age. To support our proposal, we review cognitive and brain evidence indicating an age-related shift toward gist memory. We then discuss why this shift likely arises from more than age-related decline and instead partly reflects a natural, arguably adaptive, outcome of experience, motivation, and mode-of-thinking factors. Our proposal reveals an upside of age-related memory changes and identifies important research questions.

Prediction in the aging brain: Merging cognitive, neurological, and evolutionary perspectives

Although the aging brain is typically characterized by declines in a variety of cognitive functions, there has been growing attention to cognitive functions that may stabilize or improve with age. We integrate evidence from behavioral, computational, and neurological domains under the hypothesis that over the life span the brain becomes more effective at predicting (i.e., utilizing knowledge) compared to learning. Moving beyond mere description of the empirical literature—with the aim of arriving at a deeper understanding of cognitive aging—we provide potential explanations for a learning-to-prediction shift based on evolutionary models and principles of senescence and plasticity. The proposed explanations explore whether the occurrence of a learning-to-prediction shift can be explained by (changes in) the fitness effects of learning and prediction over the life span. Prediction may optimize (a) the allocation of limited resources across the life span, and/or (b) late-life knowledge transfer (social learning). Alternatively, late-life prediction may reflect a slower decline in prediction compared to learning. By discussing these hypotheses, we aim to provide a foundation for an integrative neurocognitive–evolutionary perspective on aging and to stimulate further theoretical and empirical work.

Body mass and sex, but not breeding condition and season, influence open‐field exploration in the yellow‐necked mouse

Theory predicts that risk taking should be influenced by external (e.g., season) and internal (e.g., breeding condition, sex, and body mass) conditions. We investigated whether these factors are associated with a potentially risky behavior: exploration of a novel environment. We conducted repeated open‐field tests of exploration in a common forest rodent, the yellow‐necked mouse Apodemus flavicollis. Contrary to expectations, the exploration did not vary with the season (spring vs. fall) or the reproductive status of the tested animals. Also unexpectedly, there was an inverted U‐shaped relationship between body mass and exploration: animals with intermediate body mass tended to have the highest exploration tendencies. Males were more exploratory than females. Finally, even after adjusting for the effects of body mass and sex, individuals exhibited consistent, repeatable differences in exploration tendencies (“behavioral types” or “personalities”). The discrepancies between certain broad generalizations and our results suggest that risk taking depends on details of species‐specific biology.

Why and How Did Narrative Fictions Evolve? Fictions as Entertainment Technologies

Narrative fictions have surely become the single most widespread source of entertainment in the world. In their free time, humans read novels and comics, watch movies and TV series, and play video games: they consume stories that they know to be false. Such behaviors are expanding at lightning speed in modern societies. Yet, the question of the origin of fictions has been an evolutionary puzzle for decades: Are fictions biological adaptations, or the by-products of cognitive mechanisms that evolved for another purpose? The absence of any consensus in cognitive science has made it difficult to explain how narrative fictions evolve culturally. We argue that current conflicting hypotheses are partly wrong, and partly right: narrative fictions are by-products of the human mind, because they obviously co-opt some pre-existing cognitive preferences and mechanisms, such as our interest for social information, and our abilities to do mindreading and to imagine counterfactuals. But humans reap some fitness benefits from producing and consuming such appealing cultural items, making fictions adaptive. To reconcile these two views, we put forward the hypothesis that narrative fictions are best seen as entertainment technologies that is, as items crafted by some people for the proximate goal to grab the attention of other people, and with the ultimate goal to fulfill other evolutionary-relevant functions that become easier once other people's attention is caught. This hypothesis explains why fictions are filled with exaggerated and entertaining stimuli, why they fit so well the changing preferences of the audience they target, and why producers constantly make their fictions more attractive as time goes by, in a cumulative manner.

How Cues of Being Watched Promote Risk Seeking in Fund Investment in Older Adults

Social cues, such as being watched, can subtly alter fund investment choices. This study aimed to investigate how cues of being watched influence decision-making, attention allocation, and risk tendencies. Using decision scenarios adopted from the “Asian Disease Problem,” we examined participants’ risk tendency in a financial scenario when they were watched. A total of 63 older and 66 younger adults participated. Eye tracking was used to reveal the decision-maker’s attention allocation (fixations and dwell time per word). The results found that both younger and older adults tend to seek risk in the loss frame than in the gain frame (i.e., framing effect). Watching eyes tended to escalate reckless gambling behaviors among older adults, which led them to maintain their share in the depressed fund market, regardless of whether the options were gain or loss framed. The eye-tracking results revealed that older adults gave less attention to the sure option in the eye condition (i.e., fewer fixations and shorter dwell time). However, their attention was maintained on the gamble options. In comparison, images of “watching eyes” did not influence the risk seeking of younger adults but decreased their framing effect. Being watched can affect financial risk preference in decision-making. The exploration of the contextual sensitivity of being watched provides us with insight into developing decision aids to promote rational financial decision-making, such as human-robot interactions. Future research on age differences still requires further replication.