Foraging as an evidence accumulation process

Adapting to Uncertainty: Foraging Strategies in Dinoponera quadriceps (Formicidae: Ponerinae)

When searching for food, animals often make decisions about where to go, how long to stay in a foraging area, and whether to return to the most recently visited spot. These decisions can be enhanced by cognitive traits and adjusted based on previous experience. In social insects, such as ants, foraging efficiency has an impact at both the individual and colony levels. The present study investigated the effect of the distance to, capture success, food size, and the reward rate on decisions of where to forage in Dinoponera quadriceps, a ponerine ant that forages solitarily and makes individual foraging decisions, in laboratory studies. We also investigated the influence of learning on the workers' performance over successive trips to search for food by measuring the patch residence time in each foraging trip. Four scenarios were created that differed in the food reward rates, the food size offered, and the distances from the colony to the food site. Our work demonstrated that as a general rule, the D. quadriceps workers return to the place where a prey item was found on the previous trip, regardless of the distance, food size, and reward rate. When the ants did not capture prey, they were more likely to change their route to search for food. Our results also indicated a learning process for the routes of exploration, as well as the food site conditions for exploration. After repeated trips, the foragers reduced the patch residence time in areas where they did not capture food and quickly changed foraging areas, increasing their foraging efficiency.

A normative framework dissociates need and motivation in hypothalamic neurons

Physiological needs evoke motivational drives that produce natural behaviors for survival. In previous studies, the temporally intertwined dynamics of need and motivation have made it challenging to differentiate these two components. On the basis of classic homeostatic theories, we established a normative framework to derive computational models for need-encoding and motivation-encoding neurons. By combining the model-based predictions and naturalistic experimental paradigms, we demonstrated that agouti-related peptide (AgRP) and lateral hypothalamic leptin receptor (LHLepR) neuronal activities encode need and motivation, respectively. Our model further explains the difference in the dynamics of appetitive behaviors induced by optogenetic stimulation of AgRP or LHLepR neurons. Our study provides a normative modeling framework that explains how hypothalamic neurons separately encode need and motivation in the mammalian brain.

No matter what you do, travel is travel in visual foraging

In visual foraging, foragers collect multiple items from a series of visual displays (or "patches"). When the goal is to maximize the total or the rate of collection of target items, foragers must decide when to leave a depleted patch given that "traveling" from one patch to another incurs a temporal cost. In three experiments, we investigated whether the interposition of a secondary task during travel between patches in visual foraging altered patch-leaving behavior. Over the course of 10- or 30-minute experiments, participants foraged in simulated "berry patches" and traveled to the next patch at will. While they traveled, they either actively performed a secondary task or simply observed passing visual stimuli. Travel time was varied across conditions. The addition of a secondary task, regardless of its relevance to visual foraging, to traveling, or to both, did not impact patch-leaving times in the primary visual foraging task. In Experiment 1 and more weakly in Experiment 2, the patch-leaving decision was based on how long the travel took as predicted by the Marginal Value Theorem (MVT). In Experiment 3, however, patch-leaving did not depend on travel time. Participants 'overharvested' in a manner that suggests that they may have adopted rules different from those of MVT. Across all three experiments, patch-leaving did not depend on the nature of the travel.

Hippocampal representations of alternative possibilities are flexibly generated to meet cognitive demands

The cognitive ability to go beyond the present to consider alternative possibilities, including potential futures and counterfactual pasts, can support adaptive decision making. Complex and changing real-world environments, however, have many possible alternatives. Whether and how the brain can select among them to represent alternatives that meet current cognitive needs remains unknown. We therefore examined neural representations of alternative spatial locations in the rat hippocampus during navigation in a complex patch foraging environment with changing reward probabilities. We found representations of multiple alternatives along paths ahead and behind the animal, including in distant alternative patches. Critically, these representations were modulated in distinct patterns across successive trials: alternative paths were represented proportionate to their evolving relative value and predicted subsequent decisions, whereas distant alternatives were prevalent during value updating. These results demonstrate that the brain modulates the generation of alternative possibilities in patterns that meet changing cognitive needs for adaptive behavior.

A cognitive process model captures near-optimal confidence-guided waiting in rats

Rational decision-makers invest more time pursuing rewards they are more confident they will eventually receive. A series of studies have therefore used willingness to wait for delayed rewards as a proxy for decision confidence. However, interpretation of waiting behavior is limited because it is unclear how environmental statistics influence optimal waiting, and how sources of internal variability influence subjects' behavior. We trained rats to perform a confidence-guided waiting task, and derived expressions for optimal waiting that make relevant environmental statistics explicit, including travel time incurred traveling from one reward opportunity to another. We found that rats waited longer than fully optimal agents, but that their behavior was closely matched by optimal agents with travel times constrained to match their own. We developed a process model describing the decision to stop waiting as an accumulation to bound process, which allowed us to compare the effects of multiple sources of internal variability on waiting. Surprisingly, although mean wait times grew with confidence, variability did not, inconsistent with scalar invariant timing, and best explained by variability in the stopping bound. Our results describe a tractable process model that can capture the influence of environmental statistics and internal sources of variability on subjects' decision process during confidence-guided waiting.

Exploration-exploitation trade-off is regulated by metabolic state and taste value in Drosophila

Similar to other animals, the fly, Drosophila melanogaster, changes its foraging strategy from exploration to exploitation upon encountering a nutrient-rich food source. However, the impact of metabolic state or taste/nutrient value on exploration vs. exploitation decisions in flies is poorly understood. Here, we developed a one-source foraging assay that uses automated video tracking coupled with high-resolution measurements of food ingestion to investigate the behavioral variables flies use when foraging for food with different taste/caloric values and when in different metabolic states. We found that flies alter their foraging and ingestive behaviors based on their hunger state and the concentration of the sucrose solution. Interestingly, sugar-blind flies did not transition from exploration to exploitation upon finding a high-concentration sucrose solution, suggesting that taste sensory input, as opposed to post-ingestive nutrient feedback, plays a crucial role in determining the foraging decisions of flies. Using a Generalized Linear Model (GLM), we showed that hunger state and sugar volume ingested, but not the nutrient or taste value of the food, influence flies' radial distance to the food source, a strong indicator of exploitation. Our behavioral paradigm and theoretical framework offer a promising avenue for investigating the neural mechanisms underlying state and value-based foraging decisions in flies, setting the stage for systematically identifying the neuronal circuits that drive these behaviors.

Social environment-based opportunity costs dictate when people leave social interactions

There is an ever-increasing understanding of the cognitive mechanisms underlying how we process others' behaviours during social interactions. However, little is known about how people decide when to leave an interaction. Are these decisions shaped by alternatives in the environment - the opportunity-costs of connecting to other people? Here, participants chose when to leave partners who treated them with varying degrees of fairness, and connect to others, in social environments with different opportunity-costs. Across four studies we find people leave partners more quickly when opportunity-costs are high, both the average fairness of people in the environment and the effort required to connect to another partner. People's leaving times were accounted for by a fairness-adapted evidence accumulation model, and modulated by depression and loneliness scores. These findings demonstrate the computational processes underlying decisions to leave, and highlight atypical social time allocations as a marker of poor mental health.

Visual social information use in collective foraging

Collective dynamics emerge from individual-level decisions, yet we still poorly understand the link between individual-level decision-making processes and collective outcomes in realistic physical systems. Using collective foraging to study the key trade-off between personal and social information use, we present a mechanistic, spatially-explicit agent-based model that combines individual-level evidence accumulation of personal and (visual) social cues with particle-based movement. Under idealized conditions without physical constraints, our mechanistic framework reproduces findings from established probabilistic models, but explains how individual-level decision processes generate collective outcomes in a bottom-up way. In clustered environments, groups performed best if agents reacted strongly to social information, while in uniform environments, individualistic search was most beneficial. Incorporating different real-world physical and perceptual constraints profoundly shaped collective performance, and could even buffer maladaptive herding by facilitating self-organized exploration. Our study uncovers the mechanisms linking individual cognition to collective outcomes in human and animal foraging and paves the way for decentralized robotic applications.

Hierarchical control over foraging behavior by anterior cingulate cortex

Foraging is a natural behavior that involves making sequential decisions to maximize rewards while minimizing the costs incurred when doing so. The prevalence of foraging across species suggests that a common brain computation underlies its implementation. Although anterior cingulate cortex is believed to contribute to foraging behavior, its specific role has been contentious, with predominant theories arguing either that it encodes environmental value or choice difficulty. Additionally, recent attempts to characterize foraging have taken place within the reinforcement learning framework, with increasingly complex models scaling with task complexity. Here we review reinforcement learning foraging models, highlighting the hierarchical structure of many foraging problems. We extend this literature by proposing that ACC guides foraging according to principles of model-based hierarchical reinforcement learning. This idea holds that ACC function is organized hierarchically along a rostral-caudal gradient, with rostral structures monitoring the status and completion of high-level task goals (like finding food), and midcingulate structures overseeing the execution of task options (subgoals, like harvesting fruit) and lower-level actions (such as grabbing an apple).

Attention deficits linked with proclivity to explore while foraging

All mobile organisms forage for resources, choosing how and when to search for new opportunities by comparing current returns with the average for the environment. In humans, nomadic lifestyles favouring exploration have been associated with genetic mutations implicated in attention deficit hyperactivity disorder (ADHD), inviting the hypothesis that this condition may impact foraging decisions in the general population. Here we tested this pre-registered hypothesis by examining how human participants collected resources in an online foraging task. On every trial, participants chose either to continue to collect rewards from a depleting patch of resources or to replenish the patch. Participants also completed a well-validated ADHD self-report screening assessment at the end of sessions. Participants departed resource patches sooner when travel times between patches were shorter than when they were longer, as predicted by optimal foraging theory. Participants whose scores on the ADHD scale crossed the threshold for a positive screen departed patches significantly sooner than participants who did not meet this criterion. Participants meeting this threshold for ADHD also achieved higher reward rates than individuals who did not. Our findings suggest that ADHD attributes may confer foraging advantages in some environments and invite the possibility that this condition may reflect an adaptation favouring exploration over exploitation.

Understanding patch foraging strategies across development

Patch foraging is a near-ubiquitous behaviour across the animal kingdom and characterises many decision-making domains encountered by humans. We review how a disposition to explore in adolescence may reflect the evolutionary conditions under which hunter-gatherers foraged for resources. We propose that neurocomputational mechanisms responsible for reward processing, learning, and cognitive control facilitate the transition from exploratory strategies in adolescence to exploitative strategies in adulthood - where individuals capitalise on known resources. This developmental transition may be disrupted by psychopathology, as there is emerging evidence of biases in explore/exploit choices in mental health problems. Explore/exploit choices may be an informative marker for mental health across development and future research should consider this feature of decision-making as a target for clinical intervention.

Information gathering explains decision dynamics during human and monkey reward foraging

Foraging in humans and other animals requires a delicate balance between exploitation of current resources and exploration for new ones. The tendency to overharvest-lingering too long in depleting patches-is a routine behavioral deviation from predictions of optimal foraging theories. To characterize the computational mechanisms driving these deviations, we modeled foraging behavior using a virtual patch-leaving task with human participants and validated our findings in an analogous foraging task in two monkeys. Both humans and monkeys overharvested and stayed longer in patches with longer travel times compared to shorter ones. Critically, patch residence times in both species declined over the course of sessions, enhancing reward rates in humans. These decisions were best explained by a logistic transformation that integrated both current rewards and information about declining rewards. This parsimonious model demystifies both the occurrence and dynamics of overharvesting, highlighting the role of information gathering in foraging. Our findings provide insight into computational mechanisms shaped by ubiquitous foraging dilemmas, underscoring how behavioral modeling can reveal underlying motivations of seemingly irrational decisions.

Exploration patterns shape cognitive map learning

Spontaneous, volitional spatial exploration is crucial for building up a cognitive map of the environment. However, decades of research have primarily measured the fidelity of cognitive maps after discrete, controlled learning episodes. We know little about how cognitive maps are formed during naturalistic free exploration. Here, we investigated whether exploration trajectories predicted cognitive map accuracy, and how these patterns were shaped by environmental structure. In two experiments, participants freely explored a previously unfamiliar virtual environment. We related their exploration trajectories to a measure of how long they spent in areas with high global environmental connectivity (integration, as assessed by space syntax). In both experiments, we found that participants who spent more time on paths that offered opportunities for integration formed more accurate cognitive maps. Interestingly, we found no support for our pre-registered hypothesis that self-reported trait differences in navigation ability would mediate this relationship. Our findings suggest that exploration patterns predict cognitive map accuracy, even for people who self-report low ability, and highlight the importance of considering both environmental structure and individual variability in formal theory- and model-building.

Visuospatial information foraging describes search behavior in learning latent environmental features

In the real world, making sequences of decisions to achieve goals often depends upon the ability to learn aspects of the environment that are not directly perceptible. Learning these so-called latent features requires seeking information about them. Prior efforts to study latent feature learning often used single decisions, used few features, and failed to distinguish between reward-seeking and information-seeking. To overcome this, we designed a task in which humans and monkeys made a series of choices to search for shapes hidden on a grid. On our task, the effects of reward and information outcomes from uncovering parts of shapes could be disentangled. Members of both species adeptly learned the shapes and preferred to select tiles expected to be informative earlier in trials than previously rewarding ones, searching a part of the grid until their outcomes dropped below the average information outcome-a pattern consistent with foraging behavior. In addition, how quickly humans learned the shapes was predicted by how well their choice sequences matched the foraging pattern, revealing an unexpected connection between foraging and learning. This adaptive search for information may underlie the ability in humans and monkeys to learn latent features to support goal-directed behavior in the long run.

Automatically tracking feeding behavior in populations of foraging C. elegans

Caenorhabditis elegans feeds on bacteria and other small microorganisms which it ingests using its pharynx, a neuromuscular pump. Currently, measuring feeding behavior requires tracking a single animal, indirectly estimating food intake from population-level metrics, or using restrained animals. To enable large throughput feeding measurements of unrestrained, crawling worms on agarose plates at a single worm resolution, we developed an imaging protocol and a complementary image analysis tool called PharaGlow. We image up to 50 unrestrained crawling worms simultaneously and extract locomotion and feeding behaviors. We demonstrate the tool's robustness and high-throughput capabilities by measuring feeding in different use-case scenarios, such as through development, with genetic and chemical perturbations that result in faster and slower pumping, and in the presence or absence of food. Finally, we demonstrate that our tool is capable of long-term imaging by showing behavioral dynamics of mating animals and worms with different genetic backgrounds. The low-resolution fluorescence microscopes required are readily available in C. elegans laboratories, and in combination with our python-based analysis workflow makes this methodology easily accessible. PharaGlow therefore enables the observation and analysis of the temporal dynamics of feeding and locomotory behaviors with high-throughput and precision in a user-friendly system.

Stochastic dynamics of social patch foraging decisions

Animals typically forage in groups. Social foraging can help animals avoid predation and decrease their uncertainty about the richness of food resources. Despite this, theoretical mechanistic models of patch foraging have overwhelmingly focused on the behavior of single foragers. In this study, we develop a mechanistic model that accounts for the behavior of individuals foraging together and departing food patches following an evidence accumulation process. Each individual's belief about patch quality is represented by a stochastically accumulating variable, which is coupled to another's belief to represent the transfer of information. We consider a cohesive group, and model information sharing by considering both intermittent pulsatile coupling (only communicate decision to leave) and continuous diffusive coupling (communicate throughout the deliberation process). Groups employing pulsatile coupling can obtain higher foraging efficiency, which depends more strongly on the coupling parameter compared to those using diffusive coupling. Conversely, groups using diffusive coupling are more robust to changes and heterogeneities in belief weighting and departure criteria. Efficiency is measured by a reward rate function that balances the amount of energy accumulated against the time spent in a patch, computed by solving an ordered first passage time problem for the patch departures of each individual. Using synthetic departure time data, we can distinguish between the two modes of communication and identify the model parameters. Our model establishes a social patch foraging framework to identify deliberative decision strategies and forms of social communication, and to allow model fitting to field data from foraging animal groups.

Rat Anterior Cingulate Cortex Continuously Signals Decision Variables in a Patch Foraging Task

In patch foraging tasks, animals must decide whether to remain with a depleting resource or to leave it in search of a potentially better source of reward. In such tasks, animals consistently follow the general predictions of optimal foraging theory (the marginal value theorem; MVT): to leave a patch when the reward rate in the current patch depletes to the average reward rate across patches. Prior studies implicate an important role for the anterior cingulate cortex (ACC) in foraging decisions based on MVT: within single trials, ACC activity increases immediately preceding foraging decisions, and across trials, these dynamics are modulated as the value of staying in the patch depletes to the average reward rate. Here, we test whether these activity patterns reflect dynamic encoding of decision-variables and whether these signals are directly involved in decision-making. We developed a leaky accumulator model based on the MVT that generates estimates of decision variables within and across trials, and tested model predictions against ACC activity recorded from male rats performing a patch foraging task. Model predicted changes in MVT decision variables closely matched rat ACC activity. Next, we pharmacologically inactivated ACC in male rats to test the contribution of these signals to decision-making. ACC inactivation had a profound effect on rats' foraging decisions and response times (RTs) yet rats still followed the MVT decision rule. These findings indicate that the ACC encodes foraging-related variables for reasons unrelated to patch-leaving decisions.SIGNIFICANCE STATEMENT The ability to make adaptive patch-foraging decisions, to remain with a depleting resource or search for better alternatives, is critical to animal well-being. Previous studies have found that anterior cingulate cortex (ACC) activity is modulated at different points in the foraging decision process, raising questions about whether the ACC guides ongoing decisions or serves a more general purpose of regulating cognitive control. To investigate the function of the ACC in foraging, the present study developed a dynamic model of behavior and neural activity, and tested model predictions using recordings and inactivation of ACC. Findings revealed that ACC continuously signals decision variables but that these signals are more likely used to monitor and regulate ongoing processes than to guide foraging decisions.

Using optimal foraging theory to infer how groups make collective decisions

Studying animal behavior as collective phenomena is a powerful tool for understanding social processes, including group coordination and decision-making. However, linking individual behavior during group decision-making to the preferences underlying those actions poses a considerable challenge. Optimal foraging theory, and specifically the marginal value theorem (MVT), can provide predictions about individual preferences, against which the behavior of groups can be compared under different models of influence. A major strength of formally linking optimal foraging theory to collective behavior is that it generates predictions that can easily be tested under field conditions. This opens the door to studying group decision-making in a range of species; a necessary step for revealing the ecological drivers and evolutionary consequences of collective decision-making.

The emergence of a collective sensory response threshold in ant colonies

SignificanceIn this study, we ask how ant colonies integrate information about the external environment with internal state parameters to produce adaptive, system-level responses. First, we show that colonies collectively evacuate the nest when the ground temperature becomes too warm. The threshold temperature for this response is a function of colony size, with larger colonies evacuating the nest at higher temperatures. The underlying dynamics can thus be interpreted as a decision-making process that takes both temperature (external environment) and colony size (internal state) into account. Using mathematical modeling, we show that these dynamics can emerge from a balance between local excitatory and global inhibitory forces acting between the ants. Our findings in ants parallel other complex biological systems like neural circuits.

Quantity over quality? Prey-field characteristics influence the foraging decisions of little penguins (Eudyptula minor)

Quantifying prey characteristics is important for understanding the foraging behaviour of predators, which ultimately influence the structure and function of entire ecosystems. However, information available on prey is often at magnitudes which cannot be used to infer the fine-scale behaviour of predators, especially so in marine environments where direct observation of predator-prey interactions is rarely possible. In the present study, animal-borne video data loggers were used to determine the influence of prey type and patch density on the foraging behaviour of the little penguin (Eudyptula minor), an important predator in southeastern Australia. We found that numerical density positively influenced time spent foraging at a patch. However, when accounting for calorific value in density estimates, individuals spent longer at dense patches of low-quality prey. This may reflect a trade-off between capture effort and calorific gain as lower quality prey were captured at higher rates. During the breeding season, foraging trip distance and duration is constrained by the need to return to the colony each day to feed offspring. The results of the study suggest that, under these spatio-temporal constraints, little penguins maximize foraging performance by concentrating efforts at larger quantities of prey, irrespective of their calorific quality.

Biased Learning as a Simple Adaptive Foraging Mechanism

Adaptive cognitive biases, such as “optimism,” may have evolved as heuristic rules for computationally efficient decision-making, or as error-management tools when error payoff is asymmetrical. Ecologists typically use the term “optimism” to describe unrealistically positive expectations from the future that are driven by positively biased initial belief. Cognitive psychologists on the other hand, focus on valence-dependent optimism bias, an asymmetric learning process where information about undesirable outcomes is discounted (sometimes also termed “positivity biased learning”). These two perspectives are not mutually exclusive, and both may lead to similar emerging space-use patterns, such as increased exploration. The distinction between these two biases may becomes important, however, when considering the adaptive value of balancing the exploitation of known resources with the exploration of an ever-changing environment. Deepening our theoretical understanding of the adaptive value of valence-dependent learning, as well as its emerging space-use and foraging patterns, may be crucial for understanding whether, when and where might species withstand rapid environmental change. We present the results of an optimal-foraging model implemented as an individual-based simulation in continuous time and discrete space. Our forager, equipped with partial knowledge of average patch quality and inter-patch travel time, iteratively decides whether to stay in the current patch, return to previously exploited patches, or explore new ones. Every time the forager explores a new patch, it updates its prior belief using a simple single-parameter model of valence-dependent learning. We find that valence-dependent optimism results in the maintenance of positively biased expectations (prior-based optimism), which, depending on the spatiotemporal variability of the environment, often leads to greater fitness gains. These results provide insights into the potential ecological and evolutionary significance of valence-dependent optimism and its interplay with prior-based optimism.

Synthetic Spatial Foraging With Active Inference in a Geocaching Task

Humans are highly proficient in learning about the environments in which they operate. They form flexible spatial representations of their surroundings that can be leveraged with ease during spatial foraging and navigation. To capture these abilities, we present a deep Active Inference model of goal-directed behavior, and the accompanying belief updating. Active Inference rests upon optimizing Bayesian beliefs to maximize model evidence or marginal likelihood. Bayesian beliefs are probability distributions over the causes of observable outcomes. These causes include an agent's actions, which enables one to treat planning as inference. We use simulations of a geocaching task to elucidate the belief updating-that underwrites spatial foraging-and the associated behavioral and neurophysiological responses. In a geocaching task, the aim is to find hidden objects in the environment using spatial coordinates. Here, synthetic agents learn about the environment via inference and learning (e.g., learning about the likelihoods of outcomes given latent states) to reach a target location, and then forage locally to discover the hidden object that offers clues for the next location.

The role of food odor in invertebrate foraging

Foraging for food is an integral part of animal survival. In small insects and invertebrates, multisensory information and optimized locomotion strategies are used to effectively forage in patchy and complex environments. Here, the importance of olfactory cues for effective invertebrate foraging is discussed in detail. We review how odors are used by foragers to move toward a likely food source and the recent models that describe this sensory-driven behavior. We argue that smell serves a second function by priming an organism for the efficient exploitation of food. By appraising food odors, invertebrates can establish preferences and better adapt to their ecological niches, thereby promoting survival. The smell of food pre-prepares the gastrointestinal system and primes feeding motor programs for more effective ingestion as well. Optimizing resource utilization affects longevity and reproduction as a result, leading to drastic changes in survival. We propose that models of foraging behavior should include odor priming, and illustrate this with a simple toy model based on the marginal value theorem. Lastly, we discuss the novel techniques and assays in invertebrate research that could investigate the interactions between odor sensing and food intake. Overall, the sense of smell is indispensable for efficient foraging and influences not only locomotion, but also organismal physiology, which should be reflected in behavioral modeling.

Dietary abundance distributions: Dominance and diversity in vertebrate diets

Diet composition is among the most important yet least understood dimensions of animal ecology. Inspired by the study of species abundance distributions (SADs), we tested for generalities in the structure of vertebrate diets by characterising them as dietary abundance distributions (DADs). We compiled data on 1167 population-level diets, representing >500 species from six vertebrate classes, spanning all continents and oceans. DADs near-universally (92.5%) followed a hollow-curve shape, with scant support for other plausible rank-abundance-distribution shapes. This strong generality is inherently related to, yet incompletely explained by, the SADs of available food taxa. By quantifying dietary generalisation as the half-saturation point of the cumulative distribution of dietary abundance (sp50, minimum number of foods required to account for 50% of diet), we found that vertebrate populations are surprisingly specialised: in most populations, fewer than three foods accounted for at least half the diet. Variation in sp50 was strongly associated with consumer type, with carnivores being more specialised than herbivores or omnivores. Other methodological (sampling method and effort, taxonomic resolution), biological (body mass, frugivory) and biogeographic (latitude) factors influenced sp50 to varying degrees. Future challenges include identifying the mechanisms underpinning the hollow-curve DAD, its generality beyond vertebrates, and the biological determinants of dietary generalisation.

Uncertainty drives deviations in normative foraging decision strategies

Nearly all animals forage to acquire energy for survival through efficient search and resource harvesting. Patch exploitation is a canonical foraging behaviour, but there is a need for more tractable and understandable mathematical models describing how foragers deal with uncertainty. To provide such a treatment, we develop a normative theory of patch foraging decisions, proposing mechanisms by which foraging behaviours emerge in the face of uncertainty. Our model foragers statistically and sequentially infer patch resource yields using Bayesian updating based on their resource encounter history. A decision to leave a patch is triggered when the certainty of the patch type or the estimated yield of the patch falls below a threshold. The time scale over which uncertainty in resource availability persists strongly impacts behavioural variables like patch residence times and decision rules determining patch departures. When patch depletion is slow, as in habitat selection, departures are characterized by a reduction of uncertainty, suggesting that the forager resides in a low-yielding patch. Uncertainty leads patch-exploiting foragers to overharvest (underharvest) patches with initially low (high) resource yields in comparison with predictions of the marginal value theorem. These results extend optimal foraging theory and motivate a variety of behavioural experiments investigating patch foraging behaviour.

Frontal circuit specialisations for decision making

There is widespread consensus that distributed circuits across prefrontal and anterior cingulate cortex (PFC/ACC) are critical for reward-based decision making. The circuit specialisations of these areas in primates were likely shaped by their foraging niche, in which decision making is typically sequential, attention-guided and temporally extended. Here, I argue that in humans and other primates, PFC/ACC circuits are functionally specialised in two ways. First, microcircuits found across PFC/ACC are highly recurrent in nature and have synaptic properties that support persistent activity across temporally extended cognitive tasks. These properties provide the basis of a computational account of time-varying neural activity within PFC/ACC as a decision is being made. Second, the macrocircuit connections (to other brain areas) differ between distinct PFC/ACC cytoarchitectonic subregions. This variation in macrocircuit connections explains why PFC/ACC subregions make unique contributions to reward-based decision tasks and how these contributions are shaped by attention. They predict dissociable neural representations to emerge in orbitofrontal, anterior cingulate and dorsolateral prefrontal cortex during sequential attention-guided choice, as recently confirmed in neurophysiological recordings.

A new approach to assessing the space use behavior of macroinvertebrates by automated video tracking

Individual space and resource use are central issues in ecology and conservation. Recent technological advances such as automated tracking techniques are boosting ecological research in this field. However, the development of a robust method to track space and resource use is still challenging for at least one important ecosystem component: motile aquatic macroinvertebrates. The challenges are mostly related to the small body size and rapid movement of many macroinvertebrate species and to light scattering and wave signal interference in aquatic habitats.We developed a video tracking method designed to reliably assess space use behavior among individual aquatic macroinvertebrates under laboratory (microcosm) conditions. The approach involves the use of experimental apparatus integrating a near infrared backlight source, a Plexiglas multi-patch maze, multiple infrared cameras, and automated video analysis. It allows detection of the position of fast-moving (~ 3 cm/s) and translucent individuals of small size (~ 5 mm in length, ~1 mg in dry weight) on simulated resource patches distributed over an experimental microcosm (0.08 m2).To illustrate the adequacy of the proposed method, we present a case study regarding the size dependency of space use behavior in the model organism Gammarus insensibilis, focusing on individual patch selection, giving-up times, and cumulative space used.In the case study, primary data were collected on individual body size and individual locomotory behavior, for example, mean speed, acceleration, and step length. Individual entrance and departure times were recorded for each simulated resource patch in the experimental maze. Individual giving-up times were found to be characterized by negative size dependency, with patch departure occurring sooner in larger individuals than smaller ones, and individual cumulative space used (treated as the overall surface area of resource patches that individuals visited) was found to scale positively with body size.This approach to studying space use behavior can deepen our understanding of species coexistence, yielding insights into mechanistic models on larger spatial scales, for example, home range, with implications for ecological and evolutionary processes, as well as for the management and conservation of populations and ecosystems. Despite being specifically developed for aquatic macroinvertebrates, this method can also be applied to other small aquatic organisms such as juvenile fish and amphibians.

Gazing at Social Interactions Between Foraging and Decision Theory

Finding the underlying principles of social attention in humans seems to be essential for the design of the interaction between natural and artificial agents. Here, we focus on the computational modeling of gaze dynamics as exhibited by humans when perceiving socially relevant multimodal information. The audio-visual landscape of social interactions is distilled into a number of multimodal patches that convey different social value, and we work under the general frame of foraging as a tradeoff between local patch exploitation and landscape exploration. We show that the spatio-temporal dynamics of gaze shifts can be parsimoniously described by Langevin-type stochastic differential equations triggering a decision equation over time. In particular, value-based patch choice and handling is reduced to a simple multi-alternative perceptual decision making that relies on a race-to-threshold between independent continuous-time perceptual evidence integrators, each integrator being associated with a patch.

Foraging behavior in visual search: A review of theoretical and mathematical models in humans and animals

Visual search (VS) is a fundamental task in daily life widely studied for over half a century. A variant of the classic paradigm-searching one target among distractors-requires the observer to look for several (undetermined) instances of a target (so-called foraging) or several targets that may appear an undefined number of times (recently named as hybrid foraging). In these searches, besides looking for targets, the observer must decide how much time is needed to exploit the area, and when to quit the search to eventually explore new search options. In fact, visual foraging is a very common search task in the real world, probably involving additional cognitive functions than typical VS. It has been widely studied in natural animal environments, for which several mathematical models have been proposed, and just recently applied to humans: Lévy processes, composite and area-restricted search models, marginal value theorem, and Bayesian learning (among others). We conducted a systematic search in the literature to understand those mathematical models and study its applicability in human visual foraging. The review suggests that these models might be the first step, but they seem to be limited to fully comprehend foraging in visual search. There are essential variables involving human visual foraging still to be established and understood. Indeed, a jointly theoretical interpretation based on the different models reviewed could better account for its understanding. In addition, some other relevant variables, such as certain individual differences or time perception might be crucial to understanding visual foraging in humans.

Sex-specific speed-accuracy trade-offs shape neural processing of acoustic signals in a grasshopper

Speed-accuracy trade-offs-being fast at the risk of being wrong-are fundamental to many decisions and natural selection is expected to resolve these trade-offs according to the costs and benefits of behaviour. We here test the prediction that females and males should integrate information from courtship signals differently because they experience different pay-offs along the speed-accuracy continuum. We fitted a neural model of decision making (a drift-diffusion model of integration to threshold) to behavioural data from the grasshopper Chorthippus biguttulus to determine the parameters of temporal integration of acoustic directional information used by male grasshoppers to locate receptive females. The model revealed that males had a low threshold for initiating a turning response, yet a large integration time constant enabled them to continue to gather information when cues were weak. This contrasts with parameters estimated for females of the same species when evaluating potential mates, in which response thresholds were much higher and behaviour was strongly influenced by unattractive stimuli. Our results reveal differences in neural integration consistent with the sex-specific costs of mate search: males often face competition and need to be fast, while females often pay high error costs and need to be deliberate.

Systems Neuroscience of Natural Behaviors in Rodents

Animals evolved in complex environments, producing a wide range of behaviors, including navigation, foraging, prey capture, and conspecific interactions, which vary over timescales ranging from milliseconds to days. Historically, these behaviors have been the focus of study for ecology and ethology, while systems neuroscience has largely focused on short timescale behaviors that can be repeated thousands of times and occur in highly artificial environments. Thanks to recent advances in machine learning, miniaturization, and computation, it is newly possible to study freely moving animals in more natural conditions while applying systems techniques: performing temporally specific perturbations, modeling behavioral strategies, and recording from large numbers of neurons while animals are freely moving. The authors of this review are a group of scientists with deep appreciation for the common aims of systems neuroscience, ecology, and ethology. We believe it is an extremely exciting time to be a neuroscientist, as we have an opportunity to grow as a field, to embrace interdisciplinary, open, collaborative research to provide new insights and allow researchers to link knowledge across disciplines, species, and scales. Here we discuss the origins of ethology, ecology, and systems neuroscience in the context of our own work and highlight how combining approaches across these fields has provided fresh insights into our research. We hope this review facilitates some of these interactions and alliances and helps us all do even better science, together.

A spiking neural program for sensorimotor control during foraging in flying insects

Foraging is a vital behavioral task for living organisms. Behavioral strategies and abstract mathematical models thereof have been described in detail for various species. To explore the link between underlying neural circuits and computational principles, we present how a biologically detailed neural circuit model of the insect mushroom body implements sensory processing, learning, and motor control. We focus on cast and surge strategies employed by flying insects when foraging within turbulent odor plumes. Using a spike-based plasticity rule, the model rapidly learns to associate individual olfactory sensory cues paired with food in a classical conditioning paradigm. We show that, without retraining, the system dynamically recalls memories to detect relevant cues in complex sensory scenes. Accumulation of this sensory evidence on short time scales generates cast-and-surge motor commands. Our generic systems approach predicts that population sparseness facilitates learning, while temporal sparseness is required for dynamic memory recall and precise behavioral control. Our work successfully combines biological computational principles with spike-based machine learning. It shows how knowledge transfer from static to arbitrary complex dynamic conditions can be achieved by foraging insects and may serve as inspiration for agent-based machine learning.

An approach for long-term, multi-probe Neuropixels recordings in unrestrained rats

The use of Neuropixels probes for chronic neural recordings is in its infancy and initial studies leave questions about long-term stability and probe reusability unaddressed. Here, we demonstrate a new approach for chronic Neuropixels recordings over a period of months in freely moving rats. Our approach allows multiple probes per rat and multiple cycles of probe reuse. We found that hundreds of units could be recorded for multiple months, but that yields depended systematically on anatomical position. Explanted probes displayed a small increase in noise compared to unimplanted probes, but this was insufficient to impair future single-unit recordings. We conclude that cost-effective, multi-region, and multi-probe Neuropixels recordings can be carried out with high yields over multiple months in rats or other similarly sized animals. Our methods and observations may facilitate the standardization of chronic recording from Neuropixels probes in freely moving animals.

Foraging optimally in social neuroscience: computations and methodological considerations

Research in social neuroscience has increasingly begun to use the tools of computational neuroscience to better understand behaviour. Such approaches have proven fruitful for probing underlying neural mechanisms. However, little attention has been paid to how the structure of experimental tasks relates to real-world decisions, and the problems that brains have evolved to solve. To go significantly beyond current understanding, we must begin to use paradigms and mathematical models from behavioural ecology, which offer insights into the decisions animals must make successfully in order to survive. One highly influential theory-marginal value theorem (MVT)-precisely characterises and provides an optimal solution to a vital foraging decision that most species must make: the patch-leaving problem. Animals must decide when to leave collecting rewards in a current patch (location) and travel somewhere else. We propose that many questions posed in social neuroscience can be approached as patch-leaving problems. A richer understanding of the neural mechanisms underlying social behaviour will be obtained by using MVT. In this 'tools of the trade' article, we outline the patch-leaving problem, the computations of MVT and discuss the application to social neuroscience. Furthermore, we consider the practical challenges and offer solutions for designing paradigms probing patch leaving, both behaviourally and when using neuroimaging techniques.

Behavioural variability contributes to over-staying in patchy foraging

Foragers often systematically deviate from rate-maximizing choices in two ways: accuracy and precision. That is, they use suboptimal threshold values and also show variability in their application of those thresholds. We hypothesized that these biases are related and, more specifically, that foragers' widely known accuracy bias--over-staying--could be explained, at least in part, by their imprecision. To test this hypothesis, we analysed choices made by three rhesus macaques in a computerized patch foraging task. Confirming previously observed findings, we found high levels of variability. We then showed, through simulations, that this variability changed optimal thresholds, meaning that a forager aware of its own variability should increase its leaving threshold (i.e. over-stay) to increase performance. All subjects showed thresholds that were biased in the predicted direction. These results indicate that over-staying in patches may reflect, in part, an adaptation to behavioural variability.

Rats exhibit similar biases in foraging and intertemporal choice tasks

Animals, including humans, consistently exhibit myopia in two different contexts: foraging, in which they harvest locally beyond what is predicted by optimal foraging theory, and intertemporal choice, in which they exhibit a preference for immediate vs. delayed rewards beyond what is predicted by rational (exponential) discounting. Despite the similarity in behavior between these two contexts, previous efforts to reconcile these observations in terms of a consistent pattern of time preferences have failed. Here, via extensive behavioral testing and quantitative modeling, we show that rats exhibit similar time preferences in both contexts: they prefer immediate vs. delayed rewards and they are sensitive to opportunity costs of delays to future decisions. Further, a quasi-hyperbolic discounting model, a form of hyperbolic discounting with separate components for short- and long-term rewards, explains individual rats’ time preferences across both contexts, providing evidence for a common mechanism for myopic behavior in foraging and intertemporal choice.

Often decisions have to be made on whether to stick with a resource or leave it behind to search for a better alternative. Should you book that hotel room or continue looking at others? Is it time to start searching for a new job, or even for a new partner? Animals face similar 'stick or twist' decisions when foraging for food. Knowing how to maximize the amount of food you obtain is key to survival. Studies have shown that most animals tend to stick with a food source for a little too long, a phenomenon known as 'overharvesting'.

To find out why, Kane et al. designed carefully controlled experiments to compare foraging behavior in rats to another form of decision-making, known as intertemporal choice. The latter involves choosing between a small reward now versus a larger reward later. Given this choice, most rats opt to receive a smaller reward now rather than wait for the larger reward. This suggests that rats value rewards available in the future less than rewards they can get immediately.

Kane et al. showed that this preference for short-term rewards can also explain why rats overharvest in foraging scenarios. By leaving one food source to go in search of another, rats must put up with a delay before they can access the new food supply. This delay, due to the time required to travel and search, reduces the value of the future reward. As a result, rats are more likely to stick with their current food source, even though leaving it would yield a greater reward in the long run.

These findings in rats raise important questions about the mechanisms that lead to biases in thinking, and how factors like changes in the environment or specific disease states can influence these biases.