Foraging behavior in visual search: A review of theoretical and mathematical models in humans and animals

Easy does it: Selection during interactive search tasks is biased towards objects that can be examined easily

It is well understood that attentional selection is required to deploy visual attention to relevant objects within displays during visual search tasks. Interactive search, an extension of visual search, refers to tasks wherein an individual must manipulate items within their environment to uncover obscured information whilst searching for a target object. Here, we conducted two independent interactive search experiments where participants were asked to interact with virtual cubes to locate a target T shape embedded onto the side of one of the cubes. Our goal here was to investigate the drivers of attentional selection within interactive searches. To do so, we manipulated the effort required to rotate cubes (Experiment 1) and the quantity of shapes attached to the cubes (Experiment 2). Our findings suggest that the perceived effort required to interact with an object is an extremely strong driver of attentional selection within interactive search behaviors. Here, targets may be slower to be detected when that target is obscured within or by an object that conveys, in some shape or form, greater difficulty to examine compared with other objects. These findings provide an exciting first step towards understanding the factors that influence selection during interactive searches. Data and experimental code for all experiments in this study can be accessed online via this web address: https://osf.io/2zyvf/?view_only=ae4f4f2c36ab4e6aae5da3e99fb81988 . Experiments were not preregistered.

One factor to bind them all: visual foraging organization to predict patch leaving behavior with ROC curves

Predicting quitting rules is critical in visual search: Did I search enough for a cancer nodule in a breast X-ray or a threat in a baggage airport scanner? This study examines the predictive power of search organization indexes like best-r, mean ITD, PAO, or intersection rates as optimal criteria to leave a search in foraging (looking for several targets among distractors). In a sample of 29 adults, we compared static and dynamic foraging. Also, we reanalyze data from diverse foraging tasks in the lifespan already published to replicate results. Using ROC curves, all results consistently show that organization measures outperform classic intake rates commonly used in animal models to predict optimal human quitting behavior. Importantly, a combination of organization and traditional intake rates within a unitary factor is the best predictor. Our findings open a new research line for studying optimal decisions in visual search tasks based on search organization.

Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates

When freely viewing a scene, the eyes often return to previously visited locations. By tracking eye movements and coregistering eye movements and EEG, such refixations are shown to have multiple roles: repairing insufficient encoding from precursor fixations, supporting ongoing viewing by resampling relevant locations prioritized by precursor fixations, and aiding the construction of memory representations. All these functions of refixation behavior are understood to be underpinned by three oculomotor and cognitive systems and their associated brain structures. First, immediate saccade planning prior to refixations involves attentional selection of candidate locations to revisit. This process is likely supported by the dorsal attentional network. Second, visual working memory, involved in maintaining task-related information, is likely supported by the visual cortex. Third, higher-order relevance of scene locations, which depends on general knowledge and understanding of scene meaning, is likely supported by the hippocampal memory system. Working together, these structures bring about viewing behavior that balances exploring previously unvisited areas of a scene with exploiting visited areas through refixations.

Value construction through sequential sampling explains serial dependencies in decision making

Deciding between a pair of familiar items is thought to rely on a comparison of their subjective values. When the values are similar, decisions take longer, and the choice may be inconsistent with stated value. These regularities are thought to be explained by the same mechanism of noisy evidence accumulation that leads to perceptual errors under conditions of low signal to noise. However, unlike perceptual decisions, subjective values may vary with internal states (e.g. desires, priorities) that change over time. This raises the possibility that the apparent stochasticity of choice reflects changes in value rather than mere noise. We hypothesized that these changes would manifest in serial dependencies across decision sequences. We analyzed data from a task in which participants chose between snack items. We developed an algorithm, Reval, that revealed significant fluctuations of the subjective values of items within an experimental session. The dynamic values predicted choices and response times more accurately than stated values. The dynamic values also furnished a superior account of the BOLD signal in ventromedial prefrontal cortex. A novel bounded-evidence accumulation model with temporally correlated evidence samples supports the idea that revaluation reflects the dynamic construction of subjective value during deliberation, which in turn influences subsequent decisions.

The effect of target scarcity on visual foraging

Previous studies have investigated the effect of target prevalence in combination with the effect of explicit target value on human visual foraging strategies, though the conclusions have been mixed. Some find that individuals have a bias towards high-value targets even when these targets are scarcer, while other studies find that this bias disappears when those targets are scarcer. In this study, we tested for a bias for scarce targets using standard feature versus conjunction visual foraging tasks, without an explicit value being given. Based on the idea of commodity theory and implicit value, we hypothesized that participants would show a scarcity bias. The bias was investigated using a Bayesian statistical model which has been developed for predicting target-by-target foraging behaviours. However, we found no evidence of a scarcity bias in our experiment, suggesting that participants did not inherently find rarer targets more rewarding.

Grocery Shopping Under Simplified Marginal Value Theorem Predictions

This study examined whether supermarkets can be considered patches in the marginal value theorem (MVT) sense despite their particular features and whether they are models of human food foraging in resource-dense conditions. On the basis of the MVT, the quantitative relationship between gains in the Euro and patch residence time was modeled as an exponential growth function toward an upper asymptote, allowing the choice of an optimal strategy under diminishing returns. N = 61 participants were interviewed about their current shopping trip and contextual variables at a German supermarket and provided data to estimate relevant model parameters. A nonlinear model of the patch residence time and resulting gain based on an exponential function was fitted via nonlinear orthogonal distance regression. The results generally revealed the relationships predicted by the model, with some uncertainty regarding the estimation of the upper asymptote due to a lack of data from participants with long residence times. Despite this limitation, the data support the applicability of the MVT-based model. The results show that approaches from optimal foraging theory, such as the MVT, can be used successfully to model human shopping behavior even when participants' verbal reports are used.

Behavioral effects of polylactic acid microplastics on the tadpoles of Pelophylax nigromaculatus

Polylactic acid microplastics (PLA-MPs), biobased plastics made from renewable resources, are considered to be a potential solution for alleviating the pollution pressure of plastics; however, the potential environmental risks of PLA-MPs must be further evaluated. In this study, the effects of PLA-MPs on the tadpoles of Pelophylax nigromaculatus were investigated by designing different PLA-MP exposure experiments. We found that PLA-MPs negatively affected the survival, growth and development of tadpoles. In addition, in open field tests, PLA-MPs also reduced tadpole locomotion while resulting in more repetitive searching behavior within a restricted area. This effect was more pronounced at higher concentrations of PLA-MPs (20 mg/mL) and in combination with the heavy metal Cd2+. In the tank tests, PLA-MPs increased tadpole aggregation, and their combined effect with Cd2+ resulted in a tendency for tadpole aggregation to increase and then decrease, with the distribution tending to favor aggregation in edge regions. PLA-MPs also strongly inhibited the spatiotemporal exploratory activities of tadpoles in the tanks. This study provides a more detailed investigation of the behavioral effects of PLA-MPs on tadpoles and provides a theoretical basis for subsequent ecotoxicological studies of PLA-MPs.

Value construction through sequential sampling explains serial dependencies in decision making

Many decisions are expressed as a preference for one item over another. When these items are familiar, it is often assumed that the decision maker assigns a value to each of the items and chooses the item with the highest value. These values may be imperfectly recalled, but are assumed to be stable over the course of an interview or psychological experiment. Choices that are inconsistent with a stated valuation are thought to occur because of unspecified noise that corrupts the neural representation of value. Assuming that the noise is uncorrelated over time, the pattern of choices and response times in value-based decisions are modeled within the framework of Bounded Evidence Accumulation (BEA), similar to that used in perceptual decision-making. In BEA, noisy evidence samples accumulate over time until the accumulated evidence for one of the options reaches a threshold. Here, we argue that the assumption of temporally uncorrelated noise, while reasonable for perceptual decisions, is not reasonable for value-based decisions. Subjective values depend on the internal state of the decision maker, including their desires, needs, priorities, attentional state, and goals. These internal states may change over time, or undergo revaluation, as will the subjective values. We reasoned that these hypothetical value changes should be detectable in the pattern of choices made over a sequence of decisions. We reanalyzed data from a well-studied task in which participants were presented with pairs of snacks and asked to choose the one they preferred. Using a novel algorithm (Reval), we show that the subjective value of the items changes significantly during a short experimental session (about 1 hour). Values derived with Reval explain choice and response time better than explicitly stated values. They also better explain the BOLD signal in the ventromedial prefrontal cortex, known to represent the value of decision alternatives. Revaluation is also observed in a BEA model in which successive evidence samples are not assumed to be independent. We argue that revaluation is a consequence of the process by which values are constructed during deliberation to resolve preference choices.

Exploration-exploitation model of moth-inspired olfactory navigation

Navigation of male moths towards females during the mating search offers a unique perspective on the exploration-exploitation (EE) model in decision-making. This study uses the EE model to explain male moth pheromone-driven flight paths. Wind tunnel measurements and three-dimensional tracking using infrared cameras have been leveraged to gain insights into male moth behaviour. During the experiments in the wind tunnel, disturbance to the airflow has been added and the effect of increased fluctuations on moth flights has been analysed, in the context of the proposed EE model. The exploration and exploitation phases are separated using a genetic algorithm to the experimentally obtained dataset of moth three-dimensional trajectories. First, the exploration-to-exploitation rate (EER) increases with distance from the source of the female pheromone is demonstrated, which can be explained in the context of the EE model. Furthermore, our findings reveal a compelling relationship between EER and increased flow fluctuations near the pheromone source. Using an olfactory navigation simulation and our moth-inspired navigation model, the phenomenon where male moths exhibit an enhanced EER as turbulence levels increase is explained. This research extends our understanding of optimal navigation strategies based on general biological EE models and supports the development of bioinspired navigation algorithms.

Research on re-searching: interrupted foraging is not disrupted foraging

In classic visual search, observers typically search for the presence of a target in a scene or display. In foraging tasks, there may be multiple targets in the same display (or "patch"). Observers typically search for and collect these target items in one patch until they decide to leave that patch and move to the next one. This is a highly rule-governed behavior. The current study investigated whether these rules are disrupted when the foraging is interrupted in various manners. In Experiment 1, the foraging was briefly interrupted and then resumed in the same patch. In Experiments 2 and 3, the foraging in each patch either ended voluntarily or compulsorily after a fixed amount of time. In these cases, foraging resumed in a patch only after all patches were visited. Overall, the rules of foraging remained largely intact, though Experiment 2 shows that foraging rules can be overridden by the demand characteristics of the task. The results show that participants tended to perform approximately consistently despite interruptions. The results suggest that foraging behavior in a relatively simple foraging environment is resilient and not easily disrupted by interruption.

The time course of visual foraging in the lifespan: Spatial scanning, organization search, and target processing

Visual foraging is a variant of visual search, consisting of searching for an undetermined number of targets among distractors (e.g., looking for various LEGO pieces in a box). Under non-exhaustive tasks, the observer scans the display, picking those targets needed, not necessarily all of them, before leaving the search. To understand how the organization of such natural foraging tasks works, several measures of spatial scanning and organization have been proposed in the exhaustive foraging literature: best-r, intertarget distances, PAO, and target intersections. In the present study, we apply these measures and new Bayesian indexes to determine how the time course of visual foraging is organized in a dynamic non-exhaustive paradigm. In a large sample of observers (279 participants, 4-25 years old), we compare feature and conjunction foraging and explore how factors like set size and time course, not previously tested in exhaustive foraging, might affect search organization in non-exhaustive dynamic tasks. The results replicate previous findings showing younger observers' searching being less organized, feature conditions being more organized than conjunction conditions, and organization leading to a more effective search. Interestingly, observers tend to be less organized as set size increases, and search is less organized within a patch as it advances in time: Search organization decreases when search termination is coming, suggesting organization measures as potential clues to understand quitting rules in search. Our results highlight the importance of studying search organization in foraging as a critical source of understanding complex cognitive processes in visual search.

Maladaptive explore/exploit trade-offs in schizophrenia

Schizophrenia is a complex disorder that remains poorly understood, particularly at the systems level. In this opinion article we argue that the explore/exploit trade-off concept provides a holistic and ecologically valid framework to resolve some of the apparent paradoxes that have emerged within schizophrenia research. We review recent evidence suggesting that fundamental explore/exploit behaviors may be maladaptive in schizophrenia during physical, visual, and cognitive foraging. We also describe how theories from the broader optimal foraging literature, such as the marginal value theorem (MVT), could provide valuable insight into how aberrant processing of reward, context, and cost/effort evaluations interact to produce maladaptive responses.

Eristic reasoning: Adaptation to extreme uncertainty

Heuristics (shortcut solution rules) can help adaptation to uncertainty by leading to sufficiently accurate decisions with little information. However, heuristics would fail under extreme uncertainty where information is so scarce that any heuristic would be highly misleading for accuracy-seeking. Thus, under very high levels of uncertainty, decision-makers rely on heuristics to no avail. We posit that eristic reasoning (i.e., self-serving inferences for hedonic pursuits), rather than heuristic reasoning, is adaptive when uncertainty is extreme, as eristic reasoning produces instant hedonic gratifications helpful for coping. Eristic reasoning aims at hedonic gains (e.g., relief from the anxiety of uncertainty) that can be pursued by self-serving inferences. As such, eristic reasoning does not require any information about the environment as it instead gets cues introspectively from bodily signals informing what the organism hedonically needs as shaped by individual differences. We explain how decision-makers can benefit from heuristic vs. eristic reasoning under different levels of uncertainty. As a result, by integrating the outputs of formerly published empirical research and our conceptual discussions pertaining to eristic reasoning, we conceptually criticize the fast-and-frugal heuristics approach, which implies that heuristics are the only means of adapting to uncertainty.

Using Gaze for Behavioural Biometrics

A principled approach to the analysis of eye movements for behavioural biometrics is laid down. The approach grounds in foraging theory, which provides a sound basis to capture the uniqueness of individual eye movement behaviour. We propose a composite Ornstein-Uhlenbeck process for quantifying the exploration/exploitation signature characterising the foraging eye behaviour. The relevant parameters of the composite model, inferred from eye-tracking data via Bayesian analysis, are shown to yield a suitable feature set for biometric identification; the latter is eventually accomplished via a classical classification technique. A proof of concept of the method is provided by measuring its identification performance on a publicly available dataset. Data and code for reproducing the analyses are made available. Overall, we argue that the approach offers a fresh view on either the analyses of eye-tracking data and prospective applications in this field.

Detours increase local knowledge-Exploring the hidden benefits of self-control failure

Self-control enables people to override momentary thoughts, emotions, or impulses in order to pursue long-term goals. Good self-control is a predictor for health, success, and subjective well-being, as bad self-control is for the opposite. Therefore, the question arises why evolution has not endowed us with perfect self-control. In this article, we draw some attention to the hidden benefits of self-control failure and present a new experimental paradigm that captures both costs and benefits of self-control failure. In an experiment, participants worked on three consecutive tasks: 1) In a transcription task, we manipulated how much effortful self-control two groups of participants had to exert. 2) In a number-comparison task, participants of both groups were asked to compare numbers and ignore distracting neutral versus reward-related pictures. 3) After a pause for recreation, participants were confronted with an unannounced recognition task measuring whether they had incidentally encoded the distracting pictures during the previous number-comparison task. The results showed that participants who exerted a high amount of effortful self-control during the first task shifted their priorities and attention toward the distractors during the second self-control demanding task: The cost of self-control failure was reflected in worse performance in the number-comparison task. Moreover, the group which had exerted a high amount of self-control during the first task and showed self-control failure during the second task was better in the unannounced third task. The benefit of self-control failure during number comparison was reflected in better performance during the recognition task. However, costs and benefits were not specific for reward-related distractors but also occurred with neutral pictures. We propose that the hidden benefit of self-control failure lies in the exploration of distractors present during goal pursuit, i.e. the collection of information about the environment and the potential discovery of new sources of reward. Detours increase local knowledge.