Eye movements reveal memory processes during similarity- and rule-based decision making

Disentangling Perceptual and Process-Related Sources of Behavioral Variability in Categorization

People often categorize the same object variably over time. Such intraindividual behavioral variability is difficult to identify because it can be confused with a bias and can originate in different categorization steps. The current work discusses possible sources of behavioral variability in categorization, focusing on perceptual and cognitive processes, and reports a simulation with a similarity-based categorization model to disentangle these sources. The simulation showed that noise during perceptual or cognitive processes led to considerable misestimations of a response determinism parameter. Category responses could not identify the source of the behavioral variability because different forms of noise led to similar response patterns. However, continuous model predictions could identify the noise: Noisy feature perception led to variable predictions for central stimuli on the category boundary, noisy feature attention increased the prediction variability for stimuli differing from each category on another feature, and noisy similarity computation increased the variability for stimuli with moderate predictions. Measuring category beliefs in a continuous way (e.g., through category probability judgments) may therefore help to disentangle perceptual and process-related sources of behavioral variability. Ultimately, this can inform interventions aimed at improving human categorizations (e.g., diagnosis training) by indicating which steps of the categorization mechanism to target.

Identifying similarity- and rule-based processes in quantitative judgments: A multi-method approach combining cognitive modeling and eye tracking

Quantitative judgments have been suggested to result from a mixture of similarity- and rule-based processing. People can judge an object's criterion value based on the object's similarity to previously experienced exemplars and based on a rule that integrates the object's cues like a linear regression. In order to better understand these processes, the present work combines cognitive modeling and eye tracking and tests whether people who rely more on the similarity to exemplars also look more at the exemplar locations on the screen. In two eye-tracking studies, participants learned to assign each of four exemplars to a different screen corner and criterion value and then judged the criterion value of briefly presented test stimuli. Eye tracking measured participants' gazes to the now empty exemplar locations (a phenomenon called looking-at-nothing); cognitive modeling of the test phase judgments quantified participants' reliance on a similarity- over a rule-based process. Participants showed more similarity use and more looking-at-nothing in the study in which the cues were linked to the criterion by a multiplicative function than in the study with an additive cue-criterion link. Focusing on the study with a multiplicative environment, participants relying more on the similarity to exemplars also showed more looking-at-nothing ( τ = 0.25, p = .01). Within trials, looking-at-nothing was usually directed at the one exemplar that was most similar to the test stimulus. These results show that a multi-method approach combining process tracing and cognitive modeling can provide mutually supportive insights into the processes underlying higher-order cognition.

What is the airspeed velocity of an unladen swallow? modeling numerical judgments of realistic stimuli

Research on processes of multiple-cue judgments usually uses artificial stimuli with predefined cue structures, such as artificial bugs with four binary features like back color, belly color, gland size, and spot shape. One reason for using artifical stimuli is that the cognitive models used in this area need known cues and cue values. This limitation makes it difficult to apply the models to research questions with complex naturalistic stimuli with unknown cue structure. In two studies, building on early categorization research, we demonstrate how cues and cue values of complex naturalistic stimuli can be extracted from pairwise similarity ratings with a multidimensional scaling analysis. These extracted cues can then be used in a state-of-the-art hierarchical Bayesian model of numerical judgments. In the first study, we show that predefined cue structures of artificial stimuli are well recovered by an MDS analysis of similarity judgments and that using these MDS-based attributes as cues in a cognitive model of judgment data from an existing experiment leads to the same inferences as when the original cue values were used. In the second study, we use the same procedure to replicate previous findings from multiple-cue judgment literature using complex naturalistic stimuli.

Adult Avoidant Attachment, Attention Bias, and Emotional Regulation Patterns: An Eye-Tracking Study

Proximity-seeking in distress situations is one of attachment theory's primary strategies; insecure individuals often also develop secondary strategies. The mechanisms implied in attachment deactivation constitute a key issue in the current debate related to their role in support-seeking. The main aim of this study is to investigate the attachment deactivation strategy and the processes of proximity/support-seeking under distress conditions by analyzing the attentional processes (i.e., an essential emotion-regulation strategy), using eye-tracking techniques. Seventy-two participants (45 female; Mage 23.9 ± 3.97) responded to the ECR-R questionnaire in order to identify their attachment style. They participated in an experimental situation in which they had to choose between pictures of care or pictures of food, following the presentation of threatening or neutral prime conditions (via the pictures' stimuli). Results showed that a care-consistency response pattern was the most frequent pattern of response, particularly under a threatening condition; on the contrary, only avoidant individuals showed a lower care-consistency response pattern by choosing food pictures. The overall findings demonstrate that avoidant individuals used the deactivation strategy to process comfort-related attachment pictures, suggesting that they considered these stimuli to be threatening. The implications for attachment theory and particularly for avoidant strategies are discussed.

Mental-Imagery-Based Mnemonic Training: A New Kind of Cognitive Training

We investigated the immediate and maintenance effects of mental-imagery-based mnemonic training on improving youths’ working memory, long-term memory, arithmetic and spatial abilities, and fluid intelligence. In Experiment 1, 26 Chinese participants (15 boys, 11 girls) aged 10–16 years were divided into an experimental group that received 8 days of mental-imagery-based mnemonic training and a no-contact control group. Participants completed pre-, post-, and three follow-up tests (3, 6, and 12 months after the pre-test). In Experiment 2, 54 Chinese children (28 boys, 26 girls), all 12 years old, were divided into experimental and control groups. Participants completed pre-, post-, and follow-up tests (three months after the pre-test). Results showed that the training significantly affected long-term memory-related task performance but no effects were observed on working memory, arithmetic or spatial ability, or fluid intelligence-related tasks. Moreover, the effect of the training on long-term memory lasted up to one year; the more frequently the training was used, the more effective it was. A content analysis of the feedback submitted by parents of participants in Experiment 2 three months after the training showed that the children used the strategy more for memorizing content such as Chinese and English, as well as for musical scores. Furthermore, there was also the possibility that the training improved abilities and academic performance such as concentration and math performance. Our results provide a basis for the further exploration of mental-imagery-based mnemonic training as a novel training modality.

Cognitive and neural principles of a memory bias on preferential choices

Value-based decisions depend on different forms of memory. However, the respective roles of memory and valuation processes that give rise to these decisions are often vaguely described and have rarely been investigated jointly. In this review article, we address the problem of memory-based decision making from a neuroeconomic perspective. We first describe the neural and cognitive processes involved in decisions requiring memory processes, with a focus on episodic memory. Based on the results of a systematic research program, we then spotlight the phenomenon of the memory bias, a general preference for choice options that can be retrieved from episodic memory more successfully. Our findings indicate that failed memory recall biases neural valuation processes as indicated by altered effective connectivity between the hippocampus and ventromedial prefrontal cortex. This bias can be attributed to meta-cognitive beliefs about the relationship between subjective value and memory as well as to uncertainty aversion. After summarizing the findings, we outline potential future research endeavors to integrate the two research traditions of memory and decision making.

How Cues of Being Watched Promote Risk Seeking in Fund Investment in Older Adults

Social cues, such as being watched, can subtly alter fund investment choices. This study aimed to investigate how cues of being watched influence decision-making, attention allocation, and risk tendencies. Using decision scenarios adopted from the “Asian Disease Problem,” we examined participants’ risk tendency in a financial scenario when they were watched. A total of 63 older and 66 younger adults participated. Eye tracking was used to reveal the decision-maker’s attention allocation (fixations and dwell time per word). The results found that both younger and older adults tend to seek risk in the loss frame than in the gain frame (i.e., framing effect). Watching eyes tended to escalate reckless gambling behaviors among older adults, which led them to maintain their share in the depressed fund market, regardless of whether the options were gain or loss framed. The eye-tracking results revealed that older adults gave less attention to the sure option in the eye condition (i.e., fewer fixations and shorter dwell time). However, their attention was maintained on the gamble options. In comparison, images of “watching eyes” did not influence the risk seeking of younger adults but decreased their framing effect. Being watched can affect financial risk preference in decision-making. The exploration of the contextual sensitivity of being watched provides us with insight into developing decision aids to promote rational financial decision-making, such as human-robot interactions. Future research on age differences still requires further replication.

The influence of visual attention on memory-based preferential choice

Many decisions rely on past experiences. Recent research indicates that people's choices are biased towards choosing better-remembered options, even if these options are comparatively unattractive (i.e., a memory bias). In the current study, we used eye tracking to compare the influence of visual attention on preferential choice between memory-based and non-memory-based decisions. Participants completed the remember-and-decide task. In this task, they first learned associations between screen locations and snack items. Then, they made binary choices between snack items. These snacks were either hidden and required recall (memory-based decisions), or they were visible (non-memory-based decisions). Remarkably, choices were more strongly influenced by attention in memory-based compared to non-memory-based decisions. However, visual attention did not mediate the memory bias on preferential choices. Finally, we adopt and expand a recently proposed computational model to provide a comprehensive description of the role of attention in memory-based decisions. In sum, the present work elucidates how visual attention interacts with episodic memory and preference formation in memory-based decisions.

A consensus-based elastic matching algorithm for mapping recall fixations onto encoding fixations in the looking-at-nothing paradigm

We present an algorithmic method for aligning recall fixations with encoding fixations, to be used in looking-at-nothing paradigms that either record recall eye movements during silence or want to speed up data analysis with recordings of recall data during speech. The algorithm utilizes a novel consensus-based elastic matching algorithm to estimate which encoding fixations correspond to later recall fixations. This is not a scanpath comparison method, as fixation sequence order is ignored and only position configurations are used. The algorithm has three internal parameters and is reasonable stable over a wide range of parameter values. We then evaluate the performance of our algorithm by investigating whether the recalled objects identified by the algorithm correspond with independent assessments of what objects in the image are marked as subjectively important. Our results show that the mapped recall fixations align well with important regions of the images. This result is exemplified in four groups of use cases: to investigate the roles of low-level visual features, faces, signs and text, and people of different sizes, in recall of encoded scenes. The plots from these examples corroborate the finding that the algorithm aligns recall fixations with the most likely important regions in the images. Examples also illustrate how the algorithm can differentiate between image objects that have been fixated during silent recall vs those objects that have not been visually attended, even though they were fixated during encoding.

Harnessing Visual Imagery and Oculomotor Behaviour to Understand Prospection

Much of the rich internal world constructed by humans is derived from, and experienced through, visual mental imagery. Despite growing appreciation of visual exploration in guiding episodic memory processes, extant theories of prospection have yet to accommodate the precise role of visual mental imagery in the service of future-oriented thinking. We propose that the construction of future events relies on the assimilation of perceptual details originally experienced, and subsequently reinstantiated, predominantly in the visual domain. Individual differences in the capacity to summon discrete aspects of visual imagery can therefore account for the diversity of content generated by humans during future simulation. Our integrative framework provides a novel testbed to query alterations in future thinking in health and disease.

Does expertise and thinking mode matter for accuracy in judgments of job applicants' cognitive ability?

The present research examined the role of thinking mode for accuracy in recruiters and laypeople's judgments of applicants' cognitive ability. In Study 1, students who relied on their intuition were somewhat less accurate. In Study 2, an experimental manipulation of thinking mode (intuitive vs analytical) revealed no apparent differences in accuracy. Moreover, there were no differences in accuracy or agreement between recruiters and laypeople. Examination of the use of specific resume content suggested that intuitive thinking corresponds to basing one's judgments more on the way that applicants present themselves in their personal letter and less on diagnostic biographical information such as SAT scores. The findings point to the possibility that professional recruiters may not possess intuitive expertise in this context.

Memory shapes judgments: Tracing how memory biases judgments by inducing the retrieval of exemplars

When making judgments (e.g., about the quality of job candidates) decision makers should ignore salient, but unrepresentative information (e.g., the person's name). However, research suggests that salient information influences judgments, possibly because memories of past encounters with similar information are integrated into the judgment. We studied eye movements to trace the link between the retrieval of past instances and their influence on judgments. Participants were more likely to look at screen locations where exemplars matching items on a name attribute had appeared, suggesting the retrieval of exemplars. Eye movements to exemplar locations predicted judgments, explaining why names influenced judgments. The results provide insights into how exemplars are integrated into the judgment process when assessing memory retrieval online.

Comparing eye trackers by correlating their eye-metric data

Up to now, the potential of eye tracking in science as well as in everyday life has not been fully realized because of the high acquisition cost of trackers. Recently, manufacturers have introduced low-cost devices, preparing the way for wider use of this underutilized technology. As soon as scientists show independently of the manufacturers that low-cost devices are accurate enough for application and research, the real advent of eye trackers will have arrived. To facilitate this development, we propose a simple approach for comparing two eye trackers by adopting a method that psychologists have been practicing in diagnostics for decades: correlating constructs to show reliability and validity. In a laboratory study, we ran the newer, low-cost EyeTribe eye tracker and an established SensoMotoric Instruments eye tracker at the same time, positioning one above the other. This design allowed us to directly correlate the eye-tracking metrics of the two devices over time. The experiment was embedded in a research project on memory where 26 participants viewed pictures or words and had to make cognitive judgments afterwards. The outputs of both trackers, that is, the pupil size and point of regard, were highly correlated, as estimated in a mixed effects model. Furthermore, calibration quality explained a substantial amount of individual differences for gaze, but not pupil size. Since data quality is not compromised, we conclude that low-cost eye trackers, in many cases, may be reliable alternatives to established devices.

Tracing the path of forgetting in rule abstraction and exemplar retrieval

People often forget acquired knowledge over time such as names of former classmates. Which knowledge people can access, however, may modify the judgement process and affect judgement accuracy. Specifically, we hypothesised that judgements based on retrieving past exemplars from long-term memory may be more vulnerable to forgetting than remembering rules that relate the cues to the criterion. Experiment 1 systematically tracked the individual course of forgetting from initial learning to later tests (immediate, 1 day, and 1 week) in a linear judgement task facilitating rule-based strategies and a multiplicative judgement task facilitating exemplar-based strategies. Practising the acquired judgement strategy in repeated tests helped participants to consistently apply the learnt judgement strategy and retain a high judgement accuracy even after a week. Yet, whereas a long retention interval did not affect judgements in the linear task, a long retention interval impaired judgements in the multiplicative task. If practice was restricted as in Experiment 2, judgement accuracy suffered in both tasks. In addition, after a week without practice, participants tried to reconstruct their judgements by applying rules in the multiplicative task. These results emphasise that the extent to which decision makers can still retrieve previously learned knowledge limits their ability to make accurate judgements and that the preferred strategies change over time if the opportunity for practice is limited.

Paving the Way to Eureka-Introducing "Dira" as an Experimental Paradigm to Observe the Process of Creative Problem Solving

"Dira" is a novel experimental paradigm to record combinations of behavioral and metacognitive measures for the creative process. This task allows assessing chronological and chronometric aspects of the creative process directly and without a detour through creative products or proxy phenomena. In a study with 124 participants we show that (a) people spend more time attending to selected vs. rejected potential solutions, (b) there is a clear connection between behavioral patterns and self-reported measures, (c) the reported intensity of Eureka experiences is a function of interaction time with potential solutions, and (d) experiences of emerging solutions can happen immediately after engaging with a problem, before participants explore all potential solutions. The conducted study exemplifies how "Dira" can be used as an instrument to narrow down the moment when solutions emerge. We conclude that the "Dira" experiment is paving the way to study the process, as opposed to the product, of creative problem solving.

Computational neuroscience across the lifespan: Promises and pitfalls

In recent years, the application of computational modeling in studies on age-related changes in decision making and learning has gained in popularity. One advantage of computational models is that they provide access to latent variables that cannot be directly observed from behavior. In combination with experimental manipulations, these latent variables can help to test hypotheses about age-related changes in behavioral and neurobiological measures at a level of specificity that is not achievable with descriptive analysis approaches alone. This level of specificity can in turn be beneficial to establish the identity of the corresponding behavioral and neurobiological mechanisms. In this paper, we will illustrate applications of computational methods using examples of lifespan research on risk taking, strategy selection and reinforcement learning. We will elaborate on problems that can occur when computational neuroscience methods are applied to data of different age groups. Finally, we will discuss potential targets for future applications and outline general shortcomings of computational neuroscience methods for research on human lifespan development.

Watching diagnoses develop: Eye movements reveal symptom processing during diagnostic reasoning

Finding a probable explanation for observed symptoms is a highly complex task that draws on information retrieval from memory. Recent research suggests that observed symptoms are interpreted in a way that maximizes coherence for a single likely explanation. This becomes particularly clear if symptom sequences support more than one explanation. However, there are no existing process data available that allow coherence maximization to be traced in ambiguous diagnostic situations, where critical information has to be retrieved from memory. In this experiment, we applied memory indexing, an eye-tracking method that affords rich time-course information concerning memory-based cognitive processing during higher order thinking, to reveal symptom processing and the preferred interpretation of symptom sequences. Participants first learned information about causes and symptoms presented in spatial frames. Gaze allocation to emptied spatial frames during symptom processing and during the diagnostic response reflected the subjective status of hypotheses held in memory and the preferred interpretation of ambiguous symptoms. Memory indexing traced how the diagnostic decision developed and revealed instances of hypothesis change and biases in symptom processing. Memory indexing thus provided direct online evidence for coherence maximization in processing ambiguous information.

Use of evidence in a categorization task: analytic and holistic processing modes

Category learning performance can be influenced by many contextual factors, but the effects of these factors are not the same for all learners. The present study suggests that these differences can be due to the different ways evidence is used, according to two main basic modalities of processing information, analytically or holistically. In order to test the impact of the information provided, an inductive rule-based task was designed, in which feature salience and comparison informativeness between examples of two categories were manipulated during the learning phases, by introducing and progressively reducing some perceptual biases. To gather data on processing modalities, we devised the Active Feature Composition task, a production task that does not require classifying new items but reproducing them by combining features. At the end, an explicit rating task was performed, which entailed assessing the accuracy of a set of possible categorization rules. A combined analysis of the data collected with these two different tests enabled profiling participants in regard to the kind of processing modality, the structure of representations and the quality of categorial judgments. Results showed that despite the fact that the information provided was the same for all participants, those who adopted analytic processing better exploited evidence and performed more accurately, whereas with holistic processing categorization is perfectly possible but inaccurate. Finally, the cognitive implications of the proposed procedure, with regard to involved processes and representations, are discussed.

Statistical numeracy as a moderator of (pseudo)contingency effects on decision behavior

Pseudocontingencies denote contingency estimates inferred from base rates rather than from cell frequencies. We examined the role of statistical numeracy for effects of such fallible but adaptive inferences on choice behavior. In Experiment 1, we provided information on single observations as well as on base rates and tracked participants' eye movements. In Experiment 2, we manipulated the availability of information on cell frequencies and base rates between conditions. Our results demonstrate that a focus on base rates rather than cell frequencies benefits pseudocontingency effects. Learners who are more proficient in (conditional) probability calculation prefer to rely on cell frequencies in order to judge contingencies, though, as was evident from their gaze behavior. If cell frequencies are available in summarized format, they may infer the true contingency between options and outcomes. Otherwise, however, even highly numerate learners are susceptible to pseudocontingency effects.

Eye movement during retrieval of emotional autobiographical memories

This study assessed whether specific eye movement patterns are observed during emotional autobiographical retrieval. Participants were asked to retrieve positive, negative and neutral memories while their scan path was recorded by an eye-tracker. Results showed that positive and negative emotional memories triggered more fixations and saccades but shorter fixation duration than neutral memories. No significant differences were observed between emotional and neutral memories for duration and amplitude of saccades. Positive and negative retrieval triggered similar eye movement (i.e., similar number of fixations and saccades, fixation duration, duration of saccades, and amplitude of saccades). Interestingly, the participants reported higher visual imagery for emotional memories than for neutral memories. The findings demonstrate similarities and differences in eye movement during retrieval of neutral and emotional memories. Eye movement during autobiographical retrieval seems to be triggered by the creation of visual mental images as the latter are indexed by autobiographical reconstruction.