The episodic flanker effect: Memory retrieval as attention turned inward

The persistence of memory: prior memory responses modulate behavior and brain state engagement

Memory brain states may influence how we experience an event. Memory encoding and retrieval constitute neurally dissociable brain states that individuals can selectively engage based on top-down goals. To the extent that memory states linger in time - as suggested by prior behavioral work - memory states may influence not only the current experience, but also subsequent stimuli and judgments. Thus lingering memory states may have broad influences on cognition, yet this account has not been directly tested utilizing neural measures of memory states. Here we address this gap by testing the hypothesis that memory brain states are modulated by memory judgments, and that these brain states persist for several hundred milliseconds. We recorded scalp electroencephalography (EEG) while participants completed a recognition memory task. We used an independently validated multivariate mnemonic state classifier to assess memory state engagement. We replicate prior behavioral findings; however, our neural findings run counter to the predictions made on the basis of the behavioral data. Surprisingly, we find that prior responses modulate current memory state engagement on the basis of response congruency. That is, we find strong engagement of the retrieval state on incongruent trials - when a target is preceded by a correct rejection of a lure and when a lure is preceded by successful recognition of a target. These findings indicate that cortical brain states are influenced by prior judgments and suggest that a non-mnemonic, internal attention state may be recruited to in the face of changing demands in a dynamic environment.

The ordinal distance effect in working memory: does it exist in the absence of confounds?

In most daily-life situations, briefly remembering actions or words is not sufficient to reach a goal. You often have to remember them in a specific order. One behavioural observation of the processing of ordinal information in working memory is the ordinal distance effect. It refers to the facilitation in the ordinal processing of items that are at distant positions in comparison to items close to each other in working memory. So far, the ordinal distance effect has always been investigated with a simultaneous presentation of the items of the memory sequences. Such a presentation created a confound: items distant by their ordinal distance were also distant by their physical distance (i.e., the visuospatial distance between their positions on the screen). In the present study, we investigated whether the ordinal distance effect can be observed in the absence of a physical confound using a sequential presentation of the items of the memory sequence. Our findings revealed a combination of reversed and standard distance effects, unchanged by physical characteristics. The presence of a reversed distance effect suggests that a serial scanning strategy confers an advantage for adjacent items. Different strategies apply to the ordinal judgment of adjacent versus more distant items in verbal working memory. Interestingly, when ruling out the confound of primacy and recency effects, the standard distance effect disappeared while the reversed distance effect remained. Ultimately, our findings question the existence of the ordinal distance effect as a separate effect from other working memory confounds.

Top-down task goals induce the retrieval state

Engaging the retrieval state (Tulving, 1983) impacts processing and behavior (Long & Kuhl, 2019, 2021; Smith, Moore, & Long, 2022), but the extent to which top-down factors - explicit instructions and goals - vs. bottom-up factors - stimulus properties such as repetition and similarity - jointly or independently induce the retrieval state is unclear. Identifying the impact of bottom-up and top-down factors on retrieval state engagement is critical for understanding how control of task-relevant vs. task-irrelevant brain states influence cognition. We conducted between-subjects recognition memory tasks on male and female human participants in which we varied test phase goals. We recorded scalp electroencephalography and used an independently validated mnemonic state classifier (Long, 2023) to measure retrieval state engagement as a function of top-down task goals (recognize old vs. detect new items) and bottom-up stimulus repetition (hits vs. correct rejections). We find that whereas the retrieval state is engaged for hits regardless of top-down goals, the retrieval state is only engaged during correct rejections when the top-down goal is to recognize old items. Furthermore, retrieval state engagement is greater for low compared to high confidence hits when the task goal is to recognize old items. Together, these results suggest that top-down demands to recognize old items induce the retrieval state independent from bottom-up factors, potentially reflecting the recruitment of internal attention to enable access of a stored representation.

Significance Statement

Both top-down goals and automatic bottom-up influences may lead us into a retrieval brain state - a whole-brain pattern of activity that supports our ability to remember the past. Here we tested the extent to which top-down vs. bottom-up factors independently influence the retrieval state by manipulating participants' goals and stimulus repetition during a memory test. We find that in response to the top-down goal to recognize old items, the retrieval state is engaged for both old and new probes, suggesting that top-down and bottom-up factors independently engage the retrieval state. Our interpretation is that top-down demands recruit internal attention in service of the attempt to access a stored representation.

No position-specific interference from prior lists in cued recognition: A challenge for position coding (and other) theories of serial memory

Position-specific intrusions of items from prior lists are rare but important phenomena that distinguish broad classes of theory in serial memory. They are uniquely predicted by position coding theories, which assume items on all lists are associated with the same set of codes representing their positions. Activating a position code activates items associated with it in current and prior lists in proportion to their distance from the activated position. Thus, prior list intrusions are most likely to come from the coded position. Alternative "item dependent" theories based on associations between items and contexts built from items have difficulty accounting for the position specificity of prior list intrusions. We tested the position coding account with a position-cued recognition task designed to produce prior list interference. Cuing a position should activate a position code, which should activate items in nearby positions in the current and prior lists. We presented lures from the prior list to test for position-specific activation in response time and error rate; lures from nearby positions should interfere more. We found no evidence for such interference in 10 experiments, falsifying the position coding prediction. We ran two serial recall experiments with the same materials and found position-specific prior list intrusions. These results challenge all theories of serial memory: Position coding theories can explain the prior list intrusions in serial recall and but not the absence of prior list interference in cued recognition. Item dependent theories can explain the absence of prior list interference in cued recognition but cannot explain the occurrence of prior list intrusions in serial recall.

Serial attention to serial memory: The psychological refractory period in forward and backward cued recall

Guided by the conjecture that memory retrieval is attention turned inward, we examined serial attention in serial memory, combining the psychological refractory period (PRP) procedure from attention research with cued recall of two items from brief six-item lists. We report six experiments showing robust PRP effects in cued recall from memory (1-4) and cued report from perceptual displays (5-6), which suggest that memory retrieval requires the same attentional bottleneck as "retrieval" from perception. There were strong direction effects in each memory experiment. Response time (RT) was shorter and accuracy was higher when the cues occurred in the forward direction (left-to-right, top-to-bottom, first-to-last), replicating differences between forward and backward serial recall. Cue positions had strong effects on RT and accuracy in the memory experiments (1-4). The pattern suggested that subjects find cued items in memory by stepping through the list from the beginning or the end, with a preference for starting at the beginning. The perceptual experiments (5-6) showed weak effects of position that were more consistent with direct access. In all experiments, the distance between the cues in the list (lag) had weak effects, suggesting that subjects searched for each cue from the beginning or end of the list more often than they moved through the list from the first cue to the second. Direction, distance, and lag effects on RT and inter-response interval changed with SOA in a manner that suggested they affect bottleneck or pre-bottleneck processes that create and execute a plan for successive retrievals. We conclude that sequential retrieval from memory and sequential attention to perception engage the same computations and we show how computational models of memory can be interpreted as models of attention focused on memory.

The intersection of the retrieval state and internal attention

Large-scale brain states or distributed patterns of brain activity modulate downstream processing and behavior. Sustained attention and memory retrieval states impact subsequent memory, yet how these states relate to one another is unclear. I hypothesize that internal attention is a central process of the retrieval state. The alternative is that the retrieval state specifically reflects a controlled, episodic retrieval mode, engaged only when intentionally accessing events situated within a spatiotemporal context. To test my hypothesis, I developed a mnemonic state classifier independently trained to measure retrieval state evidence and applied this classifier to a spatial attention task. I find that retrieval state evidence increases during delay and response intervals when participants are maintaining spatial information. Critically, retrieval state evidence is positively related to the amount of maintained spatial location information and predicts target detection reaction times. Together, these findings support the hypothesis that internal attention is a central process of the retrieval state.

Mental strategies and resting state EEG: Effect on high alpha amplitude modulation by neurofeedback in healthy young adults

Neurofeedback (NFB) is a brain-computer interface which allows individuals to modulate their brain activity. Despite the self-regulatory nature of NFB, the effectiveness of strategies used during NFB training has been little investigated. In a single session of NFB training (6*3 min training blocks) with healthy young participants, we experimentally tested if providing a list of mental strategies (list group, N = 46), compared with a group receiving no strategies (no list group, N = 39), affected participants' neuromodulation ability of high alpha (10-12 Hz) amplitude. We additionally asked participants to verbally report the mental strategies used to enhance high alpha amplitude. The verbatim was then classified in pre-established categories in order to examine the effect of type of mental strategy on high alpha amplitude. First, we found that giving a list to the participants did not promote the ability to neuromodulate high alpha activity. However, our analysis of the specific strategies reported by learners during training blocks revealed that cognitive effort and recalling memories were associated with higher high alpha amplitude. Furthermore, the resting amplitude of trained high alpha frequency predicted an amplitude increase during training, a factor that may optimize inclusion in NFB protocols. The present results also corroborate the interrelation with other frequency bands during NFB training. Although these findings are based on a single NFB session, our study represents a further step towards developing effective protocols for high alpha neuromodulation by NFB.

Attention-Setting and Human Mental Function

This article provides an introduction to experimental research on top-down human attention in complex scenes, written for cognitive scientists in general. We emphasize the major effects of goals and intention on mental function, measured with behavioral experiments. We describe top-down attention as an open category of mental actions that initiates particular task sets, which are assembled from a wide range of mental processes. We call this attention-setting. Experiments on visual search, task switching, and temporal attention are described and extended to the important human time scale of seconds.

An interference model for visual working memory: Applications to the change detection task

Most studies of visual-working memory employ one of two experimental paradigms: change-detection or continuous-stimulus reproduction. In this study, we extended the Interference Model (IM; Oberauer & Lin, 2017), which was designed for continuous reproduction, to the single-probe change-detection task. In continuous reproduction, participants occasionally report the non-target items instead of the target. The presence of non-target response is predicted by the Interference Model, which relies in part on the interference of non-target items to explain the set-size effect. By presenting a probe matching a non-target item, we can investigate the amount of interference from non-target items in change detection. As predicted by the Interference Model, we observed poorer performance in rejecting a probe matching a non-target item compared to a new probe (i.e., a cost due to intrusions from non-targets). We fitted the IM along with the Variable Precision, the Slot-Averaging, and the Neural-Population model to the data from two change-detection experiments. The models were equipped with a Bayesian decision rule based on the one used in Keshvari, van den Berg, and Ma (2013). The Interference Model and the Neural-Population model successfully predicted the set-size effect and the non-target intrusion cost, whereas the Variable Precision (VP) and Slot-Averaging (SA) models failed to predict the intrusion cost at all. Even with additional assumptions enabling VP and SA to produce intrusion costs, the IM still performed better than the competing models quantitatively.

Can cue familiarity during recall failure prompt illusory recollective experience?

Recognition memory is thought to involve two bases: familiarity (a sense that something was encountered previously) and recollection (retrieval of specifics or context). The present study investigated the hypothesis that a sensation of familiarity during cued-recall failure might increase illusory recollective experience. This hypothesis was driven, in part, by the suggestion in the literature that the type of familiarity-driven recollective confabulation often seen in populations experiencing memory impairment might actually be a common feature of normal human memory. We examined the hypothesis that as perceived cue familiarity increases during the uncertainty of target retrieval failure, so does illusory recollection of a contextual detail. Toward this end, we systematically varied the amount of cue-to-target(s) surface feature-overlap in the recognition without cued recall paradigm, which has been shown to increase perceived cue familiarity during target recall failure. Increasing perceived cue familiarity during target retrieval failure led to increased confidence in knowing a contextual detail that was not actually known. As perceived cue familiarity increased, so did erroneous confidence in knowing the arrow direction (left or right) that supposedly accompanied the unretrieved target (Experiment 1), the background color (Experiment 2), and whether an accompanying tone was high or low (Experiment 3).