Visual long-term memory has a massive storage capacity for object details

Grouping in working memory guides chunk formation in long-term memory: Evidence from the Hebb effect

The Hebb effect refers to the improvement in immediate memory performance on a repeated list compared to unrepeated lists. That is, participants create a long-term memory representation over repetitions, on which they can draw in working memory tests. These long-term memory representations are likely formed by chunk acquisition: The whole list becomes integrated into a single unified representation. Previous research suggests that the formation of such chunks is rather inflexible and only occurs when at least the beginning of the list repeats across trials. However, recent work has shown that repetition learning strongly depends on participants recognizing the repeated information. Hence, successful chunk formation may depend on the recognizability of the repeated part of a list, and not on its position in the list. Across six experiments, we compared these two alternatives. We tested immediate serial recall of eight-letter lists, some of which partially repeated across trials. We used different partial-repetition structures, such as repeating only the first half of a list, or only every second item. We manipulated the salience of the repeating structure by spatially grouping and coloring the lists according to the repetition structure. We found that chunk formation is more flexible than previously assumed: Participants learned contiguous repeated sequences regardless of their position within the list, as long as they were able to recognize the repeated structure. Even when the repeated sequence occurred at varying positions over repetitions, learning was preserved when the repeated sequence was made salient by the spatial grouping. These findings suggest that chunk formation requires recognition of which items constitute a repeating group, and demonstrate a close link between grouping of information in working memory, and chunk formation in long-term memory.

Seeing what you believe: recognition memory for evolutionary tree structure is affected by students' misconceptions

Peoples' recognition memory for pictorial stimuli is extremely good. Even complex scientific visualisations are recognised with a high degree of accuracy. The present research examined recognition memory for the branching structure of evolutionary trees. This is an educationally consequential topic due to the potential for contamination from students' misconceptions. The authors created six pairs of scientifically accurate and structurally identical evolutionary trees that differed in whether they included a taxon that cued a misconception in memory. As predicted, Experiment 1 found that (a) college students (N = 90) had better memory for each of the six tree structures when a neutral taxon (M = 0.73) rather than a misconception-cuing taxon (M = 0.64) was included in the tree, and (b) recognition memory was significantly above chance for both sets of trees. Experiment 2 ruled out an alternative hypothesis based on the possibility that 8-12 sec was not enough time for students to encode the relationships depicted in the trees. The authors consider implications of these results for using evolutionary trees to better communicate scientific information. This is important because these trees provide information that is relevant for everyday life.

Hippocampus-to-amygdala pathway drives the separation of remote memories of related events

The mammalian brain can store and retrieve memories of related events as distinct memories and remember common features of those experiences. How it computes this function remains elusive. Here, we show in rats that recent memories of two closely timed auditory fear events share overlapping neuronal ensembles in the basolateral amygdala (BLA) and are functionally linked. However, remote memories have reduced neuronal overlap and are functionally independent. The activity of parvalbumin (PV)-expressing neurons in the BLA plays a crucial role in forming separate remote memories. Chemogenetic blockade of PV preserves individual remote memories but prevents their segregation, resulting in reciprocal associations. The hippocampus drives this process through specific excitatory connections with BLA GABAergic interneurons. These findings provide insights into the neuronal mechanisms that minimize the overlap between distinct remote memories and enable the retrieval of related memories separately.

The object as the unit for state switching in visual working memory

This study aimed to determine the unit for switching representational states in visual working memory (VWM). Two opposing hypotheses were investigated: (a) the unit of switching being a feature (feature-based hypothesis), and (b) the unit of switching being an object (object-based hypothesis). Participants (N = 180) were instructed to hold two features from either one or two objects in their VWM. The memory-driven attentional capture effect, suggesting that actively held information in VWM can cause attention to be drawn towards matched distractors, was employed to assess representational states of the first and second probed colors (indicated by a retro-cue). The results showed that only the feature indicated to be probed first could elicit memory related capture for the condition of separate objects. Importantly, features from an integrated object could guide attention regardless of the probe order. These findings were observed across three experiments involving features of different dimensions, same dimensions, or perceptual objects defined by Gestalt principles. They provide convergent evidence supporting the object-based hypothesis by indicating that features within a single object cannot exist in different states.

Behavioral signatures of the rapid recruitment of long-term memory to overcome working memory capacity limits

Working- and long-term memory are often studied in isolation. To better understand the specific limitations of working memory, effort is made to reduce the potential influence of long-term memory on performance in working memory tasks (e.g., asking participants to remember artificial, abstract items rather than familiar real-world objects). However, in everyday life we use working- and long-term memory in tandem. Here, our goal was to characterize how long-term memory can be recruited to circumvent capacity limits in a typical visual working memory task (i.e., remembering colored squares). Prior work has shown that incidental repetitions of working memory arrays often do not improve visual working memory performance - even after dozens of incidental repetitions, working memory performance often shows no improvement for repeated arrays. Here, we used a whole-report working memory task with explicit rather than incidental repetitions of arrays. In contrast to prior work with incidental repetitions, in two behavioral experiments we found that explicit repetitions of arrays yielded robust improvement to working memory performance, even after a single repetition. Participants performed above chance at recognizing repeated arrays in a later long-term memory test, consistent with the idea that long-term memory was used to rapidly improve performance across array repetitions. Finally, we analyzed inter-item response times and we found a response time signature of chunk formation that only emerged after the array was repeated (inter-response time slowing after two to three items); thus, inter-item response times may be useful for examining the coordinated interaction of visual working and long-term memory in future work.

The upside of cumulative conceptual interference on exemplar-level mnemonic discrimination

Although long-term visual memory (LTVM) has a remarkable capacity, the fidelity of its episodic representations can be influenced by at least two intertwined interference mechanisms during the encoding of objects belonging to the same category: the capacity to hold similar episodic traces (e.g., different birds) and the conceptual similarity of the encoded traces (e.g., a sparrow shares more features with a robin than with a penguin). The precision of episodic traces can be tested by having participants discriminate lures (unseen objects) from targets (seen objects) representing different exemplars of the same concept (e.g., two visually similar penguins), which generates interference at retrieval that can be solved if efficient pattern separation happened during encoding. The present study examines the impact of within-category encoding interference on the fidelity of mnemonic object representations, by manipulating an index of cumulative conceptual interference that represents the concurrent impact of capacity and similarity. The precision of mnemonic discrimination was further assessed by measuring the impact of visual similarity between targets and lures in a recognition task. Our results show a significant decrement in the correct identification of targets for increasing interference. Correct rejections of lures were also negatively impacted by cumulative interference as well as by the visual similarity with the target. Most interestingly though, mnemonic discrimination for targets presented with a visually similar lure was more difficult when objects were encoded under lower, not higher, interference. These findings counter a simply additive impact of interference on the fidelity of object representations providing a finer-grained, multi-factorial, understanding of interference in LTVM.

Beyond visual integration: sensitivity of the temporal-parietal junction for objects, places, and faces

One important role of the TPJ is the contribution to perception of the global gist in hierarchically organized stimuli where individual elements create a global visual percept. However, the link between clinical findings in simultanagnosia and neuroimaging in healthy subjects is missing for real-world global stimuli, like visual scenes. It is well-known that hierarchical, global stimuli activate TPJ regions and that simultanagnosia patients show deficits during the recognition of hierarchical stimuli and real-world visual scenes. However, the role of the TPJ in real-world scene processing is entirely unexplored. In the present study, we first localized TPJ regions significantly responding to the global gist of hierarchical stimuli and then investigated the responses to visual scenes, as well as single objects and faces as control stimuli. All three stimulus classes evoked significantly positive univariate responses in the previously localized TPJ regions. In a multivariate analysis, we were able to demonstrate that voxel patterns of the TPJ were classified significantly above chance level for all three stimulus classes. These results demonstrate a significant involvement of the TPJ in processing of complex visual stimuli that is not restricted to visual scenes and that the TPJ is sensitive to different classes of visual stimuli with a specific signature of neuronal activations.

Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response

Behavioral and neuroscience studies in humans and primates have shown that memorability is an intrinsic property of an image that predicts its strength of encoding into and retrieval from memory. While previous work has independently probed when or where this memorability effect may occur in the human brain, a description of its spatiotemporal dynamics is missing. Here, we used representational similarity analysis (RSA) to combine functional magnetic resonance imaging (fMRI) with source-estimated magnetoencephalography (MEG) to simultaneously measure when and where the human cortex is sensitive to differences in image memorability. Results reveal that visual perception of High Memorable images, compared to Low Memorable images, recruits a set of regions of interest (ROIs) distributed throughout the ventral visual cortex: a late memorability response (from around 300 ms) in early visual cortex (EVC), inferior temporal cortex, lateral occipital cortex, fusiform gyrus, and banks of the superior temporal sulcus. Image memorability magnitude results are represented after high-level feature processing in visual regions and reflected in classical memory regions in the medial temporal lobe (MTL). Our results present, to our knowledge, the first unified spatiotemporal account of visual memorability effect across the human cortex, further supporting the levels-of-processing theory of perception and memory.

Comparing memory capacity across stimuli requires maximally dissimilar foils: Using deep convolutional neural networks to understand visual working memory capacity for real-world objects

The capacity of visual working and visual long-term memory plays a critical role in theories of cognitive architecture and the relationship between memory and other cognitive systems. Here, we argue that before asking the question of how capacity varies across different stimuli or what the upper bound of capacity is for a given memory system, it is necessary to establish a methodology that allows a fair comparison between distinct stimulus sets and conditions. One of the most important factors determining performance in a memory task is target/foil dissimilarity. We argue that only by maximizing the dissimilarity of the target and foil in each stimulus set can we provide a fair basis for memory comparisons between stimuli. In the current work we focus on a way to pick such foils objectively for complex, meaningful real-world objects by using deep convolutional neural networks, and we validate this using both memory tests and similarity metrics. Using this method, we then provide evidence that there is a greater capacity for real-world objects relative to simple colors in visual working memory; critically, we also show that this difference can be reduced or eliminated when non-comparable foils are used, potentially explaining why previous work has not always found such a difference. Our study thus demonstrates that working memory capacity depends on the type of information that is remembered and that assessing capacity depends critically on foil dissimilarity, especially when comparing memory performance and other cognitive systems across different stimulus sets.

Activated long-term memory and visual working memory during hybrid visual search: Effects on target memory search and distractor memory

In hybrid visual search, observers must maintain multiple target templates and subsequently search for any one of those targets. If the number of potential target templates exceeds visual working memory (VWM) capacity, then the target templates are assumed to be maintained in activated long-term memory (aLTM). Observers must search the array for potential targets (visual search), as well as search through memory (target memory search). Increasing the target memory set size reduces accuracy, increases search response times (RT), and increases dwell time on distractors. However, the extent of observers' memory for distractors during hybrid search is largely unknown. In the current study, the impact of hybrid search on target memory search (measured by dwell time on distractors, false alarms, and misses) and distractor memory (measured by distractor revisits and recognition memory of recently viewed distractors) was measured. Specifically, we aimed to better understand how changes in behavior during hybrid search impacts distractor memory. Increased target memory set size led to an increase in search RTs, distractor dwell times, false alarms, and target identification misses. Increasing target memory set size increased revisits to distractors, suggesting impaired distractor location memory, but had no effect on a two-alternative forced-choice (2AFC) distractor recognition memory test presented during the search trial. The results from the current study suggest a lack of interference between memory stores maintaining target template representations (aLTM) and distractor information (VWM). Loading aLTM with more target templates does not impact VWM for distracting information.

Electrophysiological analysis of signal detection outcomes emphasizes the role of decisional factors in recognition memory

Introduction

Event-related potential (ERP) studies have identified two time windows associated with recognition memory and interpreted them as reflecting two processes: familiarity and recollection. However, using relatively simple stimuli and achieving high recognition rates, most studies focused on hits and correct rejections. This leaves out some information (misses and false alarms) that according to Signal Detection Theory (SDT) is necessary to understand signal processing.

Methods

We used a difficult visual recognition task with colored pictures of different categories to obtain enough of the four possible SDT outcomes and analyzed them with modern ERP methods.

Results

Non-parametric analysis of these outcomes identified a single time window (470 to 670 ms) which reflected activity within fronto-central and posterior-left clusters of electrodes, indicating differential processing. The posterior-left cluster significantly distinguished all STD outcomes. The fronto-central cluster only distinguished ERPs according to the subject's response: yes vs. no. Additionally, only electrophysiological activity within the posterior-left cluster correlated with the discrimination index (d').

Discussion

We show that when all SDT outcomes are examined, ERPs of recognition memory reflect a single-time window that may reveal a bottom-up factor discriminating the history of items (i.e. memory strength), as well as a top-down factor indicating participants' decision.

The visual familiarity effect on attentional working memory maintenance

Attentional refreshing has been described as an attention-based, domain-general maintenance mechanism in working memory. It is thought to operate via focusing executive attention on information held in working memory, protecting it from temporal decay and interference. Although attentional refreshing has attracted a lot of research, its functioning is still debated. At least one conception of refreshing supposes that it relies on semantic long-term memory representations to reconstruct working memory traces. Although investigations in the verbal domain found evidence against this hypothesis, a different pattern could emerge in visuospatial working memory in which absence of refreshing evidence has been observed for stimuli with minimal associated long-term knowledge. In a series of four experiments, the current study investigated the hypothesis of an involvement of semantic long-term representations in the functioning of attentional refreshing in the visuospatial domain. Both cognitive and memory load effects have been proposed as indexes of attentional refreshing. Therefore, we investigated the interaction between the effects of visual familiarity (a long-term memory effect) and cognitive load on recall performance (Experiments 1A and 1B), as well as the interaction between the effects of visual familiarity and memory load on the response times in a concurrent processing task (Experiments 2A and 2B). Results were consistent across experiments and go against the hypothesis of the involvement of semantic long-term memory in the functioning of attentional refreshing in visuospatial working memory. As such, this study corroborates the results found in the verbal domain. Implications for attentional refreshing and working memory are discussed.

No evidence of attentional prioritization for threatening targets in visual search

Throughout human evolutionary history, snakes have been associated with danger and threat. Research has shown that snakes are prioritized by our attentional system, despite many of us rarely encountering them in our daily lives. We conducted two high-powered, pre-registered experiments (total N = 224) manipulating target prevalence to understand this heightened prioritization of threatening targets. Target prevalence refers to the proportion of trials wherein a target is presented; reductions in prevalence consistently reduce the likelihood that targets will be found. We reasoned that snake targets in visual search should experience weaker effects of low target prevalence compared to non-threatening targets (rabbits) because they should be prioritized by searchers despite appearing rarely. In both experiments, we found evidence of classic prevalence effects but (contrasting prior work) we also found that search for threatening targets was slower and less accurate than for nonthreatening targets. This surprising result is possibly due to methodological issues common in prior studies, including comparatively smaller sample sizes, fewer trials, and a tendency to exclusively examine conditions of relatively high prevalence. Our findings call into question accounts of threat prioritization and suggest that prior attention findings may be constrained to a narrow range of circumstances.

The Accuracy and Precision of Memory for Natural Scenes: A Walk in the Park

It is challenging to quantify the accuracy and precision of scene memory because it is unclear what 'space' scenes occupy (how can we quantify error when misremembering a natural scene?). To address this, we exploited the ecologically valid, metric space in which scenes occur and are represented: routes. In a delayed estimation task, participants briefly saw a target scene drawn from a video of an outdoor 'route loop', then used a continuous report wheel of the route to pinpoint the scene. Accuracy was high and unbiased, indicating there was no net boundary extension/contraction. Interestingly, precision was higher for routes that were more self-similar (as characterized by the half-life, in meters, of a route's Multiscale Structural Similarity index), consistent with previous work finding a 'similarity advantage' where memory precision is regulated according to task demands. Overall, scenes were remembered to within a few meters of their actual location.

Rhesus monkeys show greater habituation to repeated computer-generated images than do orangutans

Humans and several other species of animals have demonstrated the ability to use familiarity to recognize that they have seen images before. In prior experiments, orangutans failed to show use of familiarity in memory tasks, even when other solutions were not available. We tested for evidence of habituation, a decreased response to repeated stimuli, as a behavioral indicator that repeated images were familiar to subjects. Monkeys and orangutans selected the smallest target out of four while computerized images were presented as distractors. Latency to complete the target-finding task was compared between conditions in which the distractor image was a familiar, repeating image, a novel, never-before-seen image, or no distractor was present. Rhesus macaques showed significant habituation, and significantly more habituation than orangutans, in each of four experiments. Orangutans showed statistically reliable habituation in only one of the four experiments. These results are consistent with previous research in which orangutans failed to demonstrate familiarity. Because we expect that familiarity and habituation are evolutionarily ancient memory processes, we struggle to explain these surprising, but consistent findings. Future research is needed to determine why orangutans respond to computerized images in this peculiar way.

Can the processing of task-irrelevant threatening stimuli be inhibited? - The role of shape and valence in the saliency of threatening objects

Numerous studies have demonstrated that attention is quickly oriented towards threatening stimuli, and that this attentional bias is difficult to inhibit. The root cause(s) of this bias may be attributable to the affective (e.g., valence) or visual features (e.g., shape) of threats. In two experiments (behavioral, eye-tracking), we tested which features play a bigger role in the salience of threats. In both experiments, participants looked for a neutral target (butterfly, lock) among other neutral objects. In half of the trials a threatening (snake, gun) or nonthreatening (but visually similar; worm, hairdryer) task-irrelevant distractor was also present at a near or far distance from the target. Behavioral results indicate that both distractor types interfered with task performance. Rejecting nonthreatening distractors as nontargets was easier when they were presented further from the target but distance had no effect when the distractor was threatening. Eye-tracking results showed that participants fixated less often (and for less time) on threatening compared to nonthreatening distractors. They also viewed targets for less time when a threatening distractor was present (compared to nonthreatening). Results suggest that visual features of threats are easier to suppress than affective features, and the latter may have a stronger role in eliciting attentional biases.

Early visual cortices reveal interrelated item and category representations in aging

Neural dedifferentiation, the finding that neural representations tend to be less distinct in older adults compared with younger adults, has been associated with age-related declines in memory performance. Most studies assessing the relation between memory and neural dedifferentiation have evaluated how age impacts the distinctiveness of neural representations for different visual categories (e.g., scenes and objects). However, how age impacts the quality of neural representations at the level of individual items is still an open question. Here, we present data from an age-comparative fMRI study that aimed to understand how the distinctiveness of neural representations for individual stimuli differs between younger and older adults and relates to memory outcomes. Pattern similarity searchlight analyses yielded indicators of neural dedifferentiation at the level of individual items as well as at the category level in posterior occipital cortices. We asked whether age differences in neural distinctiveness at each representational level were associated with inter- and/or intraindividual variability in memory performance. While age-related dedifferentiation at both the item and category level related to between-person differences in memory, neural distinctiveness at the category level also tracked within-person variability in memory performance. Concurrently, neural distinctiveness at the item level was strongly associated with neural distinctiveness at the category level both within and across participants, elucidating a potential representational mechanism linking item- and category-level distinctiveness. In sum, we provide evidence that age-related neural dedifferentiation co-exists across multiple representational levels and is related to memory performance.Significance Statement Age-related memory decline has been associated with neural dedifferentiation, the finding that older adults have less distinctive neural representations than younger adults. This has been mostly shown for category information, while evidence for age differences in the specificity of item representations is meager. We used pattern similarity searchlight analyses to find indicators of neural dedifferentiation at both levels of representation (category and item) and linked distinctiveness to memory performance. Both item- and category-level dedifferentiation in the calcarine cortex were related to interindividual differences in memory performance, while category-level distinctiveness further tracked intraindividual variability. Crucially, neural distinctiveness was strongly tied between the item and category levels, indicating that intersecting representational properties of posterior occipital cortices reflect both individual exemplars and categories.

Does value-based prioritization at working memory enhance long-term memory?

Research has demonstrated that individuals can direct their attention to valuable information in both working memory and long-term memory tasks with observable effects on performance. However, it is currently unclear whether prioritising an item for a working memory task automatically translates into a boost at long-term memory. This was examined in two experiments using relatively short (250 ms per item; Experiment 1) and longer (500 ms per item; Experiment 2) encoding times. Participants first completed a visual working memory task, in which they were presented with series of photographs of everyday objects. Following a brief delay (1,000 ms), they completed a four-alternative forced-choice test. Prior to encoding, participants were informed of the point values associated with each item. In some trials, the first item in the sequence was worth more points than the rest. In other trials, all items were equally valuable. After a filled delay, participants completed a surprise long-term memory task. At working memory, a value effect was reliably observed on recognition accuracy, along with some evidence of faster response times for high-value items. However, there was little consistent evidence of this effect automatically persisting into long-term memory. Thus, the benefits of attentional prioritization in working memory do not always translate into longer-term performance. More broadly, this provides further evidence that manipulations that enhance working memory performance do not necessarily enhance long-term memory.

Grid-like entorhinal representation of an abstract value space during prospective decision making

How valuable a choice option is often changes over time, making the prediction of value changes an important challenge for decision making. Prior studies identified a cognitive map in the hippocampal-entorhinal system that encodes relationships between states and enables prediction of future states, but does not inherently convey value during prospective decision making. In this fMRI study, participants predicted changing values of choice options in a sequence, forming a trajectory through an abstract two-dimensional value space. During this task, the entorhinal cortex exhibited a grid-like representation with an orientation aligned to the axis through the value space most informative for choices. A network of brain regions, including ventromedial prefrontal cortex, tracked the prospective value difference between options. These findings suggest that the entorhinal grid system supports the prediction of future values by representing a cognitive map, which might be used to generate lower-dimensional value signals to guide prospective decision making.

Recognition memory decisions made with short- and long-term retrieval

In the present research, we produce a coherent account of the storage and retrieval processes in short- and long-term event memory, and long-term knowledge, that produce response accuracy and response time in a wide variety of conditions in our studies of recognition memory. Two to nine pictures are studied sequentially followed by a target or foil test picture in four conditions used in Nosofsky et al. Journal of Experimental Psychology: Learning, Memory, and Cognition, 47, 316-342, (2021) and in our new paradigm: VM: target and foil responses to a given stimulus change from trial to trial; CM: the responses do not change from trial to trial; AN: every trial uses new stimuli; MIXED: combinations of VM, CN, and AN occur on each trial. In the new paradigm a given picture is equally often tested as old or new, but only in CM is the response key the same and learnable. Our model has components that have appeared in a variety of prior accounts, including learning and familiarity, but are given support by our demonstration that accuracy and response time data from a large variety of conditions can be predicted by these processes acting together, with parameter values that largely are unchanged. A longer version of this article, containing information not found here due to space, is available online  https://doi.org/10.31234/osf.io/h8msp .The avalibility of the data (supplement materials), info and link is attached at the end section ( https://psyarxiv.com/h8msp .).

Category-based attention facilitates memory search

We often need to decide whether the object we look at is also the object we look for. When we look for one specific object, this process can be facilitated by feature-based attention. However, when we look for many objects at the same time (e.g., the products on our shopping list) such a strategy may no longer be possible, as research has shown that we can actively prepare to detect only one or two objects at a time. Therefore, looking for multiple objects additionally requires long-term memory search, slowing down decision making. Interestingly, however, previous research has shown that distractor objects can be efficiently rejected during memory search when they are from a different category than the items in the memory set. Here, using EEG, we show that this efficiency is supported by top-down attention at the category level. In Experiment 1, human participants (both sexes) performed a memory search task on individually presented objects from different categories, most of which were distractors. We observed category-level attentional modulation of distractor processing from ∼150 ms after stimulus onset, expressed both as an evoked response modulation and as an increase in decoding accuracy of same-category distractors. In Experiment 2, memory search was performed on two concurrently presented objects. When both objects were distractors, spatial attention (indexed by the N2pc component) was directed to the object that was of the same category as the objects in the memory set. Together, these results demonstrate how top-down attention can facilitate memory search.Significance statement When we are in the supermarket, we repeatedly decide whether a product we look at (e.g., a banana) is on our memorized shopping list (e.g., apples, oranges, kiwis). This requires searching our memory, which takes time. However, when the product is of an entirely different category (e.g., dairy instead of fruit), the decision can be made quickly. Here, we used EEG to show that this between-category advantage in memory search tasks is supported by top-down attentional modulation of visual processing: The visual response evoked by distractor objects was modulated by category membership, and spatial attention was quickly directed to the location of within-category (vs. between-category) distractors. These results demonstrate a close link between attention and memory.

ORCA: A picture database of object-scene arrangements for cross-cultural and aging research

In recent years, cross-cultural research on the modulation of basic cognitive processes by culture has intensified - also from an aging perspective. Despite this increased research interest, only a few cross-culturally normed non-verbal stimulus sets are available to support cross-cultural cognitive research in younger and older adults. Here we present the ORCA (Official Rating of Complex Arrangements) picture database, which includes a total of 720 object-scene compositions sorted into 180 quadruples (e.g., two different helmets placed in two different deserts). Each quadruple contains visually and semantically matched pairs of objects and pairs of scenes with varying degrees of semantic fit between objects and scenes. A total of 95 younger and older German and Chinese adults rated every object-scene pair on object familiarity and semantic fit between object and scene. While the ratings were significantly correlated between cultures and age groups, small but significant culture and age differences emerged. Object familiarity was higher for older adults than younger adults and for German participants than for Chinese participants. Semantic fit was rated lower by German older adults and Chinese younger adults as compared to German younger adults and Chinese older adults. Due to the large number of stimuli, our database is particularly well suited for cognitive and neuroscientific research on cross-cultural and age-related differences in perception, attention, and memory.

Differential effects of intrinsic properties of natural scenes and interference mechanisms on recognition processes in long-term visual memory

Humans display remarkable long-term visual memory (LTVM) processes. Even though images may be intrinsically memorable, the fidelity of their visual representations, and consequently the likelihood of successfully retrieving them, hinges on their similarity when concurrently held in LTVM. In this debate, it is still unclear whether intrinsic features of images (perceptual and semantic) may be mediated by mechanisms of interference generated at encoding, or during retrieval, and how these factors impinge on recognition processes. In the current study, participants (32) studied a stream of 120 natural scenes from 8 semantic categories, which varied in frequencies (4, 8, 16 or 32 exemplars per category) to generate different levels of category interference, in preparation for a recognition test. Then they were asked to indicate which of two images, presented side by side (i.e. two-alternative forced-choice), they remembered. The two images belonged to the same semantic category but varied in their perceptual similarity (similar or dissimilar). Participants also expressed their confidence (sure/not sure) about their recognition response, enabling us to tap into their metacognitive efficacy (meta-d'). Additionally, we extracted the activation of perceptual and semantic features in images (i.e. their informational richness) through deep neural network modelling and examined their impact on recognition processes. Corroborating previous literature, we found that category interference and perceptual similarity negatively impact recognition processes, as well as response times and metacognitive efficacy. Moreover, images semantically rich were less likely remembered, an effect that trumped a positive memorability boost coming from perceptual information. Critically, we did not observe any significant interaction between intrinsic features of images and interference generated either at encoding or during retrieval. All in all, our study calls for a more integrative understanding of the representational dynamics during encoding and recognition enabling us to form, maintain and access visual information.

Control over attentional capture within 170 ms by long-term memory control settings: Evidence from the N2pc

Observers adopt attentional control settings (ACSs) based on their goals that guide the capture of attention: Searched-for stimuli capture attention, and stimuli that are not searched for do not. While previous behavioural research indicates that observers can adopt long-term memory (LTM) ACSs (Giammarco et al. Visual Cognition, 24, 78-101, 2016), it seems surprising that representations in LTM could guide attention quickly enough to control attentional capture. To assess the claim that LTM ACSs exert control over early attentional orienting, we recorded electroencephalography while participants studied and searched for 30 target objects in an attention cueing task. Participants reported the studied target and ignored the preceding cues. To control for perceptual evoked responses, on each trial we presented two cue objects (one studied and one nonstudied). Even though participants were instructed to ignore the cues, studied cues produced the N2pc event-related potential, indicating early attentional orienting that was preferentially directed towards the studied cue versus the nonstudied cue. Critically, the N2pc was detectable within 170 ms, confirming that LTM ACSs rapidly control early capture. We propose an update to contemporary models of attentional capture to account for rapid attentional guidance by LTM ACSs.

Geometry of visuospatial working memory information in miniature gaze patterns

Stimulus-dependent eye movements have been recognized as a potential confound in decoding visual working memory information from neural signals. Here we combined eye-tracking with representational geometry analyses to uncover the information in miniature gaze patterns while participants (n = 41) were cued to maintain visual object orientations. Although participants were discouraged from breaking fixation by means of real-time feedback, small gaze shifts (<1°) robustly encoded the to-be-maintained stimulus orientation, with evidence for encoding two sequentially presented orientations at the same time. The orientation encoding on stimulus presentation was object-specific, but it changed to a more object-independent format during cued maintenance, particularly when attention had been temporarily withdrawn from the memorandum. Finally, categorical reporting biases increased after unattended storage, with indications of biased gaze geometries already emerging during the maintenance periods before behavioural reporting. These findings disclose a wealth of information in gaze patterns during visuospatial working memory and indicate systematic changes in representational format when memory contents have been unattended.

Investigating the effects of perceptual complexity versus conceptual meaning on the object benefit in visual working memory

Previous research has demonstrated greater visual working memory (VWM) performance for real-world objects compared with simple features. Greater amplitudes of the contralateral delay activity (CDA)-a sustained event-related potential measured during the delay period of a VWM task-have also been noted for meaningful stimuli, despite being thought of as a neural marker of a fixed working memory capacity. The current study aimed to elucidate the factors underlying improved memory performance for real-world objects by isolating the relative contributions of perceptual complexity (i.e., number of visual features) and conceptual meaning (i.e., availability of semantic, meaningful features). Participants (N = 22) performed a lateralized VWM task to test their memory of intact real-world objects, scrambled real-world objects and colours. The CDA was measured during both encoding and WM retention intervals (600-1000 ms and 1300-1700 ms poststimulus onset, respectively), and behavioural performance was estimated by using d' (memory strength in a two-alternative forced choice task). Behavioural results revealed significantly better performance within-subjects for real-world objects relative to scrambled objects and colours, with no difference between colours and scrambled objects. The amplitude of the CDA was also largest for intact real-world objects, with no difference in magnitude for scrambled objects and colours, during working memory maintenance. However, during memory encoding, both the colours and intact real-world objects had significantly greater amplitudes than scrambled objects and were comparable in magnitude. Overall, findings suggest that conceptual meaning (semantics) supports the memory benefit for real-world objects.

The effect of hippocampal subfield damage on rapid temporal integration through statistical learning and associative inference

INTRODUCTION

The hippocampus (HPC) supports integration of information across time, often indexed by associative inference (AI) and statistical learning (SL) tasks. In AI, an indirect association between stimuli that never appeared together is inferred, whereas SL involves learning item relationships by extracting regularities across experiences. A recent model of hippocampal function (Schapiro et al., 2017) proposes that the HPC can support temporal integration in both paradigms through its two distinct pathways.

METHODS

We tested this models' predictions in four patients with varying degrees of bilateral HPC damage and matched healthy controls, with two patients with complementary damage to either the monosynaptic or trisynaptic pathway. During AI, participants studied overlapping paired associates (AB, BC) and their memory was tested for premise pairs (AB) and for inferred pairs (AC). During SL, participants passively viewed a continuous picture sequence that contained an underlying structure of triplets that later had to be recognized.

RESULTS

Binomial distributions were used to calculate above chance performance at the individual level. For AI, patients with focal HPC damage were impaired at inference but could correctly infer pairs above chance once premise pair acquisition was equated to controls; however, the patient with HPC and cortical damage showed severe impairment at recalling premise and inferred pairs, regardless of accounting for premise pair performance. For SL, none of the patients performed above chance, but notably neither did most controls.

CONCLUSIONS

Associative inference of indirect relationships can be intact with HPC damage to either hippocampal pathways or the HPC more broadly, provided premise pairs can first be formed. Inference may remain intact through residual HPC tissue supporting premise pair acquisition, and/or through extra-hippocampal structures supporting inference at retrieval. Clear conclusions about hippocampal contributions to SL are precluded by low performance in controls, which we caution is not dissimilar to previous amnesic studies using the same task. This complicates interpretations of studies claiming necessity of hippocampal contributions to SL and warrants the use of a common and reliable task before conclusions can be drawn.

The effect of reward-induced arousal on the success and precision of episodic memory retrieval

Moment-to-moment fluctuations in arousal can have large effects on learning and memory. For example, when neutral items are predictive of a later reward, they are often remembered better than neutral items without a reward association. This reward anticipation manipulation is thought to induce a heightened state of arousal, resulting in stronger encoding. It is unclear, however, whether these arousal-induced effects on encoding are 'all-or-none', or whether encoding precision varies from trial to trial with degree of arousal. Here, we examined whether trial-to-trial variability in reward-related pupil-linked arousal might correspond to variability in participants' long-term memory encoding precision. We tested this using a location memory paradigm in which half of the to-be-encoded neutral items were linked to later monetary reward, while the other half had no reward association. After the encoding phase, we measured immediate item location memory on a continuous scale, allowing us to assess both memory success and memory precision. We found that pre-item baseline pupil size and pupil size during item encoding were not related to subsequent memory performance. In contrast, the anticipation of instrumental reward increased pupil size, and a smaller anticipatory increase in pupil size was linked to greater subsequent memory success but not memory precision.

Predicting memorability of face photographs with deep neural networks

With the advent of social media in our daily life, we are exposed to a plethora of images, particularly face photographs, every day. Recent behavioural studies have shown that some of these photographs stick in the mind better than others. Previous research have shown that memorability is an intrinsic property of an image, hence the memorability of an image can be computed from that image. Moreover, various works found that the memorability of an image is highly consistent across people and also over time. Recently, researchers employed deep neural networks to predict image memorability. Here, we show although those models perform well on scene and object images, they perform poorly on photographs of human faces. We demonstrate and explain why generic memorability models do not result in an acceptable performance on face photographs and propose seven different models to estimate the memorability of face images. In addition, we show that these models outperform the previous classical methods, which were used for predicting face memorability.

High target prevalence may reduce the spread of attention during search tasks

Target prevalence influences many cognitive processes during visual search, including target detection, search efficiency, and item processing. The present research investigated whether target prevalence may also impact the spread of attention during search. Relative to low-prevalence searches, high-prevalence searches typically yield higher fixation counts, particularly during target-absent trials. This may emerge because the attention spread around each fixation may be smaller for high than low prevalence searches. To test this, observers searched for targets within object arrays in Experiments 1 (free-viewing) and 2 (gaze-contingent viewing). In Experiment 3, observers searched for targets in a Rapid Serial Visual Presentation (RSVP) stream at the center of the display while simultaneously processing occasional peripheral objects. Experiment 1 used fixation patterns to estimate attentional spread, and revealed that attention was narrowed during high, relative to low, prevalence searches. This effect was weakened during gaze-contingent search (Experiment 2) but emerged again when eye movements were unnecessary in RSVP search (Experiment 3). These results suggest that, although task demands impact how attention is allocated across displays, attention may also narrow when searching for frequent targets.

Memory benefits when actively, rather than passively, viewing images

Serial visual presentations of images exist both in the laboratory and increasingly on virtual platforms such as social media feeds. However, the way we interact with information differs between these. In many laboratory experiments participants view stimuli passively, whereas on social media people tend to interact with information actively. This difference could influence the way information is remembered, which carries practical and theoretical implications. In the current study, 821 participants viewed streams containing seven landscape images that were presented at either a self-paced (active) or an automatic (passive) rate. Critically, the presentation speed in each automatic trial was matched to the speed of a self-paced trial for each participant. Both memory accuracy and memory confidence were greater on self-paced compared to automatic trials. These results indicate that active, self-paced progression through images increases the likelihood of them being remembered, relative to when participants have no control over presentation speed and duration.

Memoir study: Investigating image memorability across developmental stages

Images have been shown to consistently differ in terms of their memorability in healthy adults: some images stick in one's mind while others are forgotten quickly. Studies have suggested that memorability is an intrinsic, continuous property of a visual stimulus that can be both measured and manipulated. Memory literature suggests that important developmental changes occur throughout adolescence that have an impact on recognition memory, yet the effect that these changes have on image memorability has not yet been investigated. In the current study, we recruited adolescents ages 11-18 (n = 273, mean = 16) to an online visual memory experiment to explore the effects of developmental changes throughout adolescence on image memorability, and determine if memorability findings in adults can be generalized to the adolescent age group. We used the online experiment to calculate adolescent memorability scores for 1,000 natural images, and compared the results to the MemCat dataset-a memorability dataset that is annotated with adult memorability scores (ages 19-27). Our study finds that memorability scores in adolescents and adults are strongly and significantly correlated (Spearman's rank correlation, r = 0.76, p < 0.001). This correlation persists even when comparing adults with developmentally different sub-groups of adolescents (ages 11-14: r = 0.67, p < 0.001; ages 15-18: r = 0.60, p < 0.001). Moreover, the rankings of image categories by mean memorability scores were identical in both adolescents and adults (including the adolescent sub-groups), indicating that broadly, certain image categories are more memorable for both adolescents and adults. Interestingly, however, adolescents experienced significantly higher false alarm rates than adults, supporting studies that show increased impulsivity and reward-seeking behaviour in adolescents. Our results reveal that the memorability of images remains consistent across individuals at different stages of development. This consistency aligns with and strengthens prior research, indicating that memorability is an intrinsic property of images. Our findings open new pathways for applying memorability studies in adolescent populations, with profound implications in fields such as education, marketing, and psychology. Our work paves the way for innovative approaches in these domains, leveraging the consistent nature of image memorability across age groups.

Large-scale network dynamics underlying the first few hundred milliseconds after stimulus presentation: An investigation of visual recognition memory using iEEG

Recognition memory is the ability to recognize previously encountered objects. Even this relatively simple, yet extremely fast, ability requires the coordinated activity of large-scale brain networks. However, little is known about the sub-second dynamics of these networks. The majority of current studies into large-scale network dynamics is primarily based on imaging techniques suffering from either poor temporal or spatial resolution. We investigated the dynamics of large-scale functional brain networks underlying recognition memory at the millisecond scale. Specifically, we analyzed dynamic effective connectivity from intracranial electroencephalography while epileptic subjects (n = 18) performed a fast visual recognition memory task. Our data-driven investigation using Granger causality and the analysis of communities with the Louvain algorithm spotlighted a dynamic interplay of two large-scale networks associated with successful recognition. The first network involved the right visual ventral stream and bilateral frontal regions. It was characterized by early, predominantly bottom-up information flow peaking at 115 ms. It was followed by the involvement of another network with predominantly top-down connectivity peaking at 220 ms, mainly in the left anterior hemisphere. The transition between these two networks was associated with changes in network topology, evolving from a more segregated to a more integrated state. These results highlight that distinct large-scale brain networks involved in visual recognition memory unfold early and quickly, within the first 300 ms after stimulus onset. Our study extends the current understanding of the rapid network changes during rapid cognitive processes.

Reminder-dependent alterations in long-term declarative memory expression

The reminder of a previously-learned memory can render that memory vulnerable to disruption or change in expression. Such memory alterations have been viewed as supportive of the framework of memory reconsolidation. However, alternative interpretations and inconsistencies in the replication of fundamental findings have raised questions particularly in the domain of human declarative memory. Here we present a series of related experiments, all of which involve the learning of a declarative memory, followed 1-2 days later by memory reminder. Post-reminder learning of interfering material did result in modulation of subsequent recall at test, but the precise manifestation of that interference effect differed across experiments. With post-reminder performance of a visuospatial task, a quantitative impairment in test recall performance was observed within a visual list-learning paradigm, but not in a foreign vocabulary learning paradigm. These results support the existence of reminder-induced memory processes that can lead to the alteration of subsequent memory performance by interfering tasks. However, it remains unclear whether these effects are reflective of modulation or impairment of the putative memory reconsolidation process.

Sequential encoding aids working memory for meaningful objects' identities but not for their colors

Previous studies have found that real-world objects' identities are better remembered than simple features like colored circles, and this effect is particularly pronounced when these stimuli are encoded one by one in a serial, item-based way. Recent work has also demonstrated that memory for simple features like color is improved if these colors are part of real-world objects, suggesting that meaningful objects can serve as a robust memory scaffold for their associated low-level features. However, it is unclear whether the improved color memory that arises from the colors appearing on real-world objects is affected by encoding format, in particular whether items are encoded sequentially or simultaneously. We test this using randomly colored silhouettes of recognizable versus unrecognizable scrambled objects that offer a uniquely controlled set of stimuli to test color working memory of meaningful versus non-meaningful objects. Participants were presented with four stimuli (silhouettes of objects or scrambled shapes) simultaneously or sequentially. After a short delay, they reported either which colors or which shapes they saw in a two-alternative forced-choice task. We replicated previous findings that meaningful stimuli boost working memory performance for colors (Exp. 1). We found that when participants remembered the colors (Exp. 2) there was no difference in performance across the two encoding formats. However, when participants remembered the shapes and thus identity of the objects (Exp. 3), sequential presentation resulted in better performance than simultaneous presentation. Overall, these results show that different encoding formats can flexibly impact visual working memory depending on what the memory-relevant feature is.

Memorability of line drawings of scenes: the role of contour properties

Why are some images more likely to be remembered than others? Previous work focused on the influence of global, low-level visual features as well as image content on memorability. To better understand the role of local, shape-based contours, we here investigate the memorability of photographs and line drawings of scenes. We find that the memorability of photographs and line drawings of the same scenes is correlated. We quantitatively measure the role of contour properties and their spatial relationships for scene memorability using a Random Forest analysis. To determine whether this relationship is merely correlational or if manipulating these contour properties causes images to be remembered better or worse, we split each line drawing into two half-images, one with high and the other with low predicted memorability according to the trained Random Forest model. In a new memorability experiment, we find that the half-images predicted to be more memorable were indeed remembered better, confirming a causal role of shape-based contour features, and, in particular, T junctions in scene memorability. We performed a categorization experiment on half-images to test for differential access to scene content. We found that half-images predicted to be more memorable were categorized more accurately. However, categorization accuracy for individual images was not correlated with their memorability. These results demonstrate that we can measure the contributions of individual contour properties to scene memorability and verify their causal involvement with targeted image manipulations, thereby bridging the gap between low-level features and scene semantics in our understanding of memorability.

Opposite effects of emotion and event segmentation on temporal order memory and object-context binding

Our daily lives unfold continuously, yet our memories are organised into distinct events, situated in a specific context of space and time, and chunked when this context changes (at event boundaries). Previous research showed that this process, termed event segmentation, enhances object-context binding but impairs temporal order memory. Physiologically, peaks in pupil dilation index event segmentation, similar to emotion-induced bursts of autonomic arousal. Emotional arousal also modulates object-context binding and temporal order memory. Yet, these two critical factors have not been systematically studied together. To address this gap, we ran a behavioural experiment using a paradigm validated to study event segmentation and extended it with emotion manipulation. During encoding, we sequentially presented greyscale objects embedded in coloured frames (colour changes defining events), with a neutral or aversive sound. During retrieval, we tested participants' memory of temporal order memory and object-colour binding. We found opposite effects of emotion and event segmentation on episodic memory. While event segmentation enhanced object-context binding, emotion impaired it. On the contrary, event segmentation impaired temporal order memory, but emotion enhanced it. These findings increase our understanding of episodic memory organisation in laboratory settings, and potentially in real life with perceptual changes and emotion fluctuations constantly interacting.

Misspelled logotypes: the hidden threat to brand identity

Brand names are valuable company assets often accompanied by a unique graphical composition (i.e., as logotypes). Recent research has demonstrated that this uniqueness makes brand names and logotypes susceptible to counterfeiting through misspelling by transposition in tasks that require participants to identify correct spellings. However, our understanding of how brand names are incidentally processed when presented as logotypes is incomplete. To address this gap in knowledge, we conducted a virtual reality experiment to explore the transposed-letter confusability effect on brand name recognition. Participants were immersed in a virtual reality setting and incidentally exposed to logotypes that had correctly spelled brand names or included letter transpositions. Offline analyses revealed that participants were more accurate at recognizing brand names that had been presented with correct spellings than those that had been misspelled. Furthermore, participants exhibited false memories for misspelled logotypes, recalling them as if they had been spelled correctly. Thus, our findings revealed that the incidental processing of misspelled logotypes (e.g., SASMUNG) affects the accuracy of logotype identity recognition, thereby underscoring the challenges faced by individuals when identifying brand names and the elements that make counterfeits so effective.

Which factor affects the storage of real-world object information in visual working memory: perceptual or conceptual information?

Visual working memory (VWM) is a limited dynamic memory system where people temporarily store and process visual information. Previous research showed that real-world objects do not have a fixed capacity compared to simple ones. In konkle's study, they found that the conceptual information and perception information of real-world objects had different effects on visual long-term memory (VLTM) capacity. VLTM capacity was more dependent on conceptual information than the perceptual distinctiveness of real-world objects. However, we did not know how the intrinsic attribute of real-world objects affects VWM capacity yet. In the current research, we set five experiments to explore the comparative effects of conceptual vs. perceptual information of real-world objects in VWM capacity. Our results suggested that VWM capacity was more dependent on the perceptual distinctiveness of real-world objects than on conceptual structure. These data provide evidence that VWM capacity for real-world objects depends more on perceptual information than on conceptual structure.

VWM-based bias in conscious access can be extended to a new sandwich masking task and real-life stimuli

Previous studies using breaking continuous flash suppression observed that the content of visual working memory (VWM) influences the priority for accessing visual awareness. However, most studies have used simple stimuli, whereas real-life objects are typically more meaningful and contain more perceptual information than simple objects. In this study, we intermixed a delayed match-to-sample task to manipulate the content of VWM, and a breaking repeated masking suppression (b-RMS) task to investigate whether this memory-based effect in conscious access can be extended to a new sandwich masking task and real-life stimuli. The results revealed that memory-congruent objects broke RMS faster than incongruent objects for both simple and real-life objects. Specifically, for simple objects, color-matching targets broke RMS faster than color-mismatching targets, whereas state-matching targets broke RMS faster than state-mismatching targets for real-life objects. These results suggest that the faster detection of VWM-matching over VWM mismatching stimuli-which has been mostly studied using only one type of task (b-CFS) and stimulus (colored shapes)-extends to (1) yet another masking technique (b-RMS) and to (2) a novel stimulus type (real-life objects), providing evidence that memory-based biases in conscious access are a ubiquitous phenomenon.

Long-term memory for movie details: selective decay for verbal information at one week

Mnemonic representations of complex events are multidimensional, incorporating information about objects and characters, their interactions and their spatial-temporal context. The present study investigated the degree to which detailed verbal information (i.e., dialogues), as well as semantic and spatiotemporal (i.e., "what", "where", and "when") elements of episodic memories for movies, are forgotten over the course of a week. Moreover, we tested whether the amount of dimension-specific forgetting differed as a function of the participant's age. In a mixed design, younger and middle-aged participants were asked to watch a ∼90 min movie and provide yes/no answers to detailed questions about different dimensions of the presented material after 1, 3 days, and 1 week. The results indicate that memory decay mainly affects the verbal dimension, both in terms of response accuracy and confidence. Instead, detailed information about objects/characters' features and spatiotemporal context seems to be relatively preserved, despite a general decrease in response confidence. Furthermore, younger adults were in general more accurate and confident than middle-aged participants, although, again, the verbal dimension exhibited a significant age-related difference. We propose that this selective forgetting depends on the progressive advantage of visual compared to auditory/verbal information in memory for complex events.

Meaningful objects avoid attribute amnesia due to incidental long-term memories

Attribute amnesia describes the failure to unexpectedly report the attribute of an attended stimulus, likely reflecting a lack of working memory consolidation. Previous studies have shown that unique meaningful objects are immune to attribute amnesia. However, these studies used highly dissimilar foils to test memory, raising the possibility that good performance at the surprise test was based on an imprecise (gist-like) form of long-term memory. In Experiment 1, we explored whether a more sensitive memory test would reveal attribute amnesia in meaningful objects. We used a four-alternative-forced-choice test with foils having mis-matched exemplar (e.g., apple pie/pumpkin pie) and/or state (e.g., cut/full) information. Errors indicated intact exemplar, but not state information. Thus, meaningful objects are vulnerable to attribute amnesia under the right conditions. In Experiments 2A-2D, we manipulated the familiarity signals of test items by introducing a critical object as a pre-surprise target. In the surprise trial, this critical item matched one of the foil choices. Participants selected the critical object more often than other items. By demonstrating that familiarity influences responses in this paradigm, we suggest that meaningful objects are not immune to attribute amnesia but instead side-step the effects of attribute amnesia.

Standardised images of novel objects created with generative adversarial networks

An enduring question in cognitive science is how perceptually novel objects are processed. Addressing this issue has been limited by the absence of a standardised set of object-like stimuli that appear realistic, but cannot possibly have been previously encountered. To this end, we created a dataset, at the core of which are images of 400 perceptually novel objects. These stimuli were created using Generative Adversarial Networks that integrated features of everyday stimuli to produce a set of synthetic objects that appear entirely plausible, yet do not in fact exist. We curated an accompanying dataset of 400 familiar stimuli, which were matched in terms of size, contrast, luminance, and colourfulness. For each object, we quantified their key visual properties (edge density, entropy, symmetry, complexity, and spectral signatures). We also confirmed that adult observers (N = 390) perceive the novel objects to be less familiar, yet similarly engaging, relative to the familiar objects. This dataset serves as an open resource to facilitate future studies on visual perception.

Sleep consolidates stimulus-response learning

Performing a motor response to a sensory stimulus creates a memory trace whose behavioral correlates are classically investigated in terms of repetition priming effects. Such stimulus-response learning entails two types of associations that are partly independent: (1) an association between the stimulus and the motor response and (2) an association between the stimulus and the classification task in which it is encountered. Here, we tested whether sleep supports long-lasting stimulus-response learning on a task requiring participants (1) for establishing stimulus-classification associations to classify presented objects along two different dimensions ("size" and "mechanical") and (2) as motor response (action) to respond with either the left or right index finger. Moreover, we examined whether strengthening of stimulus-classification associations is preferentially linked to nonrapid eye movement (non-REM) sleep and strengthening of stimulus-action associations to REM sleep. We tested 48 healthy volunteers in a between-subjects design comparing postlearning retention periods of nighttime sleep versus daytime wakefulness. At postretention testing, we found that sleep supports consolidation of both stimulus-action and stimulus-classification associations, as indicated by increased reaction times in "switch conditions"; that is, when, at test, the acutely instructed classification task and/or correct motor response for a given stimulus differed from that during original learning. Polysomnographic recordings revealed that both kinds of associations were correlated with non-REM spindle activity. Our results do not support the view of differential roles for non-REM and REM sleep in the consolidation of stimulus-classification and stimulus-action associations, respectively.

Tracing the emergence of the memorability benefit

Some visual stimuli are consistently better remembered than others across individuals, due to variations in memorability (the stimulus-intrinsic property that determines ease of encoding into visual long-term memory (VLTM)). However, it remains unclear what cognitive processes give rise to this mnemonic benefit. One possibility is that this benefit is imbued within the capacity-limited bottleneck of VLTM encoding, namely visual working memory (VWM). More precisely, memorable stimuli may be preferentially encoded into VLTM because fewer cognitive resources are required to store them in VWM (efficiency hypothesis). Alternatively, memorable stimuli may be more competitive in obtaining cognitive resources than forgettable stimuli, leading to more successful storage in VWM (competitiveness hypothesis). Additionally, the memorability benefit might emerge post-VWM, specifically, if memorable stimuli are less prone to be forgotten (i.e., are "stickier") than forgettable stimuli after they pass through the encoding bottleneck (stickiness hypothesis). To test this, we conducted two experiments to examine how memorability benefits emerge by manipulating the stimulus memorability, set size, and degree of competition among stimuli as participants encoded them in the context of a working memory task. Subsequently, their memory for the encoded stimuli was tested in a VLTM task. In the VWM task, performance was better for memorable stimuli compared to forgettable stimuli, supporting the efficiency hypothesis. In addition, we found that when in direct competition, memorable stimuli were also better at attracting limited VWM resources than forgettable stimuli, supporting the competitiveness hypothesis. However, only the efficiency advantage translated to a performance benefit in VLTM. Lastly, we found that memorable stimuli were less likely to be forgotten after they passed through the encoding bottleneck imposed by VWM, supporting the "stickiness" hypothesis. Thus, our results demonstrate that the memorability benefit develops across multiple cognitive processes.

Hippocampal orchestration of associative and sequential memory networks for episodic retrieval

Episodic memory involves the recollection of contextual details replayed mentally across time. Here, we propose the association-sequence network (ASN) model, characterizing complementary cortico-hippocampal networks underlying the retrieval of simultaneously associated and sequentially ordered events. Participants viewed objects, presented singly or in pairs, and later reported whether two objects were shown simultaneously, consecutively, or farther apart in time. Behavioral results and hippocampal activation reveal a correlation between the two sequential conditions but not the simultaneous condition, despite the temporal proximity of consecutive pairs. We also find that anterior hippocampal activity is modulated by temporal distance. Distinct cortical networks are engaged during simultaneous and sequential memory (prefrontal cortex and angular gyrus for association; supplementary motor cortex and precuneus for sequence); notably, these regions show differential connectivity with the hippocampus. The ASN model provides a comprehensive framework for how we reconstruct memories that are both rich in associative detail and temporally dynamic in nature.

The effects of viewing by scrolling on a small screen on the encoding of objects into visual long-term memory

The perception of an image obtained by scrolling through a small screen can differ from the typical perception of a wide visual field in a stable environment. However, we do not fully understand image perception by scrolling on a small screen based on psychological knowledge of visual perception and cognition of images. This study investigated how screen size limitations and image shifts caused by scrolling affect image encoding in visual long-term memory. Participants explored the stimulus images under three conditions. Under the scrolling condition, they explored the image through a small screen. Under the moving-window condition, they explored the image by moving the screen over a masked image; this is similar to looking through a moving peephole. Under the no-window condition, participants were able to view the entire image simultaneously. Each stimulus comprised 12 objects. After 1 h, the samples were tested for object recognition. Consequently, the memory retention rate was higher in the scrolling and moving-window conditions than in the no-window condition, and no difference was observed between the scrolling and moving-window conditions. The time required by participants to explore the stimulus was shorter under the no-window condition. Thus, encoding efficiency (i.e., the rate of encoding information into memory in a unit of time) did not differ among the three conditions. An analysis of the scan trace of the scrolling and window movements in relation to the image revealed differences between the scrolling and moving-window conditions in terms of the scan's dynamic features. Moreover, a negative correlation was observed between the memory retention rate and image-scrolling speed. We conclude that perceiving images by scrolling on a small screen enables better memory retention than that obtained through whole-image viewing if the viewing time is not limited. We suggest that viewing through a small screen is not necessarily disadvantageous for memory encoding efficiency depending on the presentation mode, and the results show that participants who scrolled fast tended to have worse memory retention. These findings can impact school education and thus suggest that the use of mobile devices in learning has some merit from the viewpoint of cognitive psychology.

Polish norms for a set of colored drawings of 168 objects and 146 actions with predictors of naming performance

In this study, we present the first database of pictures and their corresponding psycholinguistic norms for Polish: the CLT database. In this norming study, we used the pictures from Cross-Linguistic Lexical Tasks (CLT): a set of colored drawings of 168 object and 146 actions. The CLT pictures were carefully created to provide a valid tool for multicultural comparisons. The pictures are accompanied by norms for Naming latencies, Name agreement, Goodness of depiction, Image agreement, Concept familiarity, Age of acquisition, Imageability, Lexical frequency, and Word complexity. We also report analyses of predictors of Naming latencies for pictures of objects and actions. Our results show that Name agreement, Concept familiarity, and Lexical frequency are significant predictors of Naming latencies for pictures of both objects and actions. Additionally, Age of acquisition significantly predicts Naming latencies of pictures of objects. The CLT database is freely available at osf.io/gp9qd. The full set of CLT pictures, including additional variants of pictures, is available on request at osf.io/y2cwr.

Spatial Scene Memories Are Biased Towards a Fixed Amount of Semantic Information

Scene memory has known spatial biases. Boundary extension is a well-known bias whereby observers remember visual information beyond an image's boundaries. While recent studies demonstrate that boundary contraction also reliably occurs based on intrinsic image properties, the specific properties that drive the effect are unknown. This study assesses the extent to which scene memory might have a fixed capacity for information. We assessed both visual and semantic information in a scene database using techniques from image processing and natural language processing, respectively. We then assessed how both types of information predicted memory errors for scene boundaries using a standard rapid serial visual presentation (RSVP) forced error paradigm. A linear regression model indicated that memories for scene boundaries were significantly predicted by semantic, but not visual, information and that this effect persisted when scene depth was considered. Boundary extension was observed for images with low semantic information, and contraction was observed for images with high semantic information. This suggests a cognitive process that normalizes the amount of semantic information held in memory.

Humans predict the forest, not the trees: statistical learning of spatiotemporal structure in visual scenes

The human brain is capable of using statistical regularities to predict future inputs. In the real world, such inputs typically comprise a collection of objects (e.g. a forest constitutes numerous trees). The present study aimed to investigate whether perceptual anticipation relies on lower-level or higher-level information. Specifically, we examined whether the human brain anticipates each object in a scene individually or anticipates the scene as a whole. To explore this issue, we first trained participants to associate co-occurring objects within fixed spatial arrangements. Meanwhile, participants implicitly learned temporal regularities between these displays. We then tested how spatial and temporal violations of the structure modulated behavior and neural activity in the visual system using fMRI. We found that participants only showed a behavioral advantage of temporal regularities when the displays conformed to their previously learned spatial structure, demonstrating that humans form configuration-specific temporal expectations instead of predicting individual objects. Similarly, we found suppression of neural responses for temporally expected compared with temporally unexpected objects in lateral occipital cortex only when the objects were embedded within expected configurations. Overall, our findings indicate that humans form expectations about object configurations, demonstrating the prioritization of higher-level over lower-level information in temporal expectation.