Large capacity temporary visual memory

The resolution of proactive interference in a novel visual working memory task: A behavioral and pupillometric study

Proactive interference (PI) occurs when previously learned information impairs memory for more recently learned information. Most PI studies have employed verbal stimuli, while the role of PI in visual working memory (VWM) has had relatively little attention. In the verbal domain, Johansson and colleagues (2018) found that pupil diameter - a real-time neurophysiological index of cognitive effort - reflects the accumulation and resolution of PI. Here we use a novel, naturalistic paradigm to test the behavioral and pupillary correlates of PI resolution for what-was-where item-location bindings in VWM. Importantly, in our paradigm, trials (PI vs. no-PI condition) are mixed in a block, and participants are naïve to the condition until they are tested. This design sidesteps concerns about differences in encoding strategies or generalized effort differences between conditions. Across three experiments (N = 122 total) we assessed PI's effect on VWM and whether PI resolution during memory retrieval is associated with greater cognitive effort (as indexed by the phasic, task-evoked pupil response). We found strong support for PI's detrimental effect on VWM (even with our spatially distributed stimuli), but no consistent link between interference resolution and effort during memory retrieval (this, even though the pupil was a reliable indicator that higher-performing individuals tried harder during memory encoding). We speculate that when explicit strategies are minimized, and PI resolution relies primarily on implicit processing, the effect may not be sufficient to trigger a robust pupillometric response.

Behavioral signatures of the rapid recruitment of long-term memory to overcome working memory capacity limits

Working- and long-term memory are often studied in isolation. To better understand the specific limitations of working memory, effort is made to reduce the potential influence of long-term memory on performance in working memory tasks (e.g., asking participants to remember artificial, abstract items rather than familiar real-world objects). However, in everyday life we use working- and long-term memory in tandem. Here, our goal was to characterize how long-term memory can be recruited to circumvent capacity limits in a typical visual working memory task (i.e., remembering colored squares). Prior work has shown that incidental repetitions of working memory arrays often do not improve visual working memory performance - even after dozens of incidental repetitions, working memory performance often shows no improvement for repeated arrays. Here, we used a whole-report working memory task with explicit rather than incidental repetitions of arrays. In contrast to prior work with incidental repetitions, in two behavioral experiments we found that explicit repetitions of arrays yielded robust improvement to working memory performance, even after a single repetition. Participants performed above chance at recognizing repeated arrays in a later long-term memory test, consistent with the idea that long-term memory was used to rapidly improve performance across array repetitions. Finally, we analyzed inter-item response times and we found a response time signature of chunk formation that only emerged after the array was repeated (inter-response time slowing after two to three items); thus, inter-item response times may be useful for examining the coordinated interaction of visual working and long-term memory in future work.

Young children's subjective and objective thresholds and emergent processes of visual consciousness using a backward masking task

Visual consciousness studies in humans have primarily focused on adults. However, whether young children's visual consciousness is similar to or different from that of adults remains unknown. This study examined young children's and adults' subjective awareness and objective discrimination for thresholds and emergent processes of visual consciousness in two experiments. In Experiment 1, 20 5-6-year-olds and 20 adults attempted a figure discrimination task using a square or a diamond as the target stimulus and responded, using a two-point scale, to a question on subjective awareness of the target stimulus with stimulus onset asynchronies (SOA) from 20 to 260 ms. In Experiment 2, 31 5-6-year-olds and 16 adults attempted the task and responded, using a four-point scale, to a question on subjective awareness with SOA from 50 to 550 ms. We measured the discrimination accuracy and the awareness scale with SOA and fit them to the sigmoid function. The results showed that the objective accuracy threshold of young children was larger than that of adults. Moreover, young children's subjective awareness threshold was larger than that of adults in the four-point but not in the two-point scale responses. Finally, there were no age differences in the emergent process of consciousness. This study suggests that the emergent process of consciousness in young children is similar to that in adults, however, the threshold in young children is larger than that in adults.

The effects of viewing by scrolling on a small screen on the encoding of objects into visual long-term memory

The perception of an image obtained by scrolling through a small screen can differ from the typical perception of a wide visual field in a stable environment. However, we do not fully understand image perception by scrolling on a small screen based on psychological knowledge of visual perception and cognition of images. This study investigated how screen size limitations and image shifts caused by scrolling affect image encoding in visual long-term memory. Participants explored the stimulus images under three conditions. Under the scrolling condition, they explored the image through a small screen. Under the moving-window condition, they explored the image by moving the screen over a masked image; this is similar to looking through a moving peephole. Under the no-window condition, participants were able to view the entire image simultaneously. Each stimulus comprised 12 objects. After 1 h, the samples were tested for object recognition. Consequently, the memory retention rate was higher in the scrolling and moving-window conditions than in the no-window condition, and no difference was observed between the scrolling and moving-window conditions. The time required by participants to explore the stimulus was shorter under the no-window condition. Thus, encoding efficiency (i.e., the rate of encoding information into memory in a unit of time) did not differ among the three conditions. An analysis of the scan trace of the scrolling and window movements in relation to the image revealed differences between the scrolling and moving-window conditions in terms of the scan's dynamic features. Moreover, a negative correlation was observed between the memory retention rate and image-scrolling speed. We conclude that perceiving images by scrolling on a small screen enables better memory retention than that obtained through whole-image viewing if the viewing time is not limited. We suggest that viewing through a small screen is not necessarily disadvantageous for memory encoding efficiency depending on the presentation mode, and the results show that participants who scrolled fast tended to have worse memory retention. These findings can impact school education and thus suggest that the use of mobile devices in learning has some merit from the viewpoint of cognitive psychology.

Using spontaneous eye blink-related brain activity to investigate cognitive load during mobile map-assisted navigation

The continuous assessment of pedestrians' cognitive load during a naturalistic mobile map-assisted navigation task is challenging because of limited experimental control over stimulus presentation, human-map-interactions, and other participant responses. To overcome this challenge, the present study takes advantage of navigators' spontaneous eye blinks during navigation to serve as event markers in continuously recorded electroencephalography (EEG) data to assess cognitive load in a mobile map-assisted navigation task. We examined if and how displaying different numbers of landmarks (3 vs. 5 vs. 7) on mobile maps along a given route would influence navigators' cognitive load during navigation in virtual urban environments. Cognitive load was assessed by the peak amplitudes of the blink-related fronto-central N2 and parieto-occipital P3. Our results show increased parieto-occipital P3 amplitude indicating higher cognitive load in the 7-landmark condition, compared to showing 3 or 5 landmarks. Our prior research already demonstrated that participants acquire more spatial knowledge in the 5- and 7-landmark conditions compared to the 3-landmark condition. Together with the current study, we find that showing 5 landmarks, compared to 3 or 7 landmarks, improved spatial learning without overtaxing cognitive load during navigation in different urban environments. Our findings also indicate a possible cognitive load spillover effect during map-assisted wayfinding whereby cognitive load during map viewing might have affected cognitive load during goal-directed locomotion in the environment or vice versa. Our research demonstrates that users' cognitive load and spatial learning should be considered together when designing the display of future navigation aids and that navigators' eye blinks can serve as useful event makers to parse continuous human brain dynamics reflecting cognitive load in naturalistic settings.

The contribution of episodic long-term memory to working memory for bindings

The present experiments support two conclusions about the capacity limit of working memory (WM). First, they provide evidence for the Binding Hypothesis, WM capacity is limited by interference between bindings but not items. Second, they show that episodic LTM contributes substantially to binding memory when the capacity of WM is stretched to the limit by larger set sizes. We tested immediate memory for sets of word-picture pairs. With increasing set size, memory for bindings declined more precipitously than memory for items, as predicted from the binding hypothesis. Yet, at higher set sizes performance was more stable than expected from a capacity limited memory, suggesting a contribution of episodic long-term memory (LTM) to circumvent the WM capacity limit. In support of that hypothesis, we show a double dissociation of contributions of WM and episodic LTM to binding memory: Performance at set sizes larger than 3 was specifically affected by proactive interference - but were immune to influences from a distractor-filled delay. In contrast, performance at set size 2 was unaffected by proactive interference but harmed by a distractor-filled delay.

High spatial frequencies disrupt conscious visual recognition: evidence from an attentional blink paradigm

In this article, we tested the respective importance of low spatial frequencies (LSF) and high spatial frequencies (HSF) for conscious visual recognition of emotional stimuli by using an attentional blink paradigm. Thirty-eight participants were asked to identify and report two targets (happy faces) embedded in a rapid serial visual presentation of distractors (angry faces). During attentional blink, conscious perception of the second target (T2) is usually altered when the lag between the two targets is short (200-500 ms) but is restored at longer lags. The distractors between T1 and T2 were either non-filtered (broad spatial frequencies, BSF), low-pass filtered (LSF), or high-pass filtered (HSF). Assuming that prediction abilities could be at the root of conscious visual recognition, we expected that LSF distractors could result in a greater disturbance of T2 reporting than HSF distractors. Results showed that both LSF and HSF play a role in the emergence of exogenous consciousness in the visual system. Furthermore, HSF distractors strongly affected T1 and T2 reporting irrespective of the lag between targets, suggesting their role for facial emotion processing. We discuss these results with regards to other models of visual recognition. .

Visual continuous recognition reveals behavioral and neural differences for short- and long-term scene memory

Humans have a remarkably high capacity and long duration memory for complex scenes. Previous research documents the neural substrates that allow for efficient categorization of scenes from other complex stimuli like objects and faces, but the spatiotemporal neural dynamics underlying scene memory at timescales relevant to working and longer-term memory are less well understood. In the present study, we used high density EEG during a visual continuous recognition task in which new, old, and scrambled scenes consisting of color outdoor photographs were presented at an average rate 0.26 Hz. Old scenes were single repeated presentations occurring within either a short-term (< 20 s) or longer-term intervals of between 30 s and 3 min or 4 and 10 min. Overall recognition was far above chance, with better performance at shorter- than longer-term intervals. Sensor-level ANOVA and post hoc pairwise comparisons of event related potentials (ERPs) revealed three main findings: (1) occipital and parietal amplitudes distinguishing new and old from scrambled scenes; (2) frontal amplitudes distinguishing old from new scenes with a central positivity highest for hits compared to misses, false alarms and correct rejections; and (3) frontal and parietal changes from ∼300 to ∼600 ms distinguishing among old scenes previously encountered at short- and longer-term retention intervals. These findings reveal how distributed spatiotemporal neural changes evolve to support short- and longer-term recognition of complex scenes.

Tracking Proactive Interference in Visual Memory

The current contents of visual working memory can be disrupted by previously formed memories. This phenomenon is known as proactive interference, and it can be used to index the availability of old memories. However, there is uncertainty about the robustness and lifetime of proactive interference, which raises important questions about the role of temporal factors in forgetting. The present study assessed different factors that were expected to influence the persistence of proactive interference over an inter-trial interval in the visual recent probes task. In three experiments, participants encoded arrays of targets and then determined whether a single probe matched one of those targets. On some trials, the probe matched an item from the previous trial (a “recent negative”), whereas on other trials the probe matched a more distant item (a “non-recent negative”). Prior studies have found that recent negative probes can increase errors and slow response times in comparison to non-recent negative probes, and this offered a behavioral measure of proactive interference. In Experiment 1, factors of array size (the number of targets to be encoded) and inter-trial interval (300 ms vs. 8 s) were manipulated in the recent probes task. There was a reduction in proactive interference when a longer delay separated trials on one measure, but only when participants encoded two targets. When working memory capacity was strained by increasing the array size to four targets, proactive interference became stronger after the long delay. In Experiment 2, the inter-trial interval length was again manipulated, along with stimulus novelty (the number of stimuli used in the experiment). Proactive interference was modestly stronger when a smaller number of stimuli were used throughout the experiment, but proactive interference was minimally affected by the inter-trial interval. These findings are problematic for temporal models of forgetting, but Experiment 3 showed that proactive interference also resisted disruption produced by a secondary task presented within the inter-trial interval. Proactive interference was constantly present and generally resilient to the different manipulations. The combined data suggest a relatively durable, passive representation that can disrupt current working memory under a variety of different circumstances.

How much can we differentiate at a brief glance: revealing the truer limit in conscious contents through the massive report paradigm (MRP)

Upon a brief glance, how well can we differentiate what we see from what we do not? Previous studies answered this question as 'poorly'. This is in stark contrast with our everyday experience. Here, we consider the possibility that previous restriction in stimulus variability and response alternatives reduced what participants could express from what they consciously experienced. We introduce a novel massive report paradigm that probes the ability to differentiate what we see from what we do not. In each trial, participants viewed a natural scene image and judged whether a small image patch was a part of the original image. To examine the limit of discriminability, we also included subtler changes in the image as modification of objects. Neither the images nor patches were repeated per participant. Our results showed that participants were highly accurate (accuracy greater than 80%) in differentiating patches from the viewed images from patches that are not present. Additionally, the differentiation between original and modified objects was influenced by object sizes and/or the congruence between objects and the scene gists. Our massive report paradigm opens a door to quantitatively measure the limit of immense informativeness of a moment of consciousness.

Proactive interference and the development of working memory

Working memory (WM), the ability to maintain information in service to a task, is characterized by its limited capacity. Several influential models attribute this limitation in a large extent to proactive interference (PI), the phenomenon that previously encoded, now-irrelevant information competes with relevant information. Here, we look back at the adult PI literature, spanning over 60 years, as well as recent results linking the ability to cope with PI to WM capacity. In early development, WM capacity is even more limited, yet an accounting for the role of PI has been lacking. Our Focus Article aims to address this through an integrative account: since PI resolution is mediated by networks involving the frontal cortex (particularly, the left inferior frontal gyrus) and the posterior parietal cortex, and since children have protracted development and less recruitment of these areas, the increase in the ability to cope with PI is a major factor underlying the increase in WM capacity in early development. Given this, we suggest that future research should focus on mechanistic studies of PI resolution in children. Finally, we note a crucial methodological implication: typical WM paradigms repeat stimuli from trial-to-trial, facilitating, inadvertently, PI and reducing performance; we may be fundamentally underestimating children's WM capacity. This article is categorized under: Psychology > Memory Neuroscience > Cognition Neuroscience > Development.

Magnitude and sources of proactive interference in visual memory

Proactive interference - the disruptive effect of old memories on new learning - is a long-established forgetting mechanism, yet there are doubts about its impact on visual working memory and uncertainty about the kinds of information that cause proactive interference. The present study aimed to assess these issues in three experiments using a modified recent probes task. Participants encoded four target images on each trial and determined whether a probe matched one of those targets. In Experiment 1, probes matching targets from trial N-1 or N-3 damaged responding in relation to a novel probe. Proactive interference was also produced by probes differing in state to a previously experienced target. This was further assessed in Experiments 2 and 3. Here, probes differing in colour to a previous target, or matching the general target category only, produced little proactive interference. Conversely, probes directly matching a prior target, or differing in state information, hindered task performance. This study found robust proactive interference in visual working memory that could endure over multiple trials, but it was also produced by stimuli closely resembling an old target. This challenges the notion that proactive interference is produced by an exact representation of a previously encoded image.

Memory and Proactive Interference for spatially distributed items

Our ability to briefly retain information is often limited. Proactive Interference (PI) might contribute to these limitations (e.g., when items in recognition tests are difficult to reject after having appeared recently). In visual Working Memory (WM), spatial information might protect WM against PI, especially if encoding items together with their spatial locations makes item-location combinations less confusable than simple items without a spatial component. Here, I ask (1) if PI is observed for spatially distributed items, (2) if it arises among simple items or among item-location combinations, and (3) if spatial information affects PI at all. I show that, contrary to views that spatial information protects against PI, PI is reliably observed for spatially distributed items except when it is weak. PI mostly reflects items that appear recently or frequently as memory items, while occurrences as test items play a smaller role, presumably because their temporal context is easier to encode. Through mathematical modeling, I then show that interference occurs among simple items rather than item-location combinations. Finally, to understand the effects of spatial information, I separate the effects of (a) the presence and (b) the predictiveness of spatial information on memory and its susceptibility to PI. Memory is impaired when items are spatially distributed, but, depending on the analysis, unaffected by the predictiveness of spatial information. In contrast, the susceptibility to PI is unaffected by either manipulation. Visual memory is thus impaired by PI for spatially distributed items due to interference from recent memory items (rather than test items or item-location combinations).

Item-Position Binding Capacity Limits and Word Limits in Working Memory: A Reanalysis of Oberauer (2019)

Oberauer (2019) suggested that the working memory capacity in word lists only limits the binding of words to serial positions, with no limit for the words themselves. I advocate a word item limit as a broad kind of binding of each word to the current trial. I propose that the word capacity limit can be observed in Oberauer’s data when binding of a word to the trial is crucial (Experiment 2, words drawn from a small pool and often repeated across trials), though probably much less so when this kind of binding is unimportant (Experiment 1, words drawn from a large pool and rarely repeated across trials). In Oberauer’s recognition procedure for lists of 2, 4, 6, or 8 words, the number of words in the response set was varied, including both words from the list (1, 2, 4, 6, or 8 of them) and words that were not from the list (0, 1, 2, or 4 of them). There was also a serial recall procedure. In a re-analysis of the data from Experiment 2, an overlooked item capacity limit was found that affected the distribution of erroneous responses. Specifically, when the correct answer was unknown to the participant (which happened more at longer list lengths), proportionally fewer words from the list were selected as responses; selection of non-list words increased. It is an important theoretical refinement of Oberauer’s position to include evidence of a word item capacity limit when the item-to-trial binding is crucial, as in his Experiment 2.

Representations of Abstract Relations in Infancy

relations are considered the pinnacle of human cognition, allowing for analogical and logical reasoning, and possibly setting humans apart from other animal species. Recent experimental evidence showed that infants are capable of representing the abstract relations same and different, prompting the question of the format of such representations. In a propositional language of thought, abstract relations would be represented in the form of discrete symbols. Is this format available to pre-lexical infants? We report six experiments (N = 192) relying on pupillometry and investigating how preverbal 10- to 12-month-old infants represent the relation same. We found that infants' ability to represent the relation same is impacted by the number of individual entities taking part in the relation. Infants could represent that four syllables were the same and generalized that relation to novel sequences (Experiments 1 and 4). However, they failed to generalize the relation same when it involved 5 or 6 syllables (Experiments 2-3), showing that infants' representation of the relation same is constrained by the limits of working memory capacity. Infants also failed to form a representation equivalent to all the same, which could apply to a varying number of same syllables (Experiments 5-6). These results highlight important discontinuities along cognitive development. Contrary to adults, preverbal infants lack a discrete symbol for the relation same, and rather build a representation of the relation by assembling symbols for individual entities.

Children's long-term retention is directly constrained by their working memory capacity limitations

We explored the causal role of individual and age-related differences in working memory (WM) capacity in long-term memory (LTM) retrieval. Our sample of 160 participants included 120 children (6-13-years old) and 40 young adults (18-24 years). Participants performed a WM task with images of unique everyday items, presented at varying set sizes. Subsequently, we tested participants' LTM for items from the WM task. Using these measures, we estimated the ratio at which items successfully held in WM were recognized in LTM. While WM and LTM generally improved with age, the ability to transfer information from WM to LTM appeared consistent between age groups. Moreover, individual differences in WM capacity appeared to predict LTM encoding. Overall, these results suggested that LTM performance was constrained by experimental, individual, and age-related WM limitations. We discuss the theoretical and practical implications of this WM-to-LTM bottleneck.

Gotcha: Working memory prioritization from automatic attentional biases

Attention is an important resource for prioritizing information in working memory (WM), and it can be deployed both strategically and automatically. Most research investigating the relationship between WM and attention has focused on strategic efforts to deploy attentional resources toward remembering relevant information. However, such voluntary attentional control represents a mere subset of the attentional processes that select information to be encoded and maintained in WM (Theeuwes, Journal of Cognition, 1[1]: 29, 1-15, 2018). Here, we discuss three ways in which information becomes prioritized automatically in WM-physical salience, statistical learning, and reward learning. This review integrates findings from perception and working memory studies to propose a more sophisticated understanding of the relationship between attention and working memory.

Keeping it real: Looking beyond capacity limits in visual cognition

Research within visual cognition has made tremendous strides in uncovering the basic operating characteristics of the visual system by reducing the complexity of natural vision to artificial but well-controlled experimental tasks and stimuli. This reductionist approach has for example been used to assess the basic limitations of visual attention, visual working memory (VWM) capacity, and the fidelity of visual long-term memory (VLTM). The assessment of these limits is usually made in a pure sense, irrespective of goals, actions, and priors. While it is important to map out the bottlenecks our visual system faces, we focus here on selected examples of how such limitations can be overcome. Recent findings suggest that during more natural tasks, capacity may be higher than reductionist research suggests and that separable systems subserve different actions, such as reaching and looking, which might provide important insights about how pure attentional or memory limitations could be circumvented. We also review evidence suggesting that the closer we get to naturalistic behavior, the more we encounter implicit learning mechanisms that operate "for free" and "on the fly." These mechanisms provide a surprisingly rich visual experience, which can support capacity-limited systems. We speculate whether natural tasks may yield different estimates of the limitations of VWM, VLTM, and attention, and propose that capacity measurements should also pass the real-world test within naturalistic frameworks. Our review highlights various approaches for this and suggests that our understanding of visual cognition will benefit from incorporating the complexities of real-world cognition in experimental approaches.

Attention effects in working memory that are asymmetric across sensory modalities

A key unanswered question about working memory is the nature of interference between items. At one extreme of existing theories, interference occurs between any two items because of a general capacity limit. At another extreme, interference depends on the similarity between particular features of different items. We examine this question in three experiments by presenting two sets of items on each trial, comprising tones or colors, with three levels of similarity between the two sets: cross-modal, unimodal with different marking features (two different musical instruments or shapes), and unimodal with the same marking feature. Another question is the extent to which the entry of presented items into working memory is obligatory or optional, which we examined by requiring retention of the first, the second, or both sets of stimuli for a recognition test shortly after the presentation of the two sets. The combination of the set similarity and attention manipulations allows us to draw conclusions about the nature of working-memory storage. The findings were not entirely in accord with any pre-existing theory. The effects of feature similarity were present in both modalities but more pronounced for sounds, whereas the detrimental effects of attention to both sets for retention occurred only for visual stimuli. Based on the findings we suggest a new, hybrid conception of working memory storage.

The development of retro-cue benefits with extensive practice: Implications for capacity estimation and attentional states in visual working memory

Accessing the contents of visual short-term memory (VSTM) is compromised by information bottlenecks and visual interference between memorization and recall. Retro-cues, displayed after the offset of a memory stimulus and prior to the onset of a probe stimulus, indicate the test item and improve performance in VSTM tasks. It has been proposed that retro-cues aid recall by transferring information from a high-capacity memory store into visual working memory (multiple-store hypothesis). Alternatively, retro-cues could aid recall by redistributing memory resources within the same (low-capacity) working memory store (single-store hypothesis). If retro-cues provide access to a memory store with a capacity exceeding the set size, then, given sufficient training in the use of the retro-cue, near-ceiling performance should be observed. To test this prediction, 10 observers each performed 12 hours across 8 sessions in a retro-cue change-detection task (40,000+ trials total). The results provided clear support for the single-store hypothesis: retro-cue benefits (difference between a condition with and without retro-cues) emerged after a few hundred trials and then remained constant throughout the testing sessions, consistently improving performance by two items, rather than reaching ceiling performance. Surprisingly, we also observed a general increase in performance throughout the experiment in conditions with and without retro-cues, calling into question the generalizability of change-detection tasks in assessing working memory capacity as a stable trait of an observer (data and materials are available at osf.io/9xr82 and github.com/paulzerr/retrocues). In summary, the present findings suggest that retro-cues increase capacity estimates by redistributing memory resources across memoranda within a low-capacity working memory store.

The Practice of Experimental Psychology: An Inevitably Postmodern Endeavor

The aim of psychology is to understand the human mind and behavior. In contemporary psychology, the method of choice to accomplish this incredibly complex endeavor is the experiment. This dominance has shaped the whole discipline from the self-concept as an empirical science and its very epistemological and theoretical foundations, via research practice and the scientific discourse to teaching. Experimental psychology is grounded in the scientific method and positivism, and these principles, which are characteristic for modern thinking, are still upheld. Despite this apparently stalwart adherence to modern principles, experimental psychology exhibits a number of aspects which can best be described as facets of postmodern thinking although they are hardly acknowledged as such. Many psychologists take pride in being “real natural scientists” because they conduct experiments, but it is particularly difficult for psychologists to evade certain elements of postmodern thinking in view of the specific nature of their subject matter. Postmodernism as a philosophy emerged in the 20th century as a response to the perceived inadequacy of the modern approach and as a means to understand the complexities, ambiguities, and contradictions of the times. Therefore, postmodernism offers both valuable insights into the very nature of experimental psychology and fruitful ideas on improving experimental practice to better reflect the complexities and ambiguities of human mind and behavior. Analyzing experimental psychology along postmodern lines begins by discussing the implications of transferring the scientific method from fields with rather narrowly defined phenomena—the natural sciences—to a much broader and more heterogeneous class of complex phenomena, namely the human mind and behavior. This ostensibly modern experimental approach is, however, per se riddled with postmodern elements: (re-)creating phenomena in an experimental setting, including the hermeneutic processes of generating hypotheses and interpreting results, is no carbon copy of “reality” but rather an active construction which reflects irrevocably the pre-existing ideas of the investigator. These aspects, analyzed by using postmodern concepts like hyperreality and simulacra, did not seep in gradually but have been present since the very inception of experimental psychology, and they are necessarily inherent in its philosophy of science. We illustrate this theoretical analysis with the help of two examples, namely experiments on free will and visual working memory. The postmodern perspective reveals some pitfalls in the practice of experimental psychology. Furthermore, we suggest that accepting the inherently fuzzy nature of theoretical constructs in psychology and thinking more along postmodern lines would actually clarify many theoretical problems in experimental psychology.

Engaging Māori with qualitative healthcare research using an animated comic

This article reports an effective strategy for recruiting patients with asthma to a qualitative study using an animated comic advertised on social media. An ad spend of NZ$432 on Facebook resulted in 101 study enquiries, and 27 participants taking part in the focus groups, of which 16 (56%) were Māori, the Indigenous Peoples of New Zealand. Representation of Māori amongst participants was over five times higher than their proportion in the local population (9.7%), resulting in data fulfilling the principle of equal explanatory power, an approach to research which can help advance Māori health development and address inequity. The success of this campaign is of particular interest for health researchers in New Zealand where Māori continue to be disproportionately affected by poorer health outcomes compared with non-Māori, particularly those with asthma. Approaches that better engage and support participation of under-represented communities in clinical research are of wider global interest. We reflect on the recruitment strategy and outcomes within a Kaupapa Māori framework, explore how this can be applied more widely in healthcare, and suggest direction for future study and implementation. Lay summary We designed an animated comic to advertise a study for patients with asthma. This was shared locally with a Facebook ad. The approach was highly engaging with the public, and resulted in rapid recruitment. Interestingly, participation of Māori (the Indigenous People of New Zealand) was over five times higher than their proportion in the local population. Māori have poorer health outcomes and increased barriers to healthcare access compared with non-Māori, particularly those with asthma. Approaches which can engage and support under-represented communities to participate in clinical research are of wider global interest. In this article, we reflect on the recruitment strategy and outcomes, and suggest direction for future study and implementation.

Working memory limits severely constrain long-term retention

There has been considerable controversy in recent years as to whether information held in working memory (WM) is rapidly forgotten or automatically transferred to long-term memory (LTM). Although visual WM capacity is very limited, we appear able to store a virtually infinite amount of information in visual LTM. Still, LTM retrieval often fails. Some view visual WM as a mental sketchpad that is wiped clean when new information enters, but not a consistent precursor of LTM. Others view the WM and LTM systems as inherently linked. Distinguishing between these possibilities has been difficult, as attempts to directly manipulate the active holding of information in visual WM has typically introduced various confounds. Here, we capitalized on the WM system's capacity limitation to control the likelihood that visual information was actively held in WM. Our young-adult participants (N = 103) performed a WM task with unique everyday items, presented in groups of two, four, six, or eight items. Presentation time was adjusted according to the number of items. Subsequently, we tested participants' LTM for items from the WM task. LTM was better for items presented originally within smaller WM set sizes, indicating that WM limitations contribute to subsequent LTM failures, and that holding items in WM enhances LTM encoding. Our results suggest that a limit in WM capacity contributes to an LTM encoding bottleneck for trial-unique familiar objects, with a relatively large effect size.

When Natural Behavior Engages Working Memory

Working memory (WM) enables temporary storage and manipulation of information,¹ supporting tasks that require bridging between perception and subsequent behavior. Its properties, such as its capacity, have been thoroughly investigated in highly controlled laboratory tasks.1, 2, 3, 4, 5, 6, 7, 8 Much less is known about the utilization and properties of WM in natural behavior,9, 10, 11 when reliance on WM emerges as a natural consequence of interactions with the environment. We measured the trade-off between reliance on WM and gathering information externally during immersive behavior in an adapted object-copying task.¹² By manipulating the locomotive demands required for task completion, we could investigate whether and how WM utilization changed as gathering information from the environment became more effortful. Reliance on WM was lower than WM capacity measures in typical laboratory tasks. A clear trade-off also occurred. As sampling information from the environment required increasing locomotion and time investment, participants relied more on their WM representations. This reliance on WM increased in a shallow and linear fashion and was associated with longer encoding durations. Participants’ avoidance of WM usage showcases a fundamental dependence on external information during ecological behavior, even if the potentially storable information is well within the capacity of the cognitive system. These foundational findings highlight the importance of using immersive tasks to understand how cognitive processes unfold within natural behavior. Our novel VR approach effectively combines the ecological validity, experimental rigor, and sensitive measures required to investigate the interplay between memory and perception in immersive behavior.

Video Abstract

•

Gaze provides a measure of working-memory (WM) usage during natural behavior

•

Natural reliance on WM is low even when searching for objects externally is effortful

•

WM utilization increases linearly as searching for objects requires more locomotion

•

The trade-off between using WM versus external sampling affects performance

Semantic knowledge influences visual working memory in adults and children

We can retain only a portion of the visual information that we encounter within our visual working memory. Which factors influence how much information we can remember? Recent studies have demonstrated that the capacity of visual working memory is influenced by the type of information to be remembered and is greater for real-world objects than for abstract stimuli. One explanation for this effect is that the semantic knowledge associated with real-world objects makes them easier to maintain in working memory. Previous studies have indirectly tested this proposal and led to inconsistent conclusions. Here, we directly tested whether semantic knowledge confers a benefit for visual working memory by using familiar and unfamiliar real-world objects. We found a mnemonic benefit for familiar objects in adults and children between the ages of 4 and 9 years. Control conditions ruled out alternative explanations, namely the possibility that the familiar objects could be more easily labeled or that there were differences in low-level visual features between the two types of objects. Together, these findings demonstrate that semantic knowledge influences visual working memory, which suggests that the capacity of visual working memory is not fixed but instead fluctuates depending on what has to be remembered.

"Capturing your audience": analysis of Twitter engagements between tweets linked with an educational infographic or a peer-reviewed journal article

Information represented through conventional text may fall short of capturing the attention and promoting engagement with today's digital audience. Transforming text into visual tools, such as infographics, has emerged as a simplified method of delivering information to attract a broader audience and enhance information dissemination. The first step to evaluate the potential value of infographics is to quantify their appeal and engagement rates over conventional text. This retrospective pilot analysis sought to evaluate the difference between engagement rates for tweets containing an of infographic compared to tweets containing a link to a peer-reviewed journal article. A total of 752 tweets were published within the study period; of these, 40 tweets met inclusion criteria. When engagement rates were compared, there was an increase in median engagement rates for tweets containing an infographic compared to a tweet linked to a peer-reviewed article at 10.97% (IQR 3.47%) and 5.33% (IQR 3.17%), respectively. This pilot study provides insight on the potential impact for infographics to enhance engagement rate, which may subsequently correlate with an increase in audience reach and readership. Prospective studies are needed to validate the utility of infographics in promoting scholarship publicity, learner engagement, and as a transferable pedagogical tool to educate medical practitioners.

Individually distinctive features facilitate numerical discrimination of sets of objects in domestic chicks

Day-old domestic chicks approach the larger of two groups of identical objects, but in a 3 vs 4 comparison, their performance is random. Here we investigated whether adding individually distinctive features to each object would facilitate such discrimination. Chicks reared with 7 objects were presented with the operation 1 + 1 + 1 vs 1 + 1 + 1 + 1. When objects were all identical, chicks performed randomly, as expected (Experiment 1). In the remaining experiments, objects differed from one another due to additional features. Chicks succeeded when those features were differently oriented segments (Experiment 2) but failed when the features were arranged to depict individually different face-like displays (Experiment 3). Discrimination was restored if the face-like stimuli were presented upside-down, disrupting global processing (Experiment 4). Our results support the claim that numerical discrimination in 3 vs 4 comparison benefits from the presence of distinctive features that enhance object individuation due to individual processing. Interestingly, when the distinctive features are arranged into upright face-like displays, the process is susceptible to global over local interference due to configural processing. This study was aimed at assessing whether individual object processing affects numerical discrimination. We hypothesise that in humans similar strategies aimed at improving performance at the non-symbolic level may have positive effects on symbolic mathematical abilities.

The Dynamic-Processing Model of Working Memory

Recent shifts in the understanding of how the mind and brain retain information in working memory (WM) call for revision to traditional theories. Evidence of dynamic, “activity-silent,” short-term retention processes diverges from conventional models positing that information is always retained in WM by sustained neural activity in buffers. Such evidence comes from machine-learning methods that can decode patterns of brain activity and the simultaneous administration of transcranial magnetic stimulation (TMS) to causally manipulate brain activity in specific areas and time points. TMS can “ping” brain areas to both reactivate latent representations retained in WM and affect memory performance. On the basis of these findings, I argue for a supplement to sustained retention mechanisms. Brain-decoding methods also reveal that dynamic levels of representational codes are retained in WM, and these vary according to task context, from perceptual (sensory) codes in posterior areas to abstract, recoded representations distributed across frontoparietal regions. A dynamic-processing model of WM is advanced to account for the overall pattern of results.

Sequential Presentation Protects Working Memory From Catastrophic Interference

Neural network models of memory are notorious for catastrophic interference: Old items are forgotten as new items are memorized (French, 1999; McCloskey & Cohen, 1989). While working memory (WM) in human adults shows severe capacity limitations, these capacity limitations do not reflect neural network style catastrophic interference. However, our ability to quickly apprehend the numerosity of small sets of objects (i.e., subitizing) does show catastrophic capacity limitations, and this subitizing capacity and WM might reflect a common capacity. Accordingly, computational investigations (Knops, Piazza, Sengupta, Eger & Melcher, 2014; Sengupta, Surampudi & Melcher, 2014) suggest that mutual inhibition among neurons can explain both kinds of capacity limitations as well as why our ability to estimate the numerosity of larger sets is limited according to a Weber ratio signature. Based on simulations with a saliency map-like network and mathematical proofs, we provide three results. First, mutual inhibition among neurons leads to catastrophic interference when items are presented simultaneously. The network can remember a limited number of items, but when more items are presented, the network forgets all of them. Second, if memory items are presented sequentially rather than simultaneously, the network remembers the most recent items rather than forgetting all of them. Hence, the tendency in WM tasks to sequentially attend even to simultaneously presented items might not only reflect attentional limitations, but also an adaptive strategy to avoid catastrophic interference. Third, the mean activation level in the network can be used to estimate the number of items in small sets, but it does not accurately reflect the number of items in larger sets. Rather, we suggest that the Weber ratio signature of large number discrimination emerges naturally from the interaction between the limited precision of a numeric estimation system and a multiplicative gain control mechanism.

A Metacognitive Perspective of Visual Working Memory With Rich Complex Objects

Visual working memory (VWM) has been extensively studied in the context of memory capacity. However, less research has been devoted to the metacognitive processes involved in VWM. Most metacognitive studies of VWM studies tested simple, impoverished stimuli, whereas outside of the laboratory setting, we typically interact with meaningful, complex objects. Thus, the present study aimed to explore the extent to which people are able to monitor VWM of real-world objects that are more ecologically valid and further afford less inter-trial interference. Specifically, in three experiments, participants viewed a set of either four or six memory items, consisting of images of unique real-world objects that were not repeated throughout the experiment. Following the memory array, participants were asked to indicate where the probe item appeared (Experiment 1) whether it appeared at all (Experiment 2) or whether it appeared and what was its temporal order (Experiment 3). VWM monitoring was assessed by subjective confidence judgments regarding participants’ objective performance. Similar to common metacognitive findings in other domains, we found that subjective judgments overestimated performance and underestimated errors, even for real-world, complex items held in VWM. These biases seem not to be task-specific as they were found in temporal, spatial, and identity VWM tasks. Yet, the results further showed that meaningful, real-world objects were better remembered than distorted items, and this memory advantage also translated to metacognitive measures.

Visual short-term memory capacity predicts the "bandwidth" of visual long-term memory encoding

We are capable of storing a virtually infinite amount of visual information in visual long-term memory (VLTM) storage. At the same time, the amount of visual information we can encode and maintain in visual short-term memory (VSTM) at a given time is severely limited. How do these two memory systems interact to accumulate vast amount of VLTM? In this series of experiments, we exploited interindividual and intraindividual differences VSTM capacity to examine the direct involvement of VSTM in determining the encoding rate (or "bandwidth") of VLTM. Here, we found that the amount of visual information encoded into VSTM at a given moment (i.e., VSTM capacity), but neither the maintenance duration nor the test process, predicts the effective encoding "bandwidth" of VLTM.

Working Memory Capacity Limits Memory for Bindings

I propose that the capacity of working memory places a specific limit on the maintenance of temporary bindings. Two experiments support this binding hypothesis: Participants remembered word lists of varying length. When tested on a randomly selected word, their error rates increased with the length of the list, reflecting a limited capacity for short-term maintenance. This increase in errors was predominantly due to binding errors: People confused the correct word with other words of the current memory list, but very rarely with words not in the list. The frequencies of response choices were analyzed through two measurement models – one based on the assumption of discrete memory states, one on the assumption of continuous memory strength – that capture memory for items and for bindings in separate parameters. Increasing memory set size impaired binding memory but not item memory, supporting the binding hypothesis.

Short-term memory based on activated long-term memory: A review in response to Norris (2017)

Short-term memory (STM), the limited information temporarily in a state of heightened accessibility, includes just-presented events and recently retrieved information. Norris (2017) argued for a prominent class of theories in which STM depends on the brain keeping a separate copy of new information, and against alternatives in which the information is held only in a portion of long-term memory (LTM) that is currently activated (aLTM). Here I question premises of Norris' case for separate-copy theories in the following ways. (a) He did not allow for implications of the common assumption (e.g., Cowan, 1999; Cowan & Chen, 2009) that aLTM can include new, rapidly formed LTM records of a trial within an STM task. (b) His conclusions from pathological cases of impaired STM along with intact LTM are tenuous; these rare cases can be explained by impairments in encoding, processing, or retrieval related to LTM rather than passive maintenance. (c) Although Norris reasonably allowed structured pointers to aLTM instead of separate copies of the actual item representations in STM, the same structured pointers may well be involved in long-term learning. (d) Last, models of STM storage can serve as the front end of an LTM learning system rather than being separate. I summarize evidence for these premises and an updated version of an alternative theory in which storage depends on aLTM (newly clarified), and, embedded within it, information enhanced by the current focus of attention (Cowan, 1988, 1999), with no need for a separate STM copy. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Adaptive allocation of human visual working memory capacity during statistical and categorical learning

Human brains are finite, and thus have bounded capacity. An efficient strategy for a capacity-limited agent is to continuously adapt by dynamically reallocating capacity in a task-dependent manner. Here we study this strategy in the context of visual working memory (VWM). People use their VWM stores to remember visual information over seconds or minutes. However, their memory performances are often error-prone, presumably due to VWM capacity limits. We hypothesize that people attempt to be flexible and robust by strategically reallocating their limited VWM capacity based on two factors: (a) the statistical regularities (e.g., stimulus feature means and variances) of the to-be-remembered items, and (b) the requirements of the task that they are attempting to perform. The latter specifies, for example, which types of errors are costly versus irrelevant for task performance. These hypotheses are formalized within a normative computational modeling framework based on rate-distortion theory, an extension of conventional Bayesian approaches that uses information theory to study rate-limited (or capacity-limited) processes. Using images of plants that are naturalistic and precisely controlled, we carried out two sets of experiments. Experiment 1 found that when a stimulus dimension (the widths of plants' leaves) was assigned a distribution, subjects adapted their VWM performances based on this distribution. Experiment 2 found that when one stimulus dimension (e.g., leaf width) was relevant for distinguishing plant categories but another dimension (leaf angle) was irrelevant, subjects' responses in a memory task became relatively more sensitive to the relevant stimulus dimension. Together, these results illustrate the task-dependent robustness of VWM, thereby highlighting the dependence of memory on learning.

Induced Social Power Improves Visual Working Memory

The possibility that social power improves working memory relative to conditions of powerlessness has been invoked to explain why manipulations of power improve performance in many cognitive tasks. Yet, whether power facilitates working memory performance has never been tested directly. In three studies, we induced high or low sense of power using the episodic recall task and tested participants' visual working memory capacity. We found that working memory capacity estimates were higher in the high-power than in the low-power condition in the standard change-detection task (Study 1), in a variation of the task that introduced distractors alongside the targets (Study 2), and in a variation that used real-world objects (Study 3). Studies 2 and 3 also tested whether high power improved working memory relative to low power by enhancing filtering efficiency, but did not find support for this hypothesis. We discuss implications for theories of both power and working memory.

Gradual formation of visual working memory representations of motion directions

Although it is well accepted that the formation of visual working memory (VWM) representations from simple static features is a rapid and effortless process that completes within several hundred milliseconds, the storage of motion information in VWM within that time scale can be challenging due to the limited processing capacity of the visual system. Memory formation can also be demanding especially when motion stimuli are visually complex. Here, we investigated whether the formation of VWM representations of motion direction is more gradual than that of static orientation and examined the effects of stimulus complexity on that process. To address these issues, we examined how the number and the precision of stored items in VWM develop over time by using a continuous report procedure. Results showed that while a viewing duration of several seconds was required for the successful storage of multiple motion directions in VWM regardless of motion complexity, the accumulation of memory precision was much slower when the motion stimulus was visually complex (Experiments 1 & 2). Additional experiments showed that the difference in memory performance for simple and complex motion stimuli cannot be explained by differences in signal-to-noise levels of the stimulus (Experiment 3). These results demonstrate remarkable temporal limitations in the formation of VWM representations for dynamic objects, and further show how this process is affected by stimulus properties such as visual complexity and signal-to-noise levels.

A two-level hierarchical framework of visual short-term memory

Over the last couple of decades, a vast amount of research has been dedicated to understanding the nature and the architecture of visual short-term memory (VSTM), the mechanism by which currently relevant visual information is maintained. According to discrete-capacity models, VSTM is constrained by a limited number of discrete representations held simultaneously. In contrast, shared-resource models regard VSTM as limited in resources, which can be distributed flexibly between varying numbers of representations; and a new interference model posits that capacity is limited by interference among items. In this article, we begin by reviewing benchmark findings regarding the debate over VSTM limitations, focusing on whether VSTM storage is all-or-none and on whether object complexity affects capacity. After that, we put forward a hybrid framework of VSTM architecture, arguing that this system is composed of a two-level hierarchy of memory stores, each containing a different set of representations: (1) perceptual memory, a resourcelike level containing analog automatically formed representations of visual stimuli in varying degrees of activation, and (2) visual working memory, in which a subset of three to four items from perceptual memory are bound to conceptual representations and to their locations, thus conveying discrete (digital/symbolic) information which appears quantized. While perceptual memory has a large capacity and is relatively nonselective, visual working memory is restricted in the number of items that can be maintained simultaneously, and its content is regulated by a gating mechanism.

Attention in working memory: attention is needed but it yearns to be free

Recent theoretical development of working memory has emphasized the role of attention in several active processes supporting maintenance. Although this development is certainly welcome and has accounted for a number of phenomena, there are findings that cannot be readily accounted for through the active use of attention in refreshing or removal of information. We review these findings and suggest that, whenever the circumstances allow, participants attempt to reduce the load on attention by making use of stored concepts in long-term memory (LTM) or off-loading new configurations, forming new long-term memories. Newly formed groups and configurations in LTM constitute a list- or array-wide version of the consolidation of information into memory to prevent forgetting in a manner that reduces the need for continued attention to the material. This suggestion leads to a number of interesting questions at the behavioral and neural levels, which we also discuss.

Neural Representation of Working Memory Content Is Modulated by Visual Attentional Demand

Recent theories assert that visual working memory (WM) relies on the same attentional resources and sensory substrates as visual attention to external stimuli. Behavioral studies have observed competitive tradeoffs between internal (i.e., WM) and external (i.e., visual) attentional demands, and neuroimaging studies have revealed representations of WM content as distributed patterns of activity within the same cortical regions engaged by perception of that content. Although a key function of WM is to protect memoranda from competing input, it remains unknown how neural representations of WM content are impacted by incoming sensory stimuli and concurrent attentional demands. Here, we investigated how neural evidence for WM information is affected when attention is occupied by visual search-at varying levels of difficulty-during the delay interval of a WM match-to-sample task. Behavioral and fMRI analyses suggested that WM maintenance was impacted by the difficulty of a concurrent visual task. Critically, multivariate classification analyses of category-specific ventral visual areas revealed a reduction in decodable WM-related information when attention was diverted to a visual search task, especially when the search was more difficult. This study suggests that the amount of available attention during WM maintenance influences the detection of sensory WM representations.

Effects of proactive interference on non-verbal working memory

Working memory (WM) is a cognitive system responsible for actively maintaining and processing relevant information and is central to successful cognition. A process critical to WM is the resolution of proactive interference (PI), which involves suppressing memory intrusions from prior memories that are no longer relevant. Most studies that have examined resistance to PI in a process-pure fashion used verbal material. By contrast, studies using non-verbal material are scarce, and it remains unclear whether the effect of PI is domain-general or whether it applies solely to the verbal domain. The aim of the present study was to examine the effect of PI in visual WM using both objects with high and low nameability. Using a Directed-Forgetting paradigm, we varied discriminability between WM items on two dimensions, one verbal (high-nameability vs. low-nameability objects) and one perceptual (colored vs. gray objects). As in previous studies using verbal material, effects of PI were found with object stimuli, even after controlling for verbal labels being used (i.e., low-nameability condition). We also found that the addition of distinctive features (color, verbal label) increased performance in rejecting intrusion probes, most likely through an increase in discriminability between content-context bindings in WM.

Mental Objects in Working Memory: Development of Basic Capacity or of Cognitive Completion?

Working memory is the small amount of information that we hold in mind and use to carry out cognitive processes such as language comprehension and production, problem solving, and decision making. In order to understand cognitive development, it would be helpful to know whether working memory increases in capacity with development and, if so, how and why. I will focus on two major stumbling blocks toward understanding working memory development, namely that (1) many potentially relevant aspects of the mind change in parallel during development, obscuring the role of any one change; and (2) one cannot use the same test procedure from infancy to adulthood, complicating comparisons across age groups. With regard to the first stumbling block, the parallel development of different aspects of the mind, we discuss research in which attempts were made to hold constant some factors (knowledge, strategies, direction of attention) to investigate whether developmental differences remain. With regard to the second stumbling block, procedural differences in tests for different age groups, I suggest ways in which the results might be reconciled across procedures. I highlight the value of pursuing research that could distinguish between two different key hypotheses that emerge: that there is a developmental increase in the number of working memory slots (or in a basic resource that holds items in working memory), and that there is a developmental increase in the amount of detail that each of these slots can hold.

Validation of the Vanderbilt Holistic Face Processing Test

The Vanderbilt Holistic Face Processing Test (VHPT-F) is a new measure of holistic face processing with better psychometric properties relative to prior measures developed for group studies (Richler et al., 2014). In fields where psychologists study individual differences, validation studies are commonplace and the concurrent validity of a new measure is established by comparing it to an older measure with established validity. We follow this approach and test whether the VHPT-F measures the same construct as the composite task, which is group-based measure at the center of the large literature on holistic face processing. In Experiment 1, we found a significant correlation between holistic processing measured in the VHPT-F and the composite task. Although this correlation was small, it was comparable to the correlation between holistic processing measured in the composite task with the same faces, but different target parts (top or bottom), which represents a reasonable upper limit for correlations between the composite task and another measure of holistic processing. These results confirm the validity of the VHPT-F by demonstrating shared variance with another measure of holistic processing based on the same operational definition. These results were replicated in Experiment 2, but only when the demographic profile of our sample matched that of Experiment 1.