Serial order in perception, memory, and action

Grouping in working memory guides chunk formation in long-term memory: Evidence from the Hebb effect

The Hebb effect refers to the improvement in immediate memory performance on a repeated list compared to unrepeated lists. That is, participants create a long-term memory representation over repetitions, on which they can draw in working memory tests. These long-term memory representations are likely formed by chunk acquisition: The whole list becomes integrated into a single unified representation. Previous research suggests that the formation of such chunks is rather inflexible and only occurs when at least the beginning of the list repeats across trials. However, recent work has shown that repetition learning strongly depends on participants recognizing the repeated information. Hence, successful chunk formation may depend on the recognizability of the repeated part of a list, and not on its position in the list. Across six experiments, we compared these two alternatives. We tested immediate serial recall of eight-letter lists, some of which partially repeated across trials. We used different partial-repetition structures, such as repeating only the first half of a list, or only every second item. We manipulated the salience of the repeating structure by spatially grouping and coloring the lists according to the repetition structure. We found that chunk formation is more flexible than previously assumed: Participants learned contiguous repeated sequences regardless of their position within the list, as long as they were able to recognize the repeated structure. Even when the repeated sequence occurred at varying positions over repetitions, learning was preserved when the repeated sequence was made salient by the spatial grouping. These findings suggest that chunk formation requires recognition of which items constitute a repeating group, and demonstrate a close link between grouping of information in working memory, and chunk formation in long-term memory.

No position-specific interference from prior lists in cued recognition: A challenge for position coding (and other) theories of serial memory

Position-specific intrusions of items from prior lists are rare but important phenomena that distinguish broad classes of theory in serial memory. They are uniquely predicted by position coding theories, which assume items on all lists are associated with the same set of codes representing their positions. Activating a position code activates items associated with it in current and prior lists in proportion to their distance from the activated position. Thus, prior list intrusions are most likely to come from the coded position. Alternative "item dependent" theories based on associations between items and contexts built from items have difficulty accounting for the position specificity of prior list intrusions. We tested the position coding account with a position-cued recognition task designed to produce prior list interference. Cuing a position should activate a position code, which should activate items in nearby positions in the current and prior lists. We presented lures from the prior list to test for position-specific activation in response time and error rate; lures from nearby positions should interfere more. We found no evidence for such interference in 10 experiments, falsifying the position coding prediction. We ran two serial recall experiments with the same materials and found position-specific prior list intrusions. These results challenge all theories of serial memory: Position coding theories can explain the prior list intrusions in serial recall and but not the absence of prior list interference in cued recognition. Item dependent theories can explain the absence of prior list interference in cued recognition but cannot explain the occurrence of prior list intrusions in serial recall.

Modelling orthographic similarity effects in recognition memory reveals support for open bigram representations of letter coding

A variety of letter string representations has been proposed in the reading literature to account for empirically established orthographic similarity effects from masked priming studies. However, these similarity effects have not been explored in episodic memory paradigms and very few memory models have employed orthographic representation of words. In the current work, through two recognition memory experiments employing word and pseudoword stimuli respectively, we empirically established a set of key orthographic similarity effects for the first time in recognition memory - namely the substitution effect, transposition effect and reverse effect in recognition memory of words and pseudowords, and a start-letter importance in recognition memory of words. Subsequently, we compared orthographic representations from the reading literature including slot coding, closed-bigram, open-bigram and the overlap model. Each of these representations was situated in a global matching model and fitted to recognition performance via Luce's choice rule in a hierarchical Bayesian framework. Model selection results showed support for the open-bigram representation in both experiments.

PEPPR: A post-encoding pre-production reinstatement model of dual-list free recall

Recent events are easy to recall, but they also interfere with the recall of more distant, non-recent events. In many computational models, non-recent memories are recalled by using the context associated with those events as a cue. Some models, however, do little to explain how people initially activate non-recent contexts in the service of accurate recall. We addressed this limitation by evaluating two candidate mechanisms within the Context-Maintenance and Retrieval model. The first is a Backward-Walk mechanism that iteratively applies a generate/recognize process to covertly retrieve progressively less recent items. The second is a Post-Encoding Pre-Production Reinstatement (PEPPR) mechanism that formally implements a metacognitive control process that reinstates non-recent contexts prior to retrieval. Models including these mechanisms make divergent predictions about the dynamics of response production and monitoring when recalling non-recent items. Before producing non-recent items, Backward-Walk cues covert retrievals of several recent items, whereas PEPPR cues few, if any, covert retrievals of that sort. We tested these predictions using archival data from a dual-list externalized free recall paradigm that required subjects to report all items that came to mind while recalling from the non-recent list. Simulations showed that only the model including PEPPR accurately predicted covert recall patterns. That same model fit the behavioral data well. These findings suggest that self-initiated context reinstatement plays an important role in recall of non-recent memories and provides a formal model that uses a parsimonious non-hierarchical context representation of how such reinstatement might occur.

Retrieval of temporal structure at recall can occur automatically

Temporal-structure, namely, the order in which events unfold over time, is one of the fundamental principles of episodic memory organization. A seminal empirical demonstration of the prominence of temporal structure in memory organization is the Temporal Contiguity Effect (TCE), whereby the proximity between two items at encoding predicts the likelihood of those two items being retrieved consecutively during recall. Recent studies have found that TCE occurs under a wide variety of conditions in which strategic control processes at encoding are reduced or even eliminated. This suggests that the encoding of temporal structure occurs automatically. Extending these findings, in the current study we asked whether the retrieval of temporal structure, as reflected by indices of the TCE, is influenced by strategic control processes at retrieval. To manipulate participants' ability to rely on strategic control processes, we compared standard recall performance (Full Attention condition) to a condition in which attention was divided between recall and a concurrent task (Divided Attention condition), which has been shown to disrupt such control processes. Across two experiments-one with standard encoding conditions and one with continual distraction during encoding-we found no differences in any index of the TCE between the two conditions. These results are all the more striking considering that in both experiments, dividing attention negatively affected overall recall performance compared to the Full Attention condition. Thus, while recall performance is reduced when disrupting strategic processes, the ability to use temporal structure to drive recall is not affected.

Integrating word-form representations with global similarity computation in recognition memory

In recognition memory, retrieval is thought to occur by computing the global similarity of the probe to each of the studied items. However, to date, very few global similarity models have employed perceptual representations of words despite the fact that false recognition errors for perceptually similar words have consistently been observed. In this work, we integrate representations of letter strings from the reading literature with global similarity models. Specifically, we employed models of absolute letter position (slot codes and overlap models) and relative letter position (closed and open bigrams). Each of the representations was used to construct a global similarity model that made contact with responses and RTs at the individual word level using the linear ballistic accumulator (LBA) model (Brown & Heathcote Cognitive Psychology, 57 , 153-178, 2008). Relative position models were favored in three of the four datasets and parameter estimates suggested additional influence of the initial letters in the words. When semantic representations from the word2vec model were incorporated into the models, results indicated that orthographic representations were almost equally consequential as semantic representations in determining inter-item similarity and false recognition errors, which undermines previous suggestions that long-term memory is primarily driven by semantic representations. The model was able to modestly capture individual word variability in the false alarm rates, but there were limitations in capturing variability in the hit rates that suggest that the underlying representations require extension.

Rime Priming Effects in Spoken Word Recognition

In this study, we re-examined the facilitation that occurs when auditorily presented monosyllabic primes and targets share their final phonemes, and in particular the rime (e.g., /vɔʀd/-/kɔʀd/). More specifically, we asked whether this rime facilitation effect is also observed when the two last consonants of the rime are transposed (e.g., /vɔʀd/-/kɔʀd/). In comparison to a control condition in which the primes and the targets were unrelated (e.g., /pylt/-/kɔʀd/), we found significant priming effects in both the rime (/vɔdʀ/-/kɔʀd/) and the transposed-phoneme "rime" /vɔdʀ/-/kɔʀd/ conditions. We also observed a significantly greater priming effect in the former condition than in the latter condition. We use the theoretical framework of the TISK model (Hannagan et al., 2013) to propose a novel account of final overlap phonological priming in terms of activation of both position-independent phoneme representations and bi-phone representations.

C-SMB 2.0: Integrating over 25 years of motor sequencing research with the Discrete Sequence Production task

An exhaustive review is reported of over 25 years of research with the Discrete Sequence Production (DSP) task as reported in well over 100 articles. In line with the increasing call for theory development, this culminates into proposing the second version of the Cognitive framework of Sequential Motor Behavior (C-SMB 2.0), which brings together known models from cognitive psychology, cognitive neuroscience, and motor learning. This processing framework accounts for the many different behavioral results obtained with the DSP task and unveils important properties of the cognitive system. C-SMB 2.0 assumes that a versatile central processor (CP) develops multimodal, central-symbolic representations of short motor segments by repeatedly storing the elements of these segments in short-term memory (STM). Independently, the repeated processing by modality-specific perceptual and motor processors (PPs and MPs) and by the CP when executing sequences gradually associates successively used representations at each processing level. The high dependency of these representations on active context information allows for the rapid serial activation of the sequence elements as well as for the executive control of tasks as a whole. Speculations are eventually offered as to how the various cognitive processes could plausibly find their neural underpinnings within the intricate networks of the brain.

Examining resurgence in rats following expanded-operant treatments

Resurgence of previously reinforced behavior represents a challenge to otherwise successful interventions based on differential reinforcement of alternative behavior (DRA). Expanded-operant treatments seek to increase the number of functional alternative behaviors through DRA, thereby potentially mitigating resurgence. However, the few studies that have directly examined these methods as a tool for resurgence mitigation have provided limited and unclear results. Thus, the present experiments were designed to investigate the effect of expanded-operant DRA methods on resurgence of previously reinforced behavior using rat subjects. In two experiments, following a baseline phase in which a target response was trained, groups of rats experienced concurrent (i.e., five simultaneous alternative responses), serial (i.e., five sequentially available alternative responses), or single DRA interventions arranging similar rates of alternative reinforcement in order to examine potential differences in resurgence. Both experiments showed that neither serial nor concurrent DRA expanded-operant treatments reduced resurgence compared with single DRA regardless of whether stimuli associated with previously reinforced alternative responses were removed (Experiment 1) or remained present (Experiment 2) for the serial-DRA group. Further, a primacy effect in resurgence was obtained for the serial-DRA group in both experiments. Overall, these results suggest that expanded-operant treatments may not help to reduce resurgence.

Serial attention to serial memory: The psychological refractory period in forward and backward cued recall

Guided by the conjecture that memory retrieval is attention turned inward, we examined serial attention in serial memory, combining the psychological refractory period (PRP) procedure from attention research with cued recall of two items from brief six-item lists. We report six experiments showing robust PRP effects in cued recall from memory (1-4) and cued report from perceptual displays (5-6), which suggest that memory retrieval requires the same attentional bottleneck as "retrieval" from perception. There were strong direction effects in each memory experiment. Response time (RT) was shorter and accuracy was higher when the cues occurred in the forward direction (left-to-right, top-to-bottom, first-to-last), replicating differences between forward and backward serial recall. Cue positions had strong effects on RT and accuracy in the memory experiments (1-4). The pattern suggested that subjects find cued items in memory by stepping through the list from the beginning or the end, with a preference for starting at the beginning. The perceptual experiments (5-6) showed weak effects of position that were more consistent with direct access. In all experiments, the distance between the cues in the list (lag) had weak effects, suggesting that subjects searched for each cue from the beginning or end of the list more often than they moved through the list from the first cue to the second. Direction, distance, and lag effects on RT and inter-response interval changed with SOA in a manner that suggested they affect bottleneck or pre-bottleneck processes that create and execute a plan for successive retrievals. We conclude that sequential retrieval from memory and sequential attention to perception engage the same computations and we show how computational models of memory can be interpreted as models of attention focused on memory.

Great minds think alike: New measures to quantify the similarity of recalls

Given the recent interest in how memory operates in social contexts, it is more important than ever to meaningfully measure the similarity between recall sequences of different individuals. Similarity of recall sequences of different individuals has been quantified using primarily order-agnostic and some order-sensitive measures specific to memory research without agreement on any one preferred measure. However, edit distance measures have not been used to quantify the similarity of recall sequences in collaborative memory studies. In the current study, we review a broad range of similarity measures, highlighting commonalities and differences. Using simulations and behavioral data, we show that edit distances do measure a memory-relevant factor of similarity and capture information distinct from that captured by order-agnostic measures. We answer illustrative research questions which demonstrate potential applications of edit distances in collaborative and individual memory settings and reveal the unique impact collaboration has on similarity.

The spatiotemporal gradient of intrusion errors in continuous outcome source memory: Source retrieval is affected by both guessing and intrusions

Previous research has characterized source retrieval as a thresholded process, which fails on a proportion of trials and leads to guessing, as opposed to a continuous process, in which response precision varies across trials but is never zero. The thresholded view of source retrieval is largely based on the observation of heavy tailed distributions of response errors, thought to reflect a large proportion of "memoryless" trials. In this study, we investigate whether these errors might instead reflect systematic intrusions from other list items which can mimic source guessing. Using the circular diffusion model of decision making, which accounts for both response errors and RTs we found that intrusions account for some, but not all, errors in a continuous-report source memory task. We found that intrusion errors were more likely to come from items studied in nearby locations and times, and were well-described by a spatiotemporal gradient model, but not from semantically or perceptually similar cues. Our findings support a thresholded view of source retrieval but suggest that previous work has overestimated the proportion of guesses which have been conflated with intrusions.

Efecto de la contigüidad espacial sobre el aprendizaje de secuencias de posiciones

Cuatro condiciones de contigüidad espacial de posiciones fueron empleadas para evaluar el aprendizaje de secuencias. Se emplearon dos secuencias de 16 y 25 posiciones presentadas en dos matrices de 4×4 y 5×5, respectivamente. Dentro de cada matriz, 4 (en la matriz de 4×4) o 6 posiciones (en la matriz de 5×5) presentaron contigüidad espacial. Entre grupos, se varió el punto de la secuencia en el que se presentaron las posiciones contiguas. De este modo, la contigüidad espacial de las 4 o 6 posiciones se presentó al inicio de la secuencia (Grupo 1), en la parte media (Grupo 2), al final de la secuencia (Grupo 3), o bien, se presentó una secuencia en la que todas las posiciones ocurrieron sin contigüidad espacial (Grupo 4). Participaron 28 estudiantes de licenciatura. Los resultados no mostraron diferencias entre grupos en cuanto al número de ensayos requeridospara reproducir la secuencia correctamente. El número de errores fue menor cuando las posiciones contiguas se presentaron al inicio de la secuencia. Los hallazgos se explican a partir de un posible efecto de acentuación de la primacía, dado por la ocurrencia de posiciones contiguas al inicio de la secuencia.

Sequential versus simultaneous presentation of memoranda in verbal working memory: (How) does it matter?

To-be-memorized information in verbal working memory (WM) can be presented sequentially, like in oral language, and simultaneously, like in written language. Few studies have addressed the importance and implications for verbal WM processing of these two presentation modes. While sequential presentation may favor discrete, temporal encoding processes, simultaneous presentation may favor spatial encoding processes. We compared immediate serial recall tasks for sequential versus simultaneous word list presentation with a specific focus on serial position curves of recall performance, transposition gradients, and the nature of serial order errors. First, we observed higher recall performance in the simultaneous compared to the sequential conditions, with a particularly large effect at end-of-list items. Moreover, results showed more transposition errors between non-adjacent items for the sequential condition, as well as more omission errors especially for start-of-list items. This observation can be explained in terms of differences in refreshing opportunities for start-of-list items during encoding between conditions. This study shows that the presentation mode of sequential material can have a significant impact on verbal WM performance, with an advantage for simultaneous encoding of sequence information.

Reading about a RELO-VUTION

Pseudowords created by transposing two letters of words (e.g., MOHTER; CHOLOCATE) are highly confusable with their base word; this is known as the transposed-letter similarity effect. In this work, we examined whether transposed-letter effects occur when words span more than one line (e.g., CHOLO- in one line and CATE in another line; note that the transposed letters L and C are in different lines). While this type of presentation is not the canonical format for reading in alphabetic languages, it is widely used in advertising, billboards, and street signs. Transposed-letter pseudowords and their replacement-letter controls were written in the standard one-line format versus a two-line format (Experiments 1-2) or a syllable-per-line format (Experiment 3). While results showed some decrease in the transposed-letter effect in the two-line and syllabic formats, the transposed-letter effect was still substantial in the accuracy of responses. These findings demonstrate that even when the letters being transposed are relatively far apart in space, the transposed-letter effect is still robust. Thus, a major component of letter position coding occurs at an abstract level.

Swap errors in visual working memory are fully explained by cue-feature variability

In cue-based recall from working memory, incorrectly reporting features of an uncued item may be referred to as a “swap” error. One account of these errors ascribes them to variability in memory for the cue features leading to erroneous selection of a non-target item, especially if it is similar to the target in the cue-feature dimension. However, alternative accounts of swap errors include cue-independent misbinding, and strategic guessing when the cued item is not in memory. Here we investigated the cause of swap errors by manipulating the variability with which either cue or report features (orientations in Exp 1; motion directions in Exp 2) were encoded. We found that swap errors increased with increasing variability in memory for the cue features, and their changing frequency could be quantitatively predicted based on recall variability when the same feature was used for report. These results are inconsistent with the hypothesis that swaps are a strategic response to forgotten items, and suggest that swap errors could be wholly accounted for by confusions due to cue-dimension variability. In a third experiment we examined whether spatial configuration of memory arrays in tasks with spatial cueing has an influence on swap error frequency. We observed a specific tendency to make swap errors to non-targets located precisely opposite to the cued location, suggesting that stimulus positions are partially encoded in a non-metric format.

Raeding with the fingres: Towards a universal model of letter position coding

Letter position coding in word recognition has been widely investigated in the visual modality (e.g., labotarory is confusable with laboratory), but not as much in the tactile modality using braille, leading to an incomplete understanding of whether this process is modality-dependent. Unlike sighted readers, braille readers do not show a transposed-letter similarity effect with nonadjacent transpositions (e.g., labotarory = labodanory; Perea et al., 2012). While this latter finding was taken to suggest that the flexibility in letter position coding was due to visual factors (e.g., perceptual uncertainty in the location of visual objects (letters)), it is necessary to test whether transposed-letter effects occur with adjacent letters to reach firm conclusions. Indeed, in the auditory modality (i.e., another serial modality), a transposed-phoneme effect occurs for adjacent but not for nonadjacent transpositions. In a lexical decision task, we examined whether pseudowords created by transposing two adjacent letters of a word (e.g., laboartory) are more confusable with their base word (laboratory) than pseudowords created by replacing those letters (laboestory) in braille. Results showed that transposed-letter pseudowords produced more errors and slower responses than the orthographic controls. Thus, these findings suggest that the mechanism of serial order, while universal, can be shaped by the sensory modality at play.

Which Factors Modulate Letter Position Coding in Pre-literate Children?

One of the central landmarks of learning to read is the emergence of orthographic processing (i.e., the encoding of letter identity and letter order): it constitutes the necessary link between the low-level stages of visual processing and the higher-level processing of words. Regarding the processing of letter position, many experiments have shown worse performance in various tasks for the transposed-letter pair judge-JUDGE than for the orthographic control jupte-JUDGE. Importantly, 4-y.o. pre-literate children also show letter transposition effects in a same-different task: TZ-ZT is more error-prone than TZ-PH. Here, we examined whether this effect with pre-literate children is related to the cognitive and linguistic skills required to learn to read. Specifically, we examined the relation of the transposed-letter in a same-different task with the scores of these children in phonological, alphabetic and metalinguistic awareness, linguistic skills, and basic cognitive processes. To that end, we used a standardized battery to assess the abilities related with early reading acquisition. Results showed that the size of the transposed-letter effect in pre-literate children was strongly associated with the sub-test on basic cognitive processes (i.e., memory and perception) but not with the other sub-tests. Importantly, identifying children who may need a pre-literacy intervention is crucial to minimize eventual reading difficulties. We discuss how this marker can be used as a tool to anticipate reading difficulties in beginning readers.