Content-Specific Codes of Parametric Vibrotactile Working Memory in Humans

The independent storage mechanisms of visual and vibrotactile working memory

Whether information in working memory (WM) is stored in a domain-independent or domain-specific system is still the subject of intense debate. This study used the delayed match-to-sample paradigm, the dual-task paradigm, and the selective interference paradigm to investigate the mechanism of cross-modal storage in visual and vibrotactile WM. We postulated that WM may store cross-modal data from haptics and vision independently, and we proposed domain-specific WM storage. According to the findings, the WM can store cross-modal information from vision and haptics independently, and the storage of visual and tactile WM may be domain-specific. This study provides early support for the hypothesis that haptic and visuospatial sketchpads are dissociated. In addition, the current study provides evidence to elucidate the mechanisms by which WM stores and processes data from different modalities and content. The results also indicate that a cross-modal approach can broaden the cognitive processing bandwidth of WM.

Performing a vibrotactile discrimination task modulates finger representations in primary somatosensory cortex

It is well established that vibrotactile stimuli are represented in somatotopic maps. However, less is known about whether these somatotopic representations are modulated by task demands and maybe even in the absence of tactile input. Here, we used a vibrotactile discrimination task as a tool to investigate these questions in further detail. Participants were required to actively perceive and process tactile stimuli in comparison to a no-task control condition where identical stimuli were passively perceived (no-memory condition). Importantly, both vibrotactile stimuli were either applied to the right index or little finger, allowing us to investigate whether cognitive task demands shape finger representations in primary somatosensory cortex (S1). Using multivoxel pattern analysis and representational similarity analysis, we found that S1 finger representations were more distinct during the memory than the no-memory condition. Interestingly, this effect was not only observed while tactile stimuli were presented but also during the delay period (i.e., in the absence of tactile stimulation). Our findings imply that when individuals are required to focus on tactile stimuli, retain them in their memory, and engage in active processing of distinctive stimulus features, this exerts a modulatory effect on the finger representations present in S1.NEW & NOTEWORTHY Using multivoxel pattern analysis, we found that discrimination task demands shape finger representations in the contralateral primary somatosensory cortex (S1), and that somatotopic representations are modulated by task demands not only during tactile stimulation but also to a certain extent in the absence of tactile input.

A domain-general frontoparietal network interacts with domain-preferential intermediate pathways to support working memory task

Working memory (WM) is essential for cognition, but the underlying neural mechanisms remain elusive. From a hierarchical processing perspective, this paper proposed and tested a hypothesis that a domain-general network at the top of the WM hierarchy can interact with distinct domain-preferential intermediate circuits to support WM. Employing a novel N-back task, we first identified the posterior superior temporal gyrus (pSTG), middle temporal area (MT), and postcentral gyrus (PoCG) as intermediate regions for biological motion and shape motion processing, respectively. Using further psychophysiological interaction analyses, we delineated a frontal-parietal network (FPN) as the domain-general network. These results were further verified and extended by a delayed match to sample (DMS) task. Although the WM load-dependent and stimulus-free activations during the DMS delay phase confirm the role of FPN as a domain-general network to maintain information, the stimulus-dependent activations within this network during the DMS encoding phase suggest its involvement in the final stage of the hierarchical processing chains. In contrast, the load-dependent activations of intermediate regions in the N-back task highlight their further roles beyond perception in WM tasks. These results provide empirical evidence for a hierarchical processing model of WM and may have significant implications for WM training.

Differences in working memory coding of biological motion attributed to oneself and others

The question how the brain distinguishes between information about self and others is of fundamental interest to both philosophy and neuroscience. In this functional magnetic resonance imaging (fMRI) study, we sought to distinguish the neural substrates of representing a full‐body movement as one's movement and as someone else's movement. Participants performed a delayed match‐to‐sample working memory task where a retained full‐body movement (displayed using point‐light walkers) was arbitrarily labeled as one's own movement or as performed by someone else. By using arbitrary associations we aimed to address a limitation of previous studies, namely that our own movements are more familiar to us than movements of other people. A searchlight multivariate decoding analysis was used to test where information about types of movement and about self‐association was coded. Movement specific activation patterns were found in a network of regions also involved in perceptual processing of movement stimuli, however not in early sensory regions. Information about whether a memorized movement was associated with the self or with another person was found to be coded by activity in the left middle frontal gyrus (MFG), left inferior frontal gyrus (IFG), bilateral supplementary motor area, and (at reduced threshold) in the left temporoparietal junction (TPJ). These areas are frequently reported as involved in action understanding (IFG, MFG) and domain‐general self/other distinction (TPJ). Finally, in univariate analysis we found that selecting a self‐associated movement for retention was related to increased activity in the ventral medial prefrontal cortex.

Retrospective memory trace sustained by the human hippocampus during working memory task

Working memory is a subcategory of short-term memory that voluntarily maintains behaviourally relevant information to prepare for a subsequent action. An established theory is that working memory is supported by the prefrontal cortex (PFC) for executive control, while the hippocampus (HPC) is largely involved in long-term episodic memory. Recent studies suggest that the HPC is also involved in perception and short-term storage. However, it remains unclear whether the HPC supports active maintenance of short-term memory as working memory. To address this question, we devised a new delayed matching-to-sample task in which two visual items were presented at different locations one by one as samples. The sequential presentations of sample stimuli allowed us to dissociate the contents of working memory (i.e., identities and locations of two samples) from the constituent perceived information of single samples. By applying representational similarity analysis (RSA) to the blood-oxygen-level-dependent (BOLD) signals of human participants, we investigated the delay activity after the two sample presentations. The results of the RSA showed that the right HPC signalled only the second sample as a conjunctional representation of its item identity and location. In contrast, the right PFC, including both lateral and medial parts, represented the conjunctional information of both samples. These results suggested that the HPC may support short-term memory for retrospective coding to retain information of the last event rather than for prospective coding coupled with working memory.

The capacity and cognitive processing of vibrotactile working memory for frequency

A hallmark of working memory (WM) is its limited capacity. While visual and verbal domains of WM are able to store multiple items, the capacity of parametric vibrotactile WM (vtWM) has not yet been established for supra-threshold, one-dimensional sensory vibrotactile frequencies. The present study extends the standard delayed match-to-sample vibrotactile discrimination task to determine the capacity of the vtWM and its cognitive mechanism. Here, by presenting subjects with 2 to 6 vibratory frequencies sequentially in each trial, the present study demonstrates that it is possible to retain about only two vibrotactile frequencies information in vtWM. The results also showed that the capacity of vtWM does not depend on whether sequentially presented vibrotactile frequencies are delivered to the same or to different fingers. At the same time, the rate of correct report depends on sequence length and when in the sequence the stimuli are presented, suggesting the dynamic updating of vtWM similar to that of visual WM.

Representation of visual numerosity information during working memory in humans: An fMRI decoding study

Both animal and human studies on numerosity have shown the importance of the parietal cortex for numerosity processing. However, most studies have focused on the perceptual processing of numerosity. Still, it is unclear how and where numerosity information is coded when this information is retained during a working memory delay phase. Such temporal storage could be realized by the same structures as perceptual processes, or be transformed to a more abstract representation, potentially involving prefrontal regions. FMRI decoding studies allow the identification of brain areas that exhibit multi‐voxel activation patterns specific to the content of working memory. Here, we used an assumption‐free searchlight‐decoding approach to test where numerosity‐specific codes can be found during a 12 s retention period. Participants (n = 24) performed a retro‐cue delayed match‐to‐sample task, in which numerosity information was presented as visual dot arrays. We found mnemonic numerosity‐specific activation in the right lateral portion of the intraparietal sulcus; an area well‐known for perceptual processing of numerosity. The applied retro‐cue design dissociated working memory delay activity from perceptual processes and showed that the intraparietal sulcus also maintained working memory representation independent of perception.

Rehearsal of tactile working memory: Premotor cortex recruits two dissociable neuronal content representations

Recent working memory (WM) research has focused on identifying brain regions that retain different types of mental content. Only few neuroimaging studies have explored the mechanism of attention-based refreshing, which is a type of rehearsal and is thought to implement the dynamic components of WM allowing for update of WM contents. Here, we took advantage of the distinct coding properties of the superior parietal lobe (SPL), which retains spatial layout information, and the right inferior frontal gyrus (IFG), which retains frequency information of vibrotactile stimuli during tactile WM. In an fMRI delayed match-to-sample task, participants had to internally rehearse sequences of spatial layouts or vibratory frequencies. Our results replicate the dissociation of SPL and IFG for the retention of layout and frequency information in terms of activation differences between conditions. Additionally, we found strong premotor cortex (PMC) activation during rehearsal of either stimulus type. To explore interactions between these regions we used dynamic causal modeling and found that activation within the network was best explained by a model that allows the PMC to drive activity in the SPL and IFG during rehearsal. This effect was content-specific, meaning that the PMC showed stronger influence on the SPL during pattern rehearsal and stronger influence on the IFG during frequency rehearsal. In line with previously established PMC contributions to sequence processing, our results suggest that it acts as a content-independent area that flexibly recruits content-specific regions to bring a WM item into the focus of attention during the rehearsal of tactile stimulus sequences.

Decoding verbal working memory representations of Chinese characters from Broca's area

Representations of sensory working memory can be found across the entire neocortex. But how are verbal working memory (VWM) contents retained in the human brain? Here we used fMRI and multi-voxel pattern analyses to study Chinese native speakers (15 males, 13 females) memorizing Chinese characters. Chinese characters are uniquely suitable to study VWM because verbal encoding is encouraged by their complex visual appearance and monosyllabic pronunciation. We found that activity patterns in Broca's area and left premotor cortex carried information about the memorized characters. These language-related areas carried (1) significantly more information about cued characters than those not cued for memorization, (2) significantly more information on the left than the right hemisphere and (3) significantly more information about Chinese symbols than complex visual patterns which are hard to verbalize. In contrast, early visual cortex carries a comparable amount of information about cued and uncued stimuli and is thus unlikely to be involved in memory retention. This study provides evidence for verbal working memory maintenance in a distributed network of language-related brain regions, consistent with distributed accounts of WM. The results also suggest that Broca's area and left premotor cortex form the articulatory network which serves articulatory rehearsal in the retention of verbal working memory contents.

Parametric Representation of Tactile Numerosity in Working Memory

Estimated numerosity perception is processed in an approximate number system (ANS) that resembles the perception of a continuous magnitude. The ANS consists of a right lateralized frontoparietal network comprising the lateral prefrontal cortex (LPFC) and the intraparietal sulcus. Although the ANS has been extensively investigated, only a few studies have focused on the mental representation of retained numerosity estimates. Specifically, the underlying mechanisms of estimated numerosity working memory (WM) is unclear. Besides numerosities, as another form of abstract quantity, vibrotactile WM studies provide initial evidence that the right LPFC takes a central role in maintaining magnitudes. In the present fMRI multivariate pattern analysis study, we designed a delayed match-to-numerosity paradigm to test what brain regions retain approximate numerosity memoranda. In line with parametric WM results, our study found numerosity-specific WM representations in the right LPFC as well as in the supplementary motor area and the left premotor cortex extending into the superior frontal gyrus, thus bridging the gap in abstract quantity WM literature.

Brain responses to frequency changes due to vibratory stimulation of human fingertips: An fMRI study

Vibratory (e.g., piezoelectric) devices can stimulate cortical responses from the somatosensory area during functional magnetic resonance imaging. Twelve healthy, right-handed subjects (7 males and 5 females) were scanned with a 3.0 T magnetic resonance imaging scanner and stimulated at 30-240 Hz using a piezoelectric vibrator attached to the subjects’ index fingers. The functional images were analysed to determine the brain activation region by performing random effects analyses at the group level. One-way analysis of variance was used to measure changes in frequency on brain activity. The activated regions were identified with WFU PickAtlas software, and the images were thresholded at Puncorrected < 0.001 for multiple comparisons. The average effect of frequency revealed significant activations in the right insula and right middle frontal gyrus; the corresponding region in the somatosensory area may act as a top-down control signal to improve sensory targets. Results revealed significant differences between frequencies; 90 Hz > 120 Hz activated right inferior parietal gyrus, 120 Hz > 150 Hz activated right cerebellum, and 60 Hz > 90 Hz activated right supramarginal gyrus and bilateral inferior frontal gyrus pars triangularis. Findings indicated the role of secondary somatosensory areas and the cerebellum in performing higher-order functions and discriminating various frequencies during vibratory stimulation. Increasing the patient sample size and testing higher frequencies in future experiments will contribute to furthering brain mapping of somatosensory areas.

The Somatotopy of Mental Tactile Imagery

To what degree mental imagery (MI) bears on the same neuronal processes as perception has been a central question in the neurophysiological study of imagery. Sensory-recruitment models suggest that imagery of sensory material heavily relies on the involvement of sensory cortices. Empirical evidence mainly stems from the study of visual imagery and suggests that it depends on the mentally imagined material whether hierarchically lower regions are recruited. However, evidence from other modalities is necessary to infer generalized principles. In this fMRI study we used the somatotopic organization of the primary somatosensory cortex (SI) to test in how far MI of tactile sensations activates topographically sensory brain areas. Participants (N = 19) either perceived or imagined vibrotactile stimuli on their left or right thumbs or big toes. The direct comparison to a corresponding perception condition revealed that SI was somatotopically recruited during imagery. While stimulus driven bottom-up processing induced activity throughout all SI subareas, i.e., BA1, BA3a, BA3b, and BA2 defined by probabilistic cytoarchitectonic maps, top-down recruitment during imagery was limited to the hierarchically highest subarea BA2.

Content-specific codes of parametric auditory working memory in humans

Brain activity in frontal regions has been found to represent frequency information with a parametric code during working memory delay phases. The mental representation of frequencies has furthermore been shown to be modality independent in non-human primate electrophysiology and human EEG studies, suggesting frontal regions encoding quantitative information in a supramodal manner. A recent fMRI study using multivariate pattern analysis (MVPA) supports an overlapping multimodal network for the maintenance of visual and tactile frequency information over frontal and parietal brain regions. The present study extends the investigation of working memory representation of frequency information to the auditory domain. To this aim, we used MVPA on fMRI data recorded during an auditory frequency maintenance task. A support vector regression analysis revealed working memory information in auditory association areas and, consistent with earlier findings of parametric working memory, in a frontoparietal network. A direct comparison to an analogous dataset of vibrotactile parametric working memory revealed an overlap of information coding in prefrontal regions, particularly in the right inferior frontal gyrus. Therefore, our findings indicate that the prefrontal cortex represents frequency-specific working memory content irrespective of the modality as has been now also revealed for the auditory modality.

Asymmetric Functional Connectivity of the Contra- and Ipsilateral Secondary Somatosensory Cortex during Tactile Object Recognition

In the somatosensory system, it is well known that the bilateral secondary somatosensory cortex (SII) receives projections from the unilateral primary somatosensory cortex (SI), and the SII, in turn, sends feedback projections to SI. Most neuroimaging studies have clearly shown bilateral SII activation using only unilateral stimulation for both anatomical and functional connectivity across SII subregions. However, no study has unveiled differences in the functional connectivity of the contra- and ipsilateral SII network that relates to frontoparietal areas during tactile object recognition. Therefore, we used event-related functional magnetic resonance imaging (fMRI) and a delayed match-to-sample (DMS) task to investigate the contributions of bilateral SII during tactile object recognition. In the fMRI experiment, 14 healthy subjects were presented with tactile angle stimuli on their right index finger and asked to encode three sample stimuli during the encoding phase and one test stimulus during the recognition phase. Then, the subjects indicated whether the angle of test stimulus was presented during the encoding phase. The results showed that contralateral (left) SII activity was greater than ipsilateral (right) SII activity during the encoding phase, but there was no difference during the recognition phase. A subsequent psycho-physiological interaction (PPI) analysis revealed distinct connectivity from the contra- and ipsilateral SII to other regions. The left SII functionally connected to the left SI and right primary and premotor cortex, while the right SII functionally connected to the left posterior parietal cortex (PPC). Our findings suggest that in situations involving unilateral tactile object recognition, contra- and ipsilateral SII will induce an asymmetrical functional connectivity to other brain areas, which may occur by the hand contralateral effect of SII.