Neuroanatomical substrates involved in true and false memories for face

Challenges of face identification with varied mask coverage in the post COVID-19 era

Introduction

Recent studies have shown that wearing masks can influence face recognition abilities. During the COVID-19 pandemic, people became increasingly familiar with seeing masked faces, leading to a reduced familiarity with fully uncovered faces. With Taiwan now transitioning to a post-COVID-19 phase and the removal of mask mandates, this study investigates how varying levels of mask coverage affect face identification accuracy and response times.

Methods

We examined three levels of mask coverage-full coverage (FC), coverage up to the middle of the nose bridge (MB), and coverage up to the bottom of the nose bridge (BB)-to determine their effects on identification performance. A computer-based simulation was conducted with 100 university students (50 men and 50 women), where participants completed 30 trials (5 trials for each mask coverage level across two target sexes). Each trial presented a masked target face corresponding to one of the three coverage levels, alongside four full-face images. Participants were instructed to choose the image that best matched the masked target face, with an option to select "None" if no match was found.

Results

The findings indicate that faces with FC were identified both faster and more accurately, while those with MB coverage were the most challenging and time-consuming to recognize, particularly for female targets. The performance with BB coverage was intermediate between the other two levels.

Conclusion

This study highlights a notable shift in face identification processes in the aftermath of the pandemic, with FC now leading to quicker and more accurate recognitions, suggesting a significant adaptability in human perceptual mechanisms. These results emphasize the importance of further research into face recognition as we continue to adapt to the pandemic's lasting effects on social interactions and identity verification.

Neural basis of false recognition in Alzheimer's disease and dementia with lewy bodies

In Alzheimer's disease (AD), reports on the association between false recognition and brain structure have been inconsistent. In dementia with Lewy bodies (DLB), no such association has been reported. This study aimed to identify brain regions associated with false recognition in AD and DLB by analyzing regional gray matter volume (rGMV). We included 184 patients with AD and 60 patients with DLB. The number of false recognitions was assessed using the Alzheimer's Disease Assessment Scale' word recognition task. Brain regions associated with the number of false recognitions were examined by voxel-based morphometry analysis. The number of false recognitions significantly negatively correlated with rGMV in the bilateral hippocampus, left parahippocampal gyrus, bilateral amygdala, and bilateral entorhinal cortex in patients with AD (p < 0.05, family-wise error [FEW] corrected) and in the bilateral hippocampus, left parahippocampal gyrus, right inferior frontal gyrus, right middle frontal gyrus, right basal forebrain, right insula, left medial and lateral orbital gyri, and left fusiform in those with DLB (p < 0.05, FWE corrected). Bilateral hippocampus and left parahippocampal gyrus were associated with false recognition in both diseases. However, we found there were regions where the association between false recognition and rGMV differed from disease to disease.

Neurocognitive bases of self-monitoring of inner speech in hallucination prone individuals

Verbal hallucinations in schizophrenia patients might be seen as internal verbal productions mistaken for perceptions as a result of over-salient inner speech and/or defective self-monitoring processes. Similar cognitive mechanisms might underpin verbal hallucination proneness in the general population. We investigated, in a non-clinical sample, the cerebral activity associated with verbal hallucinatory predisposition during false recognition of familiar words -assumed to stem from poor monitoring of inner speech-vs. uncommon words. Thirty-seven healthy participants underwent a verbal recognition task. High- and low-frequency words were presented outside the scanner. In the scanner, the participants were then required to recognize the target words among equivalent distractors. Results showed that verbal hallucination proneness was associated with higher rates of false recognition of high-frequency words. It was further associated with activation of language and decisional brain areas during false recognitions of low-, but not high-, frequency words, and with activation of a recollective brain area during correct recognitions of low-, but not high-, frequency words. The increased tendency to report familiar words as targets, along with a lack of activation of the language, recollective, and decisional brain areas necessary for their judgement, suggests failure in the self-monitoring of inner speech in verbal hallucination-prone individuals.

Dynamics of working memory process revealed by independent component analysis in an fMRI study

Human memory is prone to errors in many everyday activities but also when cultivating hobbies such as traveling and/or learning a new language. For instance, while visiting foreign countries, people erroneously recall foreign language words that are meaningless to them. Our research simulated such errors in a modified Deese-Roediger-McDermott paradigm for short-term memory with phonologically related stimuli aimed at uncovering behavioral and neuronal indices of false memory formation with regard to time-of-day, a variable known to influence memory. Fifty-eight participants were tested in a magnetic resonance (MR) scanner twice. The results of an Independent Component Analysis revealed encoding-related activity of the medial visual network preceding correct recognition of positive probes and correct rejection of lure probes. The engagement of this network preceding false alarms was not observed. We also explored if diurnal rhythmicity influences working memory processes. Diurnal differences were seen in the default mode network and the medial visual network with lower deactivation in the evening hours. The GLM results showed greater activation of the right lingual gyrus, part of the visual cortex and the left cerebellum in the evening. The study offers new insight into the mechanisms associated with false memories, suggesting that deficient engagement of the medial visual network during the memorization phase of a task results in short-term memory distortions. The results shed new light on the dynamics of working memory processes by taking into account the effect of time-of-day on memory performance.

Understanding associative false memories in aging using multivariate analyses

Age-related declines in associative memory are ubiquitous, with decreases in behavioral discriminability largely arising from increases in false memories for recombined lures. Using representational similarity analyses to examine the neural basis of associative false memories in aging, the current study found that neural pattern similarity between Hits and FAs and Hits and CRs differed as a function of age in occipital ROIs, such that older adults exhibited a smaller difference between the two similarity metrics than did younger adults. Additionally, greater Hit-FA representational similarity correlated with increases in associative FAs across several ROIs. Results suggest that while neural representations underlying targets may not differ across ages, greater pattern similarity between the neural representation of targets and lures may reflect reduced distinctiveness of the information encoded in memory, such that old and new items are more difficult to discriminate, leading to more false alarms.

Cultural influences on neural systems of intergroup emotion perception: An fMRI study

Cultural factors, such as cultural group membership, have been shown to affect neural bases of face and emotion perception. However, little is known about how cultural factors influence neural processing of emotional faces expressed by in-group and out-group members. In this study, we examined cultural influences on neural activation during the intergroup perception of negative emotional faces. We used functional magnetic resonance imaging to compare neural activation during intergroup emotion processing across cultures in three participants groups; two monocultural groups (i.e. Caucasian-Americans and native Japanese) and a bicultural group (i.e. Japanese-Americans). During scanning, the participants completed an emotional match-to-sample task consisting of negative facial expressions of Japanese and Caucasians. Our results show cultural modulation of neural response in the bilateral amygdala as a function of in-group biases and collectivistic values. Additionally, bicultural Japanese-Americans showed enhanced neural responses in the ventral medial prefrontal and posterior cingulate cortices, which had been related to self-related processing, during the perception of negative facial expression of Japanese. Neural activation in the ventral and posterior cingulate cortices reflected individuals' collectivistic tendencies only in the Japanese-American group, possibly due to greater sensitivity to ingroup biases in bicultural individuals. Our results demonstrate the influence of culture on neural responses during the perception of intergroup emotion from faces.

Confident false memories for spatial location are mediated by V1

Prior functional magnetic resonance imaging (fMRI) results suggest that true memories, but not false memories, activate early sensory cortex. It is thought that false memories, which reflect conscious processing, do not activate early sensory cortex because these regions are associated with nonconscious processing. We posited that false memories may activate the earliest visual cortical processing region (i.e., V1) when task conditions are manipulated to evoke conscious processing in this region. In an fMRI experiment, abstract shapes were presented to the left or right of fixation during encoding. During retrieval, old shapes were presented at fixation and participants characterized each shape as previously on the "left" or "right" followed by an "unsure"-"sure"-"very sure" confidence rating. False memories for spatial location (i.e., "right"/left or "left"/right trials with "sure" or "very sure" confidence ratings) were associated with activity in bilateral early visual regions, including V1. In a follow-up fMRI-guided transcranial magnetic stimulation (TMS) experiment that employed the same paradigm, we assessed whether V1 activity was necessary for false memory construction. Between the encoding phase and the retrieval phase of each run, TMS (1 Hz, 8 min) was used to target the location of false memory activity (identified in the fMRI experiment) in left V1, right V1, or the vertex (control site). Confident false memories for spatial location were significantly reduced following TMS to V1, as compared to vertex. The results of the present experiments provide convergent evidence that early sensory cortex can contribute to false memory construction under particular task conditions.

The limbic-reticular coupling theory of memory processing in the brain and its greater compatibility over other theories

The limbic-reticular coupling theory suggests that the hippocampus and amygdala regulate such descending limbic structures as the mammillary bodies, septum, hypothalamus and epithalamus to regulate the ascending noradrenergic, serotonergic, dopaminergic and cholinergic systems, performing declarative memory consolidation and recall. Recent studies have revealed that, less sensitive to familiarity, the hippocampus functions via the fornix, mammillary bodies and hypothalamus for memory recall. Lesions to the thalamic nuclei were complicated with damage to adjacent fornix, stria medullaris and habenula, simultaneously destroying two kinds of structures respectively for familiarity and recall. Furthermore, the orbitofrontal cortex was shown to be clinically irrelevant for memory recall. Electrophysiologically, the hippocampus regulates the raphe nuclei in complex ways, and the hippocampal theta wave activates the dopaminergic cells in ventral tegmental area and cholinergic neurons in basal forebrain, while cholinergic-modulated theta-gamma coupling mediates cortical recall. These concurrent advances support the limbic-reticular coupling theory for elucidation of memory recall.

Neuroanatomical substrates involved in unrelated false facial recognition

Identifying faces is a process central for social interaction and a relevant factor in eyewitness theory. False recognition is a critical mistake during an eyewitness's identification scenario because it can lead to a wrongful conviction. Previous studies have described neural areas related to false facial recognition using the standard Deese/Roediger-McDermott (DRM) paradigm, triggering related false recognition. Nonetheless, misidentification of faces without trying to elicit false memories (unrelated false recognition) in a police lineup could involve different cognitive processes, and distinct neural areas. To delve into the neural circuitry of unrelated false recognition, we evaluated the memory and response confidence of participants while watching faces photographs in an fMRI task. Functional activations of unrelated false recognition were identified by contrasting the activation on this condition vs. the activations related to recognition (hits) and correct rejections. The results identified the right precentral and cingulate gyri as areas with distinctive activations during false recognition events suggesting a conflict resulting in a dysfunction during memory retrieval. High confidence suggested that about 50% of misidentifications may be related to an unconscious process. These findings add to our understanding of the construction of facial memories and its biological basis, and the fallibility of the eyewitness testimony.

The influence of perceptual similarity and individual differences on false memories in aging

Previous false memory research has suggested that older adults' false memories are based on an overreliance on gist processing in the absence of item-specific details. Yet, false memory studies have rarely taken into consideration the precise role of item-item similarity on the cognitive and neural mechanisms underlying perceptual false memories in older adults. In addition, work in our laboratory has suggested that when investigating the neural basis of false memories in older adults, it is equally as critical to take into account interindividual variability in behavior. With both factors in mind, the present study was the first to examine how both controlled, systematic differences in perceptual relatedness between targets and lures and individual differences in true and false recognition contribute to the neural basis of both true and false memories in older adults. Results suggest that between-subject variability in memory performance modulates neural activity in key regions associated with false memories in aging, whereas systematic differences in perceptual similarity did not modulate neural activity associated with false memories.

False memories for shape activate the lateral occipital complex

Previous functional magnetic resonance imaging evidence has shown that false memories arise from higher-level conscious processing regions rather than lower-level sensory processing regions. In the present study, we assessed whether the lateral occipital complex (LOC)—a lower-level conscious shape processing region—was associated with false memories for shape. During encoding, participants viewed intact or scrambled colored abstract shapes. During retrieval, colored disks were presented and participants indicated whether the corresponding item was previously “intact” or “scrambled.” False memories for shape (“intact”/scrambled > “scrambled”/scrambled) activated LOC, which indicates lower-level sensory processing regions can support false memory.

Remembering verbally-presented items as pictures: Brain activity underlying visual mental images in schizophrenia patients with visual hallucinations

BACKGROUND

Previous research suggests that visual hallucinations in schizophrenia consist of mental images mistaken for percepts due to failure of the reality-monitoring processes. However, the neural substrates that underpin such dysfunction are currently unknown. We conducted a brain imaging study to investigate the role of visual mental imagery in visual hallucinations.

METHOD

Twenty-three patients with schizophrenia and 26 healthy participants were administered a reality-monitoring task whilst undergoing an fMRI protocol. At the encoding phase, a mixture of pictures of common items and labels designating common items were presented. On the memory test, participants were requested to remember whether a picture of the item had been presented or merely its label.

RESULTS

Visual hallucination scores were associated with a liberal response bias reflecting propensity to erroneously remember pictures of the items that had in fact been presented as words. At encoding, patients with visual hallucinations differentially activated the right fusiform gyrus when processing the words they later remembered as pictures, which suggests the formation of visual mental images. On the memory test, the whole patient group activated the anterior cingulate and medial superior frontal gyrus when falsely remembering pictures. However, no differential activation was observed in patients with visual hallucinations, whereas in the healthy sample, the production of visual mental images at encoding led to greater activation of a fronto-parietal decisional network on the memory test.

CONCLUSIONS

Visual hallucinations are associated with enhanced visual imagery and possibly with a failure of the reality-monitoring processes that enable discrimination between imagined and perceived events.

What's the gist? The influence of schemas on the neural correlates underlying true and false memories

The current study used a novel scene paradigm to investigate the role of encoding schemas on memory. Specifically, the study examined the influence of a strong encoding schema on retrieval of both schematic and non-schematic information, as well as false memories for information associated with the schema. Additionally, the separate roles of recollection and familiarity in both veridical and false memory retrieval were examined. The study identified several novel results. First, while many common neural regions mediated both schematic and non-schematic retrieval success, schematic recollection exhibited greater activation in visual cortex and hippocampus, regions commonly shown to mediate detailed retrieval. More effortful cognitive control regions in the prefrontal and parietal cortices, on the other hand, supported non-schematic recollection, while lateral temporal cortices supported familiarity-based retrieval of non-schematic items. Second, both true and false recollection, as well as familiarity, were mediated by activity in left middle temporal gyrus, a region associated with semantic processing and retrieval of schematic gist. Moreover, activity in this region was greater for both false recollection and false familiarity, suggesting a greater reliance on lateral temporal cortices for retrieval of illusory memories, irrespective of memory strength. Consistent with previous false memory studies, visual cortex showed increased activity for true compared to false recollection, suggesting that visual cortices are critical for distinguishing between previously viewed targets and related lures at retrieval. Additionally, the absence of common visual activity between true and false retrieval suggests that, unlike previous studies utilizing visual stimuli, when false memories are predicated on schematic gist and not perceptual overlap, there is little reliance on visual processes during false memory retrieval. Finally, the medial temporal lobe exhibited an interesting dissociation, showing greater activity for true compared to false recollection, as well as for false compared to true familiarity. These results provided an indication as to how different types of items are retrieved when studied within a highly schematic context. Results both replicate and extend previous true and false memory findings, supporting the Fuzzy Trace Theory.

Elucidating the neural correlates of related false memories using a systematic measure of perceptual relatedness

Previous memory research has exploited the perceptual similarities between lures and targets in order to evoke false memories. Nevertheless, while some studies have attempted to use lures that are objectively more similar than others, no study has systematically controlled for perceptual overlap between target and lure items and its role in accounting for false alarm rates or the neural processes underlying such perceptual false memories. The current study looked to fill this gap in the literature by using a face-morphing program to systematically control for the amount of perceptual overlap between lures and targets. Our results converge with previous studies in finding a pattern of differences between true and false memories. Most importantly, expanding upon this work, parametric analyses showed false memory activity increases with respect to the similarity between lures and targets within bilateral middle temporal gyri and right medial prefrontal cortex (mPFC). Moreover, this pattern of activation was unique to false memories and could not be accounted for by relatedness alone. Connectivity analyses further find that activity in the mPFC and left middle temporal gyrus co-vary, suggestive of gist-based monitoring within the context of false memories. Interestingly, neither the MTL nor the fusiform face area exhibited modulation as a function of target-lure relatedness. Overall, these results provide insight into the processes underlying false memories and further enhance our understanding of the role perceptual similarity plays in supporting false memories.

True and false memories, parietal cortex, and confidence judgments

Recent studies have asked whether activity in the medial temporal lobe (MTL) and the neocortex can distinguish true memory from false memory. A frequent complication has been that the confidence associated with correct memory judgments (true memory) is typically higher than the confidence associated with incorrect memory judgments (false memory). Accordingly, it has often been difficult to know whether a finding is related to memory confidence or memory accuracy. In the current study, participants made recognition memory judgments with confidence ratings in response to previously studied scenes and novel scenes. The left hippocampus and 16 other brain regions distinguished true and false memories when confidence ratings were different for the two conditions. Only three regions (all in the parietal cortex) distinguished true and false memories when confidence ratings were equated. These findings illustrate the utility of taking confidence ratings into account when identifying brain regions associated with true and false memories. Neural correlates of true and false memories are most easily interpreted when confidence ratings are similar for the two kinds of memories.

Effector-independent brain activity during motor imagery of the upper and lower limbs: an fMRI study

We utilized functional magnetic resonance imaging (fMRI) to evaluate the common brain region of motor imagery for the right and left upper and lower limbs. The subjects were instructed to repeatedly imagined extension and flexion of the right or left hands/ankles. Brain regions, which included the supplemental motor area (SMA), premotor cortex and parietal cortex, were activated during motor imagery. Conjunction analysis revealed that the left SMA and inferior frontal gyrus (IFG)/ventral premotor cortex (vPM) were commonly activated with motor imagery of the right hand, left hand, right foot, and left foot. This result suggests that these brain regions are activated during motor imagery in an effector independent manner.

The neuroscience of face processing and identification in eyewitnesses and offenders

Humans are experts in face perception. We are better able to distinguish between the differences of faces and their components than between any other kind of objects. Several studies investigating the underlying neural networks provided evidence for deviated face processing in criminal individuals, although results are often confounded by accompanying mental or addiction disorders. On the other hand, face processing in non-criminal healthy persons can be of high juridical interest in cases of witnessing a felony and afterward identifying a culprit. Memory and therefore recognition of a person can be affected by many parameters and thus become distorted. But also face processing itself is modulated by different factors like facial characteristics, degree of familiarity, and emotional relation. These factors make the comparison of different cases, as well as the transfer of laboratory results to real live settings very challenging. Several neuroimaging studies have been published in recent years and some progress was made connecting certain brain activation patterns with the correct recognition of an individual. However, there is still a long way to go before brain imaging can make a reliable contribution to court procedures.

Item familiarity and controlled associative retrieval in Alzheimer's disease: an fMRI study

Typical Alzheimer's disease (AD) is characterized by an impaired form of associative memory, recollection, that includes the controlled retrieval of associations. In contrast, familiarity-based memory for individual items may sometimes be preserved in the early stages of the disease. This is the first study that directly examines whole-brain regional activity during one core aspect of the recollection function: associative controlled episodic retrieval (CER), contrasted to item familiarity in AD patients. Cerebral activity related to associative CER and item familiarity in AD patients and healthy controls (HCs) was measured with functional magnetic resonance imaging during a word-pair recognition task to which the process dissociation procedure was applied. Some patients had null CER estimates (AD-), whereas others did show some CER abilities (AD+), although significantly less than HC. In contrast, familiarity estimates were equivalent in the three groups. In AD+, as in controls, associative CER activated the inferior precuneus/posterior cingulate cortex (PCC). When performing group comparisons, no region was found to be significantly more activated during CER in HC than AD+ and vice versa. However, during associative CER, functional connectivity between this region and the hippocampus, the inferior parietal and dorsolateral prefrontal cortex (DLPFC) was significantly higher in HC than in AD+. In all three groups, item familiarity was related to activation along the intraparietal sulcus (IPS). In conclusion, whereas the preserved automatic detection of an old item (without retrieval of accurate word association) is related to parietal activation centred on the IPS, the inferior precuneus/PCC supports associative CER ability in AD patients, as in HC. However, AD patients have deficient functional connectivity during associative CER, suggesting that the residual recollection function in these patients might be impoverished by the lack of some recollection-related aspects such as autonoetic quality, episodic details and verification.