In search of a naturalistic neuroimaging approach: Exploration of general feasibility through the case of VR-fMRI and application in the domain of episodic memory

Decoding episodic autobiographical memory in naturalistic virtual reality

Episodic autobiographical memory (EAM) is a long-term memory system of personally experienced events with their context - what, where, when - and subjective elements, e.g., emotions, thoughts, or self-reference. EAM formation has rarely been studied in a controlled, real-life-like paradigm, and there is no predictive model of long-term retrieval from self-rated subjective experience at encoding. The present longitudinal study, with three surprise free recall memory tests immediately, one-week and one-month after encoding, investigated incidental encoding of EAM in an immersive virtual environment where 30 participants either interacted with or observed specific events of varying emotional valences with simultaneous physiological recordings. The predictive analyses highlight the temporal dynamics of the predictors of EAM from subjective ratings at encoding: common characteristics related to sense of remembering and infrequency of real-life encounter of the event were identified over time, but different variables become relevant at different time points, such as the emotion and mental imagery or prospective aspects. This dynamic and time-dependent role of memory predictors challenges traditional views of a uniform influence of encoding factors over time. Current evidence for the multiphasic nature of memory formation points to the role of different mechanisms at play during encoding but also consolidation and subsequent retrieval.

Behavioral state-dependent associations between EEG temporal correlations and depressive symptoms

Previous studies have shown abnormal long-range temporal correlations in neuronal oscillations among individuals with Major Depressive Disorders, occurring during both resting states and transitions between resting and task states. However, the understanding of this effect in preclinical individuals with depression remains limited. This study investigated the association between temporal correlations of neuronal oscillations and depressive symptoms during resting and task states in preclinical individuals, specifically focusing on male action video gaming experts. Detrended fluctuation analysis (DFA), Lifetimes, and Waitingtimes were employed to explore temporal correlations across long-range and short-range scales. The results indicated widespread changes from the resting state to the task state across all frequency bands and temporal scales. Rest-task DFA changes in the alpha band exhibited a negative correlation with depressive scores at most electrodes. Significant positive correlations between DFA values and depressive scores were observed in the alpha band during the resting state but not in the task state. Similar patterns of results emerged concerning maladaptive negative emotion regulation strategies. Additionally, short-range temporal correlations in the alpha band echoed the DFA results. These findings underscore the state-dependent relationships between temporal correlations of neuronal oscillations and depressive symptoms, as well as maladaptive emotion regulation strategies, in preclinical individuals.

Probing neurodynamics of experienced emotions-a Hitchhiker's guide to film fMRI

Film functional magnetic resonance imaging (fMRI) has gained tremendous popularity in many areas of neuroscience. However, affective neuroscience remains somewhat behind in embracing this approach, even though films lend themselves to study how brain function gives rise to complex, dynamic and multivariate emotions. Here, we discuss the unique capabilities of film fMRI for emotion research, while providing a general guide of conducting such research. We first give a brief overview of emotion theories as these inform important design choices. Next, we discuss films as experimental paradigms for emotion elicitation and address the process of annotating them. We then situate film fMRI in the context of other fMRI approaches, and present an overview of results from extant studies so far with regard to advantages of film fMRI. We also give an overview of state-of-the-art analysis techniques including methods that probe neurodynamics. Finally, we convey limitations of using film fMRI to study emotion. In sum, this review offers a practitioners' guide to the emerging field of film fMRI and underscores how it can advance affective neuroscience.

Functional neuroimaging as a catalyst for integrated neuroscience

Functional magnetic resonance imaging (fMRI) enables non-invasive access to the awake, behaving human brain. By tracking whole-brain signals across a diverse range of cognitive and behavioural states or mapping differences associated with specific traits or clinical conditions, fMRI has advanced our understanding of brain function and its links to both normal and atypical behaviour. Despite this headway, progress in human cognitive neuroscience that uses fMRI has been relatively isolated from rapid advances in other subdomains of neuroscience, which themselves are also somewhat siloed from one another. In this Perspective, we argue that fMRI is well-placed to integrate the diverse subfields of systems, cognitive, computational and clinical neuroscience. We first summarize the strengths and weaknesses of fMRI as an imaging tool, then highlight examples of studies that have successfully used fMRI in each subdomain of neuroscience. We then provide a roadmap for the future advances that will be needed to realize this integrative vision. In this way, we hope to demonstrate how fMRI can help usher in a new era of interdisciplinary coherence in neuroscience.

The role of bodily self-consciousness in episodic memory of naturalistic events: an immersive virtual reality study

Recent studies suggest that the human body plays a critical role in episodic memory. Still, the precise relationship between bodily self-consciousness (BSC) and memory formation of specific events, especially in real-life contexts, remains a topic of ongoing research. The present study investigated the relationship between BSC and episodic memory (EM) using immersive virtual reality (VR) technology. Participants were immersed in an urban environment with naturalistic events, while their visuomotor feedback was manipulated in three within-subjects conditions: Synchronous, Asynchronous, and No-body. Our results show that asynchronous visuomotor feedback and not seeing one's body, compared to synchronous feedback, decrease the sense of self-identification, self-location and agency, and sense of presence. Moreover, navigating in the Asynchronous condition had a detrimental impact on incidental event memory, perceptual details, contextual association, subjective sense of remembering, and memory consolidation. In contrast, participants in the No-Body condition were only impaired in egocentric spatial memory and the sense of remembering at ten-day delay. We discuss these findings in relation to the role of bodily self-representation in space during event memory encoding. This study sheds light on the complex interplay between BSC, sense of presence, and episodic memory processes, and strengthens the potential of embodiment and VR technology in studying and enhancing human cognition.

Narrative simulation of social experiences in naturalistic context - A neurocinematic approach

Narratives may be regarded as simulations of everyday social situations. They are key to studying the human mind in socio-culturally determined contexts as they allow anchoring to the common ground of embodied and environmentally-engaged cognition. Here we review recent findings from naturalistic neuroscience on neural functions in conditions that mimic lifelike situations. We will focus particularly on neurocinematics, a research field that applies mediated narratives as stimuli for neuroimaging experiments. During the last two decades, this paradigm has contributed to an accumulation of insights about the neural underpinnings of behavior and sense-making in various narratively contextualized situations particularly pertaining to socio-emotional encounters. One of the key questions in neurocinematics is, how do intersubjectively synchronized brain activations relate to subjective experiences? Another question we address is how to bring natural contexts into experimental studies. Seeking to respond to both questions, we suggest neurocinematic studies to examine three manifestations of the same phenomenon side-by-side: subjective experiences of narrative situations, unfolding of narrative stimulus structure, and neural processes that co-constitute the experience. This approach facilitates identifying experientially meaningful activity patterns in the brain and points out what they may mean in relation to shared and communicable contents. Via rich-featured and temporally contextualized narrative stimuli, neurocinematics attempts to contribute to emerging holistic theories of neural dynamics and connectomics explaining typical and atypical interindividual variability.

The benefits of mind wandering on a naturalistic prospective memory task

Mind wandering (MW) occurs when our attention spontaneously shifts from the task at hand to inner thoughts. MW is often future-oriented and may help people remember to carry out their planned actions (Prospective Memory, PM). Past-oriented MW might also play a critical role in boosting PM performance. Sixty participants learned 24 PM items and recalled them during an immersive virtual walk in a town. The items were divided into event-based-EB and time-based-TB. During the PM retention phase, participants were randomly assigned to a high or a low cognitive load condition, in order to manipulate MW frequency. Some PM items were encoded before this MW manipulation (pre-PM) and some during the virtual walk (post-PM). A high MW frequency was linked with better global PM performances. Spontaneous past-oriented MW predicted better pre-EB retrospective PM retrieval, while spontaneous future-oriented MW predicted better Pre-EB prospective PM retrieval. Voluntary future-oriented MW predicted better post-EB retrospective retrieval. We highlighted, for the first time, a differential impact of spontaneous MW content depending on the PM component (retrospective or prospective). Past-oriented MW is crucial for (re)consolidating PM intentions, and episodic future thinking MW for the execution of PM intentions. We discuss the twofold functional role of MW, namely, to consolidate an already programmed intention and to plan future actions.

Conditioned place preferences for virtual alcohol cues

This study examined whether a conditioned place preference (CPP) could be established for a virtual reality (VR) room that previously contained virtual alcohol stimuli. 298 undergraduates with varying levels of alcohol use completed six, three-minute conditioning sessions in which they were confined to one of two visually-distinct VR rooms: one of the VR rooms contained virtual alcohol cues (CS+) while the other VR room was neutral (CS-). Following conditioning, participants completed a three-minute test session during which they had unrestricted access to both VR rooms and neither room contained any alcohol-related cues. Although no virtual alcohol cues were present, participants with alcohol use (n = 248) spent significantly longer in CS+ relative to CS- compared to participants with alcohol non-use (n = 50) during the test session. This is the first study to show that a CPP can be established using virtual alcohol cues, in the absence of any actual alcohol administration. However, participants with alcohol use did not subjectively report enjoying CS+ more than CS- and explicitly chose CS- as their preferred room. Interestingly, these findings suggest that implicit and explicit measures of CPP may tap into distinct, separable processes and should be investigated further.

Innovations in Neuropsychology: Future Applications in Neurosurgical Patient Care

Over the last century, collaboration between clinical neuropsychologists and neurosurgeons has advanced the state of the science in both disciplines. These advances have provided the field of neuropsychology with many opportunities for innovation in the care of patients prior to, during, and following neurosurgical intervention. Beyond giving a general overview of how present-day advances in technology are being applied in the practice of neuropsychology within a neurological surgery department, this article outlines new developments that are currently unfolding. Improvements in remote platform, computer interface, "real-time" analytics, mobile devices, and immersive virtual reality have the capacity to increase the customization, precision, and accessibility of neuropsychological services. In doing so, such innovations have the potential to improve outcomes and ameliorate health care disparities.

Naturalistic neuroscience and virtual reality

Virtual reality (VR) is one of the techniques that became particularly popular in neuroscience over the past few decades. VR experiments feature a closed-loop between sensory stimulation and behavior. Participants interact with the stimuli and not just passively perceive them. Several senses can be stimulated at once, large-scale environments can be simulated as well as social interactions. All of this makes VR experiences more natural than those in traditional lab paradigms. Compared to the situation in field research, a VR simulation is highly controllable and reproducible, as required of a laboratory technique used in the search for neural correlates of perception and behavior. VR is therefore considered a middle ground between ecological validity and experimental control. In this review, I explore the potential of VR in eliciting naturalistic perception and behavior in humans and non-human animals. In this context, I give an overview of recent virtual reality approaches used in neuroscientific research.