Prefrontal activation and pupil dilation during n-back task performance: A combined fNIRS and pupillometry study

Pupillary correlates of individual differences in n-back task performance

We used pupillometry during a 2-back task to examine individual differences in the intensity and consistency of attention and their relative role in a working memory task. We used sensitivity, or the ability to distinguish targets (2-back matches) and nontargets, as the measure of task performance; task-evoked pupillary responses (TEPRs) as the measure of attentional intensity; and intraindividual pretrial pupil variability as the measure of attentional consistency. TEPRs were greater on target trials compared with nontarget trials, although there was no difference in TEPR magnitude when participants answered correctly or incorrectly to targets. Importantly, this effect interacted with performance: high performers showed a greater separation in their TEPRs between targets and nontargets, whereas there was little difference for low performers. Further, in regression analysis, larger TEPRs on target trials predicted better performance, whereas larger TEPRs on nontarget trials predicted worse performance. Sensitivity positively correlated with average pretrial pupil diameter and negatively correlated with intraindividual variability in pretrial pupil diameter. Overall, we found evidence that both attentional intensity (TEPRs) and consistency (pretrial pupil variation) predict performance on an n-back working memory task.

Detecting signatures of consciousness in acute brain injury after stimulation with apomorphine and methylphenidate: protocol for a placebo-controlled, randomized, cross-over study

Introduction

Acute brain injury can lead to states of decreased consciousness, that is, disorder of consciousness (DoC). Detecting signs of consciousness early is vital for DoC management in the intensive care unit (ICU), neurorehabilitation and long-term prognosis. Our primary objective is to investigate the potential of pharmacological stimulant therapies in eliciting signs of consciousness among unresponsive or low-responsive acute DoC patients.

Methods

In a placebo-controlled, randomised, cross-over setting, we evaluate the effect of methylphenidate and apomorphine in 50 DoC patients with acute traumatic or non-traumatic brain injury admitted to the ICU. Patients are examined before and after administration of the trial drugs using (1) neurobehavioural scales to determine the clinical level of consciousness, (2) automated pupillometry to record pupillary responses as a signature for awareness and (3) near-infrared spectroscopy combined with electroencephalography to record neurovascular coupling as a measure for cortical activity. Primary outcomes include pupillary dilations and increase in cortical activity during passive and active paradigms.

Ethics

The study has been approved by the ethics committee (Journal-nr: H-21022096) and follows the principles of the Declaration of Helsinki. It is deemed to pose minimal risks and to hold a significant potential to improve treatment options for DoC patients. If the stimulants are shown to enhance cortical modulation of pupillary function and neurovascular coupling, this would warrant a large multicentre trial to evaluate their clinical impact.

Dissemination

Results will be available on EudraCT, clinicaltrialsregister.eu and published in an international peer-reviewed journal.

Trial registration number

EudraCT Number: 2021-001453-31.

How a pilot's brain copes with stress and mental load? Insights from the executive control network

In aviation, mental workload and stress are two major factors that can considerably impact a pilot's flight performance and decisions. Their consequences can be even more dramatic in single-pilot aircraft or with the forthcoming single-pilot operations where the pilot will fly alone and will not be able to be assisted in case of difficulty. An accurate and automatic monitoring of the pilot's mental state could help to prevent the potentially dangerous effects of an excess mental workload and stress. For example, some tasks could be allocated to automation or to a ground-based flight crew if a mental overload or significant stress is detected. In the current study, the brain activity of 20 private pilots was recorded with a fNIRS device during two realistic flight simulator scenarios. The mental workload was manipulated with the added difficulty of a secondary task and stress was induced by a social stressor. Our results confirmed the sensitivity of the fNIRS readings to variations in the mental workload, with increased HbO2 concentration in regions of the executive control network (ECN), in particular in the dorsolateral prefrontal cortex and in lateral parietal regions, when the difficulty of the secondary task was high. The social stressor also triggered an HbO2 increase in the ECN, especially when it was combined with high mental workload. This latter result suggests that mental workload and stress together can have cumulative effects, and coping with both factors is possible at the expense of an extra recruitment of the ECN. Finally, results also revealed a time-on-task effect, with a progressive reduction of the HbO2 signal in the ECN during the flight scenario, suggesting that these regions are sensitive to short term habituation to the tasks. Overall, fNIRS efficiently indexed mental load, stress, and practice effects.

Look into my eyes: What can eye-based measures tell us about the relationship between physical activity and cognitive performance?

BACKGROUND

There is a growing interest to understand the neurobiological mechanisms that drive the positive associations of physical activity and fitness with measures of cognitive performance. To better understand those mechanisms, several studies have employed eye-based measures (e.g., eye movement measures such as saccades, pupillary measures such as pupil dilation, and vascular measures such as retinal vessel diameter) deemed to be proxies for specific neurobiological mechanisms. However, there is currently no systematic review providing a comprehensive overview of these studies in the field of exercise-cognition science. Thus, this review aimed to address that gap in the literature.

METHODS

To identify eligible studies, we searched 5 electronic databases on October 23, 2022. Two researchers independently extracted data and assessed the risk of bias using a modified version of the Tool for the assEssment of Study qualiTy and reporting in EXercise (TESTEX scale, for interventional studies) and the critical appraisal tool from the Joanna Briggs Institute (for cross-sectional studies).

RESULTS

Our systematic review (n = 35 studies) offers the following main findings: (a) there is insufficient evidence available to draw solid conclusions concerning gaze-fixation-based measures; (b) the evidence that pupillometric measures, which are a proxy for the noradrenergic system, can explain the positive effect of acute exercise and cardiorespiratory fitness on cognitive performance is mixed; (c) physical training- or fitness-related changes of the cerebrovascular system (operationalized via changes in retinal vasculature) are, in general, positively associated with cognitive performance improvements; (d) acute and chronic physical exercises show a positive effect based on an oculomotor-based measure of executive function (operationalized via antisaccade tasks); and (e) the positive association between cardiorespiratory fitness and cognitive performance is partly mediated by the dopaminergic system (operationalized via spontaneous eye-blink rate).

CONCLUSION

This systematic review offers confirmation that eye-based measures can provide valuable insight into the neurobiological mechanisms that may drive positive associations between physical activity and fitness and measures of cognitive performance. However, due to the limited number of studies utilizing specific methods for obtaining eye-based measures (e.g., pupillometry, retinal vessel analysis, spontaneous eye blink rate) or investigating a possible dose-response relationship, further research is necessary before more nuanced conclusions can be drawn. Given that eye-based measures are economical and non-invasive, we hope this review will foster the future application of eye-based measures in the field of exercise-cognition science.

Regulation of brain cognitive states through auditory, gustatory, and olfactory stimulation with wearable monitoring

Inspired by advances in wearable technologies, we design and perform human-subject experiments. We aim to investigate the effects of applying safe actuation (i.e., auditory, gustatory, and olfactory) for the purpose of regulating cognitive arousal and enhancing the performance states. In two proposed experiments, subjects are asked to perform a working memory experiment called n-back tasks. Next, we incorporate listening to different types of music, drinking coffee, and smelling perfume as safe actuators. We employ signal processing methods to seamlessly infer participants' brain cognitive states. The results demonstrate the effectiveness of the proposed safe actuation in regulating the arousal state and enhancing performance levels. Employing only wearable devices for human monitoring and using safe actuation intervention are the key components of the proposed experiments. Our dataset fills the existing gap of the lack of publicly available datasets for the self-management of internal brain states using wearable devices and safe everyday actuators. This dataset enables further machine learning and system identification investigations to facilitate future smart work environments. This would lead us to the ultimate idea of developing practical automated personalized closed-loop architectures for managing internal brain states and enhancing the quality of life.

The prefrontal cortex is differentially involved in implicit and explicit facial emotion processing: An fNIRS study

Despite extensive research, the differential roles of the prefrontal cortex (PFC) in implicit and explicit facial emotion processing remain elusive. Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique that can measure changes in both oxyhemoglobin (HbO) and deoxyhemoglobin (HbR) concentrations. Currently, how HbO and HbR change during facial emotion processing remains unclear. Here, fNIRS was used to examine and compare PFC activation during implicit and explicit facial emotion processing. Forty young adults performed a facial-matching task that required either emotion discrimination (explicit task) or age discrimination (implicit task), and the activation of their PFCs was measured by fNIRS. Participants attempted the task on two occasions to determine whether their activation patterns were maintained over time. The PFC displayed increases in HbO and/or decreases in HbR during the implicit and explicit facial emotion tasks. Importantly, there were significantly greater changes in PFC HbO during the explicit task, whereas no significant difference in HbR changes between conditions was found. Between sessions, HbO changes were reduced across tasks, but the difference in HbO changes between the implicit and explicit tasks remained unchanged. The test-retest reliability of the behavioral measures was excellent, whereas that of fNIRS measures was mostly poor to fair. Thus, the PFC plays a specific role in recognizing facial expressions, and its differential involvement in implicit and explicit facial emotion processing can be consistently captured at the group level by changes in HbO. This study demonstrates the potential of fNIRS for elucidating the neural mechanisms underlying facial emotion recognition.

Data-Driven Pupil Response Profiles as Transdiagnostic Readouts for the Detection of Neurocognitive Functioning in Affective and Anxiety Disorders

BACKGROUND

Neurocognitive functioning is a relevant transdiagnostic dimension in psychiatry. As pupil size dynamics track cognitive load during a working memory task, we aimed to explore if this parameter allows identification of psychophysiological subtypes in healthy participants and patients with affective and anxiety disorders.

METHODS

Our sample consisted of 226 participants who completed the n-back task during simultaneous functional magnetic resonance imaging and pupillometry measurements. We used latent class growth modeling to identify clusters based on pupil size in response to cognitive load. In a second step, these clusters were compared on affective and anxiety symptom levels, performance in neurocognitive tests, and functional magnetic resonance imaging activity.

RESULTS

The clustering analysis resulted in two distinct pupil response profiles: one with a stepwise increasing pupil size with increasing cognitive load (reactive group) and one with a constant pupil size across conditions (nonreactive group). A larger increase in pupil size was significantly associated with better performance in neurocognitive tests in executive functioning and sustained attention. Statistical maps of parametric modulation of pupil size during the n-back task showed the frontoparietal network in the positive contrast and the default mode network in the negative contrast. The pupil response profile of the reactive group was associated with more thalamic activity, likely reflecting better arousal upregulation and less deactivation of the limbic system.

CONCLUSIONS

Pupil measurements have the potential to serve as a highly sensitive psychophysiological readout for detection of neurocognitive deficits in the core domain of executive functioning, adding to the development of valid transdiagnostic constructs in psychiatry.

Zoom behavior during visual search modulates pupil diameter and reflects adaptive control states

Adaptive gain theory proposes that the dynamic shifts between exploration and exploitation control states are modulated by the locus coeruleus-norepinephrine system and reflected in tonic and phasic pupil diameter. This study tested predictions of this theory in the context of a societally important visual search task: the review and interpretation of digital whole slide images of breast biopsies by physicians (pathologists). As these medical images are searched, pathologists encounter difficult visual features and intermittently zoom in to examine features of interest. We propose that tonic and phasic pupil diameter changes during image review may correspond to perceived difficulty and dynamic shifts between exploration and exploitation control states. To examine this possibility, we monitored visual search behavior and tonic and phasic pupil diameter while pathologists (N = 89) interpreted 14 digital images of breast biopsy tissue (1,246 total images reviewed). After viewing the images, pathologists provided a diagnosis and rated the level of difficulty of the image. Analyses of tonic pupil diameter examined whether pupil dilation was associated with pathologists' difficulty ratings, diagnostic accuracy, and experience level. To examine phasic pupil diameter, we parsed continuous visual search data into discrete zoom-in and zoom-out events, including shifts from low to high magnification (e.g., 1× to 10×) and the reverse. Analyses examined whether zoom-in and zoom-out events were associated with phasic pupil diameter change. Results demonstrated that tonic pupil diameter was associated with image difficulty ratings and zoom level, and phasic pupil diameter showed constriction upon zoom-in events, and dilation immediately preceding a zoom-out event. Results are interpreted in the context of adaptive gain theory, information gain theory, and the monitoring and assessment of physicians' diagnostic interpretive processes.

Effects of audiovisual interactions on working memory: Use of the combined N-back + Go/NoGo paradigm

Background

Approximately 94% of sensory information acquired by humans originates from the visual and auditory channels. Such information can be temporarily stored and processed in working memory, but this system has limited capacity. Working memory plays an important role in higher cognitive functions and is controlled by central executive function. Therefore, elucidating the influence of the central executive function on information processing in working memory, such as in audiovisual integration, is of great scientific and practical importance.

Purpose

This study used a paradigm that combined N-back and Go/NoGo tasks, using simple Arabic numerals as stimuli, to investigate the effects of cognitive load (modulated by varying the magnitude of N) and audiovisual integration on the central executive function of working memory as well as their interaction.

Methods

Sixty college students aged 17-21 years were enrolled and performed both unimodal and bimodal tasks to evaluate the central executive function of working memory. The order of the three cognitive tasks was pseudorandomized, and a Latin square design was used to account for order effects. Finally, working memory performance, i.e., reaction time and accuracy, was compared between unimodal and bimodal tasks with repeated-measures analysis of variance (ANOVA).

Results

As cognitive load increased, the presence of auditory stimuli interfered with visual working memory by a moderate to large extent; similarly, as cognitive load increased, the presence of visual stimuli interfered with auditory working memory by a moderate to large effect size.

Conclusion

Our study supports the theory of competing resources, i.e., that visual and auditory information interfere with each other and that the magnitude of this interference is primarily related to cognitive load.

Programming ability prediction: Applying an attention-based convolutional neural network to functional near-infrared spectroscopy analyses of working memory

Although theoretical studies have suggested that working-memory capacity is crucial for academic achievement, few empirical studies have directly investigated the relationship between working-memory capacity and programming ability, and no direct neural evidence has been reported to support this relationship. The present study aimed to fill this gap in the literature. Using a between-subject design, 17 programming novices and 18 advanced students performed an n-back working-memory task. During the experiment, their prefrontal hemodynamic responses were measured using a 48-channel functional near-infrared spectroscopy (fNIRS) device. The results indicated that the advanced students had a higher working-memory capacity than the novice students, validating the relationship between programming ability and working memory. The analysis results also showed that the hemodynamic responses in the prefrontal cortex can be used to discriminate between novices and advanced students. Additionally, we utilized an attention-based convolutional neural network to analyze the spatial domains of the fNIRS signals and demonstrated that the left prefrontal cortex was more important than other brain regions for programming ability prediction. This result was consistent with the results of statistical analysis, which in turn improved the interpretability of neural networks.

Applying functional near-infrared spectroscopy and eye-tracking in a naturalistic educational environment to investigate physiological aspects that underlie the cognitive effort of children during mental rotation tests

Spatial cognition is related to academic achievement in science, technology, engineering, and mathematics (STEM) domains. Neuroimaging studies suggest that brain regions' activation might be related to the general cognitive effort while solving mental rotation tasks (MRT). In this study, we evaluate the mental effort of children performing MRT tasks by measuring brain activation and pupil dilation. We use functional near-infrared spectroscopy (fNIRS) concurrently to collect brain hemodynamic responses from children's prefrontal cortex (PFC) and an Eye-tracking system to measure pupil dilation during MRT. Thirty-two healthy students aged 9-11 participated in this experiment. Behavioral measurements such as task performance on geometry problem-solving tests and MRT scores were also collected. The results were significant positive correlations between the children's MRT and geometry problem-solving test scores. There are also significant positive correlations between dorsolateral PFC (dlPFC) hemodynamic signals and visuospatial task performances (MRT and geometry problem-solving scores). Moreover, we found significant activation in the amplitude of deoxy-Hb variation on the dlPFC and that pupil diameter increased during the MRT, suggesting that both physiological responses are related to mental effort processes during the visuospatial task. Our findings indicate that children with more mental effort under the task performed better. The multimodal approach to monitoring students' mental effort can be of great interest in providing objective feedback on cognitive resource conditions and advancing our comprehension of the neural mechanisms that underlie cognitive effort. Hence, the ability to detect two distinct mental states of rest or activation of children during the MRT could eventually lead to an application for investigating the visuospatial skills of young students using naturalistic educational paradigms.

Effects of Audiovisual Interactions on Working Memory Task Performance—Interference or Facilitation

(1) Background: The combined n-back + Go/NoGo paradigm was used to investigate whether audiovisual interactions interfere with or facilitate WM. (2) Methods: College students were randomly assigned to perform the working memory task based on either a single (visual or auditory) or dual (audiovisual) stimulus. Reaction times, accuracy, and WM performance were compared across the two groups to investigate effects of audiovisual interactions. (3) Results: With low cognitive load (2-back), auditory stimuli had no effect on visual working memory, whereas visual stimuli had a small effect on auditory working memory. With high cognitive load (3-back), auditory stimuli interfered (large effect size) with visual WM, and visual stimuli interfered (medium effect size) with auditory WM. (4) Conclusions: Audiovisual effects on WM follow the resource competition theory, and the cognitive load of a visual stimulus is dominated by competition; vision always interferes with audition, and audition conditionally interferes with vision. With increased visual cognitive load, competitive effects of audiovisual interactions were more obvious than those with auditory stimuli. Compared with visual stimuli, audiovisual stimuli showed significant interference only when visual cognitive load was high. With low visual cognitive load, the two stimulus components neither facilitated nor interfered with the other in accordance with a speed–accuracy trade-off.

Frontal cortical activation during emotional and non-emotional verbal fluency tests

There has been growing recognition of the utility of combining the verbal fluency test and functional near-infrared spectroscopy (fNIRS) to assess brain functioning and to screen for psychiatric disorders. Recently, an emotional analogue of the semantic fluency test (SFT) has been developed that taps partly different processes from conventional verbal fluency tests. Nevertheless, neural processing during the emotional SFT remains elusive. Here, fNIRS was used to compare frontal cortical activation during emotional and non-emotional SFTs. The goal was to determine whether the emotional SFT activated overlapping yet distinct frontal cortical regions compared with the conventional, non-emotional SFT. Forty-three healthy young adults performed the emotional and non-emotional SFTs while hemodynamic changes in the bilateral frontopolar, dorsomedial, dorsolateral, ventrolateral, and posterolateral frontal cortices were measured by fNIRS. There were significant increases in oxyhemoglobin concentration and significant decreases in deoxyhemoglobin concentration (i.e., activation) in frontopolar, dorsolateral, and ventrolateral frontal regions during both the non-emotional and emotional SFTs. Also, complementary analyses conducted on changes in the two chromophores using classical and Bayesian hypothesis testing suggested that comparable frontal cortical regions were activated while performing the two tests. This similarity in activation occurred in a context where non-emotional and emotional SFT performances exhibited differential relationships with the overall level of negative mood symptoms. In conclusion, frontal cortical activation during the emotional SFT is similar to that during the conventional, non-emotional SFT. Given that there is evidence for discriminant validity for the emotional SFT, the neural mechanisms underlying the uniqueness of this test warrant further investigation.

Publication guidelines and recommendations for pupillary measurement in psychophysiological studies

A variety of psychological and physical phenomena elicit variations in the diameter of pupil of the eye. Changes in pupil size are mediated by the relative activation of the sphincter pupillae muscle (decrease pupil diameter) and the dilator pupillae muscle (increase pupil diameter), innervated by the parasympathetic and sympathetic branches, respectively, of the autonomic nervous system. The current guidelines are intended to inform and guide psychophysiological research involving pupil measurement by (1) summarizing important aspects concerning the physiology of the pupil, (2) providing methodological and data-analytic guidelines and recommendations, and (3) briefly reviewing psychological phenomena that modulate pupillary reactivity. Because of the increased ease and tractability of pupil measurement, the goal of these guidelines is to promote accurate recording, analysis, and reporting of pupillary data in psychophysiological research.