Subject-independent decoding of affective states using functional near-infrared spectroscopy

On decoding of rapid motor imagery in a diverse population using a high-density NIRS device

Introduction

Functional near-infrared spectroscopy (fNIRS) aims to infer cognitive states such as the type of movement imagined by a study participant in a given trial using an optical method that can differentiate between oxygenation states of blood in the brain and thereby indirectly between neuronal activity levels. We present findings from an fNIRS study that aimed to test the applicability of a high-density (>3000 channels) NIRS device for use in short-duration (2 s) left/right hand motor imagery decoding in a diverse, but not explicitly balanced, subject population. A side aim was to assess relationships between data quality, self-reported demographic characteristics, and brain-computer interface (BCI) performance, with no subjects rejected from recruitment or analysis.

Methods

BCI performance was quantified using several published methods, including subject-specific and subject-independent approaches, along with a high-density fNIRS decoder previously validated in a separate study.

Results

We found that decoding of motor imagery on this population proved extremely challenging across all tested methods. Overall accuracy of the best-performing method (the high-density decoder) was 59.1 +/- 6.7% after excluding subjects where almost no optode-scalp contact was made over motor cortex and 54.7 +/- 7.6% when all recorded sessions were included. Deeper investigation revealed that signal quality, hemodynamic responses, and BCI performance were all strongly impacted by the hair phenotypical and demographic factors under investigation, with over half of variance in signal quality explained by demographic factors alone.

Discussion

Our results contribute to the literature reporting on challenges in using current-generation NIRS devices on subjects with long, dense, dark, and less pliable hair types along with the resulting potential for bias. Our findings confirm the need for increased focus on these populations, accurate reporting of data rejection choices across subject intake, curation, and final analysis in general, and signal a need for NIRS optode designs better optimized for the general population to facilitate more robust and inclusive research outcomes.

Recognition of Attentional States in VR Environment: An fNIRS Study

An improvement in ecological validity is one of the significant challenges for 21st-century neuroscience. At the same time, the study of neurocognitive processes in real-life situations requires good control of all variables relevant to the results. One possible solution that combines the capability of creating realistic experimental scenarios with adequate control of the test environment is virtual reality. Our goal was to develop an integrative research workspace involving a CW-fNIRS and head-mounted-display (HMD) technology dedicated to offline and online cognitive experiments. We designed an experimental study in a repeated-measures model on a group of BCI-naïve participants to verify our assumptions. The procedure included a 3D environment-adapted variant of the classic n-back task (2-back version). Tasks were divided into offline (calibration) and online (feedback) sessions. In both sessions, the signal was recorded during the cognitive task for within-group comparisons of changes in oxy-Hb concentration in the regions of interest (the dorsolateral prefrontal cortex-DLPFC and middle frontal gyrus-MFG). In the online session, the recorded signal changes were translated into real-time feedback. We hypothesized that it would be possible to obtain significantly higher than the level-of-chance threshold classification accuracy for the enhanced attention engagement (2-back task) vs. relaxed state in both conditions. Additionally, we measured participants' subjective experiences of the BCI control in terms of satisfaction. Our results confirmed hypotheses regarding the offline condition. In accordance with the hypotheses, combining fNIRS and HMD technologies enables the effective transfer of experimental cognitive procedures to a controlled VR environment. This opens the new possibility of creating more ecologically valid studies and training procedures.

Affective Neurofeedback Under Naturalistic Conditions: A Mini-Review of Current Achievements and Open Challenges

Affective neurofeedback training allows for the self-regulation of the putative circuits of emotion regulation. This approach has recently been studied as a possible additional treatment for psychiatric disorders, presenting positive effects in symptoms and behaviors. After neurofeedback training, a critical aspect is the transference of the learned self-regulation strategies to outside the laboratory and how to continue reinforcing these strategies in non-controlled environments. In this mini-review, we discuss the current achievements of affective neurofeedback under naturalistic setups. For this, we first provide a brief overview of the state-of-the-art for affective neurofeedback protocols. We then discuss virtual reality as a transitional step toward the final goal of "in-the-wild" protocols and current advances using mobile neurotechnology. Finally, we provide a discussion of open challenges for affective neurofeedback protocols in-the-wild, including topics such as convenience and reliability, environmental effects in attention and workload, among others.