1
|
Kosonogov V, Shelepenkov D, Rudenkiy N. EEG and peripheral markers of viewer ratings: a study of short films. Front Neurosci 2023; 17:1148205. [PMID: 37378009 PMCID: PMC10291053 DOI: 10.3389/fnins.2023.1148205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Accepted: 05/17/2023] [Indexed: 06/29/2023] Open
Abstract
Introduction Cinema is an important part of modern culture, influencing millions of viewers. Research suggested many models for the prediction of film success, one of them being the use of neuroscientific tools. The aim of our study was to find physiological markers of viewer perception and correlate them to short film ratings given by our subjects. Short films are used as a test case for directors and screenwriters and can be created to raise funding for future projects; however, they have not been studied properly with physiological methods. Methods We recorded electroencephalography (18 sensors), facial electromyography (corrugator supercilii and zygomaticus major), photoplethysmography, and skin conductance in 21 participants while watching and evaluating 8 short films (4 dramas and 4 comedies). Also, we used machine learning (CatBoost, SVR) to predict the exact rating of each film (from 1 to 10), based on all physiological indicators. In addition, we classified each film as low or high rated by our subjects (with Logistic Regression, KNN, decision tree, CatBoost, and SVC). Results The results showed that ratings did not differ between genres. Corrugator supercilii activity ("frowning" muscle) was larger when watching dramas; whereas zygomaticus major ("smiling" muscle) activity was larger during the watching of comedies. Of all somatic and vegetative markers, only zygomaticus major activity, PNN50, SD1/SD2 (heart rate variability parameters) positively correlated to the film ratings. The EEG engagement indices, beta/(alpha+theta) and beta/alpha correlated positively with the film ratings in the majority of sensors. Arousal (betaF3 + betaF4)/(alphaF3 + alphaF4), and valence (alphaF4/betaF4) - (alphaF3/betaF3) indices also correlated positively to film ratings. When we attempted to predict exact ratings, MAPE was 0.55. As for the binary classification, logistic regression yielded the best values (area under the ROC curve = 0.62) than other methods (0.51-0.60). Discussion Overall, we revealed EEG and peripheral markers, which reflect viewer ratings and can predict them to a certain extent. In general, high film ratings can reflect a fusion of high arousal and different valence, positive valence being more important. These findings broaden our knowledge about the physiological basis of viewer perception and can be potentially used at the stage of film production.
Collapse
|
2
|
Central EEG Beta/Alpha Ratio Predicts the Population-Wide Efficiency of Advertisements. Brain Sci 2022; 13:brainsci13010057. [PMID: 36672039 PMCID: PMC9856603 DOI: 10.3390/brainsci13010057] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2022] [Revised: 12/13/2022] [Accepted: 12/23/2022] [Indexed: 12/29/2022] Open
Abstract
Recent studies have demonstrated that the brain activity of a group of people can be used to forecast choices at the population level. In this study, we attempted to neuroforecast aggregate consumer behavior of Internet users. During our electroencephalography (EEG) and eye-tracking study, participants were exposed to 10 banners that were also used in the real digital marketing campaign. In the separate online study, we additionally collected self-reported preferences for the same banners. We explored the relationship between the EEG, eye-tracking, and behavioral indexes obtained in our studies and the banners' aggregate efficiency provided by the large food retailer based on the decisions of 291,301 Internet users. An EEG-based engagement index (central beta/alpha ratio) significantly correlated with the aggregate efficiency of banners. Furthermore, our multiple linear regression models showed that a combination of eye-tracking, EEG and behavioral measurements better explained the market-level efficiency of banner advertisements than each measurement alone. Overall, our results confirm that neural signals of a relatively small number of individuals can forecast aggregate behavior at the population level.
Collapse
|
3
|
Pernice R, Antonacci Y, Zanetti M, Busacca A, Marinazzo D, Faes L, Nollo G. Multivariate Correlation Measures Reveal Structure and Strength of Brain-Body Physiological Networks at Rest and During Mental Stress. Front Neurosci 2021; 14:602584. [PMID: 33613173 PMCID: PMC7890264 DOI: 10.3389/fnins.2020.602584] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Accepted: 12/16/2020] [Indexed: 12/13/2022] Open
Abstract
In this work, we extend to the multivariate case the classical correlation analysis used in the field of network physiology to probe dynamic interactions between organ systems in the human body. To this end, we define different correlation-based measures of the multivariate interaction (MI) within and between the brain and body subnetworks of the human physiological network, represented, respectively, by the time series of δ, θ, α, and β electroencephalographic (EEG) wave amplitudes, and of heart rate, respiration amplitude, and pulse arrival time (PAT) variability (η, ρ, π). MI is computed: (i) considering all variables in the two subnetworks to evaluate overall brain-body interactions; (ii) focusing on a single target variable and dissecting its global interaction with all other variables into contributions arising from the same subnetwork and from the other subnetwork; and (iii) considering two variables conditioned to all the others to infer the network topology. The framework is applied to the time series measured from the EEG, electrocardiographic (ECG), respiration, and blood volume pulse (BVP) signals recorded synchronously via wearable sensors in a group of healthy subjects monitored at rest and during mental arithmetic and sustained attention tasks. We find that the human physiological network is highly connected, with predominance of the links internal of each subnetwork (mainly η-ρ and δ-θ, θ-α, α-β), but also statistically significant interactions between the two subnetworks (mainly η-β and η-δ). MI values are often spatially heterogeneous across the scalp and are modulated by the physiological state, as indicated by the decrease of cardiorespiratory interactions during sustained attention and by the increase of brain-heart interactions and of brain-brain interactions at the frontal scalp regions during mental arithmetic. These findings illustrate the complex and multi-faceted structure of interactions manifested within and between different physiological systems and subsystems across different levels of mental stress.
Collapse
Affiliation(s)
- Riccardo Pernice
- Department of Engineering, University of Palermo, Palermo, Italy
| | - Yuri Antonacci
- Department of Physics and Chemistry “Emilio Segrè,” University of Palermo, Palermo, Italy
| | - Matteo Zanetti
- Department of Industrial Engineering, University of Trento, Trento, Italy
| | | | | | - Luca Faes
- Department of Engineering, University of Palermo, Palermo, Italy
| | - Giandomenico Nollo
- Department of Industrial Engineering, University of Trento, Trento, Italy
| |
Collapse
|
4
|
Kosmyna N, Maes P. AttentivU: An EEG-Based Closed-Loop Biofeedback System for Real-Time Monitoring and Improvement of Engagement for Personalized Learning. SENSORS 2019; 19:s19235200. [PMID: 31783646 PMCID: PMC6929136 DOI: 10.3390/s19235200] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2019] [Revised: 11/17/2019] [Accepted: 11/18/2019] [Indexed: 11/22/2022]
Abstract
Information about a person’s engagement and attention might be a valuable asset in many settings including work situations, driving, and learning environments. To this end, we propose the first prototype of a device called AttentivU—a system that uses a wearable system which consists of two main components. Component 1 is represented by an EEG headband used to measure the engagement of a person in real-time. Component 2 is a scarf, which provides subtle, haptic feedback (vibrations) in real-time when the drop in engagement is detected. We tested AttentivU in two separate studies with 48 adults. The participants were engaged in a learning scenario of either watching three video lectures on different subjects or participating in a set of three face-to-face lectures with a professor. There were three conditions administrated during both studies: (1) biofeedback, meaning the scarf (component 2 of the system) was vibrating each time the EEG headband detected a drop in engagement; (2) random feedback, where the vibrations did not correlate or depend on the engagement level detected by the system, and (3) no feedback, when no vibrations were administered. The results show that the biofeedback condition redirected the engagement of the participants to the task at hand and improved their performance on comprehension tests.
Collapse
|
5
|
Vergara RC, Moënne-Loccoz C, Ávalos C, Egaña J, Maldonado PE. Finger Temperature: A Psychophysiological Assessment of the Attentional State. Front Hum Neurosci 2019; 13:66. [PMID: 30949037 PMCID: PMC6436084 DOI: 10.3389/fnhum.2019.00066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Accepted: 02/11/2019] [Indexed: 11/13/2022] Open
Abstract
Attention is a key cognitive phenomenon that is studied to understand cognitive disorders or even to estimate workloads to prevent accidents. Usually, it is studied using brain activity, even though it has many psychophysiological correlates. In the present study, we aim to evaluate if finger temperature, as a surrogate of peripheral vasoconstriction, can be used to obtain similar and complementary information to electroencephalography (EEG) brain activity measurements. To conduct this, 34 participants were recruited and submitted to performing four tasks-one as a baseline, and three attentional tasks. These three attentional tasks measured sustained attention, resilience to distractors, and attentional resources. During the tasks, the room, forehead, tympanic, and finger temperatures were measured. Furthermore, we included a 32-channel EEG recording. Our results showed a strong monotonic association between the finger temperature and the Alpha and Beta EEG spectral bands. When predicting attentional performance, the finger temperature was complementary to the EEG spectral measurements, through the prediction of aspects of attentional performance that had not been assessed by spectral EEG activity, or through the improvement of the model's fit. We also found that during the baseline task (non-goal-oriented task), the spectral EEG activity has an inverted correlation, as compared to a goal-oriented task. Our current results suggest that the psychophysiological assessment of attention is complementary to classic EEG approach, while also having the advantage of easy implementation of analysis tools in environments of reducing control (workplaces, student classrooms).
Collapse
Affiliation(s)
- Rodrigo C Vergara
- Departmento de Neurociencia, Facultad de Medicina, Universidad de Chile, Santiago, Chile.,Instituto de Neurociencia Biomédica, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| | - Cristóbal Moënne-Loccoz
- Departmento de Neurociencia, Facultad de Medicina, Universidad de Chile, Santiago, Chile.,Instituto de Neurociencia Biomédica, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| | - Camila Ávalos
- Departmento de Neurociencia, Facultad de Medicina, Universidad de Chile, Santiago, Chile.,Instituto de Neurociencia Biomédica, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| | - José Egaña
- Instituto de Neurociencia Biomédica, Facultad de Medicina, Universidad de Chile, Santiago, Chile.,Departamento de Anestesiologiá y Medicina Perioperatoria, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| | - Pedro E Maldonado
- Departmento de Neurociencia, Facultad de Medicina, Universidad de Chile, Santiago, Chile.,Instituto de Neurociencia Biomédica, Facultad de Medicina, Universidad de Chile, Santiago, Chile
| |
Collapse
|
6
|
Küssner MB. Eysenck's Theory of Personality and the Role of Background Music in Cognitive Task Performance: A Mini-Review of Conflicting Findings and a New Perspective. Front Psychol 2017; 8:1991. [PMID: 29184523 PMCID: PMC5694457 DOI: 10.3389/fpsyg.2017.01991] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2017] [Accepted: 10/31/2017] [Indexed: 11/28/2022] Open
Abstract
The question of whether background music is able to enhance cognitive task performance is of interest to scholars, educators, and stakeholders in business alike. Studies have shown that background music can have beneficial, detrimental or no effects on cognitive task performance. Extraversion—and its postulated underlying cause, cortical arousal—is regarded as an important factor influencing the outcome of such studies. According to Eysenck's theory of personality, extraverts' cortical arousal at rest is lower compared to that of introverts. Scholars have thus hypothesized that extraverts should benefit from background music in cognitive tasks, whereas introverts' performance should decline with music in the background. Reviewing studies that have considered extraversion as a mediator of the effect of background music on cognitive task performance, it is demonstrated that there is as much evidence in favor as there is against Eysenck's theory of personality. Further, revisiting Eysenck's concept of cortical arousal—which has traditionally been assessed by activity in the EEG alpha band—and reviewing literature on the link between extraversion and cortical arousal, it is revealed that there is conflicting evidence. Due to Eysenck's focus on alpha power, scholars have largely neglected higher frequency bands in the EEG signal as indicators of cortical arousal. Based on recent findings, it is suggested that beta power might not only be an indicator of alertness and attention but also a predictor of cognitive task performance. In conclusion, it is proposed that focused music listening prior to cognitive tasks might be a more efficient way to boost performance than listening to background music during cognitive tasks.
Collapse
Affiliation(s)
- Mats B Küssner
- Institut für Musikwissenschaft und Medienwissenschaft, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
7
|
EEG indices correlate with sustained attention performance in patients affected by diffuse axonal injury. Med Biol Eng Comput 2017; 56:991-1001. [PMID: 29124529 DOI: 10.1007/s11517-017-1744-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2017] [Accepted: 10/24/2017] [Indexed: 10/18/2022]
Abstract
The aim of this study is to assess the ability of EEG-based indices in providing relevant information about cognitive engagement level during the execution of a clinical sustained attention (SA) test in healthy volunteers and DAI (diffused axonal injury)-affected patients. We computed three continuous power-based engagement indices (P β /P α , 1/P α , and P β / (P α + P θ )) from EEG recordings in a control group (n = 7) and seven DAI-affected patients executing a 10-min Conners' "not-X" continuous performance test (CPT). A correlation analysis was performed in order to investigate the existence of relations between the EEG metrics and behavioral parameters in both the populations. P β /P α and 1/P α indices were found to be correlated with reaction times in both groups while P β / (P α + P θ ) and P β /P α also correlated with the errors rate for DAI patients. In line with previous studies, time course fluctuations revealed a first strong decrease of attention after 2 min from the beginning of the test and a final fading at the end. Our results provide evidence that EEG-derived indices extraction and evaluation during SA tasks are helpful in the assessment of attention level in healthy subjects and DAI patients, offering motivations for including EEG monitoring in cognitive rehabilitation practice. Graphical abstract Three EEG-derived indices were computed from four electrodes montages in a population of seven healthy volunteers and a group of seven DAI-affected patients. Results show a significant correlation between the time course of the indices and behavioral parameters, thus demonstrating their usefulness in monitoring mental engagement level during a sustained attention task.
Collapse
|
8
|
EEG Beta Power but Not Background Music Predicts the Recall Scores in a Foreign-Vocabulary Learning Task. PLoS One 2016; 11:e0161387. [PMID: 27537520 PMCID: PMC4990275 DOI: 10.1371/journal.pone.0161387] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2016] [Accepted: 08/04/2016] [Indexed: 11/19/2022] Open
Abstract
As tantalizing as the idea that background music beneficially affects foreign vocabulary learning may seem, there is-partly due to a lack of theory-driven research-no consistent evidence to support this notion. We investigated inter-individual differences in the effects of background music on foreign vocabulary learning. Based on Eysenck's theory of personality we predicted that individuals with a high level of cortical arousal should perform worse when learning with background music compared to silence, whereas individuals with a low level of cortical arousal should be unaffected by background music or benefit from it. Participants were tested in a paired-associate learning paradigm consisting of three immediate word recall tasks, as well as a delayed recall task one week later. Baseline cortical arousal assessed with spontaneous EEG measurement in silence prior to the learning rounds was used for the analyses. Results revealed no interaction between cortical arousal and the learning condition (background music vs. silence). Instead, we found an unexpected main effect of cortical arousal in the beta band on recall, indicating that individuals with high beta power learned more vocabulary than those with low beta power. To substantiate this finding we conducted an exact replication of the experiment. Whereas the main effect of cortical arousal was only present in a subsample of participants, a beneficial main effect of background music appeared. A combined analysis of both experiments suggests that beta power predicts the performance in the word recall task, but that there is no effect of background music on foreign vocabulary learning. In light of these findings, we discuss whether searching for effects of background music on foreign vocabulary learning, independent of factors such as inter-individual differences and task complexity, might be a red herring. Importantly, our findings emphasize the need for sufficiently powered research designs and exact replications of theory-driven experiments when investigating effects of background music and inter-individual variation on task performance.
Collapse
|
9
|
Coelli S, Sclocco R, Barbieri R, Reni G, Zucca C, Bianchi AM. EEG-based index for engagement level monitoring during sustained attention. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2015:1512-1515. [PMID: 26736558 DOI: 10.1109/embc.2015.7318658] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
This paper investigates the relation between mental engagement level and sustained attention in 9 healthy adults performing a Conners' "not-X" continuous performance test (CPT), while their electroencephalographic (EEG) activity was simultaneously acquired. Spectral powers were estimated and extracted in the classical EEG frequency bands. The engagement index (β/α) was calculated employing four different cortical montages suggested by the literature. Results show the efficacy of the estimated measures in detecting changes in mental state and its correlation with subject reaction times throughout the test. Moreover, the influence of the recording sites was proved underling the role of frontal cortex in maintaining a constant sustained attention level.
Collapse
|