Frontal EEG theta changes assess the training improvements of novices in flight simulation tasks

Flight training and the anterior cingulate cortex

Pilots are considered the final line of defense for aviation safety. Before becoming a pilot, an ab initio pilot must undergo systematic flight training. This study included 25 male flying cadets. Kendall's coefficient of concordance was used to measure the regional homogeneity of the time series of a given voxel with its 26 nearest neighboring voxels. This operation was performed for all voxels to generate a regional homogeneity map for each participant based on Kendall's coefficient of concordance. A partial correlation analysis was performed to examine the relationship between regional homogeneity maps and flight training hours. We found that the anterior cingulate cortex in the ab initio group was significantly positively correlated with flight hours. These results suggest a potential relationship between flight training experience and the functional properties of the anterior cingulate cortex.

An Empirical Study on the Effect of Blended Scents in Driving Environments From a Neuro-Cognitive Perspective

BACKGROUND

An effective method that is easy to implement and widely applicable for improving driving performance and reducing driving risks remains a challenge. Although fragrances are widely used in daily driving, there is a gap between empirical research on everyday blended fragrances and functional fragrances clinical reports. In this study, a deliberately chosen blend of scent without overtly stimulating or functional proven evidence was tested for its potential to enhance performance in a driving environment.

METHOD

Thirty qualified young drivers were recruited to participate in the experiment. They were asked to watch a 15-min first-person perspective driving video to simulate a driving environment and then complete questionnaires and three sets of behavioral experiments while their brain activity was monitored by EEG.

RESULT

Participants in the scented environment exhibited statistically significant advantages in two cognitive tasks during behavioral measures. These findings were effectively supported by the EEG data, showing that beta waves exhibited more activity in the occipital and prefrontal cortex, enhanced theta waves were observed in the prefrontal cortex, and the TAB index characterizing driving fatigue was suppressed in the prefrontal cortex.

CONCLUSION

This empirical evidence highlights the potential of pleasant, natural, and blended scents in enhancing driving performance, suggesting that promoting the aromatherapy while driving as an easily applicable approach in daily life seems justified and expands the application of aromatherapy in daily life.

A Neuroergonomic Approach Fostered by Wearable EEG for the Multimodal Assessment of Drivers Trainees

When assessing trainees' progresses during a driving training program, instructors can only rely on the evaluation of a trainee's explicit behavior and their performance, without having any insight about the training effects at a cognitive level. However, being able to drive does not imply knowing how to drive safely in a complex scenario such as the road traffic. Indeed, the latter point involves mental aspects, such as the ability to manage and allocate one's mental effort appropriately, which are difficult to assess objectively. In this scenario, this study investigates the validity of deploying an electroencephalographic neurometric of mental effort, obtained through a wearable electroencephalographic device, to improve the assessment of the trainee. The study engaged 22 young people, without or with limited driving experience. They were asked to drive along five different but similar urban routes, while their brain activity was recorded through electroencephalography. Moreover, driving performance, subjective and reaction times measures were collected for a multimodal analysis. In terms of subjective and performance measures, no driving improvement could be detected either through the driver's subjective measures or through their driving performance. On the other side, through the electroencephalographic neurometric of mental effort, it was possible to catch their improvement in terms of mental performance, with a decrease in experienced mental demand after three repetitions of the driving training tasks. These results were confirmed by the analysis of reaction times, that significantly improved from the third repetition as well. Therefore, being able to measure when a task is less mentally demanding, and so more automatic, allows to deduce the degree of users training, becoming capable of handling additional tasks and reacting to unexpected events.

Virtual and Reality: A Neurophysiological Pilot Study of the Sarcophagus of the Spouses

Art experience is not solely the observation of artistic objects, but great relevance is also placed on the environment in which the art experience takes place, often in museums and galleries. Interestingly, in the last few years, the introduction of some forms of virtual reality (VR) in museum contexts has been increasing. This has solicited enormous research interest in investigating any eventual differences between looking at the same artifact either in a real context (e.g. a museum) and in VR. To address such a target, a neuroaesthetic study was performed in which electroencephalography (EEG) and autonomic signals (heart rate and skin conductance) were recorded during the observation of the Etruscan artifact "Sarcophagus of the Spouses", both in the museum and in a VR reproduction. Results from EEG analysis showed a higher level of the Workload Index during observation in the museum compared to VR (p = 0.04), while the Approach-Withdrawal Index highlighted increased levels during the observation in VR compared to the observation in the museum (p = 0.03). Concerning autonomic indices, the museum elicited a higher Emotional Index response than the VR (p = 0.03). Overall, preliminary results suggest a higher engagement potential of the museum compared to VR, although VR could also favour higher embodiment than the museum.

Psychophysiological Parameters Predict the Performance of Naive Subjects in Sport Shooting Training

In this study, we investigated the neural and behavioral mechanisms associated with precision visual-motor control during the learning of sport shooting. We developed an experimental paradigm adapted for naïve individuals and a multisensory experimental paradigm. We showed that in the proposed experimental paradigms, subjects trained well and significantly increased their accuracy. We also identified several psycho-physiological parameters that were associated with shooting outcomes, including EEG biomarkers. In particular, we observed an increase in head-averaged delta and right temporal alpha EEG power before missing shots, as well as a negative correlation between theta-band energies in the frontal and central brain regions and shooting success. Our findings suggest that the multimodal analysis approach has the potential to be highly informative in studying the complex processes involved in visual-motor control learning and may be useful for optimizing training processes.

Evaluation of a New Lightweight EEG Technology for Translational Applications of Passive Brain-Computer Interfaces

Technologies like passive brain-computer interfaces (BCI) can enhance human-machine interaction. Anyhow, there are still shortcomings in terms of easiness of use, reliability, and generalizability that prevent passive-BCI from entering real-life situations. The current work aimed to technologically and methodologically design a new gel-free passive-BCI system for out-of-the-lab employment. The choice of the water-based electrodes and the design of a new lightweight headset met the need for easy-to-wear, comfortable, and highly acceptable technology. The proposed system showed high reliability in both laboratory and realistic settings, performing not significantly different from the gold standard based on gel electrodes. In both cases, the proposed system allowed effective discrimination (AUC > 0.9) between low and high levels of workload, vigilance, and stress even for high temporal resolution (<10 s). Finally, the generalizability of the proposed system has been tested through a cross-task calibration. The system calibrated with the data recorded during the laboratory tasks was able to discriminate the targeted human factors during the realistic task reaching AUC values higher than 0.8 at 40 s of temporal resolution in case of vigilance and workload, and 20 s of temporal resolution for the stress monitoring. These results pave the way for ecologic use of the system, where calibration data of the realistic task are difficult to obtain.

Air Force Pilot Expertise Assessment with Regard to Mental Effort Requested during Unusual Attitude Recovery Flight Training Simulations

Pilot training and expertise are key aspects in aviation. A traditional way of evaluating pilot expertise is to measure performance output. However, this approach provides a narrow view of the pilot’s capacity, especially with regard to mental and emotional profile. The aim of this study is hence to investigate whether neurophysiological data can be employed as an additional objective measure to assess the expertise of pilots. In this regard, it has been demonstrated that mental effort can be used as an indirect measure of operator expertise and capacity. An increase in mental effort, for instance, can automatically result in a decrease in the remaining capacity of the operator. To better investigate this aspect, we ask two groups of Italian Air Force pilots, experienced (Experts) and unexperienced (Novices), to undergo unusual attitude recovery flight training simulations. Their behavioral (unusual attitude recovery time), subjective (mental effort demand perception) and neurophysiological data (Electroencephalogram, EEG; Electrocardiogram, ECG) are collected during the entire flight simulations. Although the two groups do not exhibit differences in terms of unusual attitude recovery time and mental effort demand perception, the EEG-based mental effort index shows how Novices request significantly higher mental effort during unusual conditions.

Changes in brain activity of trainees during laparoscopic surgical virtual training assessed with electroencephalography

OBJECTIVE

Evaluate changes in brain activity of trainees during laparoscopic surgical training from electroencephalographic (EEG) signals in an ecological scenario with few restrictions for the user. Design Longitudinal study with two follow-up measurements in the first and last session of a 4-week training with LapSim laparoscopic surgery simulator. Variables analyzed include EEG neuronal activations in theta and alpha bands, tasks performance measures, and subjective measures such as perception of mental workload. Setting Medical School, Universidad de Antioquia, Medellin, Colombia. Participants First-year surgical residents (n = 16, age = 28.0 ± 2.6 years old, right-handed, 9 females) RESULTS: Significant improvements in tasks performance were found together with changes in neuronal activity over frontal and parietal cortex. These changes were also correlated with task performance through training sessions.

CONCLUSIONS

The use of neurophysiological measures such as electroencephalography combined with source separation techniques allows evaluating neural changes associated with motor training. The experiment proposed in this work establishes less controlled recording conditions leading to a more realistic analysis scenario to cognitive assessment in residents training.

Objective Assessments of Mental Fatigue During a Continuous Long-Term Stress Condition

Prolonged periods of cognitive workload will cause mental fatigue, but objective, quantitative, and sensitive measurements that reflect long-term, stress-induced mental fatigue have yet to be elucidated. This study aims to apply a potential marker of Rényi entropy to investigate the mental fatigue changes in a long-term, high-level stress condition and compare three different instruments for assessment of mental fatigue: EEG, the oddball task, and self-scoring. We recruited nine individuals who participated in a 5-day intellectually challenging competition. The participants were assessed for mental fatigue each day of the competition using prefrontal cortex electroencephalogram (EEG). Reaction time in an oddball task and self-rated scoring were used comparatively to evaluate the performance of the EEG. Repeated measures ANOVA was utilized to analyze the differences among score, reaction time, and wavelet Rényi entropy. The results demonstrated that both wavelet Rényi entropy extracted from EEG and self-rated scoring revealed significant increases in mental fatigue during the 5 days of competition (P < 0.001). The reaction time of the oddball task did not show significant changes during the five-day competition (P = 0.066). Moreover, the wavelet Rényi entropy analysis of EEG showed greater sensitivity than the self-rated scoring and reaction time of the oddball task for measuring mental fatigue changes. In conclusion, this study shows that mental fatigue accumulates during long-term, high-level stress situations. The study also indicates that EEG wavelet Rényi entropy is an efficient metric to reflect the change of mental fatigue under a long-term stress condition and that EEG is a better method to assess long-term mental fatigue.

Mental Effort Estimation by Passive BCI: A Cross-Subject Analysis

Despite the technological advancements, the employment of passive brain computer interface (BCI) out of the laboratory context is still challenging. This is largely due to methodological reasons. On the one hand, machine learning methods have shown their potential in maximizing performance for user mental states classification. On the other hand, the issues related to the necessary and frequent calibration of algorithms and to the temporal resolution of the measurement (i.e. how long it takes to have a reliable state measure) are still unsolved. This work explores the performances of a passive BCI system for mental effort monitoring consisting of three frontal electroencephalographic (EEG) channels. In particular, three calibration approaches have been tested: an intra-subject approach, a cross-subject approach, and a free-calibration procedure based on the simple average of theta activity over the three employed channels. A Random Forest model has been employed in the first two cases. The results obtained during multi-tasking have shown that the cross-subject approach allows the classification of low and high mental effort with an AUC higher than 0.9, with a related time resolution of 45 seconds. Moreover, these performances are not significantly different from the intra-subject approach although they are significantly higher than the calibration-free approach. In conclusion, these results suggest that a light (three EEG channels) passive BCI system based on a Random Forest algorithm and cross-subject calibration could be a simple and reliable tool for out-of-the-lab employment.

Which Comes First in Sports Vision Training: The Software or the Hardware Update? Utility of Electrophysiological Measures in Monitoring Specialized Visual Training in Youth Athletes

In the present study we combined popular methods of sports vision training (SVT) with traditional oculomotor protocols of Optometric Vision Therapy (OVT) and electrophysiological indexes of EEG and VEP activity to monitor training progress and changes in performance of youth ice hockey players without the history of concussion. We hypothesized that administration of OVT protocols before SVT training may result in larger performance improvements compared to the reverse order due to the initial strengthening of visual hardware capable of handling greater demands during training of visuomotor integration and information processing skills (visual software). In a cross-over design 53 youth ice hockey players (ages 13-18) were randomly assigned to one of the two training groups. Group one (hardware-software group) completed 5 weeks of oculomotor training first followed by 5 weeks of software training. For group 2 (software-hardware) the order of procedures were reversed. After 10 weeks of training both groups significantly improved their performance on all but one measure of the Nike/Senaptec Sensory station measures. Additionally, the software-hardware training order resulted in significantly lower frontal theta-to-gamma amplitude ratios on the Nike/Senaptec test of Near-Far Quickness as well as in faster P100 latencies. Both training orders also resulted in significant decreases in post-treatment P100 amplitude to transient VEP stimuli as well as decreased theta-gamma ratios for perception span, Go/No-Go and Hand Reaction time. The observed changes in the electrophysiological indexes in the present study are thought to reflect greater efficiency in visual information processing and cognitive resource allocation following 10 weeks of visual training. There is also some evidence of the greater effectiveness of the software-hardware training order possibly due to the improved preparedness of the oculomotor system in the youth athletes for administration of targeted protocols of the Optometric Vision Therapy.

Toward EEG-Based BCI Applications for Industry 4.0: Challenges and Possible Applications

In the last few decades, Brain-Computer Interface (BCI) research has focused predominantly on clinical applications, notably to enable severely disabled people to interact with the environment. However, recent studies rely mostly on the use of non-invasive electroencephalographic (EEG) devices, suggesting that BCI might be ready to be used outside laboratories. In particular, Industry 4.0 is a rapidly evolving sector that aims to restructure traditional methods by deploying digital tools and cyber-physical systems. BCI-based solutions are attracting increasing attention in this field to support industrial performance by optimizing the cognitive load of industrial operators, facilitating human-robot interactions, and make operations in critical conditions more secure. Although these advancements seem promising, numerous aspects must be considered before developing any operational solutions. Indeed, the development of novel applications outside optimal laboratory conditions raises many challenges. In the current study, we carried out a detailed literature review to investigate the main challenges and present criteria relevant to the future deployment of BCI applications for Industry 4.0.

Wearable Technologies for Mental Workload, Stress, and Emotional State Assessment during Working-Like Tasks: A Comparison with Laboratory Technologies

The capability of monitoring user’s performance represents a crucial aspect to improve safety and efficiency of several human-related activities. Human errors are indeed among the major causes of work-related accidents. Assessing human factors (HFs) could prevent these accidents through specific neurophysiological signals’ evaluation but laboratory sensors require highly-specialized operators and imply a certain grade of invasiveness which could negatively interfere with the worker’s activity. On the contrary, consumer wearables are characterized by their ease of use and their comfortability, other than being cheaper compared to laboratory technologies. Therefore, wearable sensors could represent an ideal substitute for laboratory technologies for a real-time assessment of human performances in ecological settings. The present study aimed at assessing the reliability and capability of consumer wearable devices (i.e., Empatica E4 and Muse 2) in discriminating specific mental states compared to laboratory equipment. The electrooculographic (EOG), electrodermal activity (EDA) and photoplethysmographic (PPG) signals were acquired from a group of 17 volunteers who took part to the experimental protocol in which different working scenarios were simulated to induce different levels of mental workload, stress, and emotional state. The results demonstrated that the parameters computed by the consumer wearable and laboratory sensors were positively and significantly correlated and exhibited the same evidences in terms of mental states discrimination.

NeuroDante: Poetry Mentally Engages More Experts but Moves More Non-Experts, and for Both the Cerebral Approach Tendency Goes Hand in Hand with the Cerebral Effort

Neuroaesthetics, the science studying the biological underpinnings of aesthetic experience, recently extended its area of investigation to literary art; this was the humus where neurocognitive poetics blossomed. Divina Commedia represents one of the most important, famous and studied poems worldwide. Poetry stimuli are characterized by elements (meter and rhyme) promoting the processing fluency, a core aspect of neuroaesthetics theories. In addition, given the evidence of different neurophysiological reactions between experts and non-experts in response to artistic stimuli, the aim of the present study was to investigate, in poetry, a different neurophysiological cognitive and emotional reaction between Literature (L) and Non-Literature (NL) students. A further aim was to investigate whether neurophysiological underpinnings would support explanation of behavioral data. Investigation methods employed: self-report assessments (recognition, appreciation, content recall) and neurophysiological indexes (approach/withdrawal (AW), cerebral effort (CE) and galvanic skin response (GSR)). The main behavioral results, according to fluency theories in aesthetics, suggested in the NL but not in the L group that the appreciation/liking went hand by hand with the self-declared recognition and with the content recall. The main neurophysiological results were: (i) higher galvanic skin response in NL, whilst higher CE values in L; (ii) a positive correlation between AW and CE indexes in both groups. The present results extended previous evidence relative to figurative art also to auditory poetry stimuli, suggesting an emotional attenuation “expertise-specific” showed by experts, but increased cognitive processing in response to the stimuli.

Forefront Users' Experience Evaluation by Employing Together Virtual Reality and Electroencephalography: A Case Study on Cognitive Effects of Scents

Scents have the ability to affect peoples' mental states and task performance with to different extents. It has been widely demonstrated that the lemon scent, included in most all-purpose cleaners, elicits stimulation and activation, while the lavender scent elicits relaxation and sedative effects. The present study aimed at investigating and fostering a novel approach to evaluate users' experience with respect to scents' effects through the joint employment of Virtual Reality and users' neurophysiological monitoring, in particular Electroencephalography. In particular, this study, involving 42 participants, aimed to compare the effects of lemon and lavender scents on the deployment of cognitive resources during a daily life experience consisting in a train journey carried out in virtual reality. Our findings showed a significant higher request of cognitive resources during the processing of an informative message for subjects exposed to the lavender scent with respect to the lemon exposure. No differences were found between lemon and lavender conditions on the self-reported items of pleasantness and involvement; as this study demonstrated, the employment of the lavender scent preserves the quality of the customer experience to the same extent as the more widely used lemon scent.

Electroencephalography (EEG) Technology Applications and Available Devices

The electroencephalography (EEG) sensor has become a prominent sensor in the study of brain activity. Its applications extend from research studies to medical applications. This review paper explores various types of EEG sensors and their applications. This paper is for an audience that comprises engineers, scientists and clinicians who are interested in learning more about the EEG sensors, the various types, their applications and which EEG sensor would suit a specific task. The paper also lists the details of each of the sensors currently available in the market, their technical specs, battery life, and where they have been used and what their limitations are.

Neurophysiological changes associated with training in laparoscopic surgery using EEG: a pilot study

Laparoscopy is a minimally invasive technique that requires surgeons to acquire special motor skills derived from an extensive training. This work focuses on exploring the neurophysiological changes associated with motor learning. Electroencephalographic (EEG) signals were recorded from eight subjects while performing a bimanual coordination task in a laparoscopic simulator. Spectral power measurements in theta, alpha and beta bands during four training sessions were calculated. Power indices, task score and perception of mental workload were evaluated using analysis of variance to show the effect of training session. Results show improvements in task performance and changes in power measurements associated with the training process. This work opens the possibility to assess the training performance of surgical residents using electrophysiological recordings.

Consumer Behaviour through the Eyes of Neurophysiological Measures: State-of-the-Art and Future Trends

The new technological advances achieved during the last decade allowed the scientific community to investigate and employ neurophysiological measures not only for research purposes but also for the study of human behaviour in real and daily life situations. The aim of this review is to understand how and whether neuroscientific technologies can be effectively employed to better understand the human behaviour in real decision-making contexts. To do so, firstly, we will describe the historical development of neuromarketing and its main applications in assessing the sensory perceptions of some marketing and advertising stimuli. Then, we will describe the main neuroscientific tools available for such kind of investigations (e.g., measuring the cerebral electrical or hemodynamic activity, the eye movements, and the psychometric responses). Also, this review will present different brain measurement techniques, along with their pros and cons, and the main cerebral indexes linked to the specific mental states of interest (used in most of the neuromarketing research). Such indexes have been supported by adequate validations from the scientific community and are largely employed in neuromarketing research. This review will also discuss a series of papers that present different neuromarketing applications, such us in-store choices and retail, services, pricing, brand perception, web usability, neuropolitics, evaluation of the food and wine taste, and aesthetic perception of artworks. Furthermore, this work will face the ethical issues arisen on the use of these tools for the evaluation of the human behaviour during decision-making tasks. In conclusion, the main challenges that neuromarketing is going to face, as well as future directions and possible scenarios that could be derived by the use of neuroscience in the marketing field, will be identified and discussed.

Antismoking Campaigns' Perception and Gender Differences: A Comparison among EEG Indices

Human factors' aim is to understand and evaluate the interactions between people and tasks, technologies, and environment. Among human factors, it is possible then to include the subjective reaction to external stimuli, due to individual's characteristics and states of mind. These processes are also involved in the perception of antismoking public service announcements (PSAs), the main tool for governments to contrast the first cause of preventable deaths in the world: tobacco addiction. In the light of that, in the present article, it has been investigated through the comparison of different electroencephalographic (EEG) indices a typical item known to be able of influencing PSA perception, that is gender. In order to investigate the neurophysiological underpinnings of such different perception, we tested two PSAs: one with a female character and one with a male character. Furthermore, the experimental sample was divided into men and women, as well as smokers and nonsmokers. The employed EEG indices were the mental engagement (ME: the ratio between beta activity and the sum of alpha and theta activity); the approach/withdrawal (AW: the frontal alpha asymmetry in the alpha band); and the frontal theta activity and the spectral asymmetry index (SASI: the ratio between beta minus theta and beta plus theta). Results suggested that the ME and the AW presented an opposite trend, with smokers showing higher ME and lower AW than nonsmokers. The ME and the frontal theta also evidenced a statistically significant interaction between the kind of the PSA and the gender of the observers; specifically, women showed higher ME and frontal theta activity for the male character PSA. This study then supports the usefulness of the ME and frontal theta for purposes of PSAs targeting on the basis of gender issues and of the ME and the AW and for purposes of PSAs targeting on the basis of smoking habits.

Neurophysiological Profile of Antismoking Campaigns

Over the past few decades, antismoking public service announcements (PSAs) have been used by governments to promote healthy behaviours in citizens, for instance, against drinking before the drive and against smoke. Effectiveness of such PSAs has been suggested especially for young persons. By now, PSAs efficacy is still mainly assessed through traditional methods (questionnaires and metrics) and could be performed only after the PSAs broadcasting, leading to waste of economic resources and time in the case of Ineffective PSAs. One possible countermeasure to such ineffective use of PSAs could be promoted by the evaluation of the cerebral reaction to the PSA of particular segments of population (e.g., old, young, and heavy smokers). In addition, it is crucial to gather such cerebral activity in front of PSAs that have been assessed to be effective against smoke (Effective PSAs), comparing results to the cerebral reactions to PSAs that have been certified to be not effective (Ineffective PSAs). The eventual differences between the cerebral responses toward the two PSA groups will provide crucial information about the possible outcome of new PSAs before to its broadcasting. This study focused on adult population, by investigating the cerebral reaction to the vision of different PSA images, which have already been shown to be Effective and Ineffective for the promotion of an antismoking behaviour. Results showed how variables as gender and smoking habits can influence the perception of PSA images, and how different communication styles of the antismoking campaigns could facilitate the comprehension of PSA's message and then enhance the related impact.

Neurophysiological Measures of the Perception of Antismoking Public Service Announcements Among Young Population

Tobacco constitutes a global emergency with totally preventable millions of deaths per year and smoking-related illnesses. Public service announcements (PSAs) are the main tool against smoking and by now their efficacy is still assessed through questionnaires and metrics, only months after their circulation. The present study focused on the young population, because at higher risk of developing tobacco addiction, investigating the reaction to the vision of Effective, Ineffective and Awarded antismoking PSAs through: electroencephalography (EEG), autonomic activity variation (Galvanic skin response—GSR- and Heart Rate—HR-) and Eye-Tracking (ET). The employed indices were: the EEG frontal alpha band asymmetry and the frontal theta; the Emotional Index (EI), deriving from the GSR and HR signals matching; the ET Visual Attention (VA) index, based on the ratio between the total time spent fixating an area of interest (AOI) and its area. Smokers expressed higher frontal alpha asymmetry values in comparison to non-smokers. Concerning frontal theta, Awarded PSAs reported the highest values in comparison to both Effective and Ineffective PSAs. EI results highlighted that lowest values were expressed by Heavy Smokers (HS), and Effective PSAs obtained the highest EI values. Finally, concerning the Effective PSAs, regression analysis highlighted a correlation between the number of cigarettes smoked by participants (independent variable) and frontal alpha asymmetry, frontal theta and EI values. ET results suggested that for the Ineffective PSAs the main focus were texts, while for the Effective and Awarded PSAs were the visual elements. Results support the use of methods aimed at assessing the physiological reaction for the evaluation of PSAs images, in particular when considering the smoking habits of target populations.

ECG-Based Concentration Recognition With Multi-Task Regression

OBJECTIVE

Recognition of human activities and mental states using wearable sensors and smartphones has attracted considerable attention recently. In particular, prediction of the stress level of a subject using an electrocardiogram sensor has been studied extensively. In this paper, we attempt to predict the degree of concentration by using heart-rate features. However, due to strong diversity in individuals and high sampling costs, building an accurate prediction model is still highly challenging.

METHOD

To overcome these difficulties, we propose to use a multitask learning (MTL) technique for effectively sharing information among similar individuals.

RESULT

Through experiments with 18 healthy subjects performing daily office works, such as writing reports, we demonstrate that the proposed method significantly improves the accuracy of concentration prediction in small sample situations.

CONCLUSION

The performance of the MTL method is shown to be stable across different subjects, which is an important advantage over conventional models.

SIGNIFICANCE

This improvement has significant impact in real-world concentration recognition because the data collection burden of each user can be drastically mitigated.

A New Perspective for the Training Assessment: Machine Learning-Based Neurometric for Augmented User's Evaluation

Inappropriate training assessment might have either high social costs and economic impacts, especially in high risks categories, such as Pilots, Air Traffic Controllers, or Surgeons. One of the current limitations of the standard training assessment procedures is the lack of information about the amount of cognitive resources requested by the user for the correct execution of the proposed task. In fact, even if the task is accomplished achieving the maximum performance, by the standard training assessment methods, it would not be possible to gather and evaluate information about cognitive resources available for dealing with unexpected events or emergency conditions. Therefore, a metric based on the brain activity (neurometric) able to provide the Instructor such a kind of information should be very important. As a first step in this direction, the Electroencephalogram (EEG) and the performance of 10 participants were collected along a training period of 3 weeks, while learning the execution of a new task. Specific indexes have been estimated from the behavioral and EEG signal to objectively assess the users' training progress. Furthermore, we proposed a neurometric based on a machine learning algorithm to quantify the user's training level within each session by considering the level of task execution, and both the behavioral and cognitive stabilities between consecutive sessions. The results demonstrated that the proposed methodology and neurometric could quantify and track the users' progresses, and provide the Instructor information for a more objective evaluation and better tailoring of training programs.

Human Factors and Neurophysiological Metrics in Air Traffic Control: A Critical Review

This paper provides a focused and organized review of the research progress on neurophysiological indicators, also called "neurometrics," to show how they can effectively address some of the most important human factors (HFs) needs in the air traffic management (ATM) field. In order to better understand and highlight available opportunities of such neuroscientific applications, state of the art on the most involved HFs and related cognitive processes (e.g., mental workload and cognitive training) are presented together with examples of possible applications in current and future ATM scenarios. Furthermore, this paper will discuss the potential enhancements that further research and development activities could bring to the efficiency and safety of the ATM service.

EEG-Based Cognitive Control Behaviour Assessment: an Ecological study with Professional Air Traffic Controllers

Several models defining different types of cognitive human behaviour are available. For this work, we have selected the Skill, Rule and Knowledge (SRK) model proposed by Rasmussen in 1983. This model is currently broadly used in safety critical domains, such as the aviation. Nowadays, there are no tools able to assess at which level of cognitive control the operator is dealing with the considered task, that is if he/she is performing the task as an automated routine (skill level), as procedures-based activity (rule level), or as a problem-solving process (knowledge level). Several studies tried to model the SRK behaviours from a Human Factor perspective. Despite such studies, there are no evidences in which such behaviours have been evaluated from a neurophysiological point of view, for example, by considering brain activity variations across the different SRK levels. Therefore, the proposed study aimed to investigate the use of neurophysiological signals to assess the cognitive control behaviours accordingly to the SRK taxonomy. The results of the study, performed on 37 professional Air Traffic Controllers, demonstrated that specific brain features could characterize and discriminate the different SRK levels, therefore enabling an objective assessment of the degree of cognitive control behaviours in realistic settings.

The Berlin Brain-Computer Interface: Progress Beyond Communication and Control

The combined effect of fundamental results about neurocognitive processes and advancements in decoding mental states from ongoing brain signals has brought forth a whole range of potential neurotechnological applications. In this article, we review our developments in this area and put them into perspective. These examples cover a wide range of maturity levels with respect to their applicability. While we assume we are still a long way away from integrating Brain-Computer Interface (BCI) technology in general interaction with computers, or from implementing neurotechnological measures in safety-critical workplaces, results have already now been obtained involving a BCI as research tool. In this article, we discuss the reasons why, in some of the prospective application domains, considerable effort is still required to make the systems ready to deal with the full complexity of the real world.

Adaptive Automation Triggered by EEG-Based Mental Workload Index: A Passive Brain-Computer Interface Application in Realistic Air Traffic Control Environment

Adaptive Automation (AA) is a promising approach to keep the task workload demand within appropriate levels in order to avoid both the under- and over-load conditions, hence enhancing the overall performance and safety of the human-machine system. The main issue on the use of AA is how to trigger the AA solutions without affecting the operative task. In this regard, passive Brain-Computer Interface (pBCI) systems are a good candidate to activate automation, since they are able to gather information about the covert behavior (e.g., mental workload) of a subject by analyzing its neurophysiological signals (i.e., brain activity), and without interfering with the ongoing operational activity. We proposed a pBCI system able to trigger AA solutions integrated in a realistic Air Traffic Management (ATM) research simulator developed and hosted at ENAC (École Nationale de l'Aviation Civile of Toulouse, France). Twelve Air Traffic Controller (ATCO) students have been involved in the experiment and they have been asked to perform ATM scenarios with and without the support of the AA solutions. Results demonstrated the effectiveness of the proposed pBCI system, since it enabled the AA mostly during the high-demanding conditions (i.e., overload situations) inducing a reduction of the mental workload under which the ATCOs were operating. On the contrary, as desired, the AA was not activated when workload level was under the threshold, to prevent too low demanding conditions that could bring the operator's workload level toward potentially dangerous conditions of underload.

Topological Changes in the Brain Network Induced by the Training on a Piloting Task: An EEG-Based Functional Connectome Approach

Training is a process to improve one's capacity or performance through the acquisition of knowledge or skills specific for the trained task. Although behavioral performance would be improved monotonically and reach a plateau as the learning progresses, neurophysiological signal shows different patterns like a U-shaped curve. One possible account for the phenomenon is that the brain first works hard to learn how to use task-relevant areas, followed by improvement in the efficiency derived from disuse of irrelevant brain areas for good task performance. Here, we hypothesize that topology of the brain network would show U-shaped changes during the training on a piloting task. To test this hypothesis, graph theoretical metrics quantifying global and local characteristics of the network were investigated. Our results demonstrated that global information transfer efficiency of the functional network in a high frequency band first decreased and then increased during the training while other measures such as local information transfer efficiency and small-worldness showed opposite patterns. Additionally, the centrality of nodes changed due to the training at frontal and temporal sites. Our results suggest network metrics can be used as biomarkers for quantifying the training progress, which can be differed depending on network efficiency of the brain.

Effective Indices for Monitoring Mental Workload While Performing Multiple Tasks

This study identified several physiological indices that can accurately monitor mental workload while participants performed multiple tasks with the strategy of maintaining stable performance and maximizing accuracy. Thirty male participants completed three 10-min. simulated multitasks: MATB (Multi-Attribute Task Battery) with three workload levels. Twenty-five commonly used mental workload measures were collected, including heart rate, 12 HRV (heart rate variability), 10 EEG (electroencephalography) indices (α, β, θ, α/θ, θ/β from O1-O2 and F4-C4), and two subjective measures. Analyses of index sensitivity showed that two EEG indices, θ and α/θ (F4-C4), one time-domain HRV-SDNN (standard deviation of inter-beat intervals), and four frequency-domain HRV: VLF (very low frequency), LF (low frequency), %HF (percentage of high frequency), and LF/HF were sensitive to differentiate high workload. EEG α/θ (F4-C4) and LF/HF were most effective for monitoring high mental workload. LF/HF showed the highest correlations with other physiological indices. EEG α/θ (F4-C4) showed strong correlations with subjective measures across diff erent mental workload levels. Operation strategy would affect the sensitivity of EEG α (F4-C4) and HF.