Eyeblink Activity as an Index of Cognitive Processing: Temporal Distribution of Eyeblinks as an Indicator of Expectancy in Semantic Priming

Attentional modulation of eye blinking is altered by sex, age, and task structure

Spontaneous eye blinking is gaining popularity as a proxy for higher cognitive functions, as it is readily modulated by both environmental demands and internal processes. Prior studies were impoverished in sample size, sex representation and age distribution, making it difficult to establish a complete picture of the behavior. Here we present eye-tracking data from a large cohort of normative participants (n=604, 393 F, aged 5-93 years) performing two tasks: one with structured, discrete trials (interleaved pro/anti-saccade task; IPAST) and one with a less structured, continuous organization in which participants watch movies (free-viewing; FV). Sex- and age-based analyses revealed that females had higher blink rates between the ages of 22 and 58 years in the IPAST, and 22 and 34 years in FV. We derived a continuous measure of blink probability to reveal behavioral changes driven by stimulus appearance in both paradigms. In the IPAST, blinks were suppressed near stimulus appearance, particularly on correct anti-saccade trials, which we attribute to the stronger inhibitory control required for anti-saccades compared to pro-saccades. In FV, blink suppression occurred immediately after scene changes, and the effect was sustained on scenes where gaze clustered among participants (indicating engagement of attention). Females were more likely than males to blink during appearance of novel stimuli in both tasks, but only within the age bin of 18-44 years. The consistency of blink patterns in each paradigm endorses blinking as a sensitive index for changes in visual processing and attention, while sex and age differences drive interindividual variability.Significance Statement Eye-tracking is becoming useful as a non-invasive tool for detecting preclinical markers of neurological and psychiatric disease. Blinks are understudied despite being an important supplement to saccade and pupil eye-tracking metrics. The present study is a crucial step in developing a healthy baseline for blink behavior to compare to clinical groups. While many prior blink studies suffered from small sample sizes with relatively low age- and sex-diversity (review by Jongkees & Colzato, 2016), our large cohort of healthy participants has permitted a more detailed analysis of sex and age effects in blink behavior. Furthermore, our analysis techniques are robust to temporal changes in blink probability, greatly clarifying the relationship between blinking, visual processing, and inhibitory control mechanisms on visual tasks.

Insights from Eye Blinks into the Cognitive Processes Involved in Visual Word Recognition

Behavioral differences in speed and accuracy between reading familiar and unfamiliar words are well-established in the empirical literature. However, these standard measures of skill proficiency are limited in their ability to capture the moment-to-moment processing involved in visual word recognition. In the present study, the effect of word familiarity was initially investigated using an eye blink rate among adults and children. The probability of eye blinking was higher for familiar (real) words than for unfamiliar (pseudo)words. This counterintuitive pattern of results suggests that the processing of unfamiliar (pseudo)words is more demanding and perhaps less rewarding than the processing of familiar (real) words, as previously observed in both behavioral and pupillometry data. Our findings suggest that the measurement of eye blinks might shed new light on the cognitive processes involved in visual word recognition and other domains of human cognition.

Task-synchronized eye blink modulation neither requires visual stimulation nor active motor response and is modulated by task predictability

It has been repeatedly shown that temporal task features are reflected in eye blink dynamics during attention tasks. Eye blinks occur with increased likeliness particularly when demands on external attention allocation are low. Both predictive, top-down and reactive, bottom-up processes were shown to be involved in blink regulation. However, whether temporal stimulus prediction is a generally active component of the attention system or rather specific to the visual domain has not been fully elaborated yet. By monitoring eye blinking of 99 students during an auditory attention task and analyzing particularly the dynamics of eye blink onsets relative to stimuli timings, we show here that prediction does, in principle, not require visual stimulation, and is also not merely a consequence of the involvement of manual responses during the task. We further show that both the inclusion of manual response to stimuli and elevated task predictability enhance the prediction component reflected in eye blink dynamics, whereas for the latter we experimentally manipulate objective task predictability by adjusting the frequency dependence of the power spectral densities of the series of inter-stimulus time intervals. This allows us finally to explain why, for specific choices of experimental conditions, the generally active and present prediction component involved in attention can become difficult to detect in non-visual, auditory tasks. Conversely, this comes with the important implication that, if tasks aim for elaborating particularly temporal prediction, distributing stimuli over time such that inter-stimulus-intervals conform to a sample of Gaussian noise represents a specifically unfavorable choice.

Automatic and controlled information processing in the context of students’ ethnic background and social status: An eye-tracking study

Based on the continuum model of impression formation (Fiske & Neuberg, 1990), information processing can be more or less automated or controlled and thus relies more or less on stereotype-based or individual-based characteristics. Also, teachers’ impression formation can be influenced by social categories like students’ ethnic background or social status. However, when teachers form an impression of students’ abilities or performance social categories should not play a role. But a lot of empirical findings show that teachers make a difference depending on students’ backgrounds. Whether this can be explained by a more automated or controlled information processing depending on students’ backgrounds is still an open question. Accordingly, the purpose of this study was to investigate teacher students’ impression formation in dependence on students’ ethnic backgrounds and social status. In order to investigate whether information processing differs according to students’ ethnic backgrounds and social status, an experimental eye-tracking study with 45 teacher students was designed. As physiological processes are strongly connected to psychological processes, specific eye-movements can be interpreted as indicators for physiological arousal in first place, but might also allow conclusions about mental processes like information processing. Pupil diameter and blink rate were measured while participants read three case vignettes with manipulated student background. Analysis of variance with repeated measures showed differences in pupil diameter and blink rate according to students’ background. Results showed less arousal when forming an impression about students without immigrant background and with high social status compared to students with immigrant background and with low social status. This might indicate more automated information processing for non-immigrant students with high-status, and more controlled processing for students with immigrant background and low-status.

Eyeblink rate as an indicator of concentration on grooming in Japanese macaques (Macaca fuscata)

In primates, social relationships with a high frequency of social grooming are referred to as "affiliate relationships," "friendship," "bonding," and are described as involving positive emotion. However, the psychological state during social grooming has not been fully understood. In this study, I focused on blinking as a behavior that reflects psychological state during grooming in Macaca fuscata, a nonhuman wild primate, and examined for the first time whether the blink rate reflects concentration on social grooming. To test this hypothesis, I focused on ectoparasite removals during social grooming with the following three predictions: (1) blinks are synchronized with breakpoints (when monkeys can release visual attention) of mouthing ectoparasites during grooming, (2) the blink rate is lower during grooming (when requiring visual concentration) than during resting (when no visual concentration is required), and (3) the lower the blink rate during grooming (supposedly in high concentration), the higher the frequency of ectoparasites removals (outputs of the task). I recorded the faces of 10 wild female Japanese macaques on Kinkazan Island, Miyagi Prefecture, with video, while they were resting and grooming, and recorded the timing and frequency of eyeblink and ectoparasite removals. All three predictions were supported, suggesting that the blink rate during grooming can be an indicator of concentration on grooming in nonhuman primates. Whether grooming concentration is associated with an affiliative relationship with the grooming partner is an issue that should be carefully examined in future studies, but eyeblink studies may provide new perspectives for understanding the psychological state of individuals during grooming in a noninvasive manner.

Overt Oculomotor Behavior Reveals Covert Temporal Predictions

Our eyes move in response to stimulus statistics, reacting to surprising events, and adapting to predictable ones. Cortical and subcortical pathways contribute to generating context-specific eye-movement dynamics, and oculomotor dysfunction is recognized as one the early clinical markers of Parkinson's disease (PD). We asked if covert computations of environmental statistics generating temporal expectations for a potential target are registered by eye movements, and if so, assuming that temporal expectations rely on motor system efficiency, whether they are impaired in PD. We used a repeating tone sequence, which generates a hazard rate distribution of target probability, and analyzed the distribution of blinks when participants were waiting for the target, but the target did not appear. Results show that, although PD participants tend to produce fewer and less temporally organized blink events relative to healthy controls, in both groups blinks became more suppressed with increasing target probability, leading to a hazard rate of oculomotor inhibition effects. The covert generation of temporal predictions may reflect a key feature of cognitive resilience in Parkinson's Disease.

Physiological correlates of cognitive load in laparoscopic surgery

Laparoscopic surgery can be exhausting and frustrating, and the cognitive load experienced by surgeons may have a major impact on patient safety as well as healthcare economics. As cognitive load decreases with increasing proficiency, its robust assessment through physiological data can help to develop more effective training and certification procedures in this area. We measured data from 31 novices during laparoscopic exercises to extract features based on cardiac and ocular variables. These were compared with traditional behavioural and subjective measures in a dual-task setting. We found significant correlations between the features and the traditional measures. The subjective task difficulty, reaction time, and completion time were well predicted by the physiology features. Reaction times to randomly timed auditory stimuli were correlated with the mean of the heart rate (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r = - 0.29$$\end{document}r=-0.29) and heart rate variability (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r = 0.4$$\end{document}r=0.4). Completion times were correlated with the physiologically predicted values with a correlation coefficient of 0.84. We found that the multi-modal set of physiology features was a better predictor than any individual feature and artificial neural networks performed better than linear regression. The physiological correlates studied in this paper, translated into technological products, could help develop standardised and more easily regulated frameworks for training and certification.

Blink synchronization is an indicator of interest while viewing videos

The temporal pattern of spontaneous blinks changes greatly depending on an individual's internal cognitive state. For instance, when several individuals watch the same video, blinks can be synchronized at attentional breakpoints. The present study examined the degree of this blink synchronization, as reflecting an interest level, while viewing various video clips. In the first experiment, participants interested in soccer, shogi (Japanese chess), or a specific musical group watched a video clip related to each category and rated their interest level after viewing. Results revealed that blink synchronization increased with a rise in interest level in the video clips of soccer and shogi. Moreover, while blink synchronization increased when viewing preferred video clips for the soccer and music group fans, synchronization decreased when viewing videos from the other categories, except for the shogi fans. In contrast, the blink rates did not correlate with the interest level on the video content but changed with the number of shot transitions of it. In the second experiment, participants viewed a video in which a professional salesperson gave descriptions of several products for a few minutes each. When participants reported an interest in the product, blinks were synchronized to the salesperson's blinks. However, when feeling uninterested, blink synchronization did not occur. These results suggest that blink synchronization could be used as an involuntary index to assess a person's interest.

Recognition method of construction conflict based on driver's eye movement

Drivers eye movement data in simulated construction conflicts at different speeds were collected and analyzed to find the relationship between the drivers' eye movement and the construction conflict. On the basis of the relationship between the drivers' eye movement and the construction conflict, the peak point of wavelet processed pupil diameter, the first point on the left side of the peak point and the first blink point after the peak point are selected as key points for locating construction conflict periods. On the basis of the key points and the GSA, a construction conflict recognition method so called the CCFRM is proposed. And the construction conflict recognition speed and location accuracy of the CCFRM are verified. The good performance of the CCFRM verified the feasibility of proposed key points in construction conflict recognition.

What Does Eye-Blink Rate Variability Dynamics Tell Us About Cognitive Performance?

Cognitive performance is defined as the ability to utilize knowledge, attention, memory, and working memory. In this study, we briefly discuss various markers that have been proposed to predict cognitive performance. Next, we develop a novel approach to characterize cognitive performance by analyzing eye-blink rate variability dynamics. Our findings are based on a sample of 24 subjects. The subjects were given a 5-min resting period prior to a 10-min IQ test. During both stages, eye blinks were recorded from Fp1 and Fp2 electrodes. We found that scale exponents estimated for blink rate variability during rest were correlated with subjects' performance on the subsequent IQ test. This surprising phenomenon could be explained by the person to person variation in concentrations of dopamine in PFC and accumulation of GABA in the visual cortex, as both neurotransmitters play a key role in cognitive processes and affect blinking. This study demonstrates the possibility that blink rate variability dynamics at rest carry information about cognitive performance and can be employed in the assessment of cognitive abilities without taking a test.

Transient heart rate acceleration in association with spontaneous eyeblinks

The reason why people spontaneously blink several times more frequently than is necessary for ocular lubrication has been a mystery. However, spontaneous eyeblinks selectively occur at attentional breakpoints of information processing, suggesting the involvement of spontaneous eyeblink in attentional disengagement from external stimuli. Physiological activity also changes considerably according to attention state. Heart rate decreases when attention is directed at stimuli, while it increases as attention is released. Therefore, we examined the temporal dynamics between spontaneous eyeblinks and instantaneous heart rate under natural circumstances. Our results showed that the heart rate momentarily increases after each spontaneous eyeblink while participants were freely viewing a movie or listening to a story. This phenomenon was consistently observed even when the participants were placed in a dark room. The skin conductance level on the fingers also increased after each spontaneous eyeblink, suggesting that the blink-related heart rate acceleration was induced by an increase in sympathetic nervous system activity. In contrast, no heart rate acceleration was observed to accompany spontaneous eyeblinks at rest or volitional eyeblinks. These results demonstrated that the generation of spontaneous eyeblinks and the activity of the autonomic nervous system are correlated under attentional influence of natural circumstances.

Inhibitory Control under Threat: The Role of Spontaneous Eye Blinks in Post-Traumatic Stress Disorder

This study is the first to explore spontaneous eye blink rate (sEBR) in individuals with post-traumatic stress disorder (PTSD). We investigated the connection between the magnitude of flanker interference in PTSD participants and sEBR during performance on a modified version of the Eriksen flanker task. As a peripheral measure of cognitive control and dopaminergic function, sEBR may illuminate the relationship between PTSD and executive function. Findings revealed a positive relationship between sEBR and flanker interference in participants diagnosed with PTSD, to both threat-related and neutral stimuli, whereas this relationship was negative in participants exposed to trauma but without PTSD and in healthy controls. Although our results are suggestive of sEBR as a potential physiological index of emotional management in PTSD, most of the correlations were not significant, indicating that further research with a larger sample is needed.

Eye-blinks in choice response tasks uncover hidden aspects of information processing

Spontaneous eye-blinks occur much more often than it would be necessary to maintain the tear film on the eyes. Various factors like cognitive demand, task engagement, or fatigue are influencing spontaneous blink rate. During cognitive information processing there is evidence that blinks occur preferably at moments that can be assigned to input stream segmentation. We investigated blinking behavior in three different visual choice response experiments (Experiment 1: spatial Stimulus-Response correspondence, Experiment 2: Change Detection, Experiment 3: Continuous performance Test - AX version). Blinks during the experimental tasks were suppressed when new information was expected, as well as during cognitive processing until the response was executed. Blinks in go trials occurred within a short and relatively constant interval after manual responses. However, blinks were not a side effect of manual behavior, as they occurred in a similar manner in no-go trials in which no manual response was executed. In these trials, blinks were delayed when a prepared response had to be inhibited, compared to trials in which no response was intended. Additionally, time on task effects for no-go blinks mirrored those obtained in go trials. Thus, blinks seem to provide a reliable measure for cognitive processing beyond (or rather additional to) manual responses.

Modulation of resource allocation by intelligent individuals in linguistic, mathematical and visuo-spatial tasks

This study investigates two questions: first, how individuals with high-intelligence allocate cognitive resources while solving linguistic, mathematical and visuo-spatial tasks with varying degree of difficulty as compared to individuals with low intelligence? Second, how to distinguish between high and low intelligent individuals by analyzing pupil dilation and eye blink together? We measured the response time, error rates along with pupil dilation and eye blink rate that indicate resource allocation. We divided the whole processing into three stages namely: pre-stimuli (5s prior to stimuli onset), during stimuli and post stimuli (until 5s after the response) for better assessment of preparation and resource allocation strategies. Individuals with high intelligence showed greater task evoked pupil dilation, decreased eye blink with less response time and error rates during-stimuli stage (processing) of tough linguistic and visuo-spatial tasks but not during mathematical tasks. The finding suggests that individuals with high intelligence allocate more resources if the task demands are high else they allocate less resources. Greater pre-stimuli pupil dilation and increased eye blink of high intelligent individuals in all tasks indicated their attentiveness and preparedness. The result of our study shows that individuals with high intelligence are more attentive and flexible in terms of altering the resource allocation strategy according to task demand. Eye-blinks along with pupil dilation and other behavioral parameters can be reliably used to assess the intelligence of an individual and the analysis of pupil dilation and blink rate at pre-stimuli stage can be crucial in distinguishing individuals with varying intelligence.

Mental workload measurement for emergency operating procedures in digital nuclear power plants

Mental workload is a major consideration for the design of emergency operation procedures (EOPs) in nuclear power plants. Continuous and objective measures are desired. This paper compares seven mental workload measurement methods (pupil size, blink rate, blink duration, heart rate variability, parasympathetic/sympathetic ratio, total power and (Goals, Operations, Methods, and Section Rules)-(Keystroke Level Model) GOMS-KLM-based workload index) with regard to sensitivity, validity and intrusiveness. Eighteen participants performed two computerised EOPs of different complexity levels, and mental workload measures were collected during the experiment. The results show that the blink rate is sensitive to both the difference in the overall task complexity and changes in peak complexity within EOPs, that the error rate is sensitive to the level of arousal and correlate to the step error rate and that blink duration increases over the task period in both low and high complexity EOPs. Cardiac measures were able to distinguish tasks with different overall complexity. The intrusiveness of the physiological instruments is acceptable. Finally, the six physiological measures were integrated using group method of data handling to predict perceived overall mental workload.

PRACTITIONER SUMMARY

The study compared seven measures for evaluating the mental workload with emergency operation procedure in nuclear power plants. An experiment with simulated procedures was carried out, and the results show that eye response measures are useful for assessing temporal changes of workload whereas cardiac measures are useful for evaluating the overall workload.

Combining blink, pupil, and response time measures in a concealed knowledge test

The response time (RT) based Concealed Knowledge Test (CKT) has been shown to accurately detect participants' knowledge of mock-crime-related information. Tests based on ocular measures such as pupil-size and blink-rate have sometimes resulted in poor classification, or lacked detailed classification analyses. The present study examines the fitness of multiple pupil and blink related responses in the CKT paradigm. To maximize classification efficiency, participants' concealed knowledge was assessed using both individual test measures and combinations of test measures. Results show that individual pupil-size, pupil-slope, and pre-response blink-rate measures produce efficient classifications. Combining pupil and blink measures yielded more accuracy classifications than individual ocular measures. Although RT-based tests proved efficient, combining RT with ocular measures had little incremental benefit. It is argued that covertly assessing ocular measures during RT-based tests may guard against effective countermeasure use in applied settings. A compound classification procedure was used to categorize individual participants and yielded high hit rates and low false-alarm rates without the need for adjustments between test paradigms and subject populations. We conclude that with appropriate test paradigms and classification analyses, ocular measures may prove as effective as other indices, though additional research is needed.

The timing and temporal patterns of eye blinking are dynamically modulated by attention

A number of human behaviors and movements show self-similar temporal patterns in their occurrence over time. Human walking, finger tapping and heartbeat intervals have fluctuations that are statistically similar at multiple time scales. However, whether eye blinking, which is a unique human behavior that occurs spontaneously, embeds a similar temporal structure within other types of movements is largely unknown. In this study, we used attention-requiring tasks to assess how the temporal pattern of eye blinking is altered in both the second and sub-second time scales. Our results showed that eyeblink activity was more suppressed as the task difficulty level increased and was facilitated immediately after exposure to auditory stimuli, which were presented for 6 to 14s. Moreover, similar transient suppressive and facilitative patterns were observed in the response period, which lasted for less than one second. Furthermore, we found that spontaneous eye blinking intervals fluctuated according to an 1/f scaling property, which is widely observed in various human movements. These results suggest that the dynamics of eye blinking under specific cognitive tasks exhibit a similar temporal structure at multiple time scales.

Spontaneous eyeblinks are correlated with responses during the Stroop task

The timing and frequency of spontaneous eyeblinking is thought to be influenced by ongoing internal cognitive or neurophysiological processes, but how precisely these processes influence the dynamics of eyeblinking is still unclear. This study aimed to better understand the functional role of eyeblinking during cognitive processes by investigating the temporal pattern of eyeblinks during the performance of attentional tasks. The timing of spontaneous eyeblinks was recorded from 28 healthy subjects during the performance of both visual and auditory versions of the Stroop task, and the temporal distributions of eyeblinks were estimated in relation to the timing of stimulus presentation and vocal response during the tasks. We found that the spontaneous eyeblink rate increased during Stroop task performance compared with the resting rate. Importantly, the subjects (17/28 during the visual Stroop, 20/28 during the auditory Stroop) were more likely to blink before a vocal response in both tasks (150–250 msec) and the remaining subjects were more likely to blink soon after the vocal response (200–300 msec), regardless of the stimulus type (congruent or incongruent) or task difficulty. These findings show that spontaneous eyeblinks are closely associated with responses during the performance of the Stroop task on a short time scale and suggest that spontaneous eyeblinks likely signal a shift in the internal cognitive or attentional state of the subjects.

Blink before and after you think: blinks occur prior to and following cognitive load indexed by pupillary responses

Pupil dilation and blinks provide complementary, mutually exclusive indices of information processing. Though each index is associated with cognitive load, the occurrence of a blink precludes the measurement of pupil diameter. These indices have generally been assessed in independent literatures. We examine the extent to which these measures are related on two cognitive tasks using a novel method that quantifies the proportion of trials on which blinks occur at each sample acquired during the trial. This measure allows cross-correlation of continuous pupil-dilation and blink waveforms. Results indicate that blinks occur during early sensory processing and following sustained information processing. Pupil dilation better reflects sustained information processing. Together these indices provide a rich picture of the time course of information processing, from early reactivity through sustained cognition, and after stimulus-related cognition ends.