1
|
Kronemer SI, Bandettini PA, Gonzalez-Castillo J. Sleuthing subjectivity: a review of covert measures of consciousness. Nat Rev Neurosci 2025:10.1038/s41583-025-00934-1. [PMID: 40410390 DOI: 10.1038/s41583-025-00934-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/02/2025] [Indexed: 05/25/2025]
Abstract
Consciousness is private. Although conscious beings directly access their own conscious experiences, the consciousness of others must be inferred through overt report: observable behaviours - such as overt facial expressions, vocalizations and body gestures - that suggest the level, state and content of consciousness. However, overt report is limited because it can be erroneous (for example, resulting from wilful deception or being subject to recall error), absent (for example, during sleep and paralysis) or conflict with research goals (for example, in no-report paradigms and resting-state studies). These limitations encourage the search for covert measures of consciousness: physiological signals that disclose consciousness without relying on overt behaviour. This Review highlights emerging covert measures of consciousness in humans, including eye, skin, respiratory and heart signals. We also address the challenge of distinguishing physiological signals linked to conscious versus unconscious neural processing. Finally, we consider the ethical implications of infringing on the innate privacy of consciousness.
Collapse
Affiliation(s)
- Sharif I Kronemer
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA.
| | - Peter A Bandettini
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
- Functional Magnetic Resonance Imaging Core Facility, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| | - Javier Gonzalez-Castillo
- Section on Functional Imaging Methods, Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
| |
Collapse
|
2
|
Lu L, Su B, Jung S, Qing L, Xu X. Effects of anthropomorphic features of co-robots on users' perception and emotional responses during human-robot collaboration. ERGONOMICS 2025:1-15. [PMID: 40314069 DOI: 10.1080/00140139.2025.2497523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2025] [Accepted: 04/07/2025] [Indexed: 05/03/2025]
Abstract
Human-robot collaboration (HRC) is growing across sectors like manufacturing and healthcare. This study explores how anthropomorphic features, specifically robot appearance (human-like face, robot-like face and blank screen) and voice (human-like voice, robot-like voice and beeping sound), influence user perceptions and emotional responses. Subjective assessments included the Robotic Social Attributes Scale (RoSAS) and self-report, while physiological responses were measured using electrocardiogram (ECG), galvanic skin response (GSR) and eye-tracking. Results showed that robot-like faces and human-like voices were linked to more positive perceptions, while human-like faces and beeping sounds led to greater negative emotional responses. Physiologically, both beeping sound and human-like voices increased skin conductance, and human-like voices also raised heart rate variability (HRV), suggesting participants felt less stressed under human-like voice conditions. Eye-tracking data showed shorter blink durations with robot-like faces, indicating greater sustained attention. These findings highlight the importance of designing robot features to improve user experience and collaboration in HRC.
Collapse
Affiliation(s)
- Lu Lu
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, USA
| | - Bingyi Su
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, USA
| | - Sehee Jung
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, USA
| | - Liwei Qing
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, USA
| | - Xu Xu
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, USA
| |
Collapse
|
3
|
Shi H, Chen F, Du H, Zhang T, Li C. Evaluating the impact of self-luminous road markings on driver behavior at unsignalized intersections: A simulator study. ACCIDENT; ANALYSIS AND PREVENTION 2025; 214:107967. [PMID: 40024062 DOI: 10.1016/j.aap.2025.107967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Revised: 12/15/2024] [Accepted: 02/12/2025] [Indexed: 03/04/2025]
Abstract
Unsignalized intersections are accident-prone locations due to numerous conflict points and unclear right-of-way. This issue is exacerbated at night when road markings become less visible, leading to increased accident rates. Self-luminous road markings, a new type of proactive traffic safety control facility, have garnered increasing attention and are being gradually promoted due to their intelligent, stable brightness and variable characteristics. To explore the warning effect of self-luminous road markings at unsignalized intersections at night, this study designed three types of warning schemes: continuous-illuminating pedestrian crosswalk advance warning marking (CPWM), continuous-illuminating yield text advance warning marking (CYWM), and transition-illuminating pedestrian crosswalk advance warning marking (TPWM). Based on previous research, nine indicators were selected for comprehensive evaluation from the perspectives of driver's operating, visual characteristics, and psychology. Finally, an entropy-based matter-element model was constructed to comprehensively evaluate the warning effect. The results show that the CYWM and CPWM schemes can help drivers effectively reduce the mean speed and potential lateral conflict risk at intersections, enhancing drivers' awareness of road environment information. However, the TPWM scheme had adverse effects due to greater visual stimulation. The effectiveness of the three schemes ranks from high to low as CYWM, CPWM, and TPWM. This study confirms that self-luminous road markings are effective at intersections, providing new insights for infrastructure upgrades and offering a general framework for evaluating the effectiveness of traffic safety facilities.
Collapse
Affiliation(s)
- Hailin Shi
- The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, PR China
| | - Feng Chen
- The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, PR China.
| | - Haotian Du
- The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, PR China
| | - Ting Zhang
- The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, PR China
| | - Chen Li
- The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, PR China
| |
Collapse
|
4
|
Lozzi D, Di Pompeo I, Marcaccio M, Ademaj M, Migliore S, Curcio G. SPEED: A Graphical User Interface Software for Processing Eye Tracking Data. NEUROSCI 2025; 6:35. [PMID: 40265365 PMCID: PMC12015838 DOI: 10.3390/neurosci6020035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2025] [Revised: 04/04/2025] [Accepted: 04/08/2025] [Indexed: 04/24/2025] Open
Abstract
Eye tracking is a tool that is widely used in scientific research, enabling the acquisition of precise and detailed data on an individual's eye movements during interaction with visual stimuli, thus offering a rich source of information on visual perception and associated cognitive processes. In this work, a new software called SPEED (labScoc Processing and Extraction of Eye tracking Data) is presented to process data acquired by Pupil Lab Neon (Pupil Labs, Berlin, Germany). The software is written in Python which helps researchers with the feature extraction step without any coding skills. This work also presents a pilot study in which five healthy subjects were included in research investigating oculomotor correlates during MDMT (Moral Decision-Making Task) and testing possible autonomic predictors of participants' performance. A statistically significant difference was observed in reaction times and in the number of blinks made during the choice between the conditions of the personal and impersonal dilemma.
Collapse
Affiliation(s)
- Daniele Lozzi
- A2VI-Lab, Department of Life, Health and Environmental Sciences, University of L’Aquila, 67100 L’Aquila, Italy;
- Department of Information Engineering, Computer Science and Mathematics, University of L’Aquila, 67100 L’Aquila, Italy
| | - Ilaria Di Pompeo
- Department of Biotechnological and Applied Clinical Sciences, University of L’Aquila, 67100 L’Aquila, Italy; (I.D.P.); (M.M.); (M.A.); (S.M.)
| | - Martina Marcaccio
- Department of Biotechnological and Applied Clinical Sciences, University of L’Aquila, 67100 L’Aquila, Italy; (I.D.P.); (M.M.); (M.A.); (S.M.)
| | - Matias Ademaj
- Department of Biotechnological and Applied Clinical Sciences, University of L’Aquila, 67100 L’Aquila, Italy; (I.D.P.); (M.M.); (M.A.); (S.M.)
- Faculty of Biology, Medicine and Health, University of Manchester, Manchester M13 9PT, UK
| | - Simone Migliore
- Department of Biotechnological and Applied Clinical Sciences, University of L’Aquila, 67100 L’Aquila, Italy; (I.D.P.); (M.M.); (M.A.); (S.M.)
| | - Giuseppe Curcio
- Department of Biotechnological and Applied Clinical Sciences, University of L’Aquila, 67100 L’Aquila, Italy; (I.D.P.); (M.M.); (M.A.); (S.M.)
| |
Collapse
|
5
|
Vasudevan V, Salardaine Q, Rivaud-Péchoux S, Biondetti E, Villain N, Lehericy S, Vidailhet M, Pouget P. Revisiting eye blink in Parkinson's disease. Sci Rep 2025; 15:10751. [PMID: 40155505 PMCID: PMC11953315 DOI: 10.1038/s41598-025-95182-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Accepted: 03/19/2025] [Indexed: 04/01/2025] Open
Abstract
Spontaneous blinking is a rapid and unconscious type of blinking that has been linked to several cognitive processes. Blink rate has been established as a reliable measure of cognitive processing and a predictor of dopamine-related cognitive function. Patients with Parkinson's disease (PD) have a reduced spontaneous blink rate. In this study, we propose an additional measure of blink characteristic, namely blink duration, and evaluate its alteration in a large cohort of 107 patients with PD. We also investigate the relationship between blink rate and blink duration and disease characteristics such as severity and dopaminergic neuronal loss. The results show that the blink rate is reduced, and blink duration is increased in patients compared to healthy controls. Blink rate is related to motor deficit severity and significantly correlated with dopamine depletion (dopamine transporter striatal binding ratio). Conversely, blink duration is related to non-motor aspects such as sleepiness. These findings highlight the potential of blink as a distinguishing feature of Parkinson's disease, underscoring the importance of incorporating blink assessments into standardized oculomotor testing protocols for PD.
Collapse
Affiliation(s)
- Varsha Vasudevan
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France.
| | - Quentin Salardaine
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France
| | - Sophie Rivaud-Péchoux
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France
| | - Emma Biondetti
- Department of Neurosciences, Imaging, and Clinical Sciences, University 'G. D'Annunzio' of Chieti-Pescara, Chieti, Italy
- Institute for Advanced Biomedical Technologies, University 'G. D'Annunzio' of Chieti-Pescara, Chieti, Italy
| | - Nicolas Villain
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France
- AP-HP Sorbonne Université, Pitié-Salpêtrière Hospital, Paris, France
| | - Stephane Lehericy
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France
- AP-HP Sorbonne Université, Pitié-Salpêtrière Hospital, Paris, France
| | - Marie Vidailhet
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France
- AP-HP Sorbonne Université, Pitié-Salpêtrière Hospital, Paris, France
| | - Pierre Pouget
- INSERM U1127, CNRS UMR7225, UM75, Movement Investigation and Therapeutics Team, Paris Brain Institute, ICM, Sorbonne Université, Paris, France.
| |
Collapse
|
6
|
Nousias G, Delibasis KK, Labiris G. Blink Detection Using 3D Convolutional Neural Architectures and Analysis of Accumulated Frame Predictions. J Imaging 2025; 11:27. [PMID: 39852340 PMCID: PMC11765999 DOI: 10.3390/jimaging11010027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2024] [Revised: 01/12/2025] [Accepted: 01/17/2025] [Indexed: 01/26/2025] Open
Abstract
Blink detection is considered a useful indicator both for clinical conditions and drowsiness state. In this work, we propose and compare deep learning architectures for the task of detecting blinks in video frame sequences. The first step is the training and application of an eye detector that extracts the eye regions from each video frame. The cropped eye regions are organized as three-dimensional (3D) input with the third dimension spanning time of 300 ms. Two different 3D convolutional neural networks are utilized (a simple 3D CNN and 3D ResNet), as well as a 3D autoencoder combined with a classifier coupled to the latent space. Finally, we propose the usage of a frame prediction accumulator combined with morphological processing and watershed segmentation to detect blinks and determine their start and stop frame in previously unseen videos. The proposed framework was trained on ten (9) different participants and tested on five (8) different ones, with a total of 162,400 frames and 1172 blinks for each eye. The start and end frame of each blink in the dataset has been annotate by specialized ophthalmologist. Quantitative comparison with state-of-the-art blink detection methodologies provide favorable results for the proposed neural architectures coupled with the prediction accumulator, with the 3D ResNet being the best as well as the fastest performer.
Collapse
Affiliation(s)
- George Nousias
- Department of Computer Science and Biomedical Informatics, University of Thessaly, 35131 Lamia, Greece;
| | - Konstantinos K. Delibasis
- Department of Computer Science and Biomedical Informatics, University of Thessaly, 35131 Lamia, Greece;
| | - Georgios Labiris
- Department of Ophthalmology, General University Hospital of Alexandroupolis, 68131 Alexandroupolis, Greece;
| |
Collapse
|
7
|
Riek HC, Visanji NP, Pitigoi IC, Di Luca DG, Armengou-Garcia L, Ahmed N, Perkins JE, Brien DC, Huang J, Coe BC, Huang J, Ghate T, Lang AE, Marras C, Munoz DP. Multimodal oculomotor assessment reveals prodromal markers of Parkinson's disease in non-manifesting LRRK2 G2019S mutation carriers. NPJ Parkinsons Dis 2024; 10:234. [PMID: 39702611 DOI: 10.1038/s41531-024-00840-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Accepted: 11/14/2024] [Indexed: 12/21/2024] Open
Abstract
Oculomotor behaviour changes in patients with Parkinson's disease (PD) are a promising source of prodromal disease markers. Capitalizing on this phenomenon to facilitate early diagnosis requires oculomotor assessment in prodromal cohorts. We examined oculomotor behaviour in non-manifesting LRRK2 G2019S mutation carriers (LRRK2-NM), who have heightened PD risk.Seventeen LRRK2-NM participants, 47 patients with idiopathic PD, and 63 healthy age-matched control participants completed an interleaved pro- and antisaccade task while undergoing video-based eye-tracking. We analyzed between-group differences in saccade, pupil, blink, and fixation acquisition behaviour. Patients with PD showed previously demonstrated abnormalities (saccade hypometria, antisaccade errors). Relative to controls, LRRK2-NM participants and patients with PD both displayed increased short-latency prosaccades and reduced pupil velocity, plus altered fixation acquisition-less preemptive returning of gaze to the future fixation point location. Interestingly, the effect on blink probability was opposite-higher than controls in LRRK2-NM participants but lower in patients with PD. Future longitudinal studies must confirm the viability of these features as prodromal PD markers.
Collapse
Affiliation(s)
- Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - Naomi P Visanji
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
- Tanz Centre for Research in Neurodegenerative Diseases, University of Toronto, Toronto, ON, Canada
- Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, ON, Canada
- Krembil Brain Institute, University Health Network, Toronto, ON, Canada
- Rossy PSP Centre, University Health Network, Toronto, ON, Canada
| | - Isabell C Pitigoi
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Daniel G Di Luca
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Laura Armengou-Garcia
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
| | - Nazish Ahmed
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
| | - Julia E Perkins
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Jeff Huang
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Jana Huang
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
| | - Taneera Ghate
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
| | - Anthony E Lang
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
- Tanz Centre for Research in Neurodegenerative Diseases, University of Toronto, Toronto, ON, Canada
- Krembil Brain Institute, University Health Network, Toronto, ON, Canada
- Rossy PSP Centre, University Health Network, Toronto, ON, Canada
| | - Connie Marras
- Edmond J. Safra Program in Parkinson's Disease and the Morton and Gloria Shulman Movement Disorders Clinic, University Health Network, Toronto, ON, Canada
- Krembil Brain Institute, University Health Network, Toronto, ON, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| |
Collapse
|
8
|
Sato R, Kimura E. Voluntary blinks and eye-widenings, but not spontaneous blinks, facilitate perceptual alternation during continuous flash suppression. J Vis 2024; 24:11. [PMID: 39699910 DOI: 10.1167/jov.24.13.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2024] Open
Abstract
The fact that blinks occur more often than necessary for ocular lubrication has led to the proposal that blinks are involved in altering some aspects of visual cognition. Previous studies have suggested that blinking can modulate the alternation of different visual interpretations of the same stimulus, that is, perceptual alternation in multistable perception. This study investigated whether and how different types of blinks, spontaneous and voluntary, interact with perceptual alternation in a multistable perception paradigm called continuous flash suppression. The results showed that voluntary blinking facilitated perceptual alternation, whereas spontaneous blinking did not. Moreover, voluntary eye-widening, as well as eyelid closing, facilitated perceptual alternation. Physical blackouts, which had timing and duration comparable to those of voluntary blinks, did not produce facilitatory effects. These findings suggest that the effects of voluntary eyelid movements are mediated by extraretinal processes and are consistent with previous findings that different types of blinks are at least partially mediated by different neurophysiological processes. Furthermore, perceptual alternation was also found to facilitate spontaneous blinking. These results indicate that eyelid movements and perceptual alternation interact reciprocally with each other.
Collapse
Affiliation(s)
- Ryoya Sato
- Graduate School of Science and Engineering, Chiba University, Chiba, Japan
| | - Eiji Kimura
- Department of Psychology, Graduate School of Humanities, Chiba University, Chiba, Japan
| |
Collapse
|
9
|
Romeo MA, Coco G, Taloni A, Carnovale-Scalzo G, Scorcia V, Giannaccare G. Digital Applications for Videoterminal-Associated Dry Eye Disease. Vision (Basel) 2024; 8:67. [PMID: 39728920 PMCID: PMC11728679 DOI: 10.3390/vision8040067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2024] [Revised: 11/22/2024] [Accepted: 11/26/2024] [Indexed: 12/28/2024] Open
Abstract
Dry eye disease (DED) has become increasingly prevalent in the digital era, largely due to prolonged screen exposure. The excessive use of digital devices contributes to inappropriate blink frequency and dynamics, leading to ocular surface dryness and discomfort. Additionally, digital screen use has broader implications for systemic health, including visual strain, headaches, and disrupted circadian rhythms caused by blue light exposure. Previous studies have shown that prolonged screen time correlates with altered blink frequency and increased symptom severity in DED patients, exacerbating the imbalance in tear film production and evaporation. Blinking dynamics, particularly blink rate and completeness, are crucial in maintaining ocular surface moisture. Incomplete blinking impairs meibomian gland function, reducing lipid secretion, which is essential for preventing tear evaporation. Raising patient awareness through educational material, ergonomic adjustments, and blinking exercises has been shown to mitigate these effects. Digital tools that provide targeted educational interventions can be particularly effective in improving blink dynamics and overall ocular comfort. This study evaluates the efficacy of digital applications in optimizing blinking dynamics and enhancing tear film stability. The findings suggest that these innovations improve patient outcomes by encouraging healthier eye care practices. However, further research is needed to assess their long-term impact across diverse populations.
Collapse
Affiliation(s)
- Maria Angela Romeo
- Department of Ophthalmology, University Magna Graecia of Catanzaro, 88100 Catanzaro, Italy
| | - Giulia Coco
- Department of Clinical Sciences and Translational Medicine, University of Rome Tor Vergata, 00133 Rome, Italy
| | - Andrea Taloni
- Department of Ophthalmology, University Magna Graecia of Catanzaro, 88100 Catanzaro, Italy
| | | | - Vincenzo Scorcia
- Department of Ophthalmology, University Magna Graecia of Catanzaro, 88100 Catanzaro, Italy
| | - Giuseppe Giannaccare
- Eye Clinic, Department of Surgical Sciences, University of Cagliari, 09124 Cagliari, Italy
| |
Collapse
|
10
|
Wong SW, Kopecny L, Crowe P. Interventions to prevent visual fatigue during robotic surgery. J Robot Surg 2024; 18:396. [PMID: 39509074 DOI: 10.1007/s11701-024-02154-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Accepted: 10/26/2024] [Indexed: 11/15/2024]
Abstract
The robotic surgeon is at risk of visual fatigue from prolonged viewing of the video display resulting in digital eye strain and use of the three-dimensional binoculars resulting in accommodative stress. Symptoms of digital eye strain include blurred vision, dry eyes, eyestrain, neck and back ache, diplopia, light sensitivity, and headaches. Vergence or accommodation-related symptoms include blurred near or distance vision, difficulty refocusing, and diplopia. Beneficial ergonomic interventions to manage digital eye strain during robotic surgery include appropriate lighting, improved neck positioning, optimal screen positioning, improved image parameters, screen breaks, optimising environmental factors, and eye exercises. Correction of refractive error, use of lubricating eye drops, and blink efficiency training to induce motor memory have been shown to be effective in reducing visual fatigue. Vergence-accommodation mismatch can be reduced with slower movement of the camera, screen breaks, and correction of refractive error. Robotic surgeons should adopt these simple and non-invasive interventions to minimise visual fatigue.
Collapse
Affiliation(s)
- Shing Wai Wong
- Randwick Campus, School of Clinical Medicine, The University of New South Wales, Sydney, NSW, Australia.
- Department of General Surgery, Prince of Wales Hospital, Sydney, NSW, Australia.
| | - Lloyd Kopecny
- Department of General Surgery, Prince of Wales Hospital, Sydney, NSW, Australia
| | - Philip Crowe
- Randwick Campus, School of Clinical Medicine, The University of New South Wales, Sydney, NSW, Australia
- Department of General Surgery, Prince of Wales Hospital, Sydney, NSW, Australia
| |
Collapse
|
11
|
Kirkpatrick RH, Booij L, Riek HC, Huang J, Pitigoi IC, Brien DC, Coe BC, Couturier J, Khalid-Khan S, Munoz DP. Oculomotor behaviors in youth with an eating disorder: findings from a video-based eye tracking task. J Eat Disord 2024; 12:121. [PMID: 39169420 PMCID: PMC11337776 DOI: 10.1186/s40337-024-01084-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/17/2024] [Accepted: 08/10/2024] [Indexed: 08/23/2024] Open
Abstract
BACKGROUND The oculomotor circuit spans many cortical and subcortical areas that have been implicated in psychiatric disease. This, combined with previous findings, suggests that eye tracking may be a useful method to investigate eating disorders. Therefore, this study aimed to assess oculomotor behaviors in youth with and without an eating disorder. METHODS Female youth with and without an eating disorder completed a structured task involving randomly interleaved pro-saccade (toward at a stimulus) and anti-saccade (away from stimulus) trials with video-based eye tracking. Differences in saccades (rapid eye movements between two points), eye blinks and pupil were examined. RESULTS Youth with an eating disorder (n = 65, Mage = 17.16 ± 3.5 years) were compared to healthy controls (HC; n = 65, Mage = 17.88 ± 4.3 years). The eating disorder group was composed of individuals with anorexia nervosa (n = 49), bulimia nervosa (n = 7) and other specified feeding or eating disorder (n = 9). The eating disorder group was further divided into two subgroups: individuals with a restrictive spectrum eating disorder (ED-R; n = 43) or a bulimic spectrum eating disorder (ED-BP; n = 22). In pro-saccade trials, the eating disorder group made significantly more fixation breaks than HCs (F(1,128) = 5.33, p = 0.023). The ED-BP group made the most anticipatory pro-saccades, followed by ED-R, then HCs (F(2,127) = 3.38, p = 0.037). Groups did not differ on rate of correct express or regular latency pro-saccades. In anti-saccade trials, groups only significantly differed on percentage of direction errors corrected (F(2, 127) = 4.554, p = 0.012). The eating disorder group had a significantly smaller baseline pupil size (F(2,127) = 3.60, p = 0.030) and slower pro-saccade dilation velocity (F(2,127) = 3.30, p = 0.040) compared to HCs. The ED-R group had the lowest blink probability during the intertrial interval (ITI), followed by ED-BP, with HCs having the highest ITI blink probability (F(2,125) = 3.63, p = 0.029). CONCLUSIONS These results suggest that youth with an eating disorder may have different oculomotor behaviors during a structured eye tracking task. The oculomotor behavioral differences observed in this study presents an important step towards identifying neurobiological and cognitive contributions towards eating disorders.
Collapse
Affiliation(s)
- Ryan H Kirkpatrick
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada.
- School of Medicine, Queen's University, Kingston, ON, Canada.
| | - Linda Booij
- Eating Disorders Continuum & Research Centre, Douglas Mental Health University Institute, Montreal, QC, Canada
- Department of Psychiatry, McGill University, Montreal, QC, Canada
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Jeff Huang
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Isabell C Pitigoi
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
| | - Jennifer Couturier
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, ON, Canada
| | - Sarosh Khalid-Khan
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
- Department of Psychiatry, Queen's University, Kingston, ON, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Botterell Hall, 18 Stuart St, K7L 3N6, Kingston, ON, Canada
- School of Medicine, Queen's University, Kingston, ON, Canada
| |
Collapse
|
12
|
Tomberg C, Petagna M, de Selliers de Moranville LA. Spontaneous eye blinks in horses (Equus caballus) are modulated by attention. Sci Rep 2024; 14:19336. [PMID: 39164361 PMCID: PMC11336180 DOI: 10.1038/s41598-024-70141-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 08/13/2024] [Indexed: 08/22/2024] Open
Abstract
Spontaneous eye blinks are brief closures of both eyelids. The spontaneous eye blink rate (SEBR) exceeds physiological corneal needs and is modulated by emotions and cognitive states, including vigilance and attention, in humans. In several animal species, the SEBR is modulated by stress and antipredator vigilance, which may limit the loss of visual information due to spontaneous eye closing. Here, we investigated whether the SEBR is modulated by attention in the domestic horse (Equus caballus). Our data supported previous studies indicating a tonic SEBR specific to each individual. We also found that, superimposed on a tonic SEBR, phasic changes were induced by cognitive processing. Attention downmodulated the SEBR, with the magnitude of blink inhibition proportional to the degree of attentional selectivity. On the other hand, reward anticipation upregulated the SEBR. Our data also suggested that horses possess the cognitive property of object permanence: they understand that an object that is no longer in their visual field has not ceased to exist. In conclusion, our results suggested that spontaneous eye blinks in horses are modulated by attentional cognitive processing.
Collapse
Affiliation(s)
- Claude Tomberg
- Faculty of Medicine, Université libre de Bruxelles, 808, route de Lennik, CP 630, 1070, Brussels, Belgium.
| | - Maxime Petagna
- Faculty of Medicine, Université libre de Bruxelles, 808, route de Lennik, CP 630, 1070, Brussels, Belgium
| | | |
Collapse
|
13
|
Han L, Du Z. Investigating the influence of eye-catching effect on mental workload in highway tunnel entrances: a comprehensive analysis of eye blink behavior. TRAFFIC INJURY PREVENTION 2024; 26:52-60. [PMID: 39121372 DOI: 10.1080/15389588.2024.2382251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 07/15/2024] [Accepted: 07/16/2024] [Indexed: 08/11/2024]
Abstract
OBJECTIVE The objective of this study was to investigate the relationship between eye-catching effects and mental workload at highway tunnel entrances. Specifically, the study aimed to analyze drivers' eye blink behavior to gain a comprehensive understanding of how visual attraction at tunnel entrances affects cognitive workload. METHODS 50 participants were recruited for the naturalistic driving experiment. Four different visually attractive driving scenarios (baseline, landscape-style architecture, tip slogan, and billboard) were selected. Eye-tracking technology was utilized to record and analyze the eye blink behavior of participating drivers. Various metrics, including blink frequency, blink duration, inter-blink interval, and pupil diameter after a blink, were measured and compared across different scenarios. RESULTS The results of the study demonstrated significant differences in drivers' eye blink behavior across the different experimental scenarios, indicating the influence of visual attraction conditions on mental workload. The presence of eye-catching stimuli (landscape-style architecture, tip slogan, and billboard scenarios) at tunnel entrances resulted in decreased blink frequency, shorter blink duration, longer inter-blink intervals, and larger pupil diameter after a blink compared to when no specific eye-catching stimuli were present (baseline condition). These findings suggest that visual attractions capture drivers' attention, leading to increased cognitive workload and attentional demands. CONCLUSIONS The findings of this study contribute to the existing literature on driver attention and mental workload, particularly in relation to eye-catching effect in tunnel environments. The presence of eye-catching stimuli at tunnel entrances can distract drivers and increase their mental workload, potentially compromising driving performance and safety. It is crucial for transportation authorities and designers to carefully consider the design and placement of visual attractions in tunnel entrances to minimize distraction and cognitive workload. By doing so, driving safety and performance can be enhanced in tunnel entrances.
Collapse
Affiliation(s)
- Lei Han
- School of Traffic and Transportation, Shijiazhuang Tiedao University, Shijiazhuang, China
| | - Zhigang Du
- School of Transportation and Logistics Engineering, Wuhan University of Technology, Wuhan, China
| |
Collapse
|
14
|
Baron‐Shahaf D, Shahaf G. Markers of too little effort or too much alertness during neuropsychological assessment: Demonstration with perioperative changes. Brain Behav 2024; 14:e3649. [PMID: 39169455 PMCID: PMC11338839 DOI: 10.1002/brb3.3649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 07/21/2024] [Accepted: 07/22/2024] [Indexed: 08/23/2024] Open
Abstract
OBJECTIVE Cognitive assessment is based on performance in different tests. However, this performance might be hindered by lack of effective effort on the one hand, and by too much stress on the other hand. Despite their known impact, there are currently no effective tools for measuring cognitive effort or stress effect during cognitive assessment. We developed real-time electrophysiological markers for cognitive effort and for stress effect, which could be used during cognitive assessment. METHODS We assessed these markers during the use of the Montreal Cognitive Assessment (MoCA) before and after cardiac surgery, which is known to involve cognitive decline in up to 30%-50% of elderly patients. RESULTS The major findings of the study, for the largest group of patients, with preoperative MoCA in the intermediate range, were that the decline is significantly associated (1) with higher preoperative cognitive effort and (2) with higher postoperative stress effect during the test. CONCLUSIONS These findings, as well as preliminary additional ones, suggest a potential importance for monitoring cognitive effort and stress effect during assessment in general, and specifically during perioperative assessment. SIGNIFICANCE Easy-to-use markers could improve the efficacy of cognitive assessment and direct treatment generally, and specifically for perioperative decline.
Collapse
Affiliation(s)
| | - Goded Shahaf
- Applied Neurophysiology LaboratoryRambam Healthcare CampusHaifaIsrael
| |
Collapse
|
15
|
Sharpe BT, Smith J. Influence of Vigilance Performance on Lifeguard Gaze Behaviour. EUROPES JOURNAL OF PSYCHOLOGY 2024; 20:220-233. [PMID: 39678921 PMCID: PMC11638701 DOI: 10.5964/ejop.12121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 02/21/2024] [Indexed: 12/17/2024]
Abstract
The present study sought to examine the gaze behaviours exhibited by lifeguards with different levels of experience while performing a task focused on detecting drowning incidents across extended periods. The results indicated a gradual decline in detection performance over time, regardless of the lifeguards' levels of experience. Analysis of the participants' gaze behaviours unveiled that this decline was associated with alterations in both the number and duration of fixations. The results indicated that lifeguards with greater experience maintained higher levels of detection performance and fixation numbers for extended durations, while exhibiting consistent fixation durations throughout the task, in contrast to their less experienced counterparts. These findings offer initial indications that lifeguards with more experience may possess an attentional advantage during tasks requiring sustained vigilance.
Collapse
Affiliation(s)
- Benjamin T. Sharpe
- Institute of Psychology, Business, and Human Sciences, University of Chichester, Chichester, United Kingdom
| | - Jenny Smith
- Institute of Applied Sciences, University of Chichester, Chichester, United Kingdom
| |
Collapse
|
16
|
Render A, Eisenbarth H, Oxner M, Jansen P. Arousal, interindividual differences and temporal binding a psychophysiological study. PSYCHOLOGICAL RESEARCH 2024; 88:1653-1677. [PMID: 38806732 PMCID: PMC11282159 DOI: 10.1007/s00426-024-01976-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 05/13/2024] [Indexed: 05/30/2024]
Abstract
The sense of agency varies as a function of arousal in negative emotional contexts. As yet, it is unknown whether the same is true for positive affect, and how inter-individual characteristics might predict these effects. Temporal binding, an implicit measure of the sense of agency, was measured in 59 participants before and after watching either an emotionally neutral film clip or a positive film clip with high or low arousal. Analyses included participants' individual differences in subjective affective ratings, physiological arousal (pupillometry, skin conductance, heart rate), striatal dopamine levels via eye blink rates, and psychopathy. Linear mixed models showed that sexual arousal decreased temporal binding whereas calm pleasure had no facilitation effect on binding. Striatal dopamine levels were positively linked whereas subjective and physiological arousal may be negatively associated with binding towards actions. Psychopathic traits reduced the effect of high arousal on binding towards actions. These results provide evidence that individual differences influence the extent to which the temporal binding is affected by high arousing states with positive valence.
Collapse
Affiliation(s)
- Anna Render
- Faculty of Human Sciences, University of Regensburg, Regensburg, Germany.
- Victoria University of Wellington, Wellington, New Zealand.
- University of Passau, Passau, Germany.
| | | | - Matt Oxner
- Victoria University of Wellington, Wellington, New Zealand
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| | - Petra Jansen
- Faculty of Human Sciences, University of Regensburg, Regensburg, Germany
| |
Collapse
|
17
|
Sanchez R, Tomei AC, Mamassian P, Vidal M, Desantis A. What the eyes, confidence, and partner's identity can tell about change of mind. Neurosci Conscious 2024; 2024:niae018. [PMID: 38720814 PMCID: PMC11077902 DOI: 10.1093/nc/niae018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 03/07/2024] [Accepted: 04/10/2024] [Indexed: 05/12/2024] Open
Abstract
Perceptual confidence reflects the ability to evaluate the evidence that supports perceptual decisions. It is thought to play a critical role in guiding decision-making. However, only a few empirical studies have actually investigated the function of perceptual confidence. To address this issue, we designed a perceptual task in which participants provided a confidence judgment on the accuracy of their perceptual decision. Then, they viewed the response of a machine or human partner, and they were instructed to decide whether to keep or change their initial response. We observed that confidence predicted participants' changes of mind more than task difficulty and perceptual accuracy. Additionally, interacting with a machine, compared to a human, decreased confidence and increased participants tendency to change their initial decision, suggesting that both confidence and changes of mind are influenced by contextual factors, such as the identity of a partner. Finally, variations in confidence judgments but not change of mind were correlated with pre-response pupil dynamics, indicating that arousal changes are linked to confidence computations. This study contributes to our understanding of the factors influencing confidence and changes of mind and also evaluates the possibility of using pupil dynamics as a proxy of confidence.
Collapse
Affiliation(s)
- Rémi Sanchez
- Département Traitement de l’Information et Systèmes, ONERA, Salon-de-Provence F-13661, France
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
| | - Anne-Catherine Tomei
- Département Traitement de l’Information et Systèmes, ONERA, Salon-de-Provence F-13661, France
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
| | - Pascal Mamassian
- Laboratoire des systèmes perceptifs, Département d’études cognitives, École normale supérieure, PSL University, CNRS, Paris F-75005, France
| | - Manuel Vidal
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
| | - Andrea Desantis
- Département Traitement de l’Information et Systèmes, ONERA, Salon-de-Provence F-13661, France
- Institut de Neurosciences de la Timone (UMR 7289), CNRS and Aix-Marseille Université, Marseille F-13005, France
- Integrative Neuroscience and Cognition Center (UMR 8002), CNRS and Université Paris Cité, Paris F-75006, France
| |
Collapse
|
18
|
Wohltjen S, Wheatley T. Interpersonal eye-tracking reveals the dynamics of interacting minds. Front Hum Neurosci 2024; 18:1356680. [PMID: 38532792 PMCID: PMC10963423 DOI: 10.3389/fnhum.2024.1356680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Accepted: 02/20/2024] [Indexed: 03/28/2024] Open
Abstract
The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.
Collapse
Affiliation(s)
- Sophie Wohltjen
- Department of Psychology, University of Wisconsin–Madison, Madison, WI, United States
| | - Thalia Wheatley
- Department of Psychological and Brain Sciences, Consortium for Interacting Minds, Dartmouth College, Hanover, NH, United States
- Santa Fe Institute, Santa Fe, NM, United States
| |
Collapse
|
19
|
Gunther KE, Fu X, MacNeill LA, Jones M, Ermanni B, Pérez-Edgar K. Now it's your turn!: Eye blink rate in a Jenga task modulated by interaction of task wait times, effortful control, and internalizing behaviors. PLoS One 2024; 19:e0294888. [PMID: 38457390 PMCID: PMC10923458 DOI: 10.1371/journal.pone.0294888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Accepted: 11/10/2023] [Indexed: 03/10/2024] Open
Abstract
Dopamine is a versatile neurotransmitter with implications in many domains, including anxiety and effortful control. Where high levels of effortful control are often regarded as adaptive, other work suggests that high levels of effortful control may be a risk factor for anxiety. Dopamine signaling may be key in understanding these relations. Eye blink rate is a non-invasive proxy metric of midbrain dopamine activity. However, much work with eye blink rate has been constrained to screen-based tasks which lack in ecological validity. We tested whether changes in eye blink rate during a naturalistic effortful control task differ as a function of parent-reported effortful control and internalizing behaviors. Children played a Jenga-like game with an experimenter, but for each trial the experimenter took an increasingly long time to take their turn. Blinks-per-second were computed during each wait period. Multilevel modeling examined the relation between duration of wait period, effortful control, and internalizing behaviors on eye blink rate. We found a significant 3-way interaction between effortful control, internalizing behaviors, and duration of the wait period. Probing this interaction revealed that for children with low reported internalizing behaviors (-1 SD) and high reported effortful control (+1 SD), eye blink rate significantly decreased as they waited longer to take their turn. These findings index task-related changes in midbrain dopamine activity in relation to naturalistic task demands, and that these changes may vary as a function of individual differences in effortful control and internalizing behaviors. We discuss possible top-down mechanisms that may underlie these differences.
Collapse
Affiliation(s)
- Kelley E. Gunther
- Department of Psychology, Yale University, New Haven, CT, United States of America
| | - Xiaoxue Fu
- Department of Psychology, The University of South Carolina, Columbia, SC, United States of America
| | - Leigha A. MacNeill
- Northwestern University Feinberg School of Medicine, Chicago, IL, United States of America
| | - Morgan Jones
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, MD, United States of America
| | - Briana Ermanni
- Department of Psychology, Virginia Tech, Blacksburg, VA, United States of America
| | - Koraly Pérez-Edgar
- Department of Psychology, The Pennsylvania State University, State College, PA, United States of America
| |
Collapse
|
20
|
Wyly S, Jinon N, Francis T, Evans H, Kao TL, Lambert S, Montgomery S, Newlove M, Mariscal H, Nguyen H, Cole H, Aispuro I, Robledo D, Tenaglia O, Weinberger N, Nguyen B, Waits H, Jorian D, Koch-Kreher L, Myrdal H, Antoniou V, Warrier M, Wunsch L, Arce I, Kirchner K, Campos E, Nguyen A, Rodriguez K, Cao L, Halmekangas A, Wilson RC. The psychophysiology of Mastermind: Characterizing response times and blinking in a high-stakes television game show. Psychophysiology 2024; 61:e14485. [PMID: 37966011 DOI: 10.1111/psyp.14485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/20/2023] [Accepted: 10/21/2023] [Indexed: 11/16/2023]
Abstract
Television game shows have proven to be a valuable resource for studying human behavior under conditions of high stress and high stakes. However, previous work has focused mostly on choices-ignoring much of the rich visual information that is available on screen. Here, we take a first step to extracting more of this information by investigating the response times and blinking of contestants in the BBC show Mastermind. In Mastermind, contestants answer rapid-fire quiz questions while a camera slowly zooms in on their faces. By labeling contestants' behavior and blinks from 25 episodes, we asked how accuracy, response times, and blinking varied over the course of the game. For accuracy and response times, we tested whether contestants responded more accurately and more slowly after an error-exhibiting the "post-error increase in accuracy" and "post-error slowing" which has been repeatedly observed in the lab. For blinking, we tested whether blink rates varied according to the cognitive demands of the game-decreasing during periods of cognitive load, such as when pondering a response, and increasing at event boundaries in the task, such as the start of a question. In contrast to the lab, evidence for post-error changes in accuracy and response time was weak, with only marginal effects observed. In line with the lab, blinking varied over the course of the game much as we predicted. Overall, our findings demonstrate the potential of extracting dynamic signals from game shows to study the psychophysiology of behavior in the real world.
Collapse
Affiliation(s)
- Skyler Wyly
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Neryanne Jinon
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Timothy Francis
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Evans
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Tsai Lieh Kao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shelby Lambert
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Shayne Montgomery
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Marvelene Newlove
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Haley Mariscal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Henry Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Harrison Cole
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Israel Aispuro
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daniela Robledo
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Olivia Tenaglia
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Nina Weinberger
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Bill Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hailey Waits
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Daisy Jorian
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Lucas Koch-Kreher
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Hunter Myrdal
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Victoria Antoniou
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Meghana Warrier
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Leah Wunsch
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Iram Arce
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Kayla Kirchner
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Elena Campos
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - An Nguyen
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | | | - Lanqin Cao
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Avery Halmekangas
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
| | - Robert C Wilson
- Department of Psychology, University of Arizona, Tucson, Arizona, USA
- McKnight Brain Research Foundation, University of Arizona, Tucson, Arizona, USA
- Cognitive Science Program, University of Arizona, Tucson, Arizona, USA
| |
Collapse
|
21
|
Pitigoi IC, Coe BC, Calancie OG, Brien DC, Yep R, Riek HC, Kirkpatrick RH, Noyes BK, White BJ, Blohm G, Munoz DP. Attentional modulation of eye blinking is altered by sex, age, and task structure. eNeuro 2024; 11:ENEURO.0296-23.2024. [PMID: 38331578 PMCID: PMC10915461 DOI: 10.1523/eneuro.0296-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 01/15/2024] [Accepted: 02/05/2024] [Indexed: 02/10/2024] Open
Abstract
Spontaneous eye blinking is gaining popularity as a proxy for higher cognitive functions, as it is readily modulated by both environmental demands and internal processes. Prior studies were impoverished in sample size, sex representation and age distribution, making it difficult to establish a complete picture of the behavior. Here we present eye-tracking data from a large cohort of normative participants (n=604, 393 F, aged 5-93 years) performing two tasks: one with structured, discrete trials (interleaved pro/anti-saccade task; IPAST) and one with a less structured, continuous organization in which participants watch movies (free-viewing; FV). Sex- and age-based analyses revealed that females had higher blink rates between the ages of 22 and 58 years in the IPAST, and 22 and 34 years in FV. We derived a continuous measure of blink probability to reveal behavioral changes driven by stimulus appearance in both paradigms. In the IPAST, blinks were suppressed near stimulus appearance, particularly on correct anti-saccade trials, which we attribute to the stronger inhibitory control required for anti-saccades compared to pro-saccades. In FV, blink suppression occurred immediately after scene changes, and the effect was sustained on scenes where gaze clustered among participants (indicating engagement of attention). Females were more likely than males to blink during appearance of novel stimuli in both tasks, but only within the age bin of 18-44 years. The consistency of blink patterns in each paradigm endorses blinking as a sensitive index for changes in visual processing and attention, while sex and age differences drive interindividual variability.Significance Statement Eye-tracking is becoming useful as a non-invasive tool for detecting preclinical markers of neurological and psychiatric disease. Blinks are understudied despite being an important supplement to saccade and pupil eye-tracking metrics. The present study is a crucial step in developing a healthy baseline for blink behavior to compare to clinical groups. While many prior blink studies suffered from small sample sizes with relatively low age- and sex-diversity (review by Jongkees & Colzato, 2016), our large cohort of healthy participants has permitted a more detailed analysis of sex and age effects in blink behavior. Furthermore, our analysis techniques are robust to temporal changes in blink probability, greatly clarifying the relationship between blinking, visual processing, and inhibitory control mechanisms on visual tasks.
Collapse
Affiliation(s)
- Isabell C Pitigoi
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Olivia G Calancie
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Rachel Yep
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Ryan H Kirkpatrick
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Blake K Noyes
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Brian J White
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Gunnar Blohm
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| |
Collapse
|
22
|
Partridge GJW, Taib AG, Phillips P, James JJ, Satchithananda K, Sharma N, Morel J, McAvinchey R, Valencia A, Teh W, Khan H, Muscat E, Michell MJ, Chen Y. Take a break: should breaks be enforced during digital breast tomosynthesis reading sessions? Eur Radiol 2024; 34:1388-1398. [PMID: 37589906 PMCID: PMC10853356 DOI: 10.1007/s00330-023-10086-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/24/2023] [Accepted: 06/26/2023] [Indexed: 08/18/2023]
Abstract
OBJECTIVES Digital breast tomosynthesis (DBT) can improve diagnostic accuracy compared to 2D mammography, but DBT reporting is time-consuming and potentially more fatiguing. Changes in diagnostic accuracy and subjective and objective fatigue were evaluated over a DBT reporting session, and the impact of taking a reporting break was assessed. MATERIALS AND METHODS Forty-five National Health Service (NHS) mammography readers from 6 hospitals read a cancer-enriched set of 40 DBT cases whilst eye tracked in this prospective cohort study, from December 2020 to April 2022. Eye-blink metrics were assessed as objective fatigue measures. Twenty-one readers had a reporting break, 24 did not. Subjective fatigue questionnaires were completed before and after the session. Diagnostic accuracy and subjective and objective fatigue measures were compared between the cohorts using parametric and non-parametric significance testing. RESULTS Readers had on average 10 years post-training breast screening experience and took just under 2 h (105.8 min) to report all cases. Readers without a break reported greater levels of subjective fatigue (44% vs. 33%, p = 0.04), which related to greater objective fatigue: an increased average blink duration (296 ms vs. 286 ms, p < 0.001) and a reduced eye-opening velocity (76 mm/s vs. 82 mm/s, p < 0.001). Objective fatigue increased as the trial progressed for the no break cohort only (ps < 0.001). No difference was identified in diagnostic accuracy between the groups (accuracy: 87% vs. 87%, p = 0.92). CONCLUSIONS Implementing a break during a 2-h DBT reporting session resulted in lower levels of subjective and objective fatigue. Breaks did not impact diagnostic accuracy, which may be related to the extensive experience of the readers. CLINICAL RELEVANCE STATEMENT DBT is being incorporated into many mammography screening programmes. Recognising that reporting breaks are required when reading large volumes of DBT studies ensures this can be factored in when setting up reading sessions. TRIAL REGISTRATION Clinical trials registration number: NCT03733106 KEY POINTS: • Use of digital breast tomosynthesis (DBT) in breast screening programmes can cause significant reader fatigue. • The effectiveness of incorporating reading breaks into DBT reporting sessions, to reduce mammography reader fatigue, was investigated using eye tracking. • Integrating breaks into DBT reporting sessions reduced reader fatigue; however, diagnostic accuracy was unaffected.
Collapse
Affiliation(s)
- George John William Partridge
- Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK
| | - Adnan Gani Taib
- Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK
| | - Peter Phillips
- Health and Medical Sciences Group, University of Cumbria, Lancaster, UK
| | - Jonathan Jeffrey James
- Nottingham University Hospitals NHS Trust, Nottingham Breast Institute, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK
| | - Keshthra Satchithananda
- Department of Breast Radiology and National Breast Screening Training Centre, King's College Hospital, Denmark Hill, London, SE5 9RS, UK
| | - Nisha Sharma
- Leeds Breast Screening Unit, Leeds Teaching Hospital, York Road, Leeds, LS14 6UH, UK
| | - Juliet Morel
- Department of Breast Radiology and National Breast Screening Training Centre, King's College Hospital, Denmark Hill, London, SE5 9RS, UK
| | - Rita McAvinchey
- Jarvis Breast Screening Centre, Guildford, Surrey, GU1 1LJ, UK
| | - Alexandra Valencia
- Avon Breast Screening, Bristol Breast Care Centre, Bristol, BS10 5NB, UK
| | - William Teh
- North London Breast Screening Service, Edgware Community Hospital, London, HA8 9BA, UK
| | - Humaira Khan
- City, Sandwell and Walsall Breast Screening Service, Birmingham City Hospital, B18 7QH, Birmingham, UK
| | - Elizabeth Muscat
- South West London Breast Screening Service, St George's Hospital, London, SW17 0QT, UK
| | - Michael James Michell
- Department of Breast Radiology and National Breast Screening Training Centre, King's College Hospital, Denmark Hill, London, SE5 9RS, UK
| | - Yan Chen
- Translational Medical Sciences, School of Medicine, University of Nottingham, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, NG5 1PB, UK.
| |
Collapse
|
23
|
Hershman R, Share DL, Weiss EM, Henik A, Shechter A. Insights from Eye Blinks into the Cognitive Processes Involved in Visual Word Recognition. J Cogn 2024; 7:14. [PMID: 38250559 PMCID: PMC10798168 DOI: 10.5334/joc.343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Accepted: 12/26/2023] [Indexed: 01/23/2024] Open
Abstract
Behavioral differences in speed and accuracy between reading familiar and unfamiliar words are well-established in the empirical literature. However, these standard measures of skill proficiency are limited in their ability to capture the moment-to-moment processing involved in visual word recognition. In the present study, the effect of word familiarity was initially investigated using an eye blink rate among adults and children. The probability of eye blinking was higher for familiar (real) words than for unfamiliar (pseudo)words. This counterintuitive pattern of results suggests that the processing of unfamiliar (pseudo)words is more demanding and perhaps less rewarding than the processing of familiar (real) words, as previously observed in both behavioral and pupillometry data. Our findings suggest that the measurement of eye blinks might shed new light on the cognitive processes involved in visual word recognition and other domains of human cognition.
Collapse
Affiliation(s)
- Ronen Hershman
- Department of Psychology, University of Innsbruck, Innsbruck, Austria
| | - David L. Share
- Department of Learning Disabilities, Faculty of Education, University of Haifa, Haifa, Israel
- Edmond J. Safra Brain Research Center for the Study of Learning Disabilities, University of Haifa, Haifa, Israel
| | | | - Avishai Henik
- Department of Psychology and The Zelman Center for Brain Science, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Adi Shechter
- Department of Learning Disabilities, Faculty of Education, University of Haifa, Haifa, Israel
- Edmond J. Safra Brain Research Center for the Study of Learning Disabilities, University of Haifa, Haifa, Israel
| |
Collapse
|
24
|
Magliacano A, Catalano L, Sagliano L, Estraneo A, Trojano L. Spontaneous eye blinking during an auditory, an interoceptive and a visual task: The role of the sensory modality and the attentional focus. Cortex 2023; 168:49-61. [PMID: 37659289 DOI: 10.1016/j.cortex.2023.07.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/15/2023] [Accepted: 07/31/2023] [Indexed: 09/04/2023]
Abstract
Previous evidence suggested that spontaneous eye blinking changes as a function of the attentional focus. In particular, eye blink rate (EBR) tends to increase when attention is directed to internal versus environmental processing. Most studies on this issue compared eye blinking during visual and mental imagery tasks, and interpreted the increase in EBR as a mechanism to focus cognitive resources on internal processing by disengaging attention from interfering information. However, since eye blinking also depends on the sensory modality of the task, the findings might be influenced by a modality-specific effect. In the present Registered Report we aim at investigating whether the environmental versus internal attentional focus can affect spontaneous blinking behaviour in non-visual tasks as well, in conditions where visual stimuli are not relevant. In a within-subject design, healthy participants performed an interoceptive task (i.e., heartbeat counting) and an auditory task in which pre-recorded heartbeats were presented aurally; during both tasks irrelevant visual stimuli were also presented. In a further control condition with the same auditory and visual stimuli, the participants were required to focus their attention on visual stimuli. Participants' EBR was recorded during each task by means of an eye-tracking system. We found that, although the interoceptive task was more difficult than the auditory and visual tasks, participants' EBR decreased by a comparable level in all tasks with respect to a rest condition, with no differences between internal versus environmental conditions. The present findings do not support the idea that EBR is modulated by an internal versus external focus of attention, at least in presence of controlled visual stimulation.
Collapse
Affiliation(s)
| | - Laura Catalano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Laura Sagliano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | | | - Luigi Trojano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy.
| |
Collapse
|
25
|
Caputo GB. Strange-face-in-the-mirror illusions: specific effects on derealization, depersonalization, and dissociative identity. J Trauma Dissociation 2023; 24:575-608. [PMID: 37006162 DOI: 10.1080/15299732.2023.2195394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 01/03/2023] [Indexed: 04/04/2023]
Abstract
Anomalous strange-face illusions (SFIs) are produced when mirror gazing under a low level of face illumination. In contrast to past studies in which an observer's task was to pay attention to the reflected face and to perceive potential facial changes, the present research used a mirror gazing task (MGT) that instructed participants to fixate their gaze on a 4-mm hole in a glass mirror. The participants' eye-blink rates were thus measured without priming any facial changes. Twenty-one healthy young individuals participated in the MGT and a control panel-fixation task (staring at a hole in a gray non-reflective panel). The Revised Strange-Face Questionnaire (SFQ-R) indexed derealization (deformations of facial features; FD), depersonalization (bodily face detachment; BD), and dissociative identity (new or unknown identities; DI) scales. Mirror-fixation increased FD, BD, and DI scores compared to panel-fixation. In mirror-fixation, FD scores revealed fading specific to facial features, distinct from "classical" Troxler- and Brewster-fading. In mirror-fixation, eye-blink rates correlated negatively with FD scores. Panel-fixation produced low BD scores, and, in a few participants, face pareidolias as detected on FD scores. Females were more prone to early derealization and males to compartmentalization of a dissociative identity. SFQ-R may be a valuable instrument for measuring face-specific dissociation (FD, BD, DI) produced by MGT. Use of MGT and panel-fixation task for differential diagnoses between schizophrenia and dissociative identity disorder is discussed.
Collapse
Affiliation(s)
- Giovanni B Caputo
- Department of Humanistic Studies (DISTUM), University of Urbino, Urbino, Italy
| |
Collapse
|
26
|
Yule S, Robertson JM, Mormann B, Smink DS, Lipsitz S, Abahuje E, Kennedy-Metz L, Park S, Miccile C, Pozner CN, Doyle T, Musson D, Dias RD. Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions. HUMAN FACTORS 2023; 65:1221-1234. [PMID: 35430922 PMCID: PMC10466940 DOI: 10.1177/00187208211067575] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Accepted: 11/16/2021] [Indexed: 06/14/2023]
Abstract
OBJECTIVE Our primary aim was to investigate crew performance during medical emergencies with and without ground-support from a flight surgeon located at mission control. BACKGROUND There are gaps in knowledge regarding the potential for unanticipated in-flight medical events to affect crew health and capacity, and potentially compromise mission success. Additionally, ground support may be impaired or periodically absent during long duration missions. METHOD We reviewed video recordings of 16 three-person flight crews each managing four unique medical events in a fully immersive spacecraft simulator. Crews were randomized to two conditions: with and without telemedical flight surgeon (FS) support. We assessed differences in technical performance, behavioral skills, and cognitive load between groups. RESULTS Crews with FS support performed better clinically, were rated higher on technical skills, and completed more clinical tasks from the medical checklists than crews without FS support. Crews with FS support also had better behavioral/non-technical skills (information exchange) and reported significantly lower cognitive demand during the medical event scenarios on the NASA-TLX scale, particularly in mental demand and temporal demand. There was no significant difference between groups in time to treat or in objective measures of cognitive demand derived from heart rate variability and electroencephalography. CONCLUSION Medical checklists are necessary but not sufficient to support high levels of autonomous crew performance in the absence of real-time flight surgeon support. APPLICATION Potential applications of this research include developing ground-based and in-flight training countermeasures; informing policy regarding autonomous spaceflight, and design of autonomous clinical decision support systems.
Collapse
Affiliation(s)
- Steven Yule
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Center for Surgery & Public Health, Brigham & Women's Hospital, Boston, MA, USA; Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA; Department of Clinical Surgery, The University of Edinburgh, Edinburgh, UK
| | - Jamie M Robertson
- Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA
| | - Benjamin Mormann
- Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA
| | - Douglas S Smink
- Center for Surgery & Public Health, Brigham & Women's Hospital, Boston, MA, USA; Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA
| | - Stuart Lipsitz
- Center for Surgery & Public Health, Brigham & Women's Hospital, Boston, MA, USA
| | - Egide Abahuje
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Lauren Kennedy-Metz
- Department of Surgery, Brigham & Women's Hospital/ Harvard Medical School, Boston, MA, USA; Medical Robotics and Computer Assisted Surgery Laboratory, Division of Cardiac Surgery, U.S. Veterans Affairs Boston Healthcare System, Boston, MA, USA
| | - Sandra Park
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA
| | - Christian Miccile
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA
| | - Charles N Pozner
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA
| | - Thomas Doyle
- Department of Electrical and Computer Engineering, McMaster University, Hamilton, ON, Canada
| | - David Musson
- Faculty of Health Science, Northern Ontario School of Medicine, Thunder Bay, ON, Canada
| | - Roger D Dias
- STRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, MA, USA; Department of Emergency Medicine, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
27
|
Nishizono R, Saijo N, Kashino M. Highly reproducible eyeblink timing during formula car driving. iScience 2023; 26:106803. [PMID: 37378324 PMCID: PMC10291330 DOI: 10.1016/j.isci.2023.106803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 02/01/2023] [Accepted: 04/28/2023] [Indexed: 06/29/2023] Open
Abstract
How do humans blink while driving a vehicle? Although gaze control patterns have been previously reported in relation to successful steering, eyeblinks that disrupt vision are believed to be randomly distributed during driving or are ignored. Herein, we demonstrate that eyeblink timing shows reproducible patterns during real formula car racing driving and is related to car control. We studied three top-level racing drivers. Their eyeblinks and driving behavior were acquired during practice sessions. The results revealed that the drivers blinked at surprisingly similar positions on the courses. We identified three factors underlying the eyeblink patterns: the driver's individual blink count, lap pace associated with how strictly they followed their pattern on each lap, and car acceleration associated with when/where to blink at a moment. These findings suggest that the eyeblink pattern reflected cognitive states during in-the-wild driving and experts appear to change such cognitive states continuously and dynamically.
Collapse
Affiliation(s)
- Ryota Nishizono
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| | - Naoki Saijo
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
28
|
López-Ahumada R, Jiménez-Naharro R, Gómez-Bravo F. A Hardware-Based Configurable Algorithm for Eye Blink Signal Detection Using a Single-Channel BCI Headset. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115339. [PMID: 37300066 DOI: 10.3390/s23115339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 04/20/2023] [Accepted: 05/29/2023] [Indexed: 06/12/2023]
Abstract
Eye blink artifacts in electroencephalographic (EEG) signals have been used in multiple applications as an effective method for human-computer interaction. Hence, an effective and low-cost blinking detection method would be an invaluable aid for the development of this technology. A configurable hardware algorithm, described using hardware description language, for eye blink detection based on EEG signals from a one-channel brain-computer interface (BCI) headset was developed and implemented, showing better performance in terms of effectiveness and detection time than manufacturer-provided software.
Collapse
Affiliation(s)
- Rafael López-Ahumada
- Departamento de Ingeniería Electrónica Sistemas Informáticos y Automática, Universidad de Huelva, 21007 Huelva, Spain
| | - Raúl Jiménez-Naharro
- Departamento de Ingeniería Electrónica Sistemas Informáticos y Automática, Universidad de Huelva, 21007 Huelva, Spain
| | - Fernando Gómez-Bravo
- Centro Científico Tecnológico de Huelva (CCTH), University of Huelva, 21007 Huelva, Spain
| |
Collapse
|
29
|
Yu C, Ishibashi K, Iwanaga K. Effects of fearful face presentation time and observer's eye movement on the gaze cue effect. J Physiol Anthropol 2023; 42:8. [PMID: 37248516 DOI: 10.1186/s40101-023-00325-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Accepted: 05/12/2023] [Indexed: 05/31/2023] Open
Abstract
BACKGROUND There are many conflicting findings on the gaze cueing effect (GCE) of emotional facial expressions. This study aimed to investigate whether an averted gaze, accompanied by a fearful expression of different durations, could enhance attentional orientation, as measured by a participant's eye movements. METHODS Twelve participants (3 females) completed the gaze cue task, reacting to a target location after observing changes in the gaze and expression of a face illustrated on a computer screen. Meanwhile, participants' eye movements were monitored by electrooculography. The GCE was calculated by reaction time as an indicator of attention shift. RESULTS The analysis of the overall data did not find a significant effect of fearful facial expressions on the GCE. However, analysis of trial data that excluded a participant's eye movement data showed that brief (0, 100 ms) presentation of the fearful facial expression enhanced the GCE compared to that during a neutral facial expression, although when the presentation time of the fearful expression was increased to 200 or 400 ms, the GCE of the fearful expression was at the same level as when model showed a neutral expression. CONCLUSIONS The results suggest that the attention-enhancing effect of gaze cues induced by rapidly presented fearful expressions occurs only when the effect of eye movement trials is excluded. This effect may be mediated by reflexively neural circuits in the amygdala that process threatening stimuli. However, as the expression duration increased, the fearful expression's attention-enhancing effect decreased. We suggest that future studies on the emotion modulation of GCE should consider the negative effects of participants' saccades and blinks on the experimental results.
Collapse
Affiliation(s)
- Chuntai Yu
- Graduate School of Science and Engineering, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, 263-8522, Japan
| | - Keita Ishibashi
- Design Research Institute, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, 263-8522, Japan
| | - Koichi Iwanaga
- Design Research Institute, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, 263-8522, Japan.
| |
Collapse
|
30
|
Huber SE, Martini M, Sachse P. Task-synchronized eye blink modulation neither requires visual stimulation nor active motor response and is modulated by task predictability. Int J Psychophysiol 2023; 187:1-10. [PMID: 36773888 DOI: 10.1016/j.ijpsycho.2023.01.011] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 01/31/2023] [Accepted: 01/31/2023] [Indexed: 02/12/2023]
Abstract
It has been repeatedly shown that temporal task features are reflected in eye blink dynamics during attention tasks. Eye blinks occur with increased likeliness particularly when demands on external attention allocation are low. Both predictive, top-down and reactive, bottom-up processes were shown to be involved in blink regulation. However, whether temporal stimulus prediction is a generally active component of the attention system or rather specific to the visual domain has not been fully elaborated yet. By monitoring eye blinking of 99 students during an auditory attention task and analyzing particularly the dynamics of eye blink onsets relative to stimuli timings, we show here that prediction does, in principle, not require visual stimulation, and is also not merely a consequence of the involvement of manual responses during the task. We further show that both the inclusion of manual response to stimuli and elevated task predictability enhance the prediction component reflected in eye blink dynamics, whereas for the latter we experimentally manipulate objective task predictability by adjusting the frequency dependence of the power spectral densities of the series of inter-stimulus time intervals. This allows us finally to explain why, for specific choices of experimental conditions, the generally active and present prediction component involved in attention can become difficult to detect in non-visual, auditory tasks. Conversely, this comes with the important implication that, if tasks aim for elaborating particularly temporal prediction, distributing stimuli over time such that inter-stimulus-intervals conform to a sample of Gaussian noise represents a specifically unfavorable choice.
Collapse
Affiliation(s)
- Stefan E Huber
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria; Institute of Psychology, University of Graz, Universitätsplatz 2, A-8010 Graz, Austria.
| | - Markus Martini
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria
| | - Pierre Sachse
- Department of Psychology, University of Innsbruck, Universitätsstraße 5-7, A-6020 Innsbruck, Austria
| |
Collapse
|
31
|
Castner SA, Zhang L, Yang CR, Hao J, Cramer JW, Wang X, Bruns RF, Marston H, Svensson KA, Williams GV. Effects of DPTQ, a novel positive allosteric modulator of the dopamine D1 receptor, on spontaneous eye blink rate and spatial working memory in the nonhuman primate. Psychopharmacology (Berl) 2023; 240:1033-1048. [PMID: 36961560 PMCID: PMC10102062 DOI: 10.1007/s00213-022-06282-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Accepted: 11/23/2022] [Indexed: 03/25/2023]
Abstract
RATIONALE Dopamine (DA) signaling through the D1 receptor has been shown to be integral to multiple aspects of cognition, including the core process of working memory. The discovery of positive allosteric modulators (PAMs) of the D1 receptor has enabled treatment modalities that may have alternative benefits to orthosteric D1 agonists arising from a synergism of action with functional D1 receptor signaling. OBJECTIVES To investigate this potential, we have studied the effects of the novel D1 PAM DPTQ on a spatial delayed response working memory task in the rhesus monkey. Initial studies indicated that DPTQ binds to primate D1R with high affinity and selectivity and elevates spontaneous eye blink rate in rhesus monkeys in a dose-dependent manner consistent with plasma ligand exposures and central D1activation. RESULTS Based on those results, DPTQ was tested at 2.5 mg/kg IM in the working memory task. No acute effect was observed 1 h after dosing, but performance was impaired 48 h later. Remarkably, this deficit was immediately followed by a significant enhancement in cognition over the next 3 days. In a second experiment in which DPTQ was administered on days 1 and 5, the early impairment was smaller and did not reach statistical significance, but statistically significant enhancement of performance was observed over the following week. Lower doses of 0.1 and 1.0 mg/kg were also capable of producing this protracted enhancement without inducing any transient impairment. CONCLUSIONS DPTQ exemplifies a class of D1PAMs that may be capable of providing long-term improvements in working memory.
Collapse
Affiliation(s)
- Stacy A Castner
- Department of Comparative Medicine, Yale University, 310 Cedar St, New Haven, CT, 06520, USA
| | - Linli Zhang
- ChemPartner, 99 Lian He North Road, Zhe Lin Town, Fengxian Area, Shanghai, China
| | - Charles R Yang
- ChemPartner, 99 Lian He North Road, Zhe Lin Town, Fengxian Area, Shanghai, China
| | - Junliang Hao
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Jeffrey W Cramer
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Xushan Wang
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Robert F Bruns
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | | | - Kjell A Svensson
- Eli Lilly & Co, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Graham V Williams
- Department of Comparative Medicine, Yale University, 310 Cedar St, New Haven, CT, 06520, USA.
| |
Collapse
|
32
|
Chen Y, Sudin ES, Partridge GJW, Taib AG, Darker IT, Phillips P, James JJ, Satchithananda K, Sharma N, Michell MJ. Measuring reader fatigue in the interpretation of screening digital breast tomosynthesis (DBT). Br J Radiol 2023; 96:20220629. [PMID: 36633316 PMCID: PMC9975365 DOI: 10.1259/bjr.20220629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 11/01/2022] [Accepted: 11/06/2022] [Indexed: 01/13/2023] Open
Abstract
OBJECTIVES The interpretation of digital breast tomosynthesis (DBT) screening examinations is a complex task for an already overstretched workforce which has the potential to increase pressure on readers leading to fatigue and patient safety issues. Studies in non-medical and medical settings have suggested that changes in blink characteristics can reflect fatigue. The purpose of this study is to investigate the use of blink characteristics as an objective marker of fatigue in readers interpreting DBT breast screening examinations. METHODS Twenty-six DBT readers involved in the UK PROSPECTS trial interpreted a test set of 40 DBT cases while being observed by an eye tracking device from November 2019 to February 2021. Raw data from the eye tracker were collected and automated processing software was used to produce eye blinking characteristics data which were analysed using multiple linear regression statistical models. RESULTS Of the 26 DBT readers recruited, eye tracking data from 23 participants were analysed due to missing data rendering 3 participants' data uninterpretable. The mean reading time per DBT case was 2.81 min. There was a statistically significant increase in blinking duration of 0.38 ms/case as the reading session progressed (p < 0.0001). This was the result of a significant decrease in the number of ultra-short blinks lasting ≤50 ms (p = 0.0005) and a significant increase in longer blinks lasting 51-100 ms (p = 0.008). CONCLUSION Changes in blinking characteristics could serve as objective measures of reader fatigue and may prove useful in the development of DBT reading protocols. ADVANCES IN KNOWLEDGE Blink characteristics can be used as an objective measure of fatigue; however there is limited evidence of their use in radiological settings. Our study suggests that changes in blink duration and frequency could be used to monitor fatigue in DBT reading sessions.
Collapse
Affiliation(s)
- Yan Chen
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Ellhia S Sudin
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - George JW Partridge
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Adnan G Taib
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Iain T Darker
- University of Nottingham, School of Medicine, Translational Medical Sciences, Clinical Sciences Building, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Peter Phillips
- Health and Medical Sciences Group, University of Cumbria, Lancaster, United Kingdom
| | - Jonathan J James
- Nottingham University Hospitals NHS Trust, Nottingham Breast Institute, City Hospital Campus, Hucknall Road, Nottingham, United Kingdom
| | - Keshthra Satchithananda
- Department of Breast Radiology, National Breast Screening Training Centre, King’s College Hospital, Denmark Hill, London, United Kingdom
| | - Nisha Sharma
- Leeds Breast Screening Unit, Leeds Teaching Hospital, York Road, Leeds, United Kingdom
| | - Michael J Michell
- Department of Breast Radiology, National Breast Screening Training Centre, King’s College Hospital, Denmark Hill, London, United Kingdom
| |
Collapse
|
33
|
Aminosharieh Najafi T, Affanni A, Rinaldo R, Zontone P. Driver Attention Assessment Using Physiological Measures from EEG, ECG, and EDA Signals. SENSORS (BASEL, SWITZERLAND) 2023; 23:2039. [PMID: 36850637 PMCID: PMC9961536 DOI: 10.3390/s23042039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 02/03/2023] [Accepted: 02/07/2023] [Indexed: 06/18/2023]
Abstract
In this paper, we consider the evaluation of the mental attention state of individuals driving in a simulated environment. We tested a pool of subjects while driving on a highway and trying to overcome various obstacles placed along the course in both manual and autonomous driving scenarios. Most systems described in the literature use cameras to evaluate features such as blink rate and gaze direction. In this study, we instead analyse the subjects' Electrodermal activity (EDA) Skin Potential Response (SPR), their Electrocardiogram (ECG), and their Electroencephalogram (EEG). From these signals we extract a number of physiological measures, including eye blink rate and beta frequency band power from EEG, heart rate from ECG, and SPR features, then investigate their capability to assess the mental state and engagement level of the test subjects. In particular, and as confirmed by statistical tests, the signals reveal that in the manual scenario the subjects experienced a more challenged mental state and paid higher attention to driving tasks compared to the autonomous scenario. A different experiment in which subjects drove in three different setups, i.e., a manual driving scenario and two autonomous driving scenarios characterized by different vehicle settings, confirmed that manual driving is more mentally demanding than autonomous driving. Therefore, we can conclude that the proposed approach is an appropriate way to monitor driver attention.
Collapse
|
34
|
Evaluation of eye movement patterns during reading of mixed dentition panoramic radiographs in dental students. PEDIATRIC DENTAL JOURNAL 2023. [DOI: 10.1016/j.pdj.2023.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|
35
|
Pinggal E, Dockree PM, O'Connell RG, Bellgrove MA, Andrillon T. Pharmacological Manipulations of Physiological Arousal and Sleep-Like Slow Waves Modulate Sustained Attention. J Neurosci 2022; 42:8113-8124. [PMID: 36109167 PMCID: PMC9637000 DOI: 10.1523/jneurosci.0836-22.2022] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 08/25/2022] [Accepted: 08/29/2022] [Indexed: 11/21/2022] Open
Abstract
Sustained attention describes our ability to keep a constant focus on a given task. This ability is modulated by our physiological state of arousal. Although lapses of sustained attention have been linked with dysregulations of arousal, the underlying physiological mechanisms remain unclear. An emerging body of work proposes that the intrusion during wakefulness of sleep-like slow waves, a marker of the transition toward sleep, could mechanistically account for attentional lapses. This study aimed to expose, via pharmacological manipulations of the monoamine system, the relationship between the occurrence of sleep-like slow waves and the behavioral consequences of sustained attention failures. In a double-blind, randomized-control trial, 32 healthy human male participants received methylphenidate, atomoxetine, citalopram or placebo during four separate experimental sessions. During each session, electroencephalography (EEG) was used to measure neural activity while participants completed a visual task requiring sustained attention. Methylphenidate, which increases wake-promoting dopamine and noradrenaline across cortical and subcortical areas, improved behavioral performance whereas atomoxetine, which increases dopamine and noradrenaline predominantly over frontal cortices, led to more impulsive responses. Additionally, citalopram, which increases sleep-promoting serotonin, led to more missed trials. Based on EEG recording, citalopram was also associated with an increase in sleep-like slow waves. Importantly, compared with a classical marker of arousal such as α power, only slow waves differentially predicted both misses and faster responses in a region-specific fashion. These results suggest that a decrease in arousal can lead to local sleep intrusions during wakefulness which could be mechanistically linked to impulsivity and sluggishness.SIGNIFICANCE STATEMENT We investigated whether the modulation of attention and arousal could not only share the same neuromodulatory pathways but also rely on similar neuronal mechanisms; for example, the intrusion of sleep-like activity within wakefulness. To do so, we pharmacologically manipulated noradrenaline, dopamine, and serotonin in a four-arm, randomized, placebo-controlled trial and examined the consequences on behavioral and electroencephalography (EEG) indices of attention and arousal. We showed that sleep-like slow waves can predict opposite behavioral signatures: impulsivity and sluggishness. Slow waves may be a candidate mechanism for the occurrence of attentional lapses since the relationship between slow-wave occurrence and performance is region-specific and the consequences of these local sleep intrusions are in line with the cognitive functions carried by the underlying brain regions.
Collapse
Affiliation(s)
- Elaine Pinggal
- School of Psychological Sciences, Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria 3168, Australia
| | - Paul M Dockree
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin D02 PN40, Ireland
| | - Redmond G O'Connell
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin D02 PN40, Ireland
| | - Mark A Bellgrove
- School of Psychological Sciences, Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria 3168, Australia
| | - Thomas Andrillon
- School of Philosophical, Historical, and International Studies, Centre for Consciousness and Contemplative Studies, Monash University, Melbourne, Victoria 3168, Australia
- Paris Brain Institute, Sorbonne Université, Institut National de la Santé et de la Recherche Médicale-Centre National de la Recherche Scientifique, Paris 75013, France
| |
Collapse
|
36
|
Avirame K, Gshur N, Komemi R, Lipskaya-Velikovsky L. A multimodal approach for the ecological investigation of sustained attention: A pilot study. Front Hum Neurosci 2022; 16:971314. [PMID: 36248697 PMCID: PMC9556703 DOI: 10.3389/fnhum.2022.971314] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/05/2022] [Indexed: 11/13/2022] Open
Abstract
Natural fluctuations in sustained attention can lead to attentional failures in everyday tasks and even dangerous incidences. These fluctuations depend on personal factors, as well as task characteristics. So far, our understanding of sustained attention is partly due to the common usage of laboratory setups and tasks, and the complex interplay between behavior and brain activity. The focus of the current study was thus to test the feasibility of applying a single-channel wireless EEG to monitor patterns of sustained attention during a set of ecological tasks. An EEG marker of attention (BEI—Brain Engagement Index) was continuously recorded from 42 healthy volunteers during auditory and visual tasks from the Test of Everyday Attention (TEA) and Trail Making Test (TMT). We found a descending pattern of both performance and BEI in the auditory tasks as task complexity increases, while the increase in performance and decrease in BEI on the visual task. In addition, patterns of BEI in the complex tasks were used to detect outliers and the optimal range of attention through exploratory models. The current study supports the feasibility of combined electrophysiological and neurocognitive investigation of sustained attention in ecological tasks yielding unique insights on patterns of sustained attention as a function of task modality and task complexity.
Collapse
Affiliation(s)
- Keren Avirame
- Psychiatric Division, Sourasky Medical Center, Tel Aviv-Yafo, Israel
| | - Noga Gshur
- Independent Researcher, Tel Aviv-Yafo, Israel
| | - Reut Komemi
- School of Occupational Therapy, Faculty of Medicine, Hebrew University, Jerusalem, Israel
| | - Lena Lipskaya-Velikovsky
- School of Occupational Therapy, Faculty of Medicine, Hebrew University, Jerusalem, Israel
- *Correspondence: Lena Lipskaya-Velikovsky,
| |
Collapse
|
37
|
Lee P, Kim H, Kim Y, Choi W, Zitouni MS, Khandoker A, Jelinek HF, Hadjileontiadis L, Lee U, Jeong Y. Beyond Pathogen Filtration: Possibility of Smart Masks as Wearable Devices for Personal and Group Health and Safety Management. JMIR Mhealth Uhealth 2022; 10:e38614. [PMID: 35679029 PMCID: PMC9217147 DOI: 10.2196/38614] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 05/20/2022] [Accepted: 06/08/2022] [Indexed: 12/15/2022] Open
Abstract
Face masks are an important way to combat the COVID-19 pandemic. However, the prolonged pandemic has revealed confounding problems with the current face masks, including not only the spread of the disease but also concurrent psychological, social, and economic complications. As face masks have been worn for a long time, people have been interested in expanding the purpose of masks from protection to comfort and health, leading to the release of various "smart" mask products around the world. To envision how the smart masks will be extended, this paper reviewed 25 smart masks (12 from commercial products and 13 from academic prototypes) that emerged after the pandemic. While most smart masks presented in the market focus on resolving problems with user breathing discomfort, which arise from prolonged use, academic prototypes were designed for not only sensing COVID-19 but also general health monitoring aspects. Further, we investigated several specific sensors that can be incorporated into the mask for expanding biophysical features. On a larger scale, we discussed the architecture and possible applications with the help of connected smart masks. Namely, beyond a personal sensing application, a group or community sensing application may share an aggregate version of information with the broader population. In addition, this kind of collaborative sensing will also address the challenges of individual sensing, such as reliability and coverage. Lastly, we identified possible service application fields and further considerations for actual use. Along with daily-life health monitoring, smart masks may function as a general respiratory health tool for sports training, in an emergency room or ambulatory setting, as protection for industry workers and firefighters, and for soldier safety and survivability. For further considerations, we investigated design aspects in terms of sensor reliability and reproducibility, ergonomic design for user acceptance, and privacy-aware data-handling. Overall, we aim to explore new possibilities by examining the latest research, sensor technologies, and application platform perspectives for smart masks as one of the promising wearable devices. By integrating biomarkers of respiration symptoms, a smart mask can be a truly cutting-edge device that expands further knowledge on health monitoring to reach the next level of wearables.
Collapse
Affiliation(s)
- Peter Lee
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Heepyung Kim
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Yongshin Kim
- Graduate School of Data Science, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Woohyeok Choi
- Information & Electronics Research Institute, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - M Sami Zitouni
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Ahsan Khandoker
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Herbert F Jelinek
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Leontios Hadjileontiadis
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Uichin Lee
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Yong Jeong
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| |
Collapse
|
38
|
Hikida K. Eyeblink rate as an indicator of concentration on grooming in Japanese macaques (Macaca fuscata). Am J Primatol 2022; 84:e23392. [PMID: 35612538 DOI: 10.1002/ajp.23392] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 04/29/2022] [Accepted: 05/03/2022] [Indexed: 11/10/2022]
Abstract
In primates, social relationships with a high frequency of social grooming are referred to as "affiliate relationships," "friendship," "bonding," and are described as involving positive emotion. However, the psychological state during social grooming has not been fully understood. In this study, I focused on blinking as a behavior that reflects psychological state during grooming in Macaca fuscata, a nonhuman wild primate, and examined for the first time whether the blink rate reflects concentration on social grooming. To test this hypothesis, I focused on ectoparasite removals during social grooming with the following three predictions: (1) blinks are synchronized with breakpoints (when monkeys can release visual attention) of mouthing ectoparasites during grooming, (2) the blink rate is lower during grooming (when requiring visual concentration) than during resting (when no visual concentration is required), and (3) the lower the blink rate during grooming (supposedly in high concentration), the higher the frequency of ectoparasites removals (outputs of the task). I recorded the faces of 10 wild female Japanese macaques on Kinkazan Island, Miyagi Prefecture, with video, while they were resting and grooming, and recorded the timing and frequency of eyeblink and ectoparasite removals. All three predictions were supported, suggesting that the blink rate during grooming can be an indicator of concentration on grooming in nonhuman primates. Whether grooming concentration is associated with an affiliative relationship with the grooming partner is an issue that should be carefully examined in future studies, but eyeblink studies may provide new perspectives for understanding the psychological state of individuals during grooming in a noninvasive manner.
Collapse
Affiliation(s)
- Kenichiro Hikida
- Lab. of Human Evolution Studies, Graduate School of Science, Kyoto University, Kyoto, Japan
| |
Collapse
|
39
|
Baron Shahaf D, Weissman A, Priven L, Shahaf G. Identifying Recall Under Sedation by a Novel EEG Based Index of Attention—A Pilot Study. Front Med (Lausanne) 2022; 9:880384. [PMID: 35492350 PMCID: PMC9047181 DOI: 10.3389/fmed.2022.880384] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Accepted: 03/24/2022] [Indexed: 11/15/2022] Open
Abstract
Overview Recall is an accepted consequence of sedation. But due to the very low prevalence of the more devastating awareness under anesthesia (AUA), it might be of value to assess first the efficacy of new markers for AUA by their efficacy in discovering the more prevalent recall under sedation (RUS). In this pilot study we assessed whether a novel index for attentional effort, the cognitive effort index (CEI), derived in real-time from one forehead EEG channel, could differentiate between patients with or without RUS. Methods EEG was sampled from 2 groups: (1) Patients who underwent deep sedation (n = 25) (using drugs according to the anesthesiologist preference, but generally combining either Midazolam or Propofol together with either Fentanyl or Remifentanil). (2) Patients who underwent general anesthesia (GA, n = 13, a negative control for recall). In recovery, recall was assessed using the BRICE questionnaire. Results Of the 25 sedated patients, 11 experienced recall. The CEI marker was high during significantly longer periods in patients with recall, compared to sedated patients, or patients under GA, without recall. Moreover, the increase in CEI was evident mainly toward the end of the procedure. Conclusion RUS seems to associate with higher level of attention, which is identified in real-time by the easy-to-extract CEI marker.
Collapse
Affiliation(s)
- Dana Baron Shahaf
- Department of Anesthesia, Rambam Health Care Campus, Haifa, Israel
- *Correspondence: Dana Baron Shahaf
| | - Avi Weissman
- Department of Anesthesia, Rambam Health Care Campus, Haifa, Israel
| | - Leonid Priven
- Department of Anesthesia, Rambam Health Care Campus, Haifa, Israel
| | - Goded Shahaf
- The Applied Neurophysiology Lab, Rambam Health Care Campus, Haifa, Israel
| |
Collapse
|
40
|
Paśko W, Zadarko E, Krzeszowski T, Przednowek K. Relationship between Eye Blink Frequency and Incremental Exercise among Young Healthy Men. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19074362. [PMID: 35410042 PMCID: PMC8998332 DOI: 10.3390/ijerph19074362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 03/31/2022] [Accepted: 04/01/2022] [Indexed: 11/16/2022]
Abstract
The aim of the study was to verify the correlation between the frequency of blinking and aerobic physical exercise. The research subjects were 13 healthy man aged 23.3 ± 1 year. Measurements of the blink rate and eye closure times were performed during a progressive aerobic test on a cycle ergometer. During the test, power was gradually increased every minute by 25 W, starting from 50 W. Data acquisition involved using a GoPro camera mounted to the helmet of the research subject. The test continued until the research subject refused to continue. The subjects did not know the goal of the test, in order to ensure objectivity and obtain natural results. The largest number of statistically significant differences was observed between the initial stages and 250 W, as well as between 250 W and 325 W. The analysis showed no significant differences in blink rate, eye closure time, and single blink time in terms of heart rate ranges. Regression models were also determined for eye closure time, blink frequency, and single blink time. The analysis showed that blink frequency and eye closure time were determined by a group of factors (the value of cycle ergometer load power, heart rate, body weight, adipose tissue mass, fat-free mass, and total body water and body surface ratio).
Collapse
Affiliation(s)
- Wojciech Paśko
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
| | - Emilian Zadarko
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
| | - Tomasz Krzeszowski
- Faculty of Electrical and Computer Engineering, Rzeszow University of Technology, Al. Powstancow Warszawy 12, 35-959 Rzeszow, Poland;
| | - Krzysztof Przednowek
- Institute of Physical Culture Sciences, Medical College of Rzeszow University, Rzeszow University, 35-959 Rzeszow, Poland; (W.P.); (E.Z.)
- Correspondence:
| |
Collapse
|
41
|
Ortega J, Plaska CR, Gomes BA, Ellmore TM. Spontaneous Eye Blink Rate During the Working Memory Delay Period Predicts Task Accuracy. Front Psychol 2022; 13:788231. [PMID: 35242077 PMCID: PMC8886217 DOI: 10.3389/fpsyg.2022.788231] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 01/11/2022] [Indexed: 11/17/2022] Open
Abstract
Spontaneous eye blink rate (sEBR) has been linked to attention and memory, specifically working memory (WM). sEBR is also related to striatal dopamine (DA) activity with schizophrenia and Parkinson’s disease showing increases and decreases, respectively, in sEBR. A weakness of past studies of sEBR and WM is that correlations have been reported using blink rates taken at baseline either before or after performance of the tasks used to assess WM. The goal of the present study was to understand how fluctuations in sEBR during different phases of a visual WM task predict task accuracy. In two experiments, with recordings of sEBR collected inside and outside of a magnetic resonance imaging bore, we observed sEBR to be positively correlated with WM task accuracy during the WM delay period. We also found task-related modulation of sEBR, including higher sEBR during the delay period compared to rest, and lower sEBR during task phases (e.g., stimulus encoding) that place demands on visual attention. These results provide further evidence that sEBR could be an important predictor of WM task performance with the changes during the delay period suggesting a role in WM maintenance. The relationship of sEBR to DA activity and WM maintenance is discussed.
Collapse
Affiliation(s)
- Jefferson Ortega
- Department of Psychology, The City College of the City University of New York, New York, NY, United States
| | - Chelsea Reichert Plaska
- Department of Psychology, The City College of the City University of New York, New York, NY, United States.,Behavioral and Cognitive Neuroscience Program, The Graduate Center of the City University of New York, New York, NY, United States
| | - Bernard A Gomes
- Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA, United States
| | - Timothy M Ellmore
- Department of Psychology, The City College of the City University of New York, New York, NY, United States.,Behavioral and Cognitive Neuroscience Program, The Graduate Center of the City University of New York, New York, NY, United States
| |
Collapse
|
42
|
Tavano A, Kotz SA. Overt Oculomotor Behavior Reveals Covert Temporal Predictions. Front Hum Neurosci 2022; 16:758138. [PMID: 35221954 PMCID: PMC8874352 DOI: 10.3389/fnhum.2022.758138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 01/14/2022] [Indexed: 11/21/2022] Open
Abstract
Our eyes move in response to stimulus statistics, reacting to surprising events, and adapting to predictable ones. Cortical and subcortical pathways contribute to generating context-specific eye-movement dynamics, and oculomotor dysfunction is recognized as one the early clinical markers of Parkinson's disease (PD). We asked if covert computations of environmental statistics generating temporal expectations for a potential target are registered by eye movements, and if so, assuming that temporal expectations rely on motor system efficiency, whether they are impaired in PD. We used a repeating tone sequence, which generates a hazard rate distribution of target probability, and analyzed the distribution of blinks when participants were waiting for the target, but the target did not appear. Results show that, although PD participants tend to produce fewer and less temporally organized blink events relative to healthy controls, in both groups blinks became more suppressed with increasing target probability, leading to a hazard rate of oculomotor inhibition effects. The covert generation of temporal predictions may reflect a key feature of cognitive resilience in Parkinson's Disease.
Collapse
Affiliation(s)
- Alessandro Tavano
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- *Correspondence: Alessandro Tavano ;
| | - Sonja A. Kotz
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
43
|
Blinking While Speaking and Talking, Hearing, and Listening: Communication or Individual Underlying Process? JOURNAL OF NONVERBAL BEHAVIOR 2022. [DOI: 10.1007/s10919-021-00387-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
44
|
Bachurina V, Arsalidou M. Multiple levels of mental attentional demand modulate peak saccade velocity and blink rate. Heliyon 2022; 8:e08826. [PMID: 35128110 PMCID: PMC8800024 DOI: 10.1016/j.heliyon.2022.e08826] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 03/10/2021] [Accepted: 01/19/2022] [Indexed: 11/24/2022] Open
Abstract
Every day we mentally process new information that needs to be attended, encoded and retrieved. Processing demands depend on the amount of information and the mental attentional capacity of the individual. Research shows that eye movement indices such as peak saccade velocity and blink rate are related to processes of attentional control, however it is still unclear how eye movements are affected by graded changes in task demand. We examine for the first time relations of eye movements to mental attentional tasks with six levels of task demand and two interference conditions. We report data on 57 adults who completed two versions of the color matching task and provided subjective self rating for each mental attentional demand level. Results show that peak saccade velocity and blink rate decrease as a function of mental attentional demand and correlate negatively with self rating of mental effort. Theoretically, new findings related to mental attentional demand and eye movements inform models of visual processing and cognition. Practically, results point to directions for further research to better understand complex relations among eye movements and mental attentional demand in pediatric populations and individuals with cognitive deficits.
Collapse
Affiliation(s)
| | - Marie Arsalidou
- HSE University, Moscow, Russian Federation
- York University, Toronto, Canada
| |
Collapse
|
45
|
Huber SE, Martini M, Sachse P. Patterns of eye blinks are modulated by auditory input in humans. Cognition 2021; 221:104982. [PMID: 34923195 DOI: 10.1016/j.cognition.2021.104982] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 11/29/2021] [Accepted: 12/02/2021] [Indexed: 11/16/2022]
Abstract
Previous studies could elaborate a link between attentional processes and eye blinking in both visual and auditory attention tasks. Here we show that this link is active at a fundamental level of perception: presentation of a series of bare sine tones is sufficient to induce a modulation of temporal blink patterns, allowing to determine which series was presented to participants even when they are not required to interactively engage in processing the auditory input. In particular, we monitored eye blinking during an auditory attention task using two series of sine tones, differing in the predictability of the timing of tone onsets. Whereas inter-onset intervals in one tone series corresponded to uncorrelated samples from a normal distribution, they were distributed according to a Gaussian random walk in the other tone series. We find that blink patterns are dynamically modulated by both purely auditory inputs. The magnitude, form, and coherence of the temporal associations between tone onsets and blink events depend strongly on the requirement to respond to the presented stimuli. The predictability of the tone series appears to modulate pre-stimulus blink inhibition given that a response is required. Altogether, these findings suggest eye blink as a readily available, non-invasive behavioral marker for context-sensitive, moment-to-moment allocation of attention.
Collapse
Affiliation(s)
- Stefan E Huber
- Department of Psychology, University of Innsbruck, Innrain 52, 6020 Innsbruck, Austria; Institute for Basic Sciences in Engineering Science, University of Innsbruck, Technikerstraße 13/4, 6020 Innsbruck, Austria.
| | - Markus Martini
- Department of Psychology, University of Innsbruck, Innrain 52, 6020 Innsbruck, Austria
| | - Pierre Sachse
- Department of Psychology, University of Innsbruck, Innrain 52, 6020 Innsbruck, Austria
| |
Collapse
|
46
|
Fang X, Sun Y, Zheng X, Wang X, Deng X, Wang M. Assessing Deception in Questionnaire Surveys With Eye-Tracking. Front Psychol 2021; 12:774961. [PMID: 34880817 PMCID: PMC8646095 DOI: 10.3389/fpsyg.2021.774961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 10/26/2021] [Indexed: 11/24/2022] Open
Abstract
Deceit often occurs in questionnaire surveys, which leads to the misreporting of data and poor reliability. The purpose of this study is to explore whether eye-tracking could contribute to the detection of deception in questionnaire surveys, and whether the eye behaviors that appeared in instructed lying still exist in spontaneous lying. Two studies were conducted to explore eye movement behaviors in instructed and spontaneous lying conditions. The results showed that pupil size and fixation behaviors are both reliable indicators to detect lies in questionnaire surveys. Blink and saccade behaviors do not seem to predict deception. Deception resulted in increased pupil size, fixation count and duration. Meanwhile, respondents focused on different areas of the questionnaire when lying versus telling the truth. Furthermore, in the actual deception situation, the linear support vector machine (SVM) deception classifier achieved an accuracy of 74.09%. In sum, this study indicates the eye-tracking signatures of lying are not restricted to instructed deception, demonstrates the potential of using eye-tracking to detect deception in questionnaire surveys, and contributes to the questionnaire surveys of sensitive issues.
Collapse
Affiliation(s)
- Xinyue Fang
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Yiteng Sun
- School of Design, South China University of Technology, Guangzhou, China
| | - Xinyi Zheng
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Xinrong Wang
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Xuemei Deng
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| | - Mei Wang
- School of Mechanical Engineering, Sichuan University, Chengdu, China
| |
Collapse
|
47
|
Yuen NH, Tam F, Churchill NW, Schweizer TA, Graham SJ. Driving With Distraction: Measuring Brain Activity and Oculomotor Behavior Using fMRI and Eye-Tracking. Front Hum Neurosci 2021; 15:659040. [PMID: 34483861 PMCID: PMC8415783 DOI: 10.3389/fnhum.2021.659040] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 06/29/2021] [Indexed: 11/13/2022] Open
Abstract
Introduction Driving motor vehicles is a complex task that depends heavily on how visual stimuli are received and subsequently processed by the brain. The potential impact of distraction on driving performance is well known and poses a safety concern - especially for individuals with cognitive impairments who may be clinically unfit to drive. The present study is the first to combine functional magnetic resonance imaging (fMRI) and eye-tracking during simulated driving with distraction, providing oculomotor metrics to enhance scientific understanding of the brain activity that supports driving performance. Materials and Methods As initial work, twelve healthy young, right-handed participants performed turns ranging in complexity, including simple right and left turns without oncoming traffic, and left turns with oncoming traffic. Distraction was introduced as an auditory task during straight driving, and during left turns with oncoming traffic. Eye-tracking data were recorded during fMRI to characterize fixations, saccades, pupil diameter and blink rate. Results Brain activation maps for right turns, left turns without oncoming traffic, left turns with oncoming traffic, and the distraction conditions were largely consistent with previous literature reporting the neural correlates of simulated driving. When the effects of distraction were evaluated for left turns with oncoming traffic, increased activation was observed in areas involved in executive function (e.g., middle and inferior frontal gyri) as well as decreased activation in the posterior brain (e.g., middle and superior occipital gyri). Whereas driving performance remained mostly unchanged (e.g., turn speed, time to turn, collisions), the oculomotor measures showed that distraction resulted in more consistent gaze at oncoming traffic in a small area of the visual scene; less time spent gazing at off-road targets (e.g., speedometer, rear-view mirror); more time spent performing saccadic eye movements; and decreased blink rate. Conclusion Oculomotor behavior modulated with driving task complexity and distraction in a manner consistent with the brain activation features revealed by fMRI. The results suggest that eye-tracking technology should be included in future fMRI studies of simulated driving behavior in targeted populations, such as the elderly and individuals with cognitive complaints - ultimately toward developing better technology to assess and enhance fitness to drive.
Collapse
Affiliation(s)
- Nicole H Yuen
- Department of Medical Biophysics, Faculty of Medicine, University of Toronto, Toronto, ON, Canada.,Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
| | - Fred Tam
- Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
| | - Nathan W Churchill
- Keenan Research Centre for Biomedical Science, St. Michael's Hospital, Toronto, ON, Canada
| | - Tom A Schweizer
- Keenan Research Centre for Biomedical Science, St. Michael's Hospital, Toronto, ON, Canada.,Division of Neurosurgery, St. Michael's Hospital, Toronto, ON, Canada
| | - Simon J Graham
- Department of Medical Biophysics, Faculty of Medicine, University of Toronto, Toronto, ON, Canada.,Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
| |
Collapse
|
48
|
Enders LR, Smith RJ, Gordon SM, Ries AJ, Touryan J. Gaze Behavior During Navigation and Visual Search of an Open-World Virtual Environment. Front Psychol 2021; 12:681042. [PMID: 34434140 PMCID: PMC8380848 DOI: 10.3389/fpsyg.2021.681042] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 06/28/2021] [Indexed: 11/13/2022] Open
Abstract
Eye tracking has been an essential tool within the vision science community for many years. However, the majority of studies involving eye-tracking technology employ a relatively passive approach through the use of static imagery, prescribed motion, or video stimuli. This is in contrast to our everyday interaction with the natural world where we navigate our environment while actively seeking and using task-relevant visual information. For this reason, an increasing number of vision researchers are employing virtual environment platforms, which offer interactive, realistic visual environments while maintaining a substantial level of experimental control. Here, we recorded eye movement behavior while subjects freely navigated through a rich, open-world virtual environment. Within this environment, subjects completed a visual search task where they were asked to find and count occurrence of specific targets among numerous distractor items. We assigned each participant into one of four target conditions: Humvees, motorcycles, aircraft, or furniture. Our results show a statistically significant relationship between gaze behavior and target objects across Target Conditions with increased visual attention toward assigned targets. Specifically, we see an increase in the number of fixations and an increase in dwell time on target relative to distractor objects. In addition, we included a divided attention task to investigate how search changed with the addition of a secondary task. With increased cognitive load, subjects slowed their speed, decreased gaze on objects, and increased the number of objects scanned in the environment. Overall, our results confirm previous findings and support that complex virtual environments can be used for active visual search experimentation, maintaining a high level of precision in the quantification of gaze information and visual attention. This study contributes to our understanding of how individuals search for information in a naturalistic (open-world) virtual environment. Likewise, our paradigm provides an intriguing look into the heterogeneity of individual behaviors when completing an un-timed visual search task while actively navigating.
Collapse
Affiliation(s)
| | | | | | - Anthony J Ries
- DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, United States.,Warfighter Effectiveness Research Center, U.S. Air Force Academy, Colorado Springs, CO, United States
| | - Jonathan Touryan
- DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| |
Collapse
|
49
|
D'Agostini M, Burger AM, Franssen M, Claes N, Weymar M, von Leupoldt A, Van Diest I. Effects of transcutaneous auricular vagus nerve stimulation on reversal learning, tonic pupil size, salivary alpha-amylase, and cortisol. Psychophysiology 2021; 58:e13885. [PMID: 34245461 DOI: 10.1111/psyp.13885] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Revised: 04/26/2021] [Accepted: 05/25/2021] [Indexed: 12/11/2022]
Abstract
This study investigated whether transcutaneous auricular vagus nerve stimulation (taVNS) enhances reversal learning and augments noradrenergic biomarkers (i.e., pupil size, cortisol, and salivary alpha-amylase [sAA]). We also explored the effect of taVNS on respiratory rate and cardiac vagal activity (CVA). Seventy-one participants received stimulation of either the cymba concha (taVNS) or the earlobe (sham) of the left ear. After learning a series of cue-outcome associations, the stimulation was applied before and throughout a reversal phase in which cue-outcome associations were changed for some (reversal), but not for other (distractor) cues. Tonic pupil size, salivary cortisol, sAA, respiratory rate, and CVA were assessed at different time points. Contrary to our hypothesis, taVNS was not associated with an overall improvement in performance on the reversal task. Compared to sham, the taVNS group performed worse for distractor than reversal cues. taVNS did not increase tonic pupil size and sAA. Only post hoc analyses indicated that the cortisol decline was steeper in the sham compared to the taVNS group. Exploratory analyses showed that taVNS decreased respiratory rate but did not affect CVA. The weak and unexpected effects found in this study might relate to the lack of parameters optimization for taVNS and invite to further investigate the effect of taVNS on cortisol and respiratory rate.
Collapse
Affiliation(s)
| | - Andreas M Burger
- Research Group Health Psychology, KU Leuven, Leuven, Belgium.,Laboratory for Biological Psychology, KU Leuven, Leuven, Belgium
| | | | - Nathalie Claes
- Research Group Health Psychology, KU Leuven, Leuven, Belgium
| | - Mathias Weymar
- Department of Biological Psychology and Affective Science, Faculty of Human Sciences, University of Potsdam, Potsdam, Germany.,Faculty of Health Sciences Brandenburg, University of Potsdam, Potsdam, Germany
| | | | - Ilse Van Diest
- Research Group Health Psychology, KU Leuven, Leuven, Belgium
| |
Collapse
|
50
|
Motoki K, Saito T, Onuma T. Eye-tracking research on sensory and consumer science: A review, pitfalls and future directions. Food Res Int 2021; 145:110389. [PMID: 34112392 DOI: 10.1016/j.foodres.2021.110389] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 04/11/2021] [Accepted: 05/03/2021] [Indexed: 10/21/2022]
Abstract
Visual processing is a core cognitive element of sensory and consumer science. Consumers visually attend to food types, packaging, label design, advertisements, supermarket shelves, food menus, and other visible information. During the past decade, sensory and consumer science have used eye tracking to elucidate visual processing by consumers. This review paper summarizes earlier findings in terms of bottom-up (i.e., stimulus-driven) processing such as visual salience, size, and top-down (i.e., goal-driven) processing such as goals, task instructions, task complexity, and emotions. Downstream effects of gaze on choice are also reviewed. Pitfalls and future directions of eye-tracking research on sensory and consumer science are also discussed.
Collapse
Affiliation(s)
- Kosuke Motoki
- Department of Food Science and Business, Miyagi University, 2-2-1 Hatatate, Taihaku, Sendai 982-0215, Japan.
| | - Toshiki Saito
- Institute of Development, Aging and Cancer, Tohoku University, 4-1, Seiryo-machi Aoba, Sendai, Japan.
| | - Takuya Onuma
- Department of Management and Business, Faculty of Humanity-oriented Science and Engineering, Kindai University, Fukuoka, Japan.
| |
Collapse
|