1
|
Dhengre S, Rothrock L. Investigating mental workload across task modalities: a multimodal analysis using pupillometry. ERGONOMICS 2024:1-14. [PMID: 39413169 DOI: 10.1080/00140139.2024.2414203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Accepted: 10/04/2024] [Indexed: 10/18/2024]
Abstract
Understanding mental workload is challenging due to its multidimensional nature and varying sensitivities of its primary measures: task performance, perceived workload, and physiological responses. This study investigates the effects of task load on performance, perceived workload, and pupil measures across different information modalities. A within-subjects experiment involving three tasks (digit span, matrix span, and dual n-back) was conducted with three task load levels. Workload measures included accuracy/sensitivity, reaction time, NASA-TLX, peak pupil diameter, and peak pupil latency. Consistent patterns of associations between task load and these workload measures were found across the three modalities. Workload measures revealed a nuanced interplay between task modality and task load. Robustness of peak pupil latency, accuracy, and NASA-TLX was highlighted across verbal and visual modalities, while peak pupil diameter showed a weaker impact with differences between modalities. The findings encourage multivariate assessment of mental workload to account for different task modalities.
Collapse
Affiliation(s)
- Snehal Dhengre
- Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, State College, USA
| | - Ling Rothrock
- Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, State College, USA
| |
Collapse
|
2
|
Pan J, Sun X, Park E, Kaufmann M, Klimova M, McGuire JT, Ling S. The effects of emotional arousal on pupil size depend on luminance. Sci Rep 2024; 14:21895. [PMID: 39300137 DOI: 10.1038/s41598-024-70895-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 08/22/2024] [Indexed: 09/22/2024] Open
Abstract
Pupillometry is widely used to measure arousal states. The primary functional role of the pupil, however, is to respond to the luminance of visual inputs. We previously demonstrated that cognitive effort-related arousal interacted multiplicatively with luminance, with the strongest pupillary effects of arousal occurring at low-to-mid luminances (< 37 cd/m2), implying a narrow range of conditions ideal for assessing cognitive arousal-driven pupillary differences. Does this generalize to other forms of arousal? To answer this, we assessed luminance-driven pupillary response functions while manipulating emotional arousal, using well-established visual and auditory stimulus sets. At the group level, emotional arousal interacted with the pupillary light response differently from cognitive arousal: the effects occurred primarily at much lower luminances (< 20 cd/m2). Analyses at the individual-participant level revealed qualitatively distinct patterns of modulation, with a sizable number of individuals displaying no arousal response to the visual or auditory stimuli, regardless of luminance. Together, our results suggest that effects of arousal on pupil size are not monolithic: different forms of arousal exert different patterns of effects. More practically, our findings suggest that lower luminances create better conditions for measuring pupil-linked arousal, and when selecting ambient luminance levels, consideration of the arousal manipulation and individual differences is critical.
Collapse
Affiliation(s)
- Jasmine Pan
- Psychological & Brain Sciences, Boston University, Boston, MA, USA.
- Center for Systems Neuroscience, Boston University, Boston, MA, USA.
| | - Xuelin Sun
- Psychological & Brain Sciences, Boston University, Boston, MA, USA
- John Hopkins University, Baltimore, MD, USA
| | - Edison Park
- Psychological & Brain Sciences, Boston University, Boston, MA, USA
| | - Marine Kaufmann
- Psychological & Brain Sciences, Boston University, Boston, MA, USA
| | - Michaela Klimova
- Psychological & Brain Sciences, Boston University, Boston, MA, USA
- Center for Systems Neuroscience, Boston University, Boston, MA, USA
| | - Joseph T McGuire
- Psychological & Brain Sciences, Boston University, Boston, MA, USA
- Center for Systems Neuroscience, Boston University, Boston, MA, USA
| | - Sam Ling
- Psychological & Brain Sciences, Boston University, Boston, MA, USA.
- Center for Systems Neuroscience, Boston University, Boston, MA, USA.
| |
Collapse
|
3
|
Korda Ž, Walcher S, Körner C, Benedek M. Effects of internally directed cognition on smooth pursuit eye movements: A systematic examination of perceptual decoupling. Atten Percept Psychophys 2023; 85:1159-1178. [PMID: 36922477 PMCID: PMC10167146 DOI: 10.3758/s13414-023-02688-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/21/2023] [Indexed: 03/17/2023]
Abstract
Eye behavior differs between internally and externally directed cognition and thus is indicative of an internal versus external attention focus. Recent work implicated perceptual decoupling (i.e., eye behavior becoming less determined by the sensory environment) as one of the key mechanisms involved in these attention-related eye movement differences. However, it is not yet understood how perceptual decoupling depends on the characteristics of the internal task. Therefore, we systematically examined effects of varying internal task demands on smooth pursuit eye movements. Specifically, we evaluated effects of the internal workload (control vs. low vs. high) and of internal task (arithmetic vs. visuospatial). The results of multilevel modelling showed that effects of perceptual decoupling were stronger for higher workload, and more pronounced for the visuospatial modality. Effects also followed a characteristic time-course relative to internal operations. The findings provide further support of the perceptual decoupling mechanism by showing that it is sensitive to the degree of interference between external and internal information.
Collapse
Affiliation(s)
- Živa Korda
- Department of Psychology, University of Graz, Graz, Austria.
| | - Sonja Walcher
- Department of Psychology, University of Graz, Graz, Austria
| | | | | |
Collapse
|
4
|
Pan J, Klímová M, McGuire JT, Ling S. Arousal-based pupil modulation is dictated by luminance. Sci Rep 2022; 12:1390. [PMID: 35082319 PMCID: PMC8792027 DOI: 10.1038/s41598-022-05280-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 01/04/2022] [Indexed: 11/09/2022] Open
Abstract
Pupillometry has become a standard measure for assessing arousal state. However, environmental factors such as luminance, a primary dictator of pupillary responses, often vary across studies. To what degree does luminance interact with arousal-driven pupillary changes? Here, we parametrically assessed luminance-driven pupillary responses across a wide-range of luminances, while concurrently manipulating cognitive arousal using auditory math problems of varying difficulty. At the group-level, our results revealed that the modulatory effect of cognitive arousal on pupil size interacts multiplicatively with luminance, with the largest effects occurring at low and mid-luminances. However, at the level of individuals, there were qualitatively distinct individual differences in the modulatory effect of cognitive arousal on luminance-driven pupillary responses. Our findings suggest that pupillometry as a measure for assessing arousal requires more careful consideration: there are ranges of luminance levels that are more ideal in observing pupillary differences between arousal conditions than others.
Collapse
Affiliation(s)
- Jasmine Pan
- Psychological and Brain Sciences, Boston University, Boston, MA, USA.
- Center for Systems Neuroscience, Boston University, Boston, MA, USA.
| | - Michaela Klímová
- Psychological and Brain Sciences, Boston University, Boston, MA, USA
- Center for Systems Neuroscience, Boston University, Boston, MA, USA
| | - Joseph T McGuire
- Psychological and Brain Sciences, Boston University, Boston, MA, USA
- Center for Systems Neuroscience, Boston University, Boston, MA, USA
| | - Sam Ling
- Psychological and Brain Sciences, Boston University, Boston, MA, USA
- Center for Systems Neuroscience, Boston University, Boston, MA, USA
| |
Collapse
|
5
|
Thurman SM, Cohen Hoffing RA, Madison A, Ries AJ, Gordon SM, Touryan J. "Blue Sky Effect": Contextual Influences on Pupil Size During Naturalistic Visual Search. Front Psychol 2022; 12:748539. [PMID: 34992563 PMCID: PMC8725886 DOI: 10.3389/fpsyg.2021.748539] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 11/16/2021] [Indexed: 01/28/2023] Open
Abstract
Pupil size is influenced by cognitive and non-cognitive factors. One of the strongest modulators of pupil size is scene luminance, which complicates studies of cognitive pupillometry in environments with complex patterns of visual stimulation. To help understand how dynamic visual scene statistics influence pupil size during an active visual search task in a visually rich 3D virtual environment (VE), we analyzed the correlation between pupil size and intensity changes of image pixels in the red, green, and blue (RGB) channels within a large window (~14 degrees) surrounding the gaze position over time. Overall, blue and green channels had a stronger influence on pupil size than the red channel. The correlation maps were not consistent with the hypothesis of a foveal bias for luminance, instead revealing a significant contextual effect, whereby pixels above the gaze point in the green/blue channels had a disproportionate impact on pupil size. We hypothesized this differential sensitivity of pupil responsiveness to blue light from above as a “blue sky effect,” and confirmed this finding with a follow-on experiment with a controlled laboratory task. Pupillary constrictions were significantly stronger when blue was presented above fixation (paired with luminance-matched gray on bottom) compared to below fixation. This effect was specific for the blue color channel and this stimulus orientation. These results highlight the differential sensitivity of pupillary responses to scene statistics in studies or applications that involve complex visual environments and suggest blue light as a predominant factor influencing pupil size.
Collapse
Affiliation(s)
- Steven M Thurman
- US DEVCOM Army Research Laboratory, Human Research and Engineering Directorate, US Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| | - Russell A Cohen Hoffing
- US DEVCOM Army Research Laboratory, Human Research and Engineering Directorate, US Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| | - Anna Madison
- US DEVCOM Army Research Laboratory, Human Research and Engineering Directorate, US Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| | - Anthony J Ries
- US DEVCOM Army Research Laboratory, Human Research and Engineering Directorate, US Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| | | | - Jonathan Touryan
- US DEVCOM Army Research Laboratory, Human Research and Engineering Directorate, US Army Research Laboratory, Aberdeen Proving Ground, MD, United States
| |
Collapse
|
6
|
Correction: Dissociable mappings of tonic and phasic pupillary features onto cognitive processes involved in mental arithmetic. PLoS One 2021; 16:e0256798. [PMID: 34428255 PMCID: PMC8384216 DOI: 10.1371/journal.pone.0256798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Abstract
[This corrects the article DOI: 10.1371/journal.pone.0230517.].
Collapse
|
7
|
Is accommodation a confounder in pupillometry research? Biol Psychol 2021; 160:108046. [PMID: 33581231 DOI: 10.1016/j.biopsycho.2021.108046] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 02/07/2021] [Accepted: 02/07/2021] [Indexed: 11/24/2022]
Abstract
Much psychological research uses pupil diameter measurements to investigate the cognitive and emotional effects of visual stimuli. A potential problem is that accommodating at a nearby point causes the pupil to constrict. This study examined to what extent accommodation is a confounder in pupillometry research. Participants solved multiplication problems at different distances (Experiment 1) and looked at line drawings with different monocular depth cues (Experiment 2) while their pupil diameter, refraction, and vergence angle were recorded using a photorefractor. Experiment 1 showed that the pupils dilated while performing the multiplications, for all presentation distances. Pupillary constriction due to accommodation was not strong enough to override pupil dilation due to cognitive load. Experiment 2 showed that monocular depth cues caused a small shift in refraction in the expected direction. We conclude that, for the young student sample we used, pupil diameter measurements are not substantially affected by accommodation.
Collapse
|
8
|
Horkovičová K, Popov I, Valašková J. PUPILLOTONIA AND ADIE SYNDROME. CESKA A SLOVENSKA OFTALMOLOGIE : CASOPIS CESKE OFTALMOLOGICKE SPOLECNOSTI A SLOVENSKE OFTALMOLOGICKE SPOLECNOSTI 2020; 76:232-235. [PMID: 33499645 DOI: 10.31348/2020/33] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
The aim of the work is to approach the examination of the pupil with a focus on anisocoria, its characteristics and approach to the diagnosis of pupillotonia and Adie's syndrome and its clinical evaluation. Pupil function is important not only in neurophthalmological examination but also in general ophthalmological examination. First of all, we need to know how the reflex arc works in order to be able to exclude or confirm whether the parasympathetic or sympathetic is affected. It is also necessary to know the exact characteristics of the pupil, such as size, shape, placement, function and reaction to light and at close range. Only on this basis can we distinguish pathological features. We do not often encounter this diagnosis, but it is necessary to keep it in mind, especially in the field of neurophthalmology but also in general ophthalmology. We also present three cases of pupilotonia and Adie's syndrome, which we diagnosed at the Department of Ophthalmology, Faculty of Medicine, Comenius University, after the patient himself came by emergency admission or was sent directly to ophthalmology clinic. In the discussion, we present various other diagnoses, where the reflex arc may not be affected, but the pathological pupil is caused by intraocular tumors, general systemic diseases and, last but not least, local therapy or alkaloids.
Collapse
|