Gaze and the Eye Pupil Adjust to Imagined Size and Distance

Enabling scale and rotation invariance in convolutional neural networks with retina like transformation

Traditional convolutional neural networks (CNNs) struggle with scale and rotation transformations, resulting in reduced performance on transformed images. Previous research focused on designing specific CNN modules to extract transformation-invariant features. However, these methods lack versatility and are not adaptable to a wide range of scenarios. Drawing inspiration from human visual invariance, we propose a novel brain-inspired approach to tackle the invariance problem in CNNs. If we consider a CNN as the visual cortex, we have the potential to design an "eye" that exhibits transformation invariance, allowing CNNs to perceive the world consistently. Therefore, we propose a retina module and then integrate it into CNNs to create transformation-invariant CNNs (TICNN), achieving scale and rotation invariance. The retina module comprises a retina-like transformation and a transformation-aware neural network (TANN). The retina-like transformation supports flexible image transformations, while the TANN regulates these transformations for scaling and rotation. Specifically, we propose a reference-based training method (RBTM) where the retina module learns to align input images with a reference scale and rotation, thereby achieving invariance. Furthermore, we provide mathematical substantiation for the retina module to confirm its feasibility. Experimental results also demonstrate that our method outperforms existing methods in recognizing images with scale and rotation variations. The code will be released at https://github.com/JiaHongZ/TICNN.

Sleuthing subjectivity: a review of covert measures of consciousness

Consciousness is private. Although conscious beings directly access their own conscious experiences, the consciousness of others must be inferred through overt report: observable behaviours - such as overt facial expressions, vocalizations and body gestures - that suggest the level, state and content of consciousness. However, overt report is limited because it can be erroneous (for example, resulting from wilful deception or being subject to recall error), absent (for example, during sleep and paralysis) or conflict with research goals (for example, in no-report paradigms and resting-state studies). These limitations encourage the search for covert measures of consciousness: physiological signals that disclose consciousness without relying on overt behaviour. This Review highlights emerging covert measures of consciousness in humans, including eye, skin, respiratory and heart signals. We also address the challenge of distinguishing physiological signals linked to conscious versus unconscious neural processing. Finally, we consider the ethical implications of infringing on the innate privacy of consciousness.

Differential eye movements and greater pupil size during mental scene construction in autobiographical recall

There is growing evidence supporting a role for eye movements during autobiographical recall, but their potential functionality remains unclear. We hypothesise that the oculomotor system facilitates the process of mental scene construction, in which complex scenes associated with an autobiographical event are generated and maintained during recall. To explore this, we examined spontaneous eye movements during retrieval of cued autobiographical memories. Participants' verbal descriptions of each memory were recorded in synchronisation with their eye movements and pupil size during recall. For each memory participants described the place (details of the environment where the event took place) and the event (details of what happened). Narratives were analyzed using the Autobiographical Interview procedure, which separated internal spatial (place) and non-spatial (event, thoughts and emotion) details. Eye movements during recall of spatial details had significantly higher fixation duration and smaller saccade amplitude and peak velocity, and a higher number of consecutive unidirectional saccades, in comparison to recall of non-spatial details. Recurrence quantification analysis indicated longer sequences of refixations and more repetitions of the same fixation pattern when participants described spatial details. Recall of spatial details was also associated with significantly greater pupil area. Overall findings are consistent with the spontaneous production of more structured saccade patterns and greater cognitive load during the recall of internal spatial episodic scene details in comparison to episodic non-spatial details. These results are consistent with the oculomotor system facilitating the activation and correct positioning of elements of a complex scene relative to other imagined elements during autobiographical recall.

HDConv: Heterogeneous kernel-based dilated convolutions

Dilated convolution has been widely used in various computer vision tasks due to its ability to expand the receptive field while maintaining the resolution of feature maps. However, the critical challenge is the gridding problem caused by the isomorphic structure of the dilated convolution, where the holes filled in the dilated convolution destroy the integrity of the extracted information and cut off the relevance of neighboring pixels. In this work, a novel heterogeneous dilated convolution, called HDConv, is proposed to address this issue by setting independent dilation rates on grouped channels while keeping the general convolution operation. The heterogeneous structure can effectively avoid the gridding problem while introducing multi-scale kernels in the filters. Based on the heterogeneous structure of the proposed HDConv, we also explore the benefit of large receptive fields to feature extraction by comparing different combinations of dilated rates. Finally, a series of experiments are conducted to verify the effectiveness of some computer vision tasks, such as image segmentation and object detection. The results show the proposed HDConv can achieve a competitive performance on ADE20K, Cityscapes, COCO-Stuff10k, COCO, and a medical image dataset UESTC-COVID-19. The proposed module can readily replace conventional convolutions in existing convolutional neural networks (i.e., plug-and-play), and it is promising to further extend dilated convolution to wider scenarios in the field of image segmentation.

Tunnel motion: Pupil dilations to optic flow within illusory dark holes

We showed to the same observers both dynamic and static 2D patterns that can both evoke distinctive perceptions of motion or optic flow, as if moving in a tunnel or into a dark hole. At all times pupil diameters were monitored with an infrared eye tracker. We found a converging set of results indicating stronger pupil dilations to expansive growth of shapes or optic flows evoking a forward motion into a dark tunnel. Multiple regression analyses showed that the pupil responses to the illusory expanding black holes of static patterns were predicted by the individuals' pupil response to optic flows showing spiraling motion or "free fall" into a black hole. Also, individuals' pupil responses to spiraling motion into dark tunnels predicted the individuals' sense of illusory expansion with the static, illusory expanding, dark holes. This correspondence across individuals between their pupil responses to both dynamic and static, illusory expanding, holes suggests that these percepts reflect a common perceptual mechanism, deriving motion from 2D scenes, and that the observers' pupil adjustments reflect the direction and strength of motion they perceive and the expected outcome of an increase in darkness.

The forgotten wave of early pupillometry research

Changes in pupil size offer a rich, continuous, and integrated neurophysiological readout of attention and cognition. I here briefly reintroduce examples of a vast, forgotten literature, full of inspiring ideas, which described attentional modulations of pupil size decades earlier than often assumed. I outline parallels between these early studies and recent developments in pupillometry.

How workload and availability of spatial reference shape eye movement coupling in visuospatial working memory

Eyes are active in memory recall and visual imagination, yet our grasp of the underlying qualities and factors of these internally coupled eye movements is limited. To explore this, we studied 50 participants, examining how workload, spatial reference availability, and imagined movement direction influence internal coupling of eye movements. We designed a visuospatial working memory task in which participants mentally moved a black patch along a path within a matrix and each trial involved one step along this path (presented via speakers: up, down, left, or right). We varied workload by adjusting matrix size (3 × 3 vs. 5 × 5), manipulated availability of a spatial frame of reference by presenting either a blank screen (requiring participants to rely solely on their mental representation of the matrix) or spatial reference in the form of an empty matrix, and contrasted active task performance to two control conditions involving only active or passive listening. Our findings show that eye movements consistently matched the imagined movement of the patch in the matrix, not driven solely by auditory or semantic cues. While workload influenced pupil diameter, perceived demand, and performance, it had no observable impact on internal coupling. The availability of spatial reference enhanced coupling of eye movements, leading more frequent, precise, and resilient saccades against noise and bias. The absence of workload effects on coupled saccades in our study, in combination with the relatively high degree of coupling observed even in the invisible matrix condition, indicates that eye movements align with shifts in attention across both visually and internally represented information. This suggests that coupled eye movements are not merely strategic efforts to reduce workload, but rather a natural response to where attention is directed.

From pre-processing to advanced dynamic modeling of pupil data

The pupil of the eye provides a rich source of information for cognitive scientists, as it can index a variety of bodily states (e.g., arousal, fatigue) and cognitive processes (e.g., attention, decision-making). As pupillometry becomes a more accessible and popular methodology, researchers have proposed a variety of techniques for analyzing pupil data. Here, we focus on time series-based, signal-to-signal approaches that enable one to relate dynamic changes in pupil size over time with dynamic changes in a stimulus time series, continuous behavioral outcome measures, or other participants' pupil traces. We first introduce pupillometry, its neural underpinnings, and the relation between pupil measurements and other oculomotor behaviors (e.g., blinks, saccades), to stress the importance of understanding what is being measured and what can be inferred from changes in pupillary activity. Next, we discuss possible pre-processing steps, and the contexts in which they may be necessary. Finally, we turn to signal-to-signal analytic techniques, including regression-based approaches, dynamic time-warping, phase clustering, detrended fluctuation analysis, and recurrence quantification analysis. Assumptions of these techniques, and examples of the scientific questions each can address, are outlined, with references to key papers and software packages. Additionally, we provide a detailed code tutorial that steps through the key examples and figures in this paper. Ultimately, we contend that the insights gained from pupillometry are constrained by the analysis techniques used, and that signal-to-signal approaches offer a means to generate novel scientific insights by taking into account understudied spectro-temporal relationships between the pupil signal and other signals of interest.

Pupil dilation response elicited by violations of auditory regularities is a promising but challenging approach to probe consciousness at the bedside

Pupil dilation response (PDR) has been proposed as a physiological marker of conscious access to a stimulus or its attributes, such as novelty. In a previous study on healthy volunteers, we adapted the auditory "local global" paradigm and showed that violations of global regularity elicited a PDR. Notably without instructions, this global effect was present only in participants who could consciously report violations of global regularities. In the present study, we used a similar approach in 24 non-communicating patients affected with a Disorder of Consciousness (DoC) and compared PDR to ERPs regarding diagnostic and prognostic performance. At the group level, global effect could not be detected in DoC patients. At the individual level, the only patient with a PDR global effect was in a MCS and recovered consciousness at 6 months. Contrasting the most regular trials to the most irregular ones improved PDR's diagnostic and prognostic power in DoC patients. Pupillometry is a promising tool but requires several methodological improvements to enhance the signal-to-noise ratio and make it more robust for probing consciousness and cognition in DoC patients.

Optogenetic stimulation of the primary visual cortex drives activity in the visual association cortex

Developing optogenetic methods for research in non-human primates (NHP) is important for translational neuroscience and for delineating brain function with unprecedented specificity. Here we assess, in macaque monkeys, the selectivity by which optogenetic stimulation of the primary visual cortex (V1) drives the local laminar and widespread cortical connectivity related to visual perception. Towards this end, we transfected neurons with light-sensitive channelrhodopsin in dorsal V1. fMRI revealed that optogenetic stimulation of V1 using blue light at 40 Hz increased functional activity in the visual association cortex, including areas V2/V3, V4, motion-sensitive area MT and frontal eye fields, although nonspecific heating and eye movement contributions to this effect could not be ruled out. Neurophysiology and immunohistochemistry analyses confirmed optogenetic modulation of spiking activity and opsin expression with the strongest expression in layer 4-B in V1. Stimulating this pathway during a perceptual decision task effectively elicited a phosphene percept in the receptive field of the stimulated neurons in one monkey. Taken together, our findings demonstrate the great potential of optogenetic methods to drive the large-scale cortical circuits of the primate brain with high functional and spatial specificity.

Beyond alpha-band: The neural correlate of creative thinking

The compound nature of creativity entails the interplay of multiple cognitive processes, making it difficult to attribute creativity to a single neural signature. Divergent thinking paradigms, widely adopted to investigate creative production, have highlighted the key role of specific mental operations subserving creativity, such as inhibition of external stimuli, loose semantic associations, and mental imagery. Neurophysiological studies have typically shown a high alpha rhythm synchronization when individuals are engaged in creative ideation. Also, oculomotor activity and pupil diameter have been proposed as useful indicators of mental operations involved in such a thinking process. The goal of this study was to investigate whether beyond alpha-band activity other higher frequency bands, such as beta and gamma, may subserve divergent and convergent thinking and whether those could be associated with a different gaze bias and pupil response during ideas generation. Implementing a within-subjects design we collected behavioral measures, neural activity, gaze patterns, and pupil dilation while participants performed a revised version of the Alternative Uses Task, in which divergent thinking is contrasted to convergent thinking. As expected, participants took longer to generate creative ideas as compared to common ones. Interestingly, during divergent thinking participants displayed alpha synchronization along with beta and gamma desynchronization, more pronounced leftward gaze shift, and greater pupil dilation. During convergent thinking, an opposite pattern was observed: desynchronization in alpha and an increase in beta and gamma rhythm, along with a reduction of leftward gaze shift and greater pupil constriction. The present study uncovered specific neural dynamics and physiological patterns during idea generation, providing novel insight into the complex physiological signature of creative production.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.

Eye pupil – a window into central autonomic regulation via emotional/cognitive processing

If the eyes are windows into the soul, then the pupils represent at least the gateway to the brain and can provide a unique insight into the human mind from several aspects. The changes in the pupil size primarily mediated by different lighting conditions are controlled by the autonomic nervous system regulated predominantly at the subcortical level. Specifically, parasympathetically-linked pupillary constriction is under the Edinger-Westphal nucleus control and sympathetically-mediated pupillary dilation is regulated from the posterior hypothalamic nuclei. However, the changes in the pupil size can be observed at resting state even under constant lighting, these pupillary changes are mediated by global arousal level as well as by various cognitive factors. In this context, autonomic pathways modulating changes in the pupil size in response to the different light levels can be influenced by multiple central descending inputs driving pupillary changes under steady lighting conditions. Moreover, as the pupillary response is involved in emotional (task-evoked pupillary dilation as an index of emotional arousal) and cognitive (task-evoked pupillary dilation as an index of cognitive workload) stimulation, it can be used to detect the impact of mutual subcortical and cortical structures (i.e. overlapping brain structures included in autonomic, emotional and cognitive regulation) on the pupillary innervation system. Thus, complex understanding of the baseline pupil size´ and pupillary dynamics´ mechanisms may provide an important insight into the central nervous system functioning pointing to the pupillometry as a promising tool in the clinical application.

Eye pupil - a window into central autonomic regulation via emotional/cognitive processing

If the eyes are windows into the soul, then the pupils represent at least the gateway to the brain and can provide a unique insight into the human mind from several aspects. The changes in the pupil size primarily mediated by different lighting conditions are controlled by the autonomic nervous system regulated predominantly at the subcortical level. Specifically, parasympathetically-linked pupillary constriction is under the Edinger-Westphal nucleus control and sympathetically-mediated pupillary dilation is regulated from the posterior hypothalamic nuclei. However, the changes in the pupil size can be observed at resting state even under constant lighting, these pupillary changes are mediated by global arousal level as well as by various cognitive factors. In this context, autonomic pathways modulating changes in the pupil size in response to the different light levels can be influenced by multiple central descending inputs driving pupillary changes under steady lighting conditions. Moreover, as the pupillary response is involved in emotional (task-evoked pupillary dilation as an index of emotional arousal) and cognitive (task-evoked pupillary dilation as an index of cognitive workload) stimulation, it can be used to detect the impact of mutual subcortical and cortical structures (i.e. overlapping brain structures included in autonomic, emotional and cognitive regulation) on the pupillary innervation system. Thus, complex understanding of the baseline pupil size´ and pupillary dynamics´ mechanisms may provide an important insight into the central nervous system functioning pointing to the pupillometry as a promising tool in the clinical application.

Neurophysiological indicators of internal attention: An fMRI-eye-tracking coregistration study

Many goal-directed, as well as spontaneous everyday activities (e.g., planning, mind-wandering), rely on an internal focus of attention. This fMRI-eye-tracking coregistration study investigated brain mechanisms and eye behavior related to internally versus externally directed cognition. Building on an established paradigm, we manipulated internal attention demands within tasks utilizing conditional stimulus masking. Internally directed cognition involved bilateral activation of the lingual gyrus and inferior parietal lobe areas as well as wide-spread deactivation of visual networks. Moreover, internally directed cognition was related to greater pupil diameter, pupil diameter variance, blink duration, fixation disparity variance, and smaller amounts of microsaccades. FMRI-eye-tracking covariation analyses further revealed that larger pupil diameter was related to increased activation of basal ganglia and lingual gyrus. It can be concluded that internally and externally directed cognition are characterized by distinct neurophysiological signatures. The observed neurophysiological differences indicate that internally directed cognition is associated with reduced processing of task-irrelevant information and increased mental load. These findings shed further light on the interplay between neural and perceptual mechanisms contributing to an internal focus of attention.

Direct voluntary control of pupil constriction and dilation: Exploratory evidence from pupillometry, optometry, skin conductance, perception, and functional MRI

We present a single case who can change pupil size on command with dilation of pupil diameter of around 0.8 mm, and constriction of around 2.4 mm. Using modern pupillometric and optometric techniques in combination with measuring electrodermal activity, various indirect mechanisms possibly mediating this phenomenon were tested: accommodation, brightness, increases in arousal by increased mental effort. None of these behavioral tests could support an indirect strategy as the mode of action, although it seems plausible that the case could have learned to gain control over the pupillary response by decoupling pupil size changes from accommodation and vergence in the near triad: Even at maximal accommodation, the case voluntarily constricted his pupil without changing vergence and could improve visual acuity by >6 diopters. Using task-based functional magnetic resonance imaging we found involvement of brain regions generating and mediating volitional impulses. Changes of the left pupil size were associated with increased activation of parts of the left dorsolateral prefrontal cortex, adjacent premotor areas, and supplementary motor area. It still remains open where these neural signals enter the final pathway, either innervating the pupil's dilator directly, or more indirectly by inhibiting the parasympathetically innervated antagonistic sphincter, and vice versa for constriction. To conclude, so far none of potential - conscious or unconscious - indirect strategies, may it be accommodative or vergence efforts or mental efforts and imaginations, could be observed or inferred to be fully responsible, suggesting direct voluntary control of pupil size in the present case.

Pupillary light reflex as a diagnostic aid from computational viewpoint: A systematic literature review

This work presents a detailed and complete review of publications on pupillary light reflex (PLR) used to aid diagnoses. These are computational techniques used in the evaluation of pupillometry, as well as their application in computer-aided diagnoses (CAD) of pathologies or physiological conditions that can be studied by observing the movements of miosis and mydriasis of the human pupil. A careful survey was carried out of all studies published over the last 10 years which investigated, electronic devices, recording protocols, image treatment, computational algorithms and the pathologies related to PLR. We present the frontier of existing knowledge regarding methods and techniques used in this field of knowledge, which has been expanding due to the possibility of performing diagnoses with high precision, at a low cost and with a non-invasive method.

Top-down effect on pupillary response: Evidence from shape from shading

Shaded 2D images often create an illusion of depth, due to the shading information and assumptions regarding the location of the light source. Specifically, 2D images that are lighter on top usually appear convex while images that are darker on top, usually appear concave, reflecting the assumption that light is coming from above. The process of recovering the 3D shape of a shaded image is called Shape from Shading. Here we examined whether the pupil responds to the illusion of depth in a shape from shading task. In three experiments we show that pupil size is affected by the percept of depth, so that it dilates more when participants perceive the stimulus as concave, compared to when they perceive it as convex. This only happens if participants make a judgment regarding the shape of the stimulus or when they view it passively but are aware of the different shapes. No differences in pupil size were found with passive viewing if participants were not aware of the illusion, suggesting that some aspects of shape from shading require attention. All stimuli were equiluminant, and the percept of depth was created by manipulating the orientation of the shading, so that changes in pupil size could not be accounted by changes in the amount of light in the image. We posit, and confirmed it in a behavioral control experiment, that the perception of depth is translated to a subjective perception of darkness, due to the "darker is deeper" heuristic and conclude that the pupillary physiological response reflects the subjective perception of light.

Does stereopsis improve face identification? A study using a virtual reality display with integrated eye-tracking and pupillometry

Stereopsis is a powerful depth cue for humans, which may also contribute to object recognition. In particular, we surmise that face identification would benefit from the availability of stereoscopic depth cues, since facial perception may be based on three-dimensional (3D) representations. In this study, a virtual reality (VR) headset with integrated eye-tracking was used to present stereoscopic images of faces. As a monoscopic contrast condition, identical images of faces were displayed to the two eyes. We monitored the participants' gaze behavior and pupil diameters while they performed a sample-to-match face identification task. We found that accuracy was superior in the stereoscopic condition compared to the monoscopic condition for frontal and intermediate views, but not profiles. Moreover, pupillary diameters were smaller when identifying stereoscopically seen faces than when viewing them without stereometric cues, which we interpret as lower processing load for the former than the latter conditions. The analysis of gaze showed that participants tended to focus on regions of the face rich in volumetric information, more so in the stereoscopic condition than the monoscopic condition. Together, these findings suggest that a 3D representation of faces may be the natural format used by the visual system when assessing face identity. Stereoscopic information, by providing depth information, assists the construction of robust facial representations in memory.

Neurophysiological indicators of internal attention: An electroencephalography-eye-tracking coregistration study

INTRODUCTION

Many goal-directed and spontaneous everyday activities (e.g., planning, mind wandering) rely on an internal focus of attention. Internally directed cognition (IDC) was shown to differ from externally directed cognition in a range of neurophysiological indicators such as electroencephalogram (EEG) alpha activity and eye behavior.

METHODS

In this EEG-eye-tracking coregistration study, we investigated effects of attention direction on EEG alpha activity and various relevant eye parameters. We used an established paradigm to manipulate internal attention demands in the visual domain within tasks by means of conditional stimulus masking.

RESULTS

Consistent with previous research, IDC involved relatively higher EEG alpha activity (lower alpha desynchronization) at posterior cortical sites. Moreover, IDC was characterized by greater pupil diameter (PD), fewer microsaccades, fixations, and saccades. These findings show that internal versus external cognition is associated with robust differences in several indicators at the neural and perceptual level. In a second line of analysis, we explored the intrinsic temporal covariation between EEG alpha activity and eye parameters during rest. This analysis revealed a positive correlation of EEG alpha power with PD especially in bilateral parieto-occipital regions.

CONCLUSION

Together, these findings suggest that EEG alpha activity and PD represent time-sensitive indicators of internal attention demands, which may be involved in a neurophysiological gating mechanism serving to shield internal cognition from irrelevant sensory information.

Eye behavior predicts susceptibility to visual distraction during internally directed cognition

When we engage in internally directed cognition (e.g., planning or imagination), our eye behavior decouples from external stimuli and couples to internal representations (e.g., internal visualizations of ideas). Here, we investigated whether eye behavior predicts the susceptibility to visual distraction during internally directed cognition. To this end, participants performed a divergent thinking task, which required internally directed attention, and we measured distraction in terms of attention capture by unrelated images. We used multilevel mixed models to predict visual distraction by eye behavior right before distractor onset. In Study 1 (N = 38), visual distraction was predicted by increased saccade and blink rate, and higher pupil dilation. We replicated these findings in Study 2 using the same task, but with less predictable distractor onsets and a larger sample (N = 144). We also explored whether individual differences in susceptibility to visual distraction were related to cognitive ability and task performance. Taken together, variation in eye behavior was found to be a consistent predictor of visual distraction during internally directed cognition. This highlights the relevance of eye parameters as objective indicators of internal versus external attentional focus and distractibility during complex mental tasks.

Tuning the Senses: How the Pupil Shapes Vision at the Earliest Stage

The pupil responds reflexively to changes in brightness and focal distance to maintain the smallest pupil (and thus the highest visual acuity) that still allows sufficient light to reach the retina. The pupil also responds to a wide variety of cognitive processes, but the functions of these cognitive responses are still poorly understood. In this review, I propose that cognitive pupil responses, like their reflexive counterparts, serve to optimize vision. Specifically, an emphasis on central vision over peripheral vision results in pupil constriction, and this likely reflects the fact that central vision benefits most from the increased visual acuity provided by small pupils. Furthermore, an intention to act with a bright stimulus results in preparatory pupil constriction, which allows the pupil to respond quickly when that bright stimulus is subsequently brought into view. More generally, cognitively driven pupil responses are likely a form of sensory tuning: a subtle adjustment of the eyes to optimize their properties for the current situation and the immediate future. Expected final online publication date for the Annual Review of Vision Science, Volume 6 is September 15, 2020. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Pupillometric decoding of high-level musical imagery

Humans report imagining sound where no physical sound is present: we replay conversations, practice speeches, and "hear" music all within the confines of our minds. Research has identified neural substrates underlying auditory imagery; yet deciphering its explicit contents has been elusive. Here we present a novel pupillometric method for decoding what individuals hear "inside their heads". Independent of light, pupils dilate and constrict in response to noradrenergic activity. Hence, stimuli evoking unique and reliable patterns of attention and arousal even when imagined should concurrently produce identifiable patterns of pupil-size dynamics (PSDs). Participants listened to and then silently imagined music while eye-tracked. Using machine learning algorithms, we decoded the imagined songs within- and across-participants following classifier-training on PSDs collected during both imagination and perception. Echoing findings in vision, cross-domain decoding accuracy increased with imagery strength. These data suggest that light-independent PSDs are a neural signature sensitive enough to decode imagination.

Embodied Cognition in Performance: The Impact of Michael Chekhov's Acting Exercises on Affect and Height Perception

Modern embodied approaches to cognitive science overlap with ideas long explored in theater. Performance coaches such as Michael Chekhov have emphasized proprioceptive awareness of movement as a path to attaining psychological states relevant for embodying characters and inhabiting fictional spaces. Yet, the psychology of performance remains scientifically understudied. Experiments, presented in this paper, investigated the effects of three sets of exercises adapted from Chekhov's influential techniques for actors' training. Following a continuous physical demonstration and verbal prompts by the actress Bonnie Eckard, 29 participants enacted neutral, expanding, and contracting gestures and attitudes in space. After each set of exercises, the participants' affect (pleasantness and arousal) and self-perceptions of height were measured. Within the limitations of the study, we measured a significant impact of the exercises on affect: pleasantness increased by 50% after 15 min of expanding exercises and arousal increased by 15% after 15 min of contracting exercises, each relative to the other exercise. Although the exercises produced statistically non-significant changes in the perceived height, there was a significant relation between perceived height and affect, in which perceived height increased with increases in either pleasantness, or arousal. These findings provide a preliminary support for Chekhov's intuition that expanding and contracting physical actions exert opposite effects on the practitioners' psychological experience. Further studies are needed to consider a wider range of factors at work in Chekhov's method and the embodied experience of acting in general.

Cortical modulation of pupillary function: systematic review

BACKGROUND

The pupillary light reflex is the main mechanism that regulates the pupillary diameter; it is controlled by the autonomic system and mediated by subcortical pathways. In addition, cognitive and emotional processes influence pupillary function due to input from cortical innervation, but the exact circuits remain poorly understood. We performed a systematic review to evaluate the mechanisms behind pupillary changes associated with cognitive efforts and processing of emotions and to investigate the cerebral areas involved in cortical modulation of the pupillary light reflex.

METHODOLOGY

We searched multiple databases until November 2018 for studies on cortical modulation of pupillary function in humans and non-human primates. Of 8,809 papers screened, 258 studies were included.

RESULTS

Most investigators focused on pupillary dilatation and/or constriction as an index of cognitive and emotional processing, evaluating how changes in pupillary diameter reflect levels of attention and arousal. Only few tried to correlate specific cerebral areas to pupillary changes, using either cortical activation models (employing micro-stimulation of cortical structures in non-human primates) or cortical lesion models (e.g., investigating patients with stroke and damage to salient cortical and/or subcortical areas). Results suggest the involvement of several cortical regions, including the insular cortex (Brodmann areas 13 and 16), the frontal eye field (Brodmann area 8) and the prefrontal cortex (Brodmann areas 11 and 25), and of subcortical structures such as the locus coeruleus and the superior colliculus.

CONCLUSIONS

Pupillary dilatation occurs with many kinds of mental or emotional processes, following sympathetic activation or parasympathetic inhibition. Conversely, pupillary constriction may occur with anticipation of a bright stimulus (even in its absence) and relies on a parasympathetic activation. All these reactions are controlled by subcortical and cortical structures that are directly or indirectly connected to the brainstem pupillary innervation system.