1
|
Menicucci D, Animali S, Malloggi E, Gemignani A, Bonanni E, Fornai F, Giorgi FS, Binda P. Correlated P300b and phasic pupil-dilation responses to motivationally significant stimuli. Psychophysiology 2024; 61:e14550. [PMID: 38433453 DOI: 10.1111/psyp.14550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 02/11/2024] [Accepted: 02/12/2024] [Indexed: 03/05/2024]
Abstract
Motivationally significant events like oddball stimuli elicit both a characteristic event-related potential (ERPs) known as P300 and a set of autonomic responses including a phasic pupil dilation. Although co-occurring, P300 and pupil-dilation responses to oddball events have been repeatedly found to be uncorrelated, suggesting separate origins. We re-examined their relationship in the context of a three-stimulus version of the auditory oddball task, independently manipulating the frequency (rare vs. repeated) and motivational significance (relevance for the participant's task) of the stimuli. We used independent component analysis to derive a P300b component from EEG traces and linear modeling to separate a stimulus-related pupil-dilation response from a potentially confounding action-related response. These steps revealed that, once the complexity of ERP and pupil-dilation responses to oddball targets is accounted for, the amplitude of phasic pupil dilations and P300b are tightly and positively correlated (across participants: r = .69 p = .002), supporting their coordinated generation.
Collapse
Affiliation(s)
- Danilo Menicucci
- Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy
| | - Silvia Animali
- Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy
| | - Eleonora Malloggi
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Angelo Gemignani
- Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy
| | - Enrica Bonanni
- Department of Clinical and Experimental Medicine, University of Pisa, Pisa, Italy
| | - Francesco Fornai
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Filippo Sean Giorgi
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Paola Binda
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| |
Collapse
|
2
|
Mækelæ MJ, Kreis IV, Pfuhl G. Teleological reasoning bias is predicted by pupil dynamics: Evidence for the extensive integration account of bias in reasoning. Psychophysiology 2024; 61:e14532. [PMID: 38282116 DOI: 10.1111/psyp.14532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 10/13/2023] [Accepted: 01/03/2024] [Indexed: 01/30/2024]
Abstract
Teleological reasoning is the tendency for humans to see purpose and intentionality in natural phenomena when there is none. In this study, we assess three competing theories on how bias in reasoning arises by examining performance on a teleological reasoning task while measuring pupil size and response times. We replicate that humans (N = 45) are prone to accept false teleological explanations. Further, we show that errors on the teleological reasoning task are associated with slower response times, smaller baseline pupil size, and larger pupil dilations. The results are in line with the single-process extensive integration account and directly oppose predictions from dual-processing accounts. Lastly, by modeling responses with a drift-diffusion model, we find that larger baseline pupil size is associated with lower decision threshold and higher drift rate, whereas larger pupil dilations are associated with higher decision threshold and lower drift rate. The results highlight the role of neural gain and the Locus Coeruleus-Norepinephrine system in modulating evidence integration and bias in reasoning. Thus, teleological reasoning and susceptibility to bias likely arise due to extensive processing rather than through fast and effortless processing.
Collapse
Affiliation(s)
| | - Isabel V Kreis
- Department of Psychology, UiT The Arctic University of Norway, Tromsø, Norway
- Institute of Clinical Medicine, University of Oslo, Oslo, Norway
| | - Gerit Pfuhl
- Department of Psychology, UiT The Arctic University of Norway, Tromsø, Norway
- Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|
3
|
Algermissen J, den Ouden HEM. Pupil dilation reflects effortful action invigoration in overcoming aversive Pavlovian biases. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024:10.3758/s13415-024-01191-y. [PMID: 38773022 DOI: 10.3758/s13415-024-01191-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/22/2024] [Indexed: 05/23/2024]
Abstract
"Pavlovian" or "motivational" biases describe the phenomenon that the valence of prospective outcomes modulates action invigoration: Reward prospect invigorates action, whereas punishment prospect suppresses it. The adaptive role of these biases in decision-making is still unclear. One idea is that they constitute a fast-and-frugal decision strategy in situations characterized by high arousal, e.g., in presence of a predator, which demand a quick response. In this pre-registered study (N = 35), we tested whether such a situation-induced via subliminally presented angry versus neutral faces-leads to increased reliance on Pavlovian biases. We measured trial-by-trial arousal by tracking pupil diameter while participants performed an orthogonalized Motivational Go/NoGo Task. Pavlovian biases were present in responses, reaction times, and even gaze, with lower gaze dispersion under aversive cues reflecting "freezing of gaze." The subliminally presented faces did not affect responses, reaction times, or pupil diameter, suggesting that the arousal manipulation was ineffective. However, pupil dilations reflected facets of bias suppression, specifically the physical (but not cognitive) effort needed to overcome aversive inhibition: Particularly strong and sustained dilations occurred when participants managed to perform Go responses to aversive cues. Conversely, no such dilations occurred when they managed to inhibit responses to Win cues. These results suggest that pupil diameter does not reflect response conflict per se nor the inhibition of prepotent responses, but specifically effortful action invigoration as needed to overcome aversive inhibition. We discuss our results in the context of the "value of work" theory of striatal dopamine.
Collapse
Affiliation(s)
- Johannes Algermissen
- Donders Institute for Brain, Radboud University, Cognition, and Behaviour, Thomas van Aquinostraat 4, 6526 GD, Nijmegen, The Netherlands.
- Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Hanneke E M den Ouden
- Donders Institute for Brain, Radboud University, Cognition, and Behaviour, Thomas van Aquinostraat 4, 6526 GD, Nijmegen, The Netherlands.
| |
Collapse
|
4
|
Chang YH, Chen HJ, Barquero C, Tsai HJ, Liang WK, Hsu CH, Muggleton NG, Wang CA. Linking tonic and phasic pupil responses to P300 amplitude in an emotional face-word Stroop task. Psychophysiology 2024; 61:e14479. [PMID: 37920144 DOI: 10.1111/psyp.14479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 09/04/2023] [Accepted: 10/17/2023] [Indexed: 11/04/2023]
Abstract
The locus coeruleus-norepinephrine (LC-NE) system, which regulates arousal levels, is important for cognitive control, including emotional conflict resolution. Additionally, the LC-NE system is implicated in P300 generation. If the P300 is mediated by the LC-NE system, and considering the established correlations between LC activity and pupil dilation, P300 amplitude should correlate with task-evoked (phasic) pupil dilation on a trial-by-trial basis. However, prior studies, predominantly utilizing oddball-type paradigms, have not demonstrated correlations between concurrently recorded task-evoked pupil dilation and P300 responses. Using a recently developed emotional face-word Stroop task that links pupil dilation to the LC-NE system, here, we examined both intra- and inter-individual correlations between task-evoked pupil dilation and P300 amplitude. We found that lower accuracy, slower reaction times, and larger task-evoked pupil dilation were obtained in the incongruent compared to the congruent condition. Furthermore, we observed intra-individual correlations between task-evoked pupil dilation and P300 amplitude, with larger pupil dilation correlating with a greater P300 amplitude. In contrast, pupil dilation did not exhibit consistent correlations with N450 and N170 amplitudes. Baseline (tonic) pupil size also showed correlations with P300 and N170 amplitudes, with smaller pupil size corresponding to larger amplitude. Moreover, inter-individual differences in task-evoked pupil dilation between the congruent and incongruent conditions correlated with differences in reaction time and P300 amplitude, though these effects only approached significance. To summarize, our study provides evidence for a connection between task-evoked pupil dilation and P300 amplitude at the single-trial level, suggesting the involvement of the LC-NE system in P300 generation.
Collapse
Affiliation(s)
- Yi-Hsuan Chang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
| | - He-Jun Chen
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Cesar Barquero
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Physical Activity and Sport Science, Universidad Peruana de Ciencias Aplicadas, Lima, Peru
| | - Hsu Jung Tsai
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Wei-Kuang Liang
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Chun-Hsien Hsu
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
| | - Neil G Muggleton
- Institute of Cognitive Neuroscience, National Central University, Taoyuan City, Taiwan
- Cognitive Intelligence and Precision Healthcare Center, National Central University, Taoyuan City, Taiwan
| | - Chin-An Wang
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| |
Collapse
|
5
|
Skora L, Marzecová A, Jocham G. Tonic and phasic transcutaneous auricular vagus nerve stimulation (taVNS) both evoke rapid and transient pupil dilation. Brain Stimul 2024; 17:233-244. [PMID: 38423207 DOI: 10.1016/j.brs.2024.02.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2023] [Revised: 02/09/2024] [Accepted: 02/20/2024] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Transcutaneous auricular vagus nerve stimulation (tVNS or taVNS) is a non-invasive method of electrical stimulation of the afferent pathway of the vagus nerve, suggested to drive changes in putative physiological markers of noradrenergic activity, including pupil dilation. OBJECTIVE However, it is unknown whether different taVNS modes can map onto the phasic and tonic modes of noradrenergic activity. The effects of taVNS on pupil dilation in humans are inconsistent, largely due to differences in stimulation protocols. Here, we attempted to address these issues. METHODS We investigated pupil dilation under phasic (1 s) and tonic (30 s) taVNS, in a pre-registered, single-blind, sham-controlled, within-subject cross-over design, in the absence of a behavioural task. RESULTS Phasic taVNS induced a rapid increase in pupil size over baseline, significantly greater than under sham stimulation, which rapidly declined after stimulation offset. Tonic taVNS induced a similarly rapid (and larger than sham) increase in pupil size over baseline, returning to baseline within 5 s, despite the ongoing stimulation. Thus, both active and sham tonic modes closely resembled the phasic effect. There were no differences in tonic baseline pupil size, and no sustained effects of stimulation on tonic baseline pupil size. CONCLUSIONS These results suggest that both phasic- and tonic-like taVNS under the standard stimulation parameters may modulate primarily the phasic mode of noradrenergic activity, as indexed by evoked pupil dilation, over and above somatosensory effects. This result sheds light on the temporal profile of phasic and tonic stimulation, with implications for their applicability in further research.
Collapse
Affiliation(s)
- Lina Skora
- Heinrich Heine University Düsseldorf, Germany; University of Sussex, Brighton, UK.
| | | | | |
Collapse
|
6
|
Spaeth AM, Koenig S, Everaert J, Glombiewski JA, Kube T. Are depressive symptoms linked to a reduced pupillary response to novel positive information?-An eye tracking proof-of-concept study. Front Psychol 2024; 15:1253045. [PMID: 38464618 PMCID: PMC10920252 DOI: 10.3389/fpsyg.2024.1253045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 01/31/2024] [Indexed: 03/12/2024] Open
Abstract
Introduction Depressive symptoms have been linked to difficulties in revising established negative beliefs in response to novel positive information. Recent predictive processing accounts have suggested that this bias in belief updating may be related to a blunted processing of positive prediction errors at the neural level. In this proof-of-concept study, pupil dilation in response to unexpected positive emotional information was examined as a psychophysiological marker of an attenuated processing of positive prediction errors associated with depressive symptoms. Methods Participants (N = 34) completed a modified version of the emotional Bias Against Disconfirmatory Evidence (BADE) task in which scenarios initially suggest negative interpretations that are later either confirmed or disconfirmed by additional information. Pupil dilation in response to the confirmatory and disconfirmatory information was recorded. Results Behavioral results showed that depressive symptoms were related to difficulties in revising negative interpretations despite disconfirmatory positive information. The eye tracking results pointed to a reduced pupil response to unexpected positive information among people with elevated depressive symptoms. Discussion Altogether, the present study demonstrates that the adapted emotional BADE task can be appropriate for examining psychophysiological aspects such as changes in pupil size along with behavioral responses. Furthermore, the results suggest that depression may be characterized by deviations in both behavioral (i.e., reduced updating of negative beliefs) and psychophysiological (i.e., decreased pupil dilation) responses to unexpected positive information. Future work should focus on a larger sample including clinically depressed patients to further explore these findings.
Collapse
Affiliation(s)
- Alexandra M. Spaeth
- Department of Psychology, University of Kaiserslautern-Landau, Landau, Germany
| | - Stephan Koenig
- Department of Psychology, University of Kaiserslautern-Landau, Landau, Germany
| | - Jonas Everaert
- Department of Medical and Clinical Psychology, Tilburg University, Tilburg, Netherlands
- Research Group of Quantitative Psychology and Individual Differences, KU Leuven, Leuven, Belgium
| | | | - Tobias Kube
- Department of Psychology, University of Kaiserslautern-Landau, Landau, Germany
| |
Collapse
|
7
|
De Filippo R, Schmitz D. Synthetic surprise as the foundation of the psychedelic experience. Neurosci Biobehav Rev 2024; 157:105538. [PMID: 38220035 PMCID: PMC10839673 DOI: 10.1016/j.neubiorev.2024.105538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 01/03/2024] [Accepted: 01/05/2024] [Indexed: 01/16/2024]
Abstract
Psychedelic agents, such as LSD and psilocybin, induce marked alterations in consciousness via activation of the 5-HT2A receptor (5-HT2ARs). We hypothesize that psychedelics enforce a state of synthetic surprise through the biased activation of the 5-HTRs system. This idea is informed by recent insights into the role of 5-HT in signaling surprise. The effects on consciousness, explained by the cognitive penetrability of perception, can be described within the predictive coding framework where surprise corresponds to prediction error, the mismatch between predictions and actual sensory input. Crucially, the precision afforded to the prediction error determines its effect on priors, enabling a dynamic interaction between top-down expectations and incoming sensory data. By integrating recent findings on predictive coding circuitry and 5-HT2ARs transcriptomic data, we propose a biological implementation with emphasis on the role of inhibitory interneurons. Implications arise for the clinical use of psychedelics, which may rely primarily on their inherent capacity to induce surprise in order to disrupt maladaptive patterns.
Collapse
Affiliation(s)
- Roberto De Filippo
- Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, Neuroscience Research Center, 10117 Berlin, Germany.
| | - Dietmar Schmitz
- Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, Neuroscience Research Center, 10117 Berlin, Germany; German Center for Neurodegenerative Diseases (DZNE) Berlin, 10117 Berlin, Germany; Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, Einstein Center for Neuroscience, 10117 Berlin, Germany; Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität Berlin, and Berlin Institute of Health, NeuroCure Cluster of Excellence, 10117 Berlin, Germany; Humboldt-Universität zu Berlin, Bernstein Center for Computational Neuroscience, Philippstr. 13, 10115 Berlin, Germany
| |
Collapse
|
8
|
Nuiten SA, de Gee JW, Zantvoord JB, Fahrenfort JJ, van Gaal S. Catecholaminergic neuromodulation and selective attention jointly shape perceptual decision-making. eLife 2023; 12:RP87022. [PMID: 38038722 PMCID: PMC10691802 DOI: 10.7554/elife.87022] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2023] Open
Abstract
Perceptual decisions about sensory input are influenced by fluctuations in ongoing neural activity, most prominently driven by attention and neuromodulator systems. It is currently unknown if neuromodulator activity and attention differentially modulate perceptual decision-making and/or whether neuromodulatory systems in fact control attentional processes. To investigate the effects of two distinct neuromodulatory systems and spatial attention on perceptual decisions, we pharmacologically elevated cholinergic (through donepezil) and catecholaminergic (through atomoxetine) levels in humans performing a visuo-spatial attention task, while we measured electroencephalography (EEG). Both attention and catecholaminergic enhancement improved decision-making at the behavioral and algorithmic level, as reflected in increased perceptual sensitivity and the modulation of the drift rate parameter derived from drift diffusion modeling. Univariate analyses of EEG data time-locked to the attentional cue, the target stimulus, and the motor response further revealed that attention and catecholaminergic enhancement both modulated pre-stimulus cortical excitability, cue- and stimulus-evoked sensory activity, as well as parietal evidence accumulation signals. Interestingly, we observed both similar, unique, and interactive effects of attention and catecholaminergic neuromodulation on these behavioral, algorithmic, and neural markers of the decision-making process. Thereby, this study reveals an intricate relationship between attentional and catecholaminergic systems and advances our understanding about how these systems jointly shape various stages of perceptual decision-making.
Collapse
Affiliation(s)
- Stijn A Nuiten
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
- Department of Psychiatry (UPK), University of BaselBaselSwitzerland
| | - Jan Willem de Gee
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
- Jan and Dan Duncan Neurological Research Institute, Texas Children’s HospitalHoustonUnited States
- Department of Neuroscience, Baylor College of MedicineHoustonUnited States
- Cognitive and Systems Neuroscience, Swammerdam Institute for Life Sciences, University of AmsterdamAmsterdamNetherlands
| | - Jasper B Zantvoord
- Department of Psychiatry, Amsterdam UMC location University of AmsterdamAmsterdamNetherlands
- Amsterdam NeuroscienceAmsterdamNetherlands
| | - Johannes J Fahrenfort
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
- Institute for Brain and Behavior Amsterdam, Vrije Universiteit AmsterdamAmsterdamNetherlands
- Department of Experimental and Applied Psychology - Cognitive Psychology, Vrije Universiteit AmsterdamAmsterdamNetherlands
| | - Simon van Gaal
- Department of Psychology, University of AmsterdamAmsterdamNetherlands
- Amsterdam Brain & Cognition, University of AmsterdamAmsterdamNetherlands
| |
Collapse
|
9
|
Lee H, Lee SH. Boundary updating as a source of history effect on decision uncertainty. iScience 2023; 26:108314. [PMID: 38026228 PMCID: PMC10665832 DOI: 10.1016/j.isci.2023.108314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 09/27/2023] [Accepted: 10/20/2023] [Indexed: 12/01/2023] Open
Abstract
When sorting a sequence of stimuli into binary classes, current choices are often negatively correlated with recent stimulus history. This phenomenon-dubbed the repulsive bias-can be explained by boundary updating, a process of shifting the class boundary to previous stimuli. This explanation implies that recent stimulus history can also influence "decision uncertainty," the probability of making incorrect decisions, because it depends on the location of the boundary. However, there have been no previous efforts to elucidate the impact of previous stimulus history on decision uncertainty. Here, from the boundary-updating process that accounts for the repulsive bias, we derived a prediction that decision uncertainty increases as current choices become more congruent with previous stimuli. We confirmed this prediction in behavioral, physiological, and neural correlates of decision uncertainty. Our work demonstrates that boundary updating offers a principled account of how previous stimulus history concurrently relates to choice bias and decision uncertainty.
Collapse
Affiliation(s)
- Heeseung Lee
- Department of Brain and Cognitive Sciences, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Republic of Korea
| | - Sang-Hun Lee
- Department of Brain and Cognitive Sciences, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul 08826, Republic of Korea
| |
Collapse
|
10
|
Tan SHJ, Kalashnikova M, Di Liberto GM, Crosse MJ, Burnham D. Seeing a Talking Face Matters: Gaze Behavior and the Auditory-Visual Speech Benefit in Adults' Cortical Tracking of Infant-directed Speech. J Cogn Neurosci 2023; 35:1741-1759. [PMID: 37677057 DOI: 10.1162/jocn_a_02044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
In face-to-face conversations, listeners gather visual speech information from a speaker's talking face that enhances their perception of the incoming auditory speech signal. This auditory-visual (AV) speech benefit is evident even in quiet environments but is stronger in situations that require greater listening effort such as when the speech signal itself deviates from listeners' expectations. One example is infant-directed speech (IDS) presented to adults. IDS has exaggerated acoustic properties that are easily discriminable from adult-directed speech (ADS). Although IDS is a speech register that adults typically use with infants, no previous neurophysiological study has directly examined whether adult listeners process IDS differently from ADS. To address this, the current study simultaneously recorded EEG and eye-tracking data from adult participants as they were presented with auditory-only (AO), visual-only, and AV recordings of IDS and ADS. Eye-tracking data were recorded because looking behavior to the speaker's eyes and mouth modulates the extent of AV speech benefit experienced. Analyses of cortical tracking accuracy revealed that cortical tracking of the speech envelope was significant in AO and AV modalities for IDS and ADS. However, the AV speech benefit [i.e., AV > (A + V)] was only present for IDS trials. Gaze behavior analyses indicated differences in looking behavior during IDS and ADS trials. Surprisingly, looking behavior to the speaker's eyes and mouth was not correlated with cortical tracking accuracy. Additional exploratory analyses indicated that attention to the whole display was negatively correlated with cortical tracking accuracy of AO and visual-only trials in IDS. Our results underscore the nuances involved in the relationship between neurophysiological AV speech benefit and looking behavior.
Collapse
Affiliation(s)
- Sok Hui Jessica Tan
- The MARCS Institute of Brain, Behaviour and Development, Western Sydney University, Australia
- Science of Learning in Education Centre, Office of Education Research, National Institute of Education, Nanyang Technological University, Singapore
| | - Marina Kalashnikova
- The Basque Center on Cognition, Brain and Language
- IKERBASQUE, Basque Foundation for Science
| | - Giovanni M Di Liberto
- ADAPT Centre, School of Computer Science and Statistics, Trinity College Institute of Neuroscience, Trinity College, The University of Dublin, Ireland
| | - Michael J Crosse
- SEGOTIA, Galway, Ireland
- Trinity Center for Biomedical Engineering, Department of Mechanical, Manufacturing & Biomedical Engineering, Trinity College Dublin, Dublin, Ireland
| | - Denis Burnham
- The MARCS Institute of Brain, Behaviour and Development, Western Sydney University, Australia
| |
Collapse
|
11
|
Klaver LMF, Brinkhof LP, Sikkens T, Casado-Román L, Williams AG, van Mourik-Donga L, Mejías JF, Pennartz CMA, Bosman CA. Spontaneous variations in arousal modulate subsequent visual processing and local field potential dynamics in the ferret during quiet wakefulness. Cereb Cortex 2023; 33:7564-7581. [PMID: 36935096 PMCID: PMC10267643 DOI: 10.1093/cercor/bhad061] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 02/11/2023] [Accepted: 02/14/2023] [Indexed: 03/21/2023] Open
Abstract
Behavioral states affect neuronal responses throughout the cortex and influence visual processing. Quiet wakefulness (QW) is a behavioral state during which subjects are quiescent but awake and connected to the environment. Here, we examined the effects of pre-stimulus arousal variability on post-stimulus neural activity in the primary visual cortex and posterior parietal cortex in awake ferrets, using pupil diameter as an indicator of arousal. We observed that the power of stimuli-induced alpha (8-12 Hz) decreases when the arousal level increases. The peak of alpha power shifts depending on arousal. High arousal increases inter- and intra-areal coherence. Using a simplified model of laminar circuits, we show that this connectivity pattern is compatible with feedback signals targeting infragranular layers in area posterior parietal cortex and supragranular layers in V1. During high arousal, neurons in V1 displayed higher firing rates at their preferred orientations. Broad-spiking cells in V1 are entrained to high-frequency oscillations (>80 Hz), whereas narrow-spiking neurons are phase-locked to low- (12-18 Hz) and high-frequency (>80 Hz) rhythms. These results indicate that the variability and sensitivity of post-stimulus cortical responses and coherence depend on the pre-stimulus behavioral state and account for the neuronal response variability observed during repeated stimulation.
Collapse
Affiliation(s)
- Lianne M F Klaver
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Lotte P Brinkhof
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Tom Sikkens
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Lorena Casado-Román
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Alex G Williams
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Laura van Mourik-Donga
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
| | - Jorge F Mejías
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
- Research Priority Program Brain and Cognition, University of Amsterdam, Amsterdam, The Netherlands
| | - Cyriel M A Pennartz
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
- Research Priority Program Brain and Cognition, University of Amsterdam, Amsterdam, The Netherlands
| | - Conrado A Bosman
- Swammerdam Institute for Life Sciences, University of Amsterdam, Science Park 904, 1098 XH Amsterdam, The Netherlands
- Research Priority Program Brain and Cognition, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
12
|
Rutar D, Colizoli O, Selen L, Spieß L, Kwisthout J, Hunnius S. Differentiating between Bayesian parameter learning and structure learning based on behavioural and pupil measures. PLoS One 2023; 18:e0270619. [PMID: 36795714 PMCID: PMC9934335 DOI: 10.1371/journal.pone.0270619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Accepted: 01/18/2023] [Indexed: 02/17/2023] Open
Abstract
Within predictive processing two kinds of learning can be distinguished: parameter learning and structure learning. In Bayesian parameter learning, parameters under a specific generative model are continuously being updated in light of new evidence. However, this learning mechanism cannot explain how new parameters are added to a model. Structure learning, unlike parameter learning, makes structural changes to a generative model by altering its causal connections or adding or removing parameters. Whilst these two types of learning have recently been formally differentiated, they have not been empirically distinguished. The aim of this research was to empirically differentiate between parameter learning and structure learning on the basis of how they affect pupil dilation. Participants took part in a within-subject computer-based learning experiment with two phases. In the first phase, participants had to learn the relationship between cues and target stimuli. In the second phase, they had to learn a conditional change in this relationship. Our results show that the learning dynamics were indeed qualitatively different between the two experimental phases, but in the opposite direction as we originally expected. Participants were learning more gradually in the second phase compared to the first phase. This might imply that participants built multiple models from scratch in the first phase (structure learning) before settling on one of these models. In the second phase, participants possibly just needed to update the probability distribution over the model parameters (parameter learning).
Collapse
Affiliation(s)
- Danaja Rutar
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
- Leverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, United Kingdom
- * E-mail:
| | - Olympia Colizoli
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Luc Selen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | | | - Johan Kwisthout
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Sabine Hunnius
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|