1
|
Lettieri G, Handjaras G, Cappello EM, Setti F, Bottari D, Bruno V, Diano M, Leo A, Tinti C, Garbarini F, Pietrini P, Ricciardi E, Cecchetti L. Dissecting abstract, modality-specific and experience-dependent coding of affect in the human brain. Sci Adv 2024; 10:eadk6840. [PMID: 38457501 PMCID: PMC10923499 DOI: 10.1126/sciadv.adk6840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 02/06/2024] [Indexed: 03/10/2024]
Abstract
Emotion and perception are tightly intertwined, as affective experiences often arise from the appraisal of sensory information. Nonetheless, whether the brain encodes emotional instances using a sensory-specific code or in a more abstract manner is unclear. Here, we answer this question by measuring the association between emotion ratings collected during a unisensory or multisensory presentation of a full-length movie and brain activity recorded in typically developed, congenitally blind and congenitally deaf participants. Emotional instances are encoded in a vast network encompassing sensory, prefrontal, and temporal cortices. Within this network, the ventromedial prefrontal cortex stores a categorical representation of emotion independent of modality and previous sensory experience, and the posterior superior temporal cortex maps the valence dimension using an abstract code. Sensory experience more than modality affects how the brain organizes emotional information outside supramodal regions, suggesting the existence of a scaffold for the representation of emotional states where sensory inputs during development shape its functioning.
Collapse
Affiliation(s)
- Giada Lettieri
- Crossmodal Perception and Plasticity Laboratory, Institute of Research in Psychology & Institute of Neuroscience, Université Catholique de Louvain, Louvain-la-Neuve, Belgium
- Social and Affective Neuroscience Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Giacomo Handjaras
- Social and Affective Neuroscience Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Elisa M. Cappello
- Social and Affective Neuroscience Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Francesca Setti
- Sensorimotor Experiences and Mental Representations Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Davide Bottari
- Sensorimotor Experiences and Mental Representations Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
- Sensory Experience Dependent Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | | - Matteo Diano
- Department of Psychology, University of Turin, Turin, Italy
| | - Andrea Leo
- Department of of Translational Research and Advanced Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Carla Tinti
- Department of Psychology, University of Turin, Turin, Italy
| | | | - Pietro Pietrini
- Forensic Neuroscience and Psychiatry Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Emiliano Ricciardi
- Sensorimotor Experiences and Mental Representations Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
- Sensory Experience Dependent Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Luca Cecchetti
- Social and Affective Neuroscience Group, MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| |
Collapse
|
2
|
Fakheir Y, Khalil R. The effects of abnormal visual experience on neurodevelopmental disorders. Dev Psychobiol 2023; 65:e22408. [PMID: 37607893 DOI: 10.1002/dev.22408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 05/14/2023] [Accepted: 06/13/2023] [Indexed: 08/24/2023]
Abstract
Normal visual development is supported by intrinsic neurobiological mechanisms and by appropriate stimulation from the environment, both of which facilitate the maturation of visual functions. However, an offset of this balance can give rise to visual disorders. Therefore, understanding the factors that support normal vision during development and in the mature brain is important, as vision guides movement, enables social interaction, and allows children to recognize and understand their environment. In this paper, we review fundamental mechanisms that support the maturation of visual functions and discuss and draw links between the perceptual and neurobiological impairments in autism spectrum disorder (ASD) and schizophrenia. We aim to explore how this is evident in the case of ASD, and how perceptual and neurobiological deficits further degrade social ability. Furthermore, we describe the altered perceptual experience of those with schizophrenia and evaluate theories of the underlying neural deficits that alter perception.
Collapse
Affiliation(s)
- Yara Fakheir
- Department of Biology, Chemistry, and Environmental Sciences, American University of Sharjah, Sharjah, UAE
| | - Reem Khalil
- Department of Biology, Chemistry, and Environmental Sciences, American University of Sharjah, Sharjah, UAE
| |
Collapse
|
3
|
Setti F, Handjaras G, Bottari D, Leo A, Diano M, Bruno V, Tinti C, Cecchetti L, Garbarini F, Pietrini P, Ricciardi E. A modality-independent proto-organization of human multisensory areas. Nat Hum Behav 2023; 7:397-410. [PMID: 36646839 PMCID: PMC10038796 DOI: 10.1038/s41562-022-01507-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 12/05/2022] [Indexed: 01/18/2023]
Abstract
The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.
Collapse
Affiliation(s)
- Francesca Setti
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | | - Davide Bottari
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Andrea Leo
- Department of Translational Research and Advanced Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Matteo Diano
- Department of Psychology, University of Turin, Turin, Italy
| | - Valentina Bruno
- Manibus Lab, Department of Psychology, University of Turin, Turin, Italy
| | - Carla Tinti
- Department of Psychology, University of Turin, Turin, Italy
| | - Luca Cecchetti
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | | - Pietro Pietrini
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | |
Collapse
|
4
|
Manini B, Vinogradova V, Woll B, Cameron D, Eimer M, Cardin V. Sensory experience modulates the reorganization of auditory regions for executive processing. Brain 2022; 145:3698-3710. [PMID: 35653493 PMCID: PMC9586534 DOI: 10.1093/brain/awac205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Revised: 04/20/2022] [Accepted: 05/20/2022] [Indexed: 11/13/2022] Open
Abstract
Crossmodal plasticity refers to the reorganisation of sensory cortices in the absence of their typical main sensory input. Understanding this phenomenon provides insights into brain function and its potential for change and enhancement. Using fMRI, we investigated how early deafness influences crossmodal plasticity and the organisation of executive functions in the adult human brain. Deaf (N = 25; age: mean = 41.68, range = 19-66, SD = 14.38; 16 female, 9 male) and hearing (N = 20; age: mean= 37.50, range= 18-66, SD= 16.85; 15 female, 5 male) participants performed four visual tasks tapping into different components of executive processing: task switching, working memory, planning and inhibition. Our results show that deaf individuals specifically recruit "auditory" regions during task switching. Neural activity in superior temporal regions, most significantly in the right hemisphere, are good predictors of behavioural performance during task switching in the group of deaf individuals, highlighting the functional relevance of the observed cortical reorganisation. Our results show executive processing in typically sensory regions, suggesting that the development and ultimate role of brain regions are influenced by perceptual environmental experience.
Collapse
Affiliation(s)
- Barbara Manini
- Deafness, Cognition and Language Research Centre and Department of Experimental Psychology, UCL, London, UK, WC1H 0PD
| | | | - Bencie Woll
- Deafness, Cognition and Language Research Centre and Department of Experimental Psychology, UCL, London, UK, WC1H 0PD
| | - Donnie Cameron
- Norwich Medical School, University of East Anglia, Norwich, UK, NR4 7TJ
| | - Martin Eimer
- Department of Psychological Sciences, Birkbeck, University of London, London, UK, WC1E 7HX
| | - Velia Cardin
- Deafness, Cognition and Language Research Centre and Department of Experimental Psychology, UCL, London, UK, WC1H 0PD
| |
Collapse
|
5
|
Bednaya E, Pavani F, Ricciardi E, Pietrini P, Bottari D. Oscillatory signatures of Repetition Suppression and Novelty Detection reveal altered induced visual responses in early deafness. Cortex 2021; 142:138-153. [PMID: 34265736 DOI: 10.1016/j.cortex.2021.05.017] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 04/01/2021] [Accepted: 05/17/2021] [Indexed: 12/26/2022]
Abstract
The ability to differentiate between repeated and novel events represents a fundamental property of the visual system. Neural responses are typically reduced upon stimulus repetition, a phenomenon called Repetition Suppression (RS). On the contrary, following a novel visual stimulus, the neural response is generally enhanced, a phenomenon referred to as Novelty Detection (ND). Here, we aimed to investigate the impact of early deafness on the oscillatory signatures of RS and ND brain responses. To this aim, electrophysiological data were acquired in early deaf and hearing control individuals during processing of repeated and novel visual events unattended by participants. By studying evoked and induced oscillatory brain activities, as well as inter-trial phase coherence, we linked response modulations to feedback and/or feedforward processes. Results revealed selective experience-dependent changes on both RS and ND mechanisms. Compared to hearing controls, early deaf individuals displayed: (i) greater attenuation of the response following stimulus repetition, selectively in the induced theta-band (4-7 Hz); (ii) reduced desynchronization following the onset of novel visual stimuli, in the induced alpha and beta bands (8-12 and 13-25 Hz); (iii) comparable modulation of evoked responses and inter-trial phase coherence. The selectivity of the effects in the induced responses parallels findings observed in the auditory cortex of deaf animal models following intracochlear electric stimulation. The present results support the idea that early deafness alters induced oscillatory activity and the functional tuning of basic visual processing.
Collapse
Affiliation(s)
- Evgenia Bednaya
- Molecular Mind Laboratory, IMT School for Advanced Studies Lucca, Italy
| | - Francesco Pavani
- Center for Mind/Brain Sciences - CIMeC, University of Trento, Italy; Department of Psychology and Cognitive Science, University of Trento, Italy
| | | | - Pietro Pietrini
- Molecular Mind Laboratory, IMT School for Advanced Studies Lucca, Italy
| | - Davide Bottari
- Molecular Mind Laboratory, IMT School for Advanced Studies Lucca, Italy.
| |
Collapse
|
6
|
Bottari D, Berto M. Three factors to characterize plastic potential transitions in the visual system. Neurosci Biobehav Rev 2021; 126:444-446. [PMID: 33857578 DOI: 10.1016/j.neubiorev.2021.03.035] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Revised: 03/08/2021] [Accepted: 03/19/2021] [Indexed: 11/28/2022]
Abstract
A comprehensive understanding of brain-environment interactions is elusive even at the sensory level as neural plasticity waxes and wanes across the lifespan. Temporary and permanent visual deprivations remain pivotal approaches for studying the degree of experience-dependent plasticity of sensory functions. Natural models and experimental manipulations of visual experiences have contributed to uncovering some of the guiding principles that characterize transitions of plastic potentials in the human visual system. The existing literature regarding the neural plasticity associated with visual systems has been extensively discussed by two recent reviews articles (Röder et al., 2020; Castaldi et al., 2020) which provided an overview of different models of study and methods of investigations, gathering insights on both developing and adult brains. Here, we propose a framework of three main factors to characterize how the driving forces shaping visual circuits mutate, both quantitatively and qualitatively, between early development and adulthood.
Collapse
Affiliation(s)
- Davide Bottari
- Molecular Mind Lab, IMT School for Advanced Studies Lucca, Italy.
| | - Martina Berto
- Molecular Mind Lab, IMT School for Advanced Studies Lucca, Italy
| |
Collapse
|
7
|
Abstract
Spatial representation has been widely studied in early blindness, whereas research about late blindness is still limited. We recently demonstrated that the early (50-90 ms) event-related potential (ERP) response observed in sighted people during a spatial bisection task, is altered in early blind people and is influenced by the amount of time spent without vision in late blind individuals. Specifically, in late blind people a shorter period of blindness is associated with strong contralateral activation in occipital cortex and good performance during the spatial task-similar to that of sighted people. In contrast, non-lateralized occipital activation and lower performance characterize late blind individuals who have experienced a longer period of blindness-similar to that of early blind people. However, the same early occipital response activated in sighted individuals by spatial cues has been found to be activated by temporal cues in early blind individuals. Here, we investigate whether a similar temporal attraction can explain the neural and behavioral changes observed after many years of blindness in late blind people. An EEG recording was taken during a spatial bisection task where coherent and conflicting spatio-temporal information was presented. In participants with long blindness duration, the early recruitment of both visual and auditory areas is sensitive to temporal instead of spatial coordinates. These findings highlight some limits of neuroplasticity. Perceptual advantages from cross-sensory calibration during development seem to be subsequently lost following years of visual deprivation. This result has important implications for clinical outcomes following late blindness, highlighting the importance of timing in intervention and rehabilitation programs that activate compensatory strategies soon after sensory loss.
Collapse
Affiliation(s)
- Maria Bianca Amadeo
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, Università degli Studi di Genova, Genova, Italy
| | - Claudio Campus
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
| | - Monica Gori
- Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|