1
|
Scrivener CL, Teed JA, Silson EH. Visual imagery of familiar people and places in category selective cortex. Neurosci Conscious 2025; 2025:niaf006. [PMID: 40241880 PMCID: PMC12003044 DOI: 10.1093/nc/niaf006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 02/03/2025] [Accepted: 03/13/2025] [Indexed: 04/18/2025] Open
Abstract
Visual imagery is a dynamic process recruiting a network of brain regions. We used electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) fusion to investigate the dynamics of category selective imagery in medial parietal cortex (MPC), ventral temporal cortex (VTC), and primary visual cortex (V1). Subjects attended separate EEG and fMRI sessions where they created mental images of personally familiar people and place stimuli. The fMRI contrast comparing people and place imagery replicated previous findings of category-selectivity in the medial parietal cortex. In addition, greater activity for places was found in the ventral and lateral place memory areas, the frontal eye fields, the inferior temporal sulcus, and the intraparietal sulcus. In contrast, greater activity for people was found in the fusiform face area and the right posterior superior temporal sulcus. Using multivariate decoding analysis in fMRI, we could decode individual stimuli within the preferred category in VTC. A more complex pattern emerged in MPC, which represented information that was not restricted to the preferred category. We were also able to decode category and individual stimuli in the EEG data. EEG-fMRI fusion indicated similar timings in MPC and VTC activity during imagery. However, in the VTC, fusion was higher in place selective regions during an early time window, and higher in face selective regions in a later time window. In contrast, fusion correlations in V1 occurred later during the imagery period, possibly reflecting the top-down progression of mental imagery from category-selective regions to primary visual cortex.
Collapse
Affiliation(s)
- Catriona L Scrivener
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Jessica A Teed
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Edward H Silson
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
2
|
Vickery T, Singh B, Levy A, Sweetman K, Cronin Z, Intraub H. Neural correlates of boundary extension during visual imagination. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2025:2025.01.31.635941. [PMID: 39975090 PMCID: PMC11838463 DOI: 10.1101/2025.01.31.635941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/21/2025]
Abstract
People typically remember seeing a greater expanse of a scene than was visible in a studied close-up (boundary extension, BE). Multivoxel pattern analysis was used to test the neural correlates of BE. Classifiers were trained using a whole-brain searchlight method to discriminate between close-up and wider-angle versions of 16 scenes during repeated perceptual exposures. Earlier, each subject studied either the close or wide version of each scene and then visually imagined it from memory. If a brain region reflects BE, then unlike classification during perception, visual images of close views should sometimes be misclassified as wide (capturing false memory beyond the view), whereas visual images of wide views should be correctly classified. BE-consistent patterns during imagery were found in high-level visual regions, including posterior superior parietal cortex. This pattern did not reflect a brain-wide bias toward better classification of wider-angle views: the pattern reversed (better classification of close views) in the early visual cortex, presenting a novel distinction between early and late visual representations in imagery. We propose that this method reflects active maintenance of boundary-extended scene representations in memory and that it holds promise as a general purpose tool for decoding false memory in the brain.
Collapse
|
3
|
Montabes de la Cruz BM, Abbatecola C, Luciani RS, Paton AT, Bergmann J, Vetter P, Petro LS, Muckli LF. Decoding sound content in the early visual cortex of aphantasic participants. Curr Biol 2024; 34:5083-5089.e3. [PMID: 39419030 DOI: 10.1016/j.cub.2024.09.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 08/21/2024] [Accepted: 09/04/2024] [Indexed: 10/19/2024]
Abstract
Listening to natural auditory scenes leads to distinct neuronal activity patterns in the early visual cortex (EVC) of blindfolded sighted and congenitally blind participants.1,2 This pattern of sound decoding is organized by eccentricity, with the accuracy of auditory information increasing from foveal to far peripheral retinotopic regions in the EVC (V1, V2, and V3). This functional organization by eccentricity is predicted by primate anatomical connectivity,3,4 where cortical feedback projections from auditory and other non-visual areas preferentially target the periphery of early visual areas. In congenitally blind participants, top-down feedback projections to the visual cortex proliferate,5 which might account for even higher sound-decoding accuracy in the EVC compared with blindfolded sighted participants.2 In contrast, studies in participants with aphantasia suggest an impairment of feedback projections to early visual areas, leading to a loss of visual imagery experience.6,7 This raises the question of whether impaired visual feedback pathways in aphantasia also reduce the transmission of auditory information to early visual areas. We presented auditory scenes to 23 blindfolded aphantasic participants. We found overall decreased sound decoding in early visual areas compared to blindfolded sighted ("control") and blind participants. We further explored this difference by modeling eccentricity effects across the blindfolded control, blind, and aphantasia datasets, and with a whole-brain searchlight analysis. Our findings suggest that the feedback of auditory content to the EVC is reduced in aphantasic participants. Reduced top-down projections might lead to both less sound decoding and reduced subjective experience of visual imagery.
Collapse
Affiliation(s)
- Belén M Montabes de la Cruz
- Centre for Cognitive Neuroimaging, School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, UK
| | - Clement Abbatecola
- Centre for Cognitive Neuroimaging, School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, UK; Imaging Centre for Excellence (ICE), College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G51 4LB, UK
| | - Roberto S Luciani
- Centre for Cognitive Neuroimaging, School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, UK; School of Computing Science, College of Science and Engineering, University of Glasgow, Glasgow G12 8QQ, UK
| | - Angus T Paton
- Centre for Cognitive Neuroimaging, School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, UK; Imaging Centre for Excellence (ICE), College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G51 4LB, UK
| | - Johanna Bergmann
- Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstrasse 1, Leipzig 04303, Germany
| | - Petra Vetter
- Visual & Cognitive Neuroscience Lab, Department of Psychology, University of Fribourg, Fribourg 1700, Switzerland
| | - Lucy S Petro
- Centre for Cognitive Neuroimaging, School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, UK; Imaging Centre for Excellence (ICE), College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G51 4LB, UK
| | - Lars F Muckli
- Centre for Cognitive Neuroimaging, School of Psychology and Neuroscience, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G12 8QB, UK; Imaging Centre for Excellence (ICE), College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow G51 4LB, UK.
| |
Collapse
|
4
|
Zhang YF, Strelnikov K. Similar patterns of brain activity for holistic representation of working memory: a study in children and adults. Cereb Cortex 2024; 34:bhae370. [PMID: 39283613 DOI: 10.1093/cercor/bhae370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Revised: 08/19/2024] [Accepted: 08/27/2024] [Indexed: 01/29/2025] Open
Abstract
Working memory is the fundamental function of the various cognitive processes and abilities in the overall trajectory of development. Significant advances in multivariate analysis of human functional magnetic resonance imaging data have converged functional segregation models toward integrated representation-based models. However, due to the inherent limitations of the multi-voxel pattern analysis method, we are unable to determine whether the underlying neural representations are spatially similar in the brain. Our study attempts to answer this question by examining the spatial similarity of brain activity during the working memory task in children and adults. Our results reveal similar patterns of activity between the regions involved in working memory. This functional network of similar spatial patterns was observed in both normally developing children and adults. However, the between-region similarity was more pronounced in adults than in children and associated with better performance. We propose an exchange of similar information flows through the brain at an integrated level of working memory processes, underpinning the holistic nature of working memory representation.
Collapse
Affiliation(s)
- Yi Fan Zhang
- Faculty of Psychology, University of Clermont Auvergne, 34 Avenue Carnot, 63000 Clermont-Ferrand, France
- UMR 6024, Centre National de la Recherche Scientifique, 34 Avenue Carnot, 63000, Clermont-Ferrand, France
- Laboratory LAPSCO, Clermont-Ferrand, 34 Avenue Carnot, 63000, Clermont-Ferrand, France
| | - Kuzma Strelnikov
- Centre for Cognitive and Brain Sciences, University of Macau, Avenida da Universidade, 999078, Taipa, Macau, SAR, China
- Department of Public Health and Medicinal Administration, Faculty of Health Sciences, University of Macau, Avenida da Universidade, 999078, Macao, SAR, China
| |
Collapse
|
5
|
Dijkstra N, Convertino L, Garfinkel S. How disrupted interoception could lead to disturbances in perceptual reality monitoring. Cogn Neuropsychiatry 2024; 29:219-227. [PMID: 39511981 DOI: 10.1080/13546805.2024.2422620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2024]
Affiliation(s)
- Nadine Dijkstra
- Department of Imaging Neuroscience, Institute of Neurology, University College London, London, UK
| | - Laura Convertino
- King's College London, Institute of Psychiatry, Psychology and Neuroscience, London, UK South London and Maudsley NHS Foundation Trust, London, UK Institute of Cognitive Neuroscience, University College London, London, UK
| | - Sarah Garfinkel
- Institute of Cognitive Neuroscience, Institute of Neurology, University College London, London, UK
| |
Collapse
|
6
|
Park J, Soucy E, Segawa J, Mair R, Konkle T. Immersive scene representation in human visual cortex with ultra-wide-angle neuroimaging. Nat Commun 2024; 15:5477. [PMID: 38942766 PMCID: PMC11213904 DOI: 10.1038/s41467-024-49669-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Accepted: 06/13/2024] [Indexed: 06/30/2024] Open
Abstract
While human vision spans 220°, traditional functional MRI setups display images only up to central 10-15°. Thus, it remains unknown how the brain represents a scene perceived across the full visual field. Here, we introduce a method for ultra-wide angle display and probe signatures of immersive scene representation. An unobstructed view of 175° is achieved by bouncing the projected image off angled-mirrors onto a custom-built curved screen. To avoid perceptual distortion, scenes are created with wide field-of-view from custom virtual environments. We find that immersive scene representation drives medial cortex with far-peripheral preferences, but shows minimal modulation in classic scene regions. Further, scene and face-selective regions maintain their content preferences even with extreme far-periphery stimulation, highlighting that not all far-peripheral information is automatically integrated into scene regions computations. This work provides clarifying evidence on content vs. peripheral preferences in scene representation and opens new avenues to research immersive vision.
Collapse
Affiliation(s)
- Jeongho Park
- Department of Psychology, Harvard University, Cambridge, MA, USA.
| | - Edward Soucy
- Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - Jennifer Segawa
- Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - Ross Mair
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Department of Radiology, Harvard Medical School, Boston, MA, USA
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Talia Konkle
- Department of Psychology, Harvard University, Cambridge, MA, USA
- Center for Brain Science, Harvard University, Cambridge, MA, USA
- Kempner Institute for Biological and Artificial Intelligence, Harvard University, Boston, MA, USA
| |
Collapse
|
7
|
Dijkstra N. Uncovering the Role of the Early Visual Cortex in Visual Mental Imagery. Vision (Basel) 2024; 8:29. [PMID: 38804350 PMCID: PMC11130976 DOI: 10.3390/vision8020029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 04/25/2024] [Accepted: 04/30/2024] [Indexed: 05/29/2024] Open
Abstract
The question of whether the early visual cortex (EVC) is involved in visual mental imagery remains a topic of debate. In this paper, I propose that the inconsistency in findings can be explained by the unique challenges associated with investigating EVC activity during imagery. During perception, the EVC processes low-level features, which means that activity is highly sensitive to variation in visual details. If the EVC has the same role during visual mental imagery, any change in the visual details of the mental image would lead to corresponding changes in EVC activity. Within this context, the question should not be whether the EVC is 'active' during imagery but how its activity relates to specific imagery properties. Studies using methods that are sensitive to variation in low-level features reveal that imagery can recruit the EVC in similar ways as perception. However, not all mental images contain a high level of visual details. Therefore, I end by considering a more nuanced view, which states that imagery can recruit the EVC, but that does not mean that it always does so.
Collapse
Affiliation(s)
- Nadine Dijkstra
- Department of Imaging Neuroscience, Institute of Neurology, University College London, London WC1E 6BT, UK
| |
Collapse
|
8
|
Dijkstra N, Mazor M, Fleming SM. Confidence ratings do not distinguish imagination from reality. J Vis 2024; 24:13. [PMID: 38814936 PMCID: PMC11146086 DOI: 10.1167/jov.24.5.13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 05/03/2024] [Indexed: 06/01/2024] Open
Abstract
Perceptual reality monitoring refers to the ability to distinguish internally triggered imagination from externally triggered reality. Such monitoring can take place at perceptual or cognitive levels-for example, in lucid dreaming, perceptual experience feels real but is accompanied by a cognitive insight that it is not real. We recently developed a paradigm to reveal perceptual reality monitoring errors during wakefulness in the general population, showing that imagined signals can be erroneously attributed to perception during a perceptual detection task. In the current study, we set out to investigate whether people have insight into perceptual reality monitoring errors by additionally measuring perceptual confidence. We used hierarchical Bayesian modeling of confidence criteria to characterize metacognitive insight into the effects of imagery on detection. Over two experiments, we found that confidence criteria moved in tandem with the decision criterion shift, indicating a failure of reality monitoring not only at a perceptual but also at a metacognitive level. These results further show that such failures have a perceptual rather than a decisional origin. Interestingly, offline queries at the end of the experiment revealed global, task-level insight, which was uncorrelated with local, trial-level insight as measured with confidence ratings. Taken together, our results demonstrate that confidence ratings do not distinguish imagination from reality during perceptual detection. Future research should further explore the different cognitive dimensions of insight into reality judgments and how they are related.
Collapse
Affiliation(s)
- Nadine Dijkstra
- Department of Imaging Neuroscience, University College London, London, UK
- https://sites.google.com/view/nadinedijkstra
| | - Matan Mazor
- All Souls College and Department of Experimental Psychology, University of Oxford, Oxford, UK
- matanmazor.github.io
| | - Stephen M Fleming
- Department of Imaging Neuroscience, University College London, London, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
- Department of Experimental Psychology, University College London, London, UK
- https://metacoglab.org/
| |
Collapse
|
9
|
Park J, Soucy E, Segawa J, Mair R, Konkle T. Immersive scene representation in human visual cortex with ultra-wide angle neuroimaging. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.05.14.540275. [PMID: 37292806 PMCID: PMC10245572 DOI: 10.1101/2023.05.14.540275] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
While humans experience the visual environment in a panoramic 220° view, traditional functional MRI setups are limited to display images like postcards in the central 10-15° of the visual field. Thus, it remains unknown how a scene is represented in the brain when perceived across the full visual field. Here, we developed a novel method for ultra-wide angle visual presentation and probed for signatures of immersive scene representation. To accomplish this, we bounced the projected image off angled-mirrors directly onto a custom-built curved screen, creating an unobstructed view of 175°. Scene images were created from custom-built virtual environments with a compatible wide field-of-view to avoid perceptual distortion. We found that immersive scene representation drives medial cortex with far-peripheral preferences, but surprisingly had little effect on classic scene regions. That is, scene regions showed relatively minimal modulation over dramatic changes of visual size. Further, we found that scene and face-selective regions maintain their content preferences even under conditions of central scotoma, when only the extreme far-peripheral visual field is stimulated. These results highlight that not all far-peripheral information is automatically integrated into the computations of scene regions, and that there are routes to high-level visual areas that do not require direct stimulation of the central visual field. Broadly, this work provides new clarifying evidence on content vs. peripheral preferences in scene representation, and opens new neuroimaging research avenues to understand immersive visual representation.
Collapse
Affiliation(s)
| | | | | | - Ross Mair
- Center for Brain Science, Harvard University
- Department of Radiology, Harvard Medical School
- Department of Radiology, Massachusetts General Hospital
| | - Talia Konkle
- Department of Psychology, Harvard University
- Center for Brain Science, Harvard University
- Kempner Institute for Biological and Artificial Intelligence, Harvard University
| |
Collapse
|
10
|
Weber S, Christophel T, Görgen K, Soch J, Haynes J. Working memory signals in early visual cortex are present in weak and strong imagers. Hum Brain Mapp 2024; 45:e26590. [PMID: 38401134 PMCID: PMC10893972 DOI: 10.1002/hbm.26590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 12/06/2023] [Accepted: 12/29/2023] [Indexed: 02/26/2024] Open
Abstract
It has been suggested that visual images are memorized across brief periods of time by vividly imagining them as if they were still there. In line with this, the contents of both working memory and visual imagery are known to be encoded already in early visual cortex. If these signals in early visual areas were indeed to reflect a combined imagery and memory code, one would predict them to be weaker for individuals with reduced visual imagery vividness. Here, we systematically investigated this question in two groups of participants. Strong and weak imagers were asked to remember images across brief delay periods. We were able to reliably reconstruct the memorized stimuli from early visual cortex during the delay. Importantly, in contrast to the prediction, the quality of reconstruction was equally accurate for both strong and weak imagers. The decodable information also closely reflected behavioral precision in both groups, suggesting it could contribute to behavioral performance, even in the extreme case of completely aphantasic individuals. Our data thus suggest that working memory signals in early visual cortex can be present even in the (near) absence of phenomenal imagery.
Collapse
Affiliation(s)
- Simon Weber
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Training Group “Extrospection” and Berlin School of Mind and Brain, Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
| | - Thomas Christophel
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Department of PsychologyHumboldt‐Universität zu BerlinBerlinGermany
| | - Kai Görgen
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
| | - Joram Soch
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Institute of Psychology, Otto von Guericke University MagdeburgMagdeburgGermany
| | - John‐Dylan Haynes
- Bernstein Center for Computational Neuroscience Berlin and Berlin Center for Advanced NeuroimagingCharité ‐ Universitätsmedizin Berlin, corporate member of the Freie Universität Berlin and Humboldt‐Universität zu BerlinBerlinGermany
- Research Training Group “Extrospection” and Berlin School of Mind and Brain, Humboldt‐Universität zu BerlinBerlinGermany
- Research Cluster of Excellence “Science of Intelligence”Technische Universität BerlinBerlinGermany
- Department of PsychologyHumboldt‐Universität zu BerlinBerlinGermany
- Collaborative Research Center “Volition and Cognitive Control”Technische Universität DresdenDresdenGermany
| |
Collapse
|
11
|
Hu Y, Yu Q. Spatiotemporal dynamics of self-generated imagery reveal a reverse cortical hierarchy from cue-induced imagery. Cell Rep 2023; 42:113242. [PMID: 37831604 DOI: 10.1016/j.celrep.2023.113242] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 08/25/2023] [Accepted: 09/25/2023] [Indexed: 10/15/2023] Open
Abstract
Visual imagery allows for the construction of rich internal experience in our mental world. However, it has remained poorly understood how imagery experience derives volitionally as opposed to being cue driven. Here, using electroencephalography and functional magnetic resonance imaging, we systematically investigate the spatiotemporal dynamics of self-generated imagery by having participants volitionally imagining one of the orientations from a learned pool. We contrast self-generated imagery with cue-induced imagery, where participants imagined line orientations based on associative cues acquired previously. Our results reveal overlapping neural signatures of cue-induced and self-generated imagery. Yet, these neural signatures display substantially differential sensitivities to the two types of imagery: self-generated imagery is supported by an enhanced involvement of the anterior cortex in representing imagery contents. By contrast, cue-induced imagery is supported by enhanced imagery representations in the posterior visual cortex. These results jointly support a reverse cortical hierarchy in generating and maintaining imagery contents in self-generated versus externally cued imagery.
Collapse
Affiliation(s)
- Yiheng Hu
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Qing Yu
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China.
| |
Collapse
|
12
|
Dietz CD, Albonico A, Tree JJ, Barton JJS. Visual imagery deficits in posterior cortical atrophy. Cogn Neuropsychol 2023; 40:351-366. [PMID: 38698499 DOI: 10.1080/02643294.2024.2346362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2024]
Abstract
Visual imagery has a close overlapping relationship with visual perception. Posterior cortical atrophy (PCA) is a neurodegenerative syndrome marked by early impairments in visuospatial processing and visual object recognition. We asked whether PCA would therefore also be marked by deficits in visual imagery, tested using objective forced-choice questionnaires, and whether imagery deficits would be selective for certain properties. We recruited four patients with PCA and a patient with integrative visual agnosia due to bilateral occipitotemporal strokes for comparison. We administered a test battery probing imagery for object shape, size, colour lightness, hue, upper-case letters, lower-case letters, word shape, letter construction, and faces. All subjects showed significant impairments in visual imagery, with imagery for lower-case letters most likely to be spared. We conclude that PCA subjects can show severe deficits in visual imagery. Further work is needed to establish how frequently this occurs and how early it can be found.
Collapse
Affiliation(s)
- Connor D Dietz
- Human Vision and Eye Movement Laboratory, Departments of Medicine (Neurology) and Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada
| | - Andrea Albonico
- Human Vision and Eye Movement Laboratory, Departments of Medicine (Neurology) and Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada
| | - Jeremy J Tree
- Department of Psychology, Swansea University, Swansea, UK
| | - Jason J S Barton
- Human Vision and Eye Movement Laboratory, Departments of Medicine (Neurology) and Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, Canada
| |
Collapse
|
13
|
Li S, Zeng X, Shao Z, Yu Q. Neural Representations in Visual and Parietal Cortex Differentiate between Imagined, Perceived, and Illusory Experiences. J Neurosci 2023; 43:6508-6524. [PMID: 37582626 PMCID: PMC10513072 DOI: 10.1523/jneurosci.0592-23.2023] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 07/09/2023] [Accepted: 08/04/2023] [Indexed: 08/17/2023] Open
Abstract
Humans constantly receive massive amounts of information, both perceived from the external environment and imagined from the internal world. To function properly, the brain needs to correctly identify the origin of information being processed. Recent work has suggested common neural substrates for perception and imagery. However, it has remained unclear how the brain differentiates between external and internal experiences with shared neural codes. Here we tested this question in human participants (male and female) by systematically investigating the neural processes underlying the generation and maintenance of visual information from voluntary imagery, veridical perception, and illusion. The inclusion of illusion allowed us to differentiate between objective and subjective internality: while illusion has an objectively internal origin and can be viewed as involuntary imagery, it is also subjectively perceived as having an external origin like perception. Combining fMRI, eye-tracking, multivariate decoding, and encoding approaches, we observed superior orientation representations in parietal cortex during imagery compared with perception, and conversely in early visual cortex. This imagery dominance gradually developed along a posterior-to-anterior cortical hierarchy from early visual to parietal cortex, emerged in the early epoch of imagery and sustained into the delay epoch, and persisted across varied imagined contents. Moreover, representational strength of illusion was more comparable to imagery in early visual cortex, but more comparable to perception in parietal cortex, suggesting content-specific representations in parietal cortex differentiate between subjectively internal and external experiences, as opposed to early visual cortex. These findings together support a domain-general engagement of parietal cortex in internally generated experience.SIGNIFICANCE STATEMENT How does the brain differentiate between imagined and perceived experiences? Combining fMRI, eye-tracking, multivariate decoding, and encoding approaches, the current study revealed enhanced stimulus-specific representations in visual imagery originating from parietal cortex, supporting the subjective experience of imagery. This neural principle was further validated by evidence from visual illusion, wherein illusion resembled perception and imagery at different levels of cortical hierarchy. Our findings provide direct evidence for the critical role of parietal cortex as a domain-general region for content-specific imagery, and offer new insights into the neural mechanisms underlying the differentiation between subjectively internal and external experiences.
Collapse
Affiliation(s)
- Siyi Li
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Xuemei Zeng
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| | - Zhujun Shao
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Qing Yu
- Institute of Neuroscience, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
| |
Collapse
|
14
|
Robinson AK, Quek GL, Carlson TA. Visual Representations: Insights from Neural Decoding. Annu Rev Vis Sci 2023; 9:313-335. [PMID: 36889254 DOI: 10.1146/annurev-vision-100120-025301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/10/2023]
Abstract
Patterns of brain activity contain meaningful information about the perceived world. Recent decades have welcomed a new era in neural analyses, with computational techniques from machine learning applied to neural data to decode information represented in the brain. In this article, we review how decoding approaches have advanced our understanding of visual representations and discuss efforts to characterize both the complexity and the behavioral relevance of these representations. We outline the current consensus regarding the spatiotemporal structure of visual representations and review recent findings that suggest that visual representations are at once robust to perturbations, yet sensitive to different mental states. Beyond representations of the physical world, recent decoding work has shone a light on how the brain instantiates internally generated states, for example, during imagery and prediction. Going forward, decoding has remarkable potential to assess the functional relevance of visual representations for human behavior, reveal how representations change across development and during aging, and uncover their presentation in various mental disorders.
Collapse
Affiliation(s)
- Amanda K Robinson
- Queensland Brain Institute, The University of Queensland, Brisbane, Australia;
| | - Genevieve L Quek
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia;
| | | |
Collapse
|
15
|
Lu X, Wang Q, Li X, Wang G, Chen Y, Li X, Li H. Connectivity reveals homology between the visual systems of the human and macaque brains. Front Neurosci 2023; 17:1207340. [PMID: 37476839 PMCID: PMC10354265 DOI: 10.3389/fnins.2023.1207340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Accepted: 06/20/2023] [Indexed: 07/22/2023] Open
Abstract
The visual systems of humans and nonhuman primates share many similarities in both anatomical and functional organization. Understanding the homology and differences between the two systems can provide important insights into the neural basis of visual perception and cognition. This research aims to investigate the homology between human and macaque visual systems based on connectivity, using diffusion tensor imaging and resting-state functional magnetic resonance imaging to construct structural and functional connectivity fingerprints of the visual systems in humans and macaques, and quantitatively analyze the connectivity patterns. By integrating multimodal magnetic resonance imaging, this research explored the homology and differences between the two systems. The results showed that 9 brain regions in the macaque visual system formed highly homologous mapping relationships with 11 brain regions in the human visual system, and the related brain regions between the two species showed highly structure homologous, with their functional organization being essentially conserved across species. Finally, this research generated a homology information map of the visual system for humans and macaques, providing a new perspective for subsequent cross-species analysis.
Collapse
Affiliation(s)
- Xia Lu
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China
| | - Qianshan Wang
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China
| | - Xiaowen Li
- Shanxi Technology and Business College, Taiyuan, China
| | - Guolan Wang
- Shanxi Technology and Business College, Taiyuan, China
| | - Yifei Chen
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China
| | - Xueqi Li
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China
| | - Haifang Li
- College of Computer Science and Technology, Taiyuan University of Technology, Taiyuan, China
- Shanxi Technology and Business College, Taiyuan, China
| |
Collapse
|
16
|
Kwon S, Kim J, Kim T. Neuropsychological Activations and Networks While Performing Visual and Kinesthetic Motor Imagery. Brain Sci 2023; 13:983. [PMID: 37508915 PMCID: PMC10377687 DOI: 10.3390/brainsci13070983] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 06/18/2023] [Accepted: 06/19/2023] [Indexed: 07/30/2023] Open
Abstract
This study aimed to answer the questions 'What are the neural networks and mechanisms involved in visual and kinesthetic motor imagery?', and 'Is part of cognitive processing included during visual and kinesthetic motor imagery?' by investigating the neurophysiological networks and activations during visual and kinesthetic motor imagery using motor imagery tasks (golf putting). The experiment was conducted with 19 healthy adults. Functional magnetic resonance imaging (fMRI) was used to examine neural activations and networks during visual and kinesthetic motor imagery using golf putting tasks. The findings of the analysis on cerebral activation patterns based on the two distinct types of motor imagery indicate that the posterior lobe, occipital lobe, and limbic lobe exhibited activation, and the right hemisphere was activated during the process of visual motor imagery. The activation of the temporal lobe and the parietal lobe were observed during the process of kinesthetic motor imagery. This study revealed that visual motor imagery elicited stronger activation in the right frontal lobe, whereas kinesthetic motor imagery resulted in greater activation in the left frontal lobe. It seems that kinesthetic motor imagery activates the primary somatosensory cortex (BA 2), the secondary somatosensory cortex (BA 5 and 7), and the temporal lobe areas and induces human sensibility. The present investigation evinced that the neural network and the regions of the brain that are activated exhibit variability contingent on the category of motor imagery.
Collapse
Affiliation(s)
- Sechang Kwon
- Department of Humanities & Arts, Korea Science Academy of KAIST, 105-47, Baegyanggwanmun-ro, Busanjin-gu, Busan 47162, Republic of Korea
- Global Institute for Talented Education, Korea Advanced Institute of Science and Technology (KAIST), 291, Daehak-ro, Yuseong-gu, Daejeon 34141, Republic of Korea
| | - Jingu Kim
- Department of Physical Education, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea
| | - Teri Kim
- Institute of Sports Science, Kyungpook National University, 80 Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea
| |
Collapse
|
17
|
Morris A, Braver T. What is the nature of "internal content" prior to attentional selection? PSYCHOLOGICAL INQUIRY 2023; 33:280-284. [PMID: 37974599 PMCID: PMC10653100 DOI: 10.1080/1047840x.2022.2149196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
|
18
|
Jin L, Yuan M, Zhang W, Wang L, Chen J, Wang F, Zhu J, Liu T, Wei Y, Li Y, Wang W, Li Q, Wei L. Default mode network mechanisms of repeated transcranial magnetic stimulation in heroin addiction. Brain Imaging Behav 2023; 17:54-65. [PMID: 36418675 DOI: 10.1007/s11682-022-00741-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/24/2022] [Indexed: 11/27/2022]
Abstract
Repetitive transcranial magnetic stimulation (rTMS) over the left dorsolateral prefrontal cortex (DLPFC) has been shown to reduce cravings in heroin-dependent (HD) individuals, but the mechanisms underlying the anti-craving effects of rTMS are unknown. Abnormalities in the default mode network (DMN) are known to be consistent findings in HD individuals and are involved in cravings. We assessed the effect of rTMS on DMN activity and its relationship to the treatment response. Thirty HD individuals were included in this self-controlled study, and all HD participants received 10-Hz rTMS 7-session during a week. Data for cravings and withdrawal symptoms and resting-state functional magnetic resonance imaging data were collected before and after rTMS treatment. Thirty demographically matched healthy individuals who did not receive rTMS were included as controls. We focused on changes in coupling seeded from the medial prefrontal cortex (MPFC), posterior cingulate cortex (PCC), and bilateral inferior parietal lobe (IPL), which are the core regions of the DMN. The craving and withdrawal symptom score of HD individuals decreased significantly after rTMS treatment. The left IPL-left middle frontal gyrus coupling and the left IPL-right inferior occipital gyrus coupling decreased significantly, and the changes in the left IPL-left middle frontal gyrus coupling were positively correlated with changes in drug-cue induced cravings. rTMS could modulate the coupling between the DMN and executive control network (ECN). Alterations of the left IPL-left middle frontal gyrus coupling may play an important mechanistic role in reducing drug cue-induced cravings.
Collapse
Affiliation(s)
- Long Jin
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Menghui Yuan
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Wei Zhang
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Lei Wang
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Jiajie Chen
- Department of Radiology, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Fan Wang
- Department of Radiology, Qinhuang Hospital, Xi'an, Shaanxi, China
| | - Jia Zhu
- Department of Radiology, Qinhuang Hospital, Xi'an, Shaanxi, China
| | - Tao Liu
- Department of Radiology, Qinhuang Hospital, Xi'an, Shaanxi, China
| | - Yixin Wei
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Yunbo Li
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China
| | - Wei Wang
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China.
| | - Qiang Li
- Department of Radiology, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China.
| | - Longxiao Wei
- Department of Nuclear Medicine, Tangdu Hospital, Fourth Military Medical University, 569 Xinsi Road, BaQiao District, 710038, Xi'an, Shaanxi, China.
| |
Collapse
|
19
|
Ciarlo A, Russo AG, Ponticorvo S, Di Salle F, Lührs M, Goebel R, Esposito F. Semantic fMRI neurofeedback: A Multi-Subject Study at 3 Tesla. J Neural Eng 2022; 19. [PMID: 35561669 DOI: 10.1088/1741-2552/ac6f81] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 05/13/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Real-time fMRI neurofeedback is a non-invasive procedure allowing the self-regulation of brain functions via enhanced self-control of fMRI based neural activation. In semantic real-time fMRI neurofeedback, an estimated relation between multivariate fMRI activation patterns and abstract mental states is exploited for a multi-dimensional feedback stimulus via real-time representational similarity analysis (rt-RSA). Here, we assessed the performances of this framework in a multi-subject multi-session study on a 3T MRI clinical scanner. APPROACH Eighteen healthy volunteers underwent two semantic real-time fMRI neurofeedback sessions on two different days. In each session, participants were first requested to engage in specific mental states while local fMRI patterns of brain activity were recorded during stimulated mental imagery of concrete objects (pattern generation). The obtained neural representations were to be replicated and modulated by the participants in subsequent runs of the same session under the guidance of a rt-RSA generated visual feedback (pattern modulation). Performance indicators were derived from the rt-RSA output to assess individual abilities in replicating (and maintaining over time) a target pattern. Simulations were carried out to assess the impact of the geometric distortions implied by the low-dimensional representation of patterns' dissimilarities in the visual feedback. MAIN RESULTS Sixteen subjects successfully completed both semantic real-time fMRI neurofeedback sessions. Considering some performance indicators, a significant improvement between the first and the second runs, and within run increasing modulation performances were observed, whereas no improvements were found between sessions. Simulations confirmed that in a small percentage of cases visual feedback could be affected by metric distortions due to dimensionality reduction implicit to the rt-RSA approach. SIGNIFICANCE Our results proved the feasibility of the semantic real-time fMRI neurofeedback at 3T, showing that subjects can successfully modulate and maintain a target mental state, guided by rt-RSA derived feedback. Further development is needed to encourage future clinical applications.
Collapse
Affiliation(s)
- Assunta Ciarlo
- University of Salerno - Baronissi Campus, Via S. Allende, Baronissi, Campania, 84081, ITALY
| | | | - Sara Ponticorvo
- University of Salerno - Baronissi Campus, Via S. Allende, Baronissi, Campania, 84081, ITALY
| | - Francesco Di Salle
- Department of Medicine, Surgery and Dentistry, Scuola Medica Salernitana, University of Salerno - Baronissi Campus, Via S. Allende, Baronissi, Campania, 84081, ITALY
| | - Michael Lührs
- Department of Cognitive Neuroscience, Maastricht University, P.O. Box 616, Maastricht, Limburg, 6200 MD, NETHERLANDS
| | - Rainer Goebel
- Faculty of Psychology, University of Maastricht, P.O. Box 616, 6200 MD Maastricht, The Netherlands, Maastricht, 6200 MD, NETHERLANDS
| | - Fabrizio Esposito
- Department of Advanced Medical and Surgical Sciences, University of Campania Luigi Vanvitelli School of Medicine and Surgery, Piazza L. Miraglia, Napoli, 80138, ITALY
| |
Collapse
|
20
|
Katayama R, Yoshida W, Ishii S. Confidence modulates the decodability of scene prediction during partially-observable maze exploration in humans. Commun Biol 2022; 5:367. [PMID: 35440615 PMCID: PMC9018866 DOI: 10.1038/s42003-022-03314-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 03/23/2022] [Indexed: 11/23/2022] Open
Abstract
Prediction ability often involves some degree of uncertainty-a key determinant of confidence. Here, we sought to assess whether predictions are decodable in partially-observable environments where one's state is uncertain, and whether this information is sensitive to confidence produced by such uncertainty. We used functional magnetic resonance imaging-based, partially-observable maze navigation tasks in which subjects predicted upcoming scenes and reported their confidence regarding these predictions. Using a multi-voxel pattern analysis, we successfully decoded both scene predictions and subjective confidence from activities in the localized parietal and prefrontal regions. We also assessed confidence in their beliefs about where they were in the maze. Importantly, prediction decodability varied according to subjective scene confidence in the superior parietal lobule and state confidence estimated by the behavioral model in the inferior parietal lobule. These results demonstrate that prediction in uncertain environments depends on the prefrontal-parietal network within which prediction and confidence interact.
Collapse
Affiliation(s)
- Risa Katayama
- Graduate School of Informatics, Kyoto University, Kyoto, Kyoto, 606-8501, Japan.
| | - Wako Yoshida
- Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, OX3 9DU, UK
- Department of Neural Computation for Decision-making, Advanced Telecommunications Research Institute International, Soraku-gun, Kyoto, 619-0288, Japan
| | - Shin Ishii
- Graduate School of Informatics, Kyoto University, Kyoto, Kyoto, 606-8501, Japan
- Neural Information Analysis Laboratories, Advanced Telecommunications Research Institute International, Soraku-gun, Kyoto, 619-0288, Japan
- International Research Center for Neurointelligence, The University of Tokyo, Bunkyo-ku, Tokyo, 113-0033, Japan
| |
Collapse
|
21
|
Masís-Obando R, Norman KA, Baldassano C. Schema representations in distinct brain networks support narrative memory during encoding and retrieval. eLife 2022; 11:e70445. [PMID: 35393941 PMCID: PMC8993217 DOI: 10.7554/elife.70445] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 02/09/2022] [Indexed: 11/13/2022] Open
Abstract
Schematic prior knowledge can scaffold the construction of event memories during perception and also provide structured cues to guide memory search during retrieval. We measured the activation of story-specific and schematic representations using fMRI while participants were presented with 16 stories and then recalled each of the narratives, and related these activations to memory for specific story details. We predicted that schema representations in medial prefrontal cortex (mPFC) would be correlated with successful recall of story details. In keeping with this prediction, an anterior mPFC region showed a significant correlation between activation of schema representations at encoding and subsequent behavioral recall performance; however, this mPFC region was not implicated in schema representation during retrieval. More generally, our analyses revealed largely distinct brain networks at encoding and retrieval in which schema activation was related to successful recall. These results provide new insight into when and where event knowledge can support narrative memory.
Collapse
Affiliation(s)
| | - Kenneth A Norman
- Princeton Neuroscience InstitutePrincetonUnited States
- Department of Psychology, Princeton UniversityPrincetonUnited States
| | | |
Collapse
|
22
|
Chan A, Northoff G, Karasik R, Ouyang J, Williams K. Flights and Perchings of the BrainMind: A Temporospatial Approach to Psychotherapy. Front Psychol 2022; 13:828035. [PMID: 35444594 PMCID: PMC9014955 DOI: 10.3389/fpsyg.2022.828035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 02/21/2022] [Indexed: 11/13/2022] Open
Abstract
This article introduces a process-oriented approach for improving present moment conceptualization in psychotherapy that is in alignment with neuroscience: the Temporospatial movements of mind (TSMM) model. We elaborate on seven temporal movements that describe the moment-to-moment morphogenesis of emotional feelings and thoughts from inception to maturity. Temporal refers to the passage of time through which feelings and thoughts develop, and electromagnetic activity, that among other responsibilities, bind information across time. Spatial dynamics extend from an undifferentiated to three dimensional experiences of emotional and cognitive processes. Neurophysiologically, spatial refers to structures within the brain and their varying interactions with one another. This article culminates in the development of an atheoretical temporospatial grid that may help clinicians conceptualize where patients are in their cognitive and emotional development to further guide technique.
Collapse
Affiliation(s)
- Aldrich Chan
- Graduate School of Education and Psychology, Pepperdine University, Malibu, CA, United States
- Center for Neuropsychology and Consciousness, Miami, FL, United States
- *Correspondence: Aldrich Chan,
| | - Georg Northoff
- Faculty of Medicine, Centre for Neural Dynamics, The Royal’s Institute of Mental Health Research, Brain and Mind Research Institute, University of Ottawa, Ottawa, ON, Canada
- Mental Health Centre, Zhejiang University School of Medicine, Hangzhou, China
- Centre for Cognition and Brain Disorders, Hangzhou Normal University, Hangzhou, China
| | - Ryan Karasik
- Graduate School of Education and Psychology, Pepperdine University, Malibu, CA, United States
- Center for Neuropsychology and Consciousness, Miami, FL, United States
| | - Jason Ouyang
- Graduate School of Education and Psychology, Pepperdine University, Malibu, CA, United States
- Center for Neuropsychology and Consciousness, Miami, FL, United States
| | - Kathryn Williams
- Graduate School of Education and Psychology, Pepperdine University, Malibu, CA, United States
- Center for Neuropsychology and Consciousness, Miami, FL, United States
| |
Collapse
|
23
|
Dijkstra N, Kok P, Fleming SM. Imagery adds stimulus-specific sensory evidence to perceptual detection. J Vis 2022; 22:11. [PMID: 35175306 PMCID: PMC8857619 DOI: 10.1167/jov.22.2.11] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Internally generated imagery and externally triggered perception rely on overlapping sensory processes. This overlap poses a challenge for perceptual reality monitoring: determining whether sensory signals reflect reality or imagination. In this study, we used psychophysics to investigate how imagery and perception interact to determine visual experience. Participants were instructed to detect oriented gratings that gradually appeared in noise while simultaneously either imagining the same grating, a grating perpendicular to the to-be-detected grating, or nothing. We found that, compared to both incongruent imagery and no imagery, congruent imagery caused a leftward shift of the psychometric function relating stimulus contrast to perceptual threshold. We discuss how this effect can best be explained by a model in which imagery adds sensory signal to the perceptual input, thereby increasing the visibility of perceived stimuli. These results suggest that, in contrast to changes in sensory signals caused by self-generated movement, the brain does not discount the influence of self-generated sensory signals on perception.
Collapse
Affiliation(s)
- Nadine Dijkstra
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London, UK.,
| | - Peter Kok
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London, UK.,
| | - Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, University College London, London, UK.,Max Planck UCL Centre for Computational Psychiatry and Aging Research, University College London, London, UK.,Department of Experimental Psychology, University College London, London, UK.,
| |
Collapse
|
24
|
Ragni F, Lingnau A, Turella L. Decoding category and familiarity information during visual imagery. Neuroimage 2021; 241:118428. [PMID: 34311066 DOI: 10.1016/j.neuroimage.2021.118428] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Revised: 06/29/2021] [Accepted: 07/22/2021] [Indexed: 10/20/2022] Open
Abstract
Visual imagery relies on a widespread network of brain regions, partly engaged during the perception of external stimuli. Beyond the recruitment of category-selective areas (FFA, PPA), perception of familiar faces and places has been reported to engage brain areas associated with semantic information, comprising the precuneus, temporo-parietal junction (TPJ), medial prefrontal cortex (mPFC) and posterior cingulate cortex (PCC). Here we used multivariate pattern analyzes (MVPA) to examine to which degree areas of the visual imagery network, category-selective and semantic areas contain information regarding the category and familiarity of imagined stimuli. Participants were instructed via auditory cues to imagine personally familiar and unfamiliar stimuli (i.e. faces and places). Using region-of-interest (ROI)-based MVPA, we were able to distinguish between imagined faces and places within nodes of the visual imagery network (V1, SPL, aIPS), within category-selective inferotemporal regions (FFA, PPA) and across all brain regions of the extended semantic network (i.e. precuneus, mPFC, IFG and TPJ). Moreover, we were able to decode familiarity of imagined stimuli in the SPL and aIPS, and in some regions of the extended semantic network (in particular, right precuneus, right TPJ), but not in V1. Our results suggest that posterior visual areas - including V1 - host categorical representations about imagined stimuli, and that stimulus familiarity might be an additional aspect that is shared between perception and visual imagery.
Collapse
Affiliation(s)
- Flavio Ragni
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Italy
| | | | - Luca Turella
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Italy.
| |
Collapse
|
25
|
A Study of the Brain Network Connectivity in Visual-Word Pairing Associative Learning and Episodic Memory Reactivating Task. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:5579888. [PMID: 34306053 PMCID: PMC8285180 DOI: 10.1155/2021/5579888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Accepted: 06/25/2021] [Indexed: 11/18/2022]
Abstract
Episodic memory allows a person to recall and mentally reexperience specific episodes from one's personal past. Studies of episodic memory are of great significance for the diagnosis and the exploration of the mechanism of memory generation. Most of the current studies focus on certain brain regions and pay less attention to the interrelationship between multiple brain regions. To explore the interrelationship in the brain network, we use an open fMRI dataset to construct the brain functional connectivity and effective connectivity network. We establish a binary directed network of the memory when it is reactivated. The binary directed network shows that the occipital lobe and parietal lobe have the most causal connections. The number of edges starting from the superior parietal lobule is the highest, with 49 edges, and 31 of which are connected to the occipital cortex. This means that the interaction between the superior parietal lobule and the occipital lobe plays the most important role in episodic memory, and the superior parietal lobule plays a more causal role in causality. In addition, memory regions such as the precuneus and fusiform also have some edges. The results show that the posterior parietal cortex plays an important role of hub node in the episodic memory network. From the brain network model, more information can be obtained, which is conducive to exploring the brain's changing pattern in the whole memory process.
Collapse
|