1
|
Lande KJ. Compositionality in perception: A framework. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2024; 15:e1691. [PMID: 38807187 DOI: 10.1002/wcs.1691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 05/07/2024] [Accepted: 05/08/2024] [Indexed: 05/30/2024]
Abstract
Perception involves the processing of content or information about the world. In what form is this content represented? I argue that perception is widely compositional. The perceptual system represents many stimulus features (including shape, orientation, and motion) in terms of combinations of other features (such as shape parts, slant and tilt, common and residual motion vectors). But compositionality can take a variety of forms. The ways in which perceptual representations compose are markedly different from the ways in which sentences or thoughts are thought to be composed. I suggest that the thesis that perception is compositional is not itself a concrete hypothesis with specific predictions; rather it affords a productive framework for developing and evaluating specific empirical hypotheses about the form and content of perceptual representations. The question is not just whether perception is compositional, but how. Answering this latter question can provide fundamental insights into perception. This article is categorized under: Philosophy > Representation Philosophy > Foundations of Cognitive Science Psychology > Perception and Psychophysics.
Collapse
Affiliation(s)
- Kevin J Lande
- Department of Philosophy and Centre for Vision Research, York University, Toronto, Canada
| |
Collapse
|
2
|
Keane BP, Krekelberg B, Mill RD, Silverstein SM, Thompson JL, Serody MR, Barch DM, Cole MW. Dorsal attention network activity during perceptual organization is distinct in schizophrenia and predictive of cognitive disorganization. Eur J Neurosci 2023; 57:458-478. [PMID: 36504464 DOI: 10.1111/ejn.15889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Revised: 12/02/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022]
Abstract
Visual shape completion is a canonical perceptual organization process that integrates spatially distributed edge information into unified representations of objects. People with schizophrenia show difficulty in discriminating completed shapes, but the brain networks and functional connections underlying this perceptual difference remain poorly understood. Also unclear is whether brain network differences in schizophrenia occur in related illnesses or vary with illness features transdiagnostically. To address these topics, we scanned (functional magnetic resonance imaging, fMRI) people with schizophrenia, bipolar disorder, or no psychiatric illness during rest and during a task in which they discriminated configurations that formed or failed to form completed shapes (illusory and fragmented condition, respectively). Multivariate pattern differences were identified on the cortical surface using 360 predefined parcels and 12 functional networks composed of such parcels. Brain activity flow mapping was used to evaluate the likely involvement of resting-state connections for shape completion. Illusory/fragmented task activation differences ('modulations') in the dorsal attention network (DAN) could distinguish people with schizophrenia from the other groups (AUCs > .85) and could transdiagnostically predict cognitive disorganization severity. Activity flow over functional connections from the DAN could predict secondary visual network modulations in each group, except in schizophrenia. The secondary visual network was strongly and similarly modulated in each group. Task modulations were dispersed over more networks in patients compared to controls. In summary, DAN activity during visual perceptual organization is distinct in schizophrenia, symptomatically relevant, and potentially related to improper attention-related feedback into secondary visual areas.
Collapse
Affiliation(s)
- Brian P Keane
- University Behavioral Health Care, Department of Psychiatry, and Center for Cognitive Science, Rutgers, The State University of New Jersey, Piscataway, New Jersey, USA
- Departments of Psychiatry and Neuroscience, University of Rochester Medical Center, Rochester, New York, USA
| | - Bart Krekelberg
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, Newark, New Jersey, USA
| | - Ravi D Mill
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, Newark, New Jersey, USA
| | - Steven M Silverstein
- University Behavioral Health Care, Department of Psychiatry, and Center for Cognitive Science, Rutgers, The State University of New Jersey, Piscataway, New Jersey, USA
- Departments of Psychiatry and Neuroscience, University of Rochester Medical Center, Rochester, New York, USA
- Department of Ophthalmology, University of Rochester Medical Center, Rochester, New York, USA
| | - Judy L Thompson
- Departments of Psychiatry and Neuroscience, University of Rochester Medical Center, Rochester, New York, USA
- Department of Psychiatric Rehabilitation and Counseling Professions, Rutgers, The State University of New Jersey, Piscataway, New Jersey, USA
| | - Megan R Serody
- University Behavioral Health Care, Department of Psychiatry, and Center for Cognitive Science, Rutgers, The State University of New Jersey, Piscataway, New Jersey, USA
- Departments of Psychiatry and Neuroscience, University of Rochester Medical Center, Rochester, New York, USA
| | - Deanna M Barch
- Departments of Psychological & Brain Sciences, Psychiatry, and Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Michael W Cole
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, Newark, New Jersey, USA
| |
Collapse
|
3
|
Dual counterstream architecture may support separation between vision and predictions. Conscious Cogn 2022; 103:103375. [DOI: 10.1016/j.concog.2022.103375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 12/03/2021] [Accepted: 06/28/2022] [Indexed: 11/24/2022]
|
4
|
Keane BP, Erlikhman G, Serody M, Silverstein SM. A brief psychometric test reveals robust shape completion deficits in schizophrenia that are less severe in bipolar disorder. Schizophr Res 2022; 240:78-80. [PMID: 34974396 PMCID: PMC8917988 DOI: 10.1016/j.schres.2021.12.015] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 12/09/2021] [Accepted: 12/11/2021] [Indexed: 02/03/2023]
Affiliation(s)
- Brian P. Keane
- University Behavioral Health Care, Rutgers, The State University of New Jersey, 671 Hoes Lane West, Piscataway, NJ 08854, USA,Department of Psychiatry, University of Rochester Medical Center, 601 Elmwood Ave, Rochester 14642, NY,Department of Neuroscience and Center for Visual Science, University of Rochester Medical Center, 601 Elmwood Ave, Rochester, NY 14642, USA,Department of Brain and Cognitive Science, University of Rochester, 363 Meliora Hall, Rochester, NY 14627, USA
| | - Gennady Erlikhman
- UCLA Human Perception Laboratory and Psychology Department, University of California, Los Angeles, 1285 Franz Hall, Los Angeles, CA 90095-1563, USA
| | - Megan Serody
- University Behavioral Health Care, Rutgers, The State University of New Jersey, 671 Hoes Lane West, Piscataway, NJ 08854, USA,Department of Psychiatry, University of Rochester Medical Center, 601 Elmwood Ave, Rochester 14642, NY
| | - Steven M. Silverstein
- University Behavioral Health Care, Rutgers, The State University of New Jersey, 671 Hoes Lane West, Piscataway, NJ 08854, USA,Department of Psychiatry, University of Rochester Medical Center, 601 Elmwood Ave, Rochester 14642, NY,Department of Neuroscience and Center for Visual Science, University of Rochester Medical Center, 601 Elmwood Ave, Rochester, NY 14642, USA,Department of Ophthalmology, University of Rochester Medical Center, 601 Elmwood Ave, Rochester, NY 14642, USA
| |
Collapse
|
5
|
Keane BP, Barch DM, Mill RD, Silverstein SM, Krekelberg B, Cole MW. Brain network mechanisms of visual shape completion. Neuroimage 2021; 236:118069. [PMID: 33878383 PMCID: PMC8456451 DOI: 10.1016/j.neuroimage.2021.118069] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Revised: 03/31/2021] [Accepted: 04/06/2021] [Indexed: 11/06/2022] Open
Abstract
Visual shape completion recovers object shape, size, and number from spatially segregated edges. Despite being extensively investigated, the process’s underlying brain regions, networks, and functional connections are still not well understood. To shed light on the topic, we scanned (fMRI) healthy adults during rest and during a task in which they discriminated pac-man configurations that formed or failed to form completed shapes (illusory and fragmented condition, respectively). Task activation differences (illusory-fragmented), resting-state functional connectivity, and multivariate patterns were identified on the cortical surface using 360 predefined parcels and 12 functional networks composed of such parcels. Brain activity flow mapping (ActFlow) was used to evaluate the likely involvement of resting-state connections for shape completion. We identified 36 differentially-active parcels including a posterior temporal region, PH, whose activity was consistent across 95% of observers. Significant task regions primarily occupied the secondary visual network but also incorporated the frontoparietal dorsal attention, default mode, and cingulo-opercular networks. Each parcel’s task activation difference could be modeled via its resting-state connections with the remaining parcels (r=.62, p<10−9), suggesting that such connections undergird shape completion. Functional connections from the dorsal attention network were key in modelling task activation differences in the secondary visual network. Dorsal attention and frontoparietal connections could also model activations in the remaining networks. Taken together, these results suggest that shape completion relies upon a sparsely distributed but densely interconnected network coalition that is centered in the secondary visual network, coordinated by the dorsal attention network, and inclusive of at least three other networks.
Collapse
Affiliation(s)
- Brian P Keane
- University Behavioral Health Care, Department of Psychiatry, and Center for Cognitive Science, Rutgers, The State University of New Jersey, Piscataway, NJ 08854, USA; Departments of Psychiatry and Neuroscience, University of Rochester Medical Center, 601 Elmwood Ave, Rochester, NY 14642, USA.
| | - Deanna M Barch
- Departments of Psychological & Brain Sciences, Psychiatry, and Radiology, Washington University in St. Louis, One Brookings Drive, St. Louis, MO 63130, USA
| | - Ravi D Mill
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, 197 University Ave 07102, USA
| | - Steven M Silverstein
- University Behavioral Health Care, Department of Psychiatry, and Center for Cognitive Science, Rutgers, The State University of New Jersey, Piscataway, NJ 08854, USA; Departments of Psychiatry and Neuroscience, University of Rochester Medical Center, 601 Elmwood Ave, Rochester, NY 14642, USA; Department of Ophthalmology, University of Rochester Medical Center, 601 Elmwood Ave, Rochester, NY, USA
| | - Bart Krekelberg
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, 197 University Ave 07102, USA
| | - Michael W Cole
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, 197 University Ave 07102, USA
| |
Collapse
|
6
|
Lupyan G, Abdel Rahman R, Boroditsky L, Clark A. Effects of Language on Visual Perception. Trends Cogn Sci 2020; 24:930-944. [PMID: 33012687 DOI: 10.1016/j.tics.2020.08.005] [Citation(s) in RCA: 54] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 08/22/2020] [Accepted: 08/25/2020] [Indexed: 11/24/2022]
Abstract
Does language change what we perceive? Does speaking different languages cause us to perceive things differently? We review the behavioral and electrophysiological evidence for the influence of language on perception, with an emphasis on the visual modality. Effects of language on perception can be observed both in higher-level processes such as recognition and in lower-level processes such as discrimination and detection. A consistent finding is that language causes us to perceive in a more categorical way. Rather than being fringe or exotic, as they are sometimes portrayed, we discuss how effects of language on perception naturally arise from the interactive and predictive nature of perception.
Collapse
Affiliation(s)
- Gary Lupyan
- University of Wisconsin-Madison, Madison, WI, USA.
| | | | | | - Andy Clark
- University of Sussex, Brighton, UK; Macquarie University, Sydney, Australia
| |
Collapse
|
7
|
Keane BP, Paterno D, Kastner S, Krekelberg B, Silverstein SM. Intact illusory contour formation but equivalently impaired visual shape completion in first- and later-episode schizophrenia. JOURNAL OF ABNORMAL PSYCHOLOGY 2018; 128:57-68. [PMID: 30346202 DOI: 10.1037/abn0000384] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Visual shape completion is a fundamental process that constructs contours and shapes on the basis of the geometric relations between spatially separated edge elements. People with schizophrenia are impaired at distinguishing visually completed shapes, but when does the impairment emerge and how does it evolve with illness duration? The question bears on the debate as to whether cognition declines after illness onset. To address the issue, we tested healthy controls (n = 48), first-episode psychosis patients (n = 23), and chronic schizophrenia patients (n = 49) on a classic psychophysical task in which subjects discriminated the relative orientations of four sectored circles that either formed or did not form visually completed shapes (illusory and fragmented conditions, respectively). Visual shape completion was quantified as the extent to which performance in the illusory condition exceeded that of the fragmented. Half of the trials incorporated wire edge elements, which augment contour salience and improve shape completion. Each patient group exhibited large visual shape completion deficits that could not be explained by differences in age, motivation, or orientation tuning. Patients responded normally to changes in illusory contour salience, indicating that they were forming but not adequately employing such contours for discriminating shapes. Shape completion deficits were most apparent for patients with cognitive disorganization, poor premorbid early adolescent functioning, and normal orientation discrimination. Visual shape completion deficits emerge maximally by the first psychotic episode and arise from higher-level disturbances that are related to premorbid functioning and disorganization. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
Affiliation(s)
- Brian P Keane
- Department of Psychiatry, Robert Wood Johnson Medical School, University Behavioral Health Care, Rutgers Biomedical and Health Sciences, Rutgers University
| | | | | | - Bart Krekelberg
- Center for Molecular and Behavioral Neuroscience, Rutgers University
| | - Steven M Silverstein
- Department of Psychiatry, Robert Wood Johnson Medical School, Rutgers University
| |
Collapse
|