1
|
Maimon A, Wald IY, Snir A, Ben Oz M, Amedi A. Perceiving depth beyond sight: Evaluating intrinsic and learned cues via a proof of concept sensory substitution method in the visually impaired and sighted. PLoS One 2024; 19:e0310033. [PMID: 39321152 PMCID: PMC11423994 DOI: 10.1371/journal.pone.0310033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Accepted: 08/23/2024] [Indexed: 09/27/2024] Open
Abstract
This study explores spatial perception of depth by employing a novel proof of concept sensory substitution algorithm. The algorithm taps into existing cognitive scaffolds such as language and cross modal correspondences by naming objects in the scene while representing their elevation and depth by manipulation of the auditory properties for each axis. While the representation of verticality utilized a previously tested correspondence with pitch, the representation of depth employed an ecologically inspired manipulation, based on the loss of gain and filtration of higher frequency sounds over distance. The study, involving 40 participants, seven of which were blind (5) or visually impaired (2), investigates the intrinsicness of an ecologically inspired mapping of auditory cues for depth by comparing it to an interchanged condition where the mappings of the two axes are swapped. All participants successfully learned to use the algorithm following a very brief period of training, with the blind and visually impaired participants showing similar levels of success for learning to use the algorithm as did their sighted counterparts. A significant difference was found at baseline between the two conditions, indicating the intuitiveness of the original ecologically inspired mapping. Despite this, participants were able to achieve similar success rates following the training in both conditions. The findings indicate that both intrinsic and learned cues come into play with respect to depth perception. Moreover, they suggest that by employing perceptual learning, novel sensory mappings can be trained in adulthood. Regarding the blind and visually impaired, the results also support the convergence view, which claims that with training, their spatial abilities can converge with those of the sighted. Finally, we discuss how the algorithm can open new avenues for accessibility technologies, virtual reality, and other practical applications.
Collapse
Affiliation(s)
- Amber Maimon
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
- Computational Psychiatry and Neurotechnology Lab, Ben Gurion University, Be'er Sheva, Israel
| | - Iddo Yehoshua Wald
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
- Digital Media Lab, University of Bremen, Bremen, Germany
| | - Adi Snir
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
| | - Meshi Ben Oz
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
| | - Amir Amedi
- Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel
| |
Collapse
|
2
|
Abstract
Neurological insults, such as congenital blindness, deafness, amputation, and stroke, often result in surprising and impressive behavioural changes. Cortical reorganisation, which refers to preserved brain tissue taking on a new functional role, is often invoked to account for these behavioural changes. Here, we revisit many of the classical animal and patient cortical remapping studies that spawned this notion of reorganisation. We highlight empirical, methodological, and conceptual problems that call this notion into doubt. We argue that appeal to the idea of reorganisation is attributable in part to the way that cortical maps are empirically derived. Specifically, cortical maps are often defined based on oversimplified assumptions of 'winner-takes-all', which in turn leads to an erroneous interpretation of what it means when these maps appear to change. Conceptually, remapping is interpreted as a circuit receiving novel input and processing it in a way unrelated to its original function. This implies that neurons are either pluripotent enough to change what they are tuned to or that a circuit can change what it computes. Instead of reorganisation, we argue that remapping is more likely to occur due to potentiation of pre-existing architecture that already has the requisite representational and computational capacity pre-injury. This architecture can be facilitated via Hebbian and homeostatic plasticity mechanisms. Crucially, our revised framework proposes that opportunities for functional change are constrained throughout the lifespan by the underlying structural 'blueprint'. At no period, including early in development, does the cortex offer structural opportunities for functional pluripotency. We conclude that reorganisation as a distinct form of cortical plasticity, ubiquitously evoked with words such as 'take-over'' and 'rewiring', does not exist.
Collapse
Affiliation(s)
- Tamar R Makin
- MRC Cognition and Brain Sciences Unit, University of CambridgeCambridgeUnited Kingdom
| | - John W Krakauer
- Department of Neuroscience, Johns Hopkins University School of MedicineBaltimoreUnited States
- Department of Neurology, Johns Hopkins University School of MedicineBaltimoreUnited States
- The Santa Fe InstituteSanta FeUnited States
| |
Collapse
|
3
|
Piller S, Senna I, Ernst MO. Visual experience shapes the Bouba-Kiki effect and the size-weight illusion upon sight restoration from congenital blindness. Sci Rep 2023; 13:11435. [PMID: 37454205 PMCID: PMC10349879 DOI: 10.1038/s41598-023-38486-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 07/09/2023] [Indexed: 07/18/2023] Open
Abstract
The Bouba-Kiki effect is the systematic mapping between round/spiky shapes and speech sounds ("Bouba"/"Kiki"). In the size-weight illusion, participants judge the smaller of two equally-weighted objects as being heavier. Here we investigated the contribution of visual experience to the development of these phenomena. We compared three groups: early blind individuals (no visual experience), individuals treated for congenital cataracts years after birth (late visual experience), and typically sighted controls (visual experience from birth). We found that, in cataract-treated participants (tested visually/visuo-haptically), both phenomena are absent shortly after sight onset, just like in blind individuals (tested haptically). However, they emerge within months following surgery, becoming statistically indistinguishable from the sighted controls. This suggests a pivotal role of visual experience and refutes the existence of an early sensitive period: A short period of experience, even when gained only years after birth, is sufficient for participants to visually pick-up regularities in the environment, contributing to the development of these phenomena.
Collapse
Affiliation(s)
- Sophia Piller
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany.
- Transfer Center for Neuroscience and Education (ZNL), Ulm University, Ulm, Germany.
| | - Irene Senna
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany
- Department of Psychology, Liverpool Hope University, Liverpool, UK
| | - Marc O Ernst
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Ulm, Germany
| |
Collapse
|
4
|
Piller S, Senna I, Wiebusch D, Ben-Zion I, Ernst MO. Grasping behavior does not recover after sight restoration from congenital blindness. Curr Biol 2023; 33:2104-2110.e4. [PMID: 37130520 DOI: 10.1016/j.cub.2023.04.017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 03/17/2023] [Accepted: 04/11/2023] [Indexed: 05/04/2023]
Abstract
We investigated whether early visual input is essential for establishing the ability to use predictions in the control of actions and for perception. To successfully interact with objects, it is necessary to pre-program bodily actions such as grasping movements (feedforward control). Feedforward control requires a model for making predictions, which is typically shaped by previous sensory experience and interaction with the environment.1 Vision is the most crucial sense for establishing such predictions.2,3 We typically rely on visual estimations of the to-be-grasped object's size and weight in order to scale grip force and hand aperture accordingly.4,5,6 Size-weight expectations play a role also for perception, as evident in the size-weight illusion (SWI), in which the smaller of two equal-weight objects is misjudged to be heavier.7,8 Here, we investigated predictions for action and perception by testing the development of feedforward controlled grasping and of the SWI in young individuals surgically treated for congenital cataracts several years after birth. Surprisingly, what typically developing individuals do easily within the first years of life, namely to adeptly grasp new objects based on visually predicted properties, cataract-treated individuals did not learn after years of visual experience. Contrary, the SWI exhibited significant development. Even though the two tasks differ in substantial ways, these results may suggest a potential dissociation in using visual experience to make predictions about an object's features for perception or action. What seems a very simple task-picking up small objects-is in truth a highly complex computation that necessitates early structured visual input to develop.
Collapse
Affiliation(s)
- Sophia Piller
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Albert-Einstein-Allee 43, 89081 Ulm, Germany; Transfer Center for Neuroscience and Education (ZNL), Ulm University, Parkstraße 11, 89073 Ulm, Germany.
| | - Irene Senna
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Albert-Einstein-Allee 43, 89081 Ulm, Germany; Department of Psychology, Liverpool Hope University, Hope Park, Liverpool L16 9JD, UK
| | - Dennis Wiebusch
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Albert-Einstein-Allee 43, 89081 Ulm, Germany
| | - Itay Ben-Zion
- Pediatric Ophthalmology Service, Padeh Medical Center, Tiberias 1528001, Israel
| | - Marc O Ernst
- Applied Cognitive Psychology, Faculty for Computer Science, Engineering, and Psychology, Ulm University, Albert-Einstein-Allee 43, 89081 Ulm, Germany
| |
Collapse
|
5
|
Maimon A, Netzer O, Heimler B, Amedi A. Testing geometry and 3D perception in children following vision restoring cataract-removal surgery. Front Neurosci 2023; 16:962817. [PMID: 36711132 PMCID: PMC9879291 DOI: 10.3389/fnins.2022.962817] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 12/19/2022] [Indexed: 01/13/2023] Open
Abstract
As neuroscience and rehabilitative techniques advance, age-old questions concerning the visual experience of those who gain sight after blindness, once thought to be philosophical alone, take center stage and become the target for scientific inquiries. In this study, we employ a battery of visual perception tasks to study the unique experience of a small group of children who have undergone vision-restoring cataract removal surgery as part of the Himalayan Cataract Project. We tested their abilities to perceive in three dimensions (3D) using a binocular rivalry task and the Brock string task, perceive visual illusions, use cross-modal mappings between touch and vision, and spatially group based on geometric cues. Some of the children in this study gained a sense of sight for the first time in their lives, having been born with bilateral congenital cataracts, while others suffered late-onset blindness in one eye alone. This study simultaneously supports yet raises further questions concerning Hubel and Wiesel's critical periods theory and provides additional insight into Molyneux's problem, the ability to correlate vision with touch quickly. We suggest that our findings present a relatively unexplored intermediate stage of 3D vision development. Importantly, we spotlight some essential geometrical perception visual abilities that strengthen the idea that spontaneous geometry intuitions arise independently from visual experience (and education), thus replicating and extending previous studies. We incorporate a new model, not previously explored, of testing children with congenital cataract removal surgeries who perform the task via vision. In contrast, previous work has explored these abilities in the congenitally blind via touch. Taken together, our findings provide insight into the development of what is commonly known as the visual system in the visually deprived and highlight the need to further empirically explore an amodal, task-based interpretation of specializations in the development and structure of the brain. Moreover, we propose a novel objective method, based on a simple binocular rivalry task and the Brock string task, for determining congenital (early) vs. late blindness where medical history and records are partial or lacking (e.g., as is often the case in cataract removal cases).
Collapse
Affiliation(s)
- Amber Maimon
- The Baruch Ivcher Institute for Brain, Cognition, and Technology, Baruch Ivcher School of Psychology, Reichman University, Herzliya, Israel,The Ruth & Meir Rosenthal Brain Imaging Center, Reichman University, Herzliya, Israel,*Correspondence: Amber Maimon,
| | - Ophir Netzer
- Gonda Brain Research Center, Bar-Ilan University, Ramat Gan, Israel
| | - Benedetta Heimler
- Center of Advanced Technologies in Rehabilitation (CATR), Sheba Medical Center, Ramat Gan, Israel
| | - Amir Amedi
- The Baruch Ivcher Institute for Brain, Cognition, and Technology, Baruch Ivcher School of Psychology, Reichman University, Herzliya, Israel,The Ruth & Meir Rosenthal Brain Imaging Center, Reichman University, Herzliya, Israel
| |
Collapse
|
6
|
May E, Arach P, Kishiki E, Geneau R, Maehara G, Sukhai M, Hamm LM. Learning to see after early and extended blindness: A scoping review. Front Psychol 2022; 13:954328. [PMID: 36389599 PMCID: PMC9648338 DOI: 10.3389/fpsyg.2022.954328] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 09/26/2022] [Indexed: 10/03/2023] Open
Abstract
Purpose If an individual has been blind since birth due to a treatable eye condition, ocular treatment is urgent. Even a brief period of visual deprivation can alter the development of the visual system. The goal of our structured scoping review was to understand how we might better support children with delayed access to ocular treatment for blinding conditions. Method We searched MEDLINE, Embase and Global Health for peer-reviewed publications that described the impact of early (within the first year) and extended (lasting at least 2 years) bilateral visual deprivation. Results Of 551 reports independently screened by two authors, 42 studies met our inclusion criteria. Synthesizing extracted data revealed several trends. The data suggests persistent deficits in visual acuity, contrast sensitivity, global motion, and visual-motor integration, and suspected concerns for understanding complex objects and faces. There is evidence for resilience in color perception, understanding of simple shapes, discriminating between a face and non-face, and the perception of biological motion. There is currently insufficient data about specific (re)habilitation strategies to update low vision services, but there are several insights to guide future research in this domain. Conclusion This summary will help guide the research and services provision to help children learn to see after early and extended blindness.
Collapse
Affiliation(s)
- Eloise May
- School of Optometry and Vision Science, University of Auckland, Auckland, New Zealand
| | | | | | - Robert Geneau
- Kilimanjaro Centre for Community Ophthalmology, Moshi, Tanzania
- Division of Ophthalmology, University of Cape Town, Cape Town, South Africa
| | - Goro Maehara
- Department of Human Sciences, Kanagawa University, Yokohama, Japan
| | - Mahadeo Sukhai
- Accessibility, Research and International Affairs, Canadian National Institute for the Blind, Toronto, ON, Canada
- Department of Ophthalmology, Faculty of Health Sciences, School of Medicine, Queen's University, Kingston, ON, Canada
| | - Lisa M. Hamm
- School of Optometry and Vision Science, University of Auckland, Auckland, New Zealand
| |
Collapse
|
7
|
Developmental Trajectories of Size Constancy as Implicitly Examined by Simple Reaction Times. Vision (Basel) 2021; 5:vision5040050. [PMID: 34698311 PMCID: PMC8544729 DOI: 10.3390/vision5040050] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 09/24/2021] [Accepted: 10/13/2021] [Indexed: 11/16/2022] Open
Abstract
It is still unclear whether size constancy is an innate ability or whether it develops with age. As many developmental studies are limited to the child's comprehension of the task instructions, here, an implicit measure of perceived size, namely, simple manual reaction time (RT), was opted for based on the assumption that perceptually bigger objects generate faster detection times. We examined size constancy in children (from 5 to 14 years of age) and adults using a simple RT approach. Participants were presented with pictures of tennis balls on a screen that was physically moved to two viewing distances. Visual stimuli were adjusted in physical size in order to subtend the same visual angle across distances, determining two conditions: a small-near tennis ball vs. a big-far tennis ball. Thanks to size constancy, the two tennis balls were perceived as different even though they were of equal size on the retina. Stimuli were also matched in terms of luminance. Participants were asked to react as fast as possible to the onset of the stimuli. The results show that the RTs reflected the perceived rather than the retinal size of the stimuli across the different age groups, such that participants responded faster to stimuli that were perceived as bigger than those perceived as smaller. Hence, these findings are consistent with the idea that size constancy is already present in early childhood, at least from the age of five, and does not require extensive visual learning.
Collapse
|
8
|
Abstract
This article reviews theoretical and empirical arguments for and against various theories that explain the classic Ponzo illusion and its variants from two different viewpoints concerning the role of perceived depth in size distortions. The first viewpoint argues that all Ponzo-like illusions are driven by perceived depth. The second viewpoint argues that the classic Ponzo illusion is unrelated to depth perception. This review will give special focus to the first viewpoint and consists of three sections. In the first section, the role of the number of pictorial depth cues and previous experience in the strength of all Ponzo-like illusions are discussed. In the second section, we contrast the first viewpoint against the theories that explain the classic Ponzo illusion with mechanisms that are unrelated to depth perception. In the last section, we propose a Bayesian-motivated reconceptualization of Richard Gregory's misapplied size constancy theory that explains Ponzo-variant illusions in terms of prior information and prediction errors. The new account explains why some studies have provided inconsistent evidence for misapplied size constancy theory.
Collapse
|
9
|
Abstract
Humans constantly use depth information to support perceptual decisions about object size and location in space, as well as planning and executing actions. It was recently reported that perceived depth modulates perceptual performance even when depth information is not relevant to the task, with faster shape discrimination for objects perceived as being close to the observer. However, it is yet to be determined if the observed "close advantage" reflects differences in psychophysical sensitivity or response bias. Moreover, it is unclear whether this advantage is generalizable to other viewing situations and tasks. To address these outstanding issues, we evaluated whether visual resolution is modulated by perceived depth defined by 2D pictorial cues. In a series of experiments, we used the method of constant stimuli to measure the precision of perceptual judgements for stimuli positioned at close, far, and flat perceived distances. In Experiment 1, we found that size discrimination was more precise when the object was perceived to be closer to the observers. Experiments 2a and 2b extended this finding to a visual property orthogonal to depth information, by showing superior orientation discrimination for "close" objects. Finally, Experiment 3 demonstrated that the close advantage also occurs when performing high-level perceptual tasks such as face perception. Taken together, our results provide novel evidence that the perceived depth of an object, as defined by pictorial cues, modulates the precision of visual processing for close objects.
Collapse
|
10
|
Chen L, Xu Q, Shen L, Yuan T, Wang Y, Zhou W, Jiang Y. Distinct Contributions of Genes and Environment to Visual Size Illusion and the Underlying Neural Mechanism. Cereb Cortex 2021; 32:1014-1023. [PMID: 34379728 PMCID: PMC8889949 DOI: 10.1093/cercor/bhab262] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Revised: 06/29/2021] [Accepted: 06/30/2021] [Indexed: 11/12/2022] Open
Abstract
As exemplified by the Ebbinghaus illusion, the perceived size of an object can be significantly biased by its surrounding context. The phenomenon is experienced by humans as well as other species, hence likely evolutionarily adaptive. Here, we examined the heritability of the Ebbinghaus illusion using a combination of the classic twin method and multichannel functional near-infrared spectroscopy. Results show that genes account for over 50% of the variance in the strength of the experienced illusion. Interestingly, activations evoked by the Ebbinghaus stimuli in the early visual cortex are explained by genetic factors whereas those in the posterior temporal cortex are explained by environmental factors. In parallel, the feedforward functional connectivity between the occipital cortex and the temporal cortex is modulated by genetic effects whereas the feedback functional connectivity is entirely shaped by environment, despite both being significantly correlated with the strength of the experienced illusion. These findings demonstrate that genetic and environmental factors work in tandem to shape the context-dependent visual size illusion, and shed new light on the links among genes, environment, brain, and subjective experience.
Collapse
Affiliation(s)
- Lihong Chen
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian 116029, P.R. China.,Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian 116029, P.R. China.,State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China
| | - Qian Xu
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Li Shen
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Tian Yuan
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Ying Wang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Wen Zhou
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China
| | - Yi Jiang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, P.R. China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, P.R. China.,Chinese Institute for Brain Research, Beijing 102206, P.R. China.,Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, P.R. China
| |
Collapse
|
11
|
Fingerhut J. Enacting Media. An Embodied Account of Enculturation Between Neuromediality and New Cognitive Media Theory. Front Psychol 2021; 12:635993. [PMID: 34113285 PMCID: PMC8185019 DOI: 10.3389/fpsyg.2021.635993] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 03/15/2021] [Indexed: 11/13/2022] Open
Abstract
This paper argues that the still-emerging paradigm of situated cognition requires a more systematic perspective on media to capture the enculturation of the human mind. By virtue of being media, cultural artifacts present central experiential models of the world for our embodied minds to latch onto. The paper identifies references to external media within embodied, extended, enactive, and predictive approaches to cognition, which remain underdeveloped in terms of the profound impact that media have on our mind. To grasp this impact, I propose an enactive account of media that is based on expansive habits as media-structured, embodied ways of bringing forth meaning and new domains of values. We apply such habits, for instance, when seeing a picture or perceiving a movie. They become established through a process of reciprocal adaptation between media artifacts and organisms and define the range of viable actions within such a media ecology. Within an artifactual habit, we then become attuned to a specific media work (e.g., a TV series, a picture, a text, or even a city) that engages us. Both the plurality of habits and the dynamical adjustments within a habit require a more flexible neural architecture than is addressed by classical cognitive neuroscience. To detail how neural and media processes interlock, I will introduce the concept of neuromediality and discuss radical predictive processing accounts that could contribute to the externalization of the mind by treating media themselves as generative models of the world. After a short primer on general media theory, I discuss media examples in three domains: pictures and moving images; digital media; architecture and the built environment. This discussion demonstrates the need for a new cognitive media theory based on enactive artifactual habits-one that will help us gain perspective on the continuous re-mediation of our mind.
Collapse
Affiliation(s)
- Joerg Fingerhut
- Berlin School of Mind and Brain, Department of Philosophy, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
12
|
Pant R, Guerreiro MJS, Ley P, Bottari D, Shareef I, Kekunnaya R, Röder B. The size-weight illusion is unimpaired in individuals with a history of congenital visual deprivation. Sci Rep 2021; 11:6693. [PMID: 33758328 PMCID: PMC7988063 DOI: 10.1038/s41598-021-86227-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2019] [Accepted: 03/10/2021] [Indexed: 11/29/2022] Open
Abstract
Visual deprivation in childhood can lead to lifelong impairments in multisensory processing. Here, the Size-Weight Illusion (SWI) was used to test whether visuo-haptic integration recovers after early visual deprivation. Normally sighted individuals perceive larger objects to be lighter than smaller objects of the same weight. In Experiment 1, individuals treated for dense bilateral congenital cataracts (who had no patterned visual experience at birth), individuals treated for developmental cataracts (who had patterned visual experience at birth, but were visually impaired), congenitally blind individuals and normally sighted individuals had to rate the weight of manually explored cubes that differed in size (Small, Medium, Large) across two possible weights (350 g, 700 g). In Experiment 2, individuals treated for dense bilateral congenital cataracts were compared to sighted individuals in a similar task using a string set-up, which removed haptic size cues. In both experiments, indistinguishable SWI effects were observed across all groups. These results provide evidence that early aberrant vision does not interfere with the development of the SWI, and suggest a recovery of the integration of size and weight cues provided by the visual and haptic modality.
Collapse
Affiliation(s)
- Rashi Pant
- Biological Psychology and Neuropsychology, University of Hamburg, 20146, Hamburg, Germany.
| | - Maria J S Guerreiro
- Biological Psychology and Neuropsychology, University of Hamburg, 20146, Hamburg, Germany
| | - Pia Ley
- Biological Psychology and Neuropsychology, University of Hamburg, 20146, Hamburg, Germany
| | - Davide Bottari
- Biological Psychology and Neuropsychology, University of Hamburg, 20146, Hamburg, Germany.,Molecular Mind Lab, IMT School for Advanced Studies, 55100, Lucca, Italy
| | - Idris Shareef
- Child Sight Institute, Jasti V Ramanamma Children's Eye Care Center, LV Prasad Eye Institute, Hyderabad, Telangana, 500034, India
| | - Ramesh Kekunnaya
- Child Sight Institute, Jasti V Ramanamma Children's Eye Care Center, LV Prasad Eye Institute, Hyderabad, Telangana, 500034, India
| | - Brigitte Röder
- Biological Psychology and Neuropsychology, University of Hamburg, 20146, Hamburg, Germany
| |
Collapse
|
13
|
The acts of opening and closing the eyes are of importance for congenital blindness: Evidence from resting-state fMRI. Neuroimage 2021; 233:117966. [PMID: 33744460 DOI: 10.1016/j.neuroimage.2021.117966] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2020] [Revised: 02/07/2021] [Accepted: 03/08/2021] [Indexed: 01/02/2023] Open
Abstract
Volitional eye closure is observed only in conscious and awake humans, and is rare in animals. It is believed that eye closure can focus one's attention inward and facilitate activities such as meditation and mental imagery. Congenital blind individuals are also required to close their eyes for these activities. Resting-state functional magnetic resonance imaging (RS-fMRI) studies have found robust differences between the eyes-closed (EC) and eyes-open (EO) conditions in some brain regions in the sighted. This study analyzed data from 21 congenital blind individuals and 21 sighted controls by using amplitude of low-frequency fluctuation (ALFF) of RS-fMRI. The blind group and the sighted group shared similar pattern of differences between the EC and EO condition: ALFF was higher in the EC condition than the EO condition in the bilateral primary sensorimotor cortex, bilateral supplementary motor area, and inferior occipital cortex, while ALFF was lower in the EC condition than the EO condition in the medial prefrontal cortex, highlighting the "nature" effect on the difference between the EC and EO conditions. The results of other matrices such as fractional ALFF (fALFF) and regional homogeneity (ReHo) showed similar patterns to that of ALFF. Moreover, no significant difference was observed between the EC-EO pattern of the two subgroups of congenital blind (i.e., with and without light perception), suggesting that the EC-EO difference is irrespective of residual light perception which reinforced the "nature" effect. We also found between-group differences, i.e., more probably "nurture effect", in the posterior insula and fusiform. Our results suggest that the acts of closing and opening the eyes are of importance for the congenital blind, and that these actions and their differences might be inherent in the nature of humans.
Collapse
|
14
|
Stiles NRB, Patel VR, Weiland JD. Multisensory perception in Argus II retinal prosthesis patients: Leveraging auditory-visual mappings to enhance prosthesis outcomes. Vision Res 2021; 182:58-68. [PMID: 33607599 DOI: 10.1016/j.visres.2021.01.008] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Revised: 01/17/2021] [Accepted: 01/18/2021] [Indexed: 11/18/2022]
Abstract
Crossmodal mappings associate features (such as spatial location) between audition and vision, thereby aiding sensory binding and perceptual accuracy. Previously, it has been unclear whether patients with artificial vision will develop crossmodal mappings despite the low spatial and temporal resolution of their visual perception (particularly in light of the remodeling of the retina and visual cortex that takes place during decades of vision loss). To address this question, we studied crossmodal mappings psychophysically in Retinitis Pigmentosa patients with partial visual restoration by means of Argus II retinal prostheses, which incorporate an electrode array implanted on the retinal surface that stimulates still-viable ganglion cells with a video stream from a head-mounted camera. We found that Argus II patients (N = 10) exhibit significant crossmodal mappings between auditory location and visual location, and between auditory pitch and visual elevation, equivalent to those of age-matched sighted controls (N = 10). Furthermore, Argus II patients (N = 6) were able to use crossmodal mappings to locate a visual target more quickly with auditory cueing than without. Overall, restored artificial vision was shown to interact with audition via crossmodal mappings, which implies that the reorganization during blindness and the limitations of artificial vision did not prevent the relearning of crossmodal mappings. In particular, cueing based on crossmodal mappings was shown to improve visual search with a retinal prosthesis. This result represents a key first step toward leveraging crossmodal interactions for improved patient visual functionality.
Collapse
Affiliation(s)
- Noelle R B Stiles
- Department of Ophthalmology, University of Southern California, 1450 San Pablo Street, Los Angeles, CA 90033, USA; Department of Biomedical Engineering, University of Michigan, 2800 Plymouth Road, Ann Arbor, MI 48109, USA.
| | - Vivek R Patel
- Department of Ophthalmology, University of Southern California, 1450 San Pablo Street, Los Angeles, CA 90033, USA
| | - James D Weiland
- Department of Biomedical Engineering, University of Michigan, 2800 Plymouth Road, Ann Arbor, MI 48109, USA; Department of Ophthalmology and Visual Sciences, University of Michigan, 1000 Wall Street, Ann Arbor, MI 48109, USA
| |
Collapse
|
15
|
Chen L, Wu B, Qiao C, Liu DQ. Resting EEG in alpha band predicts individual differences in visual size perception. Brain Cogn 2020; 145:105625. [PMID: 32932108 DOI: 10.1016/j.bandc.2020.105625] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Revised: 08/04/2020] [Accepted: 09/02/2020] [Indexed: 11/19/2022]
Abstract
Human visual size perception results from an interaction of external sensory information and internal state. The cognitive mechanisms involved in the processing of context-dependent visual size perception have been found to be innate in nature to some extent, suggesting that visual size perception might correlate with human intrinsic brain activity. Here we recorded human resting alpha activity (8-12 Hz), which is an inverse indicator of sustained alertness. Moreover, we measured an object's perceived size in a two-alternative forced-choice manner and the Ebbinghaus illusion magnitude which is a classic illustration of context-dependent visual size perception. The results showed that alpha activity along the ventral visual pathway, including left V1, right LOC and bilateral inferior temporal gyrus, negatively correlated with an object's perceived size. Moreover, alpha activity in the left superior temporal gyrus positively correlated with size discrimination threshold and size illusion magnitude. The findings provide clear evidence that human visual size perception scales as a function of intrinsic alertness, with higher alertness linking to larger perceived size of objects and better performance in size discrimination and size illusion tasks, and suggest that individual variation in resting-state brain activity provides a neural explanation for individual variation in cognitive performance of normal participants.
Collapse
Affiliation(s)
- Lihong Chen
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, PR China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian, PR China.
| | - Baoyu Wu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, PR China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian, PR China
| | - Congying Qiao
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, PR China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian, PR China
| | - Dong-Qiang Liu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, PR China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, Dalian, PR China.
| |
Collapse
|
16
|
Mechanisms underlying simultaneous brightness contrast: Early and innate. Vision Res 2020; 173:41-49. [PMID: 32464426 DOI: 10.1016/j.visres.2020.04.012] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2019] [Revised: 04/25/2020] [Accepted: 04/26/2020] [Indexed: 11/21/2022]
Abstract
In the phenomenon of simultaneous brightness contrast, two patches, one on a dark background and the other on a light one, appear to have different brightness despite being physically equi-luminant. Elucidating the phenomenon's underlying mechanisms is relevant for the larger question of how the visual system makes photometric judgments in images. Accounts over the past century have spanned low-, mid- and high-level visual processes, but a definitive resolution has not emerged. We present three studies that collectively demonstrate that the computations underlying this phenomenon are low-level, instantiated prior to binocular fusion, and available innately, without need for inferential learning via an individual's visual experience. In our first two studies, we find that strong brightness induction is obtained even when observers are unaware of any luminance differences in the neighborhoods of the probe patches. Results with dichoptic displays reveal that eye of origin, although not evident consciously, has a marked influence on the eventual brightness percept of the probe patches, thereby localizing brightness estimation to a site preceding binocular fusion. The third study uses conventional simultaneous brightness contrast displays, but an unusual group of participants: Congenitally blind children whom we were able to treat surgically. The results demonstrate an immediate susceptibility to the simultaneous brightness illusion after sight onset. Together, these data strongly constrain the search for mechanisms underlying a fundamental brightness phenomenon.
Collapse
|
17
|
Castaldi E, Lunghi C, Morrone MC. Neuroplasticity in adult human visual cortex. Neurosci Biobehav Rev 2020; 112:542-552. [DOI: 10.1016/j.neubiorev.2020.02.028] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 12/30/2019] [Accepted: 02/20/2020] [Indexed: 12/27/2022]
|
18
|
Teufel C, Fletcher PC. Forms of prediction in the nervous system. Nat Rev Neurosci 2020; 21:231-242. [DOI: 10.1038/s41583-020-0275-5] [Citation(s) in RCA: 56] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/30/2020] [Indexed: 12/18/2022]
|
19
|
Candy TR. The Importance of the Interaction Between Ocular Motor Function and Vision During Human Infancy. Annu Rev Vis Sci 2019; 5:201-221. [PMID: 31525140 DOI: 10.1146/annurev-vision-091718-014741] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Numerous studies have demonstrated the impact of imposed abnormal visual experience on the postnatal development of the visual system. These studies have provided fundamental insights into the mechanisms underlying neuroplasticity and its role in clinical care. However, the ocular motor responses of postnatal human infants largely define their visual experience in dynamic three-dimensional environments. Thus, the immature visual system needs to control its own visual experience. This review explores the interaction between the developing motor and sensory/perceptual visual systems, together with its importance in both typical development and the development of forms of strabismus and amblyopia.
Collapse
Affiliation(s)
- T Rowan Candy
- Optometry & Vision Science, School of Optometry; Psychological & Brain Sciences; and Neuroscience and Cognitive Science, Indiana University, Bloomington, Indiana 47401, USA;
| |
Collapse
|
20
|
Chouinard PA, Matheson KG, Royals KA, Landry O, Buckingham G, Saccone EJ, Hocking DR. The development of the size-weight illusion in children coincides with the development of nonverbal cognition rather than motor skills. J Exp Child Psychol 2019; 184:48-64. [PMID: 30991339 DOI: 10.1016/j.jecp.2019.03.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2018] [Revised: 03/19/2019] [Accepted: 03/19/2019] [Indexed: 10/27/2022]
Abstract
We examined how the strength of the size-weight illusion develops with age in typically developing children. To this end, we recruited children aged 5-12 years and quantified the degree to which they experienced the illusion. We hypothesized that the strength of the illusion would increase with age. The results supported this hypothesis. We also measured abilities in manual dexterity, receptive language, and abstract reasoning to determine whether changes in illusion strength were associated with these factors. Manual dexterity and receptive language did not correlate with illusion strength. Conversely, illusion strength and abstract reasoning were tightly coupled with each other. Multiple regression further revealed that age, manual dexterity, and receptive language did not contribute more to the variance in illusion strength beyond children's abilities in abstract reasoning. Taken together, the effects of age on the size-weight illusion appear to be explained by the development of nonverbal cognition. These findings not only inform the literature on child development but also have implications for theoretical explanations on the size-weight illusion. We suggest that the illusion has a strong acquired component to it and that it is strengthened by children's reasoning skills and perhaps an understanding of the world that develops with age.
Collapse
Affiliation(s)
- Philippe A Chouinard
- Department of Psychology and Counselling, School of Psychology and Public Health, La Trobe University, Melbourne, Victoria 3086, Australia.
| | - Kezia G Matheson
- Department of Psychology and Counselling, School of Psychology and Public Health, La Trobe University, Melbourne, Victoria 3086, Australia
| | - Kayla A Royals
- Department of Psychology and Counselling, School of Psychology and Public Health, La Trobe University, Melbourne, Victoria 3086, Australia
| | - Oriane Landry
- Department of Psychology and Counselling, School of Psychology and Public Health, La Trobe University, Melbourne, Victoria 3086, Australia
| | - Gavin Buckingham
- Department of Sport and Health Sciences, University of Exeter, Exeter, Devon EX4 4PY, UK
| | - Elizabeth J Saccone
- Department of Psychology and Counselling, School of Psychology and Public Health, La Trobe University, Melbourne, Victoria 3086, Australia
| | - Darren R Hocking
- Developmental Neuromotor and Cognition Lab, School of Psychology and Public Health, La Trobe University, Melbourne, Victoria 3086, Australia
| |
Collapse
|
21
|
Saccone EJ, Chouinard PA. The influence of size in weight illusions is unique relative to other object features. Psychon Bull Rev 2019; 26:77-89. [PMID: 30187441 DOI: 10.3758/s13423-018-1519-5] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Research into weight illusions has provided valuable insight into the functioning of the human perceptual system. Associations between the weight of an object and its other features, such as its size, material, density, conceptual information, or identity, influence our expectations and perceptions of weight. Earlier accounts of weight illusions underscored the importance of previous interactions with objects in the formation of these associations. In this review, we propose a theory that the influence of size on weight perception could be driven by innate and phylogenetically older mechanisms, and that it is therefore more deep-seated than the effects of other features that influence our perception of an object's weight. To do so, we first consider the different associations that exist between the weight of an object and its other features and discuss how different object features influence weight perception in different weight illusions. After this, we consider the cognitive, neurological, and developmental evidence, highlighting the uniqueness of size-weight associations and how they might be reinforced rather than driven by experience alone. In the process, we propose a novel neuroanatomical account of how size might influence weight perception differently than other object features do.
Collapse
Affiliation(s)
- Elizabeth J Saccone
- School of Psychology and Public Health, La Trobe University, Edwards Road, Flora Hill, Victoria, 3552, Australia.
| | - Philippe A Chouinard
- School of Psychology and Public Health, La Trobe University, Edwards Road, Flora Hill, Victoria, 3552, Australia
| |
Collapse
|
22
|
Contour interpolation: A case study in Modularity of Mind. Cognition 2018; 174:1-18. [PMID: 29407601 DOI: 10.1016/j.cognition.2018.01.008] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2017] [Revised: 01/17/2018] [Accepted: 01/18/2018] [Indexed: 01/29/2023]
Abstract
In his monograph Modularity of Mind (1983), philosopher Jerry Fodor argued that mental architecture can be partly decomposed into computational organs termed modules, which were characterized as having nine co-occurring features such as automaticity, domain specificity, and informational encapsulation. Do modules exist? Debates thus far have been framed very generally with few, if any, detailed case studies. The topic is important because it has direct implications on current debates in cognitive science and because it potentially provides a viable framework from which to further understand and make hypotheses about the mind's structure and function. Here, the case is made for the modularity of contour interpolation, which is a perceptual process that represents non-visible edges on the basis of how surrounding visible edges are spatiotemporally configured. There is substantial evidence that interpolation is domain specific, mandatory, fast, and developmentally well-sequenced; that it produces representationally impoverished outputs; that it relies upon a relatively fixed neural architecture that can be selectively impaired; that it is encapsulated from belief and expectation; and that its inner workings cannot be fathomed through conscious introspection. Upon differentiating contour interpolation from a higher-order contour representational ability ("contour abstraction") and upon accommodating seemingly inconsistent experimental results, it is argued that interpolation is modular to the extent that the initiating conditions for interpolation are strong. As interpolated contours become more salient, the modularity features emerge. The empirical data, taken as a whole, show that at least certain parts of the mind are modularly organized.
Collapse
|
23
|
Cross-Modal Plasticity in Higher-Order Auditory Cortex of Congenitally Deaf Cats Does Not Limit Auditory Responsiveness to Cochlear Implants. J Neurosci 2017; 36:6175-85. [PMID: 27277796 DOI: 10.1523/jneurosci.0046-16.2016] [Citation(s) in RCA: 62] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2016] [Accepted: 04/19/2016] [Indexed: 12/29/2022] Open
Abstract
UNLABELLED Congenital sensory deprivation can lead to reorganization of the deprived cortical regions by another sensory system. Such cross-modal reorganization may either compete with or complement the "original" inputs to the deprived area after sensory restoration and can thus be either adverse or beneficial for sensory restoration. In congenital deafness, a previous inactivation study documented that supranormal visual behavior was mediated by higher-order auditory fields in congenitally deaf cats (CDCs). However, both the auditory responsiveness of "deaf" higher-order fields and interactions between the reorganized and the original sensory input remain unknown. Here, we studied a higher-order auditory field responsible for the supranormal visual function in CDCs, the auditory dorsal zone (DZ). Hearing cats and visual cortical areas served as a control. Using mapping with microelectrode arrays, we demonstrate spatially scattered visual (cross-modal) responsiveness in the DZ, but show that this did not interfere substantially with robust auditory responsiveness elicited through cochlear implants. Visually responsive and auditory-responsive neurons in the deaf auditory cortex formed two distinct populations that did not show bimodal interactions. Therefore, cross-modal plasticity in the deaf higher-order auditory cortex had limited effects on auditory inputs. The moderate number of scattered cross-modally responsive neurons could be the consequence of exuberant connections formed during development that were not pruned postnatally in deaf cats. Although juvenile brain circuits are modified extensively by experience, the main driving input to the cross-modally (visually) reorganized higher-order auditory cortex remained auditory in congenital deafness. SIGNIFICANCE STATEMENT In a common view, the "unused" auditory cortex of deaf individuals is reorganized to a compensatory sensory function during development. According to this view, cross-modal plasticity takes over the unused cortex and reassigns it to the remaining senses. Therefore, cross-modal plasticity might conflict with restoration of auditory function with cochlear implants. It is unclear whether the cross-modally reorganized auditory areas lose auditory responsiveness. We show that the presence of cross-modal plasticity in a higher-order auditory area does not reduce auditory responsiveness of that area. Visual reorganization was moderate, spatially scattered and there were no interactions between cross-modally reorganized visual and auditory inputs. These results indicate that cross-modal reorganization is less detrimental for neurosensory restoration than previously thought.
Collapse
|
24
|
Andres E, McKyton A, Ben-Zion I, Zohary E. Size constancy following long-term visual deprivation. Curr Biol 2017; 27:R696-R697. [DOI: 10.1016/j.cub.2017.05.071] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
25
|
Liu TT, Behrmann M. Functional outcomes following lesions in visual cortex: Implications for plasticity of high-level vision. Neuropsychologia 2017; 105:197-214. [PMID: 28668576 DOI: 10.1016/j.neuropsychologia.2017.06.030] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2016] [Revised: 06/27/2017] [Accepted: 06/28/2017] [Indexed: 12/13/2022]
Abstract
Understanding the nature and extent of neural plasticity in humans remains a key challenge for neuroscience. Importantly, however, a precise characterization of plasticity and its underlying mechanism has the potential to enable new approaches for enhancing reorganization of cortical function. Investigations of the impairment and subsequent recovery of cognitive and perceptual functions following early-onset cortical lesions in humans provide a unique opportunity to elucidate how the brain changes, adapts, and reorganizes. Specifically, here, we focus on restitution of visual function, and we review the findings on plasticity and re-organization of the ventral occipital temporal cortex (VOTC) in published reports of 46 patients with a lesion to or resection of the visual cortex early in life. Findings reveal that a lesion to the VOTC results in a deficit that affects the visual recognition of more than one category of stimuli (faces, objects and words). In addition, the majority of pediatric patients show limited recovery over time, especially those in whom deficits in low-level vision also persist. Last, given that neither the equipotentiality nor the modularity view on plasticity was clearly supported, we suggest some intermediate possibilities in which some plasticity may be evident but that this might depend on the area that was affected, its maturational trajectory as well as its structural and functional connectivity constraints. Finally, we offer suggestions for future research that can elucidate plasticity further.
Collapse
Affiliation(s)
- Tina T Liu
- Department of Psychology, and, Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, USA.
| | - Marlene Behrmann
- Department of Psychology, and, Center for the Neural Basis of Cognition, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
26
|
Abstract
In humans, geometrical illusions are thought to reflect mechanisms that are usually helpful for seeing the world in a predictable manner. These mechanisms deceive us given the right set of circumstances, correcting visual input where a correction is not necessary. Investigations of non-human animals' susceptibility to geometrical illusions have yielded contradictory results, suggesting that the underlying mechanisms with which animals see the world may differ across species. In this review, we first collate studies showing that different species are susceptible to specific illusions in the same or reverse direction as humans. Based on a careful assessment of these findings, we then propose several ecological and anatomical factors that may affect how a species perceives illusory stimuli. We also consider the usefulness of this information for determining whether sight in different species might be more similar to human sight, being influenced by contextual information, or to how machines process and transmit information as programmed. Future testing in animals could provide new theoretical insights by focusing on establishing dissociations between stimuli that may or may not alter perception in a particular species. This information could improve our understanding of the mechanisms behind illusions, but also provide insight into how sight is subjectively experienced by different animals, and the degree to which vision is innate versus acquired, which is difficult to examine in humans.
Collapse
|
27
|
Perceptual similarity and the neural correlates of geometrical illusions in human brain structure. Sci Rep 2017; 7:39968. [PMID: 28067329 PMCID: PMC5220349 DOI: 10.1038/srep39968] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2016] [Accepted: 11/29/2016] [Indexed: 11/18/2022] Open
Abstract
Geometrical visual illusions are an intriguing phenomenon, in which subjective perception consistently misjudges the objective, physical properties of the visual stimulus. Prominent theoretical proposals have been advanced attempting to find common mechanisms across illusions. But empirically testing the similarity between illusions has been notoriously difficult because illusions have very different visual appearances. Here we overcome this difficulty by capitalizing on the variability of the illusory magnitude across participants. Fifty-nine healthy volunteers participated in the study that included measurement of individual illusion magnitude and structural MRI scanning. We tested the Muller-Lyer, Ebbinghaus, Ponzo, and vertical-horizontal geometrical illusions as well as a non-geometrical, contrast illusion. We found some degree of similarity in behavioral judgments of all tested geometrical illusions, but not between geometrical illusions and non-geometrical, contrast illusion. The highest similarity was found between Ebbinghaus and Muller-Lyer geometrical illusions. Furthermore, the magnitude of all geometrical illusions, and particularly the Ebbinghaus and Muller-Lyer illusions, correlated with local gray matter density in the parahippocampal cortex, but not in other brain areas. Our findings suggest that visuospatial integration and scene construction processes might partly mediate individual differences in geometric illusory perception. Overall, these findings contribute to a better understanding of the mechanisms behind geometrical illusions.
Collapse
|
28
|
|
29
|
Murray MM, Matusz PJ, Amedi A. Neuroplasticity: Unexpected Consequences of Early Blindness. Curr Biol 2016; 25:R998-R1001. [PMID: 26485377 DOI: 10.1016/j.cub.2015.08.054] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
A pair of recent studies shows that congenital blindness can have significant consequences for the functioning of the visual system after sight restoration, particularly if that restoration is delayed.
Collapse
Affiliation(s)
- Micah M Murray
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology & Department of Clinical Neurosciences, University Hospital Centre and University of Lausanne, Lausanne, Switzerland; The Electroencephalography Brain Mapping Core, Centre for Biomedical Imaging (CIBM), University Hospital Centre and University of Lausanne, Lausanne, Switzerland; Department of Ophthalmology, University of Lausanne, Jules-Gonin Eye Hospital, Lausanne, Switzerland; Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN 37232, USA.
| | - Pawel J Matusz
- The Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology & Department of Clinical Neurosciences, University Hospital Centre and University of Lausanne, Lausanne, Switzerland; University of Social Sciences and Humanities, Faculty in Wroclaw, Wroclaw, Poland; Attention, Brain and Cognitive Development Group, Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Amir Amedi
- Department of Medical Neurobiology, Institute for Medical Research Israel-Canada (IMRIC), Hadassah Medical School, Hebrew University of Jerusalem, Jerusalem, Israel; The Edmond & Lily Safra Centre for Brain Sciences (ELSC), and Cognitive Science Program Hebrew University of Jerusalem, Jerusalem, Israel; Sorbonne Universités, UPMC Univ Paris 06, Institut de la Vision, UMR_S 968, Paris, F-75012, France.
| |
Collapse
|
30
|
Versace E, Vallortigara G. Origins of Knowledge: Insights from Precocial Species. Front Behav Neurosci 2015; 9:338. [PMID: 26696856 PMCID: PMC4673401 DOI: 10.3389/fnbeh.2015.00338] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2015] [Accepted: 11/20/2015] [Indexed: 01/01/2023] Open
Abstract
Behavioral responses are influenced by knowledge acquired during the lifetime of an individual and by predispositions transmitted across generations. Establishing the origin of knowledge and the role of the unlearned component is a challenging task, given that both learned and unlearned knowledge can orient perception, learning, and the encoding of environmental features since the first stages of life. Ethical and practical issues constrain the investigation of unlearned knowledge in altricial species, including human beings. On the contrary, precocial animals can be tested on a wide range of tasks and capabilities immediately after birth and in controlled rearing conditions. Insects and precocial avian species are very convenient models to dissect the knowledge systems that enable young individuals to cope with their environment in the absence of specific previous experience. We present the state of the art of research on the origins of knowledge that comes from different models and disciplines. Insects have been mainly used to investigate unlearned sensory preferences and prepared learning mechanisms. The relative simplicity of the neural system and fast life cycle of insects make them ideal models to investigate the neural circuitry and evolutionary dynamics of unlearned traits. Among avian species, chicks of the domestic fowl have been the focus of many studies, and showed to possess unlearned knowledge in the sensory, physical, spatial, numerical and social domains. Solid evidence shows the existence of unlearned knowledge in different domains in several species, from sensory and social preferences to the left-right representation of the mental number line. We show how non-mammalian models of cognition, and in particular precocial species, can shed light into the adaptive value and evolutionary history of unlearned knowledge.
Collapse
Affiliation(s)
- Elisabetta Versace
- Animal Cognition and Neuroscience Laboratory, Center for Mind/Brain Sciences, University of Trento Rovereto, Italy
| | - Giorgio Vallortigara
- Animal Cognition and Neuroscience Laboratory, Center for Mind/Brain Sciences, University of Trento Rovereto, Italy
| |
Collapse
|
31
|
Tracy DK, Joyce DW, Shergill SS. Kaleidoscope. Br J Psychiatry 2015; 207:183-4. [PMID: 26243769 DOI: 10.1192/bjp.207.2.183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Antidepressant effectiveness is a topic seldom out of the scientific or popular press, with claim and counter-claim about the disclosure, reporting, and interpretation of data. Hieronymus and colleagues1 have thrown their hats into the ring: noting that about half of company-sponsored trials failed to show any superiority over placebo, they challenge that most studies evaluated changes in total scores on the 17-point Hamilton Rating Scale for Depression (HRSD-17), but that this might mask improvement in important subcomponents. Not all items equally correlate with illness burden, so they undertook patient-level post hoc analyses focusing on the four-point depressed mood subcomponent in 18 placebo-controlled industry trials of various selective serotonin reuptake inhibitors (n = 6669). The choice of this question was based on its diagnostic importance and the fact it had the highest baseline severity in the pooled sample. The result was that 91% of comparisons showed superiority of the active drug over placebo, compared with 46% where the summed scale was used (P<0.001). The authors argue that the summed scale is insensitive, and clouds current views on medications. The end of the debate? We think not …
Collapse
|