Seeing with the mind's eye: top-down, bottom-up, and conscious awareness

Face Processing in Developmental Prosopagnosia: Altered Neural Representations in the Fusiform Face Area

Rationale: Face expertise is a pivotal social skill. Developmental prosopagnosia (DP), i.e., the inability to recognize faces without a history of brain damage, affects about 2% of the general population, and is a renowned model system of the face-processing network. Within this network, the right Fusiform Face Area (FFA), is particularly involved in face identity processing and may therefore be a key element in DP. Neural representations within the FFA have been examined with Representational Similarity Analysis (RSA), a data-analytical framework in which multi-unit measures of brain activity are assessed with correlation analysis. Objectives: Our study intended to scrutinize modifications of FFA-activation during face encoding and maintenance based on RSA. Methods: Thirteen participants with DP (23-70 years) and 12 healthy control subjects (19-62 years) participated in a functional MRI study, including morphological MRI, a functional FFA-localizer and a modified Sternberg paradigm probing face memory encoding and maintenance. Memory maintenance of one, two, or four faces represented low, medium, and high memory load. We examined conventional activation differences in response to working memory load and applied RSA to compute individual correlation-matrices on the voxel level. Group correlation-matrices were compared via Donsker's random walk analysis. Results: On the functional level, increased memory load entailed both a higher absolute FFA-activation level and a higher degree of correlation between activated voxels. Both aspects were deficient in DP. Interestingly, control participants showed a homogeneous degree of correlation for successful trials during the experiment. In DP-participants, correlation levels between FFA-voxels were significantly lower and were less sustained during the experiment. In behavioral terms, DP-participants performed poorer and had longer reaction times in relation to DP-severity. Furthermore, correlation levels were negatively correlated with reaction times for the most demanding high load condition. Conclusion: We suggest that participants with DP fail to generate robust and maintained neural representations in the FFA during face encoding and maintenance, in line with poorer task performance and prolonged reaction times. In DP, alterations of neural coding in the FFA might therefore explain curtailing in working memory and contribute to impaired long-term memory and mental imagery.

TMS applied to V1 can facilitate reasoning

Visual mental imagery is the subjective experience of seeing objects or events in front of the 'inner eye', although they are not actually present. Previous research indicates that (1) visual images help to remember what has been experienced in the past or when objects need to be inspected or manipulated, and (2) visual images are correlated with neural activity in early visual cortices, demonstrating a possible overlap between visual imagery and visual perception. However, recent research revealed that visual imagery can also disrupt cognitive processes and impede thinking. In this transcranial magnetic stimulation (TMS) experiment, participants had to solve relational reasoning problems that varied in their imageability (easy or difficult to visualize as a mental image). While solving the problems, eight 10 Hz pulses were either applied to primary visual cortex (V1) or a control site (Vertex). Our findings suggest a causal link between mental imagery, primary visual cortex, and reasoning with visual problems. Moreover, participants exhibited much lower error rates when TMS was applied to V1. We conclude that the disruption of visual images in primary visual cortex can facilitate reasoning.

Neural correlates of visual motion prediction

Predicting the trajectories of moving objects in our surroundings is important for many life scenarios, such as driving, walking, reaching, hunting and combat. We determined human subjects’ performance and task-related brain activity in a motion trajectory prediction task. The task required spatial and motion working memory as well as the ability to extrapolate motion information in time to predict future object locations. We showed that the neural circuits associated with motion prediction included frontal, parietal and insular cortex, as well as the thalamus and the visual cortex. Interestingly, deactivation of many of these regions seemed to be more closely related to task performance. The differential activity during motion prediction vs. direct observation was also correlated with task performance. The neural networks involved in our visual motion prediction task are significantly different from those that underlie visual motion memory and imagery. Our results set the stage for the examination of the effects of deficiencies in these networks, such as those caused by aging and mental disorders, on visual motion prediction and its consequences on mobility related daily activities.