1
|
Axelrod V, Rozier C, Sohier E, Lehongre K, Adam C, Lambrecq V, Navarro V, Naccache L. Intracranial study in humans: Neural spectral changes during watching comedy movie of Charlie Chaplin. Neuropsychologia 2023; 185:108558. [PMID: 37061128 DOI: 10.1016/j.neuropsychologia.2023.108558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 03/01/2023] [Accepted: 04/04/2023] [Indexed: 04/17/2023]
Abstract
Humor plays a prominent role in our lives. Thus, understanding the cognitive and neural mechanisms of humor is particularly important. Previous studies that investigated neural substrates of humor used functional MRI and to a lesser extent EEG. In the present study, we conducted intracranial recording in human patients, enabling us to obtain the signal with high temporal precision from within specific brain locations. Our analysis focused on the temporal lobe and the surrounding areas, the temporal lobe was most densely covered in our recording. Thirteen patients watched a fragment of a Charlie Chaplin movie. An independent group of healthy participants rated the same movie fragment, helping us to identify the most funny and the least funny frames of the movie. We compared neural activity occurring during the most funny and least funny frames across frequencies in the range of 1-170 Hz. The most funny compared to least funny parts of the movie were associated with activity modulation in the broadband high-gamma (70-170 Hz; mostly activation) and to a lesser extent gamma band (40-69Hz; activation) and low frequencies (1-12 Hz, delta, theta, alpha bands; mostly deactivation). With regard to regional specificity, we found three types of brain areas: (I) temporal pole, middle and inferior temporal gyrus (both anterior and posterior) in which there was both activation in the high-gamma/gamma bands and deactivation in low frequencies; (II) ventral part of the temporal lobe such as the fusiform gyrus, in which there was mostly deactivation the low frequencies; (III) posterior temporal cortex and its environment, such as the middle occipital and the temporo-parietal junction, in which there was activation in the high-gamma/gamma band. Overall, our results suggest that humor appreciation might be achieved by neural activity across the frequency spectrum.
Collapse
Affiliation(s)
- Vadim Axelrod
- The Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Ramat Gan, 52900, Israel.
| | - Camille Rozier
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Elisa Sohier
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Katia Lehongre
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France
| | - Claude Adam
- AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France
| | - Virginie Lambrecq
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France; AP-HP, EEG Unit, Neurophysiology Department, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France
| | - Vincent Navarro
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France; AP-HP, EEG Unit, Neurophysiology Department, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France; AP-HP, Epilepsy Unit, Pitié-Salpêtrière Hospital, DMU Neurosciences, Paris, France; AP-HP, Center of Reference for Rare Epilepsies, Pitié-Salpêtrière Hospital, Paris, France
| | - Lionel Naccache
- Sorbonne Université, Paris Brain Institute - Institut du Cerveau, ICM, INSERM, CNRS, AP-HP, Pitié-Salpêtrière Hospital, Paris, France; AP-HP, Groupe hospitalier Pitié-Salpêtrière, Department of Neurophysiology, 47-83 boulevard de l'Hôpital, Paris 75013, France
| |
Collapse
|
2
|
Abstract
High-complexity stimuli are thought to place extra demands on working memory when processing and manipulating such stimuli; however, operational definitions of complexity are not well established, nor are the measures that would demonstrate such effects. Here, we argue that complexity is a relative quantity that is affected by preexisting experience. Experiment 1 compared cued-recall performance for Chinese and English speakers when the stimuli involved Chinese features that varied in the number of strokes or involved Ethiopic features unfamiliar to both groups. Chinese pseudocharacters (two radicals) had half the strokes of Chinese pseudowords (two characters). The response terms were English words familiar to both groups. English speakers performed equivalently with the Ethiopic and pseudocharacters, but much worse on the pseudowords. In contrast, Chinese speakers performed equivalently with pseudowords or pseudocharacters, but worse with Ethiopic cues. Experiment 2 showed that the lack of a complexity effect for Chinese speakers was not due to greater ease of rehearsal of pseudowords compared with pseudocharacters. Experiment 3 ruled out that Chinese speakers are just better at learning paired associates involving Mandarin by demonstrating that while complexity did not affect them, other features of the stimuli did. Taken together, it appears that complexity is not an absolute property based on the number of visual elements, but rather a relative property affected by one's prior knowledge.
Collapse
|
3
|
Ellis CT, Turk-Browne NB. Complexity can facilitate visual and auditory perception. J Exp Psychol Hum Percept Perform 2019; 45:1271-1284. [PMID: 31318229 DOI: 10.1037/xhp0000670] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Visual and auditory inputs vary in complexity. For example, driving in a city versus the country or listening to the radio versus not are experiences that differ in complexity. How does such complexity impact perception? One possibility is that complex stimuli demand resources that exceed attentional or working memory capacities, reducing sensitivity to perceptual changes. Alternatively, complexity may allow for richer and more distinctive representations, increasing such sensitivity. We performed five experiments to test the nature of the relationship between complexity and perceptual sensitivity during movie clip viewing. Experiment 1 revealed higher sensitivity to global changes in audio or video streams for clips with greater complexity, defined both subjectively (judgments by independent coders) and objectively (information-theoretic redundancy). Experiment 2 replicated this finding but found no evidence that it resulted from complexity drawing attention. Experiment 3 provided a boundary condition by showing that change detection was unaffected by complexity when the changes were superimposed on, rather than dispersed throughout, the clips. Experiment 4 suggested that the effect of complexity, at least when defined objectively, was present without the working memory demands of the preceding experiments. Experiment 5 suggested that complexity led to richer representations of the clips, as reflected in enhanced long-term memory. Collectively, these findings show that, despite increasing informational load, complexity can serve to ground and facilitate perceptual sensitivity. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
|
4
|
Khan N, Martini MG. Bandwidth Modeling of Silicon Retinas for Next Generation Visual Sensor Networks. SENSORS 2019; 19:s19081751. [PMID: 31013739 PMCID: PMC6515179 DOI: 10.3390/s19081751] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2019] [Revised: 03/23/2019] [Accepted: 04/03/2019] [Indexed: 11/16/2022]
Abstract
Silicon retinas, also known as Dynamic Vision Sensors (DVS) or event-based visual sensors, have shown great advantages in terms of low power consumption, low bandwidth, wide dynamic range and very high temporal resolution. Owing to such advantages as compared to conventional vision sensors, DVS devices are gaining more and more attention in various applications such as drone surveillance, robotics, high-speed motion photography, etc. The output of such sensors is a sequence of events rather than a series of frames as for classical cameras. Estimating the data rate of the stream of events associated with such sensors is needed for the appropriate design of transmission systems involving such sensors. In this work, we propose to consider information about the scene content and sensor speed to support such estimation, and we identify suitable metrics to quantify the complexity of the scene for this purpose. According to the results of this study, the event rate shows an exponential relationship with the metric associated with the complexity of the scene and linear relationships with the speed of the sensor. Based on these results, we propose a two-parameter model for the dependency of the event rate on scene complexity and sensor speed. The model achieves a prediction accuracy of approximately 88.4% for the outdoor environment along with the overall prediction performance of approximately 84%.
Collapse
Affiliation(s)
- Nabeel Khan
- Wireless and Multimedia Networking Research Group, Faculty of Science, Engineering and Computing, Kingston University, Penrhyn Rd, Kingston upon Thames KT1 2EE 1, UK.
| | - Maria G Martini
- Wireless and Multimedia Networking Research Group, Faculty of Science, Engineering and Computing, Kingston University, Penrhyn Rd, Kingston upon Thames KT1 2EE 1, UK.
| |
Collapse
|
5
|
van Marlen T, van Wermeskerken M, van Gog T. Effects of visual complexity and ambiguity of verbal instructions on target identification. JOURNAL OF COGNITIVE PSYCHOLOGY 2019. [DOI: 10.1080/20445911.2018.1552700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Tim van Marlen
- Department of Education, Utrecht University Utrecht, Netherlands
| | | | - Tamara van Gog
- Department of Education, Utrecht University Utrecht, Netherlands
| |
Collapse
|
6
|
Schoth DE, Wu J, Zhang J, Guo X, Liossi C. Eye-movement behaviours when viewing real-world pain-related images. Eur J Pain 2019; 23:945-956. [PMID: 30629782 DOI: 10.1002/ejp.1363] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2017] [Revised: 12/10/2018] [Accepted: 12/19/2018] [Indexed: 11/09/2022]
Abstract
BACKGROUND Pain-related cues are evolutionarily primed to capture attention, although evidence of attentional biases towards pain-related information is mixed in healthy individuals. The present study explores whether healthy individuals show significantly different eye-movement behaviours when viewing real-world pain-related scenes compared to neutral scenes. The effect of manipulating via written information the threat value of the pain-related scenes on eye-movement behaviours was also assessed. METHODS Participants were randomized to threatening (n = 28) and non-threatening (n = 27) information conditions. All completed a free-viewing task with real-world pain-related and neutral images while their eye movements were recorded. RESULTS Participants made significantly fewer fixations of significantly longer duration when viewing pain-related images compared to neutral images. No significant differences were found between threatening and non-threatening information groups in their pattern of eye movements. CONCLUSIONS This study shows that healthy individuals demonstrate attentional biases to pain-related real-world complex images compared to neutral images. Future research is needed to establish the implications of these biases, particularly in the context of acute pain, on the onset and/or subsequent maintenance of chronic pain conditions. SIGNIFICANCE Healthy individuals show different eye-movement behaviours when viewing pain-related scenes than neutral scenes, supporting evolutionary accounts of pain. Implications for the onset and/or maintenance of chronic pain need to be explored.
Collapse
Affiliation(s)
- Daniel E Schoth
- Pain Research Laboratory, Department of Psychology, University of Southampton, Southampton, UK
| | - Jun Wu
- School of Psychology, South China Normal University, Guangzhou, China
| | - Jin Zhang
- Pain Research Laboratory, Department of Psychology, University of Southampton, Southampton, UK
| | - Xiaoying Guo
- School of Software Engineering, Shanxi University, Taiyuan, China
| | - Christina Liossi
- Pain Research Laboratory, Department of Psychology, University of Southampton, Southampton, UK
| |
Collapse
|
7
|
Kosonogov V, Martínez-Selva JM, Torrente G, Carrillo-Verdejo E, Arenas A, Sánchez-Navarro JP. Head Motion Elicited by Viewing Affective Pictures as Measured by a New LED-Based Technique. Multisens Res 2019; 32:1-14. [PMID: 31117047 DOI: 10.1163/22134808-20191363] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2018] [Accepted: 04/26/2019] [Indexed: 12/25/2022]
Abstract
The complex sensory input and motor reflexes that keep body posture and head position aligned are influenced by emotional reactions evoked by visual or auditory stimulation. Several theoretical approaches have emphasized the relevance of motor reactions in emotional response. Emotions are considered as a tendency or predisposition to act that depends on two motivational systems in the brain - the appetitive system, related to approach behaviours, and the defensive system, related to withdrawal or fight-or-flight behaviours. Few studies on emotion have been conducted employing kinematic methods, however. Motion analysis of the head may be a promising method for studying the impact of viewing affective pictures on emotional response. For this purpose, we presented unpleasant, neutral and pleasant affective pictures. Participants were instructed to view the pictures and to remain still. Two light-emitting diodes (LEDs) were attached to the foreheads of participants, and a Wii Remote controller, positioned 25 cm away, detected the position of the LEDs in the medial-lateral and anterior-posterior axes. We found more sway in response to unpleasant pictures. In addition, unpleasant pictures also provoked faster movements than both neutral and pleasant pictures. This response to unpleasant pictures, in contrast to pleasant ones, might reflect the readiness or predisposition to act. Our data also revealed that men moved faster than women, which is in accordance with previous findings related to gender differences.
Collapse
Affiliation(s)
| | - José M Martínez-Selva
- 1University of Murcia, Spain
- 3Murcia Institute for Biomedical Research (IMIB-Arrixaca), Spain
| | - Ginesa Torrente
- 1University of Murcia, Spain
- 3Murcia Institute for Biomedical Research (IMIB-Arrixaca), Spain
| | | | | | - Juan P Sánchez-Navarro
- 1University of Murcia, Spain
- 3Murcia Institute for Biomedical Research (IMIB-Arrixaca), Spain
| |
Collapse
|
8
|
GraphCom: A multidimensional measure of graphic complexity applied to 131 written languages. Behav Res Methods 2018; 50:427-449. [PMID: 28425059 DOI: 10.3758/s13428-017-0881-y] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
We report a new multidimensional measure of visual complexity (GraphCom) that captures variability in the complexity of graphs within and across writing systems. We applied the measure to 131 written languages, allowing comparisons of complexity and providing a basis for empirical testing of GraphCom. The measure includes four dimensions whose value in capturing the different visual properties of graphs had been demonstrated in prior reading research-(1) perimetric complexity, sensitive to the ratio of a written form to its surrounding white space (Pelli, Burns, Farell, & Moore-Page, 2006); (2) number of disconnected components, sensitive to discontinuity (Gibson, 1969); (3) number of connected points, sensitive to continuity (Lanthier, Risko, Stolz, & Besner, 2009); and (4) number of simple features, sensitive to the strokes that compose graphs (Wu, Zhou, & Shu, 1999). In our analysis of the complexity of 21,550 graphs, we (a) determined the complexity variation across writing systems along each dimension, (b) examined the relationships among complexity patterns within and across writing systems, and (c) compared the dimensions in their abilities to differentiate the graphs from different writing systems, in order to predict human perceptual judgments (n = 180) of graphs with varying complexity. The results from the computational and experimental comparisons showed that GraphCom provides a measure of graphic complexity that exceeds previous measures in its empirical validation. The measure can be universally applied across writing systems, providing a research tool for studies of reading and writing.
Collapse
|
9
|
Gartus A, Leder H. Predicting perceived visual complexity of abstract patterns using computational measures: The influence of mirror symmetry on complexity perception. PLoS One 2017; 12:e0185276. [PMID: 29099832 PMCID: PMC5669424 DOI: 10.1371/journal.pone.0185276] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2017] [Accepted: 09/08/2017] [Indexed: 11/18/2022] Open
Abstract
Visual complexity is relevant for many areas ranging from improving usability of technical displays or websites up to understanding aesthetic experiences. Therefore, many attempts have been made to relate objective properties of images to perceived complexity in artworks and other images. It has been argued that visual complexity is a multidimensional construct mainly consisting of two dimensions: A quantitative dimension that increases complexity through number of elements, and a structural dimension representing order negatively related to complexity. The objective of this work is to study human perception of visual complexity utilizing two large independent sets of abstract patterns. A wide range of computational measures of complexity was calculated, further combined using linear models as well as machine learning (random forests), and compared with data from human evaluations. Our results confirm the adequacy of existing two-factor models of perceived visual complexity consisting of a quantitative and a structural factor (in our case mirror symmetry) for both of our stimulus sets. In addition, a non-linear transformation of mirror symmetry giving more influence to small deviations from symmetry greatly increased explained variance. Thus, we again demonstrate the multidimensional nature of human complexity perception and present comprehensive quantitative models of the visual complexity of abstract patterns, which might be useful for future experiments and applications.
Collapse
Affiliation(s)
- Andreas Gartus
- Department of Basic Psychological Research and Research Methods, Faculty of Psychology, University of Vienna, Vienna, Austria
| | - Helmut Leder
- Department of Basic Psychological Research and Research Methods, Faculty of Psychology, University of Vienna, Vienna, Austria
| |
Collapse
|
10
|
Lobben M, Bochynska A. Grounding by Attention Simulation in Peripersonal Space: Pupils Dilate to Pinch Grip But Not Big Size Nominal Classifier. Cogn Sci 2017; 42:576-599. [PMID: 28766754 DOI: 10.1111/cogs.12524] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2016] [Revised: 06/12/2017] [Accepted: 06/23/2017] [Indexed: 11/30/2022]
Abstract
Grammatical categories represent implicit knowledge, and it is not known if such abstract linguistic knowledge can be continuously grounded in real-life experiences, nor is it known what types of mental states can be simulated. A former study showed that attention bias in peripersonal space (PPS) affects reaction times in grammatical congruency judgments of nominal classifiers, suggesting that simulated semantics may include reenactment of attention. In this study, we contrasted a Chinese nominal classifier used with nouns denoting pinch grip objects with a classifier for nouns with big object referents in a pupil dilation experiment. Twenty Chinese native speakers read grammatical and ungrammatical classifier-noun combinations and made grammaticality judgment while their pupillary responses were measured. It was found that their pupils dilated significantly more to the pinch grip classifier than to the big object classifier, indicating attention simulation in PPS. Pupil dilations were also significantly larger with congruent trials on the whole than in incongruent trials, but crucially, congruency and classifier semantics were independent of each other. No such effects were found in controls.
Collapse
Affiliation(s)
| | - Agata Bochynska
- Department of Language and Literature, Norwegian University of Science and Technology (NTNU)
| |
Collapse
|
11
|
Cyr M, Nee DE, Nelson E, Senger T, Jonides J, Malapani C. Effects of proactive interference on non-verbal working memory. Cogn Process 2017; 18:1-12. [PMID: 27838866 PMCID: PMC5292286 DOI: 10.1007/s10339-016-0784-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2016] [Accepted: 11/02/2016] [Indexed: 10/20/2022]
Abstract
Working memory (WM) is a cognitive system responsible for actively maintaining and processing relevant information and is central to successful cognition. A process critical to WM is the resolution of proactive interference (PI), which involves suppressing memory intrusions from prior memories that are no longer relevant. Most studies that have examined resistance to PI in a process-pure fashion used verbal material. By contrast, studies using non-verbal material are scarce, and it remains unclear whether the effect of PI is domain-general or whether it applies solely to the verbal domain. The aim of the present study was to examine the effect of PI in visual WM using both objects with high and low nameability. Using a Directed-Forgetting paradigm, we varied discriminability between WM items on two dimensions, one verbal (high-nameability vs. low-nameability objects) and one perceptual (colored vs. gray objects). As in previous studies using verbal material, effects of PI were found with object stimuli, even after controlling for verbal labels being used (i.e., low-nameability condition). We also found that the addition of distinctive features (color, verbal label) increased performance in rejecting intrusion probes, most likely through an increase in discriminability between content-context bindings in WM.
Collapse
Affiliation(s)
- Marilyn Cyr
- Division of Cognitive Neuroscience, New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY, 10032, USA.
| | - Derek E Nee
- Department of Psychology, Florida State University, Tallahassee, FL, USA
| | - Eric Nelson
- Division of Cognitive Neuroscience, New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY, 10032, USA
| | - Thea Senger
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
| | - John Jonides
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
| | - Chara Malapani
- Division of Cognitive Neuroscience, New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY, 10032, USA
- Department of Psychiatry, Columbia University, New York, NY, USA
| |
Collapse
|
12
|
Corchs SE, Ciocca G, Bricolo E, Gasparini F. Predicting Complexity Perception of Real World Images. PLoS One 2016; 11:e0157986. [PMID: 27336469 PMCID: PMC4919018 DOI: 10.1371/journal.pone.0157986] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2015] [Accepted: 05/09/2016] [Indexed: 11/25/2022] Open
Abstract
The aim of this work is to predict the complexity perception of real world images. We propose a new complexity measure where different image features, based on spatial, frequency and color properties are linearly combined. In order to find the optimal set of weighting coefficients we have applied a Particle Swarm Optimization. The optimal linear combination is the one that best fits the subjective data obtained in an experiment where observers evaluate the complexity of real world scenes on a web-based interface. To test the proposed complexity measure we have performed a second experiment on a different database of real world scenes, where the linear combination previously obtained is correlated with the new subjective data. Our complexity measure outperforms not only each single visual feature but also two visual clutter measures frequently used in the literature to predict image complexity. To analyze the usefulness of our proposal, we have also considered two different sets of stimuli composed of real texture images. Tuning the parameters of our measure for this kind of stimuli, we have obtained a linear combination that still outperforms the single measures. In conclusion our measure, properly tuned, can predict complexity perception of different kind of images.
Collapse
Affiliation(s)
- Silvia Elena Corchs
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Viale Sarca 336, 20126 Milano, Italy
- Milan Center for Neuroscience, Milano, Italy
- * E-mail:
| | - Gianluigi Ciocca
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Viale Sarca 336, 20126 Milano, Italy
- Milan Center for Neuroscience, Milano, Italy
| | - Emanuela Bricolo
- Department of Psychology, University of Milano-Bicocca, Via dell’ Innovazione 10, 20126 Milano, Italy
- Milan Center for Neuroscience, Milano, Italy
| | - Francesca Gasparini
- Department of Informatics, Systems and Communication, University of Milano-Bicocca, Viale Sarca 336, 20126 Milano, Italy
- Milan Center for Neuroscience, Milano, Italy
| |
Collapse
|
13
|
Marin MM, Leder H. Effects of presentation duration on measures of complexity in affective environmental scenes and representational paintings. Acta Psychol (Amst) 2016; 163:38-58. [PMID: 26595281 DOI: 10.1016/j.actpsy.2015.10.002] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2015] [Revised: 07/15/2015] [Accepted: 10/11/2015] [Indexed: 11/30/2022] Open
Abstract
Complexity constitutes an integral part of humans' environment and is inherent to information processing. However, little is known about the dynamics of visual complexity perception of affective environmental scenes (IAPS pictures) and artworks, such as affective representational paintings. In three experiments, we studied the time course of visual complexity perception by varying presentation duration and comparing subjective ratings with objective measures of complexity. In Experiment 1, 60 females rated 96 IAPS pictures, presented either for 1, 5, or 25s, for familiarity, complexity, pleasantness and arousal. In Experiment 2, another 60 females rated 96 representational paintings. Mean ratings of complexity and pleasantness changed according to presentation duration in a similar vein in both experiments, suggesting an inverted U-shape. No common pattern of results was observed for arousal and familiarity ratings across the two picture sets. The correlations between subjective and objective measures of complexity increased with longer exposure durations for IAPS pictures, but results were more ambiguous for paintings. Experiment 3 explored the time course of the multidimensionality of visual complexity perception. Another 109 females rated the number of objects, their disorganization and the differentiation between a figure-ground vs. complex scene composition of pictures presented for 1 and 5s. The multidimensionality of visual complexity only clearly emerged in the 5-s condition. In both picture sets, the strength of the correlations with objective measures depended on the type of subdimension of complexity and was less affected by presentation duration than correlations with general complexity in Experiments 1 and 2. These results have clear implications for perceptual and cognitive theories, especially for those of esthetic experiences, in which the dynamical changes of complexity perception need to be integrated.
Collapse
Affiliation(s)
- Manuela M Marin
- Department of Basic Psychological Research and Research Methods, University of Vienna, Austria.
| | - Helmut Leder
- Department of Basic Psychological Research and Research Methods, University of Vienna, Austria
| |
Collapse
|
14
|
Visual Complexity Analysis Using Taxonomic Diagrams of Figures and Backgrounds in Japanese Residential Streetscapes. ACTA ACUST UNITED AC 2015. [DOI: 10.1155/2015/173862] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
This study was conducted with the objective of finding the perceivable effect of figures and backgrounds on residential streetscapes and their connections in visual complexity. The visual complexity depends on the extent of information a viewer can observe from a visible area. The information includes a number of visual elements along the streetscapes and their diversity and interconnections. The aim of this research was to analyze the structural hierarchical visual complexity of the streetscapes, caused by varied spatial arrangement and numerous spatial connections of the perceivable visual elements. The visual elements of 60 residential streetscapes were classified into figures and backgrounds using human perception of 20 subjects. The identified figures and backgrounds were arranged in a taxonomic diagram representing their connections. These taxonomic diagrams reflect the structural hierarchical visual complexity. Finally, taxonomic entropy was applied to statistically analyze the structural hierarchical visual complexity. When the taxonomic diagram is vertically and horizontally lengthy and the arrangement of the elements of taxonomic diagram is irregular, the complexity increases depicting a large number of figures whose spatial connections impart a high visual complexity to the streetscapes.
Collapse
|
15
|
Chassy P, Lindell TAE, Jones JA, Paramei GV. A Relationship Between Visual Complexity and Aesthetic Appraisal of Car Front Images: An Eye-Tracker Study. Perception 2015; 44:1085-97. [PMID: 26562922 DOI: 10.1177/0301006615596882] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Image aesthetic pleasure (AP) is conjectured to be related to image visual complexity (VC). The aim of the present study was to investigate whether (a) two image attributes, AP and VC, are reflected in eye-movement parameters; and (b) subjective measures of AP and VC are related. Participants (N=26) explored car front images (M=50) while their eye movements were recorded. Following image exposure (10 seconds), its VC and AP were rated. Fixation count was found to positively correlate with the subjective VC and its objective proxy, JPEG compression size, suggesting that this eye-movement parameter can be considered an objective behavioral measure of VC. AP, in comparison, positively correlated with average dwelling time. Subjective measures of AP and VC were related too, following an inverted U-shape function best-fit by a quadratic equation. In addition, AP was found to be modulated by car prestige. Our findings reveal a close relationship between subjective and objective measures of complexity and aesthetic appraisal, which is interpreted within a prototype-based theory framework.
Collapse
Affiliation(s)
- Philippe Chassy
- Department of Psychology, Liverpool Hope University, Hope Park, Liverpool, UK
| | - Trym A E Lindell
- Department of Psychology, Liverpool Hope University, Hope Park, Liverpool, UK
| | - Jessica A Jones
- Department of Psychology, Liverpool Hope University, Hope Park, Liverpool, UK
| | - Galina V Paramei
- Department of Psychology, Liverpool Hope University, Hope Park, Liverpool, UK
| |
Collapse
|
16
|
van Weelden L, Schilperoord J, Swerts M, Pecher D. The Role of Shape in Semantic Memory Organization of Objects: An Experimental Study Using PI-Release. Exp Psychol 2015; 62:181-97. [PMID: 25804243 DOI: 10.1027/1618-3169/a000284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Visual information contributes fundamentally to the process of object categorization. The present study investigated whether the degree of activation of visual information in this process is dependent on the contextual relevance of this information. We used the Proactive Interference (PI-release) paradigm. In four experiments, we manipulated the information by which objects could be categorized and subsequently be retrieved from memory. The pattern of PI-release showed that if objects could be stored and retrieved both by (non-perceptual) semantic and (perceptual) shape information, then shape information was overruled by semantic information. If, however, semantic information could not be (satisfactorily) used to store and retrieve objects, then objects were stored in memory in terms of their shape. The latter effect was found to be strongest for objects from identical semantic categories.
Collapse
|
17
|
Measuring streetscape complexity based on the statistics of local contrast and spatial frequency. PLoS One 2014; 9:e87097. [PMID: 24498292 PMCID: PMC3911930 DOI: 10.1371/journal.pone.0087097] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2013] [Accepted: 12/19/2013] [Indexed: 12/03/2022] Open
Abstract
Streetscapes are basic urban elements which play a major role in the livability of a city. The visual complexity of streetscapes is known to influence how people behave in such built spaces. However, how and which characteristics of a visual scene influence our perception of complexity have yet to be fully understood. This study proposes a method to evaluate the complexity perceived in streetscapes based on the statistics of local contrast and spatial frequency. Here, 74 streetscape images from four cities, including daytime and nighttime scenes, were ranked for complexity by 40 participants. Image processing was then used to locally segment contrast and spatial frequency in the streetscapes. The statistics of these characteristics were extracted and later combined to form a single objective measure. The direct use of statistics revealed structural or morphological patterns in streetscapes related to the perception of complexity. Furthermore, in comparison to conventional measures of visual complexity, the proposed objective measure exhibits a higher correlation with the opinion of the participants. Also, the performance of this method is more robust regarding different time scenarios.
Collapse
|
18
|
Marin MM, Leder H. Examining complexity across domains: relating subjective and objective measures of affective environmental scenes, paintings and music. PLoS One 2013; 8:e72412. [PMID: 23977295 PMCID: PMC3745471 DOI: 10.1371/journal.pone.0072412] [Citation(s) in RCA: 54] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2012] [Accepted: 07/13/2013] [Indexed: 11/18/2022] Open
Abstract
Subjective complexity has been found to be related to hedonic measures of preference, pleasantness and beauty, but there is no consensus about the nature of this relationship in the visual and musical domains. Moreover, the affective content of stimuli has been largely neglected so far in the study of complexity but is crucial in many everyday contexts and in aesthetic experiences. We thus propose a cross-domain approach that acknowledges the multidimensional nature of complexity and that uses a wide range of objective complexity measures combined with subjective ratings. In four experiments, we employed pictures of affective environmental scenes, representational paintings, and Romantic solo and chamber music excerpts. Stimuli were pre-selected to vary in emotional content (pleasantness and arousal) and complexity (low versus high number of elements). For each set of stimuli, in a between-subjects design, ratings of familiarity, complexity, pleasantness and arousal were obtained for a presentation time of 25 s from 152 participants. In line with Berlyne's collative-motivation model, statistical analyses controlling for familiarity revealed a positive relationship between subjective complexity and arousal, and the highest correlations were observed for musical stimuli. Evidence for a mediating role of arousal in the complexity-pleasantness relationship was demonstrated in all experiments, but was only significant for females with regard to music. The direction and strength of the linear relationship between complexity and pleasantness depended on the stimulus type and gender. For environmental scenes, the root mean square contrast measures and measures of compressed file size correlated best with subjective complexity, whereas only edge detection based on phase congruency yielded equivalent results for representational paintings. Measures of compressed file size and event density also showed positive correlations with complexity and arousal in music, which is relevant for the discussion on which aspects of complexity are domain-specific and which are domain-general.
Collapse
Affiliation(s)
- Manuela M Marin
- Department of Basic Psychological Research and Research Methods, University of Vienna, Vienna, Austria.
| | | |
Collapse
|