N300 and social affordances: a study with a real person and a dummy as stimuli

A Review of EEG and fMRI Measuring Aesthetic Processing in Visual User Experience Research

In human-computer interaction, the visual interaction of user experience (UX) and user interface (UI) plays an important role in enriching the quality of daily life. The purpose of our study analyzes the use of brain-computer interface (BCI), wearable technology, and functional magnetic resonance imaging (fMRI) to explore the aesthetic processing of visual neural response to UI and UX designs. Specifically, this review aims to understand neuroaesthetic processing knowledge, aesthetic appreciation models, and the ways in which visual brain studies can improve the quality of current and future UI and UX designs. Recent research has found that subjective evaluations of aesthetic appreciation produce different results for objective evaluations of brain research analysis. We applied SWOT analysis and examined the advantages and disadvantages of both evaluation methods. Furthermore, we conducted a traditional literature review on topics pertaining to the use of aesthetic processing knowledge in the visual interaction field in terms of art therapy, information visualization, website or mobile applications, and other interactive platforms. Our main research findings from current studies have helped and motivated researchers and designers to use convincing scientific knowledge of brain event-related potential, electroencephalography, and fMRI to understand aesthetic judgment. The key trend finds that many designers, artists, and engineers use artistic BCI technology in the visual interaction experience. Herein, the scientific methods applied in the aesthetic appreciation to human-computer interface are summarized, and the influence of the latest wearable brain technology on visual interaction design is discussed. Furthermore, current possible research entry points for aesthetics, usability, and creativity in UI and UX designs are explicated. The study results have implications for the visual user experience research domain as well as for interaction industries, which produce interactive projects to improve people's daily lives.

The Effects of Dynamic and Static Emotional Facial Expressions of Humans and Their Avatars on the EEG: An ERP and ERD/ERS Study

This study aimed to examine whether the cortical processing of emotional faces is modulated by the computerization of face stimuli ("avatars") in a group of 25 healthy participants. Subjects were passively viewing 128 static and dynamic facial expressions of female and male actors and their respective avatars in neutral or fearful conditions. Event-related potentials (ERPs), as well as alpha and theta event-related synchronization and desynchronization (ERD/ERS), were derived from the EEG that was recorded during the task. All ERP features, except for the very early N100, differed in their response to avatar and actor faces. Whereas the N170 showed differences only for the neutral avatar condition, later potentials (N300 and LPP) differed in both emotional conditions (neutral and fear) and the presented agents (actor and avatar). In addition, we found that the avatar faces elicited significantly stronger reactions than the actor face for theta and alpha oscillations. Especially theta EEG frequencies responded specifically to visual emotional stimulation and were revealed to be sensitive to the emotional content of the face, whereas alpha frequency was modulated by all the stimulus types. We can conclude that the computerized avatar faces affect both, ERP components and ERD/ERS and evoke neural effects that are different from the ones elicited by real faces. This was true, although the avatars were replicas of the human faces and contained similar characteristics in their expression.

A Central Component of the N1 Event-Related Brain Potential Could Index the Early and Automatic Inhibition of the Actions Systematically Activated by Objects

Stimuli of the environment, like objects, systematically activate the actions they are associated to. These activations occur extremely fast. Nevertheless, behavioral data reveal that, in most cases, these activations are then automatically inhibited, around 100 ms after the occurrence of the stimulus. We thus tested whether this early inhibition could be indexed by a central component of the N1 event-related brain potential (ERP). To achieve that goal, we looked at whether this ERP component is larger in tasks that could increase the inhibition and in trials where reaction times (RTs) happen to be long. The illumination of a real space bar of a keyboard out of the dark was used as a stimulus. To maximize the modulation of the inhibition, the task participants had to perform was manipulated across blocks. A look-only task and a count task were used to increase inhibition and an immediate press task was used to decrease it. ERPs of the two block-conditions where presses had to be prevented and where the largest central N1s were predicted were compared to those elicited in the press task, differentiating the ERPs to the third of the trials where presses were the slowest from the ERPs to the third of the trials with the fastest presses. Despite larger negativities due to lateralized readiness potentials (LRPs) and despite greater attention likely in immediate press-trials, central N1s were found to be minimal for the fastest presses, intermediate for the slowest ones and maximal for the two no-press conditions. These results thus provide a strong support for the idea that the central N1 indexes an early and short lasting automatic inhibition of the actions systematically activated by objects. They also confirm that the strength of this automatic inhibition spontaneously fluctuates across trials and tasks. On the other hand, just before N1s, parietal P1s were found larger for fastest presses. They might thus index the initial activation of these actions. Finally, consistent with the idea that N300s index late inhibition processes, that occur preferentially when the task requires them, these ERPs were quasi absent for fast presses trials and much larger in the three other conditions.

Mimicking Schizophrenia: Reducing P300b by Minimally Fragmenting Healthy Participants' Selves Using Immersive Virtual Reality Embodiment

The most robust and clear biological index differentiating persons with schizophrenia from healthy controls is the drastic reduction of the amplitude of their P300b event-related brain potential (ERP). However, the cause of that reduction remains obscure. Nevertheless, the P300b belongs to the family of the late posterior positivities (LPPs) which are closely related to the consciousness of the meaning of the stimulus in the task for the participants themselves (e.g., the: I am seeing the target stimulus for which I have to respond). The fragmentation of the self present in schizophrenia, could thus be the cause. If this were true, then P300bs should be somewhat reduced in healthy participants when their self representations are temporarily and minimally fragmented. We tested this hypothesis by using the innocuous fragmentation of the self that occurs in virtual reality (VR). There, participants can have a fragment of their self in an avatar they feel embodied in, within a VR room, while having another fragment of their self in their real body in the real room where they know they are. Our participants were thus equipped with a head mounted display in which they viewed a virtual room where a female humanoid avatar was facing them. She was lifting her right hand in synchrony with the participants, in order to induce in them a feeling of embodiment. Stimuli were a frequent green- and a rare red-disk, the oddball stimulus, occurring over the right hand of the avatar. Participants had to perform a Go/NoGo task, lifting their right hand to the frequent green disk and repressing this action for the oddball red disk. In the syncMove block of trials the avatar was lifting her right hand synchronously with the participant, disturbing her self representation as confirmed by the debriefing session. In the noMove block, the avatar remained immobile. In the classic block, only the red and the green disk were displayed on a monochrome background, neither the room nor the avatar were shown. As predicted, P300bs were found to be smaller in the syncMove block than in the noMove- and the classic-block in participants who had the classically large P300b oddball effect between ERPs to the frequent and those to the rare stimuli. Reduced P300bs of schizophrenia could thus be partly due to self fragmentation. Results may also open an avenue of research to the functional significance of LPPs and the content of the consciousness indexed by these potentials.

How to Find Effects of Stimulus Processing on Event Related Brain Potentials of Close Others when Hyperscanning Partners

The partners of each pair must be able to pass the McGill Friendship Questionnaire without communicating. Each partner is then seated in front of a screen in one of two adjacent rooms. These rooms are separated by a glass window through which participants communicate to maintain feelings of togetherness while being fitted with the EEG cap. After checking for adequate EEG signals, the glass is covered by a curtain to prevent visual communication. Then, partners must be silent but are instructed to try to feel in the presence of their partner during the entire experiment. Just before it starts, participants are told that each of them will be presented with one image at a time and that these images will occur at the same time for both of them on their own screen. They are also instructed that, for each trial, the simultaneous images will always be different. However, unbeknownst to them, trials are randomized: only half of them are consistent with this instruction and actually include two different images. These trials form the DSC, that is, the different-stimuli condition. The other half of the trials are inconsistent with the instruction. They include two identical images and form the ISC (identical-stimuli condition). After the experiment, participants are sorted into two groups: those who reported that they felt in the presence of their partner during the majority of the trials and those who reported they did not. The impact of the stimulus processing of the partner is found by subtracting the mean voltages of the ERPs of the ISC (inconsistent with the instructions) from the ERPs of the DSC (consistent with the instructions) in at least two time windows (TWs): firstly, in the 75 to 150 ms TW, where the absolute values of these subtractions are greater, especially at right frontal sites, in those who felt in the presence of their partner than in those who did not; secondly, in the LPP time window (i.e., from 650 to 950 ms post onset), where ERPs are significantly less positive in the DSC than in the ISC in those in whom the raw results of the early (75-150ms) subtractions are negative.

Active inference, enactivism and the hermeneutics of social cognition

We distinguish between three philosophical views on the neuroscience of predictive models: predictive coding (associated with internal Bayesian models and prediction error minimization), predictive processing (associated with radical connectionism and 'simple' embodiment) and predictive engagement (associated with enactivist approaches to cognition). We examine the concept of active inference under each model and then ask how this concept informs discussions of social cognition. In this context we consider Frith and Friston's proposal for a neural hermeneutics, and we explore the alternative model of enactivist hermeneutics.

Long-Lasting Cortical Reorganization as the Result of Motor Imagery of Throwing a Ball in a Virtual Tennis Court

In order to characterize the neural signature of a motor imagery (MI) task, the present study investigates for the first time the oscillation characteristics including both of the time-frequency measurements, event related spectral perturbation and intertrial coherence (ITC) underlying the variations in the temporal measurements (event related potentials, ERP) directly related to a MI task. We hypothesize that significant variations in both of the time-frequency measurements underlie the specific changes in the ERP directly related to MI. For the MI task, we chose a simple everyday task (throwing a tennis ball), that does not require any particular motor expertise, set within the controlled virtual reality scenario of a tennis court. When compared to the rest condition a consistent, long-lasting negative fronto-central ERP wave was accompanied by significant changes in both time frequency measurements suggesting long-lasting cortical activity reorganization. The ERP wave was characterized by two peaks at about 300 ms (N300) and 1000 ms (N1000). The N300 component was centrally localized on the scalp and was accompanied by significant phase consistency in the delta brain rhythms in the contralateral central scalp areas. The N1000 component spread wider centrally and was accompanied by a significant power decrease (or event related desynchronization) in low beta brain rhythms localized in fronto-precentral and parieto-occipital scalp areas and also by a significant power increase (or event related synchronization) in theta brain rhythms spreading fronto-centrally. During the transition from N300 to N1000, a contralateral alpha (mu) as well as post-central and parieto-theta rhythms occurred. The visual representation of movement formed in the minds of participants might underlie a top-down process from the fronto-central areas which is reflected by the amplitude changes observed in the fronto-central ERPs and by the significant phase synchrony in contralateral fronto-central delta and contralateral central mu to parietal theta presented here.

The new hybrids: Continuing debates on social perception

I evaluate several attempts to integrate standard theories of social cognition, either theory theory or simulation theory, with aspects of interaction theory, and especially with the concept of direct social perception. I refer to these as new hybrid theories of social cognition. One of the new hybrids accomplishes the integration only by weakening the concept of mindreading or by understanding mindreading as targeting the shared situation rather than the other's mental states. Hybrids that attempt to accommodate the idea of direct perception of mental states grant a phenomenological directness only by maintaining tacit (theory-based) inferences on the subpersonal level. If such inferential processes are thought to be extra-perceptual, then perception is neither sufficient nor direct for an understanding of intentions and emotions. Moreover, insistence on top-down inferential processes trades off against the possibility of plasticity in the perceptual system itself. I suggest that a better model than a hybrid theory would be a pluralist one. A pluralist approach to social cognition would treat theoretical inference, simulation, direct perception, interactive skills, etc. as different strategies. The real challenge is to work out a pluralist account of subpersonal processes.

In your face: transcendence in embodied interaction

In cognitive psychology, studies concerning the face tend to focus on questions about face recognition, theory of mind (ToM) and empathy. Questions about the face, however, also fit into a very different set of issues that are central to ethics. Based especially on the work of Levinas, philosophers have come to see that reference to the face of another person can anchor conceptions of moral responsibility and ethical demand. Levinas points to a certain irreducibility and transcendence implicit in the face of the other. In this paper I argue that the notion of transcendence involved in this kind of analysis can be given a naturalistic interpretation by drawing on recent interactive approaches to social cognition found in developmental psychology, phenomenology, and the study of autism.