Developing Emotional Design: Emotions as Cognitive Processes and their Role in the Design of Interactive Technologies

The effect of mood on shaping belief and recollection following false feedback

The current study examined how mood affects the impact of false feedback on belief and recollection. In a three-session experiment, participants first watched 40 neutral mini videos, which were accompanied by music to induce either a positive or negative mood, or no music. Following a recognition test, they received false feedback to reduce belief in the occurrence of the events displayed in some of the videos (Session 2). This was followed by an immediate memory test and a delayed memory assessment one week later (Session 3). The results revealed that participants in negative mood reported higher belief scores compared to those in positive moods, despite an overall decline in belief scores for all groups following the false feedback. Notably, individuals in negative moods exhibited less reduction in their belief scores after encountering challenges, thereby maintaining a higher accuracy in their testimonies. Over time, a reduction in the clarity of participants' memory recall was observed, which correspondingly reduced their testimony accuracy. This study thus indicates that mood states play a role in shaping belief and memory recall under the influence of false feedback.

Virtual Reality for Awe and Imagination

Empirical research has explored the potential of the emotion of awe to shape creativity, while theoretical work has sought to understand the link between this emotion and transformation in terms of imagining new possible worlds. This branch of study relies on the transformative potential of virtual reality (VR) to examine and invite cognitive and emotional components of transformative experiences (TEs) within the interdisciplinary model of Transformative Experience Design (TED) and the Appraisal-Tendency Framework (ATF). TED suggests using the epistemic and emotional affordances of interactive technologies, such as VR, to invite TEs. The ATF can provide insight into the nature of these affordances and their relationship. This line of research draws on empirical evidence of the awe-creativity link to broaden the discourse and consider the potential impact of this emotion on core beliefs about the world. The combination of VR with these theoretical and design-oriented approaches may enable a new generation of potentially transformative experiences that remind people that they can aspire to more and inspire them to work toward imagining and creating a new possible world.

The Role of Emotion-Related Abilities in the Quality of Life of Breast Cancer Survivors: A Systematic Review

Breast cancer survivors have to deal with notable challenges even after successful treatment, such as body image issues, depression and anxiety, the stress related to changes in lifestyle, and the continual challenges inherent to health management. The literature suggests that emotional abilities, such as emotional intelligence, emotion management, mood repair, and coping play a fundamental role in such challenges. We performed a systematic review to systematize the evidence available on the role of emotional abilities in quality of life and health management in breast cancer survivors. The search was performed on three scientific databases (Pubmed, Scopus, and PsycINFO) and, after applying exclusion criteria, yielded 33 studies, mainly of a cross-sectional nature. The results clearly support the hypothesis that emotional abilities play multiple important roles in breast cancer survivors' quality of life. Specifically, the review highlighted that coping/emotional management plays multiple roles in breast cancer survivors' well-being and health management, affecting vitality and general adjustment to cancer positivity and promoting benefit findings related to the cancer experience; however, rare negative results exist in the literature. This review highlights the relevance of emotional abilities to promoting quality of life in breast cancer survivors. Future review efforts may explore other breast cancer survivors' emotional abilities, aiming at assessing available instruments and proposing tailored psychological interventions.

Understanding preservice teachers' affective responses to VR-enabled scientific experiments

Preservice teachers' preparedness, perception, and affect toward certain technology systems influence the student acquisition of science knowledge, process skills, teaching innovation, and willingness to use technology in their classroom. The purpose of this study was to explore teachers' affective responses to a virtual reality-enabled scientific experiment (VaSE) system. Fifty-one preservice teachers majoring in educational technology participated in the study. They were divided into two groups, and their reactions were measured separately on two occasions. The first occasion used a standard system following the principle of Donald Norman's affective design model (ADM). The VaSE system was then revised with a strict version of ADM before the participants' reactions were measured for a second time. The positive and negative affect scale (PANAS) was utilized for affective state evaluation. Semi-structured interviews that focused on affective experiences were organized using an ADM framework and conducted immediately after the participants used VaSE. The results indicated that the positive affect experienced by the preservice teachers was significantly enhanced, and the negative affect was significantly weakened. Academic level, gender, and prior experience were important random effect factors that impacted the affective experience. It was also revealed that participants were more likely to be affected by immersion and interactivity in terms of enhancing positive affect and were more likely to be affected by behavioral layer elements in terms of weakening negative affect. A conclusion has been drawn to provide theoretical and practical suggestions for training preservice teachers in ways that improve their ability to integrate technology into the classroom.

Anthropomorphizing Technology: A Conceptual Review of Anthropomorphism Research and How it Relates to Children's Engagements with Digital Voice Assistants

‘Anthropomorphism’ is a popular term in the literature on human-technology engagements, in general, and child-technology engagements, in particular. But what does it really mean to ‘anthropomorphize’ something in today’s world? This conceptual review article, addressed to researchers interested in anthropomorphism and adjacent areas, reviews contemporary anthropomorphism research, and it offers a critical perspective on how anthropomorphism research relates to today’s children who grow up amid increasingly intelligent and omnipresent technologies, particularly digital voice assistants (e.g., Alexa, Google Assistant, Siri). First, the article reviews a comprehensive body of quantitative as well as qualitative anthropomorphism research and considers it within three different research perspectives: descriptive, normative and explanatory. Following a brief excursus on philosophical pragmatism, the article then discusses each research perspective from a pragmatistic viewpoint, with a special emphasis on child-technology and child-voice-assistant engagements, and it also challenges some popular notions in the literature. These notions include descriptive ‘as if’ parallels (e.g., child behaves ‘as if’ Alexa was a friend), or normative assumptions that human-human engagements are generally superior to human-technology engagements. Instead, the article reviews different examples from the literature suggesting the nature of anthropomorphism may change as humans’ experiential understandings of humanness change, and this may particularly apply to today’s children as their social cognition develops in interaction with technological entities which are increasingly characterized by unprecedented combinations of human and non-human qualities.

Does bouncy equal happy? Comparing user's interpretations of emotions conveyed by one designed moving object based on the soma-semiotic framework

When designing objects, designers attempt to communicate the purpose and meaning of that object to users using various factors such as visual appearance (aesthetic), practical interaction elements (product semantics) and meanings beyond the practical product interaction (semiotics). This study sought to confirm the previous deductively-developed soma-semiotic framework, whose purpose was to understand and ultimately predict the emotional impact of different design elements on users, using one specifically designed object, Fruit Bowl (FB). The purpose of the study reported in this paper was to compare the theoretically derived emotional responses to FB from the soma-semiotic framework with empirically derived data from users in order to improve the framework. Sixty participants evaluated the meaning and emotion conveyed by FB as well as self-reported their own experienced emotions under two scenarios. The framework predicted that FB would convey joy in a first scenario, and amusement in a second scenario based on different movements. Using a weighted vector analysis based on Russell's two-dimensional Circumplex of emotions, users identified that the overall emotion of the first scenario to be similar to the predicted emotion. This was attributed mostly to the bouncy movement of the bowl and its visual aesthetic. However, in the second scenario the overall rating was calm/impressed; rather than humour. The abstract design did not favour users making the same associations as the designer. We recommend that the soma-semiotic framework be revised to include aesthetic, in addition to semiotic and semantic, elements as determinants of user interpretations and reactions to designed objects.

Virtual Reality Games and the Role of Body Involvement in Enhancing Positive Emotions and Decreasing Anxiety: Within-Subjects Pilot Study

Background

In the last few years, the introduction of immersive technologies, especially virtual reality, into the gaming market has dramatically altered the traditional concept of video games. Given the unique features of virtual reality in terms of interaction and its ability to completely immerse the individual into the game, this technology should increase the propensity for video games to effectively elicit positive emotions and decrease negative emotions and anxiety in the players. However, to date, few studies have investigated the ability of virtual reality games to induce positive emotions, and the possible effect of this new type of video game in diminishing negative emotions and anxiety has not yet been tested. Furthermore, given the critical role of body movement in individuals’ well-being and in emotional responses to video games, it seems critical to investigate how body involvement can be exploited to modulate the psychological benefits of virtual reality games in terms of enhancing players’ positive emotions and decreasing negative emotions and anxiety.

Objective

This within-subjects study aimed to explore the ability of commercial virtual reality games to induce positive emotions and diminish negative emotions and state anxiety of the players, investigating the effects of the level of body involvement requested by the game (ie, high vs low).

Methods

A total of 36 young adults played a low body-involvement (ie, Fruit Ninja VR) and a high body-involvement (ie, Audioshield) video game in virtual reality. The Visual Analogue Scale (VAS) and the State-Trait Anxiety Inventory, Form-Y1 (STAI-Y1) were used to assess positive and negative emotions and state anxiety.

Results

Results of the generalized linear model (GLM) for repeated-measures multivariate analysis of variance (MANOVA) revealed a statistically significant increase in the intensity of happiness (P<.001) and surprise (P=.003) and, in parallel, a significant decrease in fear (P=.01) and sadness (P<.001) reported by the users. Regarding the ability to improve anxiety in the players, the results showed a significant decrease in perceived state anxiety after game play, assessed with both the STAI-Y1 (P=.003) and the VAS-anxiety (P=.002). Finally, the results of the GLM MANOVA showed a greater efficacy of the high body-involvement game (ie, Audioshield) compared to the low body-involvement game (ie, Fruit Ninja VR), both for eliciting positive emotions (happiness, P<.001; and surprise, P=.01) and in reducing negative emotions (fear, P=.05; and sadness, P=.05) and state anxiety, as measured by the STAI-Y1 (P=.05).

Conclusions

The two main principal findings of this study are as follows: (1) virtual reality video games appear to be effective tools to elicit positive emotions and to decrease negative emotions and state anxiety in individuals and (2) the level of body involvement of the virtual video game has an important effect in determining the ability of the game to improve positive emotions and decrease negative emotions and state anxiety of the players.

3D Facial Expression Recognition for Defining Users’ Inner Requirements—An Emotional Design Case Study

This study proposes a novel quality function deployment (QFD) design methodology based on customers’ emotions conveyed by facial expressions. The current advances in pattern recognition related to face recognition techniques have fostered the cross-fertilization and pollination between this context and other fields, such as product design and human-computer interaction. In particular, the current technologies for monitoring human emotions have supported the birth of advanced emotional design techniques, whose main focus is to convey users’ emotional feedback into the design of novel products. As quality functional deployment aims at transforming the voice of customers into engineering features of a product, it appears to be an appropriate and promising nest in which to embed users’ emotional feedback with new emotional design methodologies, such as facial expression recognition. This way, the present methodology consists in interviewing the user and acquiring his/her face with a depth camera (allowing three-dimensional (3D) data), clustering the face information into different emotions with a support vector machine classificator, and assigning customers’ needs weights relying on the detected facial expressions. The proposed method has been applied to a case study in the context of agriculture and validated by a consortium. The approach appears sound and capable of collecting the unconscious feedback of the interviewee.

Anthropomorphic Design: Emotional Perception for Deformable Object

Despite the increasing number of studies on user experience (UX) and user interfaces (UI), few studies have examined emotional interaction between humans and deformable objects. In the current study, we investigated how the anthropomorphic design of a flexible display interacts with emotion. For 101 unique 3D images in which an object was bent at different axes, 281 participants were asked to report how strongly the object evoked five elemental emotions (e.g., happiness, disgust, anger, fear, and sadness) in an online survey. People rated the object’s shape using three emotional categories: happiness, disgust–anger, and sadness–fear. It was also found that a combination of axis of bending (horizontal or diagonal axis) and convexity (bending convexly or concavely) predicted emotional valence, underpinning the anthropomorphic design of flexible displays. Our findings provide empirical evidence that axis of bending and convexity can be an important antecedent of emotional interaction with flexible objects, triggering at least three types of emotion in users.

Immersive Interactive Technologies for Positive Change: A Scoping Review and Design Considerations

Practices such as mindfulness, introspection, and self-reflection are known to have positive short and long-term effects on health and well-being. However, in today's modern, fast-paced, technological world tempted by distractions these practices are often hard to access and relate to a broader audience. Consequently, technologies have emerged that mediate personal experiences, which is reflected in the high number of available applications designed to elicit positive changes. These technologies elicit positive changes by bringing users' attention to the self—from technologies that show representation of quantified personal data, to technologies that provide experiences that guide the user closer in understanding the self. However, while many designs available today are either built to support or are informed by these aforementioned practices, the question remains: how can we most effectively employ different design elements and interaction strategies to support positive change? Moreover, what types of input and output modalities contribute to eliciting positive states? To address these questions, we present here a state of the art scoping review of immersive interactive technologies that serve in a role of a mediator for positive change in users. We performed a literature search using ACM Digital Library, Web of Science, IEEE Xplore, and Design and Applied Arts Index (beginning of literature—January 1, 2018). We retrieved English-language articles for review, and we searched for published and unpublished studies. Risk of bias was assessed with Downs and Black 26-item QAT scale. We included 34 articles as relevant to the literature, and the analysis of the articles resulted in 38 instances of 33 immersive, interactive experiences relating to positive human functioning. Our contribution is three-fold: First we provide a scoping review of immersive interactive technologies for positive change; Second, we propose both a framework for future designs of positive interactive technologies and design consideration informed by the comparative analysis of the designs; Third, we provide design considerations for immersive, interactive technologies to elicit positive states and support positive change.