Multi-Moji: Combining Thermal, Vibrotactile and Visual Stimuli to Expand the Affective Range of Feedback

Wilson, G. and Brewster, S. A. (2017) Multi-Moji: Combining Thermal, Vibrotactile and Visual Stimuli to Expand the Affective Range of Feedback. In: CHI '17: CHI Conference on Human Factors in Computing Systems, Denver, CO, USA, 6-11 May 2017, pp. 1743-1755. ISBN 9781450346559 (doi: 10.1145/3025453.3025614)

134445.pdf - Accepted Version



This paper explores the combination of multiple concurrent modalities for conveying emotional information in HCI: temperature, vibration and abstract visual displays. Each modality has been studied individually, but can only convey a limited range of emotions within two-dimensional valencearousal space. This paper is the first to systematically combine multiple modalities to expand the available affective range. Three studies were conducted: Study 1 measured the emotionality of vibrotactile feedback by itself; Study 2 measured the perceived emotional content of three bimodal combinations: vibrotactile + thermal, vibrotactile + visual and visual + thermal. Study 3 then combined all three modalities. Results show that combining modalities increases the available range of emotional states, particularly in the problematic top-right and bottom-left quadrants of the dimensional model. We also provide a novel lookup resource for designers to identify stimuli to convey a range of emotions.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Wilson, Dr Graham and Brewster, Professor Stephen
Authors: Wilson, G., and Brewster, S. A.
College/School:College of Science and Engineering > School of Computing Science
Copyright Holders:Copyright © 2017 ACM
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
670071HappinessStephen BrewsterEuropean Commission (EC)645145COM - COMPUTING SCIENCE