Multimodal Affective Feedback: Combining Thermal, Vibrotactile, Audio and Visual Signals

Wilson, G., Freeman, E. and Brewster, S. (2016) Multimodal Affective Feedback: Combining Thermal, Vibrotactile, Audio and Visual Signals. In: 18th ACM International Conference on Multimodal Interaction, Tokyo, Japan, 12-16 Nov 2016, pp. 400-401. ISBN 9781450345569 (doi: 10.1145/2993148.2998522)

134161.pdf - Accepted Version


Publisher's URL:


In this paper we describe a demonstration of our multimodal affective feedback designs, used in research to expand the emotional expressivity of interfaces. The feedback leverages inherent associations and reactions to thermal, vibrotactile, auditory and abstract visual designs to convey a range of affective states without any need for learning feedback encoding. All combinations of the different feedback channels can be utilised, depending on which combination best conveys a given state. All the signals are generated from a mobile phone augmented with thermal and vibrotactile stimulators, which will be available to conference visitors to see, touch, hear and, importantly, feel.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Wilson, Dr Graham and Freeman, Dr Euan and Brewster, Professor Stephen
Authors: Wilson, G., Freeman, E., and Brewster, S.
Subjects:T Technology > T Technology (General)
College/School:College of Science and Engineering > School of Computing Science
Research Group:Glasgow Interactive Systems Section
Copyright Holders:Copyright © 2016 ACM
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
628131ABBIStephen BrewsterEuropean Commission (EC)611452COM - COMPUTING SCIENCE