Crossmodal congruence: the look, feel and sound of touchscreen widgets

Hoggan, E., Kaaresjoa, T., Laitinen, P. and Brewster, S.A. (2008) Crossmodal congruence: the look, feel and sound of touchscreen widgets. In: 10th international Conference on Multimodal Interfaces (ICMI 2008), Crete, Greece, 20-22 Oct 2008, ISBN 9781605581989 (doi: 10.1145/1452392.1452423)

Abstract

Our research considers the following question: how can visual, audio and tactile feedback be combined in a congruent manner for use with touchscreen graphical widgets? For example, if a touchscreen display presents different styles of visual buttons, what should each of those buttons feel and sound like? This paper presents the results of an experiment conducted to investigate methods of congruently combining visual and combined audio/tactile feedback by manipulating the different parameters of each modality. The results indicate trends with individual visual parameters such as shape, size and height being combined congruently with audio/tactile parameters such as texture, duration and different actuator technologies. We draw further on the experiment results using individual quality ratings to evaluate the perceived quality of our touchscreen buttons then reveal a correlation between perceived quality and crossmodal congruence. The results of this research will enable mobile touchscreen UI designers to create realistic, congruent buttons by selecting the most appropriate audio and tactile counterparts of visual button styles.

• Item Type: Conference Proceedings
• Status: Published
• Refereed: Yes
• Glasgow Author(s) Enlighten ID: Brewster, Professor Stephen and Hoggan, Miss Eve
• Authors: Hoggan, E., Kaaresjoa, T., Laitinen, P., and Brewster, S.A.
• Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
• College/School: College of Science and Engineering > School of Computing Science
• Publisher: ACM Press
• ISBN: 9781605581989