Multimodal mobile interactions: usability studies in real world settings

Williamson, J.R., Crossan, A. and Brewster, S. (2011) Multimodal mobile interactions: usability studies in real world settings. In: Proceedings of the 13th International Conference on Multimodal Interfaces - ICMI '11, Alicante, Spain, 14-18 Nov 2011. ACM: New York, NY, USA, pp. 361-368. ISBN 9781450306416 (doi: 10.1145/2070481.2070551)

Full text not currently available from Enlighten.

Publisher's URL:


This paper presents a study that explores the issues of mobile multimodal interactions while on the move in the real world. Because multimodal interfaces allow new kinds of eyes and hands free interactions, usability issues while moving through different public spaces becomes an important issue in user experience and acceptance of multimodal interaction. This study focuses on these issues by deploying an RSS reader that participants used during their daily commute every day for one week. The system allows users on the move to access news feeds eyes free through head- phones playing audio and speech and hands free through wearable sensors attached to the wrists. The results showed participants were able to interact with the system on the move and became more comfortable performing these interactions as the study progressed. Users were also far more comfortable gesturing on the street than on public transport, which was reflected in the number of interactions and the perceived social acceptability of the gestures in different contexts.

Item Type:Book Sections
Glasgow Author(s) Enlighten ID:Williamson, Dr Julie and Brewster, Professor Stephen and Crossan, Dr Andrew
Authors: Williamson, J.R., Crossan, A., and Brewster, S.
College/School:College of Science and Engineering > School of Computing Science

University Staff: Request a correction | Enlighten Editors: Update this record