Model-based target sonification on mobile devices

Eslambolchilar, P., Crossan, A. and Murray-Smith, R. (2004) Model-based target sonification on mobile devices. In: International Workshop on Interactive Sonification, Bielefeld, Germany, 8 January 2004,




We investigate the use of audio and haptic feedback to augment the display of a mobile device controlled by tilt input. We provide an example of this based on Doppler effects, which highlight the user's approach to a target, or a target's movement from the current state, in the same way we hear the pitch of a siren change as it passes us. Twelve participants practiced navigation/browsing a state-space that was displayed via audio and vibrotactile modalities. We implemented the experiment on a Pocket PC, with an accelerometer attached to the serial port and a headset attached to audio port. Users navigated through the environment by tilting the device. Feedback was provided via audio displayed via a headset, and by vibrotactile information displayed by a vibrotactile unit in the Pocket PC. Users selected targets placed randomly in the state-space, supported by combinations of audio, visual and vibrotactile cues. The speed of target acquisition and error rate were measured, and summary statistics on the acquisition trajectories were calculated. These data were used to compare different display combinations and configurations. The results in the paper quantified the changes brought by predictive or 'quickened' sonified displays in mobile, gestural interaction.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Murray-Smith, Professor Roderick and Crossan, Dr Andrew
Authors: Eslambolchilar, P., Crossan, A., and Murray-Smith, R.
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering
College/School:College of Science and Engineering > School of Computing Science
Publisher:Interactive Sonification Organisation
Copyright Holders:Copyright © 2004 Interactive Sonification Organization
First Published:First published in Proceedings of the International Workshop on Interactive Sonification
Publisher Policy:Reproduced with the permission of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record