Granular synthesis for display of time-varying probability densities

Williamson, J. and Murray-Smith, R. (2004) Granular synthesis for display of time-varying probability densities. In: International Workshop on Interactive Sonification, Bielefeld, Germany, 8 January 2004,




We present a method for displaying time-varying probabilistic information to users using an asynchronous granular synthesis technique. We extend the basic synthesis technique to include distribution over waveform source, spatial position, pitch and time inside waveforms. To enhance the synthesis in interactive contexts, we "quicken" the display by integrating predictions of user behaviour into the sonification. This includes summing the derivatives of the distribution during exploration of static densities, and using Monte-Carlo sampling to predict future user states in nonlinear dynamic systems. These techniques can be used to improve user performance in continuous control systems and in the interactive exploration of high dimensional spaces. This technique provides feedback from users potential goals, and their progress toward achieving them; modulating the feedback with quickening can help shape the users actions toward achieving these goals. We have applied these techniques to a simple nonlinear control problem as well as to the sonification of on-line probabilistic gesture recognition. We are applying these displays to mobile, gestural interfaces, where visual display is often impractical. The granular synthesis approach is theoretically elegant and easily applied in contexts where dynamic probabilistic displays are required.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Murray-Smith, Professor Roderick and Williamson, Dr John
Authors: Williamson, J., and Murray-Smith, R.
Subjects:T Technology > T Technology (General)
T Technology > TK Electrical engineering. Electronics Nuclear engineering
College/School:College of Science and Engineering > School of Computing Science
Publisher:Interactive Sonification Organisation
Copyright Holders:Copyright © 2004 Interactive Sonification Organization
First Published:First published in Proceedings of the International Workshop on Interactive Sonification
Publisher Policy:Reproduced with the permission of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record