Dynamics and probabilistic text entry

Williamson, J. and Murray-Smith, R. (2003) Dynamics and probabilistic text entry. [UNSPECIFIED]

Abstract

We present a gestural interface for entering text on a mobile device via continuous movements, with control based on feedback from a probabilistic language model. Text is represented by continuous trajectories over a hexagonal tessellation, and entry becomes a manual control task. The language model is used to infer user intentions and provide predictions about future actions, and the local dynamics adapt to reduce effort in entering probable text. This leads to an interface with a stable layout, aiding user learning, but which appropriately supports the user via the probability model. Experimental results demonstrate that the application of this technique reduces variance in gesture trajectories, and is competitive in terms of throughput for mobile devices. This paper provides a practical example of a user interface making uncertainty explicit to the user, and probabilistic feedback from hypothesised goals has general application in many gestural interfaces, and is well-suited to support multimodal interaction.<BR/> <BR/> Technical Report Number: TR-2003-147

• Item Type: UNSPECIFIED
• Status: Published
• Glasgow Author(s) Enlighten ID: Murray-Smith, Professor Roderick and Williamson, Dr John
• Authors: Williamson, J., and Murray-Smith, R.
• Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
• College/School: College of Science and Engineering > School of Computing Science