Multimodal trajectory playback for teaching shape information and trajectories to visually impaired computer users

Crossan, A. and Brewster, S.A. (2008) Multimodal trajectory playback for teaching shape information and trajectories to visually impaired computer users. ACM Transactions on Accessible Computing, 1(2), (doi:10.1145/1408760.1408766)

Full text not currently available from Enlighten.

Publisher's URL: http://doi.acm.org/10.1145/1408760.1408766

Abstract

There are difficulties in presenting nontextual or dynamic information to blind or visually impaired users through computers. This article examines the potential of haptic and auditory trajectory playback as a method of teaching shapes and gestures to visually impaired people. Two studies are described which test the success of teaching simple shapes. The first study examines haptic trajectory playback alone, played through a force-feedback device, and compares performance of visually impaired users with sighted users. It demonstrates that the task is significantly harder for visually impaired users. The second study builds on these results, combining force-feedback with audio to teach visually impaired users to recreate shapes. The results suggest that users performed significantly better when presented with multimodal haptic and audio playback of the shape, rather than haptic only. Finally, an initial test of these ideas in an application context is described, with sighted participants describing drawings to visually impaired participants through touch and sound. This study demonstrates in what situations trajectory playback can prove a useful role in a collaborative setting.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Brewster, Professor Stephen and Crossan, Dr Andrew
Authors: Crossan, A., and Brewster, S.A.
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
College/School:College of Science and Engineering > School of Computing Science
Journal Name:ACM Transactions on Accessible Computing
Publisher:Association for Computing Machinery, Inc.
ISSN:1936-7228
ISSN (Online):1936-7236

University Staff: Request a correction | Enlighten Editors: Update this record