The effective combination of haptic and auditory textural information

McGee, M.R., Gray, P.D.G. and Brewster, S.A. (2001) The effective combination of haptic and auditory textural information. Lecture Notes in Computer Science(2058), pp. 118-126.



Publisher's URL:


With the increasing availability and quality of auditory and haptic means of interaction, it is not unusual to incorporate many modalities in interfaces rather than the purely visual. The user can be powerfully affected however when information presented in different modalities are combined to become multimodal. Providing interface designers with the means to implement haptic-audio interfaces might result in adverse effects to interaction unless they are also equipped with structured knowledge on how to select effective combinations of such information. This work introduces `Integration of Information' as one important dimension of haptic-audio interaction and explores its effects in the context of multimodal texture perception. The range and resolution of available textures through force feedback interaction is a design consideration that might benefit from the addition of audio. This work looks at the effect of combining auditory and haptic textures on people's judgment of the roughness of a virtual surface. The combined haptic-audio percepts will vary in terms of how congruent they are in the information they convey regarding the frequency of bumps or ridges on the virtual surface. Three levels of integration (conflicting, redundant, or complementary) are described and their possible implications discussed in terms of enhancing texture perception with force-feedback devices. Keywords: Haptic, audio, force-feedback, texture perception, multimodal information processing, intersensory integration.

Item Type:Articles
Keywords:haptic, audio, force-feedback, texture perception, multimodal information processing, intersensory integration
Glasgow Author(s) Enlighten ID:Gray, Mr Philip and Brewster, Professor Stephen
Authors: McGee, M.R., Gray, P.D.G., and Brewster, S.A.
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
B Philosophy. Psychology. Religion > BF Psychology
College/School:College of Science and Engineering > School of Computing Science
Journal Name:Lecture Notes in Computer Science
Publisher:Springer Verlag
Copyright Holders:Copyright © 2001 Springer Verlag
First Published:First published in Lecture Notes in Computer Science 2058:118-126
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record