Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction

Shakeri, G., Williamson, J. H. and Brewster, S. (2017) Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction. In: AutomotiveUI 2017, Oldenburg, Germany, 24-27 Sep 2017, pp. 84-93. ISBN 9781450351508 (doi:10.1145/3122986.3123011)

149034.pdf - Accepted Version



This paper presents an investigation into the effects of different feedback modalities on mid-air gesture interaction for infotainment systems in cars. Car crashes and near-crash events are most commonly caused by driver distraction. Mid-air interaction is a way of reducing driver distraction by reducing visual demand from infotainment. Despite a range of available modalities, feedback in mid-air gesture systems is generally provided through visual displays. We conducted a simulated driving study to investigate how different types of multimodal feedback can support in-air gestures. The effects of different feedback modalities on eye gaze behaviour, and the driving and gesturing tasks are considered. We found that feedback modality influenced gesturing behaviour. However, drivers corrected falsely executed gestures more often in non-visual conditions. Our findings show that non-visual feedback can reduce visual distraction significantly

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Shakeri, Dr Gozel and Brewster, Professor Stephen and Williamson, Dr John
Authors: Shakeri, G., Williamson, J. H., and Brewster, S.
College/School:College of Science and Engineering > School of Computing Science
Publisher:ACM Press
Copyright Holders:Copyright © 2017 ACM
Publisher Policy:Reproduced in accordance with the copyright policy of the publisher

University Staff: Request a correction | Enlighten Editors: Update this record

Project CodeAward NoProject NamePrincipal InvestigatorFunder's NameFunder RefLead Dept
670071HappinessStephen BrewsterEuropean Commission (EC)645145COM - COMPUTING SCIENCE