Do That, There: An Interaction Technique for Addressing In-Air Gesture Systems

Freeman, E. , Brewster, S. and Lantz, V. (2016) Do That, There: An Interaction Technique for Addressing In-Air Gesture Systems. In: CHI 2016, San Jose, CA, USA, 7-12 May 2016, (doi: 10.1145/2858036.2858308)

116617.pdf - Accepted Version



When users want to interact with an in-air gesture system, they must first address it. This involves finding where to gesture so that their actions can be sensed, and how to direct their input towards that system so that they do not also affect others or cause unwanted effects. This is an important problem [6] which lacks a practical solution. We present an interaction technique which uses multimodal feedback to help users address in-air gesture systems. The feedback tells them how (“do that”) and where (“there”) to gesture, using light, audio and tactile displays. By doing that there, users can direct their input to the system they wish to interact with, in a place where their gestures can be sensed. We discuss the design of our technique and three experiments investigating its use, finding that users can “do that” well (93.2%–99.9%) while accurately (51mm–80mm) and quickly (3.7s) finding “there”.

Item Type:Conference Proceedings
Glasgow Author(s) Enlighten ID:Brewster, Professor Stephen and Freeman, Dr Euan
Authors: Freeman, E., Brewster, S., and Lantz, V.
College/School:College of Science and Engineering > School of Computing Science
Related URLs:

University Staff: Request a correction | Enlighten Editors: Update this record